JP2019166311A - Swing determination device, swing determination method and program - Google Patents

Abstract

To provide a swing determination device capable of supporting the improvement of golf swing in a short term.SOLUTION: A swing determination device comprises: input means for inputting a moving image capturing a swing of a user; generation means for decomposing the moving image input from the input means to generate user images as still pictures; identification means for identifying user images including a plurality of attention points which represent points to which attention should be paid when determining the quality of a swing, from a plurality of user images generated by the generation means; a plurality of determination means for determining the quality of a swing by comparing the user image including the prescribed attention points identified by the identification means with a teacher image as an image of a teacher swing being a comparison object; and output means for outputting determination results from the plurality of determination means.SELECTED DRAWING: Figure 128

Description

  The present invention relates to a swing determination device, a swing determination method, and a program.

It usually takes a lot of training, a lot of time and money to get to the level where golf seems fun. This is a big wall for those who start golf. Even if a beginner starts playing golf and goes to the course, it will be necessary to go to a practice field until they can play happily.

  In the past, there was a golf support image shooting system at a driving range, and it was necessary to analyze his own swing by himself. It was also true that there was no chance or support for going to a golf school even if they were interested in it.

  Also, even if you go to a golf school, the swing theory taught by lesson professionals can be taught by the school and teachers in various ways. , “Do not face rotation”, “turn your shoulders”, “twist your hands”, “try”, etc. There is no explanation of what is better and how it leads to a reproducible swing.

  This makes it difficult to know what series of golf swings should be aimed at. Even if he struggles and spends a lot of money and a lot of practice time, he is not able to enjoy golf. Another problem is that the current salary has declined and the young office workers and students are less likely to start playing golf.

  In this connection, Patent Document 1 provides a sensor that can measure acceleration, angular velocity, and angle in three axes in the vicinity of the golf club, and swings that aim at the time index of address, top, and impact from the three measurement results. An analysis method has been proposed.

  By determining the address, top, and impact time, it can be evaluated that the ideal swing analysis advances one step, and if the golfer confirms the time the hitting distance will be extended. I want a way to find it quickly and a swing analysis technology that goes one step further.

  Further, Patent Document 2 proposes a speech learning apparatus that learns a predetermined operation of a golf swing in real time during operation using speech.

  Real-time learning can be evaluated as an aid to beginner swing improvement. However, I would like to see specific details and guidance when the voice is generated. Furthermore, it is better if there are specific cases of sound generation in different scenes.

JP2017-159087 JP2017-136308

  Therefore, in order to stop golf enthusiasts who want to stop golfing for the reasons mentioned above, it is necessary to propose a system that supports non-golfers and golfers to improve their golf swing at any time and anywhere. Become.

  Then, you can work on mastering a systematic golf swing mainly based on the wide right side space area that amateurs should aim for, and make it a simple golf swing that is inexpensive and highly reproducible in a short time. Master shot technology.

  An object of this invention is to provide the swing determination apparatus, the swing determination method, and program which assist so that the swing including a golf swing can be improved in a short time.

The swing improvement support system according to the present invention includes an input unit that inputs a moving image obtained by imaging a user's swing, and a generating unit that decomposes the moving image input from the input unit into frames to generate a user image as a still image. Specifying means for specifying the user images each including a plurality of points of interest, which are points to be noted when determining the quality of a swing, from among the plurality of user images generated by the generation unit; A plurality of determination means for comparing the user image including the predetermined attention point specified by the means, a teacher image as a model swing image of the teacher, and comparing the user image to determine whether the swing is good or bad; Output means for outputting determination results by a plurality of the determination means.
According to such a configuration, it is possible to assist so that the swing can be improved in a short time.

Further, according to the present invention, the determination unit includes a neural network, and the quality of the swing is determined by performing learning processing by deep learning on the neural network using the teacher image including a predetermined attention point. It is characterized by doing.
According to such a configuration, the determination can be performed with high accuracy by using deep learning.

In the invention, it is preferable that the neural network scores the quality of the swing with respect to a predetermined attention point by multi-class classification.
According to such a configuration, more accurate advice can be given by classifying the swing features into a plurality of features.

Further, the present invention is characterized in that the neural network performs learning using a teacher image as an example of a bad form as the teacher image.
According to such a configuration, on the other hand, features with poor swing can be identified with high accuracy based on the teacher image.

Further, the present invention is characterized in that the output means outputs advice corresponding to the corresponding teacher.
According to such a configuration, on the other hand, based on the teacher image, it is possible to identify a feature with a poor swing and provide appropriate advice.

In the invention, it is preferable that the neural network operates by an R2D2 algorithm having a learner and a plurality of actors.
According to such a configuration, the quality of the swing can be determined with higher accuracy by the R2D2 algorithm.

Further, the present invention is a teacher image as a model swing image of a teacher, a teacher image in which a feature point of the teacher's body is specified, and information on the attention point of the swing in the teacher image, A storage unit for storing; a specifying unit for specifying a feature point of the user's body in the user image obtained by the generating unit; and a plurality of the user images in which the feature point is specified, Extracting means for extracting the user image corresponding to the teacher image; and adjusting means for adjusting the user image extracted by the extracting means so as to be comparable to the teacher image with reference to the feature points; The determination unit compares the attention points of the user image adjusted by the adjustment unit and the teacher image, and determines whether the user's swing is good or bad. It is characterized in.
According to such a configuration, it is possible to more accurately determine whether the swing is good or bad.

Further, in the present invention, when the feature amount at the attention point between the user image and the teacher image is different by a predetermined threshold or more, the determination unit determines that the attention point is NO, Otherwise, it is determined to be good.
According to such a configuration, the quality of the swing can be determined easily and accurately with reference to the threshold value.

Further, the present invention is characterized in that the determination means scores the quality of a swing according to a difference in feature amount at the attention point between the user image and the teacher image.
According to such a configuration, the quality of the swing can be accurately determined based on the difference from the teacher image.

The present invention further includes a calculation unit that has a weighting factor for each point of interest, and that calculates a swing score by cumulatively adding the weighting factor to the determination result of each determination unit, and the output unit includes: The score calculated by the calculation means is also output together.
According to such a configuration, a comprehensive evaluation of the swing can be obtained by referring to the score.

According to the present invention, the swing is a golf swing, and the weighting coefficient is changed so as to be correlated with at least one of the user's motion, score, handicap, flight distance for each club, and head speed for each club. It further has a change means.
According to such a configuration, more accurate determination and advice can be obtained by increasing the correlation with actual golf.

Further, according to the present invention, the swing is a golf swing, and the determination means relatively increases a value of the weighting coefficient of the user's right side space region, thereby determining the user's right side space region. It is characterized by preferential evaluation.
According to such a configuration, it is possible to give more accurate advice to a beginner.

Further, the present invention provides a state specifying unit for specifying the state of the user's swing based on a determination result by the determining unit, and an advice according to the state of the user's swing specified by the state specifying unit, Presenting means for presenting via the output means.
According to such a configuration, it is possible to present appropriate advice according to the swing state.

In addition, the present invention is characterized in that when there are a plurality of the advices, the presenting means has a determining unit that determines the order in which the plurality of advices are presented.
According to such a configuration, the swing can be efficiently improved by presenting advice in a more appropriate order.

Further, the present invention is characterized in that the determining means determines an order in which the advice is presented by reinforcement learning.
According to such a configuration, advice can be presented in a more appropriate order by reinforcement learning.

Further, according to the present invention, the determination means gives a reward when the user's swing state is improved when the advice is presented, and updates the Q value according to the reward, thereby performing reinforcement learning. It is characterized by performing.
According to such a configuration, reinforcement learning can be executed more efficiently.

In addition, the present invention includes a head mounted display, smart glasses, or at least one external smart display used by the user, and the head mounted display, the smart glasses, or the external smart display. And a display means for displaying a golf course landscape and a multi-directional swing of the user, and changing the displayed landscape in accordance with the user's operation.
According to such a configuration, the swing can be practiced without going to the golf course or the driving range.

Further, the present invention obtains from the storage means a reception means for receiving the user inquiry, a storage means for storing a response to the inquiry, and a response corresponding to the inquiry received via the reception means, Presenting means for presenting to a user.
According to such a configuration, the user's questions regarding the swing can be solved.

Further, the present invention provides a generation step of generating a user image as a still image by decomposing a moving image input from the input means into a frame, and a swing from a plurality of the user images generated in the generation step. A specifying step for specifying the user images each including a plurality of attention points that are points to be noted when determining the quality of the user, the user image including the predetermined attention points specified in the specifying step, and a comparison target A plurality of determination steps for determining whether or not the swing is good by comparing a teacher image as a swing image of the teacher to be output, and an output step for outputting the determination results in the plurality of determination steps .
According to such a method, it is possible to assist so that the swing can be improved in a short time.

Further, the present invention provides an input means for inputting a moving image obtained by imaging a user's swing, a generating means for generating a user image as a still image by decomposing the moving image input from the input means into frames, and the generation A specifying unit that specifies the user image including each of a plurality of points of interest that are points to be noted when determining whether or not the swing is good, from the plurality of user images generated by the unit; A plurality of determination means for comparing the user image including the predetermined attention point and a teacher image as an image of the swing of the teacher to be compared to determine the quality of the swing, and the determination results by the plurality of determination means It functions as an output means for outputting.
According to such a program, it is possible to assist so that the swing can be improved in a short time.

  The present invention can provide a swing determination device, a swing determination method, and a program that support golf swing improvement in a short time.

It is a figure which shows the structural example of 1st Embodiment of this invention. It is a figure in which stance is closed and it is determined as OK. It is a figure in which the stance is determined to be NG due to square or open. It is a figure in which the waist and shoulder lines in the stance are determined to be OK. It is a figure judged with a hook grip being OK. It is a figure judged with OK by the grip of overlapping It is a figure judged with OK with a ten finger grip. It is a figure judged with NG by a square grip. It is a figure judged with NG by a weak grip. It is a figure judged with NG by the grip of interlocking It is a figure in which weight distribution is judged as OK when it is slightly closer to the right foot. It is a figure by which weight distribution is determined to be OK at 5: 5. It is a figure in which weight distribution is judged as NG by the left foot. It is a figure in which it is determined that the stance width is a little wider than the shoulder width. It is a figure in which stance width is too wide and it is determined as NG. It is a figure in which stance width is too narrow and it is determined as NG. It is a figure in which the shoulder line and the vertical of the head are determined to be OK. It is a figure by which a shoulder line and the perpendicular | vertical of a head are determined to be NG. It is a figure by which a shoulder line is determined to be NG. It is a figure by which the direction of a toe and a knee is determined to be OK. It is a figure by which the direction of a toe and a knee is determined to be NG. It is a figure judged with the inclination OK of a club shaft. It is a figure judged with the inclination OK of a club shaft. It is a figure determined with the inclination NG of a club shaft. It is a figure judged with the position of a driver head and a ball OK. It is a figure judged with position NO of a driver head and a ball. It is a figure determined with the position of a large head and a ball OK. It is a figure judged with position NG of a large-sized head and a ball. It is a figure judged with OK of both shoulders and OK. It is a figure in which both shoulders have strength and are determined to be NG. It is a 1st figure by which it determines with the order which puts a left arm on a left chest being OK. It is a 2nd figure by which it determines with the order which puts a left arm on a left chest being OK. It is a 3rd figure by which it determines with the order which puts a left arm on a left chest being OK. It is a figure judged with NG with the left arm beside the body. It is a figure by which the line of a forward inclination and a back muscle is determined to be OK. It is a figure by which the line of a forward inclination and a back muscle is determined to be NG. It is a figure by which it is determined that the knee bending degree is OK. It is a figure by which the bending condition of a knee is determined to be NG. It is a figure by which the bending condition of a knee is determined to be NG. It is the 1st figure judged with face rotation flow OK opening 90 degrees by takeback. It is the 2nd figure judged with face rotation flow OK opening 90 degrees by takeback. It is the 3rd figure judged with face rotation flow OK opening 90 degrees by takeback. It is the 1st figure judged with face rotation flow OK opening 90 degrees by takeback. It is the 2nd figure judged with face rotation flow OK opening 90 degrees by takeback. It is the 3rd figure judged with face rotation flow OK opening 90 degrees by takeback. It is the 4th figure judged with face rotation flow OK opening 90 degrees by takeback. It is the 5th figure judged with face rotation flow OK opening 90 degrees by takeback. It is the 6th figure judged with face rotation flow OK opening 90 degrees by takeback. It is the 1st figure judged with face rotation flow OK opening 90 degrees by takeback. It is the 2nd figure judged with face rotation flow OK opening 90 degrees by takeback. It is the 3rd figure judged with face rotation flow OK opening 90 degrees by takeback. It is the 4th figure judged with face rotation flow OK opening 90 degrees by takeback. It is the 5th figure judged with face rotation flow OK opening 90 degrees by takeback. It is the 6th figure judged with face rotation flow OK opening 90 degrees by takeback. It is the 1st figure judged with the image OK of the take back face rotation "open 90 degrees and return 180 degrees". It is the 2nd figure judged with the image OK of the take back face rotation "open 90 degrees and return 180 degrees". It is the 3rd figure judged with the image OK of the take back face rotation "open 90 degrees and return 180 degrees". It is the 4th figure judged with the image OK of the take back face rotation "open 90 degrees and return 180 degrees". It is the 1st figure judged as image OK of a down swing face rotation "open 90 degrees and return 180 degrees". It is the 2nd figure judged with the image OK of the down swing face rotation "open 90 degrees and return 180 degrees". It is the 3rd figure judged with the image OK of "swing open 90 degree | times and returning 180 degree | times" downswing face rotation. It is the 4th figure judged with the image OK of "swing open 90 degree | times and returning 180 degree | times" downswing face rotation. It is the 1st figure judged with head movement OK during a left 1 axis swing. It is the 2nd figure judged with head movement OK during a left 1 axis swing. It is the 3rd figure judged with head movement OK during a left 1 axis swing. It is a figure judged with weight shift OK from the right at the time of switching from the top to the left. It is a figure which opens with the right side at the time of a top and is determined to be OK. It is a figure by which the appearance of the chest and waist at the time of the top is determined to be OK. It is a figure by which the position of the grip at the time of the top is determined to be OK at an intermediate position between the right ear and the right shoulder. It is a figure in which the right side at the top is tightened and the appearance of the chest and waist is determined to be NG. It is the 1st figure judged with release of the right elbow with the head precedence at the time of a downswing. It is the 2nd figure judged with release of the right elbow in the head precedence at the time of a downswing. It is the 3rd figure judged with right elbow release OK with head precedence at the time of a downswing. It is a figure judged as NG by the swing of the "tame" of the grip preceding the wrist which is hardened by cock. It is a figure by which it is determined that the release and release direction of the right elbow on a large plane during downswing are OK. It is the 1st figure by which it is determined that the release of the right wrist, the right elbow, and the right hand hinge in which the centrifugal force is effective are OK. It is the 2nd figure by which it is determined that the release of the right wrist, the right elbow, and the right hand hinge in which the centrifugal force is effective are OK. It is the 3rd figure by which it is determined that the release of the right wrist, the right elbow, and the right hand hinge with centrifugal force applied are OK. It is the 4th figure by which it is determined that the release of the right wrist, the right elbow, and the right hand hinge with centrifugal force applied are OK. It is the 1st figure judged as NG by the current mainstream type "tickling" swing which can unwind centrifugal force. It is the 2nd figure judged as NG by the current mainstream type "tickling" swing which can unwind centrifugal force. It is the 3rd figure judged as NG by the current mainstream type "Tameru" swing which can unwind centrifugal force. FIG. 10 is a fourth diagram in which it is determined as NG in the current “mainstream” swing that unwinds centrifugal force. FIG. 10 is a fifth diagram in which it is determined as NG in the current mainstream type “swing” swing that unwinds centrifugal force. FIG. 10 is a sixth diagram in which it is determined as NG in the current mainstream type “swing” swing that unwinds centrifugal force. FIG. 10 is a seventh diagram in which the current mainstream type “swing” swing that unwinds the centrifugal force is judged as NG. FIG. 10 is a diagram in which it is determined that the right nail hinge is OK when the thumb nail side is facing toward the user during the downswing. It is the 1st figure judged with NG by the flow which turned the right nail | claw side to the left from the impact at the time of follow and twisted the right hand. It is the 2nd figure judged with NG by the flow which the thumb nail side turned to the left and twisted the right hand from the impact to the follow. FIG. 10 is a diagram in which it is determined to be OK with the head preceding the body movement of the lower body as much as possible. It is a figure judged with NG by the weight shift of the swing lead by the lower body subject. It is a figure judged with "forward" which twists a right elbow a little inside at the time of a downswing start. It is the 1st figure by which it is determined that the twist of the hand whose right hand overtakes the left hand is OK. It is the 2nd figure by which it is determined that the twist of the hand in which the right hand overtakes the left hand is OK. It is a 3rd figure by which it is determined that the twist of the hand in which the right hand overtakes the left hand is OK. It is a figure in which the twist of the hand and the twist of the right foot are determined to be OK. It is a figure by which it is determined that the twist of the hand and the twist of the waist are OK. FIG. 10 is a diagram in which it is determined that the left leg knee is extended without changing the position of the head and the forward tilt posture by the twist of the hand and the vertical twist, and it is determined as OK. It is a figure determined not to change the height of the right shoulder at the time of downswing, but to push the right shoulder forward, but to be OK. FIG. 10 is a diagram in which it is determined that the right hip and the right knee are directed toward the ball without making the right hip / right knee forward when the downswing is performed. It is a figure determined as OK because the right foot kakato is not raised to the impact. It is a figure determined as NG because the right foot is raised by impact. At the time of impact, the face is directed to the ball direction and is a first view in which it is determined to be OK. It is a second view in which the follow after impact is determined to be OK with momentum and the face facing the target. It is the 1st figure which leaves the face forcibly after the impact from the impact and is judged as NG. It is the 2nd figure which leaves the face forcibly after the impact and is determined to be NG even after the impact. It is a figure judged with OK by the image which puts out a little ball to the right. It is the 1st figure of a back strike practice drill. It is a 2nd figure of a back strike practice drill. It is a 3rd figure of a back strike practice drill. It is a 4th figure of a back strike practice drill. It is the 1st figure of a double leg cross practice drill. It is a 2nd figure of a both-legs cross practice drill. It is a 3rd figure of a both-legs cross practice drill. It is a 4th figure of a double leg cross practice drill. It is the 1st figure of a horizontal strike practice drill. It is a 2nd figure of a horizontal strike practice drill. It is a 3rd figure of a horizontal strike practice drill. It is a 1st figure of a reverse holding element swing practice drill. It is a 2nd figure of a reverse holding element swing practice drill. It is the 1st figure of a super closed stance practice drill. It is the 2nd figure of a super closed stance practice drill. It is the 3rd figure of a super closed stance practice drill. It is a 4th figure of a super closed stance practice drill. It is the 1st figure of a split hand practice drill. It is a 2nd figure of a split hand practice drill. It is a 3rd figure of a split hand practice drill. It is a 4th figure of a split hand practice drill. It is a figure which shows the structural example of 2nd Embodiment of this invention. It is a figure which shows the detailed structural example of the determination process part shown in FIG. It is a figure for demonstrating operation | movement of 2nd Embodiment of this invention. It is a figure for demonstrating operation | movement of 2nd Embodiment of this invention. It is a figure for demonstrating operation | movement of 2nd Embodiment of this invention. It is a figure for demonstrating operation | movement of 2nd Embodiment of this invention. It is a figure for demonstrating operation | movement of 2nd Embodiment of this invention. It is a figure for demonstrating operation | movement of 2nd Embodiment of this invention. It is an example of the flowchart for demonstrating operation | movement of 2nd Embodiment of this invention. It is an example of the flowchart for demonstrating operation | movement of 2nd Embodiment of this invention. It is a figure which shows the structural example of 3rd Embodiment of this invention. FIG. 139 is a diagram showing a configuration example of the multilayer neural network shown in FIG. 138. It is a figure which shows the structural example of 4th Embodiment of this invention. It is a figure which shows the structural example of 5th Embodiment of this invention. It is a figure which shows the structural example of 6th Embodiment of this invention.

  Embodiments of the improvement support system of the present invention will be described below with reference to the drawings.

(A) Description of First Embodiment With reference to FIG. 1, a swing progress support system 1 according to the present embodiment will be described. A swing progress support system 1 according to the present embodiment shown in FIG. 1 communicates with a terminal 20 (hereinafter simply referred to as a terminal) 20 such as a smartphone that captures or captures an image of a user 2 swing, and communicates with an image and user information. And an improvement support system side PC 10 that shares the same.

The PC 10 includes a storage unit 101 in which ideal swing information derived from the external shape of the body part of the user 2 is stored in advance, and an image processing unit 102 that stores and processes the swing of the user 2 in a dynamic image or a static image. A communication unit 103 that communicates with the terminal 20, an analysis unit 104 that analyzes an image based on the image processed by the image processing unit 102,
A first determination unit 106 that determines whether or not the stance of the user 2 is within an allowable range;
A second determination unit 107 that determines whether or not the grip of the user 2 is within an allowable range;
A third determination unit 108 that determines whether or not the determination of the stance width and weight distribution of the user 2 is within an allowable range;
A fourth determination unit 109 that determines whether the determination of the shoulder and head lines of the user 2 is within an allowable range;
A fifth determination unit 110 that determines whether or not the orientation determination of the toes and both knees of the user 2 is within an allowable range;
A sixth determination unit 111 that determines whether the determination of the inclination of the club shaft of the user 2 is within an allowable range;
A seventh determination unit 112 that determines whether or not the determination of the position of the driver head of the user 2 is within an allowable range;
An eighth determination unit 113 for determining whether or not the determination of the position where the driver face of the user 2 and the ball are set is within an allowable range;
A ninth determination unit 114 that determines whether the determination of the strength of the posture of the user 2 is within an allowable range;
A tenth determination unit 115 that determines whether or not the determination as to whether the left arm of the user 2 is on the chest is within an allowable range;
An eleventh determination unit 116 that determines whether or not the determination of the forward leaning state of the user 2, the bending of the back muscles, and the bending of the knee are within allowable ranges;
A twelfth determination unit 117 that determines whether or not the determination from the take back of the user 2 to 90 degrees face rotation to the top is within an allowable range;
A thirteenth determination unit 118 that determines whether or not the determination of face rotation of the user 2 that opens 90 degrees and returns 180 degrees is within an allowable range;
A fourteenth determination unit 119 that determines whether or not the determination of the swing axis of the user 2 is within an allowable range;
A fifteenth determination unit 120 that determines whether or not the determination of the right side opening by turning back from the top of the user 2 is within an allowable range;
A sixteenth determination unit 121 that determines whether or not the determination of the appearance of the chest and waist at the top of the user 2 is within an allowable range;
A seventeenth determination unit 122 that determines whether or not the determination of the grip position at the time of top of the user 2 is within an allowable range;
An eighteenth determination unit 123 that determines whether the determination of the release direction of the downswing of the user 2 is within an allowable range;
A nineteenth determination unit 124 for determining whether or not the determination of the hinge action during the downswing of the user 2 is within an allowable range;
A twentieth determination unit 125 that determines whether or not the determination that the user 2 does not turn his / her waist in the downswing and the weight does not move is within an allowable range;
A twenty-first determination unit 126 that determines whether or not the forward determination at the time of turning back from the top of the user 2 is within an allowable range;
A twenty-second determination unit 127 for determining whether or not the twist determination of the user 2 during the downswing is within an allowable range;
A twenty-third determination unit 128 that determines whether or not the determination that the right shoulder falls and the right hip / knee is in front is within an allowable range during a downswing from the turn of the user 2;
A twenty-fourth determination unit 129 that determines whether or not the determination whether the face rises with momentum without following the right foot from the downswing to the impact of the user 2 is within an allowable range;
A twenty-fifth determination unit 130 that determines whether or not the direction of the ball 2 and the determination of the ball of the user 2 are within the allowable range.

The storage unit 101 stores in advance ideal swing information derived from the external shape of the body part of the user 2, that is, the height, the size of the hand, the length of the torso, and the foot. The systemized golf swing lesson information mainly in the wide right side space area may be texts including curriculum and drills, images, lesson videos and lesson still images. There may be.

The image processing unit 102 stores the swing information of the user 2 as a moving image or still image information. In addition, in the case of an unclear image that cannot be determined, the image needs to be corrected. However, an appropriate image quality correction process that should be a clear image that can be determined by the user 2 is performed.

The communication unit 103 is for communicating with the terminal 20. The swing information of the user 2 of the moving image or the still image information is shared with the body of the user 2 and the personal information with the terminal 20. The communication unit 103 may use any of short-range communication, long-distance communication, wireless, and wired communication formats.

The analysis unit 104 and the display unit 105 perform linked communication for analyzing and displaying an image based on the image processed by the image processing unit 102. When image quality correction is required by image analysis, the image processing unit 102 is instructed to correct it.
In addition, the first to 25th determination and advice processing units to be described later are individually processed by the first to 25th determination processings 106 to 130 themselves, but the individual users who are individually determined by the analysis unit 104 In addition, it is possible to understand improvement analysis advice (speech advice & advice by text & advice by image) corresponding to the judgment results of judgment processes 106 to 130 for image analysis of all users, and swing well If it is a user impression that it has been made, it is determined OK. On the contrary, if it is an impression that the user cannot understand in the head or that the swing is not performed well, as a result of the determination of NO, the data of each user of the determination result is the AI image analysis processing unit as the overall big data 150, the AI image analysis processing unit 150 stores the data, and the AI image analysis processing unit 150 stores the AI image as part of the determination processing analysis by the AI or as a total determination processing. A systemized golf swing lesson that is executed by the analysis processing unit 150 and fed back to the analysis unit 104 by sharing the data and is shared with the analysis unit 104 and idealized for a golf swing mainly based on a wide right side space area, Comprehensive judgment, comprehensive judgment, and comprehensive advice in which the integrated data is appropriately stored for each individual user by the AI image analysis judgment processing Under the AI lesson AI image analysis determination process based on the contents of the general lesson, the entire golf lesson support system of the present invention can automatically improve the accuracy of advice to each individual user. AI image analysis processing is performed for sharing.
Further, at the initial stage of the system configuration, all humans do not include the first to 25th determination processes 106 to 130 and the AI image analysis processing unit 150, and humans determine and determine from data from the photographed image and give advice to each individual user. From a simple PC10 system, and from the system in which the PC configuration includes the first to 25th determination processes 106 to 130 in the PC, and the PC10 and the person make determination / determination and give advice to each individual user. The AI image analysis processing unit 150 is included in the configuration, and humans do not make the determination and make the final determination of the first to 25th determination processes by the PC 10, and the AI image analysis processing unit 150 performs the AI determination analysis. The AI image analysis processing unit 150 executes the partial determination or the total determination analysis as a whole, and uses the AI image analysis determination process at the same time to perform the comprehensive determination. It is assumed that can also be a good system.
First determination unit 106, second determination unit 107, third determination unit 108, fourth determination unit 109, fifth determination unit 110, sixth determination unit 111, seventh determination unit 112, 8 determination unit 113, 9th determination unit 114, 10th determination unit 115, 11th determination unit 116, 12th determination unit 117, 13th determination unit 118, 14th determination unit 119, 15th. Determination unit 120, sixteenth determination unit 121, seventeenth determination unit 122, eighteenth determination unit 123, nineteenth determination unit 124, twentieth determination unit 125, twenty-first determination unit 126, twenty-second determination unit Specific description of each process performed by the determination unit 127, the 23rd determination unit 128, the 24th determination unit 129, and the 25th determination unit 130 will be described later.

The terminal 20 such as a smart phone is capable of inputting the body information of the user 2 and selecting the information. The imaging unit 201 captures or captures the swing of the user 2, the communication unit 202 communicates with the PC 10, and the PC 10 can input the body information of the user 2. The button 203 can be pressed down in the direction of up, down, left and right, and the button itself can be moved, and the transmitter 203 can send the advice sound, voice advice, text advice, and image advice to the user 2 204, a vibration unit 205 that vibrates and sends a advice to the user 2, and a reserve 206 for newly adding a function.

The imaging unit 201 acquires the swing of the user 2 as an image. The images may be one continuous static image or a moving image. This is saved for the user 2 to check his / her swing, or for the golf lesson support system and the PC 10 to check.

  The communication unit 202 communicates with the PC 10 and shares user 2 information. Further, the swing information and images of the user 2 acquired by the photographing unit 201 are shared. The communication unit 202 may use any short-range communication, long-range communication, wireless, or wired communication format.

  The display unit 203 allows the user 2 to input physical information and displays information. Physical information includes lesson membership number, nationality, name, gender, height, torso and foot length, foot size, club information, 7I and average flight distance of drivers. The user 2 can select items such as sex, country, club to be used, 7I and the average flight distance information of the driver displayed on the display unit 203, and the button operation can be pushed down in the up, down, left, and right directions. . Enter numbers for height, torso and foot length, foot size, and the average flight distance of 7I and the driver.

The transmitting unit 204 is an ideal closed stance region range of a golf swing mainly composed of a systemized wide right side space region that is stored in the storage unit 101 by the first to 25th determination processing units of the PC 10. If the swing of the user 2 is out of the range and it is determined NO, or after the user 2 makes one swing, the swing is out of the range and any of the first to 25th determination processing units determines NO When the determination is made, the transmission unit 204 transmits a advice sound & voice advice & text advice & image advice to the user 2.

The transmitting unit 204 can transmit different types of advice sounds to the user 2 depending on the type of each determination unit when the first to 25th determination processing units of the PC 10 determine NO. The type of sound can be selected as a high tone or a low tone, and can also be selected as a melody (song) that the user 2 likes.

The vibration unit 205 can recognize that the transmission unit 204 is not correct when the advice vibration sound is transmitted to the user 2 or when it vibrates alone and the swing of the user 2 is incorrect. In the description to be described later, when the advice sound is transmitted, the vibration unit 205 may vibrate simultaneously with the transmission of the transmission unit 204 or may not vibrate. The user 2, the golf lesson support system side, and the PC 10 can select them using the display unit 203, and may be set in advance.

The large monitor 300 has a large display screen and makes the display screen of the display unit 105 of the PC 10 easier to see. The monitor 300 makes it easier for the golf lesson support system to confirm the user's swing. In addition, a large monitor 400 may be installed to make the display screen of the display unit 203 of the terminal 20 on the user 2 side easier to see. User 2 can easily confirm his own swing. The monitor 400 may be installed in a practice field or in a break room.

Next, details of the swing improvement support system according to the present embodiment will be described focusing on the determination methods performed by the first to twenty-fifth determination units.

(Stance, stance, weight distribution judgment)
The 1st determination part 106 demonstrates a swing progress support system centering on a stance determination process. FIG. 2 is a diagram showing NG with closed stance and C FIG. 3 is NG with square or open stance. FIG. 4 is a diagram showing OK when the stance is closed but the shoulder and waist lines are square with respect to the flying ball line direction.
FIG. 11 is a diagram showing OK by weight distribution in which the weight is slightly on the right foot. FIG. 12 is a diagram showing OK with an equal weight distribution of weight distribution 5: 5. FIG. 13 is a diagram showing NG in the left foot weight distribution. FIG. 14 is a diagram showing OK when the stance width is slightly wider than the shoulder width. FIG. 15 is a diagram showing NG because the stance is wide. FIG. 16 is a diagram showing NG with a narrow stance width.

As shown in FIG. 12, it is preferable that the user 2 has a center of gravity of 5 to 5 for both the left foot and the right foot so that the weight is equal to the left or right.
As shown in FIG. 4, the lines of the hips and shoulders that have been set are made square with respect to the direction of the flying ball without turning to the right.
As shown in FIG. 11 and FIG. 12, the grip position when set is set inside the left thigh, and the stance width is preferably slightly wider than the shoulder width of both the driver and the iron as shown in FIG. . The first determination unit 106 makes an OK determination in these stances and postures. When the user 2 takes a stance, the transmission unit 204 advises the user 2 to make the closed stance described above.
In addition, as shown in FIG. 20, the transmitting unit 204 gives the user 2 the direction of the knees and the toes is not directly in front, and the pelvis moves to the outside with a slight open feeling. Advise you to open your hips and put your weight on the hip joint to make the swing smooth.

  If the first determination unit 106 of the PC 10 determines that these ideal stances are not made based on the image acquired by the photographing unit 201 of the terminal 20, the first determination unit 106 causes the transmission unit 204 of the terminal 20 to transmit the advice sound. . The ideal stance described can be confirmed on the terminal 20 or the monitor 400 as a still image or a moving image as voice guidance or a document. Thereby, it is supported that the user 2 completes an ideal stance.

(Grip judgment)
The improvement support system centering on the determination process of the second determination unit will be described with reference to FIGS. FIG. 5 is a diagram in which the grip is determined to be OK by the hook grip. FIG. 6 is a diagram in which the grip is determined to be OK by overlapping. FIG. 7 is a diagram in which it is determined that the grip is a ten finger and is OK. FIG. 8 is a diagram in which the grip is square and NO is determined. FIG. 9 is a diagram in which the grip is determined to be NO during the week. FIG. 10 is a diagram in which the grip is determined to be NG due to interlocking.

As shown in FIG. 5, it is preferable that three knuckle of the left hand are seen from the user 2 side. If the thumb is a long thumb that extends long, wrist movement is limited. As shown in FIG. 8, it is NG in the case of a square grip or in the case of a weak grip as shown in FIG. 8 With the grip shown in FIG. 9, the second determination unit 107 makes an NG determination, and the transmission unit 204 of the terminal 20 causes the user 2 to transmit a sound of advice. The grip determination by the second determination unit 107 is performed based on an image obtained when viewed from the terminal 20 side. As shown in FIG. 6, the transmission unit 204 advises the user 2 to use the overlapping grip as the basic grip and to make the grip of the right hand. Moreover, the user who comes out of the slice advises to hold the ten finger grip as shown in FIG. As shown in FIG. 5, the transmission unit 204 grips the left hand with a hook grip with the back of the left hand facing up. The hook grip is applied diagonally from the base of the left index finger to the lower bulge of the little finger. From there, place the bulge under the little finger directly above the grip, and place the base of the index finger on the grip. The transmitter 204 is correct if the user 2 sees the grip from directly above, and the line made of the thumb and forefinger points to the right shoulder and three knuckles (fists) on the left hand are visible. It is gripped with a hook grip. The transmission unit 204 advises the user 2 that it is important to grip the grip with a finger (fingertip), not a palm (palm). When you hold it with your fingers, your thumb becomes a short thumb grip. The transmission unit 204 grips the grip of the user 2 from the lower right side with the palm facing up so that the palm of the right hand is aligned with the palm of the left hand. From the base of the index finger to the lower bulge of the little finger, applying the grip diagonally to the palm is the same as the left hand. The transmission unit 204 grasps the user 2 with the little finger of the right hand placed lightly on the index finger of the left hand so that the slightly protruding bone at the base of the thumb of the left hand matches the lifeline of the right hand palm. I will continue. The transmission unit 204 places the thumb 2 slightly shifted to the left side instead of directly above the grip. The correct right hand grip is now complete.
When the transmission unit 204 grips the user 2 in this way, the grip and the palm should not closely contact each other, and an appropriate gap should be formed. If the grip and palm are in close contact, the wrist and elbow will be fixed. By having a gap, you can make better use of the sense of the right hand. The transmission unit 204 has a moderate grip strength for the user 2 as long as the grip strength of the right 10 and left 0 is the iron rule, and the wrist can be softly used and the head can be turned in a circle with the club head. Advise that you are holding.

  When the second determination unit 107 of the PC 10 determines that these ideal grips are not made based on the image acquired by the photographing unit 201 of the terminal 20, the second determination unit 107 causes the transmission unit 204 of the terminal 20 to transmit the advice sound. . The sending unit 204 sends a advice sound to the user 2. The ideal grip described can also be confirmed as a voice guidance or a document as a still image or a moving image on the terminal 20 or the monitor 400. Thereby, it is supported that the user 2 completes an ideal grip.

(address)
The transmission unit 204 determines the address of the user 2 with respect to the user 2, and the eleventh determination unit 116 determines the address of the user 2. As shown in FIG. 38, the address is in a state where the knee is slightly loosened as shown in FIG. 37 from the state where the knee is stretched out as shown in FIG. As shown in FIG. 38, it is not necessary to bend any more, and as shown in FIG. 39, it is advised not to stretch the knee. As shown in FIG. 31 to FIG. 33, the transmitting unit 204 gives the user 2 a wider range of motion by opening the scapula as shown in FIGS. 31 to 33, and the address is conscious of the movement of the left scapula. While turning the left shoulder from the back to the front, raise the left arm up. When the transmitter 204 raises the left arm so that it is perpendicular to the ground, it lowers the user 2 straight so that the left arm is placed on the chest. The transmission unit 204 spreads the left scapula to the user 2 and tightens the left side firmly. Advise to grip and address in this state.

  As shown in FIG. 35, the transmitting unit 204 gives the user 2 a little consciousness to spread the scapula outward from the spine when viewed from the back side, as shown in FIG. Advise that the shoulder blades are rolled up and the scapula widens, and the range of motion of the shoulder joints increases. The sending unit 204 advises the user 2 that the forward tilt at the time of addressing is easy to grasp the sense that the upper body is tilted forward from the hip joint when the club is applied to the base of the leg. The transmitting unit 204 advises the user 2 to tilt forward from the hip joint so that the user 2 becomes a figure of the upper body and the lower body as seen from the back of the flying ball line. The transmission unit 204 advises the user 2 to lean forward without pulling the jaw, as if the hips are sitting on a high chair.

  The transmission unit 204 holds the fourth determination unit 109 with respect to the user 2 as shown in FIG. 17, and the right hand comes down when holding the closed stance, so that the shoulder line of the upper body is held with the right foot weight slightly tilted to the right. The As for the allocation, it is advised to address with a consciousness of putting a lot of weight on the right foot in 6 to 4. As for the transmission part 204, since the shoulder line is lower than the right hand in golf for the user 2, it is natural that both shoulder lines are slightly lowered to the right and the left shoulder is raised. Also tilt slightly to the right. Advise that it is natural that the right foot weight is an address with a slightly lower right shoulder.

  The transmitting unit 204 advises the user 2 that the ball position at the address is the center of the stance from the 7th iron to the PW. Based on this, it is advised to place the ball from the center to the left when the club becomes longer, and to place the ball at a position to the right from the center when the AW or SW becomes shorter than that. The transmission unit 204 advises the user 2 that the seventh determination unit 112 holds the driver head at a position about one head away from the teeed-up ball as shown in FIG. As shown in FIG. 27, the transmitting unit 204 is a face point where the ball is positioned at a point slightly higher than the center of the driver head and slightly above the center of the toe side. Advise to set the ball at that position.

  The fourth determination unit 109 in the PC 10 causes the transmission unit 204 of the terminal 20 to transmit a sound of advice when it is determined from the image acquired by the photographing unit 201 of the terminal 20 that these ideal addresses are not made. . The sending unit 204 sends a advice sound to the user 2. The ideal stance described can be confirmed on the terminal 20 or the monitor 400 as a still image, a moving image, or as a voice or a document. Thereby, the user 2 completes the ideal address almost perfectly. Further, in the swing image determined by the first determination unit 106 and the second determination unit 107, the third determination unit 108 includes a difference regarding the weight distribution of the user 2, a difference regarding the position of the grip, and a stance width. Whether or not the user's address is within the allowable range is determined based on the difference between.

(Takeback)
As shown in FIGS. 40 to 42, FIGS. 43 to 48, and FIGS. 49 to 54, the twelfth determination unit 117 and the thirteenth determination unit 118 are very important points. It is determined whether the face rotation is within an allowable range. The transmission unit 204 starts the swing for the user 2 with the weight distribution that is placed on the right or left evenly or slightly closer to the right foot in the address, the shoulder line is slightly lowered on the right shoulder, and the weight is directed toward the right hip joint. Advise that it is easier to swing if you have an image to move and ride. As shown in FIG. 40 to FIG. 42, FIG. 43 to FIG. 48, and FIG. 49 to FIG. The swing of the take-back is started in the direction of 45 degrees right diagonally forward using the weight shift of the right hand, and when the grip passes in front of the right knee, hinge is used mainly by the right hand (the left hand is induced by the right hand hinge) Advise to lift the club up. At this time, the meaning of taking back in the direction around 45 degrees diagonally right forward is that if you take the takeback straight or inside, it will be easy to be outside inside, and if you take back in the direction around 45 degrees diagonally forward, it will be downswing. This is because it becomes easier to enter from inside. Most people think that the golf swing is the same as the takeback track and the downswing track, but the correct answer is that the golf swing is a little eight. That is. There are a lot of people who aren't aware of this, and lesson professionals don't teach it. Advise that this is an important point. The transmission unit 204 has an image of rotating the body on the right hip joint by completing a face rotation that opens 90 degrees with the ground and the club about horizontal for the user 2, integrating the right side and backswinging. Advise to have.

  As shown in FIGS. 55 to 58 and FIGS. 59 to 62, the twelfth determination unit 117 and the thirteenth determination means 118 can perform “back 90 degrees and return 180 degrees” take-back and face rotation of downswing. If it is determined that it is not, the transmitting unit 204 transmits a warning sound to the user 2. Thereby, the user 2 completes an ideal address, an ideal backswing start, and an ideal face rotation “open 90 degrees and return 180 degrees”.

  The fourth determination unit 109, the sixth determination unit 111, the seventh determination unit 112, the eighth determination unit 113, the ninth determination unit 114, the tenth determination unit 115, and the eleventh determination unit 116 of the PC 10. When the twelfth determination unit 117 and the thirteenth determination unit 118 determine that these ideal addresses and swing start have not been performed based on the images acquired by the photographing unit 201 of the terminal 20, The sending unit 204 sends a sound of advice. The described ideal address, swing start, can be confirmed on the monitor 400 or the terminal 20 as a moving image or as a document. Thereby, the user 2 completes the ideal address and takeback swing almost perfectly.

(Top, cut back)
The transmission unit 204 provides the user 2 with the fourteenth determination unit 119 and the fifteenth determination unit 120 as shown in FIGS. 63 to 65, 66, and 67, and as shown in FIGS. 204 advises the user 2 to raise the club to the top as high as possible with the right hand so that the right shoulder and waist are also rotated to the right together with the hand passing the front of the right knee in the takeback. As shown in FIG. 65, when the transmitting unit 204 puts weight on the right hip joint firmly at the top with respect to the user 2, the right side is mainly integrated, and the body is rotated on the right hip joint so as to be lowered. The image of swinging is boiling. As shown in FIG. 67, the transmission unit 204 advises the user 2 to open the right side without tightening when turning back from the top and to become a flying elbow with the right elbow floating. As shown in FIG. 66, the transmitting unit 204 moves the weight on the right toe linearly toward the base of the left big toe with the club in the top position, as shown in FIG. Advise to cut back with the image to be made. The transmission unit 204 advises the user 2 that if the user moves his body weight slightly from right to left by turning back, the club will come down naturally even if the hand is left untouched, so that the turning will be smooth. . As shown in FIG. 68, the transmitting unit 204 provides the user 2 with a 16th determination unit 121 and a 17th determination unit 122 so that the lower body of the chest and the waist can be firmly seen at the top. The transmitter 204 allows the user 2 to clearly see the lower body of the chest and waist at the top, and the grip is positioned between the right ear and the right shoulder so that the position rises to the middle position between the right ear and the right shoulder. When taking back, it is advised to adjust the angle of the takeback angle that goes diagonally forward to the right and the degree of pulling behind the right foot in a closed stance.

The fourteenth determination unit 119, the fifteenth determination unit 120, the sixteenth determination unit 121, and the seventeenth determination unit 122 are within the range in which top and reversal can be permitted by the image acquired by the photographing unit 201 of the terminal 20. If it is determined that there is not, the advisory sound is transmitted to the transmitter 204 of the terminal 20.

(Down swing)
As shown in FIGS. 59 to 62 and FIGS. 70 to 72, the transmitting unit 204 sends the user 2 to the user 2. Thus, it is advised that the conventional operation of making the swing of the downswing is unnecessary at all because the centrifugal force is loosened. As shown in FIG. 70 to FIG. 72, the transmitting unit 204 immediately extends the right elbow straight and releases it so that a fishing rod is thrown, and draws a larger swing arc. I ’m going to move the club head down. As shown in FIG. 91, the transmitter 204 sends the user 2 with the right elbow straight and releases it while twisting the right elbow slightly inward. Face rotation starts smoothly when you put in the action to start closing. Advise that with this momentary downswing, if this preparatory action is not put forward, the impact will not be met. The user 2 can catch the ball in a gentle trajectory with the right side as the main subject. As shown in FIG. 74, the transmission unit 204 advises the user 2 that the club can be moved down by a downswing at a position where the head acceleration zone can be lengthened by lowering the club diagonally to the right. .

As shown in FIG. 75 to FIG. 78 and FIG. 86, the transmitting unit 204 sends the user 2 to the 19th judging unit 124. As shown in FIGS. Hinging from the side to the palm side, centrifugal force works, and this hingeing action advises that the nail side of the thumb swings down, impact, and follow while facing the direction of one's own direction. The transmission unit 204 advises the user 2 to make an impact with an image in which a virtual ball is in front of one ball. The transmission unit 204 advises the user 2 that the left hand only needs to be attached so as not to disturb the swing. The transmission unit 204 advises the user 2 that the downswing also has an impact mainly with the right hand. As shown in FIGS. 87 to 88, the transmission unit 204 twists the right hand because the thumb nail side does not face toward you but turns to the left side by rolling the wrist as shown in FIGS. 87 to 88. Advise not to never.

The sending unit 204 advises the user 2 that the essence of the swing mainly in the right side area is that only the arm and the club are moving from downswing to impact and follow-through by not moving the trunk. . As shown in FIGS. 92 to 94, the transmitting unit 204 is only for the right hand and the left hand is attached to the club. In order to succeed in the “twist” of the swing, with the image of “do not move the waist” and “do not raise the right foot with the right foot strongly against the ground” “When turning back and entering the downswing, straighten the right elbow Release the club diagonally to the right. "At the same time, with the image of the right hand overtaking the left hand in a downswing, the face rotation is done with the right hand leading grip." "The right hand completely overtakes the left hand in front of the impact." `` I will push the club head further and run through the impact zone at once '' `` If the left hand that is overtaken folds the wrist to the back side and simultaneously swipes the left elbow, all the energy of the right hand is transmitted to the club head '' To advise. The transmission unit 204 advises the user 2 that the user 2 can swing with his / her hand without moving his / her waist, and that the twist is applied and the user 2 is successful.

(Impact)
The transmitting unit 204 is ideal for the user 2, and the twentieth determining unit 125 is ideal for the right knee, right waist, and right shoulder, as shown in FIG. Advise that you can convey the maximum power to the ball if you push the image. As shown in FIG. 89, the transmitting unit 204 is not aware of weight shift, does not move without turning the waist, and has an impact that the chest is facing backwards. To do. As shown in FIG. 90, the transmission unit 204 advises the user 2 not to move the weight of the swing lead mainly in the lower body at the time of impact. As shown in FIGS. 100 and 101, the transmission unit 204 advises the user 2 that the power is fully opened by having the consciousness not to raise the right foot heel in the impact. The transmitting unit 204 is directed to the user 2 at the time of impact, as shown in FIGS. 98 to 99, the 23rd determination unit 128 does not put out the right knee in the impact and directs the right knee toward the ball. Advise to have. As a result, the transmission unit 204 has an axis on the right side for the user 2 and the heel does not float. Advise that if you synchronize the movement of your right shoulder with the movement of your right knee, you can swing with the right side integrated.

The eighteenth determination unit 123, the nineteenth determination unit 124, the twentieth determination unit 125, the twenty-first determination unit 126, the twenty-second determination unit 127, and the twenty-third determination unit 128 are included in the photographing unit 201 of the terminal 20. If it is determined from the acquired image that these ideal downswings and impact swings have not been made, the sending unit 204 of the terminal 20 is caused to send a advice sound. The ideal address described above, the swing at the time of impact from the top, and the swing at the time of downswing can be confirmed on the monitor 400 or the terminal 20 as a moving image or as a document. As a result, the user 2 switches back from the ideal top almost completely, and the swing of downswing and impact is completed.

(Follow)
The sending unit 204 advises the user 2 that the point of follow is how to swing out the momentum of the club head that has been accelerated from the downswing to the impact without killing. As shown in FIGS. 104 to 105, the transmission unit 204 does not need to have an image of forcing the user to leave a face like a conventional swing as shown in FIGS. 104 to 105. The 24th determination unit 129 As shown in FIG. 102, the image that leaves the head is up to the moment of impact. As shown in FIG. 103, the follower pushes the body on the right side by impact and moves the face to the target direction so as to follow the head together. Advise to raise towards The transmission unit 204 advises the user 2 that the so-called look-up hitting method can transmit power to the ball without the club head decelerating during follow-up.

  As shown in FIG. 106, the transmitting unit 204 swings out the club 2 and the body in synchronization with the movement of the body with the image of the right half of the body facing the target direction, as shown in FIG. Advise. Advise that the face rotation is natural if the right-hand hinge movement is correct. The sending unit 204 advises the user 2 that the face toe is pointing up and the nail side of the thumb of both hands is pointing toward the user when following, and always imagines the form of this follow. Advise that is important.

(finish)
The transmission unit 204 gives the user 2 “All right if it's finished” and the finish unites the right side and puts the follow in the image of pushing in the target direction. Advise to get a finish with a single left foot. Ideally, for the transmission unit 204, the right side of the user 2 should come out as far as the right shoulder points in the target direction. When the transmitter 204 can swing the user 2 using the right side firmly, the grip will be in a low position at the finish. As a rule of thumb, if the grip is about the height of the left ear, we advise OK. If it is much higher than the left ear, advise that it is evidence that the left side is still conscious.

(Driver swing)
The sending unit 204 advises the user 2 that the driver is the longest of the 14 clubs and the head is large, so if you hit it like an iron, it will inevitably be delayed and the face will open easily with impact. . The transmitting unit 204 increases the swing arc for the user 2 to increase the run distance for returning the face to the square, and at the same time, the incident angle of the head with respect to the ball becomes gentle, and the impact zone is low and long. Advising you that the probability of catching with the core increases, and unnecessary backspin can be reduced.

  For the driver who has the length of the club, the transmission unit 204 is set a little farther from the ball than the iron. The swing plane is flat and the head trajectory is gentle. The transmission unit 204 advises the user 2 to hold the club head 15 cm away from the ball so that the shaft and the left arm are straight. Since the ball position comes to the left of the center of the body in the driver with respect to the user 2, the transmitting unit 204 is located at the front of the right shoulder when the head is placed on the ball. Advise that the shaft and the left arm are straightened 15cm apart and the address becomes square, and the impact image after the lowest point will be easy to boil.

  The transmission unit 204 advises the user 2 that there is a difference in grip pressure at the top between a driver who wants to earn a flight distance and an iron that emphasizes directionality. The transmission unit 204 advises the user 2 that the driver needs to loosen the grip pressure further than the iron if it is an important driver how to run the head. The transmitting unit 204 advises the user 2 that attention is necessary because the left hand-dominated swing tends to occur especially when the left hand pressure is stronger than the right hand. The transmission unit 204 advises the user 2 to grasp the three fingers from the little finger to the middle finger of the left hand so loosely that the club can play in the palm of the hand at the top. The transmitting unit 204 feels that the club is on the palm of the right hand at the top to the user 2, and removes the consciousness by grasping the left hand as gently as possible. This is a tip for a right-side swing.

  The transmitting unit 204 advises the user 2 that the driver imagines a virtual ball 15 cm before the actual ball and swings with the consciousness of hitting the ball. The transmission unit 204 advises the user 2 that this image can prevent a mistake that the head comes down from a lower position and the face opens. The transmission unit 204 advises the user 2 that the impact is reached when the head passes the lowest point and starts to rise, so that it becomes a trajectory with high launch and low spin.

  The sending unit 204 has always been told by the user 2 that “leave your head until follow-up” as a common sense in swing theory. However, I advise that this is a major reason that has hampered amateur progress. If the sending unit 204 tries to leave the head forcibly after the impact on the user 2, the natural movement of the body will be braked, and the head will hit the ball with the tip of the hand, which will be the only swing at the end. To advise. The transmitting unit 204 raises the face toward the target direction at once for the user 2 without impacting the body rotation after the impact. Advise that the heads rotate together to accelerate the head further and swing it all the way to the finish. The transmission unit 204 advises the user 2 that if the follower has an image of chasing the head with his / her eyes, the head smoothly swings out.

(Practice drill)
The transmitting unit 204 advises the user 2 to swing with a one-handed drill, holding a 7 iron with one right hand, and swinging the club using only the right half from the center of the body. . The transmission unit 204 advises the user 2 that it is also an effective practice method to stab a rubber tee at the practice field and stab it at the turf and hit it. The transmission unit 204 advises the user 2 that when the tee can be successfully hit with one right hand, the ball 2 is actually placed and hit. The point that should be conscious of the 7I right hand drill for the user 2 with respect to the user 2 is that the transmitting unit 204 moves the right side as one body, and if only the body or hand is preceded by a downswing, the ball with one hand Advise that it cannot be accurately captured. The transmission unit 204 advises the user 2 that it is an image that moves the entire right side in synchronism without trying to hit the ball with only the hand. The transmission unit 204 advises the user 2 not to change the feeling of hitting with one right hand even when hitting the club with both hands.

As shown in FIGS. 107 to 110, the transmission unit 204 advises the user 2 that the back-drilled drill is a drill that allows the user to learn how to fold the left elbow and use the right side well. The transmitting unit 204 first advises the user 2 as a drill that strikes the ball in the direction of the back in such a state that the user 2 stands with the back completely facing the target direction. The first purpose of the transmission unit 204 to perform drilling on the user 2 is to learn how to use the left elbow. Advising to use the left elbow does not mean swinging around the left side, but advises that it is a drill that learns how to use the left elbow so as not to disturb the movement of the right hand. The transmission unit 204 advises the user 2 that, when actually hitting the back side, the left elbow is obstructed like a stick and it is difficult to swing out the club in the target direction. The transmission unit 204 advises the user 2 that the movement of folding the left elbow is necessary in order to swing the head in the target direction by the swing mainly on the right side. The sending unit 204 can naturally learn how to fold the left elbow when it hits the back of the user 2 in this state, and in this state, the head is left behind, the face is turned to the left, and the ball is moved in the target direction. If it can be launched straight up, it is advised that it is evidence that the right side can be used successfully.

As shown in FIGS. 111 to 114, the transmission unit 204 advises the user 2 that a drill that strikes with the right foot and the left foot crossed should have a sense of using the right side as a subject. The calling unit 204 places the ball on the left side for the user 2. Of course, full shots are not possible, so I advise you to use half-shots or shoulder-to-shoulder three-quarter shots. The transmitting unit 204 advises the user 2 to try hitting the ball with his legs crossed without first being conscious of anything. The transmission unit 204 advises the user 2 that if the balance is lost due to follow-up, it is evidence that the swing is mainly performed on the left side. The transmitting unit 204 advises the user 2 that when the legs are crossed, it is difficult to rotate the body to the left. The transmission unit 204 does not rotate the left side mainly with respect to the user 2, but moves the right side in the target direction with an image of directing the front of the body toward the target without shaking with the hand. Advise that the right side can be integrated and the follow-up can be done without losing balance by feeling the swing axis on the right hip joint.

As shown in FIGS. 115 to 117, the transmitting unit 204, as shown in FIGS. 115 to 117, has a horizontal swing drill with a driver as usual, holding the driver as usual, so that the head passes just about the height of the chest. Advise to swing horizontally. The transmitting unit 204 looks at the user 2 by hitting the head cover placed at the chest level at this time with the head. Perhaps most people advise that they should pass underneath the head cover. The transmission unit 204 advises the user 2 that if the swing is mainly based on the left hand, the right hand is often lower than the left hand, so that the head is lowered from the position where the user is about to swing. . The transmission unit 204 advises the user 2 that, if this occurs in an actual swing, it will naturally cause the player to hit the front of the ball. The transmitting unit 204 advises the user 2 that the right shoulder is always lower than the left hand during the swing and the right shoulder is not lowered and the head can be hit without falling. The transmission unit 204 advises the user 2 that the height through which the head passes can be freely controlled by learning the swing using the right hand with the drill.

  As shown in FIG. 118 to FIG. 119, the transmission unit 204 is a drill that swings with the club reversed as shown in FIGS. 118 to 119. Advise that the drill is held with one right hand instead of both hands. The transmission unit 204 advises the user 2 that this drill is a drill for memorizing the movement of hinges as to why the right hand is one. The transmitting unit 204 advises the user 2 that cocking that moves the left hand vertically and hinged that moves the right hand so that it folds to the back or palm side is the correct role and usage. The transmission unit 204 advises the user 2 that if the user raises the right palm upward with a backswing, the user can understand that the club cannot be placed in the correct position at the top. The transmission unit 204 advises the user 2 that if the right-hand hinge is used, the palm of the hand rides on the club at the top and the head fits in the correct position pointing straight to the target direction. The transmission unit 204 advises the user 2 that the drill is a swinging sound so that a buzzing sound is emitted before and after the impact, in the order of turning down and swinging down from the right elbow to the right wrist. . The transmission unit 204 advises the user 2 to be careful if it seems to ring by follow, because the release of the right hand is delayed.

  As shown in FIGS. 120 to 123, the transmitting unit 204 sends a super closed stance drill to the user 2 with squares on both shoulders, and from the normal closed stance, the right foot is at least one foot or more. Advise to pull back. The transmission unit 204 hits the ball with this posture against the user 2, but the ball is placed in front of the toes of the left foot or on the left side of it. First, I advise you that the left side of the body is blocked by the closed stance, making it difficult for the body to flow to the left. In this state, the transmission unit 204 advises the user 2 that if the user hits a far ball outside the left foot toe, the right side will move freely. The transmitting unit 204 advises the user 2 that the correct movement can be naturally learned because the ball cannot be hit unless the right side of the body is pushed and moved in the target direction.

  As shown in FIG. 124 to FIG. 127, the transmission unit 204 sends a split hand (holding both hands apart) drill to the user 2 and grips the left hand near the grip end, while the right hand moves around the boundary between the grip and the shaft. Advise to hold and grip both hands. In this state, the transmission unit 204 advises the user 2 to actually hit the ball while being aware of the orientation of the face with a three-quarter shot from the right shoulder to the height of the left shoulder. When the transmission unit 204 swings the user 2 with the grip of both hands and swings in the image where the head overtakes the hand in front of the body, the left hand should be able to hit better, unlike when the two hands are put on. Advise. The transmitting unit 204 advises the user 2 that the face cannot be returned to the square by impact unless the right hand is used firmly. The transmission unit 204 advises the user 2 as to what kind of image the right hand should be used during the swing as a drill that can be naturally learned while hitting the ball.

(Sand wedge)
The transmitting unit 204 advises the user 2 that it is most reasonable to approach the user 2 with one sand wedge in order to approach the approach with the right hand. The transmission unit 204 advises the user 2 that it is reasonable to perform a pitch end run, a lob shot, and running with one sand wedge. The transmission unit 204 advises the user 2 that the advice of the conventional lesson that there are fewer mistakes when using all of the 8th to 9th and sand wedges is not suitable for amateurs. The sending unit 204 advises the user 2 to make it possible to imagine the feeling of vertical distance, directionality, and ball launch speed with one SW.

  The transmitting unit 204 advises the user 2 that the first feature of the sand wedge is that the address is not hand-first. The transmission unit 204 advises the user 2 that the SW has an address with a posture in which the club shaft is almost perpendicular to the ground. The transmission unit 204 advises the user 2 that the SW is not an image of crushing and hitting the ball. The second feature of the transmitting unit 204 is that the user 2 does not hit the “swing” at the time of the downswing instead of the sand wedge. Advise that. The transmission unit 204 advises the user 2 that the third feature is that the “sand wedge edge” is set by follow, so that the opening and closing of the SW face is a square movement.

  The transmission unit 204 advises the user 2 that the width of the stance of the sand wedge is reduced to about half that of the 7 iron because the SW requires a precise flight distance and directionality. The transmission unit 204 advises the user 2 that the stance direction is not open and the stance is square with respect to the target. Advise that this is easier to swing around the right side. The calling unit 204 advises the user 2 that the left side is not conscious from the center of the body, and the image of raising the back swing on the entire right side is the top of the SW when the hand is at the height of the right shoulder. To do.

The transmitting unit 204 advises the user 2 to hit the right side region of the body with a gentle trajectory instead of driving the left side subject from above. Advise that the swing track will be outside-in when set in an open stun. When the transmitter 204 is held in an open stance with respect to the user 2, the swing is outside-in and the incident angle is also from the top, so the SW with a large loft can be spun even if it is slightly displaced by the impact. Advises that the vertical distance will change and the vertical distance will vary.

  The sending unit 204 advises the user 2 that there is no duffing or sacking mistake in the right-handed swing in the swing of the sand wedge. The transmission unit 204 does not lower the head because the right hand is always higher than the left hand for the user 2, that is, the right-handed swing that is conscious of the right side space area as the subject. Therefore, it is possible to imagine a low and long impact zone, and it is possible to make a swing of an image that slides the sole of the head, thereby advising that it will not duff in front of the ball. The transmission unit 204 starts to hinge to the user 2 simultaneously with the downswing, uses the right hand hinge correctly before and after impact, and the head is firmly faced with the right hand hinge so that the toe of the face faces up in follow. Advise to turn. The transmission unit 204 advises the user 2 that he / she can catch the ball and can apply backspin even to a person without head speed. The transmission unit 204 advises the user 2 that the SW has the full function because it is a right-handed swing.

  The transmission unit 204 advises the user 2 that the management of the orientation of the face during the swing is very important in the case of the SW in which accurate flight distance and directionality are important. The transmitting unit 204 advises the user 2 to use the wrist separately for the left hand cocking and the right hand for the hinge and the left and right. The transmitting unit 204 tells the user 2 that in the conventional lesson, it is correct that the back wrist is not bent to the back side in the conventional lesson and that the left wrist is straight at the top, but it is correct. The transmission unit 204 advises the user 2 that the user 2 is in a slightly broken state. When the transmission unit 204 addresses the user 2, the left wrist is already folded slightly toward the back side. Since cocking goes vertically from that state, I advise that the correct answer is that the state is kept at the top. It is very important for the sending unit 204 that the user 2 is cocking the wrist correctly in the golf swing. If cocking is done correctly, advise the club to ride on-plane naturally.

  The transmission unit 204 advises the user 2 to master a shot of 30 yards of carry in order to learn how to handle SW. The sending unit 204 advises the user 2 that the vertical flight distance varies depending on the individual, so it cannot be generally stated, but the swing width is about one half of the full shot. The transmitting unit 204 advises the user 2 that both hands are basically used, but it is also effective to perform a practice drill that hits 30 yards with one right hand. The transmitting unit 204 advises the user 2 that the ball is never hit at an acute angle from the top and is not a downblow image as a caution at this time. The transmission unit 204 advises the user 2 to have an image of moving the head low and long in the impact zone.

  The transmission unit 204 advises the user 2 to easily divide the carry 20-yard and 10-yard shots. The transmission unit 204 advises the user 2 to use little wrist cocking at a short distance of 20 yards or less. The sending unit 204 advises the user 2 to move the weight with a small weight shift from the left to the right and raise the club on the entire right side, not to change the wrist angle of the address even during the backswing. . The transmission unit 204 advises the user 2 that it is a mistake to adjust the 20-yard carry shot and the 10-yard shot division according to the club swing width as in the conventional lesson. The transmission unit 204 advises the user 2 that the right hand swing, which is the dominant hand, can easily be used to divide the distance easily. The transmitting unit 204 advises the user 2 that when 20 yards are reached, the shaft is almost horizontal with the ground, but the wrist cocking is not used. The transmitting unit 204 advises the user 2 that the 10-yard shaft is approximately 45 degrees with respect to the ground, which is a guide for the pretending width when hitting the 10-yard. The transmission unit 204 advises the user 2 that the vertical distance of the swing using the cock in the 20-yard and 10-yard hitting methods, or the swing that is largely back-swinged and loosened by the impact will not vary. The transmission unit 204 advises the user 2 to perform a swing mainly on the right hand, which is the dominant hand. If you do so, you will be able to divide distances naturally with the sense of distance that you were born with.

  The transmission unit 204 advises the user 2 to master a shot that divides 10 yards or less. The transmission unit 204 advises the user 2 that the cocking of the wrist is not used for 10 yards or less. The transmission unit 204 advises the user 2 to hold the grip strongly in a short approach of 10 yards or less, that is, to hold the grip pressure stronger than usual to suppress unnecessary movement of the wrist. In the conventional lesson, it is common knowledge that the transmission unit 204 has a short grip in a short lesson, but if it is short, the balance of the club will change, making it difficult to feel the weight of the head. Advise that caution is necessary because hand becomes easier to come forward when the lighter. The transmission unit 204 advises the user 2 not to have a short grip because the stance is square and the balance of the club changes. The transmission unit 204 advises the user 2 that the grip is strengthened and the wrist is fixed, the wrist cocking is not used, and the swinging in the image of the putter stroke is the trick. The transmission unit 204 advises the user 2 that the one-yard shot should be tightened more strongly so that the hand becomes white. The transmission unit 204 advises the user 2 that the trick is to shake quickly and quickly so as not to loosen the grip pressure until the end of follow-up.

  The transmission unit 204 advises the user 2 of a shot that hits 50 yards deep and rough in an approach around the green. In the situation where the transmitter 204 is rough with respect to the user 2, the ball dives in the long grass, and in this situation, if the head is placed directly on the ball mainly from the left hand, the grass is entangled in the face. Advise that the resistance is so strong that the head cannot be removed. The transmitting unit 204 advises the user 2 that it is important that the right-handed swing can be swung to the resistance of the grass even in such a situation. The transmitting unit 204 advises the user 2 that the grip is first loosely gripped, and if the grip is loosely held, the wrist can be used softly and the head can be run smoothly. The transmission unit 204 advises the user 2 that the distance from the rough side can be increased by moving the head low and long with a large and loose swing and hitting the grass before and after the ball. The transmission unit 204 advises the user 2 to hold the grip in the same way as a full swing, not to hold it shortly, and to use the wrist cocking to perform a backswing firmly. The transmission unit 204 advises the user 2 to run the head so that the head passes the hand. The transmission unit 204 advises the user 2 to swing to the finish without loosening the swing.

  The transmission unit 204 advises the user 2 to approach with a lob shot mainly on the right side from the rough within 10 yards by approaching around the green. The sending unit 204 advises the user 2 that the tip of hitting with the right side is first to stand away from the ball, hand down, and hand rate. In order to make a lob shot to the user 2, the transmitting unit 204 needs to shake a large amount so that the head overtakes the hand before the impact and slides the face under the ball. Advise to use softly. This allows the head to run shallowly in the gap under the ball. The transmission unit 204 advises the user 2 to swing out to the finish in a relaxed manner during the swing. This makes it easy to hit a lob shot.

  The transmission unit 204 advises the user 2 on how to use the right hand and the sole so that the user does not go wrong with the SW approach. The transmission unit 204 advises the user 2 that it is important to use the SW Vance well in order to reduce mistakes by the SW approach. The transmission unit 204 indicates to the user 2 that the vance is a bulge on the SW sole, and the vance protrudes below the leading edge of the face. When the head is set on the ground, the vance first touches the ground. Advise that the structure has a leading edge. The transmitting unit 204 advises the user 2 that the amateur makes a left first arm and a shaft in a straight line and first strikes the head from above, so that the leading edge pierces the ground and makes a mistake. The transmission unit 204 advises the user 2 that the ball is firmly put on the face without being stabbed into the ground if the SW vance is slid from the front of the ball by swinging to the right side subject. The transmission unit 204 advises the user 2 that the state in which the face is slightly opened is a square state.

  In the approach around the green, the sending unit 204 is simple and reduces the chances of mistakes by using a single SW with various ball muscles to approach the user 2 with a ball with a long foot in the SW. Advise. The calling unit 204 shoots and hits the user 2 with a long foot with SW. The ball is placed slightly closer to the right foot than the center of the stance, and the face closes slightly with a swing mainly on the right side. Take back with the consciousness of pulling to the inside, and in the follow, the face is put out to the right from the target, hitting it like wrapping the ball in the inside out, the ball will take a light hook-type rotation, run after falling Advise that a rolling approach is possible.

The transmission unit 204 advises the user 2 that it is important for the bunker shot to swing with the right hand mainly on the right side. In the same way as the lob shot, the transmission unit 204 does not open the stance to the user 2, the square with respect to the target, the feet are not buried in the sand, the weight distribution of the addresses is equal to the left and right, or slightly to the right foot Advise the player to hang a lot and to swing away from the ball, hand-rate and hand-down. The transmitting unit 204 then gently squeezes the grip to run the head with a loose grip so that the sand before and after the ball is thrown together. I advise you to go.

The transmission unit 204 advises the user 2 how to use the wrist in the bunker shot. The transmitting unit 204 advises the user 2 not only to escape, but also to know how to use the wrist in order to get close to the pin. The transmission unit 204 urges the user 2 to run the head with the grip gripped loosely when the bunker shot is used. In this case, the leading edge is likely to pierce the sand if it is used to raise the face toe. To advise. The sending unit 204 is for the user 2 to prevent the head from diving into the sand, so use the right hand to hinge the right hand and fold the right wrist to the palm side. Advise to swing out with the face facing towards your face. In this way, the calling unit 204 is effective for the user 2 and the reading edge is less likely to sink into the sand. Also, we advise that the amount of sand that can be taken is constant and the distance feels good, so it can be brought to the pin. The transmission unit 204 advises the user 2 to understand that this is a common point in the lob shot and that the bunker shot is not a face turn like a normal shot.

  In the case of a bunker shot that is the centerpiece for the user 2, the transmitter 204 is only slightly open in this case, and the stance is only slightly open, and the face opens slightly without closing. The ball position is the same as a normal bunker shot, and it is advised to set it on the left foot Kakato line and hit the same as a normal bunker shot. If the transmitter 204 hits the user 2 without opening the face, it can skip straight to the target. The transmission unit 204 advises the user 2 to hit with the right side subject, although it is an image of hitting a bunker shot from the top rather than a normal bunker shot.

The transmission unit 204 advises the user 2 of a practice drill for SW with a wide open face. The transmitting unit 204 advises the user 2 to place the ball first and take a normal square address, hold the face wide open, and perform the same backswing as usual. The transmission unit 204 advises the user 2 to swing using the right side firmly and return the face to the square by impact. At this time, the transmission unit 204 is an effective practice drill that is effective for unifying the right side and swinging correctly using the wrist if the ball does not jump rightward but jumps straight in the target direction. To advise.

(7th fairway wood)
The sending unit 204 advises the user 2 that the merits of 7W cannot be utilized in the swing of the left side mainly using the rolling of the arm or wrist so that the conventional palm is returned. To do. The transmitting unit 204 advises the user 2 to use the right wrist with the correct grip and swing to the right side main body so that the head enters a low position and makes a gentle swing that goes low and long. The transmission unit 204 advises the user 2 that if the left hand cocking and the right hand hinge are turned, there is no fear of a mistake in the left-handed chipin.

  The sending unit 204 advises the user 2 that a short wood such as 7W is a club with a wide range of applications that can be used as a weapon for score making, such as aiming directly at the green or laying it up where it is easy to hit the next shot. To do. The transmission unit 204 advises the user 2 to divide the distance with the remainder of the grip. A person who normally fly 180 yards at 7W advises that if you hold it short in the middle of the grip, it will fall 10 yards, and if you hold it near the shaft of the grip, it will fall 20 yards to 160 yards. If the swing is mainly on the right side with respect to the user 2, the transmission unit 204 has a constant incident angle of the head, can catch the ball in the zone instead of the point of impact, and has a grip without changing the swing. Advise that the flight distance can be controlled by changing the position. If the transmission unit 204 is intended to give a flying distance of 7 W to the user 2 when it is mainly on the right side and the right hand, if the grip is long, the trajectory of launch becomes high. If you want to reduce the flight distance or the trajectory, you should have a short grip.

  The transmitting unit 204 advises the user 2 that it is useful for making a score if the user 2 can distinguish between high and low at 7W. The transmission unit 204 advises the user 2 that the high / low distinction method only changes the attitude of the address. The sending unit 204 advises the user 2 that the point is the direction of the shoulder line, and when he wants to raise the ball higher, he raises his left shoulder and lowers his right shoulder at the address to raise his eyes. The sending unit 204 advises the user 2 to lower the left shoulder and raise the right shoulder and lower the line of sight when hitting the ball low. However, even if the left shoulder is lowered, the right hand is still down, so it is advised that the shoulder line only approaches parallel to the ground.

  The transmission unit 204 advises the user 2 that it is a great merit that it can be easily hit from a sloping ground with 7W with a short and loft if the swing is mainly on the right side. The transmission unit 204 advises the user 2 that the address is important for shots from a 7 W slope. The sending unit 204 advises the user 2 to address the lie on the left foot so that it is not parallel to the slope, and the shoulder line is standing perpendicular to the earth so that it slightly opposes the slope. . The transmission unit 204 advises the user 2 that the weight is applied to the left and right 5 minutes and 5 minutes, but as a consciousness, the left foot is slightly weighted. The transmitting unit 204 advises the user 2 that the ball is placed in the middle of the normal ball position, the stance is a closed stance, and the closed stance is a basic condition on an inclined ground. When the transmission unit 204 is inclined upward to the left with respect to the user 2, the back swing slightly enters the inside and exits to the outside, so the ball becomes a hook-type ball. Advise to aim and hit. The transmission unit 204 advises the user 2 to stand strongly against the slope so that the right shoulder is likely to fall during a downswing so that the shoulder is not dropped when the inclination becomes tight. The transmission unit 204 is common to all swings for the user 2, but the right shoulder is flat so as not to drop the shoulder by a downswing than the height held by the address, and shakes his right hand at the same shoulder height. Advise to continue. The sending unit 204 advises the user 2 to hit the club with the first or second-highest club because the ball easily rises with this left-foot-raising lie and the distance of flight is reduced.

  The transmitting unit 204 advises the user 2 to first make a closed stance when laying a 7W left-footed lie. It is advised to use a closed stance where the right foot toe is usually on the left foot arch line. If the slope is tighter, advise them to pull the right foot for one shoe or more. The calling unit 204 sets the address parallel to the slope for the user 2. The weight is weighted on the left foot, and the transmitting unit 204 swings the user 2 swinging the head along the slope mainly on the right side, rotating the shaft assuming that the shaft is inside the left foot, and swinging. To advise.

  The transmitting unit 204 advises the user 2 to place the 7W toe-up lie on the ball at a position higher than the grip position, so that the address is addressed with the toe standing in a closed stance. Since the transmitter 204 has a ball at a position higher than the grip position with respect to the user 2, first try holding the grip short and swinging. If you shake the bottom turf without rubbing it, it means that the grip is too short, so it is advised to first find and find the proper grip position to rub the bottom turf. The transmission unit 204 advises the user 2 to put weight on the thumb base of both feet, to set the weight to 5 minutes 5 minutes left and right, and to place the ball slightly to the right of the usual position. The transmitting unit 204 advises the user 2 to aim at the right slightly from the target and then swing to the right side subject.

  The transmitting unit 204 adjusts the user 2 by bending the knee angle with the address because the stance of the 7W toe-falling lie is a closed stance, but this lie is prone to mistakes at the top. Advise them to keep the distance from the ball too far. The transmission unit 204 has a three-quarter shot of 70% to 80% with respect to the user 2, holding the grip as long as the usual full shot, the position of the ball slightly inward from the middle and the top not to be raised high. Advise to strike.

  The transmission unit 204 advises the user 2 to hold the grip with one finger or two fingers short for a shot with a 7 W fairway bunker. The transmission unit 204 advises the user 2 to hold the first or second-largest club short and make it difficult to squeeze, and shake it compactly without swinging. The transmitting unit 204 sets the ball position on the left heel line with respect to the user 2, does not bury the foot in the sand, makes the top slightly compact, and strikes the ball from the side mainly on the right side. Advise to hit and finish until the finish.

(putter)
What is important for putting in the putter is directionality and sense of distance. A right-handed person has a sense of distance. The sending unit 204 advises the user 2 that the sending unit 204 tells the user 2 that the putter is the opposite of a swing or a shot and does not need to be skipped at all. Advise that the best way to put it is to avoid flying.

 In order to fly on swings and shots, we advised the head to run by applying centrifugal force to the head with a fulcrum point, but in the case of a putter, the fulcrum grip and head should be used to prevent the head from running. The transmitting unit 204 advises the user 2 to move the slides in parallel so that they do not fly at the same time. The transmitting unit 204 advises the user 2 to fix the wrist with a stronger force so that the grip pressure is not blown. The putting grip should be wrapped so that the grip is slanted with respect to the palm on both the left and right sides, and the thumb should be placed lightly on the grip, with both elbows pointing diagonally behind, so that the sides close lightly. The transmission unit 204 advises the user 2. The transmitting unit 204 advises the user 2 to grip with the reverse overlapping grip, and to put the user with the feeling of hitting with the entire palm by sliding the grip and head in parallel and moving left and right. The transmitting unit 204 advises the user 2 to hold the thumb with a short thumb that does not come below the forefinger, as in a normal shot grip. The transmitting unit 204 advises the user 2 that the left hand is lightly attached and the consciousness of hitting with one right hand is the point.

  The transmission unit 204 advises the user 2 to put slowly and push out the putting. The sense of distance is not the swing width but the speed of moving the hand from side to side. The transmission unit 204 advises the user 2 not to head up with only the putter. The transmitting unit 204 does not need to skip the stance for the user 2, so the position of the ball is set so that the head is in the middle of the stance and the shaft is perpendicular to the ground as the SW stance. Give advice. The transmission unit 204 inevitably comes to the user 2 with the ball slightly to the left of the middle. Advise that it is important to place 2 to 3 balls outside of the eyes just below the eyes. This makes it easier to make a stroke mainly on the right side and stabilizes the track.

  Correct putting is never a pendulum movement with a single fulcrum. With the image of the grip and head moving in parallel with the right hand as the main subject, the follower advises the shaft to move perpendicular to the ground. The transmitting unit 204 advises the user 2 that it is important not to move up and down like drawing a letter U, but to move the head in parallel and move along a low level of the thread. That way, the sense of distance fits. Opening and closing the face turn is unnecessary in putting, so it is difficult to occur with this stroke, so the ball is caught by the core of the face and stable. Since the putter has a loft of 2 to 4 degrees, the rolling becomes constant by making a parallel stroke that moves the head low and long. The transmission unit 204 advises the user 2 to recognize that the pendulum-type stroke that is conscious of the rotation of the shoulder is erroneous because the right shoulder is easily moved forward and the direction of the face is easily changed.

  The parallel stroke of the movement putter using the tip of both elbows is easy to move the grip and the head simultaneously in parallel with the right hand as a main subject, and the transmission unit 204 advises the user 2 when the stroke is stable. Both elbows that you hold point in the diagonally backward direction. In the short putt, the transmission unit 204 advises the user 2 to hit with a stance held in a position where both the ball and the cup can be seen. The long pad divides the distance to the cup into three equal parts separately from the line while watching the cup, and the transmitting unit 204 advises the user 2 to first shake the distance of 1/3. Next, we advise you to swing 2/3 distance and finally to the distance to the cup. Prepare to create an image of a sense of distance by swinging three times and then putting. By always following the same procedure, you can stroke with good rhythm. Also, the way of putting the putter changes depending on the shape of the head, and when putting the putter on the palm, the L-shaped putter of the type where the head toe goes down like the L-shaped putter is close to the feeling of a shot There is a need to use a little opening and closing of the head.

  If you put the putter on your palm and put a face-balanced face with the face facing up, it will be a putter with a stroke that moves straight in parallel without changing the orientation of the face. Therefore, it can be said that the face balance putter with the face typified by the neo-mallet type is the most suitable. The transmission unit 204 advises the user 2 to move the ball to the left and to slightly reduce the hand rate when hitting the slice line. This makes it easier to launch to the left of the target. The transmission unit 204 advises the user 2 that the hook line moves the ball closer to the center of the stance. Thereby, it becomes light hand first and it becomes easy to get on a hook line. The transmitting unit 204 advises the user 2 to sharpen the feeling of the sole when reading the green line. The transmitting unit 204 gives the user 2 both knee sensations of the height of the knees when the knees are parallel to each other on the green, and how much both left and right when standing on the green slope. Read the difference in height around the green with your own guideline by allowing you to feel the difference between the knee height or the percentage of the slope between the sole and the feel of both knees. To advise.

  For the user 2, the transmitting unit 204 is important for patter practice, the directionality and the sense of distance, and the grip is strengthened and the wrist is fixed. It is advised to try to slide and stroke the grip and the head together at the same time with the intention of moving in parallel with the ground. The sense of distance is not the swing width but the speed of the right hand. It is effective to practice on the practice green before the round, and you will find that even with one right hand in practice, the touch will be surprising. The transmission unit 204 advises the user 2 that it is preferable to alternate one right hand and two hand strikes. In addition, the transmission unit 204 advises the user 2 so that the user can see how the ball rolls and stops after hitting. Then, you can make the image before hitting clearer. To stabilize the putting stroke, the angle of the right wrist is a point. The head trajectory is stabilized by a fixed stroke so that this angle does not change from the address. The transmitting unit 204 advises the user 2 not to change the angle of the right hand wrist even when practicing hitting with one right hand.

  If each of the first to 25th determination units of the PC 10 determines that these ideal swings are not made based on the image acquired by the imaging unit 201 of the terminal 20, the transmission unit 204 of the terminal 20 determines that the user 2 The sending unit 204 sends advice by advice sound & voice guidance & advice by text & advice by image. The ideal swing described can be confirmed on the monitor 400 and the terminal 20 as advice by advice sound & voice & advice by text & advice by image. As a result, the user 2 completes the acquisition of the ideal swing almost perfectly.

  Next, effects that can be achieved by the swing improvement support system of the present embodiment that includes the conventional problems and solves them will be described.

  As explained in the present embodiment, in order to allow the user to learn golf swings quickly, the systematized golf swing improvement support mainly based on the wide right side space area is based on the closed stance as the standard stance. In addition, the grip is a hook grip as a standard grip. The standard grip method is overlapping or ten fingers. The leading hand and arm are said to be based on the left hand and left arm in the current mainstream, but the leading hand and arm for the golf swing improvement support systemized in this system are the right hand and right arm as standard.

  The mainstream golf lessons are designed with the body in mind, turning the shoulder 90 degrees and the waist 45 degrees. In a downswing, the right elbow quickly puts it on the right flank, makes a bean, raises the shaft, finishes without hitting the head up, and continues to see where the ball was until follow-up. And in golf lessons that are currently mainstream, such as hitting down blows on irons and not breaking the triangles made of chest and arms, there is no interest in how to make use of club heads and move them at all Therefore, it can be proposed to the user that the swing mainly on the left side of the current mainstream is not suitable for amateurs.

  In addition, what is necessary for flying with a golf swing is to swing by applying centrifugal force to the club head mainly on the right side and right hand. To apply centrifugal force, move the club head round as much as possible without moving the fulcrum, that is, the body. So if you move, that is, if your body moves, the centrifugal force will slow down. In order to apply a strong centrifugal force, the head does not move as much as possible, and the centrifugal force of the head is not applied unless the fulcrum is moved in the opposite direction. So holding the left hand and turning the shoulder to swing the club is counterproductive, and the faster you turn the body, the less centrifugal force is applied. Therefore, in the current mainstream golf, of course, it is necessary to apply strength, arm strength, grip strength is necessary, and right-handed swing requires special strength, arm strength, and grip strength. No.

  Moreover, as long as the centrifugal force can be successfully applied to the club, the ball will fly easily by anyone, any age, and any physique. It has always been said that using the right hand is not good, but it is a mistake. On the other hand, it is only necessary to attach the left hand. To use the right hand right, just open the face rotation 90 degrees and close it 180 degrees. According to the swing improvement support system according to the present embodiment, at least the determination, advice, and advice (voice guidance, text advice, and image provision) are supported until the user can swing unconsciously and the swing technique is quickly performed. Makes it possible to improve.

As mentioned above, although this invention was demonstrated using the Example, the technical claim of this invention is not limited to the range as described in the said Example. In addition to the above-described embodiments, it is possible to apply, change or improve the improvement support system technology based on the image analysis processing of the current mainstream left-hand left-side golf swing, other golf swings, or various other sports items. It is clear to the operator that this is possible. It is apparent from the description of the scope of claims that the embodiments added with such applications, changes or improvements can also be included in the scope of the technical claims of the present invention.

The terminal 20 and the PC 10 develop a CPU (central processing unit) that executes instructions of a control program that realizes each function, a ROM (read only memory) program that stores the program, a RAM (random access memory) that is described above, A storage device such as a memory for storing programs and various data is provided. An object of the present invention is to record a program code (execution format program, intermediate code program, source program) of a control program for the terminal 20 and the PC 10 that is software that realizes the above-described functions so as to be readable by a computer. It can also be achieved by supplying to the PC 10 and reading and executing the program code recorded by the computer (or CPU or MPU).

  For example, tape systems such as magnetic tape and cassette tape, disk systems including magnetic disks such as floppy (registered trademark) disks / hard disks and optical disks such as CD-ROM / MO / MD / DVD / CD-R, IC cards (memory A card system such as an optical card) or a semiconductor memory system such as a mask ROM / EPROM / EEPROM / flash ROM.

  The terminal 20 and the PC 10 may be configured to be connectable to a communication network, and the program code may be supplied via the communication network. The communication network is not particularly limited. For example, the Internet, intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network, telephone line network, mobile communication network, satellite communication. A net or the like is available. Further, the transmission medium constituting the communication network is not particularly limited. For example, even in the case of wired such as IEEE 1394, USB, power line carrier, cable TV line, telephone line, ADSL line, etc., infrared rays such as IrDA and remote control, Bluetooth ( (Registered trademark), 802.11 wireless, HDR, mobile phone network, satellite line, terrestrial digital network, and the like can also be used. The present invention can also be realized in the form of a computer data signal embedded in a carrier wave in which the program code is embodied by electronic transmission.

(B) Description of Configuration of Second Embodiment Next, a second embodiment of the present invention will be described. FIG. 128 is a diagram illustrating a configuration example of the second embodiment of the present invention. In FIG. 128, parts corresponding to those in FIG. In FIG. 128, as compared with FIG. 1, the spare unit 206 of the terminal 20 is replaced with the input unit 206. In FIG. 128, the PC 10 is replaced with the PC 50 and connected to the terminal 20 via the network 30.

  Here, the input unit 206 of the terminal 20 includes, for example, a touch panel superimposed on the display unit 203, and generates and outputs information according to the operation of the user 2.

  The network 30 is configured by the Internet or the like, for example, and can exchange information between the communication unit 202 and the communication unit 502. Note that the terminal 20 is connected to the network 30 via, for example, a base station (not shown).

  The PC 50 includes a storage unit 501, a communication unit 502, an image storage unit 503, a feature point specifying unit 504, a determination processing unit 505, a determination result output unit 506, a feedback processing unit 507, and a large monitor 300. The large monitor 300 may be excluded.

  The storage unit 501 includes attribute information of each user 2 (name, gender, user ID, height, weight, golf score, flight distance for each club number of the user, etc.), teacher data, reinforcement learning parameters, user 2 I remember advice. The storage unit 501 is connected to a determination processing unit 505, a determination result output unit 506, and a feedback processing unit 507, and information can be exchanged between them.

  The communication unit 502 exchanges information with the communication unit 202 of the terminal 20 via the network 30 based on a predetermined protocol. The communication unit 502 is connected to the image storage unit 503, the determination processing unit 505, the determination result output unit 506, and the feedback processing unit 507, and can exchange information with them.

  The image storage unit 503 stores a user image (moving image) received from the terminal 20 via the communication unit 502. The feature point specifying unit 504 specifies a feature point (a specific part of the body, a golf club, a ball, etc.) of the user 2 that is reflected in the image stored in the image storage unit 503.

  The determination processing unit 505 compares the user 2 image and the teacher image to determine whether the user 2 form is good or bad.

  The determination result output unit 506 outputs the determination result by the determination processing unit 505. The feedback processing unit 507 has a function of feeding back, for example, advice regarding a form score and a form improvement point to the user 2 based on the determination result output from the determination result output unit 506.

  The large monitor 300 displays a form score output from the feedback processing unit 507, advice on improvement points of the form, and the like, and a user image in the image storage unit 503.

  FIG. 129 illustrates a detailed configuration example of the determination processing unit 505 illustrated in FIG. 128. In the example of FIG. 129, the determination processing unit 505 includes related frame extraction units 61-1 to 61-25, image adjustment units 62-1 to 62-25, and determination units 63-1 to 63-25. Yes. Note that the storage unit 501 is the same as the storage unit 501 illustrated in FIG. 128.

  Here, the related frame extraction units 61-1 to 61-25 identify and extract frames to be determined from a plurality of frames included in the moving image of the user 2, respectively.

  The image adjustment units 62-1 to 62-25 adjust (standardize) the size, angle, and the like of the user 2 image so that the user 2 image reflected in the frame can be compared with the teacher image. Each process is executed.

  The determination units 63-1 to 63-25 compare the user 2 image with the teacher image, determine the quality of the swing form of the user 2 based on a predetermined determination criterion, and determine the determination result. Output. The determination units 63-1 to 63-25 correspond to the first determination unit to the 25th determination unit illustrated in FIG. 1 and determine items similar to these.

(C) Description of Operation of Second Embodiment Next, the operation of the second embodiment of the present invention will be described. If the user 2 operates the terminal 20 and designates and accesses the URL (Uniform Resource Locator) of the PC 50, an authentication process is started between the terminal 20 and the PC 50 and stored in the storage unit 501 of the PC 50. When the legitimacy of the user 2 is confirmed by the attribute information, the session is established between the terminal 20 and the PC 50 and information can be exchanged. Instead of accessing by specifying a URL, software for executing processing to be described later is registered in the terminal 20 as application software, and when the application software is activated, the PC 50 is automatically accessed. Then, the authentication process may be executed.

  Next, the user 2 designates the type of swing to be evaluated. For example, the user 2 operates the input unit 206 to instruct to receive a swing evaluation by the driver. Such information input by the user 2 is transmitted to the PC 50 via the communication unit 202 and the network 30.

  In the PC 50, the communication unit 502 receives information transmitted via the network 30 and supplies the information to the determination processing unit 505. The determination processing unit 505 receives such information and recognizes that the user 2 is about to receive an evaluation of the driver's swing. And the part corresponding to the content instruct | indicated from the user 2 among the related frame extraction parts 61-1 to 61-25, the image adjustment parts 62-1 to 62-25, and the determination parts 63-1 to 63-25 Becomes operable.

  Next, the user 2 images his / her swing in a state where imaging by the imaging unit 201 of the terminal 20 is possible. As a result, the captured moving image is transmitted to the PC 50 via the network 30 by the communication unit 202.

  In the PC 50, the communication unit 502 receives the moving image transmitted via the network 30 and stores it in the image storage unit 503.

  FIG. 130 shows an example of a moving image stored in the image storage unit 503. In the example of FIG. 130, the moving image that captures the swing of the user 2 is composed of a plurality of frames u1 to un (n> 1). Note that the frame is composed of, for example, a number of images corresponding to the frame rate (for example, 20 fps (Frame per Second)) of the photographing unit 201 of the terminal 20 illustrated in FIG. For example, a 10-second moving image with a frame rate of 20 fps includes an image of 20 × 10 = 200 frames.

  The feature point specifying unit 504 acquires a moving image that captures the swing of the user 2 stored in the image storage unit 503, breaks it down into frames, and specifies the feature points of the user 2 shown in each frame. For example, in the example of FIG. 130, the feature points of the image of the user 2 shown in each of the frames u1 to un (left and right temporal regions, left and right shoulders, left and right elbows, left and right arms, left and right hands, club base) , Club tips, left and right hips, left and right knees, and left and right toes. As a method for specifying the feature point, a technique using deep learning (for example, “Open Pose” or the like) can be used. Of course, it goes without saying that other techniques may be used. Features include head, left and right temporal region, left and right shoulders, chest, left and right chest, back line, left and right arms, left and right elbows, left and right wrists, left and right hand back, left and right palms, left and right Finger, grip, shaft, club face, head leading edge, head top, club neck, club head, left and right hips, left and right knees, left and right toes, left and right heels, ball out A locus or the like may be specified.

  FIG. 131 shows an example in which the feature points of the user 2 captured in the frame u1 are extracted. In the example of FIG. 131, the left and right temporal regions, left and right shoulders, left and right elbows, left and right hands, club base, club tip, left and right hips, left and right knees, and left and right toes of the user 2 image. Are identified as feature points, and a line segment connecting these feature points is displayed. Note that the feature points shown in FIG. 131 are examples, and other feature points may be specified. For example, as described above, the head, left and right temporal regions, left and right shoulders, chest, left and right chest, back line, left and right arms, left and right elbows, left and right wrists, left and right hand back, left and right palms, Left and right fingers, grip, shaft, club face, head leading edge, head top, club neck, club head, left and right hips, left and right knees, left and right toes, left and right heels, ball out You may make it identify the locus | trajectory etc. of a ball | bowl.

  Next, of the determination units 63-1 to 63-25, the portion corresponding to the instruction of the user 2 acquires an image (hereinafter referred to as “teacher image”) as an example of the teacher from the storage unit 501. For example, in the present example, since the user 2 is seeking evaluation of the driver's swing, the portion related to the driver's swing among the determination units 63-1 to 63-25 is stored in the storage unit 501 from the driver's swing. Get teacher images for.

  FIG. 132 shows an example of a teacher image. In the example of FIG. 132, the teacher image shows the teacher image and the feature points of the teacher. In the example of FIG. 132, the teacher's left and right temporal regions, left and right shoulders, left and right elbows, left and right hands, the base of the club, the tip of the club, the left and right hips, the left and right knees, and the left and right toes It is shown as feature points, and a line segment connecting these feature points is shown. As mentioned above, the head, left and right temporal regions, left and right shoulders, chest, left and right chest, back muscle lines, left and right arms, left and right elbows, left and right wrists, left and right hand backs, left and right palms, Left and right fingers, grip, shaft, club face, head leading edge, head top, club neck, club head, left and right hips, left and right knees, left and right toes, left and right heels, ball out You may make it identify the locus | trajectory etc. of a ball | bowl.

  Next, the related frame extraction units 61-1 to 61-25 identify and extract a frame to be determined from a plurality of frames included in the moving image of the user 2. In addition, as a method of specifying the target frame, for example, the feature point of the teacher image is compared with the feature point of each frame, the absolute value of the difference value of the position between each feature point is obtained, and the absolute value of A frame having a small sum can be specified as a target frame. As a result, for example, when determining the stance width, a frame having the same feature point as the teacher image and showing the stance is selected and extracted. The related frame extraction process may be executed together with an image adjustment process described later. In addition, as a method for specifying a related frame, for example, a neural network is used for learning (for example, deep learning) using a target teacher image, and a frame similar to the teacher image is specified by the neural network. Also good.

  The image adjustment units 62-1 to 62-25 adjust (standardize) the size, angle, and the like of the user 2 image so that the user 2 image reflected in the frame can be compared with the teacher image. Execute the process. More specifically, the feature point of the teacher image and the feature point of the image of the user 2 are compared, the absolute value of the difference value of the position between each feature point is obtained, and the sum of the absolute values is minimized. The image of user 2 is adjusted. Adjustments include not only changing the image size, but also changing the aspect ratio of the image, rotating the image, cropping the image, changing the contrast of the image, and enhancing the edge of the image (high spatial frequency component enhancement). It includes shifting, up / down / left / right reversal, enlargement / reduction, and skewing.

  133 and 134 are diagrams illustrating an example of processing of the image adjustment units 62-1 to 62-25. As shown in FIG. 133 and FIG. 134, the image adjustment units 62-1 to 62-25 can measure the size and angle of the image of the user 2 so that the teacher's frame t1 can be compared with the frame u1 of the user 2. The process of adjusting (standardizing) etc. is executed. As a result, the adjusted frame u1 of the user 2 as shown in FIG. 134 can be obtained.

  The determination units 63-1 to 63-25 compare the user 2 image with the teacher image, determine whether the swing of the user 2 is good based on a predetermined determination criterion, and output the determination result. It should be noted that the determination result may differ depending on the type of frame extracted by the related frame extraction units 61-1 to 61-25 and the degree / content of image adjustment by the image adjustment units 62-1 to 62-25. Therefore, the determination result is fed back to the related frame extraction units 61-1 to 61-25 and the image adjustment units 62-1 to 62-25, and an optimum result is output.

  For example, the determination unit 63-1 that determines whether or not the stance is good compares the teacher image that is a closed stance with the image of the user 2, and the user 2 and the teacher image based on the positional relationship between the left and right knees and the left and right toes. Are different (for example, when the user 2 is a square stance or an open stance), it is determined as NO. In addition, the determination unit 63-3 compares the teacher image and the image of the user 2, and determines whether or not the stance width and the weight distribution of the user 2 are within the allowable range. More specifically, the stance width is good when the left and right toe positions of the teacher image and the left and right toe positions of the user 2 image are compared and their difference value is equal to or smaller than a predetermined threshold value. Is determined. As for weight distribution, the center of gravity position is calculated from the position of the head, both shoulders, and waist of the teacher image and the image of the user 2, respectively, and it is good when the difference value of the center of gravity position is not more than a predetermined threshold value. Can be determined. Of course, the determination may be made by other methods.

  Note that the determination units 63-2 and 63-4 to 63-25 also determine whether or not the swing of the user 2 is good by comparing the teacher image and the image of the user 2 in the same manner as described above.

  As a specific determination method, for example, a method of comparing the areas of feature points (for example, the area of the back of the left hand of the teacher image and the user 2 image), an angle of a line segment connecting the feature points (for example, left and right) The angle of the line segment connecting the shoulders), the method of comparing the positional relationship of the fingers of the hand, the method of estimating the weight distribution from the positional relationship of the feature points, and the positional relationship of the ball and the feature points And a method of setting the weight of the feature amount to the directionality and size of the vector divided into the left and right and up and down of the feature amount by setting the axis and the area ratio surrounded by the line segment. Of course, you may make it determine by methods other than the above-mentioned.

  Next, the determination units 63-1 to 63-25 instruct the related frame extraction units 61-1 to 61-25 to intentionally move the target frame back and forth, and the image adjustment unit 62-. 1 to 62-25 are each instructed to readjust the image. The determination units 63-1 to 63-25 execute the determination process again on the image of the user 2 obtained as a result. The determination units 63-1 to 63-25 adopt the better one when the result of the determination process again is better than the previous result, and the previous result when the result is not good. adopt. In this way, changing the frame to be extracted or changing the adjustment of the image and repeating the determination process may result in erroneous determination based on an image in which an inappropriate frame is selected or an inappropriate adjustment is made. This is to prevent this.

  The determination units 63-1 to 63-25 output the determination results after repeating the above-described process several times. The determination results output from the determination units 63-1 to 63-25 are supplied to the feedback processing unit 507 via the determination result output unit 506.

  The feedback processing unit 507 acquires the determination units 63-1 to 63-25 via the determination result output unit 506.

  The feedback processing unit 507 scores the swing score by the following process. The feedback processing unit 507 displays advice by the following processing, and learns an optimal advice display procedure and the like by reinforcement learning.

  First, regarding the calculation of the score Sc of the swing, for example, the feedback processing unit 507 determines that the determination result Di (i = 1 to 25) output from the determination units 63-1 to 63-25 (for example, the result is good). The case is represented by “1”, and if it is not represented by “0”), the weighting factor Wi is multiplied to calculate the sum. Of course, it may be calculated by other methods. The weighting factor Wi can be set using, for example, multiple regression analysis or the like so as to have a correlation with each user's best score or handicap. Further, the user's right side space area may be preferentially evaluated by relatively increasing the value of the weight coefficient of the user's right side space area.

... (1)

  As reinforcement learning, for example, Q-learning represented by the following equation (2) can be used.

Q (St, a) ← (1-α) Q (St, a) + α (r + γmaxQ) (2)

  In Equation (2), Q (St, a) indicates the state action value, St indicates the state of the user 2, a indicates the action (here, advice), r indicates the reward, α and γ represents a constant set in advance, and maxQ represents the largest Q value in the state after the transition by advice.

  Detailed operations relating to Q-learning will be described. First, the feedback processing unit 507 sets the determination result acquired from the determination units 63-1 to 63-25 as the state St of the user 2. Here, St is, for example, 25-bit information, and the determination results output from the determination units 63-1 to 63-25 are assigned to the respective bits. For example, the output of the determination unit 63-1 is represented by “1” when the result is good, and is represented by “0” when the result is negative. If it is good, the first bit (LSB (Least Significant Bit)) of St is set to “1”. Similarly, the state of bits of the second to 25th bits is set according to the results of the determination units 63-2 to 63-25.

  Next, the feedback processing unit 507 selects the advice having the highest Q value from the storage unit 501 among the advices corresponding to the state St. As described above, the Q value indicates a state action value in Q learning that is reinforcement learning. That is, when a plurality of bits constituting the state St are “0” (not), it is determined that a plurality of parts of the form of the user 2 are not appropriate, but advice for correcting the corresponding part in that case It is difficult for the user 2 to respond to all of these advices simultaneously.

  For this reason, for example, when both the first bit (closed stance) and the third bit (stance width and weight distribution), which are bits related to the stance, are “0” (not), first, the closed stance is corrected. Advise to “Please lower your right foot a little to make it a closed stance”, then select “Please secure a little more stance width” and “Increase the weight distribution to the right foot a little. By selecting “”, the user 2 can be surely corrected the form. Note that the order in which advice is presented is learned by Q-learning, and the optimum order of presentation is determined. That is, the above-described example of presenting the advice is an example, and the advice may be selected in an order other than this, or the advice may have different contents.

  The feedback processing unit 507 transmits the swing scoring result obtained by the above-described equation (1) to the terminal 20 via the communication unit 502. Also, the feedback processing unit 507 transmits the advice selected from the storage unit 501 to the terminal 20 via the communication unit 502. As a result, the advice selected by the feedback processing unit 507 and the scoring result are displayed on the display unit 203 of the terminal 20.

  FIG. 135 shows an example of a screen displayed on the display unit 203. In the example of FIG. 135, one frame of the moving image of the user 2 is displayed on the screen. In addition, a confirmation playback button that is operated when the user 2's video is played and a teacher video playback button that is operated when the teacher's video is played are displayed at the top of the screen. In the lower right of the screen, “score = 87” is displayed as the score of the swing, and “Please lower your right foot to make it a closed stance” is displayed as advice. Such advice may be output as voice from the terminal 20. When the confirmation playback button is operated, the moving image of the user 2 stored in the image storage unit 503 is transmitted to the terminal 20 via the communication unit 502 and played back. When the teacher video playback button is operated, the teacher video stored in the storage unit 501 is transmitted to the terminal 20 via the communication unit 502 and played back.

  Next, after the user 2 improves the form based on the presented advice and the user 20 captures and transmits a moving image again, the feedback processing unit 507 performs the same process as described above again. Executed. The determination processing unit 505 outputs a determination result for the improved moving image and supplies it to the feedback processing unit 507. The feedback processing unit 507 identifies the state St of the user 2 based on the supplied determination result.

  Next, the feedback processing unit 507 calculates the reward r based on the state St of the user 2. For example, the feedback processing unit 507 sets the reward r = 1 when the number of “0” (not) included in the state St of the user 2 is reduced by the advice, and otherwise reward r = 0. For example, when the 3 bits of the state St are “1” and the 4 bits of the state St are “1” due to the improvement, the reward r = 1 is assumed that “1” has increased.

  The feedback processing unit 507 calculates the Q value shown in Expression (2) based on the above result.

  Since the above processing is repeatedly executed until the form of the user 2 is improved, an appropriate advice presentation order corresponding to the form state is learned by reinforcement learning. By using the system learned in this way, the user can improve the swing form efficiently and quickly. Moreover, a more universal learning result can be obtained by performing the reinforcement learning process for a plurality of users.

  Next, an example of processing executed in the second embodiment will be described with reference to FIGS. 136 and 137.

  FIG. 136 is a flowchart for explaining an example of processing executed in the PC 50. When the processing of the flowchart shown in FIG. 136 is started, the following steps are executed.

  In step S <b> 10, the communication unit 502 acquires the moving image of the user 2 from the terminal 20 via the network 30. For example, the communication unit 502 acquires a moving image obtained by capturing the swing by the driver of the user 2 via the network 30 and stores the moving image in the image storage unit 503.

  In step S11, the feature point specifying unit 504 decomposes the moving image acquired in step S10 and stored in the image storage unit 503 into frames. As a result, for example, a moving image of 20 fps for 10 seconds is broken down into 200 frames.

  In step S12, the feature point specifying unit 504 specifies the feature point of each frame obtained in step S11. For example, the feature point specifying unit 504 extracts a feature point of the user 2 in each frame by using a technique (for example, “Open Pose”) using deep learning.

  In step S13, each of the related frame extraction units 61-1 to 61-25 specifies a frame related to the content to be determined. For example, the related frame extraction unit 61-1 that determines whether the stance is good identifies a frame having a feature point having the same positional relationship as the teacher image in which the stance is captured.

  In step S14, each of the related frame extraction units 61-1 to 61-25 extracts the frame specified in step S13. For example, the related frame extraction unit 61-1 that determines whether or not the stance is good extracts a frame in which a stance similar to the teacher image specified in step S13 is captured.

  In step S15, the image adjustment units 62-1 to 62-25 execute processing for adjusting the related frames extracted in step S14 according to the teacher image. For example, as illustrated in FIGS. 133 and 134, the image adjustment units 62-1 to 62-25 adjust the frame of the user 2 according to the teacher image.

  In step S16, each of the determination units 63-1 to 63-25 acquires a teacher image related to the content to be determined from the storage unit 501, and specifies a feature point from the acquired teacher image.

  In step S17, each of the determination units 63-1 to 63-25 compares the feature point of the user 2 identified in step S16 with the feature point of the teacher image identified in step S16.

  In step S18, the determination units 63-1 to 63-25 adjust the frames extracted by the related frame extraction units 61-1 to 61-25 and adjust the frames by the image adjustment units 62-1 to 62-25. It is determined whether or not the adjustment process that is the adjustment process is to be continued. If it is determined that the adjustment process is to be continued (step S18: Y), the process returns to step S13 and the same process as described above is repeated. In this case (step S18: N), the process proceeds to step S19.

  In step S19, the determination units 63-1 to 63-25 output the best determination result in the repetition of the adjustment process. Note that the determination results output from the determination units 63-1 to 63-25 are supplied to the feedback processing unit 507 via the determination result output unit 506.

  In step S20, the determination units 63-1 to 63-25 determine whether or not to repeat the process. If it is determined that the process is to be repeated (step S20: Y), the process returns to step S10 and is the same as described above. The above process is repeated, and in other cases (step S20: N), the process ends.

  Next, processing executed in the feedback processing unit 507 shown in FIG. 128 will be described with reference to FIG. When the processing of the flowchart shown in FIG. 137 is started, the following steps are executed.

  In step S30, the feedback processing unit 507 acquires the determination result output in step S19 of FIG. As a result, the determination results by the determination units 63-1 to 63-25 are acquired.

  In step S31, the feedback processing unit 507 applies the determination result acquired in step S30 to the above-described equation (1) to calculate the score Sc.

  In step S <b> 32, the feedback processing unit 507 transmits the score Sc calculated in step S <b> 31 to the terminal 20 via the communication unit 502 and causes the display unit 203 of the terminal 20 to display the score Sc. As a result, for example, “score = 87” is displayed on the display unit 203.

  In step S33, the feedback processing unit 507 specifies the state St of the user 2 based on the determination result of the swing form of the user 2 acquired in step S30. More specifically, for example, when the determination results of the determination units 63-1 to 63-25 are good, the corresponding bit of St composed of 25 bits is set to “1”, and the determination result is negative. In this case, the corresponding bit is set to “0”.

  In step S34, the feedback processing unit 507 specifies the presence / absence of the corresponding advice from the state St of the user 2 specified in step S33. For example, it is specified whether there is advice corresponding to the state St.

  In step S35, the feedback processing unit 507 proceeds to step S36 when the presence of advice corresponding to the state St of the user 2 is identified in step S33 (step S35: Y), and otherwise (step S35: In N), the process proceeds to step S39.

  In step S <b> 36, the feedback processing unit 507 transmits the advice specified in step S <b> 34 to the terminal 20 via the communication unit 502 and causes the display unit 203 of the terminal 20 to display the advice. As a result, for example, the advice “Please lower your right foot slightly to make it a closed stance” is displayed on the display unit 203.

  In step S <b> 37, the feedback processing unit 507 acquires the determination result after presenting the advice from the determination result output unit 506. More specifically, it is assumed that after presenting the advice, the user 2 improves the form in accordance with the advice, and captures and transmits the moving image again. In that case, the moving image transmitted from the terminal 20 is received by the communication unit 502 and stored in the image storage unit 503. The determination processing unit 505 compares the feature point of the image of the user 2 specified by the feature point specifying unit 504 with the feature point of the teacher image stored in the storage unit 501, and outputs a determination result.

  In step S38, the feedback processing unit 507 identifies the state St of the user 2. More specifically, for example, when the determination results of the determination units 63-1 to 63-25 are good, the corresponding bit of the state St composed of 25 bits is set to “1”, and the determination result is negative. In some cases, the corresponding bit is set to “0”.

  In step S39, the feedback processing unit 507 calculates the reward r of Expression (2) described above. More specifically, the feedback processing unit 507 sets the reward r to “1” when the bit “1” (good) constituting the state St increases, and to “0” otherwise. . For example, the reward r is set to “1” when the state where the 3 bits are “1” is changed to the state where the 4 bits is “1”, and the reward r is set to “0” in other cases. .

  In step S40, the feedback processing unit 507 calculates a Q value. More specifically, the feedback processing unit 507 calculates the Q value shown in Expression (2) based on the above result.

  In step S41, the feedback processing unit 507 determines whether or not to repeat the process. If it is determined that the process is to be repeated (step S41: Y), the process returns to step S30 and repeats the same process as described above. In other cases (step S41: N), the process ends.

  According to the above processing, the above-described operation can be realized.

(D) Description of Configuration of Third Embodiment Next, with reference to FIG. 138, a configuration example of the third embodiment of the present invention will be described. In FIG. 138, portions corresponding to those in FIG. 128 are denoted by the same reference numerals, and description thereof is omitted. In FIG. 138, compared with FIG. 128, PC50 is replaced with PC70. Further, the large monitor 40 is replaced with smart displays 40-1 to 40-3.

  The PC 70 includes a communication unit 502, an image storage unit 503, a frame decomposition unit 71, a frame classification multilayer neural network 72, a first determination multilayer neural network 73-1 to a 25th determination multilayer neural network 73-25, and a score. A calculation unit 75, an advice presentation unit 74, and a large monitor 300 are provided.

  Here, the frame decomposition unit 71 decomposes the moving image sent from the terminal 20 into frames and outputs the frames.

  The multi-layer neural network for frame classification 72 is configured by a multi-layer neural network, and the form part (for example, address, take back, back swing, top of swing, down swing, impact, follow through, finish) of the user 2 shown in the frame. Etc.) and the frames are supplied to the first determination multilayer neural network 73-1 to the 25th determination multilayer neural network 73-25.

  The first determination multilayer neural network 73-1 to the 25th determination multilayer neural network 73-25 are based on the attention points corresponding to the first determination unit 106 to the 25th determination unit 130 described above, and the user 2 swings. The quality of the form is judged and the score is output.

  The score calculation unit 75 combines the scores output from the first determination multilayer neural network 73-1 to the 25th determination multilayer neural network 73-25, and calculates the total score of the form.

  The advice presenting unit 74 presents information on the evaluation and improvement points of the form of the user 2 based on the determination results output from the first determination multilayer neural network 73-1 to the 25th determination multilayer neural network 73-25. To do. Further, it may be acquired from the advice presenting unit 74 corresponding to the inquiry of the user 2 and presented to the user 2 by, for example, FAQ of AI chatbot.

FIG. 139 is a diagram illustrating an example of the configuration of the frame classification multilayer neural network 72 and the first determination multilayer neural network 73-1 to the 25th determination multilayer neural network 73-25. The example shown in FIG. 139 is a neural network composed of seven layers: an input layer, an intermediate layer, and an output layer. Each layer has a plurality of units. Each unit calculates an output z based on the following equations (3) and (4) for a plurality of inputs x ₁ , x ₂ ,..., X _n . _{Incidentally, w 1, w 2, w} 3, ···, w n is a weighting factor, b is bias, f () is the activation function.

... (3)

... (4)

  Note that FIG. 139 is an example, and other multilayer neural networks may be used. For example, the intermediate layer may be other than five layers. Further, the number of units in each layer may be other than that shown in FIG. Furthermore, the mode of coupling between units may be other than that in FIG.

  Returning to FIG. 138, the smart displays 40-1 to 40-3 are configured such that the user 2 wears the head on the head in the same manner as the glasses, and the video information transmitted from the communication unit 202 by radio waves, for example, is displayed on the smart glasses. Or display on the built-in goggles of the head mounted display. In addition, as an external display, a swing image, swing information, a golf course landscape, and the like are displayed on a single or a plurality of smart displays.

(E) Description of Operation of Third Embodiment Next, operation of the third embodiment will be described. When the user 2 shoots his / her swing form as a moving image on the terminal 20 and transmits it to the PC 70 via the network 30, the moving image is received by the PC 70 via the network 30. In the PC 70, the communication unit 502 receives the moving image and stores it in the image storage unit 503.

  The moving image stored in the image storage unit 503 is supplied to the frame decomposition unit 71. The frame decomposing unit 71 decomposes the moving image into frames and supplies them to the multi-layer neural network 72 for frame classification.

  The multi-layer neural network for frame classification 72 is constituted by, for example, a seven-layer neural network, classifies frames according to the part of the form of the user 2 shown in the input frame, and the first multi-layer neural network 73-1 for determination. ˜Supply to any one or more of the twenty-fifth determination multilayer neural networks 73-25.

  More specifically, the multi-layer neural network for frame classification 72 is configured by, for example, a CNN (Convolutional Neural Network). The CNN has an input layer, a convolution layer, a pooling layer, a convolution layer, a pooling layer, a fully coupled layer, and an output layer.

  A frame image is input to the input layer. The Convolution layer performs a convolution operation on input data and calculates a feature amount. The Pooling layer performs compression processing on the feature value and outputs it. All connected layers calculate a weighted sum for the calculated feature value. For example, the output layer classifies and outputs the feature amounts by the SoftMax function shown in the following equation (5).

... (5)

Here, the subscript k indicates the kth unit, and the superscript (L) indicates the Lth layer. The total input of each unit k (= 1,..., K) of the output layer l = L is based on the output of l = L−1 of the next lower layer, and the following equation (6) Given by. Based on this, the output of the k-th unit in the output layer can be expressed by the above-described equation (5). The SoftMax function is characterized in that the total number of y ₁ ,..., Y _K is 1.

... (6)

For the multi-layer neural network configured as described above, for example, a teacher including an attention point to be determined by each of the first determination multi-layer neural network 73-1 to the 25th determination multi-layer neural network 73-25. A learning process is executed using an image (an image of an ideal form). As a result, when a frame including an attention point to be determined by each of the first determination multilayer neural network 73-1 to the 25th determination multilayer neural network 73-25 is input, the output of the corresponding unit is output. The value is larger than other units. For example, the first determination multilayer neural network determines whether the stance of the user 2 is good or not. Therefore, when a frame in which the stance of the user 2 is reflected is input to the frame classification multilayer neural network 72, the first determination is performed. the output of y ₁ is a unit corresponding to the use multilayer neural network 73-1 is a value close to "1" or "1", the other is a value close to "0" or "0".

  The frame supplied from the frame decomposing unit 71 is one of the first determination multilayer neural network 73-1 to the 25th determination multilayer neural network 73-25 based on the classification result by the frame classification multilayer neural network 72, or Supplied to a plurality of these.

  The first determination multilayer neural network 73-1 to the 25th determination multilayer neural network 73-25 inputs the frames classified by the frame classification multilayer neural network 72, and based on the learning result by the teacher image, The evaluation is performed, and the evaluation result is output as a numerical value between 0 and 1, for example.

  More specifically, the first determination multilayer neural network 73-1 to the 25th determination multilayer neural network 73-25 include, for example, an input layer, a convolution layer, a pooling layer, a convolution layer, a pooling layer, as described above. It is constituted by a CNN having a total coupling layer and an output layer.

As an example, the first determination multilayer neural network 73-1 to the 25th determination multilayer neural network 73-25 are subjected to learning processing by one or a plurality of teacher images which are ideal forms, and examples of bad forms. Learning processing is performed with one or a plurality of images (hereinafter referred to as “inverse teacher images”). For example, when learning processing is performed with a plurality of ideal teacher images and the form of the user 2 is similar to the ideal teacher image, for example, the output y ₁ is “1”, and the other outputs are It becomes “0”. When the form of the user 2 is similar to the first opposite teacher's form (for example, the stance width is not sufficient), the output y ₂ is “1”, and the other outputs are “0”. Furthermore, when the form of the user 2 is similar to the second opposite teacher's form (for example, not in a closed stance), the output y ₃ is “1” and the other outputs are “0”. . Of course, the above is an example, and a configuration other than that described above may be used.

  The score calculation unit 75 multiplies the determination results output from the first determination multilayer neural network 73-1 to the 25th determination multilayer neural network 73-25 by a weighting factor, and performs the swing form of the user 2 To give a score. It is desirable that the weighting coefficient is adjusted according to the importance of the determination contents of the first determination multilayer neural network 73-1 to the 25th determination multilayer neural network 73-25. In the embodiment shown in FIG. 138, there are 25 determination units, so in the case of a maximum of 100 points, in simple calculation, each determination unit has 4 points, but the determination unit with high importance has 4 points. A score smaller than 4 can be allocated to a determination unit having a lower score and a less important level. As a result, “87 points” is output from the score calculation unit 75 as an example.

The advice presentation unit 74 selects and outputs advice based on the determination results of the first determination multilayer neural network 73-1 to the 25th determination multilayer neural network 73-25. For example, when the first determination multilayer neural network 73-1 is similar to the second opposite teacher's form (for example, not in a closed stance), the output y ₃ is “1”. Therefore, for example, “Please lower your right foot a little to make it a closed stance” is selected and output as advice.

  The score output from the score calculation unit 75 and the advice output from the advice presenting unit 74 are transmitted to the terminal 20 via the communication unit 502. In the terminal 20, for example, information as illustrated in FIG. 135 is displayed on the display unit 203 or the large monitor 40. By referring to such information, the user 2 can improve his / her swing form.

  In the above description, the case where a learned multi-layer neural network is used has been described as an example. However, the multi-layer neural network may be re-learned as necessary. For example, when the determination by the first determination multilayer neural network 73-1 to the 25th determination multilayer neural network 73-25 does not sufficiently function for a predetermined user 2 (for example, a plurality of outputs are set to “1”). If the values are close to each other), the corresponding advice is presented in order, and the output with improved form is the correct judgment result. Then, the relearning can be performed based on the form of the user 2 so that the output with the improved form becomes “1”. It should be noted that re-learning may be performed based on feedback from the user 2 instead of using the improvement of the form as a reference.

In addition, not only when the determination does not function sufficiently, but also when the determination functions, relearning may be performed. For example, when it is determined that the form of the user 2 is similar to the first opposite teacher's form (for example, the stance width is not sufficient) and the output y ₂ is “1”, the form of the user 2 On the other hand, relearning may be performed using the teacher image.

  In this way, by re-learning, the system can be "grown" to become a skilled lesson professional.

  In the embodiment shown in FIG. 138, the advice is displayed as it is, but the advice selected by the reinforcement learning may be displayed as in the embodiment shown in FIG. More specifically, the determination results by the first determination multilayer neural network 73-1 to the 25th determination multilayer neural network 73-25 are supplied to the feedback processing unit 507 shown in FIG. Based on the determination results of the first determination multilayer neural network 73-1 to the 25th determination multilayer neural network 73-25, appropriate advice is learned using the Q-learning represented by the above-described equation (2). May be. Note that reinforcement learning may be realized using a multilayer neural network.

((F) Description of Configuration of Fourth Embodiment Fig. 140 is a diagram showing a configuration example of the fourth embodiment of the present invention. In Fig. 140, portions corresponding to Fig. 128 are denoted by the same reference numerals. 140, the terminal 20 is replaced with the terminal 80, as compared with the case of Fig. 128. The terminal 80 includes a SG + WP (Smart Glass and Wireless Phone) 90 as a wearable device, A 3D laser scanner 91, an IoT (Internet of Things) sensor 92, an IoT camera 93, and smart displays 40-1 to 40-3, such as a head mounted display and smart displays 40-1 to 40-3, are connected. The terminal 80 includes a communication unit 202, a vibration unit 205, a spare unit 207, an image processing unit 801, an input unit 802, and an information processing unit 803. ing.

  Here, the communication unit 202, the vibration unit 205, and the spare unit 207 are the same as those in FIG. For example, the image processing unit 801 processes information received from the PC 50 via the communication unit 202 and supplies the information to the smart glasses 90, the head mounted display, the smart displays 40-1 to 40-3, and the like, and displays them as images.

  The input unit 802 inputs 3D information of the user 2 obtained by the 3D laser scanner 91. The information processing unit 803 processes the 3D information input from the input unit 802, acquires the body state of the user 2, normalizes, and generates and outputs a moving image.

  The smart glasses 90 and the head mounted display as wearable devices are worn by the user 2 in the same manner as glasses, and the surrounding situation is visually confirmed through the lens, and is supplied from the image processing unit 801 and projected onto the lens. You can view images.

  The 3D laser scanner 91 irradiates each part of the body of the user 2 with laser light, receives the reflected light, and measures the distance from the time required for the reciprocation of the laser light to each part of the body. The IoT sensor 92 includes, for example, a head speed measurement sensor and a distance sensor. The IoT camera 93 supplies a moving image obtained by imaging the user 2 from various directions to the input unit 802. The SG + WP 90, the head mounted display, and the external smart display are attached by the user 2, and provide video and audio to the user 2 without connection lines.

(G) Explanation of operation of 4th Embodiment Next, operation | movement of 4th Embodiment of this invention is demonstrated. When the user 2 places the terminal 80 around the user and performs an operation of starting imaging, the 3D laser scanner 91 irradiates the user 2 with laser light.

  Laser light reflected by each part of the body of the user 2 is received by the 3D laser scanner 91. The 3D laser scanner 91 refers to the time required for the laser beam to reciprocate, measures the distance to each part of the body, and outputs information related to the measurement result.

  The input unit 802 inputs information output from the 3D laser scanner 91 and supplies the information to the information processing unit 803. Based on information output from the 3D laser scanner 91, the information processing unit 803 obtains similar examples from a database that stores examples of golf swing movements, and estimates the positions of hands, feet, and torso, for example. Alternatively, the body 2 of the user 2 is detected by estimating the positions of hands, feet, torso, etc. by fitting a human body model to information output from the 3D laser scanner 91. Next, the information processing unit 803 converts it into a standardized moving image that can easily be associated with the teacher image of the PC 50 regardless of the positional relationship between the 3D laser scanner 91 and the user 2. That is, the orientation, size, and the like of the user in the moving image change depending on the positional relationship between the 3D laser scanner 91 and the user 2, the angle of view, the height of the user, and the like. For example, the comparison with the teacher image included in the determination processing unit 505 is possible. In order to facilitate, the orientation, size, etc. of the user 2 in the moving image are converted (standardized).

  The standardized moving image obtained in this way is supplied from the communication unit 202 to the PC 50 via the network 30.

  The PC 50 compares the moving image of the user 2 and the teacher image by the same operation as described above, determines the quality of the swing form of the user 2, and gives a score indicating the determination result and an advice indicating an improvement point. Present.

  As described above, according to the fourth embodiment of the present invention, since the swing form of the user 2 is detected using the 3D laser scanner 91, the form of the user 2 is detected at high speed and accurately. be able to.

  Further, since the standardized moving image is generated based on the form detected by the 3D laser scanner 91, the processing load by the PC 50 can be reduced.

  Instead of using the 3D data as it is, for example, the 3D data is standardized (for example, standardized so that the orientation and size of the user 2 become a desired orientation and size), and the standardized 3D Data may be projected onto 2D data, and processing may be performed using 2D data obtained by the projection processing.

(H) Description of Configuration of Fifth Embodiment Next, a fifth embodiment of the present invention will be described. FIG. 141 is a diagram showing a configuration example of the fifth embodiment of the present invention. In the fifth embodiment shown in FIG. 141, the PC 70 shown in FIG. 138 and the terminal 80 shown in FIG. 140 are combined. Note that the configurations of the PC 70 and the terminal 80 are the same as those in FIGS. 138 and 140, and thus detailed descriptions thereof are omitted.

(I) Description of Operation of Fifth Embodiment Next, the operation of the fifth embodiment of the present invention will be described. In the terminal 80, each part of the body of the user 2 is scanned at high speed by the 3D laser scanner 91, and the state of the body of the user 2 is detected by collation with a database, fitting processing, and the like. The state of the body of the user 2 detected in this way is converted into a standardized moving image and transmitted to the PC 70 via the communication unit 202 and the network 30 as described above.

  In the PC 70, the moving image is decomposed into frames by the frame decomposing unit 71 by the same operation as described above, the frames are classified according to the attention point by the multi-layer neural network 72 for frame classification, and the multi-layer neural network 73 for first determination. -1 to 25th determination multilayer neural network 73-25. Each of the first determination multilayer neural network 73-1 to the 25th determination multilayer neural network 73-25 calculates the score of the swing form of the user 2 by comparing the frame with the teacher image or the teacher image. Then, the data is supplied to the score calculator 75 and supplied to the advice presenter 74.

  The score calculation unit 75 adds up the scores supplied from the first determination multilayer neural network 73-1 to the 25th determination multilayer neural network 73-25, and outputs a total score. Further, the advice presenting unit 74 generates and outputs a corresponding advice based on the determination result supplied from the first determination multilayer neural network 73-1 to the 25th determination multilayer neural network 73-25.

  The score and the advice generated in this way are supplied to the terminal 80 via the network, and are displayed on the smart glass 90, the head mounted display, and the external smart display, for example, in a correspondence similar to FIG.

  As described above, according to the fifth embodiment of the present invention, the moving image generated by high-speed scanning by the 3D laser scanner 91 is determined using the multilayer neural network, so that the determination accuracy is improved. be able to.

(J) Description of Configuration of Sixth Embodiment Next, a sixth embodiment of the present invention will be described with reference to FIG. In FIG. 142, portions corresponding to those in FIG. 141 are denoted by the same reference numerals, and description thereof is omitted. More specifically, in FIG. 142, the frame classification multilayer neural network 72 is replaced with the frame classification R2D2172, and the first determination multilayer neural network 73-1 to the 25th determination multilayer neural network 73-25 perform the first determination. Multilayer R2D2173-1 to 25th determination R2D2173-25.

  Here, R2D2 (Recurrent Replay Distributed DQN) has Learner and a plurality of actors. The Learner causes the Actor to execute processing, and based on the result, the Learner learns efficient processing. Thereby, an ideal process can be learned from various processes. Actor records the processing result, and Learner learns when a certain amount of Actor records are accumulated, and teaches Actor how to perform good processing. By repeating the processing as described above, the processing efficiency of the actor is improved little by little.

(K) Description of Operation of Sixth Embodiment Next, the operation of the sixth embodiment of the present invention will be described. Note that the operations from when the image is captured by the terminal 80 and transmitted via the network 30 until the moving image is decomposed into frames by the frame decomposing unit 71 are the same as those in the fifth embodiment, and thus detailed description thereof is omitted. To do.

  The frames constituting the moving image of the user 2 output from the frame decomposition unit 71 are supplied to the frame classification R2D2172. The frame classification R2D2172 has a first determination learner and a plurality of actors. The plurality of actors extract and output a frame highly relevant to the first determination by each method. Learner executes the learning process when the actor process is executed a certain number of times. In the learning process, referring to the determination result by the first determination R2D2173-1, an actor having a high frame extraction accuracy is identified, and the actor process is transmitted to other actors, thereby improving the accuracy of the actor process. . Note that the frame classification R2D2172 includes the second determination to the twenty-fifth determination Learner and a plurality of actors, and these Learners and a plurality of actors are also extracted by the same operation as described above. Learning to improve accuracy.

  The frames classified by the frame classification R2D2172 are supplied to the first determination R2D2173-1 to the 25th determination R2D2173-25, respectively. The first determination R2D2173-1 includes a first determination learner and a plurality of actors. The plurality of actors determine the quality of the form of the user 2 based on the first determination and output by each method. Learner executes the learning process when the actor process is executed a certain number of times. In the learning process, for example, an actor having a high determination accuracy is identified based on the progress of improvement of the form of the user 2, and the actor process is transmitted to other actors, thereby improving the accuracy of the actor process. Note that the second determination R2D2173-2 to the 25th determination R2D21773-25 each have a Learner and a plurality of actors, like the second determination R2D2173-1, and each of these learners and a plurality of actors. Also, learning is performed so as to increase the extraction accuracy by the same operation as described above.

  As described above, according to the sixth embodiment of the present invention, the determination accuracy can be efficiently increased by using the R2D2 process.

(L) Description of Modified Embodiment Each of the above embodiments is an example, and it is needless to say that the present invention is not limited only to the case described above. For example, in the above embodiments, golf swings have been described as examples. However, for example, tennis, baseball, badminton, table tennis, and the like can be determined.

  In the second embodiment described above, Q-learning is used. However, for example, Deep Q Network as reinforcement learning using deep learning by a neural network may be used.

  In the second embodiment described above, as a method of calculating the score of the swing form of the user 2, the calculation is made based on the equation (1). For example, the calculation can be performed using multiple regression analysis. Alternatively, it may be calculated by a learning process using a neural network.

  In the flowchart shown in FIG. 136, the adjustment process is repeatedly executed. However, the adjustment process may be executed only once, or the adjustment process may be omitted.

  In addition, the terminal 20 illustrated in FIG. 128 includes the single imaging unit 201. However, the two imaging units are arranged at a predetermined distance in the horizontal direction so as to include an imaging unit that can capture a stereo image. It may be. By using such a stereo image, it is possible to detect the feature point of the user 2 more accurately using trigonometry and to detect the position in the depth direction of the image of each feature point. Moreover, you may make it have a omnidirectional camera and a 360 degree camera.

In the second embodiment shown in FIG. 128, the PC 50 is operated as a cloud computer, but the functions of the PC 50 may be ported to the terminal 20 so that the terminal 20 also realizes all the functions of the PC 50. .
Further, the hardware product of the Iot camera 93 or the Iot sensor 92, for example, on the terminal device, instead of the cloud or the server, may be executed with a deep learning inference technique such as image recognition based on the DNN model. If the processing related to deep learning is executed on the cloud, the communication cost becomes high. Therefore, if the processing related to deep learning is realized by an edge device, the communication cost can be reduced. In addition to recognition of images, for example, information such as sound and acceleration is not only supplied to the cloud with information received from the Iot camera 93 and the Iot sensor 92, but also realizes processing related to deep learning on the edge side. It may be.

  In the second embodiment shown in FIG. 128, the terminal 20 does not have a GPS (Global Positioning System) function, but is equipped with a GPS function and refers to position information obtained by the GPS, for example, The user's flight distance and the remaining distance of the course may be measured, the club number to be used may be selected, or the height difference of the course may be detected and notified to the user 2.

  In the second embodiment, the Q-learning reward r is “1” when the form is improved. For example, the reward r is “1” when the flying distance of the ball is increased. Alternatively, it may be set to “1” when the score is improved.

  In the second embodiment described above, the case of preparing one advice has been described as an example for each improvement point. However, for example, a plurality of advices are prepared, and the plurality of advices are assigned to, for example, an attraction. It may be displayed at random and appropriate advice may be selected by an A / B test. For example, regarding a grown stance, “Please lower your right foot a little to make it a closed stance.” “Please make a closed stance that stands diagonally so that the right side of the body is away from the ball.” Prepare a closed stance by slightly lowering the right foot. ”And“ Please make a closed stance where the left foot goes forward and pull the right foot. ” You may make it choose quick advice.

  In the second embodiment described above, the moving image that has been shot is transmitted to the PC 50. However, the stream moving image output from the photographing unit 201 is transmitted to the PC 50 in real time via the communication unit 202, and the PC 50 The stream moving image received in step 1 may be sequentially processed. According to such a configuration, a result can be obtained quickly.

  Further, in the above embodiment, the case where a swing is photographed has been described as an example at a golf course or a driving range. For example, the image processing unit 801 synthesizes an image of a golf course or a driving range. While displaying on a device such as a smart display or smart glass or a head-mounted display, the user 2 can detect the swing movement / head speed of the user 2 with an acceleration sensor and display an image corresponding to the detected acceleration. You may be able to practice swing while at home by using so-called virtual reality that makes you feel as if you are practicing at a golf course or driving range. When practicing at home, one or a plurality of smart displays may be used in addition to the smart glasses and the head mounted display.

  In each of the above embodiments, the advice transmitted by the PC 50 is unilaterally presented to the user 2. For example, a response corresponding to the question of the user 2 is stored in the storage unit 501 or the like of the PC 50. Alternatively, advice corresponding to the inquiry of the user 2 may be acquired from the storage unit 501 and presented to the user 2 by, for example, FAQ of an AI chatbot.

  In the above embodiment, the first determination unit to the twenty-fifth determination unit are included. However, the first determination unit to the twenty-seventh determination unit may be included. The contents of the determination can be as follows.

(1) First determination unit (stance determination)
(1-1-1) Contents Stance = Closed Stance (1-2-1) On the other hand Square Stance, Open Stance (1-1-2) Contents Shoulder Line and Waist Line = Square with respect to the target direction line , The right shoulder should never come forward than the left shoulder (1-2-2) On the other hand, the shoulder line and the waist line are open to the left of the target with respect to the target direction, conversely to the right of the target Closed facing (1-3) Image detection feature amount and determination Image detection of the length of the difference between the position of the left foot toe and the position of the right foot toe

(2) Second determination unit (grip determination)
(2-1-1) Content Grip = Hook Grip (2-2-1) On the other hand Square Grip, Week Grip (2-1-2) Content Grip = Overwrapping, Tenfinger (2-2-2) Teacher Interlocking (2-3) Image detection feature quantity and determination Grip = Image detection of the area of the left back, gripping method = Overwrapping is whether the right little finger is placed on the left index finger, or ten fingers Determines if the grip is gripped with all 10 fingers

(3) Third determination unit (determination of ball position, stance width and weight distribution at the time of addressing)
(3-1-1) Contents The ball position from No. 7 I to PW is the center of the stance, and the stance width is about the shoulder width. Shorter AW and SW ball positions are slightly to the right of the center, and the stance width is about half of 7th I (3-1-2) Contents 6th I above, Utility and Fairway Wood ball positions Is a position to the left of the center and the stance width is slightly wider than the shoulder width (3-1-3) Contents Weight distribution = Weight distribution slightly to the right foot -2-3) On the other hand, the weight distribution near the left foot, the face is approaching the ball (3-1-4) Contents Weight distribution = the face is not close to the ball, the chin is not pulled, and the toes are slightly conscious (3-3) Image Detection Feature Amount and Determination Stance width = Slightly wider than shoulder width is detected by image detection, weight distribution = multiple regression analysis, for example, if objective variable is “weight shift” The variable is the body centerline "Head area or volume""Neck area or volume""Chest area or volume""Abdominal area or volume""Waist area or volume""Right leg area or volume""Left foot area or volume" Based on multiple measured values such as “area or volume”, “right arm area or volume” and “left arm area or volume” images, the predicted value of weight shift from left to right during takeback and from right to left during downswing is calculated. Let the AI study.

(4) Fourth determination unit (determination of shoulder line and head line at address)
(4-1-1) Contents The left and right shoulder lines = address, and the grip comes down on the right hand, so the lines on both shoulders will naturally fall slightly to the right and the left shoulder will be slightly higher ) On the other hand, the left and right shoulders are parallel, both shoulder lines are lowered to the left, and the right shoulder is lowered (4-1-2) Contents Head Line = Head is Vertical (4-2-2) Tends to the right (4-3) Image detection feature value and determination
"The left and right shoulder lines, the left and right waist lines, and the flying ball line vector direction are detected and determined. Judgment is made by drawing the line angle perpendicular to the image detection.

(5) Fifth determination unit (determination of toe and knee orientations of both feet at the time of addressing)
(5-1) Contents Both knees and toe orientation = knee / toe orientation is not just in front, but slightly outward (5-2) On the other hand Teachers Both knees and toes are in front and inward (5-3) Image detection feature quantity and determination Judgment is made by detecting whether the direction of the toes and knees is the outer vector direction.

(6) Sixth determination unit (determination of club shaft inclination at the time of addressing)
(6-1-1) Contents For wood clubs, hand rate = head first club shaft tilt (6-2-1) On the other hand, for wood clubs, hand first club shaft tilt (6-1-2) Contents Iron type is vertical or slightly hand-first club shaft tilt due to the structure of the club head and neck (6-3) Image detection feature quantity and judgment The club shaft tilt is vertical or slightly hand Judgment by detecting image of late angle

(7) Seventh determination unit (address position where the driver head is placed)
(7-1) Contents Since the ball is teeed up when using the driver, the position of the driver's head is placed about one centimeter away from the teeed-up ball by about 15 cm and addressed ( 7-2) On the other hand, when the driver's head is placed near the ball being teeed up, the right shoulder comes out at the address. (7-3) Image detection features and determination Image detection to determine if the position of the vaulting tee is set apart by the length of one head

(8) Eighth determination section (determination of driver face and ball setting position)
(8-1) Contents In the recent large metal heads, the top part of the face center slightly close to the toe is the point where the top part jumps the most, so set the head close to the center toe. (8-2) On the other hand Set the position at the center of the driver head. (8-3) Image detection feature quantity and determination Determine whether the ball position is set near the center toe of the driver head.

(9) Ninth determination unit (determination of the strength of the attitude at the time of addressing)
(9-1) Contents Addresses where both shoulders are put forward and the chest is closed, the left and right shoulder blades are opened to the outside, and both knees are stretched out from a stretched state (9-2) On the other hand, stretch the back, stretch the back, the address where the scapula is closed, both knees are stretched or bent deeply (9-3) Image detection features and determination Back curve and bending of both knees Judging by detecting the angle image

(10) Tenth determining unit (determining whether the left arm at the time of addressing is on the chest)
(10-1) Contents Turn left shoulder forward while being conscious of the left scapula so that the left arm is placed on the left chest from the back to the front of the chest, and the left side is firmly tightened. Grip and address (10-2) On the other hand, the left arm is gripped and addressed while it is just beside the body (10-3) Image detection feature quantity and determination The left side is firmly tightened, Image detection to determine if left arm is on left chest

(11) Eleventh determination unit (determination of forward leaning at the time of addressing, bending of the back muscles and bending of the knee)
(11-1) Contents Hold the chin without pulling it, lean forward from the hip joint so that the line of the back becomes the shape of the upper body and lower body, and do not stretch the back and back muscles lightly with the back of the cat An address with a curved posture (11-2) On the other hand, the teacher pulls the jaw, stretches the chest and stretches the back muscles, and leans forward (11-3) Image detection features and determination Check by image detection to determine, check by image detection to determine if the back muscle line is curved

(12) Twelfth judgment part When taking the back knee and stretching the right knee while taking back, the body naturally rotates in the back direction, and the left knee is kept until the waist is facing backward while the chest is facing upward. Determining whether the body is bent and taken back (12-1) Contents When taking back, the body can be easily turned back by bending the left knee so that the lower body of the entire chest and waist can be seen securely (12-2) Teacher Turn the left shoulder under the chin to raise the body's torsional consciousness, so that the body does not turn back firmly and the chest and waist do not turn back (12-3) Image detection features and determination Take back the knee of the left foot By consciously bending, the entire chest and waist will naturally face backwards, so the area of the entire chest and waist will be confirmed by image detection

(13) Thirteenth determining section (determining whether the club head is taken back in the direction of 45 degrees diagonally forward right using the weight shift from the left to the right of the club head during takeback)
(13-1) Contents To make an inside-out swing trajectory, takeback is started by moving the weight from left to right, the left hand is a vertical cock, and the right hand is laterally hinged. (13-2) On the other hand, when taking back the club head straight or taking the club head in the inside direction tends to cause an outside-in orbit, and when taking back, a triangle is formed with the chest and both arms. Make and raise without breaking (13-3) Image detection feature value and judgment During takeback, it is possible to detect whether the club head is on the outside from the line behind the ball as viewed from behind, or whether the club head is on the inside. Confirm and judge

(14) Fourteenth determination unit (determination of face rotation that opens 90 degrees during takeback)
(14-1) Contents When taking back with the right hand side hinged and the left hand vertical cocking, the head is tilted forward 45 degrees to the right and the right hand opens slightly while the left hand is triggered by the right hand and the upper is raised. When the grip comes to the level of the right waist, the 90 degree face rotation is completed where the shaft is parallel to the ground.
(14-2) On the other hand, the takeback does not rotate the face while keeping the face facing the ball. (14-3) Image detection features and determination Take the back and the club head is 45 degrees outward and right diagonally when viewed from the front. Whether the club head is taking back in the direction of is determined by checking the amount of angle by image detection, the swing plane will draw a figure of 8 The club's leading edge and face are at an angle perpendicular to the ground The image is detected and checked to determine if the right hand is opened little by little with the initial action of the takeback, the hinge starts so that the back of the left hand faces upward, the cocking of the left hand is triggered, the grip is at the height of the right waist, The shaft is parallel to the ground, completing a 90-degree face rotation. Check the flow by image detection and judge

(15) Fifteenth determination unit (face rotation determination that opens 90 degrees and returns 180 degrees during downswing)
(15-1) Contents The face rotation when closing the face during the downswing is because the face that started to close simultaneously with the downswing is not the image to return 180 degrees in the head before the impact. The swing has an impact with a strong image of “open 90 degrees and return 180 degrees” (15-2) On the other hand teacher takeback that does not rotate the face while keeping the face facing the ball with takeback (15-3) Image detection Judgment based on feature detection Judgment by image detection of face rotation movement in hinges where the right hand overtakes the left hand and the right hand is above the left hand during impact

(16) Sixteenth determination unit (swing axis determination)
(16-1) Contents The swing axis mainly composed of the right side is not the vertical left axis on the conventional left hip joint, but the central axis of the body. In other words, using the right hand and the right side means that the axis must be left.
(16-2) On the other hand, swing while weight is applied to the left leg, swing while weight is applied to the right leg (16-3) feature detection and determination of image detection Leave the weight on the right foot, move the body as it is, and use the image detection to determine if the swing is conscious of moving the head around the body with the right side as the axis

(17) Seventeenth determination unit (determination of opening of the right side at the top)
(17-1) Contents The right side is not closed, but the top is opened with the top as high as possible. (17-2) On the other hand, the right side is tightened with the top or down (17-3) Image Detection feature value and judgment Image detection confirms whether it is a flying elbow with the right side open at the top.

(18) Eighteenth determination unit (determination of grip position at the time of top)
(18-1) Contents At the top, so that the grip is positioned between the right ear and the right shoulder,
(18-2) On the other hand, the position of the grip at the time of top is off the inside of the body outside the right shoulder. While keeping the angle, open the right side and raise the grip as high as possible to become the top, then check by image detection to determine if the grip is in the middle of the right ear and right shoulder

(19) Nineteenth determination unit (determination of forward movement when switching from the top)
(19-1) Contents At the time of downswing, the right elbow is straightened and released, and at the same time the right elbow is twisted slightly to the left to create a chance to start closing the face. (19-2) On the other hand, open the face by tightening the right side during downswing (19-3) Image detection feature quantity and determination Image detection of whether the club head turns to the left when entering the downswing after turning back Confirm with

(20) 20th determination unit (determination as to whether or not the player is in the downswing with the chest and waist visible from behind when the downswing is turned from the turn)
(20-1) Contents At the time of downswing after turning back, the player enters the downswing with the chest and waist still facing backwards that can be seen from behind. If you do not move your body in the downswing, the centrifugal force of the club head will not be unraveled (20-2). On the other hand, if the chest and hips turn during the downswing after turning back, the body will open and the club head will not have the centrifugal force The flight distance is not.
(20-3) Image detection feature quantity and determination When entering a downswing after turning back, it is determined by detecting whether or not the release of the downswing is entered with the chest and waist still facing backwards from behind.

(21) Twenty-first determination unit (determination of the direction in which the right elbow and right wrist are released during the downswing)
(21-1) Contents The head trajectory where the club is swung down at the time of downswing is lowering the club diagonally to the right so that the acceleration zone becomes longer and the centrifugal force increases and the flight distance increases.
(21-2) On the other hand, “Grip trajectory” with the right elbow quickly attached to the right flank and cocked from the wrist with downsins
(21-3) Image detection feature amount and determination When entering the downswing, swing down with the image of hitting the right rear pile with a hammer as the direction to swing down, and the right elbow right wrist extends to release the club Confirm by image detection

(22) Twenty-second determination unit (determination of wrist hinge action during downswing)
(22-1) Contents The wrist work is softened, the right wrist is correctly hinged so that the nail side of the thumb is directed toward the user, and the club head is placed on a large track while the face is closed. The right hand hinge release action does not result in a hooked ball that is said to be a chipin even if it is released and impacted. Therefore, Qi-Ping comes out (22-3) Image detection feature amount and determination The right lateral hinge action of the right hand when entering the downswing is the right hand hinge action of the thumb nail side facing itself during face rotation. Confirm by image detection

(23) Twenty-third determination unit (determination of hip rotation and weight shift during downswing)
(23-1) Contents Right-side downswing is “not aware of weight shift”. Without being conscious of the weight shift at the time of getting on the left at the top turning back, “Do not move without conscious of the weight shift until the impact with the chest facing back without turning the waist”. Therefore, the right side-dominated swing functions and the twist can be used naturally, increasing the flight distance.
(23-2) On the other hand, with downsyn, the right elbow is quickly attached to the right flank, makes a slug, and cuts the waist. (23-3) Image detection features and determinations Without being conscious of the movement of the weight that got on the left from the top turnback, `` I judge by checking by image detection whether to swing down without turning the waist with the chest facing backwards as it is

(24) 24th determination unit (determination of twist during downswing)
(24-1) Contents During the downswing, “Do not move your body without consciousness of weight shift to impact with your chest facing back without turning your waist”. Then, the swing on the right side mainly works and the twist can be used naturally and the flight distance increases. In addition, if the right hand moves ahead of the left hand at the same time as the right hand is overtaking the left hand at the same time when swinging down from the top, if the right hand precedes the left hand, the head will precede the hand in the impact zone, Since there is no mistake that the grip like the left side main body precedes, the twist movement of the hand is always necessary (24-2) On the other hand, the right elbow is quickly attached to the right flank by downsyn, Make a Tail and Cut the Waist (24-3) Image Detection Feature Value and Determination Firstly, check by image detection to determine whether the right hand is overwhelming the left hand and at the same time downswing with image detection. Second, from the downswing to the impact, with your right foot toe facing outwards, strung your body strongly to brake the rotational movement of the body and At the time of impact, the right foot twist that leads to intense acceleration is confirmed by image detection and judged, and the third is using the hand twist while impacting the left foot knee without changing the head position and forward tilt posture Check by image detection to determine if a vertical twist is applied to extend and brake

(25) 25th determination unit (determination of whether the right shoulder does not come down during the downswing, or whether the right hip / right knee does not come forward)
(25-1) Contents Turned from the top and conscious of not changing the height of the right shoulder at the time of turning back and down swinging linearly moving the weight on the little finger base of the right foot toward the base of the thumb of the left foot It is important to have it, and it is also important to have the consciousness not to push the right shoulder forward. In addition, it is important to be aware that the lower body's right hips and knees are not pushed forward during the downswing. The right hip comes out and slices (25-3) Image detection feature amount and determination The image is checked to determine whether the height of the right shoulder at the top does not drop during downswing, and the right waist is determined.・ When the right knee is downswing, check by image detection to determine if it comes out before the left hip or left knee

(26) 26th determination unit (determination of whether the right foot heel is not lifted from the downswing to the impact, or whether the face is raised with a natural feeling by following)
(26-1) Contents If you put your weight on the right foot hip joint at the top, you have the consciousness of moving only the head around the body with the right side as the axis, so both feet firmly touch the ground from the address to the impact with the thumb ball. Keep stepping on. The point is the image that keeps straddling without raising the right foot from the address to the impact. However, after the impact, it will be pulled by the momentum of the head, so if the body naturally rotates to the left, the face will naturally go up with the right foot and move toward the target without being conscious. I will continue.
(26-2) On the other hand, if you continue to look at the impact follow and ball from the downswing, it will become a reverse pivot (Gittan Bakkon), the weight will remain on the left foot at the top, the right foot will remain on the downswing, and it will become a Gittan Bakkon swing The In Follow-up, the body becomes an unnatural inverted C type, and the distance does not go out and it hurts the lower back (26-3) Image detection feature amount and determination Image detection whether the right foot heel is floating from downswing to impact Confirm by checking the image, and by following the image, check if the face is rising naturally.

(27) Twenty-seventh determination unit (determination of ball direction and ball muscle)
(27-1) Contents The ball appears slightly to the right, and the ball is a straight ball or a light draw ball close to straight.
(27-2) On the other hand, it becomes a draw ball that bends greatly. (27-3) Image detection feature quantity and determination It is confirmed by image detection whether the ball after impact has come out a little to the right. Judgment

1 Golf swing improvement support system 2 User
10 PC
20 Terminal 101 Storage unit 102 Image processing unit 103 Communication unit 104 Analysis unit 105 Display unit (PC side)
106 1st determination part 107 2nd determination part 108 3rd determination part 109 4th determination part 110 5th determination part 111 6th determination part 112 7th determination part 113 8th determination part 114 8th 9 determination units 115 10th determination unit 116 11th determination unit 117 12th determination unit 118 13th determination unit 119 14th determination unit 120 15th determination unit 121 16th determination unit 122 17th determination unit Determination unit 123 18th determination unit 124 19th determination unit 125 20th determination unit 126 21st determination unit 127 22nd determination unit 128 23rd determination unit 129 24th determination unit 130 25th determination unit 150 AI Image Analysis Processing Unit 201 Imaging Unit 202 Communication Unit 203 Display Unit (User Side)
204 Transmission unit 205 Vibration unit 206 Preliminary unit 300 Large monitor (PC side)
400 Large monitor (user side)

The swing determination apparatus according to the present invention includes an input unit that inputs a moving image that captures a user's swing, a generating unit that decomposes the moving image input from the input unit into frames and generates a user image as a still image, from a plurality of the user image generated by the generating means, specifying means for specifying the user image including a plurality of target point is a point to be noted in determining the quality of the swing, the specific A plurality of determination means for comparing the user image including the predetermined attention point specified by the means and a teacher image as an image of the swing of the teacher to be compared to determine the quality of the swing; and the plurality of the determinations It has an output means for outputting a determination result by the means, wherein the determination means includes a neural network, with respect to the neural network, Using the teacher image which includes a constant point of interest to determine the quality of the swing by performing a learning process by deep learning, the neural network is to score the quality of the swing for a given target point by a multi-class classification, It is characterized by having.

Further, the present invention is characterized in that the neural network performs learning using a teacher image as an example of a bad form as the teacher image .

Further, the present invention is characterized in that the neural network performs learning using a teacher image as an example of a bad form as the teacher image .

Further, the present invention is characterized in that the output means outputs advice corresponding to the corresponding teacher .

In the invention, it is preferable that the neural network operates by an R2D2 algorithm having a learner and a plurality of actors .

The present invention also includes an input means for inputting a moving image that captures the user's swing;
When generating a user image as a still image by decomposing a moving image input from the input unit into frames, and determining whether or not the swing is good from among the plurality of user images generated by the generating unit Specifying means for specifying the user image including each of a plurality of attention points that are points to be noted, the user image including the predetermined attention point specified by the specifying means, and a teacher swing to be compared A plurality of determination means for comparing the teacher image as an image of the image to determine the quality of the swing, an output means for outputting the determination results by the plurality of determination means, and a teacher image as an image of the swing of the teacher as a model A storage means for storing a teacher image in which a feature point of the teacher's body is specified, and information relating to a point of interest in a swing in the teacher image A specifying means for specifying a feature point of the user's body in the user image obtained by the generating means, and a correspondence to the teacher image from among the plurality of user images for which the feature points have been specified. Extracting means for extracting the user image; and adjusting means for adjusting the user image extracted by the extracting means so as to be comparable to the teacher image with reference to the feature points; It said determining means, said user picture, adjusted by the adjusting means compares the point of interest of the teacher image, and determines the quality of the user's swing, characterized in that.

Further, in the present invention, when the feature amount at the attention point between the user image and the teacher image is different by a predetermined threshold or more, the determination unit determines that the attention point is NO, Otherwise, it is determined to be good .

Further, the present invention is characterized in that the determination means scores the quality of a swing according to a difference in feature amount at the attention point between the user image and the teacher image .

In addition, the present invention further includes a calculation unit that has a weighting factor for each point of interest, and calculates a swing score by cumulatively adding the weighting factor to the determination result of each determination unit. The score calculated by the calculation means is also output together .

According to the present invention, the swing is a golf swing, and the weighting coefficient is changed so as to be correlated with at least one of the user's motion, score, handicap, flight distance for each club, and head speed for each club. It further has a change means .

Further, according to the present invention, the swing is a golf swing, and the determination means relatively increases a value of the weighting coefficient of the user's right side space region, thereby determining the user's right side space region. It is characterized by preferential evaluation .

Further, the present invention provides a state specifying unit that specifies the swing state of the user based on a determination result by the determination unit, and advice according to the swing state of the user specified by the state specifying unit. Presenting means for presenting via the output means .

In addition, the present invention is characterized in that when there are a plurality of the advices, the presenting means has a determining unit that determines the order in which the plurality of advices are presented .

Further, the present invention is characterized in that the determining means determines an order in which the advice is presented by reinforcement learning .

Further, according to the present invention, the determination means gives a reward when the user's swing state is improved when the advice is presented, and updates the Q value according to the reward, thereby performing reinforcement learning. It is characterized by performing .

In addition, the present invention includes a head mounted display, smart glasses, or at least one external smart display used by the user, and the head mounted display, the smart glasses, or the external smart display. And a display means for displaying a golf course landscape and a multi-directional swing of the user, and changing the displayed landscape in accordance with the user's operation .

Further, the present invention obtains from the storage means a reception means for receiving the user inquiry, a storage means for storing a response to the inquiry, and a response corresponding to the inquiry received via the reception means, Presenting means for presenting to a user .

Further, the present invention provides an input step of inputting a moving image obtained by imaging a user's swing, a generating step of generating a user image as a still image by decomposing the moving image input from the input step into frames, A specifying step for specifying the user image including each of a plurality of attention points, which are points to be noted when determining whether or not a swing is good, from the plurality of user images generated in the step; A plurality of determination steps for determining whether the swing is good or not by comparing the user image including the predetermined attention point and a teacher image as a swing image of a teacher to be compared; determination results in the plurality of determination steps Functioning as an output step, and the determination step includes a neural network. , To determine the quality of the swing by performing learning processing by deep learning using the teacher image including the predetermined attention point for the neural network, the neural network relates to the predetermined attention point by multi-class classification The feature is that the quality of the swing is scored .

Further, the present invention provides an input step of inputting a moving image obtained by imaging a user's swing, a generating step of generating a user image as a still image by decomposing the moving image input from the input step into frames, A specifying step for specifying the user image including each of a plurality of attention points, which are points to be noted when determining whether or not a swing is good, from the plurality of user images generated in the step; A plurality of determination steps for determining whether the swing is good or not by comparing the user image including the predetermined attention point and a teacher image as a swing image of a teacher to be compared; determination results in the plurality of determination steps Functioning as an output step, and the determination step includes a neural network. , To determine the quality of the swing by performing learning processing by deep learning using the teacher image including the predetermined attention point for the neural network, the neural network relates to the predetermined attention point by multi-class classification The feature is that the quality of the swing is scored .

Further, the present invention provides an input step of inputting a moving image obtained by imaging a user's swing, a generating step of generating a user image as a still image by decomposing the moving image input from the input step into frames, A specifying step for specifying the user image including each of a plurality of attention points, which are points to be noted when determining whether or not a swing is good, from the plurality of user images generated in the step; A plurality of determination steps for determining whether the swing is good or not by comparing the user image including the predetermined attention point and a teacher image as a swing image of a teacher to be compared; determination results in the plurality of determination steps An output step for outputting a teacher image as a model swing image of the teacher, A storage step of storing a teacher image in which a feature point of the teacher's body is identified, and information on a point of interest of a swing in the teacher image in a storage unit, and the user image obtained in the generation step is reflected in the user image A specifying step of specifying a feature point of the user's body, an extracting step of extracting the user image corresponding to the teacher image from the plurality of user images in which the feature points are specified, and the extraction step extracted An adjustment step of adjusting a user image so that it can be compared with the teacher image with reference to the feature point, and the determination step includes the user image adjusted in the adjustment step, The point of interest with the teacher image is compared to determine whether the user's swing is good or bad .

Further, the present invention provides an input means for inputting a moving image obtained by imaging a user's swing, a generating means for generating a user image as a still image by decomposing the moving image input from the input means into frames, and the generation Specifying means for specifying the user image including each of a plurality of attention points, which should be noted when determining whether or not the swing is good, from among the plurality of user images generated by the means; specified by the specifying means A plurality of determination means for comparing the user image including the predetermined attention point and a teacher image as an image of the swing of the teacher to be compared to determine the quality of the swing, the determination results by the plurality of determination means A teacher image as an image of a teacher's swing as an example, wherein the teacher's body feature points are specified Storage means for storing the information about the attention point of the swing in the teacher image, specifying means for specifying the feature point of the user's body in the user image obtained by the generating means, and specifying the feature point Extracting means for extracting the user image corresponding to the teacher image from the plurality of user images, the user image extracted by the extracting means, with reference to the feature points, and the teacher image The adjustment means functions so as to make the comparison possible, and the determination means compares the attention points of the user image adjusted by the adjustment means and the teacher image to determine whether the user's swing is good or bad. It is characterized by determining .

Claims (20)

An input means for inputting a moving image of the user's swing;
Generating means for decomposing the moving image input from the input means into frames to generate a user image as a still image;
A specifying means for specifying the user images each including a plurality of attention points, which are points to be noted when determining the quality of a swing, from among the plurality of user images generated by the generation means;
A plurality of determining means for comparing the user image including the predetermined attention point specified by the specifying means and a teacher image as an image of a teacher swing to be compared to determine whether the swing is good or bad;
Output means for outputting determination results by the plurality of determination means;
A swing determination device characterized by comprising:   The determination unit includes a neural network, and determines whether the swing is good or bad by performing learning processing by deep learning on the neural network using the teacher image including a predetermined attention point. The swing determination apparatus according to claim 1.   The swing determination device according to claim 2, wherein the neural network scores the quality of the swing for a predetermined attention point by multi-class classification.   The swing determination apparatus according to claim 3, wherein the neural network performs learning by using a teacher image as an example of a bad form as the teacher image.   The swing determination apparatus according to claim 4, wherein the output unit outputs advice corresponding to the corresponding opposite teacher.   The swing determination apparatus according to claim 2, wherein the neural network is operated by an R2D2 algorithm having a learner and a plurality of actors. A storage unit that stores a teacher image as an image of a swing of a teacher who serves as a model, the teacher image specifying a feature point of the teacher's body, and information on the attention point of the swing in the teacher image;
Specifying means for specifying a feature point of the user's body in the user image obtained by the generating means;
Extracting means for extracting the user image corresponding to the teacher image from among the plurality of user images in which feature points are specified;
Adjusting the user image extracted by the extracting unit with reference to the feature point so as to be comparable with the teacher image;
The determination means compares the attention points of the user image adjusted by the adjustment means and the teacher image, and determines whether the user's swing is good or bad.
The swing determination device according to claim 1.   The determination means determines that the attention point is NO when the feature amount at the attention point of the user image and the teacher image is different by a predetermined threshold or more, and is good otherwise. The swing determination apparatus according to claim 7, wherein   9. The swing determination device according to claim 8, wherein the determination unit scores the quality of the swing according to a difference in feature amount at the attention point between the user image and the teacher image. It has a weighting factor for each point of interest, and further has a calculation means for calculating the score of the swing by cumulatively adding the weighting coefficient to the determination result of each determination means,
The swing determination apparatus according to claim 1, wherein the output unit also outputs the score calculated by the calculation unit. The swing is a golf swing,
And a change means for changing the weighting factor so as to be correlated with at least one of the user's action, score, handicap, flight distance for each club, and head speed for each club.
The swing determination apparatus according to claim 10. The swing is a golf swing,
The determination unit preferentially evaluates the right side space area of the user by relatively increasing the value of the weighting coefficient of the right side space area of the user.
The swing determination apparatus according to claim 10 or 11, wherein Based on the determination result by the determination means, state specifying means for specifying the state of the user's swing;
Presenting means for presenting advice according to the swing state of the user specified by the state specifying means via the output means;
The swing determination device according to claim 1, further comprising:   14. The swing determination apparatus according to claim 13, further comprising a determining unit that determines an order in which the plurality of advices are presented by the presenting unit when there are a plurality of the advices.   The swing determination apparatus according to claim 14, wherein the determination unit determines an order in which the advice is presented by reinforcement learning.   The determination means gives a reward when the user's swing state is improved when the advice is presented, and executes reinforcement learning by updating a Q value according to the reward. The swing determination device according to claim 15. A head-mounted display used by the user, smart glasses, or at least one external smart display;
A display for displaying a golf course landscape and a user's multi-directional swing on the head-mounted display, the smart glass, or the external smart display, and changing the displayed landscape according to the user's operation. Means,
The swing determination device according to claim 11, comprising: Receiving means for receiving the user's inquiry;
Storage means for storing a response to the inquiry;
Presenting means for obtaining a response corresponding to the inquiry received via the receiving means from the storage means and presenting it to the user;
The swing determination device according to claim 1, comprising: A generation step of generating a user image as a still image by decomposing the moving image input from the input means into frames;
A specifying step of specifying the user images each including a plurality of points of interest, which are points to be noted when determining the quality of the swing, from among the plurality of user images generated in the generation step;
A plurality of determination steps for comparing the user image including the predetermined attention point specified in the specifying step and a teacher image as an image of a teacher swing to be compared to determine whether the swing is good or bad;
An output step for outputting the determination results in the plurality of determination steps;
A swing determination method characterized by comprising: Computer
Input means for inputting a moving image of the user's swing;
Generating means for decomposing the moving image input from the input means into frames and generating a user image as a still image;
A specifying means for specifying the user images each including a plurality of attention points, which are points to be noted when determining whether or not the swing is good, from the plurality of user images generated by the generation means;
A plurality of determining means for comparing the user image including the predetermined attention point specified by the specifying means and a teacher image as a swing image of a teacher to be compared to determine whether the swing is good or bad;
Output means for outputting determination results by the plurality of determination means;
A computer-readable program characterized in that it functions as a computer program.