JP2022104634A - Golf swing analysis system, golf swing analysis method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a golf swing analysis system, a golf swing analysis method and a program allowing a player to easily acquire whether or not to swing correctly.

SOLUTION: A captured moving image acquisition part 70 acquires a captured moving image in which a player playing a golf swing is reflected. A swing trajectory type specification part 86 specifies at least one reference angle based on at least one of a position of a prescribed body part of the player in addressing or a position of a shaft in addressing specified based on the captured moving image. The swing trajectory type specification part 86 specifies a swing-down angle of a club head appearing in the captured moving image based on the captured moving image. The swing trajectory type specification part 86 compares the reference angle and the swing-down angle.

SELECTED DRAWING: Figure 3

COPYRIGHT: (C)2022,JPO&INPIT

Description

The present invention relates to a golf swing analysis system, a golf swing analysis method and a program.

Patent Document 1 describes a technique for displaying a histogram generated by factors such as the inclination of both shoulders of a player who has performed a golf swing, the position of the wrist, the center position of the stance, the width of the stance, and the swing plane angle. ing.

Japanese Unexamined Patent Publication No. 2014-186168

Even if the technique described in Patent Document 1 is used, a general player who does not have knowledge about golf such as a range of an appropriate swing plane angle cannot grasp whether or not he / she can swing correctly.

The present invention has been made in view of the above problems, and one of the objects thereof is to provide a golf swing analysis system, a golf swing analysis method, and a program in which a player can easily grasp whether or not a player can swing correctly. ..

The golf swing analysis system according to the present invention comprises a shooting moving image acquisition means for acquiring a shooting moving image of a player who is swinging golf, and a shooting moving image of the player at an address, which is specified based on the shooting moving image. A reference angle specifying means for specifying at least one reference angle based on at least one of the position of a predetermined body part or the position of the shaft at the time of addressing, and a club appearing in the shooting moving image based on the shooting moving image. It includes a swing-down angle specifying means for specifying a swing-down angle of the head, and a comparison means for comparing the reference angle with the swing-down angle.

One aspect of the present invention further includes a swing trajectory type specifying means for specifying the type of swing trajectory in the swing based on the comparison result between the reference angle and the swing down angle.

In this aspect, the reference angle specifying means identifies the first reference angle based on the position of the predetermined body part, and the reference angle specifying means is based on the position of the shaft. The reference angle is specified, and the swing trajectory type specifying means determines the swing trajectory in the swing based on the first reference angle, the second reference angle, and the swing-down angle. It may be specified whether it is inside-out, inside-in, or outside-in.

Further, in one aspect of the present invention, the reference angle specifying means is based on the position of the predetermined body portion and the position of the ball before being swung, which is specified based on the captured moving image. Specify the reference angle.

In this aspect, the ball trajectory specifying means for specifying the trajectory of the ball reflected in the captured moving image based on the captured moving image is further included, and the reference angle specifying means is specified based on the trajectory, swing. The reference angle may be specified based on the position of the ball before it is made.

Further, in one aspect of the present invention, the reference angle specifying means specifies the reference angle represented by the two-dimensional image coordinate system of the captured moving image, and the swing-down angle specifying means is the captured moving image. The swing-down angle represented by the two-dimensional image coordinate system of is specified.

Further, in one aspect of the present invention, the shooting moving image acquisition means acquires the shooting moving image in which the player is viewed from behind in the target direction of the ball.

Further, in one aspect of the present invention, the analysis moving image generation means for generating the analysis moving image in which the line representing the reference angle is superimposed on the photographed moving image may be further included.

Further, the golf swing analysis method according to the present invention includes a step of acquiring a shooting moving image of a player who is swinging golf, and a predetermined position of the player at the time of addressing, which is specified based on the shooting moving image. A step of specifying at least one reference angle based on at least one of the position of a body part or the position of the shaft at the time of addressing, and the swing-down angle of the club head shown in the moving image based on the moving image. Includes a step of specifying the reference angle and a step of comparing the reference angle with the swing-down angle.

Further, the program according to the present invention includes a procedure for acquiring a shooting moving image of a player who is swinging golf, and a predetermined body part of the player at the time of addressing, which is specified based on the shooting moving image. A procedure for specifying at least one reference angle based on at least one of the positions of the shaft at the time of position or address, a procedure for specifying a swing-down angle of the club head reflected in the shooting moving image based on the shooting moving image, Have the computer perform the procedure of comparing the reference angle with the swing-down angle.

It is a figure which shows an example of the structure of the user terminal which concerns on one Embodiment of this invention. It is a figure which shows an example of the frame image included in the analysis moving image. It is a functional block diagram which shows an example of the function of the user terminal which concerns on one Embodiment of this invention. It is a figure which shows an example of a player area. It is a figure which shows an example of the comparison result image. It is a figure which shows an example of the origin area. It is a figure which shows an example of a candidate ball position. It is a figure which shows an example of a ballistic list candidate. It is a figure which shows an example of a candidate ball position. It is a figure which shows an example of a ballistic list candidate. It is a figure which shows an example of a candidate ball position. It is a figure which shows an example of a ballistic list candidate. It is a figure which shows an example of the top position frame image. It is a figure which shows an example of an impact frame image. It is explanatory drawing explaining an example of the right-and-left angle absolute value and the bending angle absolute value. It is a figure which shows an example of a head detection area. It is a figure which shows an example of a club pass angle. It is a figure which shows an example of a launch angle. It is a figure which shows an example of a reference angle. It is a figure which shows an example of the swing-down angle. It is a figure which shows an example of the variation of an impact image. It is a flow diagram which shows an example of the flow of the process performed in the user terminal which concerns on one Embodiment of this invention.

Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.

FIG. 1 is a diagram showing an example of the configuration of a user terminal 10 according to an embodiment of the present invention.

The user terminal 10 according to the present embodiment is a computer such as a mobile phone (including a smartphone) and a mobile information terminal (including a tablet computer). As shown in FIG. 1, the user terminal 10 according to the present embodiment includes a processor 20, a storage unit 22, a communication unit 24, a touch panel 26, a camera unit 28, and a sensor unit 30.

The processor 20 is, for example, a program control device such as a microprocessor that operates according to a program installed in the user terminal 10. The storage unit 22 is, for example, a storage element such as a ROM or RAM, a solid state drive (SSD), or the like. The storage unit 22 stores a program or the like executed by the processor 20. The communication unit 24 is, for example, a communication interface for wired communication or wireless communication, and exchanges data with a computer such as a server via a computer network such as the Internet.

The touch panel 26 displays and outputs information according to an instruction input from the processor 20, and outputs the content of an operation performed by the user to the processor 20, for example.

The camera unit 28 is, for example, a shooting device such as a digital video camera capable of shooting a moving image.

The sensor unit 30 is a sensing device such as a GPS module, an acceleration sensor, or a motion sensor. In this embodiment, the case where the sensor unit 30 is included in the user terminal 10 will be described, but the sensor unit 30 may be outside the user terminal 10.

In the present embodiment, for example, a user who operates the user terminal 10 (hereinafter, referred to as an operating user) swings golf using the camera unit 28 of the user terminal 10 at a golf course or a driving range. Take a picture of the player. Then, a moving image showing the player making the swing is generated.

In this embodiment, prior to the shooting of the swing, the position of the player with respect to the position of the camera unit 28 is within a predetermined allowable range, and the orientation of the player with respect to the shooting direction is within the predetermined allowable range. , The position and inclination of the user terminal 10 are adjusted. Then, in the present embodiment, after the adjustment of the user terminal 10 is performed, when the operating user performs a predetermined operation, the camera unit 28 takes a picture of the player, and a moving image of the player making the swing is captured. An image is generated. In the present embodiment, it is assumed that a moving image having a predetermined frame rate (for example, 60 fps) is generated.

Then, in the present embodiment, by executing the camera shake correction process on the moving image generated in this way, each frame image is corrected so that the player appears at substantially the same position in all the frame images. To. Hereinafter, the moving image on which the image stabilization process is executed will be referred to as a shooting moving image. In the present embodiment, it is assumed that the number of vertical and horizontal pixels of the frame image included in the generated moving image is the same.

Hereinafter, the frame image whose frame number is n (n = 1, 2, 3, ...) Will be referred to as a frame image (n). Further, the frame corresponding to the frame image (n) is expressed as the nth frame.

Then, in the present embodiment, the swing analysis process is performed on the captured moving image. Then, an analysis moving image in which an image showing the result of the swing analysis processing is superimposed on the captured moving image is generated. Then, the generated analysis moving image is stored in the storage unit 22 of the user terminal 10.

Then, for example, a user of the user terminal 10 such as the above-mentioned player or operation user can reproduce the analysis moving image stored in the storage unit 22 by performing a predetermined operation as appropriate.

FIG. 2 is a diagram showing an example of a frame image at the time of finishing included in the analyzed moving image to be reproduced. In the frame image shown in FIG. 2, the club head trajectory effect image 42 representing the trajectory of the club head and the ball trajectory effect image 44 representing the trajectory of the ball are included in the frame image included in the shooting motion image captured by the player 40. It is superimposed.

Further, the analysis result information 46 is arranged in the upper right of the frame image shown in FIG. In the example of FIG. 2, as the analysis result information 46, a character string indicating the ball speed, the flight distance, and the type of the swing trajectory such as outside-in, inside-in, inside-out, etc. is arranged.

Further, in the lower left of the frame image shown in FIG. 2, an impact image 48 representing the trajectory of the club head, the direction of the club face at the time of impact, and the bending direction of the ball is arranged.

The impact image 48 shown in FIG. 2 includes a head moving direction image 50, a face orientation image 52, and a ball direction image 54. The head moving direction image 50 is, for example, an image showing the moving direction of the club head at the time of impact. In the example of FIG. 2, the direction in which the arrows are lined up corresponds to the moving direction of the club head at the time of impact. The face-oriented image 52 is, for example, an image showing the orientation of the club face at the time of impact. In the example of FIG. 2, the face-oriented image 52 is an image on a line, and the stretching direction of the face-oriented image 52 is the impact. Corresponds to the direction of the face of the club at the time of. The ball direction image 54 is, for example, an image showing the pop-out direction and the bending direction of the ball. In the ball direction image 54 according to the present embodiment, the direction perpendicular to the stretching direction of the face-oriented image 52 on the line is shown as the pop-out direction of the ball.

Further, the frame image shown in FIG. 2 includes a V zone image 56 showing a V zone in which it is desirable that the trajectory of the club head passes during a downswing.

As described above, according to the present embodiment, the user of the user terminal 10 can confirm the analysis result of the golf swing performed by the player.

Hereinafter, the functions of the user terminal 10 according to the present embodiment and the processes executed by the user terminal 10 according to the present embodiment will be further described with a focus on the swing analysis process described above.

FIG. 3 is a functional block diagram showing an example of a function implemented in the user terminal 10 according to the present embodiment. It should be noted that it is not necessary for the user terminal 10 according to the present embodiment to implement all of the functions shown in FIG. 3, and functions other than the functions shown in FIG. 3 may be implemented.

The user terminal 10 according to the present embodiment has a function as a swing analysis system for analyzing a golf swing. Then, as shown in FIG. 3, the user terminal 10 according to the present embodiment is functionally, for example, functionally, for example, a shooting moving image acquisition unit 70, a player area specifying unit 72, a comparison result image generation unit 74, and a starting point area specifying unit. 76, ball trajectory specifying unit 78, flight distance calculation unit 80, club head trajectory specifying unit 82, launch direction specifying unit 84, swing trajectory type specifying unit 86, bending direction determination unit 88, analysis moving image generation unit 90, analysis moving image A storage unit 92 and a display control unit 94 are included.

Shooting motion image acquisition unit 70, player area identification unit 72, comparison result image generation unit 74, starting point area identification unit 76, ball trajectory identification unit 78, flight distance calculation unit 80, club head trajectory specification unit 82, launch direction specification unit 84. , The swing trajectory type specifying unit 86, the bending direction determination unit 88, and the analysis moving image generation unit 90 are mainly mounted with the processor 20. The analysis moving image storage unit 92 mainly implements the storage unit 22. The display control unit 94 mainly mounts the processor 20 and the touch panel 26.

The above functions may be implemented by executing a program installed on the user terminal 10 which is a computer and including a command corresponding to the above functions on the user terminal 10. Further, this program may be supplied to the user terminal 10 via a computer-readable information storage medium such as an optical disk, a magnetic disk, a magnetic tape, or a magneto-optical disk, or via the Internet or the like.

In the present embodiment, the shooting moving image acquisition unit 70 acquires, for example, a shooting moving image in which a player 40 swinging golf is captured. Here, as described above, the captured moving image after the image stabilization process is executed may be acquired.

Further, as shown in FIG. 2, the shooting moving image may be a moving image taken by the player 40 from one direction. Further, the captured moving image may be a moving image showing the player 40 viewed from behind the target direction of the ball.

As described above, in the present embodiment, it is assumed that a shooting moving image shot at a predetermined frame rate (for example, 60 fps) is acquired.

In the present embodiment, the player area specifying unit 72 specifies, for example, the player area 96 exemplified in FIG. 4, which is an area in which the player 40 is captured in the frame image included in the shooting moving image.

Here, for example, a trained machine learning model such as OpenPose may be installed in the user terminal 10 according to the present embodiment. Then, the player area specifying unit 72 may specify the positions of the nodes and links of the skeleton model 98 representing the skeleton (bone) of the player 40 in the frame image by using the trained machine learning model. .. The positions of the plurality of nodes included in the skeleton model 98 shown in FIG. 4 are associated with the positions of body parts of the player 40, such as shoulders and hips, respectively.

The player area specifying unit 72 may specify a rectangular area whose position, shape, and size are specified as the player area 96 based on the skeleton model 98. For example, a region obtained by enlarging a rectangular region circumscribing the skeleton model 98 at a predetermined magnification without changing the position of the center may be specified as the player region 96.

Here, the player area 96 may be specified based on one representative frame image. Further, the player area 96 may be specified based on a plurality of frame images. In this case, an area representing a rectangular area specified for a plurality of frame images, such as a common area or an average area of the rectangular area specified for the plurality of frame images, may be specified as the player area 96.

Further, when a person other than the player is reflected in the shooting moving image, a plurality of candidates for the player area 96 may be specified. In this case, any one candidate may be specified as the player area 96 based on given conditions such as the size of the area, the distance from the center of the frame image, the ratio of the height and the width of the area, and the like. ..

In the present embodiment, the comparison result image generation unit 74 generates the comparison result image illustrated in FIG. 5 by using, for example, an image difference method based on a captured moving image.

In the present embodiment, a comparison result image associated with the frame image is generated for each of the plurality of frame images included in the captured moving image. For example, for the frame image (n), the comparison result image (n) is generated as the corresponding comparison result image.

The comparison result image generation unit 74 may generate a comparison image by, for example, smoothing the frame images of a predetermined number of consecutive frame images (for example, 20 frames). For example, the comparative image (n) may be generated by smoothing 20 frame images from the frame image (n-20) to the frame image (n-1) included in the captured moving image. For example, for each pixel, the average value of the pixel values of the pixels corresponding to the pixels in the frame images from the frame image (n-20) to the frame image (n-1) is set to the pixel values of the pixels. A comparative image (n) may be generated.

Then, the comparison result image generation unit 74 has, for each pixel associated with each other, the pixel value in the frame image (n) which is the next frame image of the predetermined number of frame images and the comparison target image (n). Calculate the difference from the pixel value in. Then, the comparison result image generation unit 74 generates a comparison result image (n) indicating whether or not the difference between the pixel values of the frame image (n) and the comparison target image (n) is equal to or greater than a predetermined value for each pixel. do. In the comparison result image shown in FIG. 5, pixels having a pixel value difference of greater than or equal to a predetermined value are represented in white, and pixels having a pixel value less than a predetermined value are represented in black. Hereinafter, a pixel in which the difference between the pixel values is equal to or larger than a predetermined value, that is, a pixel represented in white in the comparison result image shown in FIG. 5 is referred to as a change pixel.

In the present embodiment, when the comparison image is generated based on the 20 frame images as described above, the comparison result image associated with the frame image is the frame image after the frame image (21). Generated.

In the present embodiment, the starting point region specifying unit 76 specifies, for example, the starting point region 100 used for specifying the trajectory of the ball by the ball trajectory specifying unit 78, which will be described later, as exemplified in FIG.

The starting point region 100 according to the present embodiment is, for example, a rectangular region uniquely specified based on the player region 96. Here, for example, the position of the left side of the starting point region 100 may be the same as the position of the left side of the frame image, and the position of the right side of the starting point region 100 may be the same as the position of the right side of the frame image. Further, the position of the upper side of the starting point region 100 may be a position that is 30% below the vertical length of the player area 96 from the upper side of the player area 96. Further, the position of the lower side of the starting point region 100 may be the same position as the position of the lower side of the player area 96 or a position passing through the feet of the player 40. Note that this method is only an example of a method for specifying the starting point region 100, and the starting point region 100 may be specified by another method.

In the present embodiment, the ball trajectory specifying unit 78 specifies the trajectory of the ball reflected in the captured moving image, for example, based on the captured moving image.

In the present embodiment, the trajectory of the ball is specified as a list of a plurality of frame images included in the captured moving image in which the positions where the balls appear in the frame images are related to each other. Hereinafter, the list will be referred to as a ballistic list.

Hereinafter, an example of the ball trajectory specifying process by the ball trajectory specifying unit 78 will be described with reference to FIGS. 7 to 12.

As described above, it is assumed that the comparison result image associated with the frame image is generated for the frame images after the frame image (21). In this case, with respect to the comparison result image after the comparison result image (21), at least one pixel block of the changing pixel, which is in the range of a predetermined number of pixels and is in the predetermined region, is specified. Then, the position of the representative point (for example, the center) of these pixel clusters is specified as the candidate ball position.

Here, for example, the candidate ball positions are not specified up to the comparison result image (n-1), and the three candidate ball positions (P (n, a), P) shown in FIG. 7 are shown in the comparison result image (n). It is assumed that (n, b) and P (n, c)) are specified.

Then, the candidate ball positions, which are the first elements of the ballistic list candidates (hereinafter referred to as ballistic list candidates), are narrowed down. For example, the candidate ball position outside the starting point region 100 is excluded from the candidate ball position. In this way, P (n, a) is excluded from the candidate ball positions that are the first elements, and P (n, b) and P (n, c) are narrowed down as the candidate ball positions that are the first elements. Is done.

In this case, as shown in FIG. 8, P (n, b) and P (n, c), each of which has one element, are specified as ballistic list candidates.

Then, it is assumed that the three candidate ball positions (P (n + 1, a), P (n + 1, b), and P (n + 1, c)) shown in FIG. 9 are specified in the comparison result image (n + 1).

In addition to these candidate ball positions, FIG. 9 shows P (n, b) and P (n, c) that are not excluded from the candidate ball positions.

In this case, P (n + 1, a) outside the starting point region 100 is excluded from the candidate ball position that is the first element. On the other hand, P (n + 1, b) and P (n + 1, c) are narrowed down as candidate ball positions to be the first elements.

Further, in the situation where the ballistic list candidate already exists, the candidate ball position associated with the ballistic list candidate that already exists is also specified.

For example, from among P (n + 1, a), P (n + 1, b), and P (n + 1, c), the candidate ball position associated with P (n, b) is specified. For example, the length from P (n, b) is longer than the predetermined length, the length from P (n, b) is shorter than the predetermined length, and the position is lower than P (n, b). Those that satisfy certain conditions such as are excluded from the candidate ball positions associated with P (n, b). For example, P (n + 1, c) is excluded from the candidate ball positions because the position is lower than P (n, b). Then, P (n + 1, a) and P (n + 1, b) are narrowed down as candidate ball positions associated with P (n, b).

Similarly, from among P (n + 1, a), P (n + 1, b), and P (n + 1, c), the candidate ball position associated with P (n, c) is specified. Here, for example, P (n + 1, c) is excluded from the candidate ball positions because the position is lower than P (n, c). Then, P (n + 1, a) and P (n + 1, b) are narrowed down as candidate ball positions associated with P (n, c).

Then, as shown in FIG. 10, ballistic list candidates are added. In the above example, P (n + 1, b), P (n + 1, c), P (n, b) -P (n + 1, a), P (n, b) -P (n + 1, b), P (n). , C) -P (n + 1, a), P (n, c) -P (n + 1, b) are added to the ballistic list candidates. FIG. 10 also shows a ballistic candidate list that includes a plurality of candidate ball positions associated with each other. For example, the element P (n, b) and the ballistic list candidate including the element P (n + 1, a) are shown in FIG. 10 as P (n, b) -P (n + 1, a). Note that P (n, b) and P (n, c) shown in FIG. 8 are not overwritten and are left as ballistic list candidates.

Then, it is assumed that the two candidate ball positions (P (n + 2, a) and P (n + 2, b)) shown in FIG. 11 are specified in the comparison result image (n + 2).

In addition to these candidate ball positions, FIG. 11 also shows candidate ball positions that are not excluded. From this, P (n + 2, a) outside the starting point region 100 is excluded from the candidate ball position that is the first element. On the other hand, P (n + 2, b) is narrowed down as a candidate ball position as a starting point.

Further, as described above, the position of the candidate ball associated with the ballistic list candidate having one element is specified. For example, P (n + 2, b) is excluded from the candidate ball positions associated with P (n, c) because the length from P (n, c) is shorter than the predetermined length. Further, P (n + 2, a) is excluded from the candidate ball positions associated with P (n + 1, c) because the length from P (n + 1, c) is longer than the predetermined length.

From here, the position of the candidate ball associated with the ballistic list candidate having a plurality of elements is also specified. In this case, the length from the candidate ball position, which is the last element of the ballistic list candidate, is longer than the predetermined length, the length from the candidate ball position, which is the last element of the ballistic list candidate, is shorter than the predetermined length, and the trajectory. Anything that satisfies certain conditions, such as being below the candidate ball position, which is the last element of the list candidate, may be excluded from the candidate ball positions associated with the ballistic list candidate.

In addition to these conditions, for example, the angle of the trajectory suddenly changes (turns beyond a predetermined angle), the speed of the trajectory suddenly changes (shorter or longer than a predetermined length), or the direction of the trajectory changes. Candidates associated with ballistic list candidates also satisfy certain conditions for a ballistic list candidate that includes multiple elements, such as (the ballistics heading to the right go to the left, or the ballistics heading to the left go to the right). It may be excluded from the ball position.

In the example of FIG. 11, P (n + 2, a) has a sudden change in the angle of the trajectory with respect to the trajectory connecting P (n, b) and P (n + 1, b), so that P (n, b) ) -Excluded from the candidate ball positions associated with P (n + 1, b). Further, since P (n + 2, a) has a suddenly slower trajectory than the trajectory connecting P (n, c) and P (n + 1, a), P (n, c)-. It is excluded from the candidate ball positions associated with P (n + 1, a).

For example, in this way, as shown in FIG. 12, five ballistic list candidates are added. Here, each of the two elements associated with each other included in the ballistic list candidate, such as P (n, b) -P (n + 2, a) and P (n, c) -P (n + 2, a). The frames corresponding to may not be continuous. However, for example, a candidate ball position separated by a predetermined number of frames (for example, 4 frames) or more from the frame corresponding to the last element of the ballistic list candidate is excluded from the candidate ball positions associated with the ballistic list candidate. You may do it.

As described above, in the present embodiment, a plurality of ballistic list candidates are specified. Then, among these ballistic list candidates, the one having the largest number of elements (candidate ball positions) included in the ballistic list candidates is specified as the ballistic list. Hereinafter, the candidate ball position, which is an element included in the specified ballistic list, will be referred to as a ballistic ball position.

Here, for example, the ballistic list may be specified according to other criteria. For example, a trajectory list candidate representing a trajectory closest to a straight line may be specified as a trajectory list.

As described above, the ballistic ball position is usually specified for about 50 frames immediately after the impact, but the ballistic ball position for all the frames up to the landing point is not specified.

Then, the ball trajectory specifying unit 78 is represented by the image two-dimensional coordinate system of the captured moving image by performing, for example, linear estimation based on the ballistic ball position in each frame specified as described above. Identify the trajectory of the trajectory.

Then, by extending the specified locus downward and extrapolating it, the frame number corresponding to the timing at which the vertical position in the frame image is at a predetermined position is set as the frame number corresponding to the impact timing. Identify. In this embodiment, the frame number is specified in a unit finer than an integer, for example, 103.195. Hereinafter, the frame corresponding to the frame number specified in this way will be referred to as an impact frame.

Then, the ball trajectory specifying unit 78 specifies the position of the ball (hereinafter, referred to as an initial position) before being shot. For example, the ball trajectory specifying unit 78 identifies frame images in the frames immediately before and after the impact frame. For example, when the frame number of the impact frame is 103.195, the frame having the frame number 103 corresponds to the frame immediately before the impact frame, and the frame having the frame number 104 corresponds to the frame immediately after the impact frame. do. In this case, the frame image (103) is specified as the frame image in the frame immediately before the impact frame. Further, the frame image (104) is specified as a frame image in the frame immediately after the impact frame.

Then, the ball trajectory specifying unit 78 detects an object that exists in the frame image immediately before the impact and does not exist in the frame image immediately after the impact by comparing these two frame images. Then, the ball trajectory specifying unit 78 identifies the position of the detected object as the initial position.

If the initial position cannot be specified in this way, the ball trajectory specifying unit 78 may detect the shaft from the frame image of the frame at the time of addressing (for example, the fifth frame). Then, the ball trajectory specifying portion 78 includes a line extending the detected shaft and a line extending in the left-right direction at a position 10% above the vertical length of the player area 96 from the lower side of the player area 96. The position of the intersection of the above may be specified as the initial position.

When the ballistic ball position is specified based on the comparison result image, the initial position, which is the position of the ball that is not moving in the placed state, does not become a change pixel and cannot be detected. Also, it is highly possible that the ball is hidden by the club head before the shot. Even in such a situation, in the present embodiment, the initial position can be specified as described above.

In the present embodiment, the flight distance calculation unit 80 calculates, for example, the head speed, the ball speed, and the flight distance of the shot taken by the player 40.

For example, the flight distance calculation unit 80 first extracts, for example, a top position frame image in which the club head appears on the far left and an impact frame image in which the club head appears on the far right from the frame images included in the shooting moving image. do. FIG. 13 is a diagram showing an example of a top position frame image. FIG. 14 is a diagram showing an example of an impact frame image.

Then, the flight distance calculation unit 80 has the coordinate values (x, y) of the club head in the top position frame image and the coordinate values (x') of the head in the impact frame image, which are represented by the two-dimensional image coordinate system of the frame image. , Y') and. Then, the flight distance calculation unit 80 calculates the head movement distance D1 in the image based on the coordinate values (x, y) and the coordinate values (x', y'). Here, D1 is, for example, the square root of the sum of the square of (x'-x) and the square of (y'-y). In the frame image, the right direction is the x-axis positive direction and the downward direction is the y-axis positive direction.

Then, the flight distance calculation unit 80 multiplies the difference between the frame number of the impact frame and the frame number of the top position frame image by the shooting time interval (for example, 1/60 second) to obtain the head movement time T1 (head movement time T1). Calculated as seconds).

Then, the flight distance calculation unit 80 calculates the value obtained by dividing the value D1 by the value T1 as the head speed S (meters per second).

Then, the flight distance calculation unit 80 calculates a value obtained by multiplying the head speed S by a predetermined provisional meet rate 1.25 as the provisional ball initial velocity V (meters per second).

Then, the flight distance calculation unit 80 calculates a value obtained by multiplying the temporary ball initial velocity V by a predetermined coefficient 4 × 0.8 × 1.0936 as the temporary total flight distance D2 (yards).

Then, the flight distance calculation unit 80 moves up and down in the camera coordinate system in the frame based on the coordinate values of the ballistic ball positions in the frame image represented by the two-dimensional image coordinate system of the frame image for each frame image. Specify the angle and the left-right angle. Here, the coordinate value of the ballistic ball position with respect to the frame image (n) is expressed as (x1 (n), y1 (n)), and the vertical angle in the camera coordinate system in the frame corresponding to the frame image (n) is a1. It is expressed as (n), and the left-right angle is expressed as a2 (n). Here, the vertical angle in the camera coordinate system refers to the vertical angle when the ball is viewed from the camera unit 28 with respect to a predetermined direction, and the horizontal angle refers to the vertical angle with respect to the predetermined direction. Refers to the angle in the left-right direction when the ball is viewed from the portion 28.

In the present embodiment, as described above, the position and inclination of the user terminal 10 are adjusted, so that the two-dimensional coordinate value of the ball position can be associated with the vertical angle and the horizontal angle on a one-to-one basis. It has become. Therefore, in the present embodiment, for example, by referring to the data indicating the conversion formula and the conversion table held in advance by the flight distance calculation unit 80, the vertical angle and the horizontal angle can be determined based on the two-dimensional coordinate values of the ball position. It can be uniquely identified.

Similarly, the flight distance calculation unit 80 has a vertical angle a1'and a horizontal angle when the ball at the initial position is viewed from the camera unit 28 based on the coordinate values (x0, y0) of the initial position of the ball. Identify a2'.

Then, the flight distance calculation unit 80 specifies a parabola representing the trajectory of the ball's trajectory in the three-dimensional space, which is associated with the provisional total flight distance D2, based on the calculated provisional total flight distance D2. In this embodiment, the provisional total flight distance D2 and the shape of the parabola are associated with each other in advance. Then, the flight distance calculation unit 80 calculates the three-dimensional coordinate value of the position of the ball in the three-dimensional space along the parabola corresponding to the vertical angle and the horizontal angle. Here, for example, for the frame corresponding to the frame image (n), the three-dimensional coordinate values (x2 (n), y2 (x2 (n), y2) are based on the above-mentioned parabola, vertical angle a1 (n), and horizontal angle a2 (n). It is assumed that n) and z2 (n)) are calculated.

In the present embodiment, for example, for each frame, the three-dimensional coordinate value of the position of the ball is calculated with the three-dimensional coordinate value corresponding to the vertical angle a1'and the horizontal angle a2' about the initial position of the ball as the origin.

Here, too, since the position and inclination of the user terminal 10 are adjusted, the combination of the parabola, the vertical angle, and the horizontal angle can be associated with the three-dimensional coordinate value of the ball position on a one-to-one basis. It has become. Therefore, in the present embodiment, for example, by referring to the data indicating the conversion formula and the conversion table held in advance by the flight distance calculation unit 80, the position of the ball is determined based on the parabolic, vertical angle, and horizontal angle. The three-dimensional coordinate values can be uniquely specified.

Then, the flight distance calculation unit 80 solves a binary equation in which the left-right angle and the elevation angle are unknowns by inputting two of the three-dimensional coordinate values of the ball positions calculated as described above. The left-right angle and elevation angle corresponding to the input are calculated.

The flight distance calculation unit 80 selects a pair of input three-dimensional coordinate values in various patterns, and calculates a combination of a left-right angle value and an elevation angle value for each pattern. Then, the flight distance calculation unit 80 determines the average value of the elevation angle values calculated for various patterns as the elevation angle a3 for the entire flight trajectory of the ball.

Then, the flight distance calculation unit 80 calculates the left-right angle for each frame when the calculated elevation angle a3 is set as a fixed value based on the three-dimensional coordinate value of the position of the ball.

Then, as shown in FIG. 15, the flight distance calculation unit 80 calculates the initial value and the final value (horizontal angle when the ball lands) of the left-right angle by regression analysis. Here, for example, the left-right angle at impact is calculated as the initial value of the left-right angle. Then, the left-right angle at the position of the landing point specified based on the above-mentioned parabola is calculated as the final value of the left-right angle.

Then, the flight distance calculation unit 80 is described in 1.33. The meet rate is calculated by the formula of × (1-0.01 × elevation deviation) × cos (absolute value of left / right angle + absolute value of bending angle).

Here, the elevation angle deviation refers to the absolute value of the difference between the calculated elevation angle a3 and the value 14. The absolute value of the left-right angle refers to the absolute value of the value calculated as the initial value of the left-right angle. The absolute value of the bending angle refers to the absolute value of the value calculated as the final value of the left-right angle minus the value calculated as the initial value of the left-right angle.

Then, the flight distance calculation unit 80 calculates the initial ball speed by multiplying the meet rate calculated in this way by the calculated head speed S.

Then, the flight distance (yard) is calculated by multiplying the calculated initial velocity of the ball by 4 × 0.8 × 1.0936.

The method for calculating the flight distance and the like is not limited to the above method.

In the present embodiment, the club head trajectory specifying unit 82 identifies the trajectory of the club head reflected in the photographed moving image, for example, based on the photographed moving image.

For example, the club head trajectory specifying unit 82 first identifies the head detection area 102 shown in FIG. Here, the position, shape, and size of the head detection area 102 are uniquely specified based on, for example, the position, shape, and size of the player area 96 according to a predetermined rule. In the example of FIG. 16, a region having the same center position as the player region 96, three times the length in the left-right direction, and twice the length in the up-down direction is shown as a head detection area 102.

Then, the club head trajectory specifying unit 82 identifies the position where the club head is captured in the head detection area 102 of the frame image for the plurality of frame images included in the captured moving image. Here, for example, with respect to the frame image up to the impact frame, the area where the club head appears may be specified in the frame image. Here, the above-mentioned comparison result image may be used in specifying the area in which the club head is captured. For example, a region in the head detection region 102 corresponding to a pixel block of changing pixels, which is a range of a predetermined number of pixels, may be specified as an region in which the club head is captured. Then, the club head trajectory specifying unit 82 may specify the position of the representative point (for example, the center) in the specified area as the position where the club head is reflected (hereinafter, referred to as the club head position). good.

Then, the club head trajectory specifying unit 82 may specify the trajectory of the club head based on the specified plurality of club head positions. For example, the club head trajectory specifying unit 82 uses cubic Bezier curve calculation to interpolate the club head position specified for each frame, thereby interpolating smoothness between frames as illustrated in FIG. The linear movement locus L1 of the club head may be specified as the locus of the club head.

Further, the club head trajectory specifying unit 82 may specify the moving direction of the club head at the time of impact based on the captured moving image. For example, the club head trajectory specifying unit 82 may specify the position of the club head in the frame immediately before the impact frame on the movement trajectory L1 of the club head specified as described above. Further, the club head trajectory specifying unit 82 may specify the position of the club head in the frame immediately after the impact frame on the movement trajectory L1 of the club head specified as described above.

Then, the club head trajectory specifying portion 82 specifies a line L2 connecting the position of the club head in the frame immediately before the impact frame and the position of the club head in the frame immediately after the impact frame, which is exemplified in FIG. May be good.

Then, the club head trajectory specifying unit 82 may specify the angle of the club head moving direction at the time of impact with respect to a predetermined reference direction represented by the two-dimensional image coordinate system of the captured moving image. As shown in FIG. 17, the club head trajectory specifying portion 82 has a club at the time of impact, for example, the angle formed by the line L3 extending in the vertical direction in the frame image and the above-mentioned line L2 along the moving direction of the club head. It may be specified as the angle a4 in the moving direction of the head. Hereinafter, the angle in the moving direction of the club head at the time of the impact specified in this way will be referred to as a club pass angle. In the present embodiment, the club pass angle is in the counterclockwise direction as the positive direction. That is, the value of the club pass angle a4 shown in FIG. 17 is negative.

In the present embodiment, the launching direction specifying unit 84 specifies the launching direction of the ball reflected in the shooting moving image, for example, based on the shooting moving image.

The launch direction specifying unit 84 specifies the launch direction based on, for example, the position where the ball appears in the frame image of a plurality of frame images included in the shooting moving image. Here, for example, the launch direction specifying unit 84 may specify the launch direction based on the trajectory of the ball specified by the ball trajectory specifying unit 78. For example, the launch direction may be specified based on the ballistic ball position in the frame image in a predetermined number of frames (for example, 5 frames) immediately after the impact frame specified by the ball trajectory specifying unit 78. For example, the direction of the approximate straight line L4 along the ballistic ball position in the frame image in a predetermined number of frames immediately after the impact frame, which is exemplified in FIG. 18, may be specified as the launch direction.

Further, the launch direction specifying unit 84 may specify the angle of the launch direction with respect to a predetermined reference direction represented by the two-dimensional image coordinate system of the captured moving image. For example, as shown in FIG. 18, the angle formed by the line L3 extending in the vertical direction and the line L4 along the launch direction in the frame image may be specified as the launch angle a5. In the present embodiment, the launch angle is in the counterclockwise direction as the positive direction. That is, the value of the launch angle a5 shown in FIG. 18 is positive.

Then, the launch direction specifying unit 84 specifies the direction of the face of the club at the time of impact based on the specified launch direction.

For example, when the absolute value of the launch angle a5 is less than a predetermined value, the orientation of the face may be specified as square. Further, when the absolute value of the launch angle a5 is equal to or higher than a predetermined value and the value of the launch angle a5 is positive, it may be specified that the orientation of the face is closed (closed). Further, when the absolute value of the launch angle a5 is equal to or higher than a predetermined value and the value of the launch angle a5 is negative, it may be specified that the orientation of the face is open (open).

In the present embodiment, the swing trajectory type specifying unit 86 specifies, for example, the type of swing trajectory performed by the player 40. Here, for example, the swing trajectory type specifying unit 86 specifies whether the swing trajectory in the swing performed by the player 40 is inside-out, inside-in, or outside-in.

The swing trajectory type specifying unit 86 may specify the type of the swing trajectory based on, for example, the above-mentioned club path angle a4.

For example, when the absolute value of the club pass angle a4 is less than a predetermined value, the type of swing trajectory may be specified as inside-in. Further, when the absolute value of the club pass angle a4 is equal to or higher than a predetermined value and the value of the club pass angle a4 is positive, the type of swing trajectory may be specified as outside-in. Further, when the absolute value of the club pass angle a4 is equal to or higher than a predetermined value and the value of the club pass angle a4 is negative, the type of swing trajectory may be specified as inside out.

The method for specifying the type of swing trajectory by the swing trajectory type specifying unit 86 is not limited to the above method.

For example, the swing trajectory type specifying unit 86 may specify the position of a predetermined body part of the player 40 in the frame image at the time of addressing based on the captured moving image. Here, for example, the swing trajectory type specifying unit 86 may specify the position of a predetermined body part of the player 40 in the frame image (for example, the frame image (5)) having a predetermined frame number. Here, for example, the position of the shoulder of the player 40 shown in the skeleton model 98 specified by the player area specifying unit 72 may be specified.

Then, as shown in FIG. 19, the swing trajectory type specifying unit 86 may specify the line L5 connecting the specified shoulder position Q1 and the initial position Q2 specified by the ball trajectory specifying unit 78.

Further, as shown in FIG. 19, the swing trajectory type specifying unit 86 may specify the line L6 along the shaft shown in the frame image.

Here, the swing trajectory type specifying unit 86 may specify the address-time shaft detection area 104 and the swing-up time-time shaft detection area 106 shown in FIG. Here, for example, the address-time shaft detection area 104 may be an area located at the lower right of the player area 96, for example, where the position and size are uniquely specified based on the player area 96. Further, the swing-up shaft detection area 106 may be, for example, an area located at the upper left of the player area 96 in which the position and size are uniquely specified based on the player area 96.

Then, the swing trajectory type specifying unit 86 may specify a frame image in which the shaft is detected in the swing-up shaft detection region 106 as a swing-up frame image. Then, the swing trajectory type specifying unit 86 represents the difference between the pixel value in the frame image at the time of address and the pixel value in the frame image at the time of swinging up for each pixel associated with each other in the shaft detection area 104 at the time of address. A detection image may be generated. Here, instead of the frame image at the time of swinging up specified as described above, the above-mentioned top position frame image may be used.

Then, the swing trajectory type specifying unit 86 may specify the line L6 along the shaft by applying a straight line detection method such as a Hough transform to the generated shaft detection image.

Then, the swing trajectory type specifying unit 86 is at least one based on at least one of the position of a predetermined body part of the player 40 at the time of addressing or the position of the shaft at the time of addressing, which is specified based on the captured moving image. A reference angle may be specified.

Here, the swing trajectory type specifying unit 86 may specify the first reference angle based on, for example, the position of a predetermined body part. Further, the swing trajectory type specifying unit 86 may specify the first reference angle based on the position of a predetermined body portion and the position of the ball before being swung.

For example, as shown in FIG. 19, the swing trajectory type specifying unit 86 has a first angle formed by a line L7 extending in the left-right direction in the frame image and a line L5 connecting the shoulder position Q1 and the initial position Q2. It may be specified as the reference angle a6 of.

Further, the swing trajectory type specifying unit 86 may specify the second reference angle based on the position of the shaft at the time of addressing, for example.

For example, as shown in FIG. 19, the swing trajectory type specifying unit 86 specifies the angle formed by the line L7 extending in the left-right direction and the line L6 along the shaft as the second reference angle a7 in the frame image. You may.

In this way, the reference angle represented by the two-dimensional image coordinate system of the captured moving image may be specified.

Further, the swing trajectory type specifying unit 86 may specify the swing-down angle of the club head reflected in the captured moving image based on the captured moving image. For example, the swing trajectory type specifying unit 86 may specify the swing-down angle based on the frame images of a predetermined number of frames before impact, for example.

Here, for example, the frame number of the frame immediately after the impact frame is m. Here, the positions of the club heads on the movement locus L1 of the club heads specified as described above for the four frames from the (m-5) th frame to the (m-2) th frame are specified. You may. Then, the moving direction of the club head from the first (m-5) frame to the (m-4) frame, the moving direction of the club head from the (m-4) frame to the third (m-3) frame, and the first (m-4) frame. Even if the line representing the moving direction obtained by averaging the moving directions of the club heads from the m-3) frame to the (m-2) frame is specified as the line L8 along the swing-down direction exemplified in FIG. 20. good.

Alternatively, an approximate straight line along the position of the club head for the four frames from the (m-5) th frame to the (m-2) th frame is a line along the swing-down direction exemplified in FIG. It may be specified as L8. The frame used to specify the line L8 is not limited to the four frames from the (m-5) th frame to the (m-2) th frame.

Then, as shown in FIG. 20, the swing trajectory type specifying unit 86 specifies the angle formed by the line L7 extending in the left-right direction and the line L8 along the above-mentioned swing-down direction as the swing-down angle a8 in the frame image. You may.

In this way, the swing-down angle represented by the two-dimensional image coordinate system of the captured moving image may be specified.

Then, the swing trajectory type specifying unit 86 may compare the above-mentioned reference angle with the above-mentioned swing-down angle. Then, the swing trajectory type specifying unit 86 may specify the type of the swing trajectory in the swing based on the comparison result between the above-mentioned reference angle and the above-mentioned swing-down angle. For example, in the swing trajectory type specifying unit 86, the swing trajectory in the swing is inside-out, inside-in, or outside-in based on the first reference angle, the second reference angle, and the swing-down angle. You may specify which one.

For example, when the value of the swing-down angle a8 is larger than the value of the first reference angle a6, the type of the swing trajectory may be specified as outside-in. In this case, it corresponds to the situation where the club is swung down from the outside (upper side) of the so-called V zone.

Further, when the value of the swing-down angle a8 is equal to or greater than the value of the second reference angle a7 and equal to or less than the value of the first reference angle a6, the type of swing trajectory may be specified as inside-in. In this case, it corresponds to a situation where the so-called swing trajectory is within the range of the V zone.

Further, when the value of the swing-down angle a8 is smaller than the value of the second reference angle a7, the type of the swing trajectory may be specified as inside-out. In this case, it corresponds to the situation where the club is swung down from the inside (lower side) of the so-called V zone.

In the present embodiment, the bending direction determination unit 88 determines the bending direction of the launched ball based on, for example, the trajectory of the club head specified as described above and the launching direction specified as described above. To judge. The bending direction determination unit 88 may determine the bending direction based on the moving direction of the club head and the launching direction.

The bending direction determination unit 88 determines the bending direction of the ball, for example, based on the difference between the signed club path angle a4 and the signed launch angle a5. For example, when the difference between the value of the signed club pass angle a4 and the value of the signed launch angle a5 is less than a predetermined value, it is determined that the ball is not bent (flyed straight). Further, for example, the difference between the value of the signed club pass angle a4 and the value of the signed launch angle a5 is a predetermined value or more, and the signed launch angle a5 is larger than the value of the signed club pass angle a4. If the value is higher, the ball is determined to turn to the left. Further, the difference between the value of the signed club path angle a4 and the value of the signed launch angle a5 is equal to or larger than a predetermined value, and the value of the signed launch angle a5 is larger than the value of the signed club path angle a4. If it is smaller, the ball is determined to turn to the right.

Further, the bending direction determination unit 88 may determine the bending direction and the bending size of the launched ball based on the trajectory of the club head and the launching direction. For example, the absolute value of the difference between the value of the signed club path angle a4 and the value of the signed launch angle a5 may be specified as the bending value indicating the magnitude of the bending. Further, for example, based on the magnitude of the absolute value of the difference between the value of the signed club path angle a4 and the value of the signed launch angle a5, for example, "large", "medium", "small", etc. , The bending evaluation value for evaluating the bending size in several stages (for example, three stages) may be determined.

In the present embodiment, the analysis moving image generation unit 90 generates, for example, an analysis moving image in which an image showing the result of the swing analysis processing is superimposed on the captured moving image.

In the analysis moving image generation unit 90, an image expressing the trajectory of the club head, the orientation of the club face at the time of impact specified based on the launch direction, and the bending direction of the ball is superimposed on the captured moving image. The analysis moving image may be generated. For example, an analysis moving image may be generated in which the impact image 48 shown in FIG. 2 is superimposed on the frame image included in the shooting moving image. Here, the type of the swing trajectory specified by the swing trajectory type specifying unit 86 may be represented in the impact image 48 as the trajectory of the club head.

FIG. 21 is a diagram showing an example of variations of the impact image 48. FIG. 21 shows nine types of impact images 48 according to the combination of the type of swing trajectory and the type of face orientation.

The impact image 48 shown in FIG. 21 reflects the types of the swing trajectory, the direction of the face, and the bending direction of the ball. The impact image 48 may reflect not only the type of swing trajectory, the direction of the face, and the bending direction of the ball, but also the size.

For example, the size of the angle formed by the head moving direction (direction in which the arrows are lined up) and the vertical direction shown by the head moving direction image 50 may correspond to the size of the above-mentioned club path angle a4. .. Here, the size of the angle formed by the head moving direction and the vertical direction shown by the head moving direction image 50 does not have to be the same as the size of the above-mentioned club path angle a4. For example, the angle formed by the head moving direction and the vertical direction shown by the head moving direction image 50 may be an angle determined based on the club path angle a4 according to a predetermined conversion rule.

Further, for example, the angle formed by the head moving direction and the vertical direction shown by the head moving direction image 50 is determined based on the above-mentioned size of the club path angle a4 from among the sizes of several stages of angles. It may be of a size.

Further, for example, the magnitude of the angle formed by the stretching direction and the left-right direction of the linear face-oriented image 52 shown in FIG. 2 may correspond to the launch angle a5 described above. Here, the angle formed by the stretching direction and the left-right direction of the face-oriented image 52 does not have to be the same as the size of the launch angle a5 described above. For example, the angle formed by the stretching direction and the left-right direction of the face-oriented image 52 may be an angle determined based on the launch angle a5 according to a predetermined conversion rule.

Further, for example, the angle formed by the stretching direction and the left-right direction of the linear face-oriented image 52 is determined based on the size of the above-mentioned launch angle a5 from among the sizes of several stages of angles. May be.

Further, the size of the bend of the ball direction image 54 may correspond to the size of the absolute value of the difference between the value of the club pass angle a4 and the value of the launch angle a5. For example, the larger the absolute value of the difference between the value of the club pass angle a4 and the value of the launch angle a5, the larger the bending of the ball direction image 54 may be expressed. Further, for example, the bending size of the ball direction image 54 may be in proportion to the bending evaluation value described above.

Further, the analysis moving image generation unit 90 may generate an analysis moving image in which the line representing the above-mentioned reference angle is superimposed on the captured moving image. For example, the analysis moving image generation unit 90 may generate an analysis moving image in which the above-mentioned line representing the first reference angle and the above-mentioned line representing the second reference angle are superimposed on the captured moving image. For example, an analysis moving image may be generated in which the V-zone image 56 shown in FIG. 2 is superimposed on the frame image included in the shooting moving image. As shown in FIG. 2, the V-zone image 56 is a triangular image, the upper side corresponding to the line L5 shown in FIG. 19 and the lower side corresponding to the line L6 shown in FIG. Here, for example, the V zone image 56 may be arranged in the frame image so that the upper side and the lower side of the V zone image 56 pass through the above-mentioned initial positions.

Further, as shown in FIG. 2, a strip-shaped club head trajectory effect image 42 corresponding to the trajectory of the club head specified as described above may be superimposed on the analysis moving image. Further, the strip-shaped ball trajectory effect image 44 corresponding to the trajectory of the ball specified as described above may be superimposed on the analysis moving image.

Further, as shown in FIG. 2, analysis result information 46 indicating the analysis result by the above-mentioned swing analysis process may be arranged in the analysis moving image. For example, the analysis result information 46 includes information indicating values (ball initial velocity, flight distance, etc.) calculated by the flight distance calculation unit 80, and information indicating the type of swing trajectory specified by the swing trajectory type identification unit 86. May be included.

Then, in the present embodiment, the analysis moving image generation unit 90 stores, for example, the generated analysis moving image in the analysis moving image storage unit 92.

In the present embodiment, the analysis moving image storage unit 92 stores, for example, the analysis moving image generated by the analysis moving image generation unit 90.

In the present embodiment, the display control unit 94 causes the touch panel 26 to display the analysis video stored in the analysis video storage unit 92 in response to a request from the user of the user terminal 10, for example. In this way, the display control unit 94 may notify the user of the comparison result between the above-mentioned reference angle and the above-mentioned swing-down angle. For example, the display control unit 94 may notify the user of the type of swing trajectory specified based on the comparison result between the above-mentioned reference angle and the above-mentioned swing-down angle.

Here, an example of the flow of processing performed by the user terminal 10 according to the present embodiment will be described with reference to the flow diagram illustrated in FIG. 22.

First, the shooting moving image acquisition unit 70 acquires the shooting moving image (S101).

Then, the player area specifying unit 72 specifies the player area 96 (S102).

Then, the comparison result image generation unit 74 generates a plurality of comparison result images based on the shooting moving image acquired by the process shown in S101 (S103).

Then, the starting point area specifying unit 76 specifies the starting point area 100 based on the player area 96 specified by the process shown in S102 (S104).

Then, the ball trajectory specifying unit 78 identifies the trajectory of the ball based on the comparison result image generated by the process shown in S103 (S105).

Then, the flight distance calculation unit 80 calculates the flight distance and the like of the shot in the swing captured in the shooting moving image acquired by the process shown in S101 (S106).

Then, the club head trajectory specifying unit 82 identifies the trajectory of the club head based on the shooting moving image acquired by the process shown in S101 (S107).

Then, the launch direction specifying unit 84 specifies the launch direction of the ball based on the trajectory of the ball specified by the process shown in S105 (S108).

Then, the swing trajectory type specifying unit 86 was acquired by the process shown in S101 based on the trajectory of the club head specified by the process shown in S107 and the launch direction of the ball specified by the process shown in S108. The type of swing trajectory in the swing shown in the captured moving image is specified (S109).

Then, the bending direction determination unit 88 determines the bending direction of the ball in the shot based on the trajectory of the club head specified by the process shown in S107 and the launching direction of the ball specified by the process shown in S108. Judgment (S110).

Then, the analysis moving image generation unit 90 generates an analysis moving image based on the shooting moving image acquired by the process shown in S101 and the result of the processing shown in S105 to S110 (S111).

Then, the analysis moving image generation unit 90 stores the analysis moving image generated by the process shown in S111 in the analysis moving image storage unit 92 (S112), and the process shown in this processing example is completed.

As described above, in the process shown in S109, the swing trajectory type specifying unit 86 may specify the swing-down angle and the reference angle. Then, the swing trajectory type specifying unit 86 may specify the type of swing trajectory in the swing captured in the captured moving image acquired by the process shown in S101 based on the specified swing-down angle and reference angle.

In the present embodiment, it is possible to accurately determine the bending direction of the ball without directly measuring the direction of the face only by photographing the player who is swinging the golf. In this way, according to the present embodiment, a general player can easily analyze a golf swing at a golf course, a driving range, or the like using a smartphone or the like.

Further, in the present embodiment, the above-mentioned reference angle and the above-mentioned swing-down angle are compared only by photographing the player who is swinging the golf. Therefore, according to the present embodiment, even a general player who does not have knowledge about golf such as an appropriate swing plane angle range can swing correctly by knowing the comparison result between the reference angle and the swing-down angle. It will be possible to easily grasp whether or not it was possible.

Further, in the present embodiment, as described above, the type of swing trajectory in the swing is accurately specified based on the above-mentioned reference angle and the above-mentioned swing-down angle. Therefore, according to the present embodiment, even a general player can easily grasp whether or not he / she was able to swing on the correct swing trajectory by knowing the type of his / her own swing trajectory.

The present invention is not limited to the above-described embodiment.

For example, the above-mentioned first reference angle does not need to be specified based on the position of the shoulder, and may be specified based on the position of the neck muscle of the player 40, for example.

Further, for example, the above-mentioned first reference angle does not need to be specified based on the initial position of the ball, and may be specified, for example, based on the position specified by the user or the position of the club head at the time of addressing. ..

Further, for example, the above-mentioned second reference angle does not need to be specified based on the position of the shaft, and may be specified based on the position of the waist of the player 40, for example. For example, the above-mentioned second reference angle is specified based on a line connecting the position of the waist of the player 40 and the initial position of the ball, or a line connecting the position of the waist of the player 40 and the position of the club head at the time of addressing. May be done.

Further, it is not necessary to specify two reference angles, and the type of swing trajectory may be specified based on one reference angle. For example, it may be specified whether or not it is outside-in based on one reference angle. Further, for example, it may be specified whether or not it is inside out based on one reference angle.

Further, all or part of the processing shown in FIG. 3 may be implemented by a server capable of communicating with the user terminal 10.

Further, the above-mentioned specific character strings and numerical values and specific character strings and numerical values in the drawings are examples, and are not limited to these character strings and numerical values.

10 user terminal, 20 processor, 22 storage unit, 24 communication unit, 26 touch panel, 28 camera unit, 30 sensor unit, 40 player, 42 club head trajectory effect image, 44 ball trajectory effect image, 46 analysis result information, 48 impact image. , 50 head movement direction image, 52 face orientation image, 54 ball direction image, 56 V zone image, 70 shooting moving image acquisition unit, 72 player area identification unit, 74 comparison result image generation unit, 76 origin area identification unit, 78 ball Ballistic identification unit, 80 flight distance calculation unit, 82 club head trajectory identification unit, 84 launch direction identification unit, 86 swing trajectory type identification unit, 88 bending direction determination unit, 90 analysis video generation unit, 92 analysis video storage unit, 94 Display control unit, 96 player area, 98 skeleton model, 100 starting point area, 102 head detection area, 104 address shaft detection area, 106 swing-up shaft detection area.

The golf swing analysis system according to the present invention is based on a shooting moving image acquisition means for acquiring a shooting moving image showing a player who is swinging golf as seen from behind the target direction of the ball, and the shooting moving image. A reference angle specifying means for specifying a first reference angle based on the position of a predetermined body part of the player at the time of address and the position of the ball before being swung, and the first reference. It includes an analysis moving image generation means for generating an analysis moving image in which a line representing an angle is superimposed on the captured moving image.

One aspect of the present invention further includes a ball trajectory specifying means for specifying the trajectory of the ball reflected in the photographed moving image based on the photographed moving image.

In this aspect, the reference angle specifying means may specify the first reference angle based on the position of the ball before being swung, which is specified based on the trajectory.

Further, in one aspect of the present invention, the predetermined body part is the shoulder.

Further, in one aspect of the present invention, the reference angle specifying means specifies a second reference angle based on the position of the shaft at the time of addressing, and the analysis moving image generating means determines the first reference angle. The analysis moving image is generated by superimposing the image representing the second reference angle on the upper side and the line representing the second reference angle as the lower side.

In this aspect, the line representing the first reference angle and the line representing the second reference angle may pass through the position of the ball.

Further, in one aspect of the present invention, the club head trajectory specifying means for specifying the trajectory of the club head reflected in the photographed moving image based on the photographed moving image is further included, and the analyzed moving image generating means is the club. The band-shaped image corresponding to the trajectory of the head is superimposed on the captured moving image to generate the analyzed moving image.

Further, the analysis moving image generation means may generate the analysis moving image in which a band-shaped image corresponding to the trajectory of the ball is superimposed on the captured moving image.

Further, the golf swing analysis method according to the present invention is specified based on a step of acquiring a shooting moving image showing a player who is swinging golf as seen from behind the target direction of the ball, and the shooting moving image. A step of specifying a first reference angle based on the position of a predetermined body part of the player at the time of addressing and the position of the ball before being swung, and a line representing the first reference angle. A step of generating an analysis moving image superimposed on the captured moving image is included.

Further, the program according to the present invention is a procedure for acquiring a shooting moving image showing a player who is swinging golf as seen from behind the target direction of the ball, and at the time of addressing, which is specified based on the shooting moving image. A procedure for specifying a first reference angle based on the position of a predetermined body part of the player and the position of the ball before being swung, and a line representing the first reference angle is shown in the captured moving image. Have the computer perform the procedure for generating the superimposed analysis video.

Claims (10)

A shooting moving image acquisition means for acquiring a shooting moving image of a player who is swinging golf,
Reference angle specifying means for specifying at least one reference angle based on at least one of the position of a predetermined body part of the player at the time of addressing or the position of the shaft at the time of addressing, which is specified based on the captured moving image. When,
A swing-down angle specifying means for specifying a swing-down angle of the club head reflected in the shooting moving image based on the shooting moving image, and a swing-down angle specifying means.
A comparison means for comparing the reference angle and the swing-down angle, and
A golf swing analysis system characterized by including. Further including a swing trajectory type specifying means for specifying the type of the swing trajectory in the swing based on the comparison result between the reference angle and the swing down angle.
The golf swing analysis system according to claim 1. The reference angle specifying means identifies the first reference angle based on the position of the predetermined body part.
The reference angle specifying means identifies the second reference angle based on the position of the shaft.
In the swing trajectory type specifying means, the swing trajectory in the swing is inside-out, inside-in, or based on the first reference angle, the second reference angle, and the swing-down angle. Identify which is outside-in,
The golf swing analysis system according to claim 2. The reference angle specifying means specifies the reference angle based on the position of the predetermined body part and the position of the ball before being swung, which is specified based on the captured moving image.
The golf swing analysis system according to any one of claims 1 to 3, wherein the golf swing analysis system is characterized. Further including a ball trajectory specifying means for specifying the trajectory of the ball reflected in the captured moving image based on the captured moving image.
The reference angle specifying means identifies the reference angle based on the position of the ball before being swung, which is specified based on the trajectory.
The golf swing analysis system according to claim 4. The reference angle specifying means identifies the reference angle represented by the two-dimensional image coordinate system of the captured moving image.
The swing-down angle specifying means identifies the swing-down angle represented by the two-dimensional image coordinate system of the captured moving image.
The golf swing analysis system according to any one of claims 1 to 5, wherein the golf swing analysis system is characterized. The shooting moving image acquisition means acquires the shooting moving image in which the player is viewed from behind the target direction of the ball.
The golf swing analysis system according to any one of claims 1 to 6, wherein the golf swing analysis system is characterized. Further including an analysis moving image generation means for generating an analysis moving image in which a line representing the reference angle is superimposed on the captured moving image.
The golf swing analysis system according to any one of claims 1 to 7, wherein the golf swing analysis system is characterized. Steps to acquire a shooting video of a player swinging golf,
A step of specifying at least one reference angle based on at least one of the position of a predetermined body part of the player at the time of addressing or the position of the shaft at the time of addressing, which is specified based on the captured moving image.
A step of specifying the swing-down angle of the club head reflected in the photographed moving image based on the photographed moving image, and
A step of comparing the reference angle and the swing-down angle,
A golf swing analysis method comprising. Procedure for acquiring a shooting video of a player playing a golf swing,
A procedure for specifying at least one reference angle based on at least one of the position of a predetermined body part of the player at the time of addressing or the position of the shaft at the time of addressing, which is specified based on the captured moving image.
A procedure for specifying the swing-down angle of the club head shown in the shooting moving image based on the shooting moving image.
Procedure for comparing the reference angle and the swing-down angle,
A program characterized by having a computer execute.

Images