JP7076031B1 - Ball position identification system, ball position identification method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a ball position specifying system, a ball position specifying method and a program capable of accurately specifying a geographical position of a shot golf ball without fixing a measuring terminal for measuring a golf ball to a predetermined position.
SOLUTION: A shot specifying unit 220 is a user terminal 10 at the time of flying distance and measurement of a golf ball based on a measured value related to the golf ball acquired from a user terminal 10 that measures the shot golf ball. Identify the angle to the direction in which you are facing. The terminal position / orientation specifying unit 222 specifies the terminal position, which is the geographical position of the user terminal 10 at the time of measurement, and the terminal orientation, which is the orientation at which the user terminal 10 is facing at the time of measurement. The ball position specifying unit 224 determines the geographical position of the shot golf ball based on the terminal position, the terminal orientation, the flight distance of the golf ball, and the angle with respect to the direction in which the user terminal 10 is facing at the time of measurement. Identify a ball position.
[Selection diagram] FIG. 27

Description

The present invention relates to a ball position specifying system, a ball position specifying method and a program.

Patent Document 1 describes a measuring device that measures a falling point of a golf ball based on an image taken by a CCD camera fixed above the pole.

Japanese Unexamined Patent Publication No. 2005-233800

In the technique described in Patent Document 1, the pixels included in the captured image and the geographical position of the drop point are associated in advance. Therefore, it is necessary to fix the position of the CCD camera at a predetermined position.

The present invention has been made in view of the above problems, and one of the purposes thereof is to accurately determine the geographical position of a shot golf ball without fixing the measuring terminal for measuring the golf ball at a predetermined position. It is an object of the present invention to provide a ball position identification system, a ball position identification method, and a program that can be specified.

The ball position specifying system according to the present invention measures the flight distance of the golf ball and the measurement at the time of the measurement based on the measured value related to the golf ball acquired from the measuring terminal that measures the shot golf ball. A shot specifying means for specifying an angle with respect to the direction in which the terminal is facing, a terminal position which is the geographical position of the measuring terminal at the time of the measurement, and a terminal orientation which is the direction in which the measuring terminal is facing at the time of the measurement. A ball that specifies a ball position that is a geographical position of the shot golf ball based on the terminal position / orientation specifying means and the terminal position, the terminal orientation, the flight distance, and the angle. Includes locating means.

In one aspect of the present invention, a shooting moving image acquisition means for acquiring a shooting moving image of a player shooting a golf ball, which is shot by a shooting unit included in the measuring terminal, and the shooting moving image. Further includes, for at least one frame image included in the image, a position specifying means in the image for specifying the position in the image which is the position of the golf ball reflected in the frame image, and the shot specifying means is the position in the image. The flight distance and the angle are specified based on the above.

In this aspect, an accuracy specifying means for specifying the accuracy of at least one of the specified flight distance or the angle based on the number of the frame images for which the position in the image is specified may be further included.

Further, based on the ball position and the accuracy, the remaining distance specifying means for specifying the range of the remaining distance in the hole where the golf play is performed, the flight distance, and the range of the remaining distance are used. It may further include a recommended number specifying means for specifying a number recommended for use in the next shot, which is a number corresponding to the range of the flight distance and the remaining distance.

Further, in one aspect of the present invention, based on the remaining distance specifying means for specifying the remaining distance in the hole where golf play is performed based on the ball position, the flight distance, and the remaining distance, the following It also includes recommended count identification means for identifying the recommended count for use in shots.

In this aspect, the accuracy specifying means for specifying the accuracy of at least one of the flight distance or the angle is further included, and the remaining distance specifying means is the remaining distance based on the ball position and the accuracy. The range may be specified, and the recommended number specifying means may specify a number of the counts according to the range of the remaining distance.

Further, in one aspect of the present invention, the ball position specifying means identifies the ball positions of a plurality of golf balls shot by different players, and the plurality of ball positions are displayed on the measuring terminal. It further includes a display control means for displaying on the unit.

In this aspect, a notification means for notifying information regarding the order of remaining distances for the plurality of players, which is generated based on the plurality of ball positions, may be further included.

Further, the ball position data receiving means for receiving the ball position data indicating the ball position is further included, and the display control means receives the ball position specified based on the measured value acquired from the measuring terminal. The ball position specified based on the ball position data may be displayed on the display unit.

Further, in one aspect of the present invention, the ball position data transmitting means for transmitting the ball position data indicating the ball position is further included.

Further, the ball position specifying method according to the present invention is based on the measured value related to the golf ball acquired from the measuring terminal that measured the shot golf ball, and at the time of the flight distance of the golf ball and the measurement. The step of specifying the angle with respect to the direction in which the measuring terminal is facing, the terminal position which is the geographical position of the measuring terminal at the time of the measurement, and the terminal orientation which is the direction in which the measuring terminal is facing at the time of the measurement. A step of specifying a ball position, which is a geographical position of the shot golf ball, based on the terminal position, the terminal orientation, the flight distance, and the angle. ..

Further, the program according to the present invention is based on the measured value related to the golf ball acquired from the measuring terminal that measured the shot golf ball, and the flying distance of the golf ball and the measuring terminal at the time of the measurement. Procedure for specifying the angle with respect to the direction in which the measuring terminal is facing, the procedure for specifying the terminal position which is the geographical position of the measuring terminal at the time of the measurement, and the procedure for specifying the terminal orientation which is the orientation at which the measuring terminal is facing at the time of the measurement. , The computer is made to perform a procedure for identifying a ball position, which is a geographical position of the shot golf ball, based on the terminal position, the terminal orientation, the flight distance, and the angle.

It is a figure which shows an example of the structure of the user terminal which concerns on one Embodiment of this invention. It is a figure which shows an example of the frame image included in the analysis moving image. It is a functional block diagram which shows an example of the function of the user terminal which concerns on one Embodiment of this invention. It is a figure which shows an example of a player area. It is a figure which shows an example of the comparison result image. It is a figure which shows an example of the origin area. It is a figure which shows an example of a candidate ball position. It is a figure which shows an example of a ballistic list candidate. It is a figure which shows an example of a candidate ball position. It is a figure which shows an example of a ballistic list candidate. It is a figure which shows an example of a candidate ball position. It is a figure which shows an example of a ballistic list candidate. It is a figure which shows an example of the top position frame image. It is a figure which shows an example of an impact frame image. It is explanatory drawing explaining an example of the right-and-left angle absolute value and the bending angle absolute value. It is a figure which shows an example of a head detection area. It is a figure which shows an example of a club pass angle. It is a figure which shows an example of a launch angle. It is a figure which shows an example of a reference angle. It is a figure which shows an example of the swing-down angle. It is a figure which shows an example of the variation of an impact image. It is a flow diagram which shows an example of the flow of the process performed in the user terminal which concerns on one Embodiment of this invention. It is a figure which shows an example of the structure of the ball position sharing system which concerns on one Embodiment of this invention. It is a figure which shows an example of a hall image. It is a figure which shows an example of a hall image. It is a figure which shows an example of a hall image. It is a functional block diagram which shows an example of the function of the user terminal which concerns on one Embodiment of this invention. It is a figure which shows an example of the count flight distance correspondence data. It is a figure which shows an example of the count flight distance correspondence data. It is a flow diagram which shows an example of the flow of the process performed in the user terminal which concerns on one Embodiment of this invention.

[First Embodiment]
Hereinafter, the first embodiment, which is an embodiment of the present invention, will be described in detail with reference to the drawings.

FIG. 1 is a diagram showing an example of the configuration of the user terminal 10 according to the present embodiment.

The user terminal 10 according to the present embodiment is a computer such as a mobile phone (including a smartphone) and a mobile information terminal (including a tablet computer). As shown in FIG. 1, the user terminal 10 according to the present embodiment includes a processor 20, a storage unit 22, a communication unit 24, a touch panel 26, a camera unit 28, and a sensor unit 30.

The processor 20 is, for example, a program control device such as a microprocessor that operates according to a program installed in the user terminal 10. The storage unit 22 is, for example, a storage element such as a ROM or RAM, a solid state drive (SSD), or the like. The storage unit 22 stores a program or the like executed by the processor 20. The communication unit 24 is, for example, a communication interface for wired communication or wireless communication, and transfers data to and from a computer such as a server via a computer network such as the Internet.

The touch panel 26 displays and outputs information according to an instruction input from the processor 20, and outputs the content of an operation performed by the user to the processor 20, for example.

The camera unit 28 is, for example, a shooting device such as a digital video camera capable of shooting a moving image.

The sensor unit 30 is a sensing device such as a GPS module, an acceleration sensor, a motion sensor, or a direction sensor. In this embodiment, the case where the sensor unit 30 is included in the user terminal 10 will be described, but the sensor unit 30 may be outside the user terminal 10.

In the present embodiment, for example, a user who operates the user terminal 10 (hereinafter, referred to as an operating user) swings golf using the camera unit 28 of the user terminal 10 at a golf course or a driving range. Take a picture of the player. Then, a moving image showing the player making the swing is generated.

In this embodiment, prior to the shooting of the swing, the position of the player with respect to the position of the camera unit 28 is within a predetermined allowable range, and the orientation of the player with respect to the shooting direction is within the predetermined allowable range. , The position and inclination of the user terminal 10 are adjusted. Then, in the present embodiment, after the adjustment of the user terminal 10 is performed, when the operating user performs a predetermined operation, the camera unit 28 takes a picture of the player, and a moving image of the player making the swing is captured. An image is generated. In the present embodiment, it is assumed that a moving image having a predetermined frame rate (for example, 60 fps) is generated.

Then, in the present embodiment, by executing the camera shake correction process on the moving image generated in this way, each frame image is corrected so that the player appears at substantially the same position in all the frame images. To. Hereinafter, the moving image on which the image stabilization process is executed will be referred to as a shooting moving image. In the present embodiment, it is assumed that the number of vertical and horizontal pixels of the frame image included in the generated moving image is the same.

Hereinafter, the frame image whose frame number is n (n = 1, 2, 3, ...) Will be referred to as a frame image (n). Further, the frame corresponding to the frame image (n) is expressed as the nth frame.

Then, in the present embodiment, the swing analysis process is performed on the captured moving image. Then, an analysis moving image in which an image showing the result of the swing analysis processing is superimposed on the captured moving image is generated. Then, the generated analysis moving image is stored in the storage unit 22 of the user terminal 10.

Then, for example, a user of the user terminal 10 such as the above-mentioned player or operation user can reproduce the analysis moving image stored in the storage unit 22 by performing a predetermined operation as appropriate.

FIG. 2 is a diagram showing an example of a frame image at the time of finishing included in the analyzed moving image to be reproduced. In the frame image shown in FIG. 2, the club head trajectory effect image 42 representing the trajectory of the club head and the ball trajectory effect image 44 representing the trajectory of the ball are included in the frame image included in the shooting motion image captured by the player 40. It is superimposed.

Further, the analysis result information 46 is arranged at the upper right of the frame image shown in FIG. In the example of FIG. 2, as the analysis result information 46, a character string indicating the ball speed, the flight distance, and the type of the swing trajectory such as outside-in, inside-in, inside-out, etc. is arranged.

Further, in the lower left of the frame image shown in FIG. 2, an impact image 48 representing the trajectory of the club head, the direction of the club face at the time of impact, and the bending direction of the ball is arranged.

The impact image 48 shown in FIG. 2 includes a head moving direction image 50, a face orientation image 52, and a ball direction image 54. The head moving direction image 50 is, for example, an image showing the moving direction of the club head at the time of impact. In the example of FIG. 2, the direction in which the arrows are lined up corresponds to the moving direction of the club head at the time of impact. The face-oriented image 52 is, for example, an image showing the orientation of the club face at the time of impact. In the example of FIG. 2, the face-oriented image 52 is an image on a line, and the stretching direction of the face-oriented image 52 is the impact. Corresponds to the orientation of the club face at the time. The ball direction image 54 is, for example, an image showing the pop-out direction and the bending direction of the ball. In the ball direction image 54 according to the present embodiment, the direction perpendicular to the stretching direction of the face-oriented image 52 on the line is shown as the pop-out direction of the ball.

Further, the frame image shown in FIG. 2 includes a V zone image 56 showing a V zone in which it is desirable that the trajectory of the club head passes during a downswing.

As described above, according to the present embodiment, the user of the user terminal 10 can confirm the analysis result of the golf swing performed by the player.

Hereinafter, the functions of the user terminal 10 according to the present embodiment and the processes executed by the user terminal 10 according to the present embodiment will be further described with a focus on the swing analysis process described above.

FIG. 3 is a functional block diagram showing an example of a function implemented in the user terminal 10 according to the present embodiment. It should be noted that it is not necessary for the user terminal 10 according to the present embodiment to implement all of the functions shown in FIG. 3, and functions other than the functions shown in FIG. 3 may be implemented.

The user terminal 10 according to the present embodiment has a function as a swing analysis system for analyzing a golf swing. Then, as shown in FIG. 3, the user terminal 10 according to the present embodiment is functionally, for example, functionally, for example, a shooting moving image acquisition unit 70, a player area specifying unit 72, a comparison result image generation unit 74, and a starting point area specifying unit. 76, ball trajectory specifying unit 78, flight distance calculation unit 80, club head trajectory specifying unit 82, launch direction specifying unit 84, swing trajectory type specifying unit 86, bending direction determination unit 88, analysis moving image generation unit 90, analysis moving image A storage unit 92 and a display control unit 94 are included.

Shooting motion image acquisition unit 70, player area identification unit 72, comparison result image generation unit 74, starting point area identification unit 76, ball trajectory identification unit 78, flight distance calculation unit 80, club head trajectory specification unit 82, launch direction specification unit 84. , The swing trajectory type specifying unit 86, the bending direction determination unit 88, and the analysis moving image generation unit 90 are mainly mounted with the processor 20. The analysis moving image storage unit 92 mainly implements the storage unit 22. The display control unit 94 mainly mounts the processor 20 and the touch panel 26.

The above functions may be implemented by executing a program installed on the user terminal 10 which is a computer and including a command corresponding to the above functions on the user terminal 10. Further, this program may be supplied to the user terminal 10 via a computer-readable information storage medium such as an optical disk, a magnetic disk, a magnetic tape, or a magneto-optical disk, or via the Internet or the like.

In the present embodiment, the shooting moving image acquisition unit 70 acquires, for example, a shooting moving image in which a player 40 swinging golf is captured. Here, as described above, the captured moving image after the image stabilization process is executed may be acquired.

Further, as shown in FIG. 2, the shooting moving image may be a moving image taken by the player 40 from one direction. Further, the captured moving image may be a moving image showing the player 40 viewed from behind the target direction of the ball.

As described above, in the present embodiment, it is assumed that a shooting moving image shot at a predetermined frame rate (for example, 60 fps) is acquired.

In the present embodiment, the player area specifying unit 72 specifies, for example, the player area 96 exemplified in FIG. 4, which is the area in which the player 40 is captured in the frame image included in the shooting moving image.

Here, for example, a trained machine learning model such as OpenPose may be installed in the user terminal 10 according to the present embodiment. Then, the player area specifying unit 72 may specify the positions of the nodes and links of the skeleton model 98 representing the skeleton (bone) of the player 40 in the frame image by using the trained machine learning model. .. The positions of the plurality of nodes included in the skeleton model 98 shown in FIG. 4 are associated with the positions of body parts of the player 40, such as shoulders and hips, respectively.

The player area specifying unit 72 may specify a rectangular area whose position, shape, and size are specified as the player area 96 based on the skeleton model 98. For example, a region obtained by enlarging a rectangular region circumscribing the skeleton model 98 at a predetermined magnification without changing the position of the center may be specified as the player region 96.

Here, the player area 96 may be specified based on one representative frame image. Further, the player area 96 may be specified based on a plurality of frame images. In this case, an area representing a rectangular area specified for a plurality of frame images, such as a common area or an average area of the rectangular area specified for the plurality of frame images, may be specified as the player area 96.

Further, when a person other than the player is reflected in the shooting moving image, a plurality of candidates for the player area 96 may be specified. In this case, any one candidate may be specified as the player area 96 based on a given condition such as the size of the area, the distance from the center of the frame image, the ratio of the height and the width of the area, and the like. ..

In the present embodiment, the comparison result image generation unit 74 generates the comparison result image illustrated in FIG. 5 by using, for example, an image difference method based on a captured moving image.

In the present embodiment, a comparison result image associated with the frame image is generated for each of the plurality of frame images included in the captured moving image. For example, for the frame image (n), the comparison result image (n) is generated as the corresponding comparison result image.

The comparison result image generation unit 74 may generate a comparison image by, for example, smoothing the frame images of a predetermined number of consecutive frame images (for example, 20 frames). For example, the comparative image (n) may be generated by smoothing 20 frame images from the frame image (n-20) to the frame image (n-1) included in the captured moving image. For example, for each pixel, the average value of the pixel values of the pixels corresponding to the pixels in the frame images from the frame image (n-20) to the frame image (n-1) is set to the pixel values of the pixels. A comparative image (n) may be generated.

Then, the comparison result image generation unit 74 has, for each pixel associated with each other, the pixel value in the frame image (n) which is the next frame image of the predetermined number of frame images and the comparison target image (n). Calculate the difference from the pixel value in. Then, the comparison result image generation unit 74 generates a comparison result image (n) indicating whether or not the difference between the pixel values of the frame image (n) and the comparison target image (n) is equal to or greater than a predetermined value for each pixel. do. In the comparison result image shown in FIG. 5, pixels having a pixel value difference of greater than or equal to a predetermined value are represented in white, and pixels having a pixel value of less than a predetermined value are represented in black. Hereinafter, a pixel in which the difference between the pixel values is equal to or larger than a predetermined value, that is, a pixel represented in white in the comparison result image shown in FIG. 5 is referred to as a change pixel.

In the present embodiment, when the comparison image is generated based on the 20 frame images as described above, the comparison result image associated with the frame image is the frame image after the frame image (21). Generated.

In the present embodiment, the starting point region specifying unit 76 specifies, for example, the starting point region 100 used for specifying the trajectory of the ball by the ball trajectory specifying unit 78, which will be described later, as exemplified in FIG.

The starting point region 100 according to the present embodiment is, for example, a rectangular region uniquely specified based on the player region 96. Here, for example, the position of the left side of the starting point region 100 may be the same as the position of the left side of the frame image, and the position of the right side of the starting point region 100 may be the same as the position of the right side of the frame image. Further, the position of the upper side of the starting point region 100 may be a position that is 30% below the vertical length of the player area 96 from the upper side of the player area 96. Further, the position of the lower side of the starting point region 100 may be the same position as the position of the lower side of the player area 96 or a position passing through the feet of the player 40. Note that this method is only an example of a method for specifying the starting point region 100, and the starting point region 100 may be specified by another method.

In the present embodiment, the ball trajectory specifying unit 78 specifies the trajectory of the ball reflected in the captured moving image, for example, based on the captured moving image.

In the present embodiment, the trajectory of the ball is specified as a list of a plurality of frame images included in the captured moving image in which the positions where the balls appear in the frame images are related to each other. Hereinafter, the list will be referred to as a ballistic list.

Hereinafter, an example of the ball trajectory specifying process by the ball trajectory specifying unit 78 will be described with reference to FIGS. 7 to 12.

As described above, it is assumed that the comparison result image associated with the frame image is generated for the frame images after the frame image (21). In this case, with respect to the comparison result image after the comparison result image (21), at least one pixel block of the changing pixel, which is in the range of a predetermined number of pixels and is in the predetermined region, is specified. Then, the position of the representative point (for example, the center) of these pixel clusters is specified as the candidate ball position.

Here, for example, the candidate ball positions are not specified up to the comparison result image (n-1), and the three candidate ball positions (P (n, a), P) shown in FIG. 7 are shown in the comparison result image (n).
It is assumed that (n, b) and P (n, c)) are specified.

Then, the candidate ball positions, which are the first elements of the ballistic list candidates (hereinafter referred to as ballistic list candidates), are narrowed down. For example, the candidate ball position outside the starting point region 100 is excluded from the candidate ball position. In this way, P (n, a) is excluded from the candidate ball positions that are the first elements, and P (n, b) and P (n, c) are narrowed down as the candidate ball positions that are the first elements. Is done.

In this case, as shown in FIG. 8, P (n, b) and P (n, c), each of which has one element, are specified as ballistic list candidates.

Then, it is assumed that the three candidate ball positions (P (n + 1, a), P (n + 1, b), and P (n + 1, c)) shown in FIG. 9 are specified in the comparison result image (n + 1).

In addition to these candidate ball positions, FIG. 9 shows P (n, b) and P (n, c) that are not excluded from the candidate ball positions.

In this case, P (n + 1, a) outside the starting point region 100 is excluded from the candidate ball position that is the first element. On the other hand, P (n + 1, b) and P (n + 1, c) are narrowed down as candidate ball positions to be the first elements.

Further, in the situation where the ballistic list candidate already exists, the candidate ball position associated with the ballistic list candidate that already exists is also specified.

For example, from among P (n + 1, a), P (n + 1, b), and P (n + 1, c), the candidate ball position associated with P (n, b) is specified. For example, the length from P (n, b) is longer than the predetermined length, the length from P (n, b) is shorter than the predetermined length, and the position is lower than P (n, b). Those that satisfy certain conditions such as are excluded from the candidate ball positions associated with P (n, b). For example, P (n + 1, c) is excluded from the candidate ball positions because the position is lower than P (n, b). Then, P (n + 1, a) and P (n + 1, b) are narrowed down as candidate ball positions associated with P (n, b).

Similarly, from among P (n + 1, a), P (n + 1, b), and P (n + 1, c), the candidate ball position associated with P (n, c) is specified. Here, for example, P (n + 1, c) is excluded from the candidate ball positions because the position is lower than P (n, c). Then, P (n + 1, a) and P (n + 1, b) are narrowed down as candidate ball positions associated with P (n, c).

Then, as shown in FIG. 10, ballistic list candidates are added. In the above example, P (n + 1, b), P (n + 1, c), P (n, b) -P (n + 1, a), P (n, b) -P (n + 1, b), P (n). , C) -P (n + 1, a), P (n, c) -P (n + 1, b) are added to the ballistic list candidates. FIG. 10 also shows a ballistic candidate list that includes a plurality of candidate ball positions associated with each other. For example, the element P (n, b) and the ballistic list candidate including the element P (n + 1, a) are shown in FIG. 10 as P (n, b) -P (n + 1, a). Note that P (n, b) and P (n, c) shown in FIG. 8 are not overwritten and are left as ballistic list candidates.

Then, it is assumed that the two candidate ball positions (P (n + 2, a) and P (n + 2, b)) shown in FIG. 11 are specified in the comparison result image (n + 2).

In addition to these candidate ball positions, FIG. 11 also shows candidate ball positions that are not excluded. From this, P (n + 2, a) outside the starting point region 100 is excluded from the candidate ball position that is the first element. On the other hand, P (n + 2, b) is narrowed down as a candidate ball position as a starting point.

Further, as described above, the position of the candidate ball associated with the ballistic list candidate having one element is specified. For example, P (n + 2, b) is excluded from the candidate ball positions associated with P (n, c) because the length from P (n, c) is shorter than the predetermined length. Further, P (n + 2, a) is excluded from the candidate ball positions associated with P (n + 1, c) because the length from P (n + 1, c) is longer than the predetermined length.

From here, the position of the candidate ball associated with the ballistic list candidate having a plurality of elements is also specified. In this case, the length from the candidate ball position, which is the last element of the ballistic list candidate, is longer than the predetermined length, the length from the candidate ball position, which is the last element of the ballistic list candidate, is shorter than the predetermined length, and the trajectory. Anything that satisfies certain conditions, such as being below the candidate ball position, which is the last element of the list candidate, may be excluded from the candidate ball positions associated with the ballistic list candidate.

In addition to these conditions, for example, the angle of the trajectory suddenly changes (turns beyond a predetermined angle), the speed of the trajectory suddenly changes (shorter or longer than a predetermined length), or the direction of the trajectory changes. Candidates associated with ballistic list candidates that satisfy certain conditions for a ballistic list candidate that includes multiple elements, such as (the ballistics heading to the right go to the left, or the ballistics heading to the left go to the right). It may be excluded from the ball position.

In the example of FIG. 11, P (n, b) has a sudden change in the angle of the trajectory with respect to the trajectory connecting P (n, b) and P (n + 1, b). ) -Excluded from the candidate ball positions associated with P (n + 1, b). Further, since P (n + 2, a) has a suddenly slower trajectory than the trajectory connecting P (n, c) and P (n + 1, a), P (n, c)-. It is excluded from the candidate ball positions associated with P (n + 1, a).

For example, in this way, as shown in FIG. 12, five ballistic list candidates are added. Here, each of the two elements associated with each other included in the ballistic list candidate, such as P (n, b) -P (n + 2, a) and P (n, c) -P (n + 2, a). The frames corresponding to may not be continuous. However, for example, a candidate ball position separated by a predetermined number of frames (for example, 4 frames) or more from the frame corresponding to the last element of the ballistic list candidate is excluded from the candidate ball positions associated with the ballistic list candidate. You may do it.

As described above, in the present embodiment, a plurality of ballistic list candidates are specified. Then, among these ballistic list candidates, the one having the largest number of elements (candidate ball positions) included in the ballistic list candidates is specified as the ballistic list. Hereinafter, the candidate ball position, which is an element included in the specified ballistic list, will be referred to as a ballistic ball position.

Here, for example, the ballistic list may be specified according to other criteria. For example, a trajectory list candidate representing a trajectory closest to a straight line may be specified as a trajectory list.

As described above, the ballistic ball position is usually specified for about 50 frames immediately after the impact, but the ballistic ball position for all the frames up to the landing point is not specified.

Then, the ball trajectory specifying unit 78 is represented by the image two-dimensional coordinate system of the captured moving image by performing, for example, linear estimation based on the ballistic ball position in each frame specified as described above. Identify the trajectory of the trajectory.

Then, by extending the specified locus downward and extrapolating it, the frame number corresponding to the timing at which the vertical position in the frame image is at a predetermined position is set as the frame number corresponding to the impact timing. Identify. In the present embodiment, the frame number is specified in a unit finer than an integer, for example, 103.195. Hereinafter, the frame corresponding to the frame number specified in this way will be referred to as an impact frame.

Then, the ball trajectory specifying unit 78 specifies the position of the ball (hereinafter, referred to as an initial position) before being shot. For example, the ball trajectory specifying unit 78 identifies frame images in the frames immediately before and after the impact frame. For example, when the frame number of the impact frame is 103.195, the frame having the frame number 103 corresponds to the frame immediately before the impact frame, and the frame having the frame number 104 corresponds to the frame immediately after the impact frame. do. In this case, the frame image (103) is specified as the frame image in the frame immediately before the impact frame. Further, the frame image (104) is specified as a frame image in the frame immediately after the impact frame.

Then, the ball trajectory specifying unit 78 detects an object that exists in the frame image immediately before the impact and does not exist in the frame image immediately after the impact by comparing these two frame images. Then, the ball trajectory specifying unit 78 identifies the position of the detected object as the initial position.

If the initial position cannot be specified in this way, the ball trajectory specifying unit 78 may detect the shaft from the frame image of the frame at the time of addressing (for example, the fifth frame). Then, the ball trajectory specifying portion 78 includes a line extending the detected shaft and a line extending in the left-right direction at a position 10% above the vertical length of the player area 96 from the lower side of the player area 96. The position of the intersection of the above may be specified as the initial position.

When the ballistic ball position is specified based on the comparison result image, the initial position, which is the position of the ball that is not moving in the placed state, does not become a change pixel and cannot be detected. Also, before the shot, it is highly possible that the ball is hidden by the club head. Even in such a situation, in the present embodiment, the initial position can be specified as described above.

In the present embodiment, the flight distance calculation unit 80 calculates, for example, the head speed, the ball speed, and the flight distance of the shot taken by the player 40.

For example, the flight distance calculation unit 80 first extracts, for example, a top position frame image in which the club head appears on the far left and an impact frame image in which the club head appears on the far right from the frame images included in the shooting moving image. do. FIG. 13 is a diagram showing an example of a top position frame image. FIG. 14 is a diagram showing an example of an impact frame image.

Then, the flight distance calculation unit 80 has the coordinate values (x, y) of the club head in the top position frame image and the coordinate values (x') of the head in the impact frame image, which are represented by the two-dimensional image coordinate system of the frame image. , Y') and. Then, the flight distance calculation unit 80 calculates the head movement distance D1 in the image based on the coordinate values (x, y) and the coordinate values (x', y'). Here, D1 is, for example, the square root of the sum of the square of (x'-x) and the square of (y'-y). In the frame image, the right direction is the x-axis positive direction and the downward direction is the y-axis positive direction.

Then, the flight distance calculation unit 80 multiplies the difference between the frame number of the impact frame and the frame number of the top position frame image by the shooting time interval (for example, 1/60 second) to obtain the head movement time T1 (head movement time T1). Calculated as seconds).

Then, the flight distance calculation unit 80 calculates the value obtained by dividing the value D1 by the value T1 as the head speed S (meters per second).

Then, the flight distance calculation unit 80 calculates a value obtained by multiplying the head speed S by a predetermined provisional meet rate 1.25 as the provisional ball initial velocity V (meters per second).

Then, the flight distance calculation unit 80 calculates a value obtained by multiplying the temporary ball initial velocity V by a predetermined coefficient 4 × 0.8 × 1.0936 as the temporary total flight distance D2 (yards).

Then, the flight distance calculation unit 80 moves up and down in the camera coordinate system in the frame based on the coordinate values of the ballistic ball positions in the frame image represented by the two-dimensional image coordinate system of the frame image for each frame image. Specify the angle and the left-right angle. Here, the coordinate value of the ballistic ball position with respect to the frame image (n) is expressed as (x1 (n), y1 (n)), and the vertical angle in the camera coordinate system in the frame corresponding to the frame image (n) is a1. It is expressed as (n), and the left-right angle is expressed as a2 (n). Here, the vertical angle in the camera coordinate system refers to the vertical angle when the ball is viewed from the camera unit 28 with respect to a predetermined direction, and the horizontal angle refers to the vertical angle with respect to the predetermined direction. Refers to the angle in the left-right direction when the ball is viewed from the portion 28.

In the present embodiment, as described above, the position and inclination of the user terminal 10 are adjusted, so that the two-dimensional coordinate value of the ball position can be associated with the vertical angle and the horizontal angle on a one-to-one basis. It has become. Therefore, in the present embodiment, for example, by referring to the data indicating the conversion formula and the conversion table held in advance by the flight distance calculation unit 80, the vertical angle and the horizontal angle can be determined based on the two-dimensional coordinate values of the ball position. It can be uniquely identified.

Similarly, the flight distance calculation unit 80 has a vertical angle a1'and a horizontal angle when the ball at the initial position is viewed from the camera unit 28 based on the coordinate values (x0, y0) of the initial position of the ball. Identify a2'.

Then, the flight distance calculation unit 80 specifies a parabola representing the trajectory of the ball's trajectory in the three-dimensional space, which is associated with the provisional total flight distance D2, based on the calculated provisional total flight distance D2. In this embodiment, the provisional total flight distance D2 and the shape of the parabola are associated with each other in advance. Then, the flight distance calculation unit 80 calculates the three-dimensional coordinate value of the position of the ball in the three-dimensional space along the parabola corresponding to the vertical angle and the horizontal angle. Here, for example, for the frame corresponding to the frame image (n), the three-dimensional coordinate values (x2 (n), y2 (x2 (n), y2) are based on the above-mentioned parabola, vertical angle a1 (n), and horizontal angle a2 (n). It is assumed that n) and z2 (n)) are calculated.

In the present embodiment, for example, for each frame, the three-dimensional coordinate value of the position of the ball is calculated with the three-dimensional coordinate value corresponding to the vertical angle a1'and the horizontal angle a2' about the initial position of the ball as the origin.

Here, too, since the position and inclination of the user terminal 10 are adjusted, the combination of the parabola, the vertical angle, and the horizontal angle can be associated with the three-dimensional coordinate value of the ball position on a one-to-one basis. It has become. Therefore, in the present embodiment, for example, by referring to the data indicating the conversion formula and the conversion table held in advance by the flight distance calculation unit 80, the position of the ball is determined based on the parabola, the vertical angle, and the horizontal angle. The three-dimensional coordinate values can be uniquely specified.

Then, the flight distance calculation unit 80 solves a binary equation in which the left-right angle and the elevation angle are unknowns by inputting two of the three-dimensional coordinate values of the ball positions calculated as described above. The left-right angle and elevation angle corresponding to the input are calculated.

The flight distance calculation unit 80 selects a pair of input three-dimensional coordinate values in various patterns, and calculates a combination of a left-right angle value and an elevation angle value for each pattern. Then, the flight distance calculation unit 80 determines the average value of the elevation angle values calculated for various patterns as the elevation angle a3 for the entire flight trajectory of the ball.

Then, the flight distance calculation unit 80 calculates the left-right angle for each frame when the calculated elevation angle a3 is set as a fixed value based on the three-dimensional coordinate value of the position of the ball.

Then, as shown in FIG. 15, the flight distance calculation unit 80 calculates the initial value and the final value (left-right angle when the ball lands) of the left-right angle by regression analysis. Here, for example, the left-right angle at impact is calculated as the initial value of the left-right angle. Then, the left-right angle at the position of the landing point specified based on the above-mentioned parabola is calculated as the final value of the left-right angle.

Then, the flight distance calculation unit 80 is described in 1.33. The meet rate is calculated by the formula of × (1-0.01 × elevation deviation) × cos (absolute value of left-right angle + absolute value of bending angle).

Here, the elevation angle deviation refers to the absolute value of the difference between the calculated elevation angle a3 and the value 14. Further, the left-right angle absolute value refers to the absolute value of the value calculated as the initial value of the left-right angle. The absolute value of the bending angle refers to the absolute value of the value calculated as the final value of the left-right angle minus the value calculated as the initial value of the left-right angle.

Then, the flight distance calculation unit 80 calculates the initial ball velocity by multiplying the meet rate calculated in this way by the calculated head speed S.

Then, the flight distance (yard) is calculated by multiplying the calculated initial velocity of the ball by 4 × 0.8 × 1.0936.

The method for calculating the flight distance and the like is not limited to the above method.

In the present embodiment, the club head trajectory specifying unit 82 identifies the trajectory of the club head reflected in the captured moving image, for example, based on the captured moving image.

For example, the club head trajectory specifying unit 82 first identifies the head detection area 102 shown in FIG. Here, the position, shape, and size of the head detection area 102 are uniquely specified based on, for example, the position, shape, and size of the player area 96 according to a predetermined rule. In the example of FIG. 16, a region having the same center position as the player region 96, three times the length in the left-right direction, and twice the length in the up-down direction is shown as a head detection area 102.

Then, the club head trajectory specifying unit 82 identifies the position where the club head is captured in the head detection area 102 of the frame image for the plurality of frame images included in the captured moving image. Here, for example, with respect to the frame image up to the impact frame, the area where the club head appears may be specified in the frame image. Here, the above-mentioned comparison result image may be used in specifying the area in which the club head is captured. For example, a region in the head detection region 102 corresponding to a pixel block of changing pixels, which is a range of a predetermined number of pixels, may be specified as an region in which the club head is captured. Then, the club head trajectory specifying unit 82 may specify the position of the representative point (for example, the center) in the specified area as the position where the club head is reflected (hereinafter, referred to as the club head position). good.

Then, the club head trajectory specifying unit 82 may specify the trajectory of the club head based on the specified plurality of club head positions. For example, the club head trajectory specifying unit 82 uses cubic Bezier curve calculation to interpolate the club head position specified for each frame, thereby interpolating smoothness between frames as illustrated in FIG. The linear movement locus L1 of the club head may be specified as the locus of the club head.

Further, the club head trajectory specifying unit 82 may specify the moving direction of the club head at the time of impact based on the captured moving image. For example, the club head trajectory specifying unit 82 may specify the position of the club head in the frame immediately before the impact frame on the movement trajectory L1 of the club head specified as described above. Further, the club head trajectory specifying unit 82 may specify the position of the club head in the frame immediately after the impact frame on the movement trajectory L1 of the club head specified as described above.

Then, the club head trajectory specifying portion 82 specifies a line L2 connecting the position of the club head in the frame immediately before the impact frame and the position of the club head in the frame immediately after the impact frame, which is exemplified in FIG. May be good.

Then, the club head trajectory specifying unit 82 may specify the angle of the club head moving direction at the time of impact with respect to a predetermined reference direction represented by the two-dimensional image coordinate system of the captured moving image. As shown in FIG. 17, the club head trajectory specifying portion 82 has a club at the time of impact, for example, the angle formed by the line L3 extending in the vertical direction in the frame image and the above-mentioned line L2 along the moving direction of the club head. It may be specified as the angle a4 in the moving direction of the head. Hereinafter, the angle in the moving direction of the club head at the time of the impact specified in this way will be referred to as a club pass angle. In the present embodiment, the club pass angle is in the counterclockwise direction as the positive direction. That is, the value of the club pass angle a4 shown in FIG. 17 is negative.

In the present embodiment, the launching direction specifying unit 84 specifies the launching direction of the ball reflected in the shooting moving image, for example, based on the shooting moving image.

The launch direction specifying unit 84 specifies the launch direction based on, for example, the position where the ball appears in the frame image of a plurality of frame images included in the shooting moving image. Here, for example, the launch direction specifying unit 84 may specify the launch direction based on the trajectory of the ball specified by the ball trajectory specifying unit 78. For example, the launch direction may be specified based on the ballistic ball position in the frame image in a predetermined number of frames (for example, 5 frames) immediately after the impact frame specified by the ball trajectory specifying unit 78. For example, the direction of the approximate straight line L4 along the ballistic ball position in the frame image in a predetermined number of frames immediately after the impact frame, which is exemplified in FIG. 18, may be specified as the launch direction.

Further, the launch direction specifying unit 84 may specify the angle of the launch direction with respect to a predetermined reference direction represented by the two-dimensional image coordinate system of the captured moving image. For example, as shown in FIG. 18, the angle formed by the line L3 extending in the vertical direction and the line L4 along the launch direction in the frame image may be specified as the launch angle a5. In the present embodiment, the launch angle is set to the positive direction in the counterclockwise direction. That is, the value of the launch angle a5 shown in FIG. 18 is positive.

Then, the launch direction specifying unit 84 specifies the direction of the face of the club at the time of impact based on the specified launch direction.

For example, when the absolute value of the launch angle a5 is less than a predetermined value, the orientation of the face may be specified as square. Further, when the absolute value of the launch angle a5 is equal to or higher than a predetermined value and the value of the launch angle a5 is positive, it may be specified that the orientation of the face is closed (closed). Further, when the absolute value of the launch angle a5 is equal to or higher than a predetermined value and the value of the launch angle a5 is negative, it may be specified that the orientation of the face is open (open).

In the present embodiment, the swing trajectory type specifying unit 86 specifies, for example, the type of swing trajectory performed by the player 40. Here, for example, the swing trajectory type specifying unit 86 specifies whether the swing trajectory in the swing performed by the player 40 is inside-out, inside-in, or outside-in.

The swing trajectory type specifying unit 86 may specify the type of the swing trajectory based on, for example, the above-mentioned club path angle a4.

For example, when the absolute value of the club pass angle a4 is less than a predetermined value, the type of swing trajectory may be specified as inside-in. Further, when the absolute value of the club pass angle a4 is equal to or higher than a predetermined value and the value of the club pass angle a4 is positive, the type of swing trajectory may be specified as outside-in. Further, when the absolute value of the club pass angle a4 is equal to or higher than a predetermined value and the value of the club pass angle a4 is negative, the type of swing trajectory may be specified as inside out.

The method for specifying the type of swing trajectory by the swing trajectory type specifying unit 86 is not limited to the above method.

For example, the swing trajectory type specifying unit 86 may specify the position of a predetermined body part of the player 40 in the frame image at the time of addressing based on the captured moving image. Here, for example, the swing trajectory type specifying unit 86 may specify the position of a predetermined body part of the player 40 in the frame image (for example, the frame image (5)) having a predetermined frame number. Here, for example, the position of the shoulder of the player 40 shown in the skeleton model 98 specified by the player area specifying unit 72 may be specified.

Then, as shown in FIG. 19, the swing trajectory type specifying unit 86 may specify the line L5 connecting the specified shoulder position Q1 and the initial position Q2 specified by the ball trajectory specifying unit 78.

Further, as shown in FIG. 19, the swing trajectory type specifying unit 86 may specify the line L6 along the shaft shown in the frame image.

Here, the swing trajectory type specifying unit 86 may specify the address-time shaft detection area 104 and the swing-up time-time shaft detection area 106 shown in FIG. Here, for example, the address-time shaft detection area 104 may be an area located at the lower right of the player area 96, for example, where the position and size are uniquely specified based on the player area 96. Further, the swing-up shaft detection area 106 may be, for example, an area located at the upper left of the player area 96 in which the position and size are uniquely specified based on the player area 96.

Then, the swing trajectory type specifying unit 86 may specify a frame image in which the shaft is detected in the swing-up shaft detection region 106 as a swing-up frame image. Then, the swing trajectory type specifying unit 86 represents the difference between the pixel value in the frame image at the time of address and the pixel value in the frame image at the time of swinging up for each pixel associated with each other in the shaft detection area 104 at the time of address. A detection image may be generated. Here, instead of the frame image at the time of swinging up specified as described above, the above-mentioned top position frame image may be used.

Then, the swing trajectory type specifying unit 86 may specify the line L6 along the shaft by applying a straight line detection method such as a Hough transform to the generated shaft detection image.

Then, the swing trajectory type specifying unit 86 is at least one based on at least one of the position of a predetermined body part of the player 40 at the time of addressing or the position of the shaft at the time of addressing, which is specified based on the captured moving image. A reference angle may be specified.

Here, the swing trajectory type specifying unit 86 may specify the first reference angle based on, for example, the position of a predetermined body part. Further, the swing trajectory type specifying unit 86 may specify the first reference angle based on the position of a predetermined body portion and the position of the ball before being swung.

For example, as shown in FIG. 19, the swing trajectory type specifying unit 86 has a first angle formed by a line L7 extending in the left-right direction in the frame image and a line L5 connecting the shoulder position Q1 and the initial position Q2. It may be specified as the reference angle a6 of.

Further, the swing trajectory type specifying unit 86 may specify the second reference angle based on the position of the shaft at the time of addressing, for example.

For example, as shown in FIG. 19, the swing trajectory type specifying unit 86 specifies the angle formed by the line L7 extending in the left-right direction and the line L6 along the shaft as the second reference angle a7 in the frame image. You may.

In this way, the reference angle represented by the two-dimensional image coordinate system of the captured moving image may be specified.

Further, the swing trajectory type specifying unit 86 may specify the swing-down angle of the club head reflected in the captured moving image based on the captured moving image. For example, the swing trajectory type specifying unit 86 may specify the swing-down angle based on, for example, frame images of a predetermined number of frames before impact.

Here, for example, the frame number of the frame immediately after the impact frame is m. Here, the positions of the club heads on the movement locus L1 of the club heads specified as described above for the four frames from the (m-5) th frame to the (m-2) th frame are specified. You may. Then, the moving direction of the club head from the first (m-5) frame to the (m-4) frame, the moving direction of the club head from the (m-4) frame to the third (m-3) frame, and the first (m-4) frame. Even if the line representing the moving direction obtained by averaging the moving directions of the club heads from the m-3) frame to the (m-2) frame is specified as the line L8 along the swing-down direction exemplified in FIG. 20. good.

Alternatively, an approximate straight line along the position of the club head for the four frames from the (m-5) th frame to the (m-2) th frame is a line along the swing-down direction exemplified in FIG. It may be specified as L8. The frame used to specify the line L8 is not limited to the four frames from the (m-5) th frame to the (m-2) th frame.

Then, as shown in FIG. 20, the swing trajectory type specifying unit 86 specifies the angle formed by the line L7 extending in the left-right direction and the line L8 along the above-mentioned swing-down direction as the swing-down angle a8 in the frame image. You may.

In this way, the swing-down angle represented by the two-dimensional image coordinate system of the captured moving image may be specified.

Then, the swing trajectory type specifying unit 86 may compare the above-mentioned reference angle with the above-mentioned swing-down angle. Then, the swing trajectory type specifying unit 86 may specify the type of the swing trajectory in the swing based on the comparison result between the above-mentioned reference angle and the above-mentioned swing-down angle. For example, in the swing trajectory type specifying unit 86, the swing trajectory in the swing is inside-out, inside-in, or outside-in based on the first reference angle, the second reference angle, and the swing-down angle. You may specify which one.

For example, when the value of the swing-down angle a8 is larger than the value of the first reference angle a6, the type of the swing trajectory may be specified as outside-in. In this case, it corresponds to the situation where the club is swung down from the outside (upper side) of the so-called V zone.

Further, when the value of the swing-down angle a8 is equal to or greater than the value of the second reference angle a7 and equal to or less than the value of the first reference angle a6, the type of swing trajectory may be specified as inside-in. In this case, it corresponds to a situation where the so-called swing trajectory is within the range of the V zone.

Further, when the value of the swing-down angle a8 is smaller than the value of the second reference angle a7, the type of the swing trajectory may be specified as inside-out. In this case, it corresponds to the situation where the club is swung down from the inside (lower side) of the so-called V zone.

In the present embodiment, the bending direction determination unit 88 determines the bending direction of the launched ball based on, for example, the trajectory of the club head specified as described above and the launching direction specified as described above. To judge. The bending direction determination unit 88 may determine the bending direction based on the moving direction of the club head and the launching direction.

The bending direction determination unit 88 determines the bending direction of the ball, for example, based on the difference between the signed club path angle a4 and the signed launch angle a5. For example, when the difference between the value of the signed club pass angle a4 and the value of the signed launch angle a5 is less than a predetermined value, it is determined that the ball is not bent (flyed straight). Further, for example, the difference between the value of the signed club path angle a4 and the value of the signed launch angle a5 is a predetermined value or more, and the signed launch angle a5 is larger than the value of the signed club path angle a4. If the value is higher, the ball is determined to turn to the left. Further, the difference between the value of the signed club path angle a4 and the value of the signed launch angle a5 is equal to or larger than a predetermined value, and the value of the signed launch angle a5 is larger than the value of the signed club path angle a4. If it is smaller, the ball is determined to turn to the right.

Further, the bending direction determination unit 88 may determine the bending direction and the bending size of the launched ball based on the trajectory of the club head and the launching direction. For example, the absolute value of the difference between the value of the signed club path angle a4 and the value of the signed launch angle a5 may be specified as the bending value indicating the magnitude of the bending. Further, for example, based on the magnitude of the absolute value of the difference between the value of the signed club path angle a4 and the value of the signed launch angle a5, for example, "large", "medium", "small", etc. , The bending evaluation value for evaluating the bending size in several stages (for example, three stages) may be determined.

In the present embodiment, the analysis moving image generation unit 90 generates, for example, an analysis moving image in which an image showing the result of the swing analysis processing is superimposed on the captured moving image.

In the analysis moving image generation unit 90, an image expressing the trajectory of the club head, the orientation of the club face at the time of impact specified based on the launch direction, and the bending direction of the ball is superimposed on the captured moving image. The analysis moving image may be generated. For example, an analysis moving image may be generated in which the impact image 48 shown in FIG. 2 is superimposed on the frame image included in the shooting moving image. Here, the type of the swing trajectory specified by the swing trajectory type specifying unit 86 may be represented in the impact image 48 as the trajectory of the club head.

FIG. 21 is a diagram showing an example of variations of the impact image 48. FIG. 21 shows nine types of impact images 48 according to the combination of the type of swing trajectory and the type of face orientation.

The impact image 48 shown in FIG. 21 reflects the types of the swing trajectory, the direction of the face, and the bending direction of the ball. The impact image 48 may reflect not only the type of swing trajectory, the direction of the face, and the bending direction of the ball, but also the size.

For example, the size of the angle formed by the head moving direction (direction in which the arrows are lined up) and the vertical direction shown by the head moving direction image 50 may correspond to the size of the above-mentioned club path angle a4. .. Here, the size of the angle formed by the head moving direction and the vertical direction shown by the head moving direction image 50 does not have to be the same as the size of the club path angle a4 described above. For example, the angle formed by the head moving direction and the vertical direction shown by the head moving direction image 50 may be an angle determined based on the club path angle a4 according to a predetermined conversion rule.

Further, for example, the angle formed by the head moving direction and the vertical direction shown by the head moving direction image 50 is determined based on the above-mentioned size of the club path angle a4 from among the sizes of several stages of angles. It may be of a size.

Further, for example, the magnitude of the angle formed by the stretching direction and the left-right direction of the linear face-oriented image 52 shown in FIG. 2 may correspond to the launch angle a5 described above. Here, the angle formed by the stretching direction and the left-right direction of the face-oriented image 52 does not have to be the same as the size of the launch angle a5 described above. For example, the angle formed by the stretching direction and the left-right direction of the face-oriented image 52 may be an angle determined based on the launch angle a5 according to a predetermined conversion rule.

Further, for example, the angle formed by the stretching direction and the left-right direction of the linear face-oriented image 52 is determined based on the size of the launch angle a5 described above from among the sizes of several stages of angles. May be.

Further, the size of the bend of the ball direction image 54 may correspond to the size of the absolute value of the difference between the value of the club pass angle a4 and the value of the launch angle a5. For example, the larger the absolute value of the difference between the value of the club pass angle a4 and the value of the launch angle a5, the larger the bending of the ball direction image 54 may be expressed. Further, for example, the bending size of the ball direction image 54 may be in proportion to the bending evaluation value described above.

Further, the analysis moving image generation unit 90 may generate an analysis moving image in which the line representing the above-mentioned reference angle is superimposed on the captured moving image. For example, the analysis moving image generation unit 90 may generate an analysis moving image in which the line representing the above-mentioned first reference angle and the line representing the above-mentioned second reference angle are superimposed on the captured moving image. For example, an analysis moving image may be generated in which the V-zone image 56 shown in FIG. 2 is superimposed on the frame image included in the shooting moving image. As shown in FIG. 2, the V-zone image 56 is a triangular image, the upper side corresponding to the line L5 shown in FIG. 19 and the lower side corresponding to the line L6 shown in FIG. Here, for example, the V zone image 56 may be arranged in the frame image so that the upper side and the lower side of the V zone image 56 pass through the above-mentioned initial positions.

Further, as shown in FIG. 2, a strip-shaped club head trajectory effect image 42 corresponding to the trajectory of the club head specified as described above may be superimposed on the analysis moving image. Further, the strip-shaped ball trajectory effect image 44 corresponding to the trajectory of the ball specified as described above may be superimposed on the analysis moving image.

Further, as shown in FIG. 2, analysis result information 46 indicating the analysis result by the above-mentioned swing analysis process may be arranged in the analysis moving image. For example, the analysis result information 46 includes information indicating values (ball initial velocity, flight distance, etc.) calculated by the flight distance calculation unit 80, and information indicating the type of swing trajectory specified by the swing trajectory type identification unit 86. May be included.

Then, in the present embodiment, the analysis moving image generation unit 90 stores, for example, the generated analysis moving image in the analysis moving image storage unit 92.

In the present embodiment, the analysis moving image storage unit 92 stores, for example, the analysis moving image generated by the analysis moving image generation unit 90.

In the present embodiment, the display control unit 94 causes the touch panel 26 to display the analysis video stored in the analysis video storage unit 92 in response to a request from the user of the user terminal 10, for example. In this way, the display control unit 94 may notify the user of the comparison result between the above-mentioned reference angle and the above-mentioned swing-down angle. For example, the display control unit 94 may notify the user of the type of swing trajectory specified based on the comparison result between the above-mentioned reference angle and the above-mentioned swing-down angle.

Here, an example of the flow of processing performed by the user terminal 10 according to the present embodiment will be described with reference to the flow diagram illustrated in FIG. 22.

First, the shooting moving image acquisition unit 70 acquires the shooting moving image (S101).

Then, the player area specifying unit 72 specifies the player area 96 (S102).

Then, the comparison result image generation unit 74 generates a plurality of comparison result images based on the shooting moving image acquired by the process shown in S101 (S103).

Then, the starting point area specifying unit 76 specifies the starting point area 100 based on the player area 96 specified by the process shown in S102 (S104).

Then, the ball trajectory specifying unit 78 identifies the trajectory of the ball based on the comparison result image generated by the process shown in S103 (S105).

Then, the flight distance calculation unit 80 calculates the flight distance and the like of the shot in the swing captured in the shooting moving image acquired by the process shown in S101 (S106).

Then, the club head trajectory specifying unit 82 identifies the trajectory of the club head based on the captured moving image acquired by the process shown in S101 (S107).

Then, the launch direction specifying unit 84 specifies the launch direction of the ball based on the trajectory of the ball specified by the process shown in S105 (S108).

Then, the swing trajectory type specifying unit 86 was acquired by the process shown in S101 based on the trajectory of the club head specified by the process shown in S107 and the launch direction of the ball specified by the process shown in S108. The type of swing trajectory in the swing shown in the captured moving image is specified (S109).

Then, the bending direction determination unit 88 determines the bending direction of the ball in the shot based on the trajectory of the club head specified by the process shown in S107 and the launching direction of the ball specified by the process shown in S108. Judgment (S110).

Then, the analysis moving image generation unit 90 generates an analysis moving image based on the shooting moving image acquired by the process shown in S101 and the result of the processing shown in S105 to S110 (S111).

Then, the analysis moving image generation unit 90 stores the analysis moving image generated by the process shown in S111 in the analysis moving image storage unit 92 (S112), and the process shown in this processing example is completed.

As described above, in the process shown in S109, the swing trajectory type specifying unit 86 may specify the swing-down angle and the reference angle. Then, the swing trajectory type specifying unit 86 may specify the type of swing trajectory in the swing reflected in the captured moving image acquired by the process shown in S101 based on the specified swing-down angle and reference angle.

In the present embodiment, it is possible to accurately determine the bending direction of the ball without directly measuring the direction of the face only by photographing the player who is swinging the golf. In this way, according to the present embodiment, a general player can easily analyze a golf swing at a golf course, a driving range, or the like using a smartphone or the like.

Further, in the present embodiment, the above-mentioned reference angle and the above-mentioned swing-down angle are compared only by photographing the player who is swinging the golf. Therefore, according to the present embodiment, even a general player who does not have knowledge about golf such as an appropriate swing plane angle range can swing correctly by knowing the comparison result between the reference angle and the swing-down angle. It will be possible to easily grasp whether or not it was possible.

Further, in the present embodiment, as described above, the type of swing trajectory in the swing is accurately specified based on the above-mentioned reference angle and the above-mentioned swing-down angle. Therefore, according to the present embodiment, even a general player can easily grasp whether or not he / she was able to swing on the correct swing trajectory by knowing the type of his / her own swing trajectory.

In this embodiment, the above-mentioned first reference angle does not have to be specified based on the position of the shoulder, and may be specified based on, for example, the position of the neck muscle of the player 40.

Further, for example, the above-mentioned first reference angle does not need to be specified based on the initial position of the ball, and may be specified, for example, based on the position specified by the user or the position of the club head at the time of addressing. ..

Further, for example, the above-mentioned second reference angle does not need to be specified based on the position of the shaft, and may be specified based on the position of the waist of the player 40, for example. For example, the above-mentioned second reference angle is specified based on a line connecting the position of the waist of the player 40 and the initial position of the ball, or a line connecting the position of the waist of the player 40 and the position of the club head at the time of addressing. May be done.

Further, it is not necessary to specify two reference angles, and the type of swing trajectory may be specified based on one reference angle. For example, it may be specified whether or not it is outside-in based on one reference angle. Further, for example, it may be specified whether or not it is inside out based on one reference angle.

Further, all or part of the processing shown in FIG. 3 may be implemented by a server capable of communicating with the user terminal 10.

[Second Embodiment]
Hereinafter, a second embodiment, which is an embodiment of the present invention, will be described in detail with reference to the drawings.

FIG. 23 is a diagram showing an example of the configuration of the ball position sharing system 200 according to the present embodiment. The ball position sharing system 200 includes a map data providing server 202 and a plurality of user terminals 10.

As shown in FIG. 23, the ball position sharing system 200 has four user terminals 10 (10a, 10b, 10c, and four) possessed by each of the four players who round together in golf play at a golf course. 10d) may be included. Hereinafter, the players possessing the user terminals 10a, 10b, 10c, and 10d will be referred to as player A, player B, player C, and player D, respectively.

Since the configuration of the user terminal 10 according to the present embodiment is the same as that of the user terminal 10 described in the first embodiment, the description thereof will be omitted.

In the present embodiment, the map data providing server 202 is, for example, a server that provides map data including images such as aerial images, satellite images, and map images in which geographical positions (for example, latitude and longitude) are associated with each pixel. be.

The user terminal 10 and the map data providing server 202 are connected to a computer network 204 such as the Internet. Therefore, the user terminal 10 and the map data providing server 202 can communicate with each other via the computer network 204, and the user terminals 10 can also communicate with each other. It should be noted that the user terminals 10 may be able to directly communicate with each other without going through the computer network 204 by, for example, short-range wireless communication such as Bluetooth (registered trademark).

In the present embodiment, for example, in golf play at a golf course, a state in which a player is shooting a golf ball is photographed by a camera unit 28 included in a user terminal 10 in the same manner as in the first embodiment. Then, a shooting moving image showing the player shooting a golf ball is generated.

In the present embodiment, the position and tilt of the user terminal 10 are adjusted so that the position of the player with respect to the position of the camera unit 28 becomes a predetermined position and the direction of the player with respect to the shooting direction becomes a predetermined direction. In the present embodiment, the photographing direction is the direction along the horizontal plane.

Then, in the present embodiment, for example, the hole image 206 illustrated in FIG. 24 is generated based on the photographed moving image. Then, the generated hall image 206 is displayed on the touch panel 26 included in the user terminal 10.

As shown in FIG. 24, the hole image 206 includes, for example, a ball position image 208, navigation information 210, and a terminal position image 212. The ball position image 208 is, for example, an image showing the geographical position of the shot ball. As shown in FIG. 24, a character string representing player identification information such as the name of the player who made the shot may be arranged near the ball position image 208.

The navigation information 210 includes a character string representing information presented to the player, such as the remaining distance and the number recommended for use in the next shot.

The terminal position image 212 is, for example, an image showing the geographical position of the user terminal 10 at the time of shooting a shooting moving image.

FIG. 25 is a diagram showing another example of the hall image 206 according to the present embodiment. As shown in FIG. 25, the hole image 206 may include a prediction range image 214, which is an image according to the accuracy of the geographical position of the ball shown in the ball position image 208. The prediction range image 214 in the example of FIG. 25 is a circular image, and the higher the accuracy, the smaller the radius.

Further, as shown in FIG. 25, the navigation information 210 may indicate the range of the remaining distance. Further, as shown in FIG. 25, the navigation information 210 may indicate a plurality of counts recommended for use in the next shot.

As described above, according to the present embodiment, the user of the user terminal 10 can confirm the geographical position of the shot ball and the like.

The hall image 206 shown in FIGS. 24 and 25 may not include the navigation information 210.

Further, in the present embodiment, for example, as shown in FIG. 26, a hole image 206 including a plurality of ball position images 208, a plurality of prediction range images 214, and navigation information 210 may be generated. Here, the combination of the ball position image 208 and the prediction range image 214 is associated with the player who made the shot in the hole. Further, the navigation information 210 shown in FIG. 26 includes, for example, the remaining distance of each player, the number recommended to be used in the next shot for each player, and the order in which the remaining distance is long (generally, in the next shot). (Associated in batting order), etc. are included.

The hole image 206 shown in FIG. 26 may not include the prediction range image 214. Further, the hall image 206 shown in FIG. 26 may not include the navigation information 210. Further, in the navigation information 210 shown in FIG. 26, the remaining distance as shown in FIG. 24 may be indicated instead of the range of the remaining distance. Further, as shown in FIG. 26, in the navigation information 210, only one count recommended for use in the next shot may be indicated, or a plurality of counts may be indicated. Further, the hall image 206 shown in FIG. 26 may include the terminal position image 212.

Hereinafter, the functions of the user terminal 10 according to the present embodiment and the processes executed by the user terminal 10 according to the present embodiment will be further described, focusing on the processes related to the generation and display of the hall image 206 described above.

FIG. 27 is a functional block diagram showing an example of a function implemented in the user terminal 10 according to the present embodiment. It should be noted that it is not necessary for the user terminal 10 according to the present embodiment to implement all of the functions shown in FIG. 27, and functions other than the functions shown in FIG. 27 may be implemented.

The user terminal 10 according to the present embodiment has a function as a ball position specifying system for specifying the geographical position of the shot ball. Then, as shown in FIG. 27, the user terminal 10 according to the present embodiment is functionally, for example, functionally, for example, a shooting moving image acquisition unit 70, a player area specifying unit 72, a comparison result image generation unit 74, and a starting point area specifying unit. 76, ball trajectory specifying unit 78, display control unit 94, shot specifying unit 220, terminal position orientation specifying unit 222, ball position specifying unit 224, accuracy specifying unit 226, remaining distance specifying unit 228, shot count information acquisition unit 230, recommended. The count specifying unit 232, the player information acquisition unit 234, the ball data generation unit 236, the ball data transmission unit 238, the ball data reception unit 240, the map data acquisition unit 242, and the hall image generation unit 244 are included.

Shooting moving image acquisition unit 70, player area identification unit 72, comparison result image generation unit 74, starting point area identification unit 76, ball trajectory identification unit 78, shot identification unit 220, ball position identification unit 224, accuracy identification unit 226, remaining distance. The processor 20 is mainly mounted on the specific unit 228, the recommended count specific unit 232, the ball data generation unit 236, and the hole image generation unit 244. The display control unit 94, the shot count information acquisition unit 230, and the player information acquisition unit 234 are mainly mounted with the processor 20 and the touch panel 26. The terminal position / orientation specifying unit 222 mainly mounts the processor 20 and the sensor unit 30. The ball data transmission unit 238, the ball data reception unit 240, and the map data acquisition unit 242 are mainly mounted with the communication unit 24.

The above functions may be implemented by executing a program installed on the user terminal 10 which is a computer and including a command corresponding to the above functions on the user terminal 10. Further, this program may be supplied to the user terminal 10 via a computer-readable information storage medium such as an optical disk, a magnetic disk, a magnetic tape, or a magneto-optical disk, or via the Internet or the like.

The functions of the shooting moving image acquisition unit 70, the player area specifying unit 72, the comparison result image generation unit 74, the starting point region specifying unit 76, and the ball trajectory specifying unit 78 are the shooting moving image acquisition units 70 described in the first embodiment, respectively. Since the functions are the same as those of the player area specifying unit 72, the comparison result image generation unit 74, the starting point area specifying unit 76, and the ball trajectory specifying unit 78, the description thereof will be omitted.

In the present embodiment, the shot specifying unit 220 is, for example, based on the measured value related to the golf ball acquired from the user terminal 10 that measures the shot golf ball, and the flight distance of the golf ball and the measurement are performed. The angle with respect to the direction in which the user terminal 10 is facing is specified. The shot specifying unit 220 specifies, for example, the flight distance of a golf ball and the horizontal angle with respect to the direction in which the user terminal 10 is facing at the time of the measurement. Here, the horizontal angle means an angle along a horizontal plane.

The shot specifying unit 220 may be equipped with a function similar to that of the flight distance calculation unit 80 in the first embodiment. In this case, for example, even if the signed value calculated as the final value of the left-right angle, which is shown as the final left-right angle in FIG. 15, is specified as the value indicating the angle with respect to the direction in which the user terminal 10 is facing. good.

Here, for example, as described in the first embodiment, the frame image is about at least one frame image included in the shooting moving image in which the ball trajectory specifying unit 78 shows the player shooting a golf ball. The position in the image, which is the position of the golf ball reflected inside, may be specified. For example, the ballistic ball position described in the first embodiment corresponds to the position in the specified image. Then, the shot specifying unit 220 may specify the flight distance of the golf ball and the angle with respect to the direction in which the user terminal 10 is facing at the time of measurement, based on the specified position in the image.

The shot specifying unit 220 does not need to specify the above-mentioned flight distance and the above-mentioned angle based on the captured moving image. For example, when the sensor unit 30 includes a laser sensor, the above-mentioned flight distance and the above-mentioned angle may be specified based on the measured value by the laser sensor.

In the present embodiment, the terminal position / orientation specifying unit 222 determines, for example, the terminal position which is the geographical position of the user terminal 10 at the time of the above measurement and the terminal orientation which is the direction at which the user terminal 10 faces at the time of the measurement. Identify. Here, as the geographical position of the user terminal 10, for example, the latitude and longitude of the user terminal 10 may be specified. The specified geographical position is not limited to latitude and longitude.

In the present embodiment, the ball position specifying unit 224 is based on, for example, the above-mentioned terminal position, the above-mentioned terminal orientation, the flight distance specified by the shot specifying unit 220, and the angle specified by the shot specifying unit 220. Identify the ball position, which is the geographical position of the shot golf ball. As the geographical position of the golf ball shot here, for example, the latitude and longitude of the golf ball may be specified. The specified geographical position is not limited to latitude and longitude.

In the present embodiment, the accuracy specifying unit 226 specifies the accuracy of at least one of the flight distance or the angle specified by the shot specifying unit 220, for example. Here, the accuracy specifying unit 226 may specify the accuracy based on the number of frame images for which the above-mentioned position in the image is specified. For example, as the number of frame images for which the position in the image is specified increases, a large value may be specified as a value indicating accuracy. Data indicating the association between the number of frame images and the accuracy may be stored in the accuracy specifying unit 226. This association may be in mathematical form or in table form. Then, a value indicating accuracy may be specified based on this data. The accuracy of at least one of the flight distance and the angle does not need to be specified based on the number of frame images for which the position in the image is specified.

In general, the longer the flight distance specified by the shot specifying unit 220, the smaller the value indicating the accuracy specified by the accuracy specifying unit 226 is likely to be.

In the present embodiment, the remaining distance specifying unit 228 specifies the remaining distance in the hole where golf play is performed, based on, for example, the ball position specified by the ball position specifying unit 224. Here, the remaining distance specifying unit 228 may store, for example, the geographical position of the green center of the hole where golf play is performed, or the green position data indicating the geographical position of the pin. Then, the remaining distance specifying unit 228 may specify the remaining distance based on the green position data and the ball position specified by the ball position specifying unit 224.

Further, the remaining distance specifying unit 228 may specify the range of the remaining distance based on the ball position specified by the ball position specifying unit 224 and the above-mentioned accuracy specified by the accuracy specifying unit 226. The remaining distance specifying unit 228 may specify the range of the remaining distance so that, for example, the larger the value indicating the accuracy specified by the accuracy specifying unit 226, the smaller the size of the range.

For example, suppose the remaining distance is specified as 140 yards based on the ball position. In this case, if the value indicating accuracy is 80% or more, the size of the range may be specified as 0 yard. In this case, 140 yards is specified as the range of remaining distance. Further, when the value indicating the accuracy is 60% or more and less than 80%, the size of the range may be specified as 10 yards. In this case, 135 yards to 145 yards is specified as the range of the remaining distance. Further, when the value indicating accuracy is 40% or more and less than 60%, the size of the range may be specified as 20 yards. In this case, 130 yards to 150 yards is specified as the range of the remaining distance.

In the present embodiment, the shot count information acquisition unit 230 acquires shot count information indicating the count used in the shot captured in the shot moving image, for example. For example, the user may perform an input operation for designating the number of the club used in the shot captured in the shot moving image before or after shooting the shot moving image. Then, the shot count information acquisition unit 230 may acquire the shot count information indicating the count specified by the input operation. Further, the shot count information acquisition unit 230 may specify the club count used in the shot captured in the shot moving image, for example, by executing an image recognition process on the shot moving image. Then, the shot count information acquisition unit 230 may acquire the shot count information indicating the count.

In this embodiment, the recommended count specifying unit 232 is recommended to be used in the next shot based on, for example, the flight distance specified by the shot specifying unit 220 and the remaining distance specified by the remaining distance specifying unit 228. Identify the number to do. Hereinafter, the count specified in this way will be referred to as a recommended count.

The recommended count specifying unit 232 is shown in FIGS. 28 and 29, for example, based on the flight distance specified by the shot specifying unit 220 and the count indicated by the shot count information acquired by the shot count information acquisition unit 230. Such data corresponding to the count flight distance in which the count and the flight distance are associated may be generated. FIG. 28 shows the count flight distance correspondence data generated when the flight distance specified when the driver shot is taken is 240 yards. FIG. 29 shows the count flight distance correspondence data generated when the flight distance specified when the driver shot is taken is 160 yards.

Here, for example, the count flight distance correspondence data may be generated based on the data showing the calculation formula held in advance by the recommended count specifying unit 232 or the correspondence table.

Then, the recommended count specifying unit 232 may specify the recommended count based on the count flight distance correspondence data and the remaining distance specified by the remaining distance specifying unit 228. For example, in the count flight distance correspondence data, the count associated with the flight distance matching the remaining distance or the flight distance closest to the remaining distance may be specified as the recommended count. For example, when the remaining distance is 140 yards and the generated count flight distance correspondence data is as shown in FIG. 28, the 8 iron may be specified as the recommended count. On the other hand, when the remaining distance is 140 yards and the generated count flight distance correspondence data is as shown in FIG. 29, the third wood may be specified as the recommended count.

Here, the recommended number specifying unit 232 may specify a number of recommended numbers according to the range of the remaining distance. Further, the recommended number specifying unit 232 may specify a number of recommended numbers according to the range of the specified flight distance and the remaining distance. For example, in the count flight distance correspondence data, one or a plurality of counts associated with the flight distance included in the range of the remaining distance may be specified as the recommended count. Alternatively, in the count flight distance correspondence data, the count associated with the flight distance closest to the range of the remaining distance may be specified as the recommended count. For example, when the range of the remaining distance is 130 yards to 150 yards and the generated count flight distance correspondence data is as shown in FIG. 28, the 7th iron, the 8th iron, and the 9th iron are used. It may be specified as a recommended count.

Further, for example, when the range of the remaining distance is 125 yards to 135 yards and the generated count flight distance correspondence data is as shown in FIG. 29, the 5th wood may be specified as the recommended count.

The driver may not be specified as the recommended number. For example, when the range of the remaining distance is 170 yards to 180 yards and the generated count flight distance correspondence data is as shown in FIG. 29, the 3rd wood is specified as the recommended count instead of the driver. You may.

Further, the count and the flight are based on the flight distance specified by the shot specifying unit 220, the accuracy specified by the accuracy specifying unit 226, and the count indicated by the shot count information acquired by the shot count information acquisition unit 230. The count flight distance correspondence data associated with the range of the distance may be generated. In the count flight distance correspondence data, a count corresponding to a flight distance range in which a part or all of the flight distance range overlaps with the remaining distance range may be specified as a recommended count.

In the present embodiment, the player information acquisition unit 234 acquires player information indicating player identification information such as a player's name appearing in a captured moving image. The player information acquisition unit 234 may acquire player information indicating the player's identification information such as the player's name, which is input by the user's operation before the shooting of the shooting moving image or after the shooting of the shooting moving image. ..

In the present embodiment, the ball data generation unit 236 generates ball data including ball position data indicating the ball position specified by the ball position specifying unit 224, for example. Here, the ball data generation unit 236 may generate ball data including the remaining distance data indicating the remaining distance specified by the remaining distance specifying unit 228 or the range of the remaining distance. Further, the ball data generation unit 236 may generate ball data including accuracy data indicating the accuracy specified by the accuracy specifying unit 226. Further, the ball data generation unit 236 may generate ball data including the recommended number data indicating the club number specified by the recommended number specifying unit 232. Further, the ball data generation unit 236 may generate ball data including the player information acquired by the player information acquisition unit 234.

In the present embodiment, the ball data transmission unit 238 transmits, for example, the ball position data indicating the above-mentioned ball position. For example, the ball data transmission unit 238 transmits the ball data generated by the ball data generation unit 236 to another user terminal 10.

In the present embodiment, the ball data receiving unit 240 receives, for example, the ball position data indicating the above-mentioned ball position. For example, the ball data receiving unit 240 receives ball data transmitted from another user terminal 10. The ball position specifying unit 224 may specify the ball position associated with the ball position data based on the ball position data received by the ball data receiving unit 240.

For example, it is assumed that the player A shoots a shooting moving image in which the player B is captured by the user terminal 10a. Then, it is assumed that the ball data is generated in the user terminal 10a based on the captured moving image. In this case, the player A performs a predetermined transmission operation to the user terminal 10a, and the player B performs a predetermined reception operation to the user terminal 10b, so that the generated ball data is transmitted from the user terminal 10a to the user terminal. It may be transmitted to 10b. In this way, in the present embodiment, even if the user terminal 10a of the player A shoots a shooting moving image in which the shot of the player B is captured, the player B uses the ball data based on the shooting moving image on the user terminal 10b. It will be possible to handle at.

Further, the ball position specifying unit 224 may specify the ball positions of a plurality of golf balls shot by different players. For example, the ball data generation unit 236 of the user terminal 10a may generate ball data for the player A. Then, the ball data receiving unit 240 of the user terminal 10a may receive the ball data about the player B from the user terminal 10b. Then, the ball data receiving unit 240 of the user terminal 10a may receive the ball data about the player C from the user terminal 10c. Then, the ball data receiving unit 240 of the user terminal 10a may receive the ball data about the player D from the user terminal 10d.

Then, the ball position specifying unit 224 is based on the ball data of the player A generated by the ball data generation unit 236 and the ball data of the player B, the player C, and the player D received by the ball data receiving unit 240. Therefore, a plurality of ball positions associated with each of the player A, the player B, the player C, and the player D may be specified.

In the present embodiment, the map data acquisition unit 242 has, for example, an aerial image, a satellite image, a map image, or the like of a golf course where golf play is performed, in which a geographical position (for example, latitude and longitude) is associated with each pixel. Get map data, including images of. The map data acquisition unit 242 may, for example, receive the map data of the golf course designated by the input operation of the user from the map data providing server 202. Further, the map data is stored in the storage unit 22 of the user terminal 10, and the map data acquisition unit 242 may acquire the map data stored in the storage unit 22.

In the present embodiment, the hole image generation unit 244 generates, for example, the hole image 206 illustrated in FIGS. 24 to 26. Here, for example, the hole image generation unit 244 is located at a position in the image included in the map data acquired by the map data acquisition unit 242, which is associated with the geographical position of the golf ball specified by the ball position identification unit 224. A hole image 206 in which the ball position image 208 is superimposed may be generated.

Further, the hole image generation unit 244 is a hole in which the prediction range image 214, which is a circular image having a radius associated with the accuracy specified by the accuracy specifying unit 226, is superimposed and arranged around the position of the ball position image 208. Image 206 may be generated. For example, data indicating the association between accuracy and radius may be stored in the Hall image generation unit 244. This association may be in mathematical form or in table form. Then, the radius of the predicted range image 214 may be determined based on this data. Here, for example, the larger the value indicating the specified accuracy, the smaller the determined radius may be. Further, the hall image 206 in which the predicted range image 214 corresponding to the specified remaining distance range is arranged may be generated.

Further, the hall image generation unit 244 superimposes the terminal position image 212 on the position in the image included in the map data acquired by the map data acquisition unit 242, which is associated with the terminal position specified by the terminal position orientation specifying unit 222. The arranged hole image 206 may be generated.

Further, the hall image generation unit 244 is arranged with the navigation information 210 including the remaining distance specified by the remaining distance specifying unit 228 and the character string representing the recommended number specified by the recommended number specifying unit 232 superimposed. May be generated.

Further, the hole image generation unit 244 is a hole image in which a ball position image 208 indicating a ball position in a shot of the player, which is associated with a character string representing the player information of the player, is superimposed and arranged for each of the plurality of players. 206 may be generated. Further, the hole image generation unit 244 is a circular image having a radius associated with the above-mentioned accuracy for the player, centered on the position of the ball position image 208 associated with the player, for each of the plurality of players. A hole image 206 in which a certain prediction range image 214 is superimposed may be generated. Further, for each of the plurality of players, a hole image 206 may be generated in which the navigation information 210 including the remaining distance for the player and the character string representing the recommended number is superimposed and arranged.

Further, the hole image generation unit 244 may generate the hole image 206 based on the ball data received by the ball data reception unit 240. Here, for example, the hall image generation unit 244 of the user terminal 10a has a ball position specified based on a measured value acquired from the user terminal 10a, and from each of the user terminal 10b, the user terminal 10c, and the user terminal 10d. You may generate a hole image 206 showing the ball position data to be received and a plurality of ball positions identified based on the ball position data.

Further, the hole image generation unit 244 may specify the order in which the remaining distances for the plurality of players are long, based on the remaining distance data included in the ball data. Then, as shown in FIG. 26, the hall image generation unit 244 may generate the hall image 206 in which the navigation information 210 including the character string indicating the order in which the remaining distance is long is superimposed and arranged. Alternatively, the hole image generation unit 244 may generate a hole image 206 in which the player with the longest remaining distance is identified and displayed (for example, the player information of the player with the longest remaining distance is arranged). In general, the player with the longest remaining distance is the player to be shot next, so in this way, it is possible to accurately grasp who should be shot next.

Further, the hole image generation unit 244 generates a hole image 206 in which the navigation information 210 including the range of the remaining distance or the remaining distance for the player having the longest remaining distance and the character string representing the recommended count is superimposed and arranged. May be good.

In the present embodiment, the display control unit 94 displays, for example, the hall image 206 illustrated in FIGS. 24 to 26 on the touch panel 26. As shown in FIG. 26, the display control unit 94 may display a plurality of ball positions on the touch panel 26 included in the user terminal 10. Here, for example, the hall image 206 may be displayed according to a predetermined display operation.

Further, the display control unit 94 of the user terminal 10 determines the ball position specified based on the measured value acquired from the user terminal 10 and the ball position specified based on the received ball position data on the touch panel 26. It may be displayed in.

Further, as shown in FIG. 26, the display control unit 94 may display the hole image 206 showing information regarding the order of the remaining distances for the plurality of players. In this case, the display control unit 94 serves as a notification unit for notifying information regarding the order of the remaining distances for the plurality of players, which is generated based on the plurality of ball positions.

Note that the notification of information regarding the order of the remaining distances for the plurality of players is not limited to the mode shown in FIG. 26. For example, even if the display control unit 94 of the user terminal 10 used by the player having the longest remaining distance displays information indicating that the batting order is next on the touch panel 26, the notification is performed. good. Further, the display control unit 94 does not have to play a role as a notification unit. For example, the notification may be performed by causing a predetermined voice output from the user terminal 10 used by the player having the longest remaining distance.

Here, an example of the flow of processing performed by the user terminal 10 according to the present embodiment will be described with reference to the flow diagram illustrated in FIG.

First, the map data acquisition unit 242 acquires the map data (S201).

Then, the player information acquisition unit 234 acquires the player information of the player who performs the shot (S202).

Then, the shot count information acquisition unit 230 acquires shot count information indicating the count used in the shot (S203).

Then, the shooting of the shooting moving image is started, and the processes shown in S204 to S208 are executed. Since the processes shown in S204 to S208 are the same as the processes shown in S101 to S105, the description thereof will be omitted.

When the trajectory of the ball is specified by the process shown in S208, the shot specifying unit 220 faces the user terminal 10 when measuring the flight distance and measurement of the golf ball in the shot shown in the captured moving image acquired by the process shown in S204. The angle with respect to the direction is specified (S209).

Then, the terminal position / orientation specifying unit 222 specifies the terminal position and the terminal orientation of the user terminal 10 at the time of shooting the shooting moving image (S210).

Then, the ball position specifying unit 224 specifies the ball position based on the terminal position and the terminal direction specified by the process shown in S210, and the flight distance and the angle specified by the process shown in S209 (S211). ..

Then, the accuracy specifying unit 226 has a flight distance in the process shown in S209 based on the number of frame images in which the ballistic ball position is specified among the frame images included in the shooting moving image acquired in the process shown in S204. And the specific accuracy of the angle (S212).

Then, the remaining distance specifying unit 228 specifies the range of the remaining distance based on the ball position specified by the process shown in S211 and the accuracy specified by the process shown in S212 (S213).

Then, the recommended count specifying unit 232 is within the range of the count indicated by the shot count information acquired in the process shown in S203, the flight distance specified in the process shown in S209, and the remaining distance specified in the process shown in S213. Based on this, at least one recommended count is specified (S214).

Then, the ball data generation unit 236 determines the ball position data indicating the ball position specified in the process shown in S211, the accuracy data indicating the accuracy specified in the process shown in S212, and the remaining distance specified in the process shown in S213. The ball data including the remaining distance data indicating the range, the recommended number data indicating the recommended number specified in the process shown in S214, and the player information acquired in the process shown in S202 is generated (S215).

Then, the hole image generation unit 244 generates the hole image 206 based on the ball data generated by the process shown in S215 (S216).

Then, the display control unit 94 displays the hall image 206 generated by the process shown in S216 on the touch panel 26 (S217), and the process shown in this processing example is completed.

The ball data generated by the process shown in S215 may be transmitted to another user terminal 10 according to the user's operation.

If there is ball data received from another user terminal 10 before the process shown in S216, the ball data generated in the process shown in S215 and the received ball data in the process shown in S216 Based on this, the hole image 206 may be generated.

As described above, in the present embodiment, the geographical position of the shot golf ball can be accurately specified without fixing the user terminal 10 for measuring the golf ball at a predetermined position.

The present invention is not limited to the above-described embodiment.

For example, when the map data includes a 3D model of the terrain, the final ball position may be determined based on the inclination at the position specified by the ball position specifying unit 224.

Further, the hall image 206 including the terminal position image 212 may be displayed on the touch panel 26 of the user terminal 10 in response to a predetermined operation on the user terminal 10 before shooting the captured moving image. The hole image 206 does not include the ball position image 208, the navigation information 210, or the prediction range image 214.

Further, the present invention is applicable not only to the scene of specifying the geographical position of the golf ball shot on the tee shot but also to the scene of specifying the geographical position of the golf ball shot after the second shot.

Further, the above-mentioned specific character strings and numerical values and specific character strings and numerical values in the drawings are examples, and are not limited to these character strings and numerical values.

10,10a,10b,10c,10d user terminal, 20 processor, 22 storage unit, 24 communication unit, 26 touch panel, 28 camera unit, 30 sensor unit, 40 player, 42 club head trajectory effect image, 44 ball trajectory effect image, 46 Analysis result information, 48 Impact image, 50 Head movement direction image, 52 Face orientation image, 54 Ball direction image, 56 V zone image, 70 Shooting moving image acquisition unit, 72 Player area identification unit, 74 Comparison result image generation unit, 76 Origin area identification part, 78 Ball ballistic identification part, 80 Flying distance calculation part, 82 Club head trajectory identification part, 84 Launch direction identification part, 86 Swing trajectory type identification part, 88 Bending direction determination part, 90 Analysis video generation part , 92 analysis video storage unit, 94 display control unit, 96 player area, 98 skeleton model, 100 starting point area, 102 head detection area, 104 address shaft detection area, 106 swing-up shaft detection area, 200 ball position sharing system, 202 Map data providing server, 204 Computer network, 206 hole image, 208 ball position image, 210 navigation information, 212 terminal position image, 214 prediction range image, 220 shot identification part, 222 terminal position orientation identification part, 224 ball position identification part 226 Accuracy identification unit, 228 distance identification unit, 230 shot count information acquisition unit, 232 Recommended count identification unit, 234 Player information acquisition unit, 236 ball data generation unit, 238 ball data transmission unit, 240 ball data reception unit, 242 map Data acquisition unit, 244 hole image generation unit.

Claims (14)

A shooting moving image acquisition means for acquiring a shooting moving image of a player shooting the golf ball, which is taken by a shooting unit included in a measuring terminal that measures the shot golf ball.
With respect to at least one frame image included in the captured moving image, an in-image position specifying means for specifying an in-image position which is a position of the golf ball reflected in the frame image, and an in-image position specifying means.
A shot specifying means for specifying the flight distance of the golf ball and the angle with respect to the direction in which the measuring terminal is facing at the time of the measurement based on the position in the image .
A terminal position orientation specifying means for specifying a terminal position which is a geographical position of the measuring terminal at the time of the measurement and a terminal orientation which is an orientation toward which the measuring terminal is facing at the time of the measurement.
A ball position specifying means for specifying a ball position, which is a geographical position of the shot golf ball, based on the terminal position, the terminal direction, the flight distance, and the angle.
An accuracy specifying means for specifying the accuracy of at least one of the specified flight distance or the angle based on the number of the frame images for which the position in the image is specified.
A ball positioning system characterized by including. Remaining distance specifying means for specifying the range of the remaining distance in the hole where golf play is performed based on the ball position and the accuracy.
Based on the flight distance and the range of the remaining distance, a recommended count specifying means for specifying a number corresponding to the range of the flight distance and the remaining distance, which is recommended for use in the next shot, and Including,
The ball position specifying system according to claim 1 . Based on the measured value related to the golf ball acquired from the measuring terminal that measured the shot golf ball, the flight distance of the golf ball and the angle with respect to the direction in which the measuring terminal is facing at the time of the measurement are specified. Shot identification means and
A terminal position orientation specifying means for specifying a terminal position which is a geographical position of the measuring terminal at the time of the measurement and a terminal orientation which is an orientation toward which the measuring terminal is facing at the time of the measurement.
A ball position specifying means for specifying a ball position, which is a geographical position of the shot golf ball, based on the terminal position, the terminal direction, the flight distance, and the angle.
Remaining distance specifying means for specifying the remaining distance in the hole where golf play is performed based on the ball position, and
Based on the flight distance and the remaining distance, a recommended count specifying means for specifying a count recommended for use in the next shot, and a recommended count specifying means.
A ball positioning system characterized by including. Further including an accuracy specifying means for specifying the accuracy of at least one of the flight distance or the angle.
The remaining distance specifying means specifies the range of the remaining distance based on the ball position and the accuracy.
The recommended count specifying means identifies a number of the counts according to the range of the remaining distance.
The ball position specifying system according to claim 3 . Based on the measured value related to the golf ball acquired from the measuring terminal that measured the shot golf ball, the flight distance of the golf ball and the angle with respect to the direction in which the measuring terminal is facing at the time of the measurement are specified. Shot identification means and
A terminal position orientation specifying means for specifying a terminal position which is a geographical position of the measuring terminal at the time of the measurement and a terminal orientation which is an orientation toward which the measuring terminal is facing at the time of the measurement.
A ball position that is the geographical position of the shot golf ball for a plurality of golf balls shot by different players based on the terminal position, the terminal orientation, the flight distance, and the angle. Ball position identification means to identify and
A notification means for notifying information about the order of remaining distances for the plurality of players, which is generated based on the plurality of the ball positions.
A ball positioning system characterized by including. A display control means for displaying the plurality of ball positions on a display unit included in the measurement terminal is further included.
The ball position specifying system according to claim 5. The ball position data receiving means for receiving the ball position data indicating the ball position is further included.
The display control means causes the display unit to display the ball position specified based on the measured value acquired from the measurement terminal and the ball position specified based on the received ball position data. ,
The ball position specifying system according to claim 6 . A ball position data transmitting means for transmitting ball position data indicating the ball position is further included.
The ball position specifying system according to any one of claims 1 to 7 , wherein the ball position is specified. A step of acquiring a shooting moving image of a player shooting a golf ball, which is shot by a shooting unit included in a measuring terminal that measures the shot golf ball.
With respect to at least one frame image included in the captured moving image, a step of specifying a position in the image which is a position of the golf ball reflected in the frame image, and a step of specifying the position in the image.
A step of specifying the flight distance of the golf ball and an angle with respect to the direction in which the measuring terminal is facing at the time of the measurement based on the position in the image .
A step of specifying a terminal position which is a geographical position of the measuring terminal at the time of the measurement and a terminal orientation which is an orientation of the measuring terminal at the time of the measurement.
A step of specifying a ball position, which is a geographical position of the shot golf ball, based on the terminal position, the terminal orientation, the flight distance, and the angle.
A step of specifying the accuracy of at least one of the specified flight distance or the angle based on the number of the frame images for which the position in the image is specified.
A method for identifying a ball position, which comprises. Based on the measured value related to the golf ball acquired from the measuring terminal that measured the shot golf ball, the flight distance of the golf ball and the angle with respect to the direction in which the measuring terminal is facing at the time of the measurement are specified. Steps to do and
A step of specifying a terminal position which is a geographical position of the measuring terminal at the time of the measurement and a terminal orientation which is an orientation of the measuring terminal at the time of the measurement.
A step of specifying a ball position, which is a geographical position of the shot golf ball, based on the terminal position, the terminal orientation, the flight distance, and the angle.
Based on the ball position, a step of specifying the remaining distance in the hole where golf play is performed, and
Based on the flight distance and the remaining distance, a step to specify a count recommended for use in the next shot, and
A method for identifying a ball position, which comprises. Based on the measured value related to the golf ball acquired from the measuring terminal that measured the shot golf ball, the flight distance of the golf ball and the angle with respect to the direction in which the measuring terminal is facing at the time of the measurement are specified. Steps to do and
A step of specifying a terminal position which is a geographical position of the measuring terminal at the time of the measurement and a terminal orientation which is an orientation of the measuring terminal at the time of the measurement.
A ball position that is the geographical position of the shot golf ball for a plurality of golf balls shot by different players based on the terminal position, the terminal orientation, the flight distance, and the angle. Steps to identify and
A step of notifying information about the order of remaining distances for the plurality of players, which is generated based on the plurality of the ball positions.
A method for identifying a ball position, which comprises. A procedure for acquiring a shooting moving image of a player shooting a golf ball, which is shot by a shooting unit included in a measuring terminal that measures a shot golf ball.
A procedure for specifying a position in an image, which is a position of a golf ball reflected in the frame image, for at least one frame image included in the captured moving image.
A procedure for specifying the flight distance of the golf ball and the angle with respect to the direction in which the measuring terminal is facing at the time of the measurement based on the position in the image .
A procedure for specifying a terminal position that is a geographical position of the measuring terminal at the time of the measurement and a terminal orientation that is the direction in which the measuring terminal is facing at the time of the measurement.
A procedure for identifying a ball position, which is a geographical position of the shot golf ball, based on the terminal position, the terminal orientation, the flight distance, and the angle.
A procedure for specifying the accuracy of at least one of the specified distance or angle based on the number of the frame images for which the position in the image is specified.
A program characterized by having a computer execute. Based on the measured value related to the golf ball acquired from the measuring terminal that measured the shot golf ball, the flight distance of the golf ball and the angle with respect to the direction in which the measuring terminal is facing at the time of the measurement are specified. Procedure to do,
A procedure for specifying a terminal position that is a geographical position of the measuring terminal at the time of the measurement and a terminal orientation that is the direction in which the measuring terminal is facing at the time of the measurement.
A procedure for identifying a ball position, which is a geographical position of the shot golf ball, based on the terminal position, the terminal orientation, the flight distance, and the angle.
A procedure for determining the remaining distance in a hole where golf play is performed based on the ball position.
A procedure for identifying a number recommended for use in the next shot based on the flight distance and the remaining distance.
A program characterized by having a computer execute. Based on the measured value related to the golf ball acquired from the measuring terminal that measured the shot golf ball, the flight distance of the golf ball and the angle with respect to the direction in which the measuring terminal is facing at the time of the measurement are specified. Procedure to do,
A procedure for specifying a terminal position that is a geographical position of the measuring terminal at the time of the measurement and a terminal orientation that is the direction in which the measuring terminal is facing at the time of the measurement.
A ball position that is the geographical position of the shot golf ball for a plurality of golf balls shot by different players based on the terminal position, the terminal orientation, the flight distance, and the angle. Procedure to identify,
A procedure for notifying information about the order of remaining distances for a plurality of the players, which is generated based on the plurality of the ball positions.
A program characterized by having a computer execute.

Images