KR102107206B1 - Putting Lie Displaying Application Stored in Computer-readable Medium - Google Patents

Abstract

The present invention relates to a putting lie display application stored in a computer-readable recording medium to optimally manage position migration of a hole cup, a state change of a putting green, and the like. According to the present invention, the putting lie display application executes the following steps, in a computer: converting a 3D image received from a camera module into a 3D image; calculating the distance between a golf ball and the hole cup; calculating bend between a golf ball and the hole cup; comparing a horizontal line acquired through a level with the horizon acquired from the 2D image to calculate a horizontal inclination of a putting lie; extracting a slip speed of the golf ball corresponding to the humidity received from a humidity sensor of a smartphone from a lookup table storing relation between the humidity and the slip speed of the golf ball based on a proportional expression to calculate a putting line; and combining the distance, the bend, the horizontal inclination, and the putting line with the 3D image to display the 3D image on a screen of the smartphone.

Description

Putting Lie Displaying Application Stored in Computer-readable Medium

The present invention relates to a smart phone application, and more particularly, to a putting lie display application for displaying a putting lie.

In golf, putting should put the golf ball into the hole cup by accurately grasping the lie on the green or the inclination of the green and hitting the golf ball in an appropriate intensity and direction.

Because putting has a great influence on the score, it is an important factor in the golf game, and as a result, players analyze the lie between the golf ball and the hole cup by lying or lying on the green before putting on the green.

However, due to the nature of the green, it is not easy to analyze the lie with the eye because it is monochromatic (green), and since the slope is not formed in only one direction, and there are many slopes, that is, curves, from the position of the golf ball to the hole cup It is not easy to accurately analyze the slope.

Patent registration No. 1234911 (golf putting support device and method), patent registration No. 1577764 (mobile terminal providing the expected putting trajectory of golf green), patent registration No. 1853688 (how to provide putting information in green), etc. Suggests a technique to help putt accurately on the putting green.

Patent registration No. 1234911 discloses a technique for providing an accurate putt line on a putting green, including a tilt measurement unit, a 3D support information generation unit, and an image display unit. However, Patent Registration No. 1234911 takes a method of estimating the inclination of another point based on the measured inclination of several points, and thus has limitations in providing an accurate expected putting line. Patent registration No. 1577764 and patent registration No. 1853688 take the method of downloading the green three-dimensional shape information from a remote server, so there are limitations in reflecting the movement of the hole cup on the putting green and the state change of the green in the field. And the cost of building a server can also be a problem. In addition, when the position of the golf ball is specified using the GPS signal, there is a limit to accurately specifying the position of the golf ball due to the GPS error.

The present invention is to solve the problems of the prior art,

First, it can respond optimally to the movement of the hole cup and the change in the state of the putting green.

Second, it is intended to provide a putting lie display application that can accurately provide golf ball location, hole cup location, and putting lie information based on field data.

The putting lie display application stored in a computer-readable storage medium according to the present invention for achieving this purpose includes an image conversion step, a distance calculation step, a bending calculation step, a horizontal tilt calculation step, a putting line calculation step, a display step, etc. It can be run on a computer (smartphone).

The image conversion step may convert a 2D image received from a smartphone camera module into a 3D image.

The distance calculating step may calculate the distance between the golf ball and the hole cup.

The bending calculation step may calculate the bending between the golf ball and the hole cup.
In the horizontal tilt calculation step, the horizontal tilt of the putting lie may be calculated by comparing a horizontal line obtained through a level aligner with a horizontal line obtained from a 2D image.
The putting line calculation step may calculate the putting line by extracting the golf ball sliding speed corresponding to the humidity received from the humidity sensor of the smartphone based on the proportionality from the lookup table matching and storing the humidity and golf ball sliding speed.

In the display step, a distance between a golf ball and a hole cup, a bend, a horizontal tilt, and a putting line can be combined on a 3D image and displayed on a smartphone screen.

delete

In the putting lie display application of the present invention, the step of calculating a distance includes storing an object model corresponding to an object including a golf ball and a hole cup in an object model database, searching the object model database, and golf balls included in a 2D or 3D image. The method may include detecting a hole cup, and calculating a distance between a golf ball and a hole cup in a 2D or 3D image based on pixel spacing using image geometry.

delete

delete

delete

In the putting lie display application of the present invention, the distance calculation step may calculate the distance between the golf ball and the hole cup using the acceleration sensor measurement value received from the acceleration sensor of the smartphone while the smartphone moves between the golf ball and the hole cup. .

In the putting lie display application of the present invention, the bending calculation step uses the gyro sensor measurement value and the acceleration sensor measurement value received from the gyro sensor and the acceleration sensor of the smartphone while the smartphone moves between the golf ball and the hole cup. You can calculate the bend between.

In the putting lie display application of the present invention, the bending calculation step is Z, which is received from the geomagnetic sensor of the smartphone while the roll and pitch information derived from the gyro sensor measurement value and the acceleration sensor measurement value and the smartphone move between the golf ball and the hole cup. Axial measurements can be used to remove shake noise.

In the putting lie display application of the present invention, the bending calculation step may sample the gyro sensor measurement value and the acceleration sensor measurement value at regular intervals.

delete

According to the putting lie display application of the present invention having such a configuration, it is possible to quickly and optimally respond to the position movement of the hole cup, the changing state of the putting lie by generating a 3D image based on the actual 2D image of the putting lie.

According to the putting lie display application of the present invention, by specifying the location of the golf ball and the hole cup from the image actually taken through the camera module, furthermore, by walking the distance from the golf ball location to the hole cup by holding the smartphone and actually measuring and displaying the distance , It is possible to accurately display the distance between the golf ball and the hole cup, the bending state, and the like.

1 is a configuration diagram for running the putting lie display application according to the present invention on a smartphone.
2 illustrates a process of displaying a putting lie in a putting lie display application according to the present invention.
3 illustrates a process of calculating a distance between a golf ball and a hole cup in the putting lie display application according to the present invention.
4 shows a process of calculating the bending between the golf ball and the hole cup in the putting lie display application according to the present invention.
5 shows a part of a process for calculating an optimal putting line in the putting lie display application according to the present invention.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a configuration diagram for running the putting lie display application according to the present invention on a smartphone.

As shown in FIG. 1, the putting lie display application 100 according to the present invention, when divided into execution units, includes an image conversion unit 110, a distance calculation unit 120, a bending calculation unit 130, and a horizontal tilt It may include a calculator 140, a putting line calculator 150, a putting controller 160, and the like.

The image converter 110 may convert a 2D image received from the camera module 210 of the smartphone into a 3D image. The image converter 110 may use image processing techniques that are generally used in the field of image processing. For example, the image converter 110 generates a left image and a right image with different parallax information from the 2D plane image, and provides depth information to objects displayed on the 2D plane image to generate depth. A 2D plane image may be converted into a 3D stereoscopic image, including a step of generating a depth map and a step of generating a left image and a right image based on a depth map. As a method of generating a depth map, a pixel value of a 2D image may be calculated, a motion vector may be generated to automatically generate a depth map, or a user may directly input a depth information of a 2D object.

The distance calculator 120 may calculate a distance between the golf ball and the hole cup. The distance calculator 120 may calculate a distance between a golf ball and a hole cup from a 2D image received from the camera module 210 or a 3D image converted by the image converter 110 based on pixel spacing. The distance calculator 120 may calculate the distance between the golf ball and the hole cup using the acceleration sensor measurement value received from the acceleration sensor 230. The distance calculation using the acceleration sensor measurement value can be used alone or as an augmentation of the distance calculation using the image.

The bend calculator 130 may calculate the bend of the putting green between the golf ball position and the hole cup. The bending of the putting green may include slopes in all directions including front and rear, left and right, and the like. The flexure calculator 130 receives the smartphone from the gyro sensor 220 and the acceleration sensor 230 of the smartphone while the player moves from the golf ball position to the hole cup position while holding the smartphone and measures the acceleration sensor measurement value. Can be received in real time. The bend calculation unit 130 continuously calculates the bending between the golf ball position and the hole cup from the gyro sensor measurement value, that is, the X, Y, Z axis change amount and the acceleration sensor measurement value, X, Y, Z axis change amount, to continuously incline information Phosphorus bending information can be calculated. The bending calculation unit 130 converts the X, Y, and Z axis changes of the gyro sensor and the X, Y, and Z axis changes of the acceleration sensor into Roll, Pitch, and Yaw values to remove the shaking (translational motion) noise caused by walking movement. Can be used to

The bend calculator 130 may receive the geomagnetic sensor measurement value in real time from the geomagnetic sensor 240 of the smartphone while the smartphone moves from the golf ball position to the hole cup position. The bend calculating unit 130 may use the geomagnetic sensor measurement value, that is, the reference information for filtering the shaking noise of the Z-axis change amount, that is, a comparison value of the Z-axis change amount between the acceleration sensor measurement value and the gyro sensor measurement value.

The bend calculation unit 130 continuously samples the gyro sensor measurement value, the acceleration sensor measurement value, and the geomagnetic sensor measurement value at predetermined time intervals, for example, 2 seconds, 3 seconds, and 5 seconds, and continuously sampled measurement values. From this it is possible to calculate the bending between the hole cups at the putting green, especially the golf ball position.

The horizontal tilt calculator 140 may calculate a horizontal tilt of the putting green. The horizontal tilt calculator 140 may calculate a horizontal tilt of the putting green by comparing a horizontal line obtained through a level aligner with a horizontal line obtained from a 2D image.

The putting line calculator 150 may include a look-up table that matches and stores temperature, humidity, golf ball sliding speed, and swing size. The putting line calculator 150 may extract the temperature received from the temperature sensor 250 and the humidity sensor 260, the golf ball sliding speed corresponding to the humidity, and the swing size based on a proportional expression from the lookup table. The putting line calculator 150 may receive distances, bends, and horizontal tilts from the distance calculator 120, the bend calculator 130, and the horizontal tilt calculator 140. The putting line calculator 150 may calculate an optimal putting line from the golf ball position to the hole cup based on distance, bending, horizontal tilt, temperature, humidity, sliding speed, swing size, and the like.

The putting line calculator 150 may match the golf ball position and the hole cup position to the 3D image, and after performing simulation using a method of known putting trajectory physical property simulation, an optimal putting line between the golf ball position and the hole cup can be generated. have. The simulation of putting trajectory properties is generally simulated using the principle of force, such as the force applied when hitting the golf ball, the static friction force between the golf ball and the green, the frictional motion generated by the golf ball rolling, and the gravity generated by bending. In consideration, the position (latitude, longitude, altitude) of the ball against the time axis can be calculated through a numerical analysis method. The putting line calculator 150 may provide the optimum putting line together with temperature, humidity, golf ball sliding speed, swing size, etc., as the putting line may vary depending on the putting hitting strength, that is, the swing size.

The putting control unit 160 combines the distance received from the distance calculating unit 120, the bending received from the bending calculating unit 130, the putting line information received from the putting line calculating unit 150, and the like into a 3D image of the smartphone. It can be displayed on the screen 270. The putting control unit 160 may display a plurality of bends indicating a bend, for example, a triangle having a direction, etc., separated by a predetermined distance, for example, in units of pixels, between a golf ball and a hole cup. When displaying the putting line, the putting control unit 160 may display temperature, humidity, sliding speed, swing size, and the like together on the smartphone screen 270.

2 illustrates a process of displaying a putting lie in a putting lie display application according to the present invention.

As shown in FIG. 2, the process of displaying the putting lie on the smartphone screen 270 is first image conversion (S11), horizontal tilt calculation (S12), distance calculation (S13), bending calculation (S14), putting line The calculation (S15) or the like may be performed individually or sequentially to calculate a 3D image of the putting lie, the horizontal tilt of the putting lie, the distance and curvature between the golf ball and the hole cup, and the putting line, respectively.

In step S16, the putting control unit 160 may combine the horizontal tilt, distance, bending, and putting line calculated in steps S12 to S15 with the 3D image calculated in step S11.

Thereafter, in step S17, the putting controller 160 may display the combination of step S16 on the smartphone screen 270.

3 illustrates a process of calculating a distance between a golf ball and a hole cup in the putting lie display application according to the present invention.

As shown in FIG. 3, in the putting lie display application 100 according to the present invention, the distance calculator 120 calculates a distance based on a 2D image, but measures an acceleration sensor to calculate an accurate distance between a golf ball and a hole cup Additional values are available.

First, in step S21, the distance calculator 120 may receive a 2D image of the putting green from the camera module 210. The 2D image may include a putting lie, a golf ball, a hole cup, and the like.

In step S22, the distance calculator 120 may detect a golf ball and a hole cup in a 2D image. The distance calculating unit 120 may include an object model database, an object detection unit, and the like.

The object model database may store object models for golf balls, hole cups, and the like.

The object detection unit may detect a golf ball and a hole cup in a 2D image. The object detection unit searches the object model database and checks whether there is an object model that matches objects such as golf balls and hole cups included in the 2D image. Can be recognized as Through this object detection process, the distance calculator 120 can actively respond to a shape change or a position movement of a golf ball or a hole cup.

In step S23, the distance calculator 120 may calculate a distance between the golf ball and the hole cup. The distance calculating unit 120 may include a distance conversion unit, and the distance conversion unit may calculate a distance between a golf ball object and a hole cup object in a 2D image based on pixel spacing using image geometry.

In step S24, the distance calculating unit 120 calculates the distance between the golf ball position and the hole cup again using the acceleration sensor measurement value received from the acceleration sensor 230 while the player moves from the golf ball position to the hole cup. can do.

Then, in step S25, if the distance measured using the 2D image in step S23 is different from the distance using the acceleration sensor measurement in step S24, the distance calculated in step S24 is the golf ball position And the hole cup.

In the present invention, steps S24 and S25 may be performed as auxiliary steps of steps S21 to S23, or may be configured as independent processes by replacing steps S21 to S23 as necessary.

As described above, the putting lie display application 100 of the present invention can provide an accurate putting lie, putting line, swing size, and the like by measuring and providing an accurate distance using the acceleration sensor 230.

4 shows a process of calculating the bending between the golf ball and the hole cup in the putting lie display application according to the present invention.

As shown in Figure 4, in step (S31), the bending calculator 130, the player while holding the smartphone while moving from the golf ball position to the hole cup position, the gyro sensor 220 of the smartphone, the acceleration sensor (230), the measurement value of the geomagnetic sensor 240 may be received in real time. In step S31, the flexure calculating unit 130 may sample the gyro sensor measurement value, the acceleration sensor measurement value, and the geomagnetic sensor measurement value at regular intervals such as 2 seconds, 3 seconds, and 5 seconds.

In step S32, the bending calculation unit 130 may correct the gyro sensor measurement value, the acceleration sensor measurement value, or remove the shake noise by using the geomagnetic sensor measurement value, that is, the Z-axis change amount.

In step S33, the bend calculating unit 130 may calculate the curvature of the putting lie, that is, the surface inclination, using the gyro sensor measurement value and the acceleration sensor measurement value from which noise is removed.

As described above, the present invention calculates and provides the surface slope of the putting lie based on the value actually measured while the player moves from the golf ball position to the hole cup position while holding the smartphone, so that the smartphone has almost the same surface slope as the actual putting lie. It can be provided to the player through the screen 270.

5 shows a part of a process for calculating an optimal putting line in the putting lie display application according to the present invention.

As shown in FIG. 5, first, in step S41, the putting line calculator 150 may receive the temperature and humidity of air from the temperature sensor 250 and the humidity sensor 260.

In step S42, the putting line calculator 150 searches for a look-up table matching and storing temperature, humidity, sliding speed, swing size, and the like, and extracts sliding speed, swing size, etc. matching the current temperature and humidity. You can.

In step S43, the putting line calculator 150 receives the sliding speed, swing size, and the like calculated in step S42 from the distance calculator 120, the bend calculator 130, and the horizontal tilt calculator 140. Based on the distance from the golf ball to the hole cup, the bending, and the horizontal tilt, the optimal putting line can be calculated by using a predetermined putting trajectory property simulation method.

In step S43, the putting line calculator 150 may not provide the optimum putting line, but may provide only putting lie information such as distance, bend, horizontal tilt, and sliding speed.

In the above, the present invention has been described as an example, but this is for illustrating the present invention. Those skilled in the art will be able to modify or modify these embodiments in other forms. However, since the scope of the present invention is defined by the claims below, it can be interpreted that such modifications or modifications are included in the scope of the present invention.

100: putting lie display application 110: image conversion unit
120: distance calculation unit 130: bending calculation unit
140: horizontal tilt calculator 150: putting line calculator
160: putting control unit 210: camera module
220: gyro sensor 230: acceleration sensor
240: geomagnetic sensor 250: temperature sensor
260: humidity sensor 270: smartphone screen

Claims (8)

Converting the 2D image received from the camera module of the smartphone into a 3D image;
Calculating a distance between the golf ball and the hole cup;
Calculating a curve between the golf ball and the hole cup;
Calculating a horizontal tilt of the putting lie by comparing a horizontal line obtained through a horizontal ruler with a horizontal line obtained from the 2D image;
Calculating a putting line by extracting a golf ball sliding speed corresponding to the humidity received from the humidity sensor of the smartphone based on a proportional expression from a lookup table storing a relationship between the humidity and the golf ball sliding speed; And
A putting lie display application stored in a computer-readable storage medium that causes the computer to perform the step of combining the distance, bending, horizontal tilt, and putting line on the 3D image and displaying it on a smartphone screen. delete The method of claim 1, wherein the step of calculating the distance
Storing an object model corresponding to the object including the golf ball and the hole cup in the object model database;
Searching the object model database to detect golf balls and hole cups in the 2D or 3D images; And
And calculating a distance between a golf ball and a hole cup in the 2D or 3D image based on pixel spacing, a putting lie display application stored in a computer-readable storage medium. The method of claim 1 or 3, wherein the step of calculating the distance
Putting lie display application stored in a computer-readable storage medium to calculate the distance using the acceleration sensor measurement value received from the acceleration sensor of the smartphone while the smartphone moves between the golf ball and the hole cup. The method of claim 1, wherein the bending calculation step
While putting the smartphone between the golf ball and the hole cup, using the gyro sensor measurement value and the acceleration sensor measurement value received from the gyro sensor and the acceleration sensor of the smartphone, the curve is calculated, and the putting stored in a computer-readable storage medium Rai display application. The method of claim 5, wherein the bending calculation step
The roll, pitch information derived from the measured values of the gyro sensor and the acceleration sensor and the Z-axis measurement received from the geomagnetic sensor of the smartphone for noise removal while the smartphone moves between the golf ball and the hole cup, are read by a computer Putting lie display application stored in the storage medium. The method of claim 5, wherein the bending calculation step
A putting lie display application stored in a computer-readable storage medium that samples the gyro sensor measurements and acceleration sensor measurements at regular intervals.
delete

Images