KR101982678B1 - Apparatus for putting analysis based on processing image and method - Google Patents

Abstract

A mat portion in which a hit golf ball is moved and a predetermined pattern is formed on at least one shooting region of an upper surface; A camera unit disposed in an upper space of the photographing area to acquire an image in the photographing area; A stand unit for fixing and mounting the camera unit; And an image analyzer for analyzing the motion of the golf ball and the golf club using the image.

Description

[0001] APPARATUS FOR PUTTING ANALYSIS BASED ON PROCESSING IMAGE AND METHOD [0002]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a putting analysis apparatus, and more particularly, to an image processing based putting analysis apparatus and method capable of practicing a putting method of putting a golf ball into a hole using a putter.

Golf is a movement in a grassy field, where a small, hard golf ball is hit by a golf club and put into a hole cup. Golf is already popular in Korea. However, not only is it costly to go out to the field every time golfers play golf, but also because it takes a lot of time, they usually use indoor screen golf courses.

Golf is also important to increase the distance of golf ball by tee shot or iron shot, but it is crucial to reduce the number of golf balls by putting a golf ball after putting green after the golf ball is green. You can use a field or a golf driving range to practice these putts, but it is more effective to practice putting mats in a home or office.

The putting mat usually has a mat attached to an upper portion of the main body having a predetermined length, and a hole cup may be formed on one side of the main body. Meanwhile, according to the development of the putting mat, a putting simulation device which allows the user to feel the reality as fitting in the green while watching the simulation image has appeared.

Conventionally, a golf putting simulation apparatus, which is commercially available at home and abroad, has adopted a method of measuring the trajectory and velocity of a putting stroke by attaching a separate device equipped with a sensor to a shaft such as a putter. However, this has the problem that the weight of the separate device is added to the golf club, which is different from the case of putting in the actual field, thereby deteriorating the effect of the practice.

Also, in the conventional method, since the face angle of the golf club can not be accurately known at the impact time when the golf ball is hit by the golf club, there is a limit in analyzing the movement trajectory and distance of the golf ball.

Korean Registered Patent No. 10-1645693 (Registered on July 29, 2016) Korean Registered Patent No. 10-1121952 (registered on February 23, 2012) Korean Registered Patent No. 10-1389052 (Registered on Apr. 18, 2014) United States Patent No. 07283647 (registered on October 16, 2007)

The embodiment of the present invention has been devised to solve the problems described above, and it is possible to enjoy putting at a level similar to that of a screen golf course while practicing putting easily at home or office using a smart terminal, And to provide a putting analysis device capable of analyzing his putting motion at the same time. At this time, in order to realize realistic physics, it is possible to measure the face angle of the golf club at the moment of impact where the golf ball is hit.

At this time, the distortion phenomenon according to the characteristics of the camera lens is easily corrected, and the reliability of the image photographing is further improved by adjusting the horizontal zero point of the camera part.

In addition, when a dedicated application and an upgrade version thereof are uploaded to an app store or the like, a user can easily download the application and the putting analysis device through a smart terminal or the like, thereby providing a putting analysis device that is easy to maintain and manage the putting analysis device.

The present invention also provides a putting analyzer capable of automatically recognizing the start and end points of each swing operation when a user takes a swing operation for putting, thereby replaying only the part of his putting operation at any time.

The present invention provides a putting analysis method that can analyze the putting motion similar to a screen golf course by using a smart terminal commonly owned by a person such as a smart phone and its dedicated application.

In order to solve the above-described problems, an embodiment of the present invention provides a golf club head comprising: a mat portion in which a hit golf ball is moved and a predetermined pattern is formed on at least one shooting region of an upper surface; A camera unit disposed in an upper space of the photographing area to acquire an image in the photographing area; A stand unit for fixing and mounting the camera unit; And an image analyzer for analyzing the motion of the golf ball and the golf club using the image.

The camera unit may further include a lens correcting unit correcting a distortion of the camera lens using the image of the pattern.

The camera unit is preferably a camera module included in the smart terminal.

Preferably, the image analysis unit is a dedicated application installed and executed in the smart terminal.

The image analysis unit may extract a contour of a golf ball and a golf club in an image frame, respectively.

The image analysis unit may measure the face angle of the golf club using the image frame at and around the impact moment when the golf ball is hit by the golf club.

The image analyzer may automatically recognize a swing start point and a swing end point of the golf club, respectively, by using the motion of the golf club.

Preferably, the pattern is a lattice pattern, and the lattice patterns are crossed with each other.

The stand unit may further include a horizontal adjustment unit for adjusting a horizontal angle of the camera unit.

A method for performing a putting analysis based on image processing, the method comprising: a first step of acquiring, through a camera unit, an image in an imaging region in which a predetermined pattern is formed on at least one part of a mat unit on which a hit golf ball is moved; A second step of extracting a contour of the golf ball and the contour of the golf club on a frame-by-frame basis, respectively; The moving speed and the moving direction of the golf ball are analyzed using the contour of the golf ball extracted from the image frame at the impact time and the pattern and the contour line of the golf ball extracted from the image frame of the golf ball And a third step of analyzing the face angle and the moving direction of the golf club.

The first step may further include adjusting a horizontal angle of the camera unit to zero before acquiring the image and correcting distortion of the camera lens in the camera unit using the pattern.

As described above, according to the present invention, various effects including the following can be expected. However, the present invention does not necessarily achieve the following effects.

According to one embodiment of the present invention, even if a separate dedicated device is not provided, the user can enjoy putting at a level similar to that of a screen golf course while practicing putting easily at home or office using a smart terminal, . In particular, according to one embodiment, the angle of the face of the instant impact golf club at which the golf ball is struck can be measured.

In addition, a distortion phenomenon depending on the characteristics of the camera lens can be easily corrected using a predetermined pattern formed on the mat portion. In addition, since the stand has a horizontal zero point adjustment function for the camera unit, the reliability of the image shooting can be further improved.

In addition, uploading a dedicated application and its upgraded version to the App Store makes it easy to maintain and manage the putting analysis device, since users can easily download it anywhere through a smart terminal.

In addition, the predetermined pattern formed on the mat portion can be limited to the photographing region, and a pattern that forms the pattern when the image photographing is started can be used to calculate the motion information of the golf ball and the golf club.

In addition, the putting analyzer can automatically recognize the start and end points of each swing operation, so that the user can repeatedly replay only the putting motion portion.

According to an embodiment of the present invention, a putting analysis method based on image processing can analyze motion information about a golf ball and a golf club by analyzing a predetermined pattern printed on a mat unit and an image of a shooting region including the predetermined pattern.

1 is a perspective view of an image processing based putting analysis apparatus according to an embodiment of the present invention;
2 is a schematic view showing a description of exercise information of a golf ball and a golf club;
Figs. 3A and 3B are plan views showing different embodiments of the mat portion. Fig.
Figure 4 is a side schematic view of the stand portion of Figure 1;
5 is a schematic view showing information displayed through a display unit;
6 is a flow chart of a method of image processing based putting analysis according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to the embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout. The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise.

In the present application, the terms "comprises" or "having" and the like are used to specify that there is a feature, a number, a step, an operation, an element, a component or a combination thereof described in the specification, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

Hereinafter, specific embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 is a perspective view of a putting analysis apparatus based on image processing according to an embodiment of the present invention, FIG. 2 is a schematic view showing a description of motion information of a golf ball and a golf club, FIG. 4 is a side schematic view of the stand part of FIG. 1, and FIG. 5 is a schematic view showing information displayed through the display part.

1 to 5, the image processing based putting analysis apparatus according to an embodiment includes a mat unit 10, a camera unit 20, a stand unit 30, an image analysis unit (not shown), and the like do.

The mat portion 10 has a structure that can be installed regardless of the place. The mat portion 10 is formed of a material such as rubber or fabric and is easy to store and carry. In addition, the mat portion 10 does not leave any folds or the like when it is unfolded, even if it is not used or folded due to its material. In addition, the mat portion 10 may be provided with a loading point where a golf ball is mounted on one side and a hole cup (not shown) on which the golf ball is held on the other side.

The mat portion 10 provides an upper surface on which the hit golf ball is moved. Artificial turf is usually used on the top but is not necessarily limited to this. In addition, a distance line (not shown) is formed on the upper surface at a predetermined distance from the hole cup, so that the distance between the hole cup and the golf ball can be measured. A slip prevention protrusion (not shown) may be further formed on the lower surface of the mat portion 10 to prevent the slip from being brought into close contact with the bottom surface of the installation site.

A predetermined pattern may be formed on the upper surface of the mat unit 10 according to one embodiment. The pattern may be a lattice pattern formed along the extending direction of the mat portion 10, for example. At this time, the grid pattern may have a shape in which different colors cross each other. The reason for different colors is to improve the easiness of identification in image processing. For example, these colors may be complementary to each other. Alternatively, the color may be two tones of the same family of green.

On the other hand, the above-described predetermined pattern may be formed to be limited to a portion other than the entire area of the upper surface. That is, the portion where the predetermined pattern is formed may be a part of the mat portion 10. At this time, the predetermined pattern may be formed in the photographing area 12 for the camera unit 20 to acquire an image for image processing. Therefore, at least one shooting region 12 is formed on the upper surface of the mat portion 10. A loading point at which the golf ball is loaded is formed at the center of the shooting area 12. [

The camera unit 20 is disposed in the upper space of the photographing area 12 to acquire an image in the photographing area 12. [ Such a camera unit 20 is not particularly limited as long as it is an apparatus capable of photographing a moving picture exclusively. Alternatively, the camera unit 20 may be a camera module included in a smart terminal such as a smart phone. The camera module may include a plurality of, for example, dual camera lenses having two lenses.

At this time, it is preferable that the camera unit 20 corrects a distortion phenomenon existing in the photographed image in advance according to the installation position of the camera unit 20. [ To this end, the camera unit 20 further includes a lens corrector (not shown). The lens correcting unit corrects the distortion of the camera lens using an image of a pattern printed on the mat unit 10. [ Specifically, the pattern may be a plurality of square shapes constituting the grid pattern. That is, each corner of a square and the color printed on the surface of the square can be used. On the other hand, the length of one side of the square is preferably about 4 cm.

In addition, the putting analysis apparatus may further include an auxiliary light source unit (not shown) depending on the degree of darkness around the image taking apparatus. The auxiliary light portion can be configured using, for example, a white high-brightness LED, and its brightness can be adjusted step by step. On the other hand, when the camera unit 20 is a smart terminal, the auxiliary light unit can use a flash formed in the smart terminal.

The stand part (30) fixes and mounts the camera part (20). At this time, it is preferable that the camera unit 20 is disposed in the upper space of the photographing area 12 so as not to obstruct the view of the user. Specifically, the stand portion 30 may include a base plate 32, an upper frame 34, a horizontal mounting portion 36, a horizontal adjustment portion (not shown), a height adjustment portion (not shown), and the like. The base plate 32 allows the stand 30 to be stably stood, and a weight or the like may be further included in the base plate 32. [ The upper frame 34 extends vertically above the base plate 32 and determines the overall height of the stand 30.

The horizontal mount part 36 mounts the camera part 20 so that the camera lens of the camera part 20 can face the photographing area 12. [ Specifically, the horizontal mounting portion 36 allows the camera lens to be located in a space just above the center of the photographing area 12. [ For example, in the case of a smart terminal, the camera unit 20 can be disposed such that the rear camera module faces the photographing area 12. [ To this end, the horizontal mounting portion 36 may further include a receiving space into which the smart terminal is slidably inserted.

At this time, the horizontal adjustment unit adjusts the horizontal angle of the camera unit 20 to be mounted. The adjustment of the horizontal angle may be performed by adjusting the inclination angle with respect to each axis through a built-up part (not shown) having at least two axes. For this purpose, a fine adjustment screw that rotates clockwise or counterclockwise with respect to each axis may be formed in the horizontal adjustment unit. On the other hand, a horizontal two-way gauge is attached to the horizontal adjustment unit so that the horizontal angle can be confirmed.

The height adjusting unit adjusts the vertical height of the camera unit 20, that is, the distance between the camera unit 20 and the photographing area 12. Specifically, the height adjusting unit can adjust the distance by moving the position of the horizontal adjusting unit in the vertical direction.

The image analysis unit analyzes the motion of the golf ball and the golf club using the image captured through the camera unit 20. The image analyzing unit analyzes the image received through the camera unit 20 on a frame basis. At this time, it is preferable that the camera unit 20 is capable of high-speed photographing at 500 frames per second (fps) or more in order to calculate a more accurate measurement value.

Specifically, the image analysis unit can extract the outline of the golf ball and the golf club in each image frame. Such a contour or outline extraction algorithm may be, for example, a method of using a change in brightness value of a shape by a differential operator, or a method of outputting only a specific image by using a specific function after calling an image.

Meanwhile, the image analysis unit may be implemented by a dedicated application installed and executed in the smart terminal. At this time, the dedicated application can be continuously upgraded through the app store, and the user can download the dedicated application through the app store. In other words, when a product developer uploads a dedicated application and its upgrade version to the App Store, the user can easily download it from anywhere through a smart terminal or the like, and it is easy to maintain and manage the putting analysis device.

Such image processing based putting analysis apparatus can obtain various useful information through the movement of the golf ball and the golf club. Examples of useful information include a face angle of the golf club, a swing speed of the golf club, a moving speed of the golf ball, a moving direction of the golf ball, and the like.

At this time, useful information can be displayed through the display unit 40 such as the smart terminal 70 of the user or other smart TV. At the same time, the smart terminal 70 such as a smart phone can provide a virtual putting environment such as virtual green through a dedicated application. That is, when the golf ball is loaded on the mat unit 10, the dedicated application can implement the same as it is and provide a simulation image in which the user seems to putting in the field. This can be confirmed through a smart TV or the like. For this, the image photographed by the camera unit 20 can be transmitted to the display unit 40 side such as a smart TV through a short-range wireless connection such as Bluetooth.

On the other hand, the calculation method for the above-described useful information is as follows. 1) The moving speed of the golf ball uses a predetermined pattern formed on the mat unit 10 and information obtained through the photographed image together. Specifically, the pattern has a grid pattern of squares of a predetermined size as described above. Then, the image analyzing unit can extract the contour of the golf ball in the image frame at a predetermined point in time. At this time, the image analysis unit can capture at least two frames at the moment when the contour of the golf ball touches the lattice line constituting the plaid pattern. Then, the moving speed of the golf ball can be calculated using the photographing time for each frame and the distance between the grid lines contacting the contour at that time.

2) The moving direction of the golf ball can be calculated as a specific numerical value through the photographed image. Specifically, the moving direction of the golf ball is calculated by an angle between an imaginary line extending in the forward straight line direction of the mat unit 10 at the loading point of the golf ball and the center of the contour line of the golf ball extracted from the photographing image at the specific point in time can do.

3) The swing speed of the golf club uses the image frame at and around the moment of impact when the golf ball is hit by the golf club. Specifically, the outline of the head of the golf club in the image frame can be extracted. For example, the swing speed can be calculated by extracting the outline of the head immediately before the impact and the outline of the head of the impact moment, respectively, and using the photographing time information for each frame at that time and the distance between the heads.

4) The face angle of the golf club uses the image frame at and around the moment of impact that is hit by the golf club. This is done in the image analysis department. Specifically, the image analysis unit extracts the contour of the head of the golf club in the corresponding frame at the moment of impact. Then, the image analysis unit extracts contours of the head of the golf club from the front and rear frames of the moment of impact, respectively. Then, it calculates the direction of movement of the golf club relative to the head. Then, the image analyzing unit can calculate the face angle by analyzing how much the face of the impact instantaneous head has changed in the moving direction.

Meanwhile, the image analysis unit can automatically recognize the swing start point and the swing end point of the golf club, respectively, using the movement of the golf club. Accordingly, only the image between the swing start point and the swing end point can be separately managed and stored, and replayed according to the user's request. Specifically, the image analysis unit detects an image of a head of a golf club located at a loading point of the golf ball, and when the head detects an image of a backswing backward, a trigger is operated, and the head is first detected at the loading point Automatically set the image frame of the moment as the swing start point.

Then, after the golf club hits the golf ball through the image captured through the camera unit 20, the head of the golf club reaches the forward full-height point and changes its direction to the rear, the video frame is designated as the swing end point The image analysis part automatically recognizes this.

As described above, the putting analyzer can perform a putting operation similar to a screen golf course while practicing a putting easily at home or office by using a smart terminal, even if a dedicated dedicated device is not provided. At the same time, have. Particularly, it is possible to measure the face angle of the golf club at the impact time when the golf ball is hit.

6 is a flowchart illustrating a method for analyzing a putting based on image processing according to an embodiment of the present invention. Referring to FIG. 6, an image processing based putting analysis method according to an embodiment of the present invention is a method of analyzing a putting method based on image processing, in which a predetermined part of at least one part of a mat unit 10, A second step S20 of extracting the contour of the golf ball and the golf club on a frame-by-frame basis from the acquired image, a first step S10 of acquiring an image in the photographing area 12 in which the pattern is formed through the camera unit 20, And analyzing the moving speed and the moving direction of the golf ball using the contour and the pattern of the golf ball extracted from the image frame after the impact moment and comparing the impact moment of the golf ball and the contour of the golf club extracted from the front and rear image frames And a third step (S30) of analyzing the face angle and the moving direction of the golf club using the golf club.

First, a preliminary step (S05) for adjusting the horizontal angle of the camera unit 20 to zero and correcting the distortion of the camera lens in the camera unit 20 using the above-described pattern is performed. At this time, the user places the camera section 20 above the photographing area 12 in the vertical direction, taking care not to disturb the user's view. That is, the user first installs the camera unit 20 in the upper space of the photographing area 12 by mounting or the like, adjusts the horizontal angle of the camera unit 20 at the installation position, To be opposed to the region (12).

Then, a process of correcting a distortion phenomenon attributable to the lens characteristics in the camera lens is performed. The correction for the distortion uses a pattern printed on the mat portion 10 in the form of a lattice pattern or the like. For example, in a square shape constituting a lattice pattern, at least which two edge sides coincide with a virtual line on the camera lens, or the like.

The image capturing through the camera unit 20 is limited to the specific image capturing area 12, and the moving direction of the golf ball, the moving speed, the swing direction of the golf club, and the face angle can be calculated through the image information. In this case, the camera unit 20 may be any camera as long as it can shoot images, but the camera unit 20 is preferably a camera module included in a smart terminal such as a smart phone.

Next, in the second step S20, a process of extracting the contours of the golf ball and the golf club is performed. The contour extraction is performed frame by frame for the acquired image.

Then, in a third step S30, image information is analyzed through an image analysis unit. Specifically, the analysis of the moving speed and the moving direction of the golf ball uses the contour of the golf ball extracted from the image frame after the impact moment when the golf ball is hit by the golf club and the above-described pattern, respectively. The analysis of the face angle and the direction of movement of the golf club uses the contour of the golf club extracted from the image frame of the impact and the image frames before and after the impact, in particular, the contour of the head of the golf club.

On the other hand, analysis of such image information is performed through a dedicated application when a smart terminal such as a smart phone is used. The putting analysis method may further include a fourth step (S40) of displaying the analysis result. Specifically, the analysis result transmitted from the image analysis unit can be output through the display unit 40 such as a smart TV.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the invention.

10: Mat unit 20: Camera unit
30: stand unit 40: display unit
12: photographing area 32: base plate
34: Upper frame 36: Horizontal mounting part

Claims (11)

A mat portion in which a hit golf ball is moved and a predetermined pattern is formed on at least one shooting region of an upper surface;
A camera unit disposed in a vertical upper space of the photographing area to acquire an image in the photographing area;
A stand unit for fixing and mounting the camera unit; And
And an image analyzer for analyzing the motion of the golf ball and the golf club using the image,
Wherein the camera unit further comprises a lens correcting unit for correcting distortion of the camera lens using the image of the pattern, wherein the moving speed of the golf ball is calculated using the pattern in the photographing area, A loading point at which the golf ball is loaded is formed at the center of the loading hole,
Wherein the image analyzing unit extracts the contours of the golf ball and the golf club in an image frame, automatically recognizes a swing start point and a swing end point of the golf club using the motion of the golf club, A putting analysis device based on image processing that can only replay images between end points.
delete The method according to claim 1,
Wherein the camera unit is a camera module included in a smart terminal.
The method according to claim 1,
Wherein the image analysis unit is a dedicated application installed and executed in a smart terminal.
delete The method according to claim 1,
Wherein the image analysis unit measures an angle of a face of a golf club using an image frame at and around an impact moment when a golf ball is hit by the golf club.
delete The method according to claim 1,
Wherein the pattern is a lattice pattern, wherein the lattice patterns intersect with each other in color.
The method according to claim 1,
Wherein the stand comprises a horizontal adjustment unit for adjusting a horizontal angle of the camera unit.
delete delete

Images