KR20240076520A - Method for detecting strikes and acquiring golf club movement image in high performance camera for screen golf and system performing the same - Google Patents

Abstract

A method for detecting hits and acquiring golf club movement images using a high-performance camera for screen golf and a system for performing the same are provided. The method includes generating a first resolution image and a second resolution image by having a camera capture the hitting area in the hitting preparation step, first searching the first resolution image, and creating a ball ROI (Region of) around the golf ball. Extracting a region of interest, applying the ball ROI region to the image of the second resolution, and detecting a golf ball by performing a second search within the ball ROI region of the image of the second resolution. .

Description

Method for detecting hits and acquiring golf club movement images from a high-performance camera for screen golf and a system for performing the same {METHOD FOR DETECTING STRIKES AND ACQUIRING GOLF CLUB MOVEMENT IMAGE IN HIGH PERFORMANCE CAMERA FOR SCREEN GOLF AND SYSTEM PERFORMING THE SAME}

The present invention relates to a method for detecting a hit and acquiring a golf club movement image by a high-performance camera for screen golf, and a system for performing the same. More specifically, the present invention relates to a hitting detection method and a system for performing the same. More specifically, the present invention relates to a hitting detection method and a system for performing the same by detecting a golf ball and hitting point in a captured image of a stationary golf ball. The present invention relates to a method for detecting hits from a high-performance screen golf camera with improved processing speed capable of acquiring images of movement of a golf club before and after the viewpoint, a method for acquiring images of movement of a golf club, and a system for performing the same.

Golf, a representative outdoor sport, has recently become popular in the form of screen golf that can be enjoyed indoors due to the development of IT technology, and the number of people taking up golf through this is increasing. Screen golf courses help users improve their golf skills by filming and analyzing club movement videos and ball hitting videos before and after hitting.

Screen golf courses use several previously introduced methods to distinguish when to hit. For example, when the movement of an object is detected by a trigger camera through line scan, the images captured by at least two hitting position cameras and received by the master computer are processed to determine whether the triggered object is a golf ball or another object. There is a way to tell them apart.

Alternatively, there is a method of performing image processing by receiving all frame images taken with a camera without a separate trigger camera. However, if the image to be processed has a high resolution or frame rate, the amount of data increases, so the image is received from a computer and processed. Problems may arise where processing time increases.

On the other hand, there is also a launch monitor method that obtains video by placing a small-sized monitoring device in front of the batter's box. However, although it is possible to detect a hit, it has the problem of not being able to film the movement of the golf club.

Therefore, there is a need for the development of a system that can capture the entire video of club movement for hitting analysis while ensuring fast processing speed.

The technical problem to be solved by the present invention is to provide a method and system that can detect a hit from a hit image obtained through a high-speed image sensor and simultaneously process the storage of the swing image using a club.

The technical problems of the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art from the description below.

In order to solve the above technical problem, a method of detecting a hit and acquiring a moving image of a golf club by a high-performance camera for screen golf according to some embodiments of the present invention includes an image of the first resolution and Generating a resolution 2 image; extracting a ball ROI (Region of Interest) area around the golf ball by first searching the image of the first resolution; applying the ball ROI area to the image of the second resolution; and detecting a golf ball by performing a second search within the ball ROI area of the image of the second resolution.

In some embodiments of the present invention, when the golf ball detected in the image of the second resolution through the second search does not move for a predetermined time, it is determined to be ready to hit and the image of the golf ball is determined as the reference frame. Additional steps may be included.

In some embodiments of the present invention, calculating the difference between the reference frame and the captured image and detecting that the golf ball has been hit when it is detected that it has moved a certain distance as a result of comparing the difference image and the reference frame is further added. It can be included.

In some embodiments of the present invention, extracting hitting images of a predetermined m number of frames before the hitting point of the golf ball and n frames after the hitting point of the golf ball; And it may further include transmitting the extracted m+n frames to a PC to analyze the hitting data.

In some embodiments of the present invention, the first resolution image may have the same timestamp as the second resolution image and may be a scaled image.

A system for detecting a hit and acquiring an image of a golf club movement image of a high-performance camera for screen golf according to some other embodiments of the present invention for solving the above technical problem includes an interface unit that receives an image of the hitting area captured from at least one camera; A memory that stores a first resolution image and a second resolution image of the hitting area in the hitting preparation stage; and an image processing unit that performs a first search on the image of the first resolution to extract a ball ROI area around the golf ball, and applies the ball ROI area to the image of the second resolution to detect the golf ball through a second search. Includes.

In some embodiments of the present invention, the image processing unit determines that the golf ball detected in the image of the second resolution through the second search is ready to hit if it does not move for a predetermined time, and determines that the golf ball is ready to hit. can be determined as the reference frame.

In some embodiments of the present invention, the image processing unit calculates the difference between the reference frame and the captured image, and determines that the golf ball has been hit when it is detected that it has moved a certain distance as a result of comparing the difference image and the reference frame. It can be sensed.

In some embodiments of the present invention, hitting images of predetermined m frames before the hitting point of the golf ball and n frames after the hitting point are extracted, and a three-dimensional space of the golf ball is extracted from the extracted hitting images. Coordinates can be calculated.

Specific details of other embodiments are included in the detailed description and drawings.

In the hit detection and golf club movement image acquisition system of a high-performance camera for screen golf according to an embodiment of the present invention, the position of the golf ball is first searched using a relatively small first resolution image to determine the ball ROI (Region of After extracting the area of interest, the extracted ball ROI is applied to the image of the second resolution to detect the position of the golf ball within the limited ball ROI area, thereby reducing the computational work required to detect the golf ball in the image and shortening the processing time. Overflow phenomenon that may occur in golf ball recognition can be reduced.

The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description of the claims.

1 is a diagram illustrating a system for detecting a hit and acquiring a golf club movement image by a high-performance camera for screen golf according to some embodiments of the present invention.
Figure 2 is a flowchart illustrating a method of detecting a hit and acquiring a golf club movement image by a high-performance camera for screen golf according to some embodiments of the present invention.
Figure 3 is

The advantages and features of the present invention and methods for achieving them will become clear by referring to the embodiments described in detail below along with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below and will be implemented in various different forms. The present embodiments only serve to ensure that the disclosure of the present invention is complete and that common knowledge in the technical field to which the present invention pertains is not limited. It is provided to fully inform those who have the scope of the invention, and the present invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout the specification.

One component is said to be “connected to” or “coupled to” another component when it is directly connected or coupled to another component or with an intervening other component. Includes all cases. On the other hand, when one component is referred to as “directly connected to” or “directly coupled to” another component, it indicates that there is no intervening other component. “And/or” includes each and every combination of one or more of the mentioned items.

The terminology used herein is for describing embodiments and is not intended to limit the invention. As used herein, singular forms also include plural forms, unless specifically stated otherwise in the context. As used herein, “comprises” and/or “comprising” refers to the presence of one or more other components, steps, operations and/or elements. or does not rule out addition.

Although first, second, etc. are used to describe various components, these components are of course not limited by these terms. These terms are merely used to distinguish one component from another. Therefore, of course, the first component mentioned below may also be the second component within the technical spirit of the present invention.

Unless otherwise defined, all terms (including technical and scientific terms) used in this specification may be used with meanings that can be commonly understood by those skilled in the art to which the present invention pertains. Additionally, terms defined in commonly used dictionaries are not interpreted ideally or excessively unless clearly specifically defined.

The term 'unit' or 'module' used in this embodiment refers to software or hardware components such as FPGA or ASIC, and the 'unit' or 'module' performs certain roles. However, 'part' or 'module' is not limited to software or hardware. A 'unit' or 'module' may be configured to reside on an addressable storage medium and may be configured to run on one or more processors. Thus, as an example, a 'part' or 'module' refers to software components, object-oriented software components, functions, subroutines, segments of program code, microcode, circuits, data, databases, and data structures. , tables, arrays, and variables. The functionality provided within components and 'parts' or 'modules' can be combined into smaller numbers of components and 'parts' or 'modules' or into additional components and 'parts' or 'modules'. Could be further separated.

1 is a diagram illustrating a system for detecting a hit and acquiring a golf club movement image by a high-performance camera for screen golf according to some embodiments of the present invention.

Referring to Figure 1, the hitting detection and golf club movement image acquisition system 100 of a high-performance camera for screen golf according to some embodiments of the present invention includes an interface unit 110 that receives an image of the hitting area from the camera 10. ), a memory 120 that stores the first resolution image 111 and the second resolution image 112 of the hitting area, and an image that detects a golf ball through processing of the first and second resolution images 111 and 112 It may include a processing unit 130.

The hit detection and golf club movement image acquisition system 100 of the high-performance camera for screen golf of the present invention includes hardware that accelerates and performs the image processing necessary for detecting hits and acquiring golf club movement images from images captured by a camera, for example. It may be a device that has a computational speed superior to that of a typical CPU (Central Processing Unit) or GPU (Graphic Processing Unit). For example, the system 100 may include a semiconductor device, at least a portion of which is composed of a special-purpose logic circuit such as a Field Programmable Gate Array (FPGA) or an Application Specific Integrated Circuit (ASIC), but the present invention is not limited thereto. .

The system 100 may process images generated by at least one camera 10 capturing a striking area. The camera 10 may be installed around the user's striking position and set to film the striking preparation stage and the striking stage. Image data captured by the camera 10 may be provided to the system 100 through the interface unit 110.

The interface unit 110 may be connected to the camera 10 by wired or wireless data communication means. For example, the camera 10 may be connected to the interface unit 110 through an interface such as Camera Link, but the present invention This is not limited to this, and any communication interface such as USB or PCIe that can transmit images captured by the camera 10 generated at high speed to the system 100 at high speed is sufficient.

The captured image of the hitting area received by the interface unit 110 may be temporarily stored in the memory 120, and the captured image stored in the memory 120 includes an image 111 of the first resolution and an image of the second resolution. It may include (112). In an embodiment of the present invention, the first resolution and the second resolution may be different from each other, and more specifically, the second resolution may be higher than the first resolution. For example, the image of the first resolution, which is resized and transcoded by resizing the captured image of the second resolution to 2:1 horizontally and 2:1 vertically, has 1/4 the number of pixels than the second resolution, so there is golf in the video. The time required for ball recognition and hit detection may be reduced.

That is, the system 100 according to an embodiment of the present invention simultaneously stores a high-resolution second resolution image 112 and a first resolution image 111 lower than the second resolution in the memory 120. If the image processing speed is slowed when searching for a golf ball through image processing of the high-resolution second resolution image 112, overflow may occur when saving the image, making it difficult to save a normal image. In particular, in the case of high-performance cameras for screen golf, images captured at a higher speed than the typical 30fps shooting speed are often obtained in order to detect the movement of golf balls and clubs moving at high speed. In other words, a large number of images (120, 240 or more per second) are acquired as captured images, and if these are not processed quickly, the risk of overflow as described above exists.

Therefore, in the system 100 of the present invention, the position of the golf ball is first searched using a relatively small image of the first resolution, the ball ROI (Region of Interest) area is extracted, and then the extracted ball ROI is used in the second By applying it to high-resolution images and detecting the position of the golf ball within a limited ball ROI area, the computational work required to detect the golf ball in the image can be reduced and the processing time can be shortened.

The image of the first resolution may be, for example, an image reduced from the image of the second resolution to the same ratio horizontally and vertically, but may be reduced horizontally and vertically, such as 1/4 of the number of horizontal pixels and 1/2 of the number of vertical pixels of the second resolution. It may also include cases where is reduced to an unequal ratio. Images at the first resolution may also be scaled down to an aspect ratio that is not an integer multiple.

The first resolution image and the second resolution image may each be images provided from the camera 10, but the system 100 may receive only the second resolution image and transcode it to generate the first resolution image.

The image processing unit 130 can detect the golf ball using the captured image stored in the memory 120. The image processing unit 130 performs a first search on the image of the first resolution to extract a ROI (Reason of Interest) area to view, and then performs a second search by applying the extracted ROI area to the image of the second resolution. can do. The first search, second search, and hit detection by the image processing unit 130 will be described using FIG. 2.

Figure 2 is a flowchart illustrating a method of detecting a hit and acquiring a golf club movement image by a high-performance camera for screen golf according to some embodiments of the present invention.

First, the image processing unit 130 receives an image of the first resolution stored in the memory 120 (S105). The image processing unit 130 searches for whether a reference frame exists in the memory 120 prior to analyzing the image at the first resolution (S110). The reference frame is an image created by assuming that the golf ball is placed at the hitting position during the preparation stage and that the golf ball stops after a certain period of time. For example, even after placing the golf ball, if a shiny golf club passes by blocking the golf ball during practice swings, if there is an object around the plate that creates a reflective shape similar to the golf ball, or if there is an object next to the golf ball when putting. Various misrecognition situations may occur, such as when a putter placed and ready to hit is recognized as a golf ball. Accordingly, the image processing unit 130 can prevent misrecognition of the golf ball due to a golf club or other interfering elements by using a captured image when the golf ball is recognized and stopped for a certain period of time or more as a reference frame in the hitting preparation stage.

If a reference frame exists, the image processing unit 130 may calculate a difference image between the reference frame and the current first resolution image (S111). That is, the image processing unit 130 may search whether there is a change from the reference frame in the first resolution image to detect a golf ball hit. If a reference frame does not exist, search is performed based on the current first resolution image.

A first search is performed using the current first resolution image or the difference image with the reference frame (S115). The image processing unit 130 performs filtering on the image of the first resolution to extract an ROI area to view. The ball ROI area corresponds to an area where the golf ball is likely to be located, that is, an area representing the approximate location of the golf ball in the captured image, and may include a certain area around the golf ball in the captured image.

As described above, the image of the first resolution has a lower number of pixels than the image of the second resolution, and the ball ROI area obtained through filtering corresponds to the approximate location of the golf ball rather than the exact location of the golf ball, so the task of extracting the ball ROI area is quite considerable. It can be performed at high speed. If the ball ROI area is detected through the first search, the image processing unit 130 proceeds with a second search process in the second resolution image using the corresponding area. If the golf ball is not searched, the first search of the next frame is performed. You can return to the process of receiving high-resolution video (S105).

Next, the image processing unit 130 may apply the ROI area to be viewed to the image of the second resolution (S125). Since the image of the first resolution and the image of the second resolution have the same timestamp and are images with different resolutions, if the coordinates of the ball ROI area extracted from the first resolution are applied to the second resolution area as is according to the magnification ratio, the second resolution You can search for the approximate location of the golf ball in the video. In this way, if the location to be searched is limited by applying the ball ROI area in the second resolution image, the search speed can be significantly improved compared to the case of searching for a golf ball through filtering on the entire high-resolution image of the second resolution. there is.

The image processing unit 130 can extract the exact location of the golf ball by performing a second search through filtering on the ball ROI area in the second resolution image (S130). The image processing unit 130 may obtain parameters such as the coordinates and radius of the center position of the golf ball extracted from the ball ROI area.

After the image processing unit 130 extracts the position of the golf ball from the captured image, it must detect the hit of the golf ball through the state of the golf ball in the image. First, the image processing unit 130 determines whether the golf ball is ready for hitting (S135). For example, the image processing unit 130 determines whether the golf ball is ready for hitting by using whether the reference frame is stored in the memory 120. Awareness can be determined. As described above, when an image of the same first resolution or an image of the second resolution is input for a predetermined time, the image processing unit 130 determines that the golf ball is stopped (S136) and uses the captured image as a reference frame (S137) ) You can set the strike preparation state while playing.

If the reference frame is already stored in the memory 120, the judgment process of step S135 is omitted and a hit detection process (S140 to S150) using the difference between the reference frame and the captured image is performed. The image processing unit 130 may determine that the golf ball has been hit when the golf ball moves more than a certain pixel from the center coordinates of the reference frame (S145), and when the hit is detected, it is determined whether the golf ball is in the target area. (S150). The target area is an area set to obtain the movement of the hit golf ball. If there is no golf ball in the target area, the hit can be determined by movement in the preparation area. Examples of preparation areas and target areas for golf ball strike recognition are shown in Figures 3 and 4, respectively.

In summary, the system 100 for detecting hits and acquiring images of golf club movements by a high-performance camera for screen golf according to an embodiment of the present invention first searches for the position of the golf ball using a relatively small image of first resolution. After extracting the ball ROI area, the extracted ball ROI is applied to the image of the second resolution to detect the position of the golf ball within the limited ball ROI area, thereby reducing the computational work required to detect the golf ball in the image and shortening the processing time. By doing so, the overflow phenomenon that may occur in golf ball recognition can be reduced.

Meanwhile, when a golf ball hit is detected, a process of processing the hit data using images before and after the hit may be performed. This will be explained using Figure 5.

Figure 5 is a flow chart for explaining a method of detecting a hit and acquiring a golf club movement image by a high-performance camera for screen golf according to an embodiment of the present invention.

Referring to FIG. 5, the method of detecting a hit and acquiring a moving image of a golf club by a high-performance camera for screen golf according to an embodiment of the present invention includes receiving N frames of captured images after detecting a hit (S205), N frames obtained A step of searching for a golf ball for each frame (S210 to S225), and a step of processing the hitting data by transmitting M frames before hitting and N frames after hitting to a PC when receiving N frames of captured video (S230). It can be included.

In the process of processing the hitting data, the step of reading one frame (S215) and searching for a golf ball can be done by using the method of recognizing a golf ball using the image of the first resolution and the image of the second resolution described above. there is. That is, in step S205, the N frames are each composed of an image of the first resolution and an image of the second resolution, and the system 100 sets the ROI area to be viewed in the image of the first resolution and then viewed in the image of the second resolution. By recognizing the exact location of, data for hitting analysis is generated. Subsequently, when the hit recognition is completed, the system 100 transmits M frames before the hit and N frames after the hit. In this case, both an image of the first resolution and an image of the second resolution may be included, and each of the first resolution images may be included. The ROI area to be viewed may be displayed in the image, and the location to be viewed may be displayed and transmitted in the image of the second resolution.

An example of hitting data transmitted to a PC appears as shown in Figure 6. In Figure 6, a total of 40 frames are transmitted as an example, with the 13th frame before hitting, the 14th frame after hitting, and the 15th frame immediately after hitting shown in order from the top. 14 frames before hitting and 26 frames after hitting are transmitted to a PC, and analysis of hitting data can be performed based on the speed, rotation amount, and direction of the golf ball obtained from a series of frames.

The present invention can also be implemented as computer-readable code on a computer-readable recording medium. Computer-readable recording media include all types of recording devices that store data that can be read by a computer device. Examples of computer-readable recording media include hard disks, ROM, RAM, CD-ROM, hard disks, magnetic tapes, floppy disks, and optical data storage devices.

Although embodiments of the present invention have been described above with reference to the attached drawings, those skilled in the art will understand that the present invention can be implemented in other specific forms without changing its technical idea or essential features. You will be able to understand it. Therefore, the embodiments described above should be understood in all respects as illustrative and not restrictive.

100: System 110: Interface unit
120: memory 130: image processing unit

Claims (11)

In the hitting preparation step, a camera photographs the hitting area and generates an image of a first resolution and an image of a second resolution;
extracting a ball ROI (Region of Interest) area around the golf ball by first searching the image of the first resolution;
applying the ball ROI area to the image of the second resolution; and
Comprising detecting a golf ball by performing a second search within the ball ROI area of the image of the second resolution,
Method for detecting hits and acquiring golf club movement images from a high-performance camera for screen golf. According to claim 1,
If the golf ball detected in the image of the second resolution through the second search does not move for a predetermined time, determining that it is ready to hit and determining the image of the golf ball as a reference frame, further comprising:
Method for detecting hits and acquiring golf club movement images from a high-performance camera for screen golf. According to clause 2,
Calculate the difference between the reference frame and the captured image,
Further comprising detecting that the golf ball has been hit when it is detected that it has moved a certain distance as a result of comparing the difference image and the reference frame,
Method for detecting hits and acquiring golf club movement images from a high-performance camera for screen golf. According to clause 3,
Extracting a hitting image of a predetermined m number of frames before the hitting point of the golf ball and n frames after the hitting point of the golf ball; and
Further comprising the step of transmitting the extracted m+n frames to a PC to analyze the hitting data,
Method for detecting hits and acquiring golf club movement images from a high-performance camera for screen golf. According to clause 1,
The image of the first resolution has the same timestamp as the image of the second resolution and is a low-resolution (scaled) image,
Method for detecting hits and acquiring golf club movement images from a high-performance camera for screen golf. An interface unit that receives images of the hitting area captured from at least one camera;
A memory that stores a first resolution image and a second resolution image of the hitting area in the hitting preparation stage; and
An image processing unit extracts a ball ROI area around the golf ball by first searching the image of the first resolution, and detects the golf ball through a second search by applying the ball ROI area to the image of the second resolution. doing,
Hit detection and golf club movement image acquisition system for high-performance cameras for screen golf. According to clause 6,
The image processing unit,
If the golf ball detected in the image of the second resolution through the second search does not move for a predetermined time, it is determined to be ready to hit and the image of the golf ball is determined as the reference frame,
Hit detection and golf club movement image acquisition system for high-performance cameras for screen golf. According to clause 7,
The image processing unit,
Calculate the difference between the reference frame and the captured image,
Detecting that the golf ball has been hit when it is detected that it has moved a certain distance as a result of comparing the difference image and the reference frame,
Hit detection and golf club movement image acquisition system for high-performance cameras for screen golf. According to clause 8,
The image processing unit,
Extracting a hitting image of a predetermined m number of frames before the hitting point of the golf ball and n frames after the hitting point of the golf ball,
Calculating coordinates in three-dimensional space of the golf ball from the extracted hitting image,
Hit detection and golf club movement image acquisition system for high-performance cameras for screen golf. According to clause 6,
The image of the first resolution has the same timestamp as the image of the second resolution and is a low-resolution (scaled) image,
Hit detection and golf club movement image acquisition system for high-performance cameras for screen golf. A computer program stored in the computer-readable recording medium recording a program for executing the method of any one of claims 1 to 5 using a computer.