KR101907897B1 - Putting information display system and method for golf on the air - Google Patents

Abstract

The present invention relates to a golf putting information display system and method thereof, and more particularly, to a golf putting information display system and a golf putting information display method that match an image of three-dimensional original green information and an image of an on- The present invention relates to a golfing putting information display system and a method thereof, in which a virtual avatar demonstrates a putting in advance and shows the trajectory of a virtual putting line in accordance with the putting.
A method of displaying a putting information in golf broadcasting includes generating a putting operation using a virtual avatar based on the putting information and generating a putting line according to the putting operation, And displaying a putting line trajectory in which the golf ball enters the hole cup along a trajectory on a three-dimensional green information screen on which the positions of the golf ball and the hole cup are indicated by the putting operation.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a putting information display system and a golf putting information display system,

The present invention relates to a golf putting information display system and method thereof, and more particularly, to a golf putting information display system and a golf putting information display method that match an image of three-dimensional original green information and an image of an on- The present invention relates to a golfing putting information display system and a method thereof, in which a virtual avatar demonstrates a putting in advance and shows the trajectory of a virtual putting line in accordance with the putting.

In general, a golf game is a game in which a club is hit by a golf ball and puts it into 18 holes. In turn, the player who hits the golf course the least after hitting the course is the winner. The greater the number of handicaps, the more novice golfers.

In the case of putting in such golf, it is necessary to precisely grasp the slope of the lie or the green on the green, and hit the golf ball with appropriate strength and direction and insert it into the pin.

Therefore, putting has been regarded as the most important factor in the golf game because of its large impact on the score, and many golfers observe the slope as they move to grasp the lie between the golf ball and the hole cup before putting on the green .

However, most amateur golfers are not easy to read the green slope, which makes putting very difficult.

Meanwhile, conventional golf broadcasts extract image information input from a field camera at the time of broadcasting and data necessary for previously stored broadcasting, and based on the golf broadcast-related information processed and edited according to the form of broadcasting, the announcer and commentator broadcast .

Therefore, the broadcast order is a form in which the announcer and commentator broadcast it in order based on the materials prepared independently from the field camera and in advance.

In golf broadcasts on the golf course, a golfer reads the distance from the golfer to the golf ball and the hole cup, reads the distance from the golf ball to the hole cup, and displays the degree of putting swing To swing.

However, most of amateur golfers watch these golf broadcasts, so that they do not feel a sense of realism, and the golf broadcasts do not help much in putting on the actual green.

Publication No. 2000-0063821 (Publication date November 6, 2000)

SUMMARY OF THE INVENTION The present invention is conceived to solve the above-described problems, and it is an object of the present invention to provide a golf ball game system in which, when a golf ball is turned on during a golf broadcast, an image of 3D original green information is matched with a video image of an on- The present invention provides a method of displaying a putting information display system in a golf broadcasting system that can display a trajectory of a virtual putting line due to the putting, There is a purpose.

According to another aspect of the present invention, there is provided a putting information display system for golf putting information, the method comprising the steps of: acquiring original green information by three-

In a golf broadcast, a still image captured by a broadcast camera in real time is captured to obtain a real green image, and the position of the golf ball and the hole cup is displayed on the three-dimensional circle green information by matching the actual green image with the three-

A green information providing server for obtaining the putting information by calculating a distance, a tilt, and a left / right tilt of the golf ball and the hole cup;

A golf broadcast server for providing three-dimensional original green information provided from the green information providing server and golf related information such as course information, player information, game information, and record information to the matching means;

A golf broadcast assistant server for generating a putting operation with a virtual avatar on the basis of the putting information provided from the green information providing server, and generating a putting line according to the putting operation and providing the putting line to the matching means; And

Matching means for obtaining broadcast data by matching the green information, the golf related information, the putting information, the putting action, the putting line, the audio signal and the video signal in a predetermined order so as to be able to broadcast; .

In addition, in the golf putting information display method according to the embodiment of the present invention, a one-green picture photographed by a camera to capture a circle green, Dimensional image to obtain three-dimensional original green information;

Acquiring actual green information using an actual green screen photographed in real time from a broadcasting camera during golf broadcasting at the green information providing server;

The green information providing server displays the image of the three-dimensional original green information and the image of the actual green information to display the position of the hole cup and the golf ball on the image of the three-dimensional original green information, thereby displaying the distance, Calculating a left-right inclination or a correction putting distance to generate putting information;

Providing the golf information server with green information such as three-dimensional original green information, three-dimensional original green information indicating the position of the golf ball and the hole cup in the green information providing server, and providing the putting information to the golf broadcast assistance server;

Generating a putting operation using a virtual avatar based on the putting information in the golf broadcasting assistance server or generating a putting line according to the putting operation; And

The matching means may be configured to receive the green information or golf related information provided by the golf broadcast server, the putting information provided by the golf broadcast assistance server, the virtual avatar putting operation or the putting line information, the video signal photographed by a plurality of broadcasting cameras, And outputting the broadcast data by matching the received audio signal in a predetermined order so that the audio signal can be outputted as a broadcast; .

According to the means for solving the above-mentioned problems, when a golf ball is turned on during golf broadcasting, a virtual avatar is putted in advance by matching an image of three-dimensional original green information with a video image of a golf ball and a hole cup, By showing the trajectory of the virtual putting line according to the putting, it is possible to feel the vivid sense of presence while watching the golf broadcast, and it can help putting in the actual green.

1 is a block diagram of a putting information display system according to an embodiment of the present invention.
2 is a flowchart of a putting information display method according to an embodiment of the present invention.
3 is a detailed flowchart of the original green information acquisition process shown in FIG.
4 is a detailed flowchart of the actual green information acquisition process shown in FIG.
5 is a detailed flowchart of the matching and output process shown in FIG.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

It is to be noted that the same components of the drawings are denoted by the same reference numerals and symbols as possible even if they are shown in different drawings. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

Also, when a part is referred to as "including " an element, it does not exclude other elements unless specifically stated otherwise.

1 is a block diagram of a putting information display system according to an embodiment of the present invention.

As shown, the putting information display system includes a green information providing server 10, a golf broadcast server 20, a matching means 30, cameras 32a, 32b, ..., 32n, microphones 34a, 34b, 34n, a broadcasting device 40, and a golf broadcast assistance server 50. [

The green information providing server 10 is a server for acquiring original green information and providing it to a golf broadcast server. The green information providing server 10 three-dimensionally implements a one-green picture photographed with a camera for each hole of each golf course, Acquires the green information, stores it in the green information DB 12, and provides it to the golf broadcast server 20.

In addition, the green information providing server 20 captures a still image from among actual green images captured in real time by a plurality of broadcasting cameras 32a, 32b, ..., 32n during golf broadcasting to obtain a real green image, And displays the position of the golf ball and the position of the golf ball in the three-dimensional circle green information, and provides it to the golf broadcast server 20.

The green information providing server 20 obtains the putting information by calculating the distance, the inclination, the inclination and the correcting putting distance of the golf ball and the hole cup, and provides the putting information to the golf broadcasting assistance server 50.

The correction putting distance will be described in detail in Fig.

The golf broadcast server 20 receives the green information provided from the green information providing server 10 (including three-dimensional original green information, three-dimensional original green information indicating the position of the hole cup and the golf ball), a golf related information DB 22 (Including putting moving pictures of the athletes), game information, record information, and the like, which are stored in the game device 30, to the matching means 30.

The golf broadcast assistant server 50 transmits the putting information provided by the green information providing server 10 to the virtual avatar DB 52 based on the distance, And generates a putting line in accordance with the putting operation, and provides the putting line to the matching means 30.

A plurality of broadcasting cameras 32a, 32b, ..., 32n take images in real time during golf broadcasting, convert them into digital video signals and provide them to the matching means 30, and the microphones 34a, 34b, ..., The sound of the announcer, the commentator, and the field sound are converted into digital audio signals and provided to the matching means 30.

The matching means 30 is configured to receive various information provided through the golf broadcast server 20, the golf broadcast assistant server 50, the broadcasting cameras 32a, 32b, ..., and 32n, and the microphones 34a, 34b, And outputs broadcast data obtained by matching in a predetermined order so that the broadcast signal can be output to the broadcast. The broadcast device 40 broadcasts the broadcast data through an airwave or cable to the outside.

2 is a flowchart of a putting information display method according to an embodiment of the present invention.

As shown in FIG. 2, the green information providing server 10 implements a three-dimensional image by image-based modeling of a one-green picture photographed by a camera to capture a circle green, Green information is obtained (S10).

Next, the green information providing server 10 receives the actual green picture taken in real time from the broadcasting cameras 32a, 32b, ..., 32n during golf broadcasting, captures a screen showing the golf ball and the hole in the actual green picture, Information is acquired (S20).

The next green information providing server 10 displays the position of the hole cup and the golf ball on the image of the three-dimensional green information by matching the image of the three-dimensional green information and the actual green information image, The inclination and the left-right inclination and the correction putting distance are calculated to generate putting information (S30).

The corrected putting distance is a distance corrected based on the current green speed based on a normal green speed (for example, 2.4 m / sec).

(누토)라 정의할 때, (2.4/1.5) X 3 = 4.8 누토가 보정퍼팅거리가 된다.For example, if the current green speed is 1.5 m / sec and the distance between the golf ball and the hole cup is 3 m, the putting distance of 1 m from 2.4 m /

(Nuto), (2.4 / 1.5) X 3 = 4.8 Nuto is the corrected putting distance.

(누토)의 보정퍼팅거리를 보내는 스윙의 크기로 스윙하여야 한다.Therefore, 4.8

(Nuto) should swing to the size of the swing that sends the putting distance.

Similarly, the correction putting distance is calculated in consideration of the inclination (downhill, uphill) between the golf ball and the hole cup.

For a downhill slope of -37 cm, the correction putting distance would be 4.8-0.37 = 4.43 Ntos.

Next, the green information providing server 10 provides green information such as three-dimensional green information, three-dimensional green information indicating the position of the golf ball and the hole cup to the golf broadcast server 30, and stores the distance, And provides the putting information such as the right-left inclination and the correction putting distance to the golf broadcast assistance server 50 (S40).

The golf broadcasting assistance server 50 generates a putting operation using a virtual avatar stored in the virtual avatar DB 52 based on the putting information, generates a putting line according to the putting operation, and provides the putting line to the matching means 30 (S50 ).

The matching means 30 is configured to match the green information and golf related information provided by the golf broadcast server 20 with the virtual avatar putting operation and putting line information provided by the golf broadcast assistant server 50, 32b,..., 32n and audio signals input through the plurality of microphones 34a, 34b, ..., 34n are matched in a predetermined order so as to be output as broadcasts, (S60).

For example, after the image of the three-dimensional original green information indicating the position of the golf ball and the hole cup is matched with the video signal and the audio signal, the virtual avatar putting operation is matched to the image of the three- After the virtual avatar putting operation is completed, the trajectory of the putting line is matched with the image of the three-dimensional raw green information indicating the positions of the golf ball and the hole cup.

The broadcast apparatus 40 broadcasts the broadcast data output from the matching means 30 through an airwave or a cable, and the viewer watches the golf broadcast using a receiver such as a TV, a computer, or a smart phone.

3 is a detailed flowchart of the original green information acquisition process shown in FIG.

As shown in FIG. 3, one or more photo zones are designated (S11) by setting a position where the entire putting green can be photographed in the vicinity of the putting green while showing the shape and feature points of the putting green.

In step S12, a circle green is drawn so that a circle green, a green edge, a bunker surrounding the green, and the like are entered using the camera in the designated photo zone.

At this time, in order to detect the depth of the photographed object (the original green), which is the information for acquiring the three-dimensional image, the photographing of the parallel visual stereo system and the cross virtual visual system are performed, Take a picture of green.

Terrestrial LiDAR (Terrestrial Light Detection and Ranging) is used to emit a laser beam to a measurement object (a circle green), calculate the return time and phase difference, And acquires three-dimensional spatial information combining information.

Of course, in step S11, it is also possible to shoot the original green so that the original green, the green edge, and the bunker surrounding the green can be entered by using the camera at any place without designating the photo zone.

The original green picture is stored in the information providing server 10 and an image program is executed to generate a pure original green image by removing additional images such as a hall position, a golf tool (for example, a flag pin of a hole cup) (S13).

Next, the 3D original green information is obtained by post-processing image-based modeling such as simplifying the original image of the original source, rotating the simplified original image of the original green, and correcting the height (S14).

That is, the three-dimensional image is reconstructed by a method of detecting the depth of the real object from the two-dimensional original green photograph, and the three-dimensional image is generated by image-based modeling to generate the original green information.

At this time, it is possible to calculate the three-dimensional image according to the depth and the depth of the three-dimensional object in at least two images based on the parallel visual stereo method or the cross visual stereo method, or to process the image obtained from one camera separately It can also be used as a 3D image.

For example, in the parallel vision stereo method, when two lens projection center lines are arranged in parallel, the image of the same object point is divided into an epipolar line (a line formed by two lens centers and an image plane) generated by the object point Wherein the depth of the real object can be sensed by the distance on the lens center and the focal distance and the distance between the projection objects on the image plane through the two lenses.

In the next three-dimensional circle green information, feature points such as the green edge and the green surrounding bunker which are characteristic of the original green are extracted or a pattern of a specific area is extracted (S15).

This feature point extraction is performed by face direction recognition or fingerprint recognition technology, and block direction extraction, binarization, and thinning are performed, and finally, feature point data is extracted.

The pattern extraction of the specific region transforms the image of the three-dimensional green information into a binary image and then extracts a pattern from a specific region of the binary image.

The pattern of the extracted feature points or feature regions is stored in the green information DB 12 together with the three-dimensional original green information (S16).

4 is a detailed flowchart of the actual green information acquisition process shown in FIG.

As shown in FIG. 4, when the golf ball is actually positioned on the green at the time of golfer's rounding in the process of acquiring the actual green information, the green information providing server 10 uses the broadcasting cameras 32a, 32b, ..., A screen representing the area between the golf ball and the hole cup is captured on the screen photographed in real time, and an actual green picture is obtained (S21).

In the actual green picture, additional images such as a golf tool and other person (golfer) shape are removed (S22).

The feature point is extracted from the actual green information from which the additional image is removed or a pattern of a specific region is extracted from the actual green information (S23).

In addition, the golf ball and the hole cup are checked in the actual green information from which the additional image is removed to generate position information of the golf ball and the hole cup (S24).

The positional information of the golf ball and the hole cup and the actual green information are stored in the drawn information DB 12 (S25).

5 is a detailed flowchart of the matching and output process shown in FIG.

As shown in FIG. 5, the matching means 30 is adapted to match a video signal photographed by a plurality of broadcasting cameras 32a, 32b, ..., and 32n and an audio signal input through a plurality of microphones, And obtains the data and outputs the broadcast data (S61).

Next, the green data and the putting information provided from the golf broadcasting server 20 and the golf broadcasting assistance server 50 are matched with the video and audio signals to obtain broadcast data and output the broadcast data (S62).

Next, the virtual avatar putting operation provided by the golf broadcast assistant server 50 is demonstrated on a three-dimensional raw green information screen in which the positions of the golf ball and the hole cup are displayed (S63).

의 힘으로 홀컵 15cm 우측으로 보내면 됩니다." 등과 같이 퍼팅동작시 참조할 정보를 구두로 설명한다.At this time, if the virtual avatar is executed interactively with the virtual avatar and the name of the virtual avatar (for example, Nutoin) is called, Nutoin demonstrates the putting action and "

And send it to the hole 15cm to the right with the power of ".

In the step S64, a putting line trajectory in which the golf ball enters the hole cup along the trajectory is displayed on the three-dimensional green information screen showing the positions of the golf ball and the hole cup by the putting operation after the demonstration of the putting operation.

In addition, the matching means 30 receives the real putting moving pictures of other players (golfers) from the current green on the basis of the golf broadcasting server 20 and outputs them to the data screen (S65).

10: Green information providing server 12: Green information DB
20: golf broadcast server 22: golf related information DB
30: matching means 40: broadcasting device
50: Golf broadcast assistance server 52: Virtual avatar DB

Claims (11)

The original green image photographed by the camera is three-dimensionally modeled by image-based modeling to acquire the original green information,
In a golf broadcast, a still image captured by a broadcast camera in real time is captured to obtain a real green image, and the position of the golf ball and the hole cup is displayed on the three-dimensional circle green information by matching the actual green image with the three-
A green information providing server for obtaining the putting information by calculating a distance, a tilt, and a left / right tilt of the golf ball and the hole cup;
A golf broadcast server for providing three-dimensional original green information provided from the green information providing server and golf related information such as course information, player information, game information, and record information to the matching means;
A golf broadcast assistant server for generating a putting operation with a virtual avatar on the basis of the putting information provided from the green information providing server, and generating a putting line according to the putting operation and providing the putting line to the matching means; And
Matching means for obtaining broadcast data by matching the at least one of the green information, the golf related information, the putting information, the putting action, and the putting line in a predetermined order so as to be able to be broadcasted;
Wherein the putting information display system comprises: The method according to claim 1,
The green information providing server calculates a correction putting distance which is a distance corrected based on a current green speed on the basis of a normal green speed and provides the corrected putting distance to the golf broadcasting auxiliary server by including the corrected putting distance in the putting information Putting information display system during golf broadcast. A step of acquiring three-dimensional original green information by imaging the original green image photographed so that the original green, the green, and the surrounding bunker are contained by using the camera, by three-dimensional image-based modeling by the green information providing server;
Acquiring actual green information using an actual green screen photographed in real time from a broadcasting camera during golf broadcasting in the green information providing server;
The green information providing server displays the image of the three-dimensional original green information and the image of the actual green information to display the position of the hole cup and the golf ball on the image of the three-dimensional original green information, thereby displaying the distance, Calculating a left-right inclination or a correction putting distance to generate putting information;
Providing the golf information server with green information such as three-dimensional original green information, three-dimensional original green information indicating the position of the golf ball and the hole cup in the green information providing server, and providing the putting information to the golf broadcast assistance server;
Generating a putting operation using a virtual avatar based on the putting information in the golf broadcasting assistance server or generating a putting line according to the putting operation; And
In the matching means, in order to export at least one of green information provided by the golf broadcast server, golf related information, putting information provided by the golf broadcast assistant server, virtual avatar putting operation and putting line information, Obtaining broadcast data by matching and outputting the broadcast data;
And displaying the putting information on the golf course. The method of claim 3,
The step of acquiring the three-dimensional original green information includes the steps of photographing a raw green so that a raw green, a green edge, a green surrounding bunker,
Removing a supplementary image such as a hole position, a golf tool, and a human shape in the original green image to generate a pure original green image;
Acquiring three-dimensional original green information by image-based modeling in the pure green image;
And extracting characteristic points such as a green edge and a green surrounding bunker that characterize the original green in the three-dimensional original green information or extracting a pattern of a specific area. 5. The method of claim 4,
Wherein the step of acquiring the actual green information comprises the steps of: acquiring a real green picture taken by a broadcasting camera in real time, capturing an actual green picture between the golf ball and the hall cup,
Removing additional images such as golf tools and other human shapes from the actual green picture;
Extracting a feature point from the actual green information from which the additional image has been removed, or extracting a pattern of a specific region from the actual green information,
And generating position information of the golf ball and the hole cup by checking the golf ball and the hole cup in the actual green information from which the additional image is removed. 6. The method of claim 5,
When matching the image of the three-dimensional original green information with the image of the actual green information, a pattern of the feature point or the specific region extracted from the three-dimensional original green information and a pattern of the feature point or the specific region extracted from the actual green information are matched Wherein the putting information is displayed on the screen. 6. The method of claim 5,
Wherein the image is photographed in a designated photo zone when photographing the original green with the camera or when photographing the actual green with the broadcast camera in real time. The method of claim 3,
Wherein the step of obtaining the broadcast data includes matching a video signal captured by a plurality of broadcast cameras and an audio signal input through a plurality of microphones so as to be broadcasted,
Matching three-dimensional original green information and putting information indicating a position of a golf ball and a hole cup provided from the golf broadcast server or the golf broadcast assistance server with a video signal or an audio signal;
And displaying the virtual avatar putting operation provided by the golf broadcast assistant server on a three-dimensional green information screen displaying the position of the golf ball and the hole cup. 9. The method of claim 8,
Further comprising the step of displaying a putting line trajectory in which a golf ball enters a hole cup along a trajectory on a three-dimensional green information screen on which a position of a golf ball and a hole cup is indicated by the putting operation after the demonstration of the putting operation, Display method. 9. The method of claim 8,
Wherein the virtual avatar is a demonstration of a putting operation, and verbally describes information to be referred to in a putting operation. 9. The method of claim 8,
Further comprising receiving from the golf broadcast server a real putting moving picture of other players in the past on the current green, and outputting the putting moving moving picture to a data screen.

Images