KR20140023137A - On green information display system and method for golf on the air - Google Patents

Abstract

The present invention relates to a system for displaying on-green information during a golf television program and a method for the same and more specifically, to a system for displaying on-green information during a golf television program and a method for the same, which is capable of, if a golf ball is on the green during a golf television program, matching an image for three-dimensional circular green information and an image obtained by photographing the golf ball being on the green and a hole cup to allow a virtual avatar to simulate putting in advance, and displaying the trajectory of a virtual putting line according to the putting. The method for displaying on-green information during a golf television of the present invention comprises the steps of: generating a putting motion with a virtual avatar based on putting information and creating a putting line according to the putting motion; simulating the putting motion of the virtual avatar on a screen for three-dimensional circular green information in which the locations of a golf ball and a hole cup are indicated; and displaying the trajectory of a putting line, along which the golf ball moves into the hole cup along the trajectory, on the screen for three-dimensional circular green information in which the locations of the golf ball and the hole cup are indicated, based on the putting motion. [Reference numerals] (S10) Obtain three-dimensional circular green information using a photo; (S20) Obtain location information for a golf ball and a hole cup; (S30) Generate putting information; (S40) Provide the green information and the putting information; (S50) Generate a putting motion of a virtual avatar; (S60) Match and output various information; (S70) Broadcast

Description

ON GREEN INFORMATION DISPLAY SYSTEM AND METHOD FOR GOLF ON THE AIR}

The present invention relates to a display system and method for displaying on-green information during golf broadcasting, and more particularly, when a golf ball is on-green during golf broadcasting, by matching an image of three-dimensional one-green information with an image of the current green ball and a hole cup on-green. The present invention relates to an on-green information display system and method during a golf broadcast, in which a virtual avatar demonstrates putting in advance and shows a trajectory of a virtual putting line according to the putting.

In general, a golf game is a game in which a club hits a golf ball and puts it into 18 holes. The player who hits the golf course the least after hitting the entire course in turn is the winner. Unlike other games, there is a handicap The greater the number of handicap, the more beginner golfers are.

In the case of putting in such golfing, it is necessary to accurately grasp the inclination of the lie or the green on the green and hit the golf ball in the appropriate strength and direction to put it into the hole cup.

Therefore, putting has been considered the most important factor in the game of golf because the impact on the score is very large, and many golfers observe the slope as they move to identify the lie between the golf ball and the hole cup before putting on the green. .

However, most amateur golfers find it difficult to read the slope of the green, making putting very difficult.

Meanwhile, in the conventional golf broadcast, the announcer and the commentators broadcast through the voice based on the golf broadcast-related information that is edited and processed according to the form of the broadcast by extracting the image information input from the field camera at the time of broadcasting and the data necessary for the previously stored broadcast. Will proceed.

Therefore, the broadcasting sequence is broadcasted by announcers and commentators based on the data prepared independently of the field camera in advance.

The golf broadcast on the green during the golf broadcast, the field camera shows the entire green and the green from the golf ball to the hole cup on the screen while the interpreter reads the distance and the slope to the golf ball and the hole cup, and how much putting swing size in any direction. Tells you to swing.

However, most amateur golfers do not feel vivid realism while watching these golf broadcasts, and there was a problem that these golf broadcasts did not greatly help putting on the green.

Publication No.2000-0063821 (published 6 November 2000)

The present invention has been made to solve the above-described problems, the virtual avatar is putt in advance by matching the image of the three-dimensional circle green information and the image of the current green ball and the hole cup when the golf ball is on green during golf broadcasting By showing the trajectory of the virtual putting line according to the putt, you can feel the vivid reality while watching the golf broadcast, and provide the method of on-green information display system during the golf broadcast that can help you to putt on the green. There is a purpose.

On-going information display system during golf broadcasting according to an embodiment of the present invention for achieving the above object is to obtain the original green information by three-dimensionalizing the original green photograph taken by the camera by image-based modeling,

During golf broadcasting, it acquires the location information of the golf ball and the hole cup displayed on the 3D circle green information screen output to the display device.

A green information providing server that obtains putting information by calculating distances, inclinations and left and right inclinations of the golf ball and the hole cup based on the position information of the golf ball and the hole cup in the three-dimensional circle green information;

A golf broadcasting server providing 3D circle green information and golf related information such as course information, player information, game information and record information provided from the green information providing server to the matching means;

A golf broadcasting auxiliary server for generating a putting operation with a virtual avatar based on the putting information provided from the green information providing server and generating a putting line according to the putting operation and providing the matching line to the matching means; And

Matching means for matching broadcasting in a predetermined order so that any one or more of the green information, golf related information, putting information, putting operation, and putting line can be broadcasted;

.

In addition, the on-green information display method during the golf broadcast according to an embodiment of the present invention is a one-green picture taken to enter the green, green edge or the bunker around the green using a camera, 3 by image-based modeling in the green information providing server Imaging in three dimensions to obtain three-dimensional circle green information;

Acquiring position information of a golf ball and a hole cup displayed on a 3D circle green information screen during golf broadcasting by the green information providing server;

Generating putting information by calculating distance, inclination, left and right inclination or correction putting distance of the golf ball and the hole cup based on the position information of the golf ball and the hole cup in the three-dimensional circle green information;

Providing green information, such as three-dimensional circle green information, three-dimensional circle green information indicating the positions of the golf ball and the hole cup, to the golf broadcasting server and providing putting information to the golf broadcasting auxiliary server in the green information providing server;

Generating a putting operation with a virtual avatar based on the putting information in the golf broadcasting auxiliary server, or generating a putting line according to the putting operation; And

According to a predetermined order, the matching means may send out one or more of the green information or golf-related information provided by the golf broadcasting server, the putting information provided by the golf broadcasting auxiliary server, the virtual avatar putting motion or the putting line information. Matching to obtain broadcast data and outputting the broadcast data;

.

According to the above-mentioned means for solving the problem, when the golf ball is on green during golf broadcasting, the virtual avatar is putt in advance by matching the image of the 3D circle green information with the image of the current green ball and the hole cup. By showing the trajectory of the virtual putting line according to the putting, you can feel the vivid realism while watching the golf broadcast, and it can help to putt on the actual green.

1 is a block diagram of an on green information display system according to an embodiment of the present invention.
2 is a flowchart illustrating a putting information display method according to an embodiment of the present invention.
FIG. 3 is a detailed flowchart of the process of acquiring one green information shown in FIG. 2.
4 is a detailed flowchart of a golf ball and hole cup position information acquisition process shown in FIG.
FIG. 5 is a detailed flowchart of the matching and output process shown in FIG. 2.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

It is to be noted that the same components of the drawings are denoted by the same reference numerals and symbols as possible even if they are shown in different drawings. In the following description of the present invention, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted.

In addition, when a part is said to "include" a certain component, this means that it may further include other components, except to exclude other components unless otherwise stated.

1 is a block diagram of a putting information display system according to an exemplary embodiment of the present invention.

As shown, the putting information display system is a green information providing server 10, golf broadcasting server 20, matching means 30, cameras 32a, 32b, ..., 32n, microphones 34a, 34b, ..., 34n), pointer 36, broadcast device 40, golf broadcast assistance server 50, and display device 60.

The green information providing server 10 is a server that obtains the original green information and provides it to a golf broadcasting server. Acquire green information, store it in the green information DB 12, and provide it to the golf broadcasting server 20.

In addition, the green information providing server 20 uses the pointer 36 as an announcer and commentator by referring to an actual green screen which is recorded and output in real time with a plurality of broadcasting cameras 32a, 32b, ..., 32n during golf broadcasting. The position information of the golf ball and the hole cup is obtained by the position of the golf ball and the hole cup indicated in the dimensional circle green information, and stored in the green information DB 12.

In addition, the green information providing server 20 calculates the distance, the tilt and the left and right inclination and the correction putting distance of the golf ball and the hole cup based on the position information of the golf ball and the hole cup to obtain the putting information and the putting information to the golf broadcasting auxiliary server 50 To provide.

The correction putting distance will be described in detail with reference to FIG. 2.

Golf broadcasting server 20 is the green information provided from the green information providing server 10 (including three-dimensional circle green information and three-dimensional circle green information indicating the position of the hole cup and golf ball), and golf-related information DB 22 The golf-related information, namely, course information, player information (including putting videos of players), game information, record information, and the like, which are stored in itself, are provided to the matching means 30.

The golf broadcasting auxiliary server 50 is a virtual avatar stored in the virtual avatar DB 52 based on the putting information provided from the green information providing server 10, that is, the distance between the golf ball and the hole cup, the inclination, the left and right inclination, and the correction putting distance. To generate a putting operation, and to generate a putting line according to the putting operation is provided to the matching means (30).

A plurality of broadcasting cameras 32a, 32b, ..., 32n take images in real time during golf broadcasting, convert them into digital video signals, and provide them to the matching means 30. Microphones 34a, 34b, ..., 34n are provided. Sounds and field sounds, such as announcers and commentators, are converted into digital audio signals and provided to the matching means 30.

When the 3D circle green information is output on the screen of the display device 60, the touch pen 36 presses the display device 30 by an announcer or a commentator to position the golf ball and the hole cup on the screen of the 3D circle green information. Is displayed.

At this time, the announcer or commentator displays the positions of the golf ball and the hole cup on the screen of the three-dimensional circle green information with reference to the actual green screen photographed and output in real time using a plurality of broadcasting cameras 32a, 32b, ..., 32n.

The display device 60 is composed of a touch screen, and configured to sense the pressure pressed on the touch screen, and thus the detected pressure of the display device 60 is coordinated by the green information providing server for coordinates of three-dimensional circle green information. The value is read and thereby position information of the hole cup and the golf ball is obtained.

In this case, in order to accurately acquire the position information of the hole cup and the golf ball, it is preferable to use a touch pen 40 having a form such as a pen that applies pressure to the display device 60.

The matching means 30 is a variety of information provided through the golf broadcast server 20, the golf broadcast auxiliary server 50, broadcast cameras (32a, 32b, ..., 32n), microphones (34a, 34b, ..., 34n) B. The broadcast data obtained by matching the signals in a predetermined order is output to the broadcast device 40 or the display device 60 so that the signals can be broadcasted, and the broadcast device 40 transmits them to the outside via airwaves or cables. Golf broadcasts.

2 is a flowchart illustrating a putting information display method according to an embodiment of the present invention.

As shown in FIG. 2, the green information providing server 10 uses a camera to image a three-dimensional image of a one-green photograph taken to enter a circle green, green edge, or a green surrounding bunker by three-dimensional image-based modeling. Acquire green information (S10).

During the next golf broadcast, the actual green screen photographed by the broadcasting cameras 32a, 32b, ..., 32n in real time is output to the display device 60 through the matching means 30, or simultaneously with the output, the three-dimensional circle green information. Is output to the display device 60 through the matching means 30, the announcer or commentator presses (presses) the display device 60 made of the touch screen with the touch pen 36 referring to the actual green screen 3 When the position of the golf ball and the hole cup is displayed on the dimensional one green information screen, the green information providing server 10 reads the coordinate values of the golf ball and the hole cup on the three dimensional one green information screen at the pressure detected by the display device 60. By the position information of the hole cup and the golf ball is obtained (S20).

Next, the green information providing server 10 calculates the distance, the inclination, the left and right inclination and the correction putting distance of the golf ball and the hole cup based on the position information of the golf ball and the hole cup from the three-dimensional circle green information (S30).

The correction putting distance is a distance corrected in consideration of the current green speed based on a general green speed (for example, 2.4 m / sec).

(누토)라 정의할 때, (2.4/1.5) X 3 = 4.8 누토가 보정퍼팅거리가 된다.For example, if the current green speed is 1.5m / sec and the distance between the golf ball and the hole cup is 3m, a putting distance of 1m at 2.4m / sec is 1

When defined as (Nuto), (2.4 / 1.5) X 3 = 4.8 Nuto is the correction putting distance.

(누토)의 보정퍼팅거리를 보내는 스윙의 크기로 스윙하여야 한다.Thus 4.8

Swing to the size of the swing that sends the correct putting distance of (Nuto).

Similarly, the correction putting distance is calculated in consideration of the slope (downhill, uphill) between the golf ball and the hole cup.

For downhill slopes with a slope of-37 cm, the correct putting distance is 4.8-0.37 = 4.43 noto.

Next, the green information providing server 10 provides the green broadcasting information, such as three-dimensional circle green information, three-dimensional circle green information indicating the positions of the golf ball and the hole cup, to the golf broadcasting server 30, and the distance, the slope and the distance between the golf ball and the hole cup. Putting information, such as the left and right inclination and the correction putting distance is provided to the golf broadcasting auxiliary server 50 (S40).

The golf broadcasting auxiliary server 50 generates a putting operation with a virtual avatar stored in the virtual avatar DB 52 based on the putting information, generates a putting line according to the putting operation, and provides it to the matching means 30 (S50). ).

The matching means 30 is the green information and golf-related information provided by the golf broadcasting server 20, the virtual avatar putting operation and putting line information provided by the golf broadcasting auxiliary server 50, a plurality of broadcasting cameras 32a, The broadcast data is matched in a predetermined order so that the video signal photographed at 32b, ..., 32n and audio signals input through the plurality of microphones 34a, 34b, ..., 34n can be broadcasted. Is output through the broadcast apparatus 40 and the display apparatus 60 (S60).

For example, after the image of the 3D circle green information indicating the position of the golf ball and the hole cup is matched with the video signal and the audio signal, the virtual avatar putting motion is matched to the image of the 3D circle green information indicating the position of the golf ball and the hole cup. After the virtual avatar putting operation is completed, the trajectory of the putting line is matched to the image of the three-dimensional circle green information indicating the positions of the golf ball and the hole cup.

The broadcasting device 40 transmits and broadcasts the broadcast data output from the matching means 30 through airwaves or a cable, and the viewer watches the golf broadcast using a receiving device such as a TV, a computer, or a smartphone.

FIG. 3 is a detailed flowchart of the process of acquiring one green information shown in FIG. 2.

As illustrated in FIG. 3, one or more photo zones may be designated by determining a location that can show the shape and characteristic points of the putting green while photographing the entire putting green around the putting green (S11).

In the designated photo zone, one green is photographed using a camera so that one green, green edge, green bunker, etc. are entered (S12).

At this time, in order to detect the image depth of the real object (circle green), which is information for acquiring a 3D image, parallel stereo imaging and cross stereo imaging are performed or a single camera is used. Shoot the green.

Or by using Terrestrial LiDAR (Terrestrial Light Detection And Ranging) surveying equipment, the laser beam is emitted to the surveying target (circle green) and the return time and phase difference are calculated to calculate the position information and image of the target (circle green). Acquiring three-dimensional spatial information combining the information.

Of course, in step S11, without specifying a photo zone, the camera may be photographed in such a way that the green, the green edge, the bunkers around the green, etc. are used at any place.

The original green image is stored in the green information providing server 10 and the image program is executed to remove the additional images such as hole positions, golf tools (for example, the flagpole of the hole cup), and other human shapes to generate pure one-green images. (S13).

Next, three-dimensional circle green information is obtained by image-based modeling after postprocessing such as simplifying the pure circle green image, rotating the simplified pure circle green image, and correcting the height (S14).

That is, circle green information is generated by image-forming in three dimensions by image-based modeling which reconstructs three dimensions by detecting the depth of the real object from a two-dimensional circle green photograph.

At this time, the depth of the three-dimensional object and the three-dimensional image according to the depth may be calculated from at least two images based on the parallel stereoscopic method or the cross-visual stereo method, and the image obtained from one camera may be processed separately. It can also be 3D imaging.

For example, in the parallel-vision stereo system, when two lens projection center lines are placed in parallel, an image of the same object point is placed on an epipolar line generated by the object point (a line formed by two lens centers and an image plane). In this case, the depth of the real object may be sensed by the distance between the lens center and the focal length and the distance between the projection objects in the image plane through the two lenses.

Next, the 3D circle green information is stored in the green information DB 12 (S15).

4 is a detailed flowchart of a golf ball and hole cup position information acquisition process shown in FIG.

As shown in FIG. 4, when the golfer turns green on the rounding, the broadcasting cameras 32a, 32b, ..., 32n shoot the actual green so that the green between the golf ball and the hole cup appears well, and match the shot real green. It outputs to the display apparatus 60 via the means 30 (S21).

The green information providing server 10 outputs the three-dimensional circle green information provided to the golf broadcasting server 20 on the screen of the display device 60 through the matching means 30 (S22).

In this case, the photographing actual green may be output to the display device 60 first, and then 3D circle green information may be output, or the photographing actual green and the 3D circle green information may be simultaneously output by dividing the screen.

Next, the announcer or commentator presses (presses) the screen of the display device 60 on which the 3D circle green information is output using the touch pen 36 by referring to the positions of the golf ball and the hole cup on the actual green screen. The position of the golf ball and the hole cup on the green information screen is displayed (S23).

The green information providing server 10 reads the coordinate values of the golf ball and the hole cup on the three-dimensional circle green information screen with the pressure sensed by the display device 60 to obtain position information of the hole cup and the golf ball (S24).

Thereafter, the position information of the golf ball and the hole cup is stored in the green information DB 12 (S25).

FIG. 5 is a detailed flowchart of the matching and output process shown in FIG. 2.

As shown in FIG. 5, the matching means 30 matches and broadcasts video signals photographed by a plurality of broadcasting cameras 32a, 32b, ..., 32n, and audio signals input through a plurality of microphones. Data is obtained and this broadcast data is output (S61).

Next, the green data and the putting information provided from the golf broadcasting server 20 and the golf broadcasting auxiliary server 50 are matched with video and audio signals to obtain broadcast data and output the broadcast data (S62).

Next, the virtual avatar putting operation provided by the golf broadcasting auxiliary server 50 is demonstrated on the three-dimensional circle green information screen in which the positions of the golf ball and the hole cup are displayed (S63).

의 힘으로 홀컵 15cm 우측으로 보내면 됩니다." 등과 같이 퍼팅동작시 참조할 정보를 구두로 설명한다.In this case, the command is performed interactively with the virtual avatar, and the virtual avatar name (for example, Nutoin) is called. Nutoin demonstrates the putting motion with the "Golf ball into the hole cup.

Please send the hole cup 15cm to the right.

After the putting operation demonstration, the putting line trajectory shows the golf ball entering the hole cup along the trajectory on the three-dimensional circle green information screen in which the positions of the golf ball and the hole cup are displayed by the putting operation (S64).

In addition, the matching means 30 receives a mistake putting video of other players (goers) in the past in the current green from the golf broadcasting server 20 and outputs the data screen (S65).

10: green information providing server 12: green information DB
20: golf broadcasting server 22: golf-related information DB
30: matching means 36: touch pen
40: broadcasting device 50: golf broadcasting auxiliary server
52: virtual avatar DB 60: display device

Claims (11)

Three-dimensional one-green photos taken by the camera to obtain three-dimensional information by image-based modeling,
During golf broadcasting, it acquires the location information of the golf ball and the hole cup displayed on the 3D circle green information screen output to the display device.
A green information providing server that obtains putting information by calculating distances, inclinations and left and right inclinations of the golf ball and the hole cup based on the position information of the golf ball and the hole cup in the three-dimensional circle green information;
A golf broadcasting server providing 3D circle green information and golf related information such as course information, player information, game information and record information provided from the green information providing server to the matching means;
A golf broadcasting auxiliary server for generating a putting operation with a virtual avatar based on the putting information provided from the green information providing server and generating a putting line according to the putting operation and providing the matching line to the matching means; And
Matching means for matching broadcasting in a predetermined order so that any one or more of the green information, golf related information, putting information, putting operation, and putting line can be broadcasted;
On green information display system during the golf broadcast. The method of claim 1,
The green information providing server calculates a correction putting distance, which is a distance corrected in consideration of the current green speed, based on a general green speed, and includes the correction putting distance in the putting information and provides the golf broadcasting assistance server. On green information display system during golf broadcasting. The method of claim 1,
Wherein the display device is a touch screen,
On-green information display system during golf broadcasting, characterized in that the position of the golf ball and the hole cup on the three-dimensional circle green information screen with a pen touched on the actual green screen taken by the camera for broadcasting during the golf broadcast. Obtaining a three-dimensional original green information by imaging a one-green photograph taken to enter one green, green edge, or green bunker using a camera in three dimensions by image-based modeling in a green information providing server;
Acquiring position information of a golf ball and a hole cup displayed on a 3D circle green information screen during golf broadcasting by the green information providing server;
Generating putting information by calculating distance, inclination, left and right inclination or correction putting distance of the golf ball and the hole cup based on the position information of the golf ball and the hole cup in the three-dimensional circle green information;
Providing green information, such as three-dimensional circle green information, three-dimensional circle green information indicating the positions of the golf ball and the hole cup, to the golf broadcasting server and providing putting information to the golf broadcasting auxiliary server in the green information providing server;
Generating a putting operation with a virtual avatar based on the putting information in the golf broadcasting auxiliary server, or generating a putting line according to the putting operation; And
According to a predetermined order, the matching means may send out one or more of the green information or golf-related information provided by the golf broadcasting server, the putting information provided by the golf broadcasting auxiliary server, the virtual avatar putting motion or the putting line information. Matching to obtain broadcast data and outputting the broadcast data;
On-green information display method during the golf broadcast comprising a. 5. The method of claim 4,
The acquiring of the 3D circle green information may include photographing the circle green such that the circle green, the green edge, the bunker surrounding the green, etc. are entered using a camera;
Generating a pure one green image by removing additional images such as hole positions, golf tools, and other human shapes from the one green image,
And obtaining 3D circle green information from the pure circle green image by image-based modeling. The method of claim 5,
Acquiring the position information of the golf ball and the hole cup is the step of photographing the actual green and output to the display device so that the green between the golf ball and the hole cup is well displayed with a broadcasting camera during golf broadcasting;
Outputting the three-dimensional circle green information to a display device;
Displaying the positions of the golf ball and the hole cup on the three-dimensional circle green information screen by referring to the positions of the golf ball and the hole cup on the actual green screen with a touch pen;
And reading the coordinate values of the golf ball and the hole cup by the pressure sensed by the display device in the green information providing server to obtain position information of the hole cup and the golf ball. The method according to claim 6,
On-green information display method during the golf broadcast, characterized in that shooting in the designated photo zone when shooting a real green with a camera or a real-time shooting with a broadcast camera. 5. The method of claim 4,
The acquiring of the broadcast data includes matching video signals captured by a plurality of broadcast cameras and audio signals input through a plurality of microphones to be broadcasted;
Matching the three-dimensional circle green information or the putting information indicating the position of the golf ball and the hole cup received from the golf broadcasting server or the golf broadcasting auxiliary server with a video signal or an audio signal;
And demonstrating a virtual avatar putting operation provided by the golf broadcasting auxiliary server on a three-dimensional circle green information screen displaying the positions of a golf ball and a hole cup. 9. The method of claim 8,
After the putting operation demonstration, the greening information during the golf broadcast further comprising the step of showing the path of the golf ball and the putting line to the hole cup along the trajectory on the three-dimensional circle green information screen displayed by the putting operation Display method. 9. The method of claim 8,
And the virtual avatar verbally explains information to be referred to in the putting operation together with the demonstration of the putting operation. 9. The method of claim 8,
And receiving a mistake putting video of other players in the past from the golf broadcasting server in the current green and outputting the data screen on the golf broadcasting.

Images