KR20170052164A - System and method for automatically creating image information on golf - Google Patents

Abstract

The present invention provides a system and method for automatically golf image information, capable of providing a user with image contents that are memorable for a golf shot by automatically generating the golf image information by editing image information showing a series of processes from a golf shot to a motion on a region including a target point of the golf shot ball for the user who plays a round of golf beyond a simple hole-in-one confirmation or near-pin authentication. The system for automatically generating golf image information includes a first photographing unit which obtains the golf shot image of the user, a second photographing unit which photographs the region including the target point, and an image information processing unit which automatically generates the golf image information.

Description

TECHNICAL FIELD [0001] The present invention relates to a system and method for automatically generating golf image information,

The present invention relates to a system and method for automatically generating golf image information, and more particularly, to a method and system for automatically generating a golf image information and a method for automatically generating golf image information, And more particularly, to a system and a process driven by the system for efficiently recording and editing images and providing the user with contents that are memorable for a golf round.

The majority of golfers who play golf rounds on the golf course find that the golf ball is properly seated on the green during the course of the round of golf, the ball is seated very close to the green cup, and sometimes the marvelous record, such as hole- I also experience it.

For example, if a user who has not played a proper ongreen because of a low hit rate during the usual round of golf, the ball shot tee at the par 3 hole will be properly warmed up to the user, the golf shot will be a stunning experience for the user.

In addition, there are many cases where people competing with each other compete in the par 3 hole to see whether the tee shot is close to the green top, or near pin competition. Even if you win, it will be an incredible experience for the user.

In particular, if you record a hole-in-one in the Par 3 Hall, it will be an incredible experience for the user.

However, as described above, golfers experience remarkable experiences during the course of golf rounds. However, in the past, there has been a technology for recording and providing contents that golfers can memorize with such amazing experience There was a problem that it was not implemented.

[0003] However, in the related art, there has been a problem that the conventional one disclosed in JP-A-2013-248381 (a hole-in-one confirmation system and its camera), JP-A 2004-46648 (a hole- A recognition system, and the like, a technique is known in which a camera is installed on a green side and a golfer's golf shot is played in a tee box, .

However, in the known technologies disclosed in the above-mentioned publication, the user simply confirms whether the golf ball shot by the user is a hole-in-one, and notifies the user or provides a shot image related to the hole-in- Since a series of processes such as the movement of the ball on the green can not be recorded and provided as an image, there is a problem in that it is very insufficient as a content for memorizing the golf shot of the user and the recording thereof.

The present invention edits image information showing a series of processes from a golf shot to a motion on an area including a target point of the golf shot for a user who is making a round of golf beyond a simple hole-in-one confirmation or near- The present invention provides a golf image information automatic generation system and a golf image information automatic generation method capable of providing a user with image contents that are memorable for a golf shot by automatically generating golf image information.

According to an embodiment of the present invention, a system for automatically generating golf image information according to a golf shot of a user in a golf course includes a first photographing unit for acquiring an image of a golf shot by a user in the photographing area; A second photographing unit photographing an area including a target point; And a control unit for collecting images photographed respectively from the first photographing unit and the second photographing unit, determining an extracting interval of the images collected from the first photographing unit and the second photographing unit, And an image information processing apparatus for automatically generating the golf image information by editing each extracted image according to a preset item.

Preferably, the first photographing unit includes at least one of a first camera for photographing a side of a user swinging a golf and a second camera for photographing a front side of the user swinging the golf, 2 photographing unit includes at least one of a third camera for photographing an area including a target point and a fourth camera for photographing an area including the target point at a time different from that of the third camera .

Preferably, the image information processing apparatus further includes: a storage unit for storing images photographed by the cameras of the first and second photographing units; And an image management unit for collecting images photographed by the cameras of the first photographing unit and the second photographing unit and storing the images in the storage unit for each camera, And the golf image information is automatically generated by editing an image extracted from each camera-stored image stored in the storage unit according to preset items according to an extraction interval of the determined image And an information processing unit including an image editing unit, wherein the information processing unit is configured to transmit the automatically generated golf image information to a server or the user's personal terminal.

Preferably, the information processing unit senses that the ball is moved due to the impact through the image processing of the image of the first shooting unit, and generates a trigger signal when it detects that the ball is moving due to the impact in the image Wherein the image editing unit is configured to determine an image extraction period for generating the golf image information for each camera based on a time point at which the trigger signal is generated by the trigger processing unit .

Preferably, the information processing unit receives a trigger signal transmitted from the outside when the ball is hit by the golf swing of the user, and the image editing unit detects the trigger signal transmitted from the golf video And an image extracting section for generating information is determined for each camera-specific image.

Preferably, the information processing unit senses that the ball is moved due to the impact through the image processing of the image of the first shooting unit, and generates a trigger signal when it detects that the ball is moving due to the impact in the image And a ball tracking processing unit for detecting a ball through image processing of the image of the second photographing unit and determining when the ball stops moving, And an image extracting section for generating the golf image information is determined for each camera based on a time point at which the ball determined to be stopped by the ball tracking processing section stops moving. .

According to another aspect of the present invention, there is provided a system for automatically generating golf image information according to a golf shot of a user in a golf course, the system comprising: A first photographing unit for photographing a side of the user who is shooting the golf; A second photographing unit photographing an area including the green; And a control unit for collecting images photographed respectively from the first photographing unit and the second photographing unit, determining an extracting interval of the images collected from the first photographing unit and the second photographing unit, And an image information processing apparatus for automatically generating the golf image information by editing each extracted image according to a preset item.

Preferably, the image information processing apparatus further includes: a storage unit for storing images photographed from the first image capturing unit and the second image capturing unit, respectively; And an image management unit for collecting the images photographed from the first and second photographing units and storing the images in the storage unit for each photographing unit, And the golf image information is automatically generated by editing an image extracted from each of the images of the respective shooting units stored in the storage unit according to preset items in accordance with an extraction interval of the determined image And an information processing unit including an image editing unit, wherein the information processing unit is configured to transmit the automatically generated golf image information to a server or the user's personal terminal.

Preferably, the information processing unit further includes a ball tracking processing unit for detecting a ball through image processing of the image of the second photographing unit and determining when the ball stops moving, An image extracting section for generating the golf image information on the basis of a time point at which the trigger signal is generated by the analysis or external signal input and a point at which the ball determined by the ball tracking processing section stops moving, Respectively.

 Preferably, the information processing unit further includes: a hole cup position sensing unit for recognizing the green cup or the flag of the cup from the image of the second shooting unit to sense the position of the green cup on the real time basis; And a ball tracking processing unit for tracking the position of the ball through the image processing of the image of the shooting unit, wherein the ball tracking processing unit determines the position of the ball, which is sensed by the hole cup position sensing unit, Wherein the image editing unit is configured to perform at least one of a determination of whether the ball is a hole or not and a calculation of a distance between the ball and the hole cup, Wherein the ball-tracking unit inserts the content for the ball-and-pinching process, and the distance between the ball and the hole cup If the output is characterized in that to display the distance between the calculated video information to the golf ball and the generated hole cup.

According to another embodiment of the present invention, there is provided a system for automatically generating golf image information according to a golf shot of a user in a golf course, the system comprising: A tee box photographing unit for acquiring a tee box; A fairway photographing unit installed to photograph one area on the fairway; And a control unit for collecting images photographed from the tee box photographing unit and the fairway photographing unit, determining an extraction period of the image collected from each of the tee box photographing unit and the fairway photographing unit, And an image information processing apparatus for automatically generating the golf image information by editing each image according to a preset item.

Preferably, the fairway photographing unit is configured to photograph a target area set in advance on the fairway, and the image information processing device analyzes the image collected from the fairway photographing unit, Each of the golf round users determines whether or not the ball is positioned within the target area for a golf shot, and informs the user of the determination result or transmits the result to the server.

Preferably, the image information processing apparatus analyzes the image collected from the fairway photographing unit to calculate the position of the ball in the image, thereby determining a user who recorded the longest distance among the users who round the golf, And to transmit the determined or determined result to the user or to the server so as to record the result.

According to another aspect of the present invention, there is provided a system for automatically generating golf image information according to a golf shot of a user in a golf course, the system comprising: A first photographing unit which acquires an image of the object; And at least one of a zoom-in, a zoom-out, and a view change by rotation of at least one of up and down and left and right is performed in accordance with a preset item, A second photographing unit configured to photograph the image according to the golf shots by the user; And a control unit for collecting images photographed from the first photographing unit and the second photographing unit, respectively, and editing each image extracted from the respective images collected from the first photographing unit and the second photographing unit according to preset items, And an image information processing device for automatically generating golf image information.

Preferably, the second photographing unit is zoomed-in at a predetermined first magnification so as to acquire an image of the golf shot by the user, and output the trigger signal of the image information processing apparatus or the externally input trigger signal And is configured to photograph an image by rotating at least one of up, down, left, and right so that an area including a target point is included in the photographing area, and the image information processing device is configured to photograph the image Unit and the zoom-out image based on the trigger signal in an image collected from the second photographing unit, and an image obtained by extracting the zoom-in image, the zoom-out image, And extracting the image of the region including the target point photographed by rotating at least one of the right and left sides By combining the image and being configured to automatically generate the golf video information.

According to another aspect of the present invention, there is provided a method for automatically generating golf image information in a system for automatically generating golf image information according to a golf shot of a user in a golf course, Collecting an image taken by a user for a golf shot in the shooting region and storing the captured image in a storage unit; Collecting an image to be photographed with respect to an area including a target point by a second photographing unit including at least one camera, and storing the collected image in the storage unit; Determining an extraction interval of an image collected from each of the first imaging unit and the second imaging unit; And automatically generating the golf image information by editing each image extracted according to an extraction interval of the determined image from each image stored in the storage unit according to a preset item.

Preferably, the step of determining an extraction interval of the image may include a step of detecting a movement of the ball by the impact through the image processing of the image of the first shooting unit, A step of determining a point of time when a trigger signal is received from the outside when the ball is hit by the swing; and a step of detecting an image extracting section for generating the golf image information based on a point- And a camera-specific image of each of the plurality of cameras.

Preferably, the step of determining an extraction interval of the image may include a step of detecting a movement of the ball by the impact through the image processing of the image of the first shooting unit, Determining a point of time when a trigger signal is received from the outside when the ball is hit by the swing; detecting a ball through image processing of the image of the second shooting unit and determining when the ball stopped moving; Determining an image extraction period for generating the golf image information based on a generation time point or a reception time point of the trigger signal and a time point at which the ball stops moving, for each camera image of each photographing unit .

Preferably, the method further comprises the steps of: tracking the position of the ball through image processing of the image of the second imaging unit; determining a distance between the ball and the target point using the position of the target point and the position of the tracked ball Wherein the step of automatically generating the golf image information comprises the step of displaying distance information between the calculated ball and the target point on the generated golf image information.

Preferably, the first photographing unit is configured to include a camera installed in the tee box for photographing a side of a user who is shooting a golf shot, and the step of determining an extraction region of the image may include: Recognizing at least one tee marker provided in the tee box and setting a region of interest having a predetermined size based on the recognized at least one tee marker; Generating a trigger signal by detecting a movement of a hit ball by a differential image analysis; and generating an image extracting section for generating the golf image information based on a time point at which the trigger signal is generated, And a step of determining each of the camera-specific images of the unit.

Preferably, the second photographing unit is configured to include a camera for photographing an area including a green, the method comprising the steps of: tracking the position of the ball through image processing on the image of the second photographing unit; Determining whether the golf ball is a hole-in-one or calculating a distance between the ball and the hole cup using the position of the hole cup on the golf ball and the position of the ball being tracked, Inserts a content for a hole-in-one in the generated golf image information if it is determined that the ball is a hole-in-one as a tracking result of the golf ball, The method comprising the steps of:

Also preferably, the second photographing unit is configured to include a camera for photographing an area including a green, and each of the golf shots of each user who rounds the golf is subjected to image processing on the image of the second photographing unit Determining whether the ball is closest to the golf ball of each user who rounds the golf ball using the position of the ball on the green and the position of the ball being tracked; Wherein the step of automatically generating the golf image information further comprises inserting contents for celebrating the near list into the golf image information of the golf shot of the user determined to be the closest to the ball in the hole cup .

Preferably, the second photographing unit is configured to include a camera for photographing an area including the green, and recognizes the green cup or the flag of the hole cup from the image of the second photographing unit, The method comprising the steps of: detecting a position of the ball in a real time; tracking a position of the ball through image processing of the image of the second shooting unit; Determining whether or not the golf ball is a hole-in-one, and calculating a distance between the ball and the hole cup, wherein the step of automatically generating the golf image information comprises: And displaying the result of distance calculation between the golf balls on the golf image information.

According to another aspect of the present invention, there is provided a method for automatically generating golf image information in a system for automatically generating golf image information according to a golf shot of a user in a golf course, comprising the steps of: A first shooting unit image collection and storage step of collecting an image of a golf shot taken by a user and storing the image in a storage unit; Performing at least one of zoom-in, zoom-out, and a view change by rotating at least one of up, down, left, and right by a second photographing unit installed on the other side of the specific hole and capable of performing pan / tilt- A second photographing unit image collecting and storing step of collecting images photographed by the user in accordance with the golf shots and storing the images in the storing unit; And automatically generating the golf image information by editing the first extracted image extracted from the first photographing unit and the second extracted image extracted from the second photographing unit according to a preset item.

Preferably, the second image capturing unit image capturing and storing step includes the steps of: acquiring an image of the user's golf shot in a basic state zoomed in at a first magnification preset by the second image capturing unit; Acquiring an image while the second photographing unit zooms-out at a predetermined second magnification in the basic state according to a trigger signal of the image information processing apparatus or an externally input trigger signal; A step of acquiring an image of an area including the target point by recognizing the position information of the target point, the image being rotationally driven by at least one of up, down, left, and right, And stored in the storage unit.

Preferably, the step of automatically generating the golf image information may further include the steps of: extracting an image of a predetermined section on the basis of the trigger signal from the image collected from the first photographing unit; Extracting an image including the zoom-in image, the zoom-out image, and an image of an area including the target point photographed by rotating the zoom-in image on at least one of up and down and left and right with reference to the trigger signal in the collected image; , The golf image information is automatically generated by combining the extracted images or by combining the extracted images and inserting predetermined contents into the combined image or performing predetermined image processing on each extracted image The method comprising the steps of:

Preferably, the step of automatically generating the golf image information may further include the steps of: extracting an image of a predetermined section on the basis of the trigger signal from the image collected from the first photographing unit; The zoom-in image, the zoom-out image, the image of the region including the target point photographed by rotating at least one of the upper and lower and left and right, and the region including the target point on the basis of the trigger signal in the collected image Extracting an image including a zoomed-in image at a magnification determined according to a position of the target point with respect to the image of the target point, combining the extracted images or combining the extracted images, By inserting predetermined contents into the extracted images or performing image processing in advance for each of the extracted images, In that it comprises the step of automatically generating the phase information it is characterized.

The system for automatically generating a golf image information and the method for automatically generating golf image information according to the present invention can be applied to a user who is making a round of golf beyond a simple hole- It is possible to provide the user with the image content that is memorable for the golf shot by automatically generating the golf image information by editing the image information showing a series of processes from the start to the end.

1 is a diagram illustrating an example in which a golf image information automatic generation system according to an embodiment of the present invention is installed in a specific hole of a golf course.
FIG. 2 is a block diagram illustrating a system for automatically generating a golf image information according to an embodiment of the present invention shown in FIG. 1. Referring to FIG.
3 is a flowchart illustrating a method for automatically generating golf image information used in a golf image information automatic generation system according to an embodiment of the present invention.
4 is a view for explaining a method of performing image processing on a corresponding image as an example of an image taken by a first camera of the system for automatically generating golf image information according to an embodiment of the present invention.
5 (a) to 5 (f) show images of the nth frame to the (n + 5) th frame captured by the first camera in a time-series manner,
FIGS. 6A to 6F are time-series images of the m-th frame to the (m + 5) -th frame captured by the first camera, respectively, showing the detection of a ball in each image.
FIG. 7 illustrates an example of an image captured by a third camera of the system for automatically generating a golf image information according to an exemplary embodiment of the present invention. Referring to FIG. 7, An example in which an indication of golf information is made is shown.
8 is a diagram illustrating an example of generating golf image information by extracting and editing necessary images from respective camera images by an image information processing apparatus of the system for automatically generating golf image information according to an embodiment of the present invention.
9 is a flowchart illustrating a method for automatically generating golf image information used in a golf image information automatic generation system according to another embodiment of the present invention.
FIG. 10 is a diagram illustrating an example of generating golf image information by extracting and editing necessary images in each photographing unit image by the automatic golf image information generating method according to the flowchart shown in FIG.
11 to 13 are views showing an example of the edited image described in FIG. 10 in a time-series manner.

A golf image information automatic generation system and a golf image information automatic generation method according to the present invention will be described in more detail with reference to the drawings.

First, a golf image information automatic generation system according to an embodiment of the present invention will be described with reference to FIGS. 1 and 2. FIG.

1 and 2, a golf image information automatic generation system according to an embodiment of the present invention includes a first shooting unit 100 installed on one side of one hole of a golf course and a second shooting unit 100 installed on the opposite side of the hole, The image capturing unit 200 and the first and second image capturing units 100 and 200 are connected to each other through a wired or wireless communication, And an image information processing apparatus 500 for automatically generating golf image information to be provided to a user by extracting and editing an appropriate image from the received image.

The first photographing unit 100 and the second photographing unit 200 may include only one camera or two or more cameras, respectively. When one shooting unit 100 or 200 includes two or more cameras, it is preferable that each camera shoots the same area at different positions.

The system and method for automatically generating golf image information according to the present invention are configured to include all images related to a series of processes from when a user makes a golf shot to when the ball according to the golf shot reaches and stops near a target point Since the editing is performed automatically, if the user sends a ball from the start point to the target point with one golf shot, the utilization is high.

Here, the target point may be a hole cup on the green or an arbitrary point on the fairway near the green.

The system for automatically generating golf image information according to the present invention automatically generates an image related to a series of processes from when a user makes a golf shot to when the ball corresponding to the golf shot reaches and stops near a target point, It is preferable because it is easy to apply in a case where the ball can be seated directly on the green by a golf shot in a tee box like a Par 3 hole, and a hole-in-one is possible.

1 shows an example in which the first photographing unit 100 is installed in a tee box area of a par 3 hall and the second photographing unit 200 is installed in the vicinity of a green (G).

1, the first photographing unit 100 includes a first camera 110 and a second camera 120, and the second photographing unit 200 includes a third camera 210 and a fourth camera 220 ) Is included.

The first camera 110 of the first photographing unit 100 is installed to photograph an image at an angle of view looking at the side of a user swinging the golf swing while the second camera 120 is installed to photograph a front side of a user swinging the golf swing It is preferable to be provided so as to photograph an image at an angle of view.

The second photographing unit 200 may include one camera. However, when two or more cameras such as the third camera 210 and the fourth camera 220 are installed as shown in FIG. 1, It is preferable that the image pickup unit is provided so as to photograph the region including the green G at an angle of view looking at different angles.

In Fig. 1, HC refers to a hole cup on a green (G), and FL refers to a flag pin fmf inserted in a hole cup (HC).

On the other hand, in order to generate the image content of the golf image information to be provided to the user as a more dramatic and advanced image from more various viewpoints, the third shooting units 310 and 320 are installed near the midpoint of the hole as shown in FIG. .

For example, when the hole shown in FIG. 1 is a Par 4 hole or a Par 5 hole, it is general that a golf shot in a tee box (TB) can not reach the green G immediately, Here, as shown in FIG. 1, it is possible that the third imaging units 310 and 320 perform functions similar to those of the second imaging units 210 and 220.

That is, when the system for automatically generating golf image information according to the present invention is installed in Par 4 hole or Part 5 hole, the target point may be a spot on the target area EV on the face have.

Accordingly, it can be determined from the image captured by the fifth camera 310 or the sixth camera 320 of the third photographing unit how close the user puts the golf shot in the tee box TB to the target area EV on the fairway (It is possible to determine and determine whether the ball is seated in the target area or how close to the center it is by the calculation and tracking of the ball position in the image to be described later) It is possible to analyze the photographed image of the photographing unit 3 and discriminate the photographed image, and inform the user of the result or send the result to the server so that the server can record the result.

As described above, the image of the third photographing unit is analyzed, and each of the golf rounding users performs the golf shot in the tee box in the order closest to the center of the target area EV prepared in advance in the fairway The prize determined according to the ranking may be paid according to the rank determined by the image analysis result of the third shooting unit.

As shown in FIG. 1, even if the target area (EV) is not determined, a longest game (Longest Game), which is usually performed in Par 4 hole or Par 5 hole in a golf course, (By grasping the positional information of the ball in the image) through analysis of the captured image of the third shooting unit by the winner of the game in which the user wins the longest distance on the screen.

It is possible to determine or determine whether an event is won or whether a winner of a long-time game is won through the determination of whether or not the ball is seated in the target area by analyzing the shot image of the third shooting unit, and the winner or winner The golf image information automatically generated through the image editing by the image information processing apparatus can be provided by using the shot images of each of the first shooting unit and the third shooting unit (the winner or the winner And the golf image information automatically generated by the image information processing apparatus is transmitted to the mobile terminal of the corresponding user.

Here, the tee box shooting unit and the fairway shooting unit described in claims 11 to 13 of this application are respectively the same as the first shooting unit and the third shooting unit described above.

Meanwhile, the cameras of the respective photographing units described above are connected to the image information processing apparatus 500 to communicate with each other, and images captured by the cameras are transmitted to the image information processing apparatus 500 and collected, The apparatus 500 extracts an appropriate image from each image collected from each camera, combines the extracted images, or performs image editing such as inserting a camera image of another camera into a sub-image, So as to automatically generate golf image information.

In order to automatically generate golf image information as described above, the image information processing apparatus 500 extracts an appropriate image from each image collected from each camera of each shooting unit, and determines which section of the image is appropriate to extract And the golf image information is generated by extracting and editing an appropriate image.

That is, the image information processing apparatus 500 analyzes an image collected from each camera to determine an appropriate image extraction interval, and extracts an appropriate image according to the determined extraction interval, which will be described later.

2, the image information processing apparatus 500 includes a storage unit 510 and an information processing unit 520. The information processing unit 520 includes a video management unit 521, a trigger processing unit 522, a ball tracking processing unit 523, a hole cup position sensing unit 524, and an image editing unit 525.

Here, the image management unit 521, the trigger processing unit 522, the ball tracking processing unit 523, the hole cup position sensing unit 524, and the image editing unit 525 may be implemented by hardware or software, The information processing unit 520 may divide and display the functions performed by the information processing unit 520.

The storage unit 510 stores the images collected from the respective cameras of the shooting units 100 and 200 and the image management unit 521 stores the images collected from the respective cameras of the shooting units 100 and 200 The captured images are collected and classified by each camera, and are stored in the storage unit 510 and managed.

The trigger processing unit 522 performs image processing on the images of the first camera 110 or the second camera 120 of the first shooting unit 100 stored in the storage unit 510, Detects a moving motion, and generates a trigger signal when it detects that the ball is moving due to the impact in the image.

The trigger processing unit 522 detects 'moving the ball by hitting' by using an algorithm that detects a ball in a difference image of two different frame images with respect to images of various frames, Detection of the ball becomes possible. A more detailed description thereof will be described later.

Meanwhile, the image information processing apparatus 500 of the system for automatically generating golf image information according to another embodiment of the present invention receives an externally generated trigger signal instead of a trigger processing unit for generating a trigger signal through image analysis as described above So that it can be used as a trigger signal.

That is, a golf terminal MT used in a course of golf rounds may be a terminal for inputting and managing a golf score while carrying a caddy, or a mobile terminal such as a golf assistant terminal or smart phone carried by each golfer When another user operates the golf terminal MT to transmit a shot signal to the video information processing apparatus 500 in accordance with the impact time point when a user performs a golf shot, The control unit 500 can receive the shot signal and use it as the trigger signal. Specific details will be described later.

Meanwhile, the ball tracking processing unit 523 analyzes the image captured by the camera 210 or 220 included in the second shooting unit 200 installed at a target point, that is, near the green, And generates position information of the ball to perform the function of tracking the ball.

The ball tracking processing unit 523 continuously tracks the ball near the target point, such as when the ball lands on the green, and determines when the ball stops moving.

The ball tracking processing unit 523 may continuously track the position of the ball through the image analysis to determine whether the ball is in a hole or not by using the position of the ball on the green and the position of the ball, May be calculated.

Meanwhile, the hole-cup position sensing unit 524 senses the position of the green-colored hole cup in real time by analyzing the captured image of the camera 210 or 220 included in the second photographing unit 200 installed near the green And updates the changed position information of the hole cup when the position of the hole cup is changed.

Normally, the position of the hole cup on the green is changed frequently in each hole of the golf course. Accordingly, the golf image information automatic generation system according to an embodiment of the present invention does not have the position of the hole cup on the green as fixed position information, but updates the position of the hole cup every time the system operates or at a preset cycle.

The hole-cup position sensing unit 524 can directly grasp and recognize the position of the hole-cup on the green through the preset image processing of the image collected from the camera that photographs the area including the green in the vicinity of the green, It is possible to recognize the flagpole and recognize the position of the lower end of the flagpole as the position of the hole cup.

Since the position information on the green cup on the green is maintained by the ball cup position sensing unit 524, the ball tracking processing unit 523 can accurately determine the hole-in-one, the near pin, and the distance between the ball cup and the ball .

On the other hand, the image editing unit 525 extracts images necessary for generating golf image information to be finally generated from each camera-related image managed by the image management unit 521, and combines the extracted images It is a part where image editing such as inserting a specific extracted image into another extracted image as a sub image is performed.

The image editing unit 525 determines an extraction period of an image for each camera and extracts necessary images from the respective camera images according to the determined extraction period. The trigger processing unit 522 or the external golf An extraction interval of the image is determined by using information such as a viewpoint of a trigger signal generated by the terminal, a point at which the ball is no longer detected in the image of the first camera, a point at which the ball hitting and moving stops, . Specific details will be described later.

Here, the "viewpoint" may be time information or frame information of an image. For example, the 'trigger signal generation time' may mean a time when the trigger signal is generated by the trigger processor, a corresponding image frame when the trigger signal is generated, or both.

The 'time at which the ball is no longer detected' may also refer to time information when the ball is not detected through image analysis or a corresponding image frame when the ball is not detected. May also refer to time information when there is no movement of the ball in the ball tracking process or information of the corresponding image frame.

The "extraction interval" may be a time interval or a frame interval. For example, if the time from the trigger point to the point in time when the ball is no longer detected is to extract image frames corresponding to the time interval between the time when the trigger occurred and the time when the ball was no longer detected And may mean extracting image frames corresponding to a frame interval between a corresponding image frame when a trigger occurs and a corresponding image frame when the ball is no longer detected.

Referring to FIG. 3, a method for automatically generating golf image information used in the golf image information automatic generation system according to an embodiment of the present invention will be described.

In the flowchart shown in Fig. 3, the first camera 110 (see Fig. 1) and the second camera 120 (Fig. 1) are attached to a tee box 1), which is performed by the video information processing apparatus 500 (see FIG. 1) in a case where a third camera 210 (see FIG. 1) .

Here, the first camera photographs an image at an angle of view looking at a side of a user who takes a golf swing posture (photographs an image behind the progress direction of the ball), and the second camera displays a front face of a user taking a golf swing posture Take a picture with a viewing angle of view (take a picture from the side of the direction of the ball).

When the system starts to operate, the first camera and the second camera installed near the tee box respectively start image capturing (S10), and the image managing unit 521 (see Fig. 2) The captured images are collected and stored in the storage unit 510 (see FIG. 2) (S12).

When the user hits the ball in the tee box according to the golf shot, a trigger signal is generated by the trigger processing unit 522 (see FIG. 2) or a trigger signal is received from an external golf terminal or the like (S20).

When the trigger signal is generated as described above, the third camera installed near the green starts image capturing (S22), and the image managing unit also collects the captured image from the third camera and stores the captured image in the storage unit.

Then, as the trigger signal is generated as described above, the image editing unit 525 (see FIG. 2) determines the trigger point (S24).

Meanwhile, the trigger processing unit detects a moving ball in the image by applying a difference image and a ball detection method to the captured image of the first camera stored in the storage unit (S30).

Since the photographed image of the first camera is an image photographed at an angle of view looking in the ball traveling direction from the rear side of the tee box, if the ball flees to some extent, the ball can no longer be detected in the image (S40) The editing unit determines a point at which the ball is no longer detected in the photographed image of the first camera, that is, the point at which the ball disappears from the first camera image (S42).

Alternatively, when the predetermined time has elapsed from the trigger point (S40), the image editing unit determines that the predetermined time has elapsed (S42).

If it is determined that the ball has disappeared from the image of the first camera as described above, the image management unit ends the collection of the first camera image (S44) (the first camera ends the image capture).

The ball tracking unit 523 (see FIG. 2) of the image information processing apparatus detects a ball by detecting a difference image and a ball detection method on the photographed image of the third camera that photographs the green region, (S50).

In the case where the ball does not move further after the ball tracking process is progressed by the ball tracking process unit, for example, when the ball has stopped rolling on the green (S60), the image editing unit determines a time point when the ball stops on the green (S64) .

If it is determined that the ball is stopped in the image of the third camera as described above, the image management unit ends the collection of the third camera image (S62) (the third camera ends the image capture).

At this time, since the ball tracking processing unit knows the position of the hole cup and knows the position information of the ball through image analysis, it can determine whether it is a hole-in-one using the position of the hole cup and the position information of the ball (S70).

If a hole-in-one has occurred, the video editing unit inserts the hole-in-one celebration content prepared in advance into the golf image information finally generated (S72).

If it is not a hole-in-one, the ball tracking processing unit calculates the distance between the hole cup and the ball (S80), and the image editing unit displays distance information between the calculated hole cup and the ball in the finally generated golf image information (S82 ).

On the other hand, the image editing unit uses the trigger point determined at step S24, the point at which the ball disappears from the first camera image determined at step S42, and the point at which the ball determined at step S64 is stopped on the green, Extracts each image from each camera image stored in the storage unit, edits the extracted image according to preset items, and if necessary, displays the holed-in-the-blank content in step S72 or the distance information display in step S82 Thereby finally generating golf image information (S100).

A specific example of automatic generation of golf image information according to the flowchart shown in FIG. 3 will be described with reference to FIGS. 4 to 8. FIG.

4 is a view for explaining a method of performing image processing on a corresponding image as an example of the image 101 photographed by the first camera.

It is necessary to determine the trigger point and the point of time at which the ball disappears from the image taken by the first camera. This is done by analyzing the image photographed by the first camera through a predetermined image process .

In order to facilitate the analysis through the image processing, as shown in FIG. 4, the tee markers 1 and 2 are always recognized in the tee box and the tee markers 1 and 2 are recognized in the corresponding tee marker, 1 and 2, and extracts a portion corresponding to the ROI for every shot image of the first camera, thereby extracting the extracted ROI portion Can be used.

As described above, when the ROI is set as described above, only the set ROI is extracted from all the frames of the first camera during the golf shot, can do.

5 (a) to 5 (f) show images of the nth frame to the (n + 5) th frame photographed by the first camera in a time-series manner, (Where n is an arbitrary natural number).

FIG. 5A shows an n-th frame image, FIG. 5B shows an n + 1-th frame image, FIG. 5C shows an n + 2-th frame image, e represents an n + 4th frame image and (f) represents an n + 5th frame image. In each frame image, a moving ball, as indicated by b1, b2, b3, b4, Can be detected.

Such a ball detection can be performed through a difference image and a ball detection method. For example, if a difference image between an n-th frame image and an (n + 1) -th frame image is subjected to predetermined image preprocessing such as normalization, There are only a few of them, including balls.

It is possible to detect the ball in such a manner that the size, the aspect ratio, the straightness, and the like of the ball are set in advance and the non-corresponding portions are removed from the image generated by the difference image according to the predetermined items.

For example, a head portion, a body, a leg portion, a golf club portion, and a ball portion of a user, which are moving parts through a car image, are detected. The user's head, torso, leg, The golf club portion can be easily excluded according to the vertical ratio information and can be easily excluded according to the predetermined items of the straightness because the golf club portion is forced to move to the curved orbit so that the ball is easily removed as the unnecessary portions are excluded in this manner Can be detected.

According to the above-described ball detection method, b1 to b6 denote balls detected on each frame image shown in Figs. 5 (a) to 5 (f).

The trigger processing section of the image information processing apparatus of the system according to the present invention is the trigger point when the ball is detected for the first time by the ball detection method described above.

As the ball b1 is detected in the nth frame image of the first camera image shown in Fig. 5 (a), the nth frame is determined as the trigger point, or the time when the ball is detected in the nth frame image is determined as the trigger point .

If a trigger point is determined by receiving an external trigger signal instead of the trigger processor, a trigger point (a frame at that time or a corresponding time) at which a trigger signal is generated by another user or a caddy operating the golf terminal becomes a trigger point .

The trigger point of the trigger signal generated by the image processing of the trigger processor may be different from the trigger point of the trigger signal determined by receiving the trigger signal from the outside and is determined as the trigger point when the head of the golf club is impacted by the golf swing There is no need to. Since an appropriate time is set as a trigger time point and an image corresponding to a predetermined section before and after the time point is extracted and the video is edited, appropriate golf image information can be generated even if the impact point does not become the trigger point.

6 (a) through 6 (f) show images of the mth frame to the (m + 5) th frame captured by the first camera in a time-series manner, (Where m is an arbitrary natural number and m is greater than n).

FIG. 6A shows an m-th frame image, FIG. 6B shows an m + 1-th frame image, e represents an (m + 4) th frame image and (f) represents an (m + 5) th frame image in which a moving ball is detected as indicated by B1, B2, B3, B4 and B5 in each frame image (No ball is detected in the (m + 5) th frame image in Fig. 6).

Here, the method of detecting the ball is the same as that described with reference to FIG.

After the trigger signal is generated, the trigger processing unit analyzes the image of the first camera for each frame to detect the ball. Since the ball is not detected in the (m + 5) th frame image, that is, it can be determined that the ball has disappeared in the image It is possible to determine the time when the ball disappears or the time when the ball is not detected in the image as the time when the ball disappears.

Meanwhile, FIG. 7 shows an example of an image 201 captured by the third camera, in which the display of the golf information that can be provided to the user on the green, such as a distance between the ball and the ball, Respectively.

Through the image of the third camera illustrated in FIG. 7, the ball tracking processing unit of the image information processing apparatus of the present invention detects a ball ba in the corresponding image (the ball detecting method is the same as described above) The position of the ball is tracked by calculating the position information of the ball.

Since the position information of the ball ba can be calculated for each frame, it is also possible to display the trajectory tr of the ball as shown in Fig. 7 in the finally generated golf image information.

2) of the image information processing apparatus of the present invention can directly detect a hole cup hc on a green (g) in an image 201 or a flag fl And can calculate the position of the hole cup.

Since the hall cup hc or flag fl has a distinct color from the green g, the image of the third camera is converted into the HSV image, and the hall cup or the flag can be searched through the color analysis of the converted image .

When looking for a flagpole, it is possible to judge whether the flagpole is upright or lying through the color distribution of the flagpole in the image. If the flagpole is laid, it does not sense the position of the hole cup. If the flagpole is raised, It can be specified as the position of the hole cup.

Since the ball tracking processing unit knows the position information of the ball by the in-video ball detection method and also knows the position of the hole cup detected through the hole cup position sensing unit, It is possible to determine whether the hole cup hc is held in the hole hc or not and the distance between the hole cup hc and the ball ba in the case where the ball ba stops.

As described above, the image editing unit of the image information processing apparatus of the present invention can insert and display the prepared hole-in-one-in-one-in-one-content content in the golf image information when the ball is inserted into the hole cup, Similarly, if the distance between the ball ba and the hole cup hc is calculated, the calculated distance information can be displayed on the golf image information.

7, a virtual object such as a concentric circle Ra is displayed on the basis of the detected position of the hole cup, so that the insertion of content for visually displaying how close the ball ba is to the hole cup hc It is possible.

Meanwhile, FIG. 8 shows an example of generating golf image information by extracting and editing necessary images from respective camera images by the image editing unit.

In FIG. 8, IM-1 represents an image captured by the image management unit as an image captured by the first camera and stored in the storage unit, IM-2 represents an image captured by the second camera, IM-3 represents an image captured by the third camera and collected by the image management unit and stored in the storage unit, and IM-G represents an image obtained by editing the image extracted from the respective images.

In order to extract an image necessary for generating golf image information in each of the images IM-1, IM-2 and IM-3, a trigger point (refer to step S24 in FIG. 3) (Refer to step S64 of FIG. 3) are respectively determined. Here, the trigger point is T1, the point at which the ball disappears is T2, and the point at which the ball is stopped is T3.

The trigger time point T1 needs to be determined and the time point T2 or the time point T3 at which the ball is stopped and the time point at which the ball is stopped need not necessarily be determined, (IM-1, IM-2, and IM-3) by extracting an image corresponding to a predetermined time or frame interval after the trigger point in advance It is possible.

However, considering that the golfers may have difficulty in capturing an appropriate image for the ball due to various disturbance parameters such as the distance from the ball to the ball, Determining each viewpoint through image analysis and determining an image extraction interval according to the determined viewpoint may be more advantageous for capturing an appropriate image for the ball. Hereinafter, a case where an image extracting section is determined according to each determined time will be described.

8, when a trigger point of time T1 and a point of time T2 at which the ball disappears are determined through analysis of an image of the first camera, a trigger point T1 The image corresponding to the interval S1-2 between the image corresponding to the previously set interval S1-1 and the point T2 at which the ball disappears from the trigger point T1 can be extracted.

Of course, if the time T2 at which the ball has disappeared is not determined separately, a predetermined section from the trigger point T1 can be extracted as the S1-2 section. Even if the point T2 at which the ball disappears is determined, it is not necessary to set the S1-2 section as a section from T1 to T2, and a section from the point T1 to a point slightly ahead of the point T2 or later is referred to as S1-2 It can be determined and extracted as a section.

An image extracted corresponding to the S1-1 section and the S1-2 section in the IM-1 image will be referred to as E1.

On the other hand, the image extracted from the image of the second camera can be variously determined according to what contents the golf image to be edited is composed. Since the image of the second camera is an image captured with the angle of view facing the user, the user inserts the image of the first camera into the image of the first camera or the image of the third camera, and inserts the user's facial expression in the image It may be extracting for the purpose of betting.

8, it is possible to extract the image corresponding to the preset section S2 from the trigger point T1 with respect to the image IM-2 of the second camera, and to extract the image corresponding to the section S2 from the image IM- And the extracted image of the S2 section is referred to as E2.

8, when the time T3 at which the ball stops is analyzed through the analysis of the image of the third camera, the time T2 at which the ball disappears from the image IM-3 of the third camera, (S3) up to a time point (T3) when the ball is stopped can be extracted.

Of course, if the time point T3 at which the ball is stopped is not separately determined, a predetermined section from the trigger point T1 or a point T2 at which the ball has disappeared can be extracted as the S3 section.

The extracted image of the S3 section from the image IM-3 of the third camera will be referred to as E3.

When images of E1, E2 and E3 are respectively extracted from the first camera image IM-1, the second camera image IM-2 and the third camera image IM-3 as described above, (IM-G).

That is, as shown in FIG. 8, the image editing can be performed by combining the E1 image and the E3 image and inserting the E2 image into the combined image as a sub-image.

In the case of a sub-image, a specific portion such as a user's upper body portion or a face portion alone may be extracted from the original image, or an enlarged image for the user may be used.

The system for automatically generating golf image information according to an embodiment of the present invention may be configured to display a trajectory (tr) of a ball as described with reference to FIG. 7, a concentric circle (Ra) on a green image on an image obtained by editing the E1, E2, Display, the distance between the hole and the ball, the display of the congratulation content for the hole-in-one, etc., or 'Nice Shot!', 'Nearest Winner!' And so on, so that the final golf image information can be automatically generated.

When the creation of the golf image information is completed, the image information processing apparatus 500 (see FIG. 1) may transmit the created golf image information to an operation server of the golf course or a separate server, The user can access the server using the PC or the mobile terminal and receive the golf image information about his / her memorial golf shot by downloading the golf image information.

3 to 8 illustrate a case where a first camera and a second camera are installed in a tee box, a third camera is installed in a green area, and images are collected from the third camera to generate golf image information , The system and method for automatically generating golf image information according to the present invention is not limited to such a case, and can be implemented in various ways as long as two or more cameras are used.

For example, when the first camera is installed in the tee box and only the third camera is installed in the green area, the image IM-2 of the second camera and the portion related to the image E2 extracted therefrom are excluded, And the golf image information can be generated using the image and the E3 image.

For example, when the first camera and the second camera are installed in the tee box and the third camera and the fourth camera are installed in the green area (see Fig. 1), T1, T2 and T3 And extracting the image according to the determined interval and inserting the extracted image as a sub-image on the edited image or combining the extracted image with the E3 image (the fourth camera Since the image is photographed in a green region different from the third camera, it is possible to extract the images from the third camera image and the fourth camera image into appropriate sections and combine them. It is also possible to embed the image as a sub-image on the E3 image so that the image is enlarged and photographed).

For example, when a third photographing unit (fifth camera and sixth camera, see Fig. 1) is provided between the tee box and the green, an image is extracted from the images of the third photographing unit in an appropriate section, The image editing can be performed by appropriately combining or inserting between the image and the E3 image.

9 to 13, a system for automatically generating a golf image information according to another embodiment of the present invention and a method for automatically generating golf image information used in the system will be described.

The system for automatically generating golf image information according to another embodiment of the present invention includes a first shooting unit installed at one side of a specific hole of a golf course, a second shooting unit installed at the other side, And an image information processing device connected to the image processing device. In the present embodiment, the configuration and the function of the image information processing apparatus described above can be practically the same.

Here, the first photographing unit may be implemented by the first camera shown in FIG. 1 or may be implemented by the second camera. The first photographing unit is not necessarily installed in the tee box, .

The second photographing unit may be implemented by the third camera shown in FIG. 1 or may be implemented by the fourth camera, and may not necessarily be installed in the vicinity of the green, and may be installed at some distance from the green .

Hereinafter, the first shooting unit refers to a camera device installed in the vicinity of a golf shot by a user, and the second shooting unit refers to a camera device installed around a target point (e.g., a green hole cup) do.

9 is a flowchart illustrating a method for automatically generating golf image information used in a golf image information automatic generation system according to another embodiment of the present invention.

The second photographing unit of the automatic golf image information generating system according to the present invention to which the method of automatically generating golf image information according to the flowchart shown in FIG. 9 is applied is a PTZ camera capable of performing a pan-tilt-zoom Device.

The pan function of the PTZ camera is a function of rotating the camera left and right, the tilt function is a function of rotating the camera up and down, and the zooming function is a function of enlarging or reducing the image.

When the system starts to operate, the first shooting unit starts shooting the image of the golf shot by the user, and the second shooting unit starts shooting the image (S210). At this time, the second photographing unit looks at a position where the user makes a golf shot in a state where the user is installed at a distance (for example, around the green) at a certain distance from a position (for example, a tee box) (Hereinafter, the user of the second photographing unit looks at the position where the golf shot is made and zooms in at a predetermined first magnification) 'Basic state' ').

The image management unit 521 (see FIG. 2) collects images photographed from the first and second photographing units and stores them in the storage unit 510 (see FIG. 2) (S220).

When the user hits the ball in the tee box according to the golf shot, a trigger signal is generated by the trigger processor 522 (see FIG. 2) or a trigger signal is received from an external golf terminal or the like (S230). When the trigger signal is generated, the image editing unit 525 (see FIG. 2) determines the trigger point (S232).

In addition, when the trigger signal is generated as described above, the second photographing unit performs photographing in the basic state and transmits the photographed image to the image information processing apparatus while gradually zooming-out to a second magnification preset ( S310).

As described above, when the second photographing unit gradually zooms-out and reaches the preset second magnification (which may be a basic magnification or a higher magnification), zoom-out is completed (S320).

After the zoom-out is completed, the second photographing unit performs pan-tilting, that is, it rotates left and right as it rotates up and down, or rotates up and down and right and left to photograph a predetermined area including the target point. That is, the second photographing unit is driven to perform pan-tilting of the second photographing unit so that the view can be made so that the green including the hole cup is included in the photographing range of the second photographing unit.

Here, the above-described pan-tilting may be performed by rotating the second photographing unit from the beginning to a predetermined up-and-down and / or left-right angle, and the image information processing apparatus analyzes the image transmitted from the second photographing unit, Tilting may be performed by transmitting the up and / or down and / or left / right angle information to be rotated to the second shooting unit, and the second shooting unit itself may include an image analysis unit, It is also possible to calculate the rotation angle information based on the position of the hole cup and perform the pan-tilting according to the calculated rotation angle information.

After the pan-tilting of the second photographing unit is performed as described above, the second photographing unit captures an image of green and transmits the photographed image to the image information processing apparatus (S340).

On the other hand, in the case where the first shooting unit is a video shot at an angle of view looking in the ball proceeding direction from the rear side of the tee box, if the ball is blown away to some extent by the blow, the ball can no longer be detected in the video, At this time, the image editing unit can determine a point at which the ball is no longer detected in the photographed image of the first photographing unit, that is, the point at which the ball disappears from the first photographing unit image.

When the golf image information is generated, the future image editing unit may determine an extraction period of the image to be extracted from the image of the first shooting unit on the basis of the disappearance time of the ball. Alternatively, It is possible to extract an image up to the elapsed time from the image of the first photographing unit when a predetermined time elapses from the trigger point. In Fig. 9, the latter is shown.

That is, the image information processing apparatus determines whether a predetermined time has elapsed after the trigger signal has been generated (S400), and ends the collection of the photographed image of the first photographing unit when the predetermined time elapses (S410) 1 photographing unit also ends photographing).

The ball tracking processing unit 523 (see FIG. 2) of the image information processing apparatus detects a ball by applying a difference image, a ball detection method, or the like to the photographed image of the second image capturing unit that photographs the green region, (S420).

In the case where the ball does not move any more when ball tracking is advanced by the ball tracking processing unit, for example, when the ball is stopped on the green (S500), the image editing unit determines a time point when the ball stops on the green (S502) .

If it is determined that the ball is stopped in the image of the second shooting unit as described above, the image management unit finishes the collection of the second shooting unit shooting image (S350) (the second shooting unit ends shooting also). At this time, the second photographing unit returns to the basic state by zoom-in and pan-tilting (S360).

Since the ball tracking unit knows the position of the hole cup and knows the position information of the ball through image analysis, the ball tracking processing unit can determine whether it is a hole-in-one using the position of the hole cup and the position information of the ball (S520).

If a hole-in-one occurs, the video editing unit inserts the hole-in-one-celebration content prepared in advance into the golf image information finally generated (S521).

If it is not a hole-in-one, the ball tracking processing unit calculates the distance between the hole cup and the ball (S540), and the image editing unit displays distance information between the calculated hole cup and the ball in the finally generated golf image information (S550 ).

On the other hand, the image editing unit extracts images from the shooting unit images stored in the storage unit on the basis of the determined time points, using the trigger time determined in step S232 and the time point when the ball determined in step S502 is stopped on the green (Step S600), and if necessary, generates the golf image information by inserting the hole-in-one congratulatory content of step S521 or the distance information display of step S550, if necessary, .

A specific example of automatic generation of golf image information according to the flowchart shown in FIG. 3 will be described with reference to FIGS. 10 to 13. FIG.

FIG. 10 is a diagram illustrating an example of generating golf image information by extracting and editing necessary images in each photographing unit image by the automatic golf image information generating method according to the flowchart shown in FIG.

In FIG. 10, IM-A represents an image captured by the image management unit and stored in the storage unit as a captured image of the first image capturing unit, IM-B is collected by the image managing unit as a captured image of the second image capturing unit, IM-G represents an image in which the image extracted from each image is edited.

In order to extract an image necessary for generating golf image information in each of the images IM-A and IM-B, a trigger point (refer to step S232 of FIG. 3) and a point of time when the ball is stopped (refer to step S502 of FIG. 3) Respectively, and the point at which the ball described in Fig. 3 disappears may be determined depending on the case.

Here, the trigger time point is T1, the time point of the ball disappearing or the time point of the predetermined interval from the trigger time point is T2, and the time point when the ball is stopped is T3, and the matters concerning T1, T2 and T3 are as described in FIG. 8 .

As shown in Fig. 10, in the image IM-A of the first photographing unit, the image corresponding to the preset section R1-1 before the trigger point T1 and the image corresponding to the point of time from the trigger point of time T1 to the point of T2 An image corresponding to the section R1-2 can be extracted.

The image extracted corresponding to the R1-1 section and the R1-2 section in the IM-A image will be referred to as ER1.

10, when the time T3 at which the ball stops is analyzed through the analysis of the image of the second shooting unit, the trigger point T1 is detected in the image IM-B of the second shooting unit, (R2) from the time point when the ball is stopped to the time point T3 when the ball is stopped can be extracted.

Of course, if the time point T3 at which the ball is stopped is not determined separately, a predetermined section from the trigger point T1 can be extracted as the R2 section.

9, the image IM-B of the second photographing unit represents a zoom-in image for the te box area in the basic state (Sa), and the image IM-B of the second photographing unit starts from the trigger point T1 (Sb) indicating a zoom-out image (which may be a previous or a previously set time), indicating a view (a green area including a hole cup) changed by pan-tilting when the zoom-out is completed (Sc) (Sd) such as maintaining the same view or enlarging the view more.

The matters relating to the ball tracking in S420 and the subsequent steps of FIG. 9 can be processed by analyzing using the Sd image.

The extracted image of the R2 section from the image IM-B of the second photographing unit is referred to as ER2. Preferably, the ER2 image includes the zoom-in image Sa, the zoom-out image Sb, By including both the view Sc changed by the pan-tilting and the image Sd which is maintained or enlarged after that, golf image information according to the user's golf shot can be displayed more dramatically in the finally edited image have.

As described above, if images of ER1 and ER2 are respectively extracted from the first imaging unit IM-A and the second imaging unit IM-B, an edited IM-G can be created using the images of ER1 and ER2 .

The insertion and display of predetermined content and the like in the edit image IM-G are the same as those described above with reference to FIG. 8, so a detailed description thereof will be omitted.

When the creation of the golf image information is completed, the image information processing apparatus can transmit the created golf image information to the operation server of the golf course or a separate server so as to be stored and managed in the server. The user can access the server and download the golf image information to receive golf image information about his / her memorial golf shot.

In FIG. 11, an example of an edited image of the ER1 image and the ER2 image described in FIG. 10 is shown in a time-series manner.

11A and 11B show an example of the ER1 image extracted from the first shooting unit and a scene in which a user is making a golf shot in the te box area in the image.

11C shows an example of the ER2 image extracted from the second photographing unit and shows a state in which the t-box (tb) region is photographed as a zoom-in image.

11 (d) shows a state in which the t-box tb area in the image is distanced by zoom-out. Fig. 11 (e) shows a state in which the second photographing unit is pan- 11 (f) shows a state in which the camera view is changed by pan-tilting (in the image of FIG. 11 (f)), It is preferable that the second photographing unit is pan-tilted so as to have a view including a green (g) region including a hole cup (hc) / flag (fl) position).

In the image after (f) of FIG. 11, a ball appears on the green (the user looks at the green by pan-tilting the zooming-out of the second shooting unit before the hit ball reaches the green 12 (a) and 12 (b) show that the second shooting unit is panning-tilted to shoot an image in a state in which the view is changed, and in the state shown in FIG. 12 (a) And the image from the appearance of the ball ba on the green g to the stop of its movement is included in the golf image information as shown in Fig. 12 (b).

13 (a) to 13 (d), the second photographing unit can be connected to the pan-tilting camera in FIG. 13 (a) The enlarged image is displayed at a preset magnification. 13 (b), 13 (c) and 13 (d) show the case where the view of the second photographing unit is changed by the pan-tilting, It shows the image until the ball ba appears and stops in the magnified state at the set magnification.

13 (b) to 13 (d) may be an image photographed by the second image capturing unit zoom-in, or the image information processing apparatus may be set to a preset image for the image received from the second image capturing unit It may be a magnified-edited image at a magnification.

As described above, the system for automatically generating golf image information and the method for automatically generating golf image information according to the present invention collects and analyzes images photographed in respective areas in a specific hole of a golf course, And editing the extracted images, the user can be informed about the golf round by using the image information showing a series of processes from the golf shot to the motion on the area including the target point of the golf shot ball, Information can be automatically generated and provided to the user, and since such golf image information can be automatically generated with a dramatic configuration, there is a merit that can be a very valuable souvenir to a golfing user.

100: first photographing unit, 110: first camera
120: second camera, 200: second photographing unit
210: third camera, 220: fourth camera
500: Image information processing apparatus, 510: Storage section
520: information processing unit, 521:
522: Trigger processing section, 523: Ball tracking processing section
524: hole cup position sensing unit, 525: image editing unit

Claims (27)

A system for automatically generating golf image information according to a golf shot of a user in a golf course,
A first photographing unit that acquires an image of a user's golf shot in the photographing area;
A second photographing unit photographing an area including a target point; And
Wherein the control unit collects images photographed from the first photographing unit and the second photographing unit, determines an extraction period of the image collected from each of the first photographing unit and the second photographing unit, An image information processing device for automatically generating the golf image information by editing each image according to a preset item;
The golf image information generating system comprising: The method according to claim 1,
Wherein the first photographing unit comprises:
A first camera for photographing a side of a golf swinging user, and a second camera for photographing a front side of the golf swinging user,
Wherein the second photographing unit comprises:
A third camera for photographing an area including a target point, and a fourth camera for photographing an area including the target point at a different time from the third camera. Automatic generation system. 3. The image information processing apparatus according to claim 2,
A storage unit for storing images photographed by respective cameras of the first photographing unit and the second photographing unit; And
An image management unit for collecting images photographed by the cameras of the first and second photographing units and storing the captured images in the storage unit for each camera; And an image for automatically generating the golf image information by editing an image extracted from each camera image stored in the storage unit according to a preset item in accordance with an extraction interval of the determined image, And an information processing unit including an editing unit,
Wherein the information processing unit is configured to transmit the automatically generated golf image information to the server or the user's personal terminal. The information processing apparatus according to claim 3,
Further comprising a trigger processor for detecting a movement of the ball by the blow through the image processing of the image of the first shooting unit and generating a trigger signal when the ball senses that the ball is moving due to the blow,
Wherein the image editing unit is configured to determine an image extraction period for generating the golf image information for each camera based on a time point at which the trigger signal is generated by the trigger processing unit, Generating system. The information processing apparatus according to claim 3,
Wherein the image editing unit receives a trigger signal transmitted from the outside when the ball is hit by the user's golf swing, and the image editing unit includes an image extracting section for generating the golf image information based on the trigger signal reception time point from the outside, Wherein the determination unit is configured to determine each of the images for each camera. The information processing apparatus according to claim 3,
A trigger processor for detecting a movement of the ball by a blow through the image processing of the image of the first photographing unit and generating a trigger signal when the ball senses that the ball is moved by the blow,
Further comprising a ball tracking processing unit for detecting a ball through image processing of the image of the second photographing unit and determining when the ball stopped moving,
Wherein the image editing unit includes an image extracting section for generating the golf image information on the basis of a time point at which the trigger signal is generated by the trigger processing unit and a time point at which the ball determined by the ball tracking processing unit stops moving, The golf image information generation system comprising: A system for automatically generating golf image information according to a golf shot of a user in a golf course,
A first photographing unit installed in the tee box for acquiring an image of a user golfing in the photographing area and photographing a side of the user who is shooting the golf;
A second photographing unit photographing an area including the green; And
Wherein the control unit collects images photographed from the first photographing unit and the second photographing unit, determines an extraction period of the image collected from each of the first photographing unit and the second photographing unit, An image information processing device for automatically generating the golf image information by editing each image according to a preset item;
The golf image information generating system comprising: 8. The image information processing apparatus according to claim 7,
A storage unit for storing images photographed by the first and second photographing units, respectively; And
An image management unit for collecting images photographed from the first and second photographing units and storing the images in the storage unit and managing the divided images for each photographing unit; A video image for automatically generating the golf image information by editing an image extracted from each of the images of the respective shooting units stored in the storage unit according to a preset item in accordance with an extraction interval of the determined image, And an information processing unit including an editing unit,
Wherein the information processing unit is configured to transmit the automatically generated golf image information to the server or the user's personal terminal. The information processing apparatus according to claim 8,
Further comprising a ball tracking processing unit for detecting a ball through image processing of the image of the second photographing unit and determining when the ball stopped moving,
Wherein the image editing unit includes an image extraction section for generating the golf image information based on a time point at which a trigger signal is generated by an image analysis or an external signal input and a point at which a ball determined by the ball tracking processing unit stops moving, Wherein the determination unit is configured to determine each of the images for each shooting unit. The information processing apparatus according to claim 8,
A hole cup position sensing unit for recognizing the green cup or the flag of the cup from the image of the second shooting unit to sense the position of the green cup on the real time basis,
And a ball tracking processing unit for tracking the position of the ball through image processing on the image of the second photographing unit,
The ball tracking apparatus according to claim 1,
Wherein the controller is configured to perform at least one of a determination of a hole-in-one using the position of the hole cup sensed by the hole cup position sensing unit and a position of the ball being tracked, and a distance between the ball and the hole cup,
Wherein the image editing unit comprises:
When the ball tracking processing unit determines that the golf ball is a hole-in-one, inserts content for a hole-in-one in the generated golf image information, and when the distance between the ball and the hole cup is calculated by the ball tracking unit, And the distance between the calculated ball and the hole cup is displayed in the information. A system for automatically generating golf image information according to a golf shot of a user in a golf course,
A tee box photographing unit installed in the tee box to acquire an image of a user's golf shot in the photographing area;
A fairway photographing unit installed to photograph one area on the fairway; And
An image pickup section for picking up images taken from the t-box photographing unit and the fairway photographing unit, an extracting section for extracting images collected from the t-box photographing unit and the fairway photographing unit, An image information processing device for automatically generating the golf image information by editing an image according to preset items;
The golf image information generating system comprising: 12. The method of claim 11,
The fairway photographing unit includes:
And to photograph a target area set in advance on the fairway,
The image information processing apparatus includes:
And calculating a position of the ball in the image by analyzing the image collected from the fairway photographing unit, so that each of the users who rounds the golf ball determines whether the ball is seated in the target area for a golf shot, And the user is notified or transmitted to the server for recording. The image information processing apparatus according to claim 11,
The image collected from the fairway photographing unit is analyzed to calculate the position of the ball in the image. Thus, the user who has recorded the longest distance among the golf rounding users is determined, or the ranking is determined for the users based on the distance Wherein the user is informed of the determined or determined result or transmitted to the server and recorded. A system for automatically generating golf image information according to a golf shot of a user in a golf course,
A first photographing unit installed on one side of a specific hole of a golf course to acquire an image of a golf shot by the user in the photographing area;
And at least one of a zoom-in, a zoom-out, and a view change by rotation of at least one of up and down and left and right is performed in accordance with a preset item, A second photographing unit configured to photograph the image according to the golf shots by the user; And
Wherein each of the images captured from the first shooting unit and the second shooting unit is collected, and each image extracted from each of the images collected from the first shooting unit and the second shooting unit is edited according to a preset item, An image information processing device for automatically generating image information;
The golf image information generating system comprising: 15. The method of claim 14,
Wherein the second photographing unit comprises:
Zooming in at a predetermined first magnification so as to obtain an image of the golf shot by the user and zooming out at a preset second magnification according to a trigger signal of the image information processing apparatus or an externally inputted trigger signal, And to photograph the image by rotating at least one of up and down and left and right so that an area including the target point is included in the photographing area,
The image information processing apparatus includes:
A zoom-in image, a zoom-in image, and a zoom-in image based on the trigger signal in an image collected from the second photographing unit, Wherein the golf image information generating unit is configured to automatically generate the golf image information by combining the extracted image so as to include the image of the region including the target point rotated by at least one of the out- . A method of automatically generating golf image information of a system for automatically generating golf image information according to a golf shot of a user in a golf course,
Collecting, by a first photographing unit including at least one camera, an image photographed by the user about a golf shot in the photographing area and storing the captured image in a storage unit;
Collecting an image to be photographed with respect to an area including a target point by a second photographing unit including at least one camera, and storing the collected image in the storage unit;
Determining an extraction interval of an image collected from each of the first imaging unit and the second imaging unit; And
Automatically generating the golf image information by editing each image extracted according to an extraction interval of the determined image from each image stored in the storage unit according to a preset item;
And automatically generating the golf image information. 17. The method of claim 16, wherein the step of determining an extraction interval of the image comprises:
When a trigger signal is generated as the ball senses the ball being moved by the image processing through the image processing of the first shooting unit or when the ball is hit by the user's golf swing, Determining,
Determining an image extraction period for generating the golf image information based on a time point at which the trigger signal is generated or a time point at which the trigger signal is generated based on a camera-by-camera image of each photographing unit, Generation method. 17. The method of claim 16, wherein the step of determining an extraction interval of the image comprises:
When a trigger signal is generated as the ball senses the ball being moved by the image processing through the image processing of the first shooting unit or when the ball is hit by the user's golf swing, Determining,
Detecting a ball through image processing on the image of the second shooting unit and determining when the ball stopped moving;
Determining an image extraction period for generating the golf image information based on a generation time point or a reception time point of the trigger signal and a time point at which the ball stops moving, for each camera image of each photographing unit A method for automatically generating golf image information. 17. The method of claim 16,
Tracking the position of the ball through image processing of the image of the second photographing unit;
Further comprising calculating a distance between the ball and the target point using the position of the target point and the position of the tracked ball,
Wherein the step of automatically generating the golf image information comprises:
And displaying distance information between the calculated ball and the target point on the generated golf image information. 17. The method of claim 16,
Wherein the first shooting unit is configured to include a camera installed in a tee box and photographing a side of a golf shot user,
Wherein the step of determining an extraction interval of the image comprises:
Recognizing at least one tee marker installed in the tee box in an image of the first photographing unit and setting a region of interest having a predetermined size based on the recognized at least one tee marker;
Generating a trigger signal by extracting an image corresponding to the set region of interest from an image of a plurality of frames and sensing that the hit ball is moved by the differential image analysis;
And determining an image extraction period for generating the golf image information based on a time point at which the trigger signal is generated, for each camera-specific image of each shooting unit. 17. The method of claim 16,
The second photographing unit is configured to include a camera for photographing an area including a green,
Tracking the position of the ball through image processing of the image of the second photographing unit;
Determining whether the ball is a hole-in-one or calculating a distance between the ball and the hole cup using the position of the green cup and the position of the ball being tracked,
Wherein the step of automatically generating the golf image information comprises:
If the result of the tracking of the ball position is determined to be a hole-in-one, the content for a hole-in-one is inserted into the generated golf image information. If the result of the tracking of the ball position is not a hole- The method comprising the steps of: (a) displaying a distance between the golf course and the golf course; 17. The method of claim 16,
The second photographing unit is configured to include a camera for photographing an area including a green,
Tracking the position of the ball through image processing on the image of the second shooting unit for each golf shot of each user who rounds the golf,
Determining whether the ball is closest to the hole of the golf ball of each user who rounds the golf ball using the position of the green cup and the position of the ball being tracked;
Wherein the step of automatically generating the golf image information comprises:
Further comprising the step of inserting content for celebrating the near list into the golf image information of the golf shot of the user determined to be the closest to the ball in the hole cup. 17. The method of claim 16,
The second photographing unit is configured to include a camera for photographing an area including a green,
Recognizing the green cup or the flag of the cup from the image of the second shooting unit to detect the position of the green cup on the real time;
Tracking the position of the ball through image processing of the image of the second photographing unit;
Further comprising performing at least one of a determination of whether the ball is a hole-in-one using the position of the hole cup determined by the real-time sensing and a position of the ball being tracked, and a distance between the ball and the hole cup,
Wherein the step of automatically generating the golf image information comprises:
Further comprising the step of determining whether the golf ball is a hole-in-one, or displaying a result of distance calculation between the ball and the hole cup on the golf image information. A method of automatically generating golf image information of a system for automatically generating golf image information according to a golf shot of a user in a golf course,
A first photographing unit image collecting and storing step of collecting images of golf shots taken by a first photographing unit installed at one side of a specific hole of a golf course and storing the images in a storage unit;
Performing at least one of zoom-in, zoom-out, and a view change by rotating at least one of up, down, left, and right by a second photographing unit installed on the other side of the specific hole and capable of performing pan / tilt- A second photographing unit image collecting and storing step of collecting images photographed by the user in accordance with the golf shots and storing the images in the storing unit; And
Automatically generating the golf image information by editing a first extracted image extracted from the first photographing unit and a second extracted image extracted from the second photographing unit according to a preset item;
And automatically generating the golf image information. 25. The method of claim 24, wherein the second capturing unit image capturing and storing step comprises:
A step of acquiring an image of the golf shot by the user in a basic state zoomed in at a first magnification preset by the second photographing unit;
Acquiring an image while the second photographing unit zooms-out at a predetermined second magnification in the basic state according to a trigger signal of the image information processing apparatus or an externally input trigger signal;
The second photographing unit rotating and driving at least one of up, down, left, and right, recognizing position information of the target point and acquiring an image of an area including the target point,
And a step in which the acquired image of each of the golfers is collected by the image information processing apparatus and stored in the storage unit. The method of claim 25, wherein automatically generating the golf image information comprises:
Extracting an image of a predetermined section based on the trigger signal in an image collected from the first photographing unit,
The zoom-in image, the zoom-out image, and the image of the region including the target point photographed by rotating at least one of up, down, left, and right, based on the trigger signal in the image collected from the second photographing unit Extracting an image,
Generating the golf image information automatically by combining the extracted images or by combining the extracted images and inserting predetermined contents into the combined image or performing predetermined image processing on each extracted image And automatically generating the golf image information. The method of claim 25, wherein automatically generating the golf image information comprises:
Extracting an image of a predetermined section based on the trigger signal in an image collected from the first photographing unit,
A zoom-in image, a zoom-out image, an image of an area including the target point photographed by rotating at least one of the up, down, left, and right directions on the basis of the trigger signal in an image collected from the second photographing unit, Extracting an image to include a zoomed-in image at a magnification determined according to the position of the target point with respect to the image of the area including the target point,
Generating the golf image information automatically by combining the extracted images or by combining the extracted images and inserting predetermined contents into the combined image or performing predetermined image processing on each extracted image And automatically generating the golf image information.

Images