WO2017078435A1 - Système et procédé de génération automatique d'informations d'images de golf - Google Patents

Système et procédé de génération automatique d'informations d'images de golf Download PDF

Info

Publication number
WO2017078435A1
WO2017078435A1 PCT/KR2016/012606 KR2016012606W WO2017078435A1 WO 2017078435 A1 WO2017078435 A1 WO 2017078435A1 KR 2016012606 W KR2016012606 W KR 2016012606W WO 2017078435 A1 WO2017078435 A1 WO 2017078435A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
golf
ball
unit
image information
Prior art date
Application number
PCT/KR2016/012606
Other languages
English (en)
Korean (ko)
Inventor
주상현
Original Assignee
주식회사 골프존
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주식회사 골프존 filed Critical 주식회사 골프존
Priority to JP2018517854A priority Critical patent/JP6596746B2/ja
Priority to CN201680063726.7A priority patent/CN108293151B/zh
Publication of WO2017078435A1 publication Critical patent/WO2017078435A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/8549—Creating video summaries, e.g. movie trailer

Definitions

  • the present invention relates to a system for automatically generating golf image information and a method for automatically generating golf image information. More specifically, a user who plays a golf round at a golf course takes a golf shot and a shot of a hit ball flying to the target point. It is about the system and the processes driven by it that effectively record and edit the process of the video to provide the user with compelling content for golf rounds.
  • golf shots may be properly seated on the green, the ball may be very close to the hole cup on the green, or sometimes you may experience amazing records such as hole-in-one or albatross.
  • the present invention provides video information that shows a series of processes from golf shots to movements in the area including the target point of the golf shot ball for users who are playing golf beyond simple hole-in-one identification or near-pin certification.
  • Automatic golf video information generation system that automatically generates golf video information to provide users with video content that can be commemorated for golf shots.
  • a system for automatically generating golf image information includes: a first photographing unit for acquiring an image of a golf shot by a user in a photographing area; a second photographing unit for photographing an area including a target point; and the first photographing unit Collecting images taken from the unit and the second photographing unit, and determining an extraction section of the images collected from the first and second photographing units, and extracting each image extracted according to the extraction section of the determined image. And an image information processing device for automatically generating the golf image information by editing according to a preset item.
  • a system for automatically generating golf image information according to a user's golf shot at a golf course is installed in a tee box for the user's golf shot within a shooting area.
  • a first photographing unit for acquiring an image and photographing a side of the user who takes the golf shot; a second photographing unit for photographing an area including a green; and an image photographed from the first photographing unit and a second photographing unit, respectively;
  • the golf image information is collected by determining the extraction interval of the image collected from each of the first and second imaging units, and editing each extracted image according to the preset section according to the extraction interval of the determined image.
  • an image information processing device that generates automatically.
  • a system for automatically generating golf image information according to a user's golf shot at a golf course is installed in a tee box to allow a user to golf shot within a shooting area.
  • a tee box photographing unit for acquiring an image;
  • a fairway photographing unit installed to photograph a region on the fairway; and collecting images taken from the tee box photographing unit and the fairway photographing unit, and extracting sections of the images collected from the tee box photographing unit and the fairway photographing unit, respectively. And extracts each extracted image according to the extracted section of the determined image.
  • a system for automatically generating golf image information according to a golf shot of a user at a golf course is installed at one side of a specific hole of a golf course, where the user can play golf in a shooting area.
  • 1 1 shooting unit for acquiring images of the shot; installed on the other side of the specific hole, pan-tilt-zoom operation, zoom-in, zoom-out, up, down, left and right
  • a second photographing unit configured to perform at least one change of view by one rotation, to record an image according to the golf shot by the user; and to collect images photographed from the first photographing unit and the second photographing unit, respectively;
  • an image information processing apparatus for automatically generating the golf image information by editing each image extracted from each image collected from the first photographing unit and the second photographing unit according to a preset matter.
  • a method for automatically generating golf image information of a system that automatically generates golf image information includes collecting images captured by a user for golf shot in the shooting area by a first shooting unit including at least one camera. Storing the image captured by the second photographing unit including at least one camera in an area including a target point and storing the image captured in the storage unit; Determining an extraction section of the image captured from each of the first photographing unit and the second photographing unit; and editing each image extracted according to the extraction section of the determined image from each image stored in the storage unit according to a preset matter. Thereby automatically generating the golf video information.
  • a method for automatically generating golf image information of a system that automatically generates golf image information according to a golf shot of a user at a golf course includes: a first method installed on one side of a specific hole of a golf course; Collecting and storing a first photographing unit image which collects and stores an image of a golf shot by a user photographed by the photographing unit in a storage unit; a second photographing unit installed at the other side of the specific hole and capable of pan-tilt-zoom driving; A system that collects and stores images captured by the user as a golf shot by performing at least one of zoom-in, zoom-out, and view change by rotation of at least one of up, down, left and right by the unit. 2 collecting unit image collection and storage step; and the first extracted image extracted from the first recording unit and the second extracted image extracted from the second recording unit according to the preset
  • the automatic generation method simply checks the hole number or goes beyond the near pin authentication. It can be a memorial to golf shots by automatically generating golf video information by editing the video information that shows the sequence of the process from the golf shot to the movement including the target point of the golf shot ball. It has the effect of providing enough video content.
  • FIG. 1 is a diagram illustrating an example in which a golf image information automatic generation system according to an embodiment of the present invention is installed in a specific hole of a golf course.
  • FIG. 2 is an automatic generation of golf image information according to an embodiment of the present invention shown in FIG.
  • FIG. 3 is a flowchart illustrating a method for automatically generating golf image information used in an automatic golf image information generation system according to an embodiment of the present invention.
  • FIG. 4 is a view illustrating a system for automatically generating golf image information according to an embodiment of the present invention.
  • An example of the images taken by the camera is to explain how to process the images in the images.
  • a time series representation of an image of a frame showing the detection of a ball within each image.
  • 6A to 6F show images of m-th frame to m + 5th frames taken by the first camera in time series, and the detection of the ball in each image. .
  • FIG. 7 is a third embodiment of an automatic golf image information generation system according to an embodiment of the present invention.
  • An example of an image taken by the camera is an example of how the distance between the hole cup and the ball is indicated for the golf information that may be provided to the user on the green.
  • Figure 8 with one embodiment of the invention eunbon "each by a golf video information according to the image information processing system for the automatic generation system to extract the necessary image on the camera image
  • Fig. 1 shows an example of generating golf image information by editing.
  • FIG. 9 illustrates a system for automatically generating golf image information according to another embodiment of the present invention.
  • FIG. 10 extracts and edits a necessary image from each photographing unit image by the method of automatically generating golf image information according to the flowchart shown in FIG.
  • Fig. 1 shows an example of generating golf video information.
  • 1 to 13 are diagrams illustrating one example of the edited video described with reference to FIG. 10 in time series.
  • the automatic generation system includes a first photographing unit 100 installed on one side of a hole of a golf course, a second photographing unit 200 installed on an opposite side of the hole, and the first photographing unit 100 and a second photographing unit 200 Communication with wired or wireless
  • An image information processing apparatus 500 for receiving an image taken from a photographing unit, performing image analysis, and automatically generating golf image information to be provided to a user by extracting and editing an appropriate image from the received image. Can be configured.
  • the first photographing unit 100 and the second photographing unit 200 each have only one camera.
  • each camera may contain more than one camera. If one shooting unit (100 or 200) contains more than one camera, it is preferable that each camera is configured to shoot the same area in different positions.
  • the system and method for automatically generating golf image information according to the present invention are all about a series of processes from when a user takes a golf shot to when a ball according to the golf shot reaches a target point and stops. Since video editing is done automatically for inclusion, the user is said to be very active when sending a ball from the start point to the target point in a single golf shot.
  • the target point may be a hole cup on the green and near the green.
  • the automatic golf image information generation system automatically generates an image of a series of processes from when a user takes a golf shot to when a ball according to the golf shot reaches a target point and stops. Therefore, it is preferable not only to be easy to apply but also to hole-in-one when the ball can be seated on the tee box directly by golf shot, such as Par 3 hole.
  • the first photographing unit 100 is configured in the tee box (TB) area of the Par 3 hole.
  • the first photographing unit 100 includes a first camera 110 and a second camera 120
  • the second photographing unit 200 now includes a third camera 210 and a fourth camera 220. Indicate if it contains.
  • the first camera 110 of the first photographing unit 100 is installed to record an image at an angle of view facing the side of the golf swing user, and the second camera 120
  • the golf club is installed so as to take an image at the front angle of view of the user.
  • the second photographing unit 200 may include a single camera, but as shown in FIG. If cameras are installed, it is preferable that each camera is set up to shoot images at different angles of view looking at the area containing green (G).
  • HC refers to the hole cup on the green (G) and FL refers to the flagpole fmf inserted in the hole cup (HC).
  • the above-mentioned target point is not a hole cup on the green, for example, on the target area (EV) of the pacing.
  • EV target area
  • Each rounding user ranks golf shots from the tee box and ranks them in the order closest to the center of the target area (EV) prepared in advance on the fairway, and analyzes the prizes set according to the ranking. It can be paid according to the rank determined by the result.
  • EV target area
  • the Youngsing-information processing unit can provide the golf image information automatically generated by editing the image (winner or winner).
  • the image information processing apparatus automatically generates the above-mentioned automatically with the determination or determination.
  • the golf video information can be transferred to the user's mobile terminal.
  • the tee box photographing unit and the pair photographing unit described in claims 11 to 13 of the present application are the same as the first photographing unit and the third photographing unit.
  • the camera of each photographing unit as described above is connected to the image information processing device 500 and communicates with each other, the image acquired by each camera is transmitted to the image information processing device 500 and collected,
  • the information processing apparatus 500 performs image editing such as extracting an appropriate image from each image collected from each camera, combining the extracted images with each other, or inserting images of other cameras as sub-images into the image of a specific camera. Finally, it is configured to automatically generate golf image information.
  • the image information processing apparatus 500 may generate the golf image information as described above.
  • an appropriate image from the image it is determined by an information processing unit that is pre-programmed as to which section is suitable for extracting the image, and extracts and edits the appropriate image to generate the golf image information.
  • the image information processing apparatus 500 collects the images collected from each camera.
  • the analysis section determines the extraction interval of an appropriate image, and extracts the appropriate image according to the determination. This will be described later.
  • the image information processing apparatus 500 includes a storage unit 510 and an information processing unit 520
  • the mall information processing unit 520 includes an image management unit 521, Trigger processing unit 522, ball tracking processing unit 523, hole cup position detection unit 524 and video
  • the image management unit 521, the trigger processing unit 522, the ball tracking processing unit 523, the hole cup position detecting unit 524, and the image editing unit 525 are each hardware or the like.
  • It may be implemented in software, and may be a diagram showing each function performed by the information processing unit 520.
  • the storage unit 510 is a portion for storing images collected from each camera of each photographing unit (100, 200, etc.), and the image management unit 521 is a portion from each camera of each photographing unit (100, 200, etc.). Collected images are classified and stored in the storage unit 510 for each camera.
  • the trigger processing unit 522 stores the first data stored in the storage unit 51.0.
  • the image processing of the image of the first camera 110 or the second camera 120 of the photographing unit 100 detects that the ball is moved by the hit, and the ball within the image is detected. Detecting movement by hitting will generate a trigger signal.
  • the trigger processor 522 detects the motion of the ball due to the hit by the algorithm for detecting the ball in the difference image of two different frame images with respect to the image of several frames. The detection of the ball enables detection of the ball, which is described in more detail below.
  • a golf image information automatic generation system is provided.
  • the image information processing apparatus 500 may receive a trigger signal generated outside, instead of generating a trigger signal through image analysis, and use it as a trigger signal.
  • a golf terminal used in the course of golf rounds (MT: a terminal usually carried by a caddy and entering and managing a golf score, or a golf assistant or mobile phone carried by each golfer).
  • MT a terminal usually carried by a caddy and entering and managing a golf score, or a golf assistant or mobile phone carried by each golfer.
  • the information processing apparatus 500 can receive the shot signal and use it as the trigger signal described above. Specific details thereof will be described later.
  • the ball tracking processing unit 523 analyzes the captured image of the camera 210 or 220 included in the second photographing unit 200 installed near the target point, i.e., green, by analyzing the image through image processing. To detect the location of the ball
  • This part performs the function to track the ball by creating it.
  • the ball tracking processing unit 523 determines a time point at which the ball stops moving by continuously tracking the ball near the target point such that the ball rests on the green.
  • the ball tracking processing unit 523 can continuously determine the position of the ball through the image analysis as described above to determine whether the hole in the circle using the position of the hole cup on the green and the difference in the ball. You can also calculate the distance between the ball and the hole cup.
  • the hole cup position detecting unit 524 analyzes the captured image of the camera 210 or 220 included in the second photographing unit 200 installed near the green by analyzing the image through the image processing to determine the hole cup position on the green. It detects in real time and performs the function to update the changed hole cup position information when the hole cup position is changed.
  • the automatic golf image information generation system does not have the hole cup position on the green as fixed position information. Each time you move or at a preset interval, the hole cup position is updated and updated.
  • the hole position detection unit 524 may directly recognize the position of the hole cup on the green through preset image processing of an image collected from a camera photographing an area including the green near the green.
  • the flagpole inserted in the hole cup can also be recognized as the hole cup position.
  • the hole cup position information on the green is maintained by the hole cup position detecting unit 524, so that the ball tracking processing unit 523 determines the accuracy of hole in or near pin determination and the distance calculation between the hole cup and the ball. Di-.
  • the image editing unit 525 extracts the images required for the generation of the golf image information to be finally made from the image of each camera managed by the image management unit 521 and the extracted images Image editing is performed such as combining with each other or inserting a specific extracted image as a sub image into another extracted image.
  • the image editing unit 525 extracts an image extraction section for an image of each camera.
  • the extraction section of the image is determined using information such as the point at which it is no longer detected, the point at which the moving ball stops on the green, and the like. Specific details thereof will be described later.
  • ⁇ view point '' may be time information or frame information of an image.
  • ⁇ start point of trigger signal '' may mean a time when a trigger signal is generated by a trigger processing unit. It can mean the video frame when the trigger signal occurs, or it can mean both.
  • the image analysis can mean the image frame when the ball is not detected and time information or when the ball is not detected.
  • time information or when the ball is not detected can also mean the time information or the corresponding video frame information when the ball does not move in the ball tracking process.
  • the "extraction section” may be a time section or a frame section.
  • a segment from the trigger point to the point where the ball is no longer detected can mean that the video frames are extracted from the time interval between when the trigger occurs and when the ball is no longer detected. It may mean that the video frames corresponding to the frame interval between the video frame when it occurs and the video frame when the ball is no longer detected are extracted.
  • the first camera (110, see FIG. 1) and the second camera (120; 1) and automatically generates golf image information performed by the image information processing device 500 (see FIG. 1) when the third camera 210 (see FIG. 1) is installed near the green (G). It's about how it's shown.
  • the first camera takes a picture with an angle of view looking at the side of the user taking a golf swing posture (takes a picture from the rear direction of the ball), the second camera takes a golf blue posture. Shoot the image with the angle of view facing the front of the face (taken from the side of the ball in the forward direction).
  • the camera starts to take images, respectively (S 10), and the image management unit 521 (see Fig. 2) collects the images taken from each of the first camera and the second camera and the storage unit (510, Fig.
  • a trigger signal is generated or a trigger signal is received from an external golf terminal or the like (S20).
  • the third camera installed near the green starts image recording (S22), and the image management unit collects the captured image from the third camera and stores it in the storage unit.
  • the image editing unit 525 determines the trigger point (S24).
  • the trigger processing unit detects a ball moving in the image by applying a difference image and a ball detection method to the captured image of the first camera stored in the storage unit (S30).
  • the photographed image of the first camera is directed toward the ball from the rear side of the tee box.
  • the ball can no longer be detected within the image when the ball is farther away (S40). At this time, the image editor can no longer detect the ball in the captured image of the first camera. The timing point at which the ball disappears from the camera image is determined (S42).
  • the image editing unit determines the time point at which the predetermined time elapses as the time point of disappearing the ball (S42).
  • the image management unit ends the collection of the first camera photographed image (S44) (the first camera also ends the photographing).
  • the ball tracking processing unit (523, see FIG. 2) of the image information processing apparatus detects a ball by applying a difference image and a ball detection method to the captured image of the third camera photographing the green area. Track the position of the motor (S50).
  • the image editing unit determines the point at which the ball stops on the green (S64). ).
  • the image management unit ends the collection of the third camera photographed image (S62) (the third camera also ends the shooting).
  • the ball tracking processing unit can determine whether it is hole in one using the position of the hole cup and the position information of the ball (S70).
  • the hole-in-one celebration content prepared in advance for the golf video information is inserted (S72).
  • the ball tracking processing unit determines the distance between the hole cup and the ball.
  • the image editing unit After calculating (S80), the image editing unit displays the distance information between the hole cup and the ball calculated on the final generated golf image information (S82).
  • the image editing unit uses the trigger point determined in step S24, the point where the ball disappears in the first camera image determined in step S42, and the point in which the ball stops on the green determined in step S64. Based on the viewpoint, the respective images are extracted from the camera images stored in the storage unit, and the extracted images are edited according to preset details.If necessary, the hole-in-one content of step S72 or the distance information of step S82 are used. Lights
  • FIG. 4 is an example of the image 101 photographed by the first camera described above to explain a method of performing image processing on the image.
  • the tee box always uses ready-to-use tee markers and 2 to recognize the tickers 1 and 2 in the image and to set up a region of interest (ROI) containing the recognized tick markers 1 and 2,
  • ROI region of interest
  • the extracted region of interest ROI may be used for image processing by extracting a portion corresponding to the region of interest ROI for each photographed image frame.
  • (A) in FIG. 5 is an nth frame image
  • (b) is a ⁇ + lth frame image
  • (c) is an n + 2th frame image
  • (d) is an n + 3th frame image
  • (e) represents the n + 4th frame image
  • (f) represents the n + 5th frame image
  • bl Moving balls, as b2, b3, b4, b5 and b6, can be detected.
  • Such ball detection can be performed through a difference image and a ball detection method. For example, when a predetermined image preprocessing such as a difference image of an nth frame image and an n + 1th frame image and normalization thereof is performed, Only the moving parts remain, including the ball.
  • the blob can be detected by pre-setting the size of the ball, aspect ratio, straightness, etc., and then removing the non-applicable parts of the image generated by the difference image according to the preset value.
  • the user's head, torso, leg, etc. which are moving parts of the car image, and golf clubs and balls are detected, and the user's head, torso, and legs are preset sizes of balls. Since it can be easily excluded according to the information or aspect ratio information, and the golf club part can only be moved by the curved track, it can be easily excluded according to the preset information regarding the straightness, so that unnecessary parts can be easily excluded in this way. Can be detected.
  • bl to b6 indicate balls detected on each frame image shown in 5 (a) to (f), respectively.
  • the trigger point of the image information processing apparatus of the system according to the present invention becomes the trigger point when the ball is first detected by the above-described ball detection method.
  • the nth frame may be determined as the trigger point, or the time at which the ball is detected in the nth frame image may be determined as the trigger point.
  • the attrigger point in time (frame at that time or frame) that triggered the other—user or Canadian golf terminal to generate the trigger signal.
  • the triggering point determined by the trigger processing by the image processing of the trigger processing unit and receiving the triggering signal from the outside may be different, and the triggering point is determined when the head of the golf club is impacted on the ball by the user's golf swing. Since the image is edited by extracting the image as much as the pre-set section before and after the trigger point as a trigger point, it is possible to generate appropriate golf image information even if the impact point is not the trigger point.
  • 6 (a) to (f) show images of m-th to m + 5th frames taken by the first camera in time series, and detect a ball in each image. It is about something (where m is any natural number and m is greater than n).
  • 6 (a) shows an m th frame image, (b) an m + 1 th frame image, (c) an m + 2 th frame image, and (d) an m + 3 th frame image
  • (E) represents the m + 4th frame image, and (f) represents the m + 5th frame image
  • the moving balls are referred to as B1, B2, B3, B4, and B5 within each frame image. Can be detected (the ball was not detected in the m + 5th frame image in Figure 6).
  • the trigger processing unit analyzes the image of the first camera frame by frame and detects the ball. Since the ball is not detected in the m + 5th frame image, that is, the ball may disappear in the image. Therefore, you can determine the time when the ball disappeared or the time when the ball was not detected in the video.
  • the golf information that can be provided to the user on the green such as the distance indicator between the hole cup and the ball, is shown as an example of the image 201 taken by the limit 3 camera. .
  • the ball tracking processing unit of the video information processing apparatus of the present invention detects the ball ba in the video (the ball detection method is as described above).
  • the ball position is tracked by calculating the ball position information for each frame image.
  • the trajectory tr of the ball can also be displayed in the final golf video information as shown in FIG.
  • the hole cup position can be calculated either by looking for the hole cup (he) on the green (g) directly or by finding the flagpole (fl) inserted in the hole cup.
  • the hole cup (he) or flagpole (fl) has a color that is clearly distinguished from the green (g)
  • the image of the third camera is converted into an HSV image, and the hole cup or flagpole is analyzed through color analysis of the converted image. You can find it.
  • the ball tracker processing unit knows the ball position information by the ball detection method in the image, and also knows the position of the hole cup detected through the hole cup position detection unit, and uses the position information of the hole cup and the ball position information. It is possible to determine whether the ball (ba) is holed into the hole cup (he), as well as the distance between the hole cup (he) and the ball (ba) if the ball (ba) is stopped.
  • the image editing unit of the image information processing apparatus of the present invention when the ball is holed in the hole cup as described above, that is, if the hole in one, the pre-prepared hole in one axis content It can be inserted and displayed in the golf video information. If the distance between the ball ba and the hole cup he is calculated as shown in Fig. 7, the calculated distance information can be displayed on the golf video information.
  • the virtual object such as concentric circles Ra is used as the center of the hole cup position so as to visually indicate how close the ball ba is to the hole cup he. Can also be inserted.
  • FIG. 8 shows an example in which golf image information is generated by extracting and editing a required image from each camera image by the image editing unit.
  • IM-1 is a captured image of a first camera and is captured by an image management unit, and represents an image stored in a storage unit.
  • IM-2 is a captured image of a second camera, and is captured by an image management unit and stored in a storage unit.
  • IM-3 represents the image captured by the image management unit and stored in the storage unit, and IM-G represents the edited image extracted from each image.
  • Trigger point (see step S24 of FIG. 3) and ball disappearing point in order to extract the image necessary to generate golf image information from each image (IM-1, IM-2, IM-3) 3) and the point where the ball stops (see step S64 in Figure 3) are preferably determined, where the trigger point is T1, the ball disappears T2, and the ball stops T3. .
  • the trigger point T1 needs to be determined in each of the above-described points of time, and the point T2 and the point T3 in which the ball disappears do not necessarily need to be determined.
  • the video necessary to generate the golf image information from each video ( ⁇ -1, ⁇ -2, ⁇ -3) is obtained. It is possible to extract.
  • triggering is performed by analyzing an image of the first camera.
  • the section preset in advance from the time point T1 can be extracted as the above-described S1-2 section. Even when the ball disappears (T2), it is not necessary to make the above S1-2 sections from Tl to T2, and the section from T1 to the point slightly earlier or later than S1-2. Can be extracted by determining the interval-.
  • E1 An image extracted for the S1-1 section and the S1-2 section in the IM-1 image will be referred to as E1.
  • the video extracted from the video of the second camera can be determined in various ways depending on the content of the golf video to be edited.
  • the video of the second camera is taken at an angle of view facing the user in front. Therefore, the image may be extracted from the image of the first camera or the image of the third camera and inserted into the image to extract the user's expressions together in the image while the golf ball is flying.
  • the image corresponding to the preset section S2 can be extracted from the trigger point T1 for the image IM-2 of the second camera, and the image of the second camera can be extracted.
  • the extracted image of the S2 section from the image (IM-2) will be referred to as E2.
  • the section S3 from the point in time T2 to the point in time T3 at which the ball has stopped can be extracted.
  • a section preset from the time point T1 or a section previously set from the time point T2 at which the ball disappeared can be extracted as the above-described S3 section.
  • the extracted image of the S3 section from the image (IM-3) of the third camera will be referred to as E3.
  • the E1 image and the E3 image are combined and combined into the combined image.
  • Video editing can be done by inserting an E2 picture as a sub picture.
  • It can be used by extracting only parts or face parts, or can use an enlarged image of a user.
  • the E1 In the edited image of the E2 and E3 images, inserting the display of congratulation contents such as the track mark (tr) of the ball, the concentric circle (Ra) of the green, the distance between the hole cup and the ball, the hole in circle, etc.
  • Final golf image information can be automatically generated by inserting indicator lights such as 'Nice Shot!' And 'Nearest Winner!'.
  • the image information processing apparatus 500 transmits the generated golf image information to an operation server of a golf course or a separate server so that the server can be stored and managed.
  • PC mobile
  • the first camera and the second camera are stored in the tee box.
  • the third camera is installed in the installed and green area, and the images are collected from each of them to explain golf video information.
  • the automatic golf video information generation system and method according to the present invention are not limited in this case. If you use two cameras, of course, you can use it with more than four cameras.
  • the part related to the image (IM-2) of the second camera and the image (E2) extracted therefrom is shown in FIG. 8. Except for this, golf image information can be generated using E1 image and E3 image.
  • the Tl, there T2 and T3 popularly least determining the image extraction range on the basis of a point in time and sleep that extracts the image according to the determined period to probe image coming from the insertion on the image to be edited or editing bangsak binding to E3 video achieved (fourth Since the image of the camera is taken with a different time from the 3rd camera, it can be combined with each other by extracting the image from the 3rd camera and the 4th camera into appropriate sections. It is also possible to insert an image on the E3 image and process it so that the image is enlarged and taken).
  • an image may be extracted from the images of the third photographing unit at an appropriate interval.
  • image editing can be done by properly combining or inserting between the E1 and E3 images.
  • a first photographing unit installed on one side of the specific hole of the golf course, a twelve photographing unit installed on the other side, and an image information processing device connected to the first photographing unit and the second photographing unit.
  • the configuration and function of the above image information processing apparatus can be applied substantially in the same way.
  • the first photographing unit may be implemented by the first camera shown in FIG. 1 or may be implemented by the second camera, and is not necessarily installed in the city box, but installed at a distance from the tee box.
  • the second photographing unit may be implemented by the third camera shown in FIG. It can be implemented by the camera, not necessarily around the green, and can be installed some distance from the green.
  • the first photographing unit means a camera device installed around a golf shot by a user
  • the second photographing unit means a camera device installed around a target point (eg, a green cup). It is defined as doing.
  • FIG. 9 is a view illustrating a system for automatically generating golf image information according to another embodiment of the present invention.
  • the second photographing unit of the automatic golf image information generation system according to the present invention to which the automatic golf image information generation method according to the pull chart shown in FIG.
  • the pan function of the PTZ camera is a function of rotating the camera left and right, and tilt.
  • the function is to rotate the camera up and down, and the zoom function is to enlarge or reduce the image.
  • the first recording unit starts to take an image of the golf shot by the user
  • the second recording unit also starts to take an image (S210).
  • the camera is positioned at a distance (eg, around the green) from a location where the golf shot is taken (e.g., around the tee box), and the user zooms in at a preset first magnification.
  • Start shooting in the state (hereinafter, the position of the user of the second shooting unit, where the golf shot is taken, is zoomed in at a preset 1x magnification.
  • the image management unit 521 (see FIG. 2) includes the first photographing unit and the second photographing unit.
  • Images captured from each are collected and stored in the storage unit 510 (see FIG. 2) (S220).
  • a trigger signal is generated by the trigger processing unit 522 (see FIG. 2) or a trigger signal is received from an external golf terminal pole (S230).
  • the image editing unit 525 determines the trigger point (S232).
  • the second recording unit shoots in the default state, and transmits the captured image to the image information processing device while zooming-out at the second set magnification. (S310).
  • the zoom-out is completed (S320).
  • the second recording unit After the zoom-out is completed, the second recording unit performs pan-tilting, and immediately
  • the pan tilting of the second photographing unit is driven.
  • the second photographing unit has a predetermined up and down and / or left and right angles from the beginning.
  • the pan-tilting may be performed by rotating, and the image information processing apparatus analyzes the image transmitted from the second photographing unit to recognize the hole cup position, and provides up to 12 photographing units with up and down and / or left and right angle information.
  • the above pan-tilting can be achieved by transmitting the above-mentioned pan-tilting, and the second recording unit itself includes an image analysis unit to recognize the hole cup position through its own image analysis, and calculate the rotation angle information based on the hole cup position. Pan-tilting is also possible.
  • the second photographing unit captures an image of the green to capture an image captured by the image information processing device.
  • the ball can no longer detect the ball in the image when the ball is flying farther away.
  • picture editing unit is able to determine when the ball has passed from the first shot point is found on the shot image is no longer detected, jeukje first recording units of the unit image.
  • the image information processing apparatus determines whether or not a predetermined time has elapsed after the trigger signal is generated (S400), and when the predetermined time elapses, the image information collection apparatus ends the collection of captured images of the first photographing unit. S410) (the first photographing unit also finishes photographing).
  • the ball tracking processing unit 523 (see FIG. 2) of the image information processing apparatus detects a ball by applying a difference image and a ball detection method to the second image capturing the green area. By tracking the position of the ball (S420).
  • the image editing unit determines the point where the ball stops on the green ( S502).
  • the image management unit ends the collection of the photographing images of the second photographing unit (S350) (the second photographing unit also ends the photographing). At this time, the second photographing unit returns to the above basic state by zoom-in and pan-tilting (S360).
  • the bolt racking process knows the position of the hole cup in advance and also knows the position of the ball through image analysis, it can determine whether it is a hole-in-one using the position of the hole cup and the position of the ball (S520).
  • the ball tracking processing unit determines the distance between the hole cup and the ball.
  • the image editing unit displays distance information between the calculated hole cup and the ball in the finally generated golf image information (S550).
  • the image is extracted from each photographing unit image stored in the storage unit on the basis of the determined time point, and the editing is performed according to the preset information on the extracted image. If necessary, the golf image information is finally generated by inserting the hole-in-one reduction content of step S521 or the distance information display of the step S550 (S600).
  • FIG. 10 extracts and edits necessary images from each recording unit image by the method for automatically generating golf image information according to the pull chart shown in FIG.
  • Fig. 1 shows an example of generating golf video information.
  • IM-A is a captured image of the first photographing unit.
  • the image collected and stored in the storage unit is shown, and the IM-B is a captured image of the second shooting unit.
  • the image is collected in the video camera unit and displayed in the storage unit.
  • the IM-G is the edited image extracted from each image. Indicates
  • a trigger point (see step S232 of FIG. 3) and a ball stop point (step S502 of FIG. 3) It is preferable that each of these is determined, and the point of time when the ball disappears as described in FIG. 3 may be determined in some cases.
  • the trigger time point is T1
  • the time point where the ball disappeared or the point previously set from the trigger time point is T2
  • the time point at which the ball stops is T3.
  • the image corresponding to the section (R1-2) to the viewpoint can be extracted.
  • ER1 The image extracted for the R1-1 and R1-2 sections in the ⁇ - ⁇ image will be referred to as ER1.
  • the trigger time is determined from the image ( ⁇ - ⁇ ) of the second shooting unit.
  • the section (R2) from (T1) to the point ( ⁇ 3) at which the ball stopped can be extracted.
  • the section preset from the time point T1 can be extracted as the above-described R2 section.
  • the image of the crab 2 recording unit is Zoom-in image for the T-box area in the default state (Sa), zoom-in from the trigger point (T1) (or it may be a preset point before or after it), and zoom-out image (Sb)
  • the pan-tilting shows the changed view (the green area including the hole cup) (Sc), and afterwards, the image of the bird keeping the same view or expanding the view more (Sd).
  • the matters relating to ball tracking of S420 and subsequent steps of FIG. 9 can be processed by analyzing using the above-described Sd image.
  • the extracted image of the section R2 from the imaging unit (IM-B) of the second photographing unit will be referred to as ER2.
  • the ER2 image is the zoom-in image (Sa), zoom-out image ( Sb), a view that has been changed by pan-tilting (Sc), and then retains that view or enlarges it (Sd) so that golf image information based on users and golf shots in the final edited image is more dramatic. May appear.
  • the edited image (IM-G) can be used.
  • Inserting or displaying a predetermined content or the like into the edited video (IM-G) is the same as described in the above-mentioned limit 8, and thus, a detailed description thereof will be omitted.
  • the image information processing apparatus may transmit the generated golf image information to the operation server or a separate server of the golf course to be stored and managed on the server, the user and the PC or mobile terminal You can get the golf video information for your memorial golf shot by accessing the server and downloading the corresponding golf video information.
  • FIG. 11 illustrates an example of edited images of the ER1 and ER2 images described with reference to FIG. 10 in time series.
  • 11 (a) and 11 (b) show an example of an ER1 image extracted from the first photographing unit and shows a scene in which the user is playing golf shot in the tee box area of the image.
  • FIG. 11C is an example of an ER2 image extracted from the second photographing unit, and shows a state in which the tee box (tb) region is captured as a zoom-in image.
  • FIG. 11 (d) shows a state where the image tee box (tb) region is separated by zoom-out
  • FIG. 11 (e) shows that the second recording unit is pan-tilted (that is, up and down and And / or change the camera view by left and right
  • FIG. 11 (f) shows a state where the camera view has been changed by pan-tilting (in the image of f in FIG. 11).
  • the second imaging unit is preferably pan-tilted to have a view that includes the green (g) area including the hole cup (he) / flagpole (fl) positions).
  • FIG. 13 (a) shows a case where the view of the second shooting unit is changed by pan-tilting
  • Fig. 13 (b) shows the images until the ball (ba) comes up and stops at a preset magnification with respect to the hole cup (he) position.
  • the enlarged image of (b) to (d) of the above-mentioned limit 13 may be an image captured by the second photographing unit zoom-in, and the image information processing apparatus is preset for the image received from the second photographing unit.
  • the image may be enlarged and edited in magnification.
  • the automatic golf image information generation system and the automatic golf image information generation method collect appropriate images for editing by collecting images of each area in a specific hole of a golf course and analyzing them.
  • Image information that shows the sequence of processes from the golf shot to the movement that includes the target point of the golf shot ball for the user who is playing the golf round, by determining the point of time for which the reference is to be determined and editing the extracted images therefrom.
  • the golf video information can be automatically generated and provided to the user, and the golf video information can be automatically generated by configuring it in such a way that it can be automatically generated.
  • the automatic generation method automatically generates golf image information by editing the image information showing the sequence and process from the golf shot to the user playing the golf field in the golf course to the movement on the area including the golf shot ball and the target point. This allows users to provide video content that will be a memorial to golf shots and is available for golf-related industries.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • Studio Devices (AREA)
  • Image Analysis (AREA)
  • Television Signal Processing For Recording (AREA)
  • Image Processing (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

La présente invention a pour objet un système et un procédé de génération automatique d'informations d'images de golf. Lesdits système et procédé peuvent fournir à un utilisateur un contenu d'images mémorables se rapportant à un coup de golf en générant automatiquement des informations d'images de golf en modifiant des informations d'images qui non seulement confirment un trou d'un coup ou valident un coup près de la tige mais en plus montrent à un pratiquant une série d'étapes allant d'un coup de golf à des mouvements dans une zone contenant un point cible d'une balle frappée par le coup de golf.
PCT/KR2016/012606 2015-11-04 2016-11-03 Système et procédé de génération automatique d'informations d'images de golf WO2017078435A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2018517854A JP6596746B2 (ja) 2015-11-04 2016-11-03 ゴルフ映像情報自動生成システム及びゴルフ映像情報自動生成方法
CN201680063726.7A CN108293151B (zh) 2015-11-04 2016-11-03 高尔夫影像信息自动生成系统及高尔夫影像信息自动生成方法

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020150154275A KR101738420B1 (ko) 2015-11-04 2015-11-04 골프영상정보 자동생성 시스템 및 골프영상정보 자동생성방법
KR10-2015-0154275 2015-11-04

Publications (1)

Publication Number Publication Date
WO2017078435A1 true WO2017078435A1 (fr) 2017-05-11

Family

ID=58662958

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2016/012606 WO2017078435A1 (fr) 2015-11-04 2016-11-03 Système et procédé de génération automatique d'informations d'images de golf

Country Status (4)

Country Link
JP (1) JP6596746B2 (fr)
KR (1) KR101738420B1 (fr)
CN (1) CN108293151B (fr)
WO (1) WO2017078435A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112463823A (zh) * 2021-02-02 2021-03-09 深圳市前海泛美图像技术有限公司 一种高尔夫码点到洞杯距离的计算方法及相关产品

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102109971B1 (ko) * 2018-10-29 2020-05-12 주식회사 크리에이츠 골프 스윙의 촬영을 지원하는 방법, 시스템 및 비일시성의 컴퓨터 판독 가능 기록 매체
KR102180108B1 (ko) * 2019-02-25 2020-11-17 양창오 골프 기념영상 제공시스템 및 제공방법
KR102613027B1 (ko) * 2022-02-28 2023-12-12 김기표 골프공 위치 추적 시스템

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008167245A (ja) * 2006-12-28 2008-07-17 Akira Kudo ホールインワン・ニアピン認定システム
KR20090021407A (ko) * 2007-08-27 2009-03-04 마이크로 인스펙션 주식회사 골프공의 거동 측정장치 및 그 제어방법
KR20100127346A (ko) * 2009-05-26 2010-12-06 최성열 골프 게임 온라인 제공방법
KR20110044101A (ko) * 2009-10-22 2011-04-28 (주)태종씨앤아이 듀얼 카메라를 이용한 실시간 감시장치
KR101356595B1 (ko) * 2013-01-17 2014-02-04 (주) 골프존 골프장에 구현되는 골프스윙영상 정보 제공 시스템과 이에 이용되는 골프스윙영상 처리장치 및 골프스윙영상 정보 제공방법

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2167511C (fr) * 1994-05-30 2003-03-11 Makoto Hyuga Methode et dispositif servant a prendre des images visuelles
JPH09239089A (ja) * 1996-03-04 1997-09-16 Masayuki Oguri ゴルフ情報システム
JP4143389B2 (ja) * 2002-11-22 2008-09-03 キヤノン株式会社 映像記録装置
JP5099501B2 (ja) * 2007-12-27 2012-12-19 章 工藤 ホールインワン確認システム
KR100970675B1 (ko) * 2009-11-30 2010-07-15 (주) 골프존 가상 골프 시뮬레이션 장치 및 이를 포함하는 시스템과, 가상 골프 시뮬레이션 방법
JP6296226B2 (ja) * 2013-11-21 2018-03-20 カシオ計算機株式会社 電子機器、撮像装置、撮像制御システム、撮像制御方法及びプログラム

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008167245A (ja) * 2006-12-28 2008-07-17 Akira Kudo ホールインワン・ニアピン認定システム
KR20090021407A (ko) * 2007-08-27 2009-03-04 마이크로 인스펙션 주식회사 골프공의 거동 측정장치 및 그 제어방법
KR20100127346A (ko) * 2009-05-26 2010-12-06 최성열 골프 게임 온라인 제공방법
KR20110044101A (ko) * 2009-10-22 2011-04-28 (주)태종씨앤아이 듀얼 카메라를 이용한 실시간 감시장치
KR101356595B1 (ko) * 2013-01-17 2014-02-04 (주) 골프존 골프장에 구현되는 골프스윙영상 정보 제공 시스템과 이에 이용되는 골프스윙영상 처리장치 및 골프스윙영상 정보 제공방법

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112463823A (zh) * 2021-02-02 2021-03-09 深圳市前海泛美图像技术有限公司 一种高尔夫码点到洞杯距离的计算方法及相关产品

Also Published As

Publication number Publication date
KR20170052164A (ko) 2017-05-12
KR101738420B1 (ko) 2017-05-22
JP2019501550A (ja) 2019-01-17
CN108293151A (zh) 2018-07-17
CN108293151B (zh) 2020-12-04
JP6596746B2 (ja) 2019-10-30

Similar Documents

Publication Publication Date Title
US10489656B2 (en) Methods and systems for ball game analytics with a mobile device
WO2019229748A1 (fr) Système d'analyse vidéo de jeu de golf
JP6120837B2 (ja) スポーツ動作のビデオを解析する方法
US10486043B2 (en) Sensing device and sensing method used in baseball practice apparatus, baseball practice apparatus using the sensing device and the sensing method, and method of controlling the baseball practice apparatus
US8848058B2 (en) Method for analyzing the motion of a person during an activity
TWI448318B (zh) 虛擬高爾夫模擬裝置及其使用之感測裝置與感測方法
WO2017078435A1 (fr) Système et procédé de génération automatique d'informations d'images de golf
WO2007035878A2 (fr) Procede et appareil pour la determination de trajectoire de balle
CN104115487A (zh) 图像处理装置、图像处理方法和程序
JP2005034619A (ja) ゴルフクラブヘッドの挙動計測装置
JP5811263B2 (ja) 仮想ゴルフシミュレーション装置及びその方法と、それに用いられるセンシング装置及びセンシング方法
US10237465B2 (en) Camera, method, and system for filming golf game
WO1995033334A1 (fr) Procede d'imagerie et son appareil
KR20140023136A (ko) 골프방송중 퍼팅정보 디스플레이시스템 및 그 방법
JP2009045495A (ja) ゴルフクラブヘッドの挙動計測装置
KR101703316B1 (ko) 영상을 기반으로 속도를 측정하는 방법 및 장치
CA3042375C (fr) Dispositif capteur servant a calculer l'information d'un coup de golf d'un utilisateur et methode de captage employant ledit dispositif
KR101499397B1 (ko) 동영상 분석기능을 갖는 모바일 단말기
JP7420377B2 (ja) テニス技術上達支援データベースの作成方法、および、テニス技術上達支援システム
KR20140013712A (ko) 사진을 이용한 그린정보 제공방법 및 그 단말
KR20220087330A (ko) 딥러닝을 이용한 동적 오브젝트 감지에 의한 스포츠 경기 무인 촬영 시스템

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16862451

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2018517854

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16862451

Country of ref document: EP

Kind code of ref document: A1