EP3773946A1 - Automated visual enhancement camera system and process - Google Patents

Automated visual enhancement camera system and process

Info

Publication number
EP3773946A1
EP3773946A1 EP19776315.4A EP19776315A EP3773946A1 EP 3773946 A1 EP3773946 A1 EP 3773946A1 EP 19776315 A EP19776315 A EP 19776315A EP 3773946 A1 EP3773946 A1 EP 3773946A1
Authority
EP
European Patent Office
Prior art keywords
guest
golf ball
video
composite
path
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP19776315.4A
Other languages
German (de)
French (fr)
Other versions
EP3773946A4 (en
Inventor
James VOLLBRECHT
Jeremy Mathew CARVER
John VOLLBRECHT
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Flyingtee Tech LLC
Original Assignee
Flyingtee Tech LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Flyingtee Tech LLC filed Critical Flyingtee Tech LLC
Publication of EP3773946A1 publication Critical patent/EP3773946A1/en
Publication of EP3773946A4 publication Critical patent/EP3773946A4/en
Withdrawn legal-status Critical Current

Links

Classifications

    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B24/00Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
    • A63B24/0003Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B24/00Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
    • A63B24/0021Tracking a path or terminating locations
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/60Editing figures and text; Combining figures or text
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B24/00Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
    • A63B24/0003Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis
    • A63B24/0006Computerised comparison for qualitative assessment of motion sequences or the course of a movement
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B57/00Golfing accessories
    • A63B57/505Hole information stands, e.g. tee-boxes
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B71/00Games or sports accessories not covered in groups A63B1/00 - A63B69/00
    • A63B71/06Indicating or scoring devices for games or players, or for other sports activities
    • A63B71/0619Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
    • A63B71/0622Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B71/00Games or sports accessories not covered in groups A63B1/00 - A63B69/00
    • A63B71/06Indicating or scoring devices for games or players, or for other sports activities
    • A63B71/0619Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
    • A63B71/0669Score-keepers or score display devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B24/00Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
    • A63B24/0003Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis
    • A63B24/0006Computerised comparison for qualitative assessment of motion sequences or the course of a movement
    • A63B2024/0012Comparing movements or motion sequences with a registered reference
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B24/00Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
    • A63B24/0021Tracking a path or terminating locations
    • A63B2024/0028Tracking the path of an object, e.g. a ball inside a soccer pitch
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B24/00Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
    • A63B24/0021Tracking a path or terminating locations
    • A63B2024/0053Tracking a path or terminating locations for locating an object, e.g. a lost ball
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B24/00Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
    • A63B24/0062Monitoring athletic performances, e.g. for determining the work of a user on an exercise apparatus, the completed jogging or cycling distance
    • A63B2024/0068Comparison to target or threshold, previous performance or not real time comparison to other individuals
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B71/00Games or sports accessories not covered in groups A63B1/00 - A63B69/00
    • A63B71/06Indicating or scoring devices for games or players, or for other sports activities
    • A63B2071/0694Visual indication, e.g. Indicia
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2102/00Application of clubs, bats, rackets or the like to the sporting activity ; particular sports involving the use of balls and clubs, bats, rackets, or the like
    • A63B2102/32Golf
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2220/00Measuring of physical parameters relating to sporting activity
    • A63B2220/80Special sensors, transducers or devices therefor
    • A63B2220/806Video cameras

Definitions

  • This invention relates generally to an automated visual enhancement camera system and method and, more particularly, to systems and methods of automatically augmenting a video of an individual who is striking or throwing an object with the travel path of the object that is struck or thrown.
  • the invention relates to an automated visual enhancement camera system and method, and more particular to an automated visual enhancement camera system and method that enhances guest experience by offering a view of a guest hitting a golf ball with shot tracer and scoring overlay of a previously struck golf ball and by allowing guest to share the experience on social media.
  • some embodiments provide an automated visual enhancement camera system and method that enhances a guest’s experience by offering short video clip or picture view of a guest engaging in entertainment or sports activities that is enhanced with computer generated overlays of a ball and resulting score, personal record, etc. which can then be shared by the guest to friends by mobile phone, PC, social media links and similar methods of digital conveyance.
  • this invention automatically creates a video clip or still image featuring a guest in a social golf range hitting a golf ball, with the flight of the golf ball and contextually relevant statistics (such as distance, resulting points scored, etc.) rendered into the clip which is then delivered to the guest for sharing by mobile phone, tablet, computer or other electronic means.
  • the guest will be hitting a golf ball in a multi-level, multi- bay golf and entertainment facility.
  • the guest might desire the composite video that contains an overlay of the shot to be shared with others in the facility.
  • the sharing might be facility wide or in bay only, and in other cases the sharing might involve direct transmission of the enhanced clip or picture directly to other designated guests, some of whom might be in competition with the sharer.
  • the guest might request that the video that includes the traced travel path of the ball be uploaded to a social media account of his or her choice, which might include the social media account of the driving range, the guest’s own personal social media account, etc.
  • uploading of the video plus the travel path will occur automatically without intervention by the guest except, perhaps, to review the clip or picture and approve its distribution to the channel offered by the invention from a list of such channels.
  • the system collects video clips or pictures of multiple shots of the guest and ranks these relative to the guest’s personal history of play, the history of all of the guests playing the game, etc., and uses pre-established criteria to suggest a choice of clips or pictures to the guest, who can then and thereafter review the clips to choose those to be shared. In some cases, this selection might be done automatically (e.g., the trial with the highest score if scoring is enabled).
  • the video that is provided to the guest might include, in addition to a trace of the shot, a score, shot statistics or other graphical elements created by the software.
  • the score might be determined based on distance to a fixed target (e.g., the pin), the flight distance of the ball, the length of the ground path, the total distance traveled, the maximum height of the path, etc. Some variations will allow the guest to use the score to compete with one or more other guests who are present at that golfing facility or even at a remote facility. Additionally, in some cases if the guest has several recorded shots the associated software might rank those shots based on the score and suggest the best one to save or upload.
  • AR augmented reality
  • A.R or“AR”
  • AR augmented reality
  • a guest who is provided with an AR headset might see the path of the ball drawn on a real-time view of the driving range.
  • the ball’s path will be traced in real time and displayed within the AR headset.
  • the path of the ball will be displayed within the AR headset some time after the ball is struck (e.g., a replay) to allow time for the path to be calculated.
  • all of the shots by all of the guests in a venue could be displayed simultaneously, giving the guest a view of multiple balls in flight on the AR device of choice and/or the composite AR video might be transmitted to other / designated users (e.g., competitors) or uploaded to a server from which it can be viewed by others (e.g., to social media).
  • FIG. 1 illustrates a rear perspective view showing an example of an automated visual enhancement camera system in accordance with an illustrative embodiment of the system and process disclosed herein.
  • FIG. 2 is a top perspective view of the automated visual enhancement camera system shown in Figure 1.
  • FIG. 3 contains a schematic illustration of an operating logic suitable for use with an embodiment.
  • FIG. 4 contains a schematic illustration of a guest participating in an embodiment with Fig. 4A illustrating the guest as s/he swings at the ball and Fig. 4B illustrating an outcome after the ball has been landed and a score has been awarded.
  • FIG. 5 i.e., Fig. 5A and 5B contains a more detailed schematic illustration of an operating logic suitable for use with an embodiment.
  • the invention relates to an automated visual enhancement camera system and method, and more particular to an automated visual enhancement camera system and method that enhances guest experience by offering“TV style” view of a guest hitting a golf ball with shot tracer and scoring overlay and by allowing guest to share the resulting composite video as represented by that experience on social media.
  • Figure 1 shows a driving range 10 that includes at least one hitting station 100, at least one golf ball 110, at least one golf club 120, and a range surface 200 that is proximate to the hitting station 100.
  • the hitting station 100 is positioned at one end of the range surface 200 and contains at least one tee box therein (not pictured). It will be understood that a guest
  • the hitting station 100 may swing the golf club 120 to hit the golf ball 110 over and onto the range surface 200.
  • the hitting station 100 will be one of many such stations that are contained within a multi-level multi-bay driving range. Those of ordinary skill in the art will recognize that such facilities can be found in most major U.S. cities and elsewhere around the world.
  • the term“hitting station” should be broadly construed as the starting location for a guest who is being videoed interacting with an object with the expectation that the path of the object that is hit, thrown, or rolled will be tracked and overlaid on the video of the guest.
  • FIG 2 shown therein is schematic representation of a plan (top down) view of the path that the golf ball 110 travels from the point of impact with the golf club 120 (referred to as the origination point 160) to the point that the golf ball 110 initially impacts the range surface 200 (referred to as the impact point 170).
  • the path the golf ball 110 travels from the origination point 160 to the impact point 170 is referred to as the flight path 130.
  • the path that the golf ball 110 travels from the impact point 170 to the point it comes to rest on the range surface 200 is referred to as the ground path 140.
  • the total travel path 150 refers to the complete path that the golf ball 110 travels after the origination point 150 to the resting point 180, and is equivalent to the combination of the flight path 130 and the ground path 140.
  • Figure 2 depicts the flight path 130, ground path 140 and total travel path 150 of a golf ball 110.
  • Figures 1 and 2 exemplify an embodiment of the inventive system configured to track the total travel path 150 of the golf balls 110 used at a driving range 10 and to display that total travel path 150 to the guest 300.
  • the system preferably includes one or more digital video cameras and/or digital video recorder system 410 in the rear of the hitting station 100 that face toward the range surface 200, a plurality of sensors 420 and 430 that are advantageously positioned downfield of the guest 300, a display device 450, and a computer having a CPU / processor and access to a locally stored or remotely stored database.
  • the information that is captured might be stored locally or transmitted to a remote location (either in real time or subsequent transmission) by a wired or wireless connection to a central server that receives and stores and/or processes that information.
  • a central server that receives and stores and/or processes that information.
  • the computer might be connected by wires or wirelessly to a local or wide area network (“LAN” or“WAN”). Additionally, in some embodiments the computer will be in electronic communication with the Internet and programmable to store and retrieve information from that source.
  • the digital camera / recorder 410 system is configured in some embodiments to continuously record activity in the hitting station 110, and may be positioned approximately ten (10) to fifteen (15) feet behind the guest 300.
  • each such recorder 410 assembly might be connected via a wire or wirelessly to one or more other computers via a LAN or WAN and possibly the Internet as well.
  • Each sensor in the plurality of sensors 420/430 is configured to record certain parameters about the total travel path 150 of a struck golf ball. Such parameters may include, without any limitation, the detection of the moment of impact, the origination point 150, the launch angle of the flight path 130, side spin of the golf ball 110, vertical spin of the golf ball 110, initial location of the golf ball 110, the impact point 160, speed/velocity of the golf ball 100 on the flight path 130, the three-dimensional coordinates of the flight path 130, the three- dimensional coordinates of the ground path 140, and the resting point 180.
  • certain other sensors that may be situated proximate to the guest 300 may be configured to detect other parameters related to the golf swing of the guest 300, including but not limited to the guest’s stance and location within the hitting station 100, the path of the moving club, the club speed/velocity, etc.
  • sensors and technologies available for the detection of parameters, including for example and without limitation, infrared beam sensors, radar sensors, pressure sensors, sound sensors, laser sensors, and cameras (both infrared and visible light). It will be further understood that certain sensors are capable of detecting a subset of the total parameters available about the total travel path 150.
  • the sensors might be any suitable sensor that can be used to detect the movement of an object through three-dimensional space, such as GPS, LIDAR, radar, optical or other sensors positioned on the range building, around the range, and/or on the moving target.
  • the database of the computer stores all parameters necessary for the system, which may include the size, shape and location of the hitting stations, the location of each of the cameras in the hitting stations, the video that each of the cameras records, the location of each of the sensors in the plurality of sensors, the parameters that each of the sensors in the plurality of sensors can detect, the location and boundaries of the range surface, and the number, expected distance and trajectory of shots hit with the selected golf club.
  • Such parameters are retrieved by the processor as needed to operate the system.
  • the camera 410 is positioned approximately ten (10) to fifteen (15) feet behind the mat in the hitting station 100, and the camera 410 is configured to continuously capture the golf swing of the guest 300 while hitting the golf ball 110.
  • the tracking sensors 420 and 430 are configured to detect and report ball launch position and ball flight position to the computer.
  • the computer with game software and/or the sensors 420 and 430 are configured to log in-game results, such as hit a bull’s eye, a card, a green or the like depending upon the type of game being played.
  • the computer compiles golf shot data for each guest, and scores or grades ball flight / shot results by guest according to a variety of different game goals.
  • a video of the guest’s swing that also shows the ball trajectory (discussed further below) might be provided to the guest might include, in addition to a trace of the shot, a score of some sort.
  • the score might be determined based on a distance from a fixed target (e.g., the pin), the flight distance of the ball, the length of the ground path, the total distance traveled, the maximum height of the path, etc.
  • a fixed target e.g., the pin
  • Some variations will allow the guest to use the score to compete with one or more other guests who are present at that driving facility or even at a remote facility.
  • Those of ordinary skill in the art will readily be able to devise systems of scoring that could be used either by the guest for personal improvement or in a competition of some sort.
  • the computer can be configured to score game play relative to the guest’s typical golf shot and frequency of a shot within“conforming shot characteristics” and/or skill level selected in the particular game. Moreover, the computer may compare shot data to a“perfect” shot that launches and flies with characteristics similar to those for PGA or LPGA guests hitting the same club, and the guest may then earn a“Pro” badge for each club if PGA/LPGA tag hits.
  • the automated visual enhancement camera system and method allows the guest 300 to review the video recorded by the camera 410, which shows the guest 300 swinging the golf club 120 from behind, and based on the computer calculations, the display 450 shows the trajectory of the golf ball 110 via highlight or“tracer” from the impact point 160 until the resting point 180 on the range surface 200.
  • the display 450 in conjunction with the camera 410 can be configured to display in-game results as part of the video feed.
  • the system and method can show in-game context or leaderboard and/or present a social media options to the guest 300.
  • the game play can be further enhanced by enabling the guest 300 to also earn a“Social Butterfly” badge or other badge for sharing shots on social media.
  • the guest might desire that the video with the trajectory overlay should be shared with others in the facility or elsewhere.
  • the sharing might be facility wide or in bay only, and in other cases the sharing might be directed toward certain other designated guests, some of whom might be in competition with the sharer, e.g., attempting to get the best score on a scored embodiment.
  • the guest might request that the video that includes the traced travel path of the ball be uploaded to a social media account of his or her choice, which might include the social media account of the driving range, the guest’s own personal social media account, etc.
  • the uploading of the video plus travel path will occur automatically without intervention by the guest except, perhaps, to indicate to the driving range computer system that such has been requested.
  • multiple golf ball trajectories of the guest might be collected and the user might be allowed to choose a“best” shot or outcome for sharing with others. In some cases, this selection might be done automatically (e.g., the drive with the highest score might be automatically chosen if scoring is enabled).
  • Fig.3 this figure contains an embodiment of an operating logic suitable for use with the instant disclosure.
  • the guest will be recognized (box 305) which might involve logging into the range computer system, presenting a fob or barcode that is recognized, etc.
  • Forms of identifying an individual to a computer system are well known and need not be further described here.
  • the digital video recording system and sensors will need to be activated (box 310). That might happen after the guest is identified or before. Either approach could readily be used.
  • the guest can now strike the ball and its flight path will be captured using the video and sensors described previously according to methods well known to those of ordinary skill in the art (box 315).
  • the information provided by video and sensors will then be used to calculate the 3D path of the ball (box 320) and the calculated path will be used to overlay a video of the guest striking the ball (box 325), where is the path would typically be displayed from the point of view of the location of the video recording system that was used.
  • the video that is used will be taken from the video recording system 410 that is situated behind the guest. In other embodiments, the video might come from one or more video recording systems that are situated elsewhere.
  • scoring is enabled for this user (the“YES” branch of decision box 330) some of the video and/or sensors will be used to determine a score for this particular flight event (box 335). As described previously, this score might be determined many different ways. The score that is determined might be presented to the guest by overlaying the score on the video, transmitted it to the guest via a text message, email, etc. However, in most cases the score will be made a part of the video in some way (box 335) if the guest has elected to participate in a game.
  • the composite video that includes at least a representation of the track of the ball will be presented to the guest. This might be done using a video display device 450 that is situated in the hitting box. It might also be done, in addition or alternatively, by transmitting it (e.g., via Wi-Fi, Bluetooth, etc.) the video to the guest’s smart phone device, or by link to a computer or networked storage device maintained at the golf range or in the cloud.
  • the guest After viewing the video, the guest will be given the option (the“YES” branch of decision item 345) to share the video with others. As explained previously, the shared video might go to others who are competing (or not) with that guest at the same facility, to others who the elsewhere, and/or to a social media account. If the guest has elected“automatic posting”, the decision item 346 will be bypassed and the controlling software will proceed to transmit the video to the selected display devices / users and/or to a social media platform. With respect to the social media platform, if the transmission is to be to the guest’s own account, identifying information would need to be provided to the controlling software that would enable such a posting. On the other hand, if the social media account is one controlled by driving range personnel, then the video could be automatically uploaded to that account without further input from the guest.
  • the guest might determine to hit another ball (the“YES” branch of decision item 355). This could be for many reasons, but among them are that the guest is attempting to get a better score than the previous attempt or the video was for some other reason unacceptable. In some case, one or more previous attempts might be saved by the controlling computer system so that the guest would have the option of selecting which one was preferred for sharing with others or selecting one or more videos for which should be saved for personal review in the future.
  • the software will, in some embodiments, save some or all of the guest’s video(s) to local, remote, or cloud-based storage according to methods well known to those of ordinary skill in the art. In other embodiments, the software will simply reset (return to box 305) and prepare for the next guest.
  • FIG. 4 this figure contains a schematic representation of a guest who is participating in an activity where the final resting position of the golf ball 110 is awarded a score based on its distance from a target 385.
  • the guest 300 is shown to be swinging along arc 380 at the ball 110.
  • the flight path of the ball 150 results in a landing as shown in Fig. 4B and the resulting score / message which will be displayed to the guest on a display device in connection with the composite video which also shows the flight path of the ball 110.
  • Figs. 5A and 5B contains a more detailed operating logic suitable with an embodiment.
  • a guest will arrive at a facility that utilizes an embodiment and be assigned a bay, enter it, and log into the facility computer (boxes 502-506).
  • the software necessary to implement a particular game will be loaded and made available to each guest (if there are more than one) that is participating (e.g., if a competition is taking place, box 514).
  • the video recording system and sensors will be read in anticipation of the guest hitting the ball (box 538).
  • the bay will have been calibrated to the location where the ball is placed (box 536).
  • the guest will hit the ball (box 532) and tracking of the flight of the ball will begin (box 540).
  • the sensor and video information will be used to render the flight of the ball in the game environment and the result, preferably including a score, will be displayed to the user (box 516) and the recording / tracking will stop (box 534).
  • the resulting video stream will be marked with the start time of the event (e.g.“at +x seconds” from the start of the recording).
  • the guest will be given the option of tracking another effort (boxes 518 and 520) and, if the guest so desires, decision item 510 will return to the start of the process (box 508).
  • the video clip will be marked with user identification, session, date, etc., and be saved to disk (box 546).
  • shot ranks will be applied based on the guest, group in session, etc., and for the venue, game, practice, age of the guest, etc., and clips are generated using pre-set criteria.
  • the guest may be offered a choice to share the only (or a selected one of a plurality) of clips with others (boxes 548, 522, 524, and 512).
  • the guest will be shown the clip that is proposed to be transmitted and given the option of how to deliver a link to it (e.g., SMS, Facebook, phone app, etc.).
  • the clip will be compressed (box 550) and an endpoint link generated to transfer to guest’s choice of recipients.
  • the link will be transmitted to each recipient (box 552).
  • the guest will then be offered the option to create another video (box 526) and, if that is declined, the game will end (box 528).
  • recording will end (box 544), all clips will be saved and associated with the particular guest and session (box 554), the final rankings (based on game score) will be retrieved (box 570) and those values will be combined with the video clips and moved to storage, after which each guest will be offered a choice of the recorded clips.
  • any of the steps 502, 504, 506, 508, 510, and 512 might be either signaled to the instant system by using a terminal proximate to the bay where the guest is situated or, in some alternatives, these sorts of steps might be performed using the guest’s smart phone or other mobile device which has been configured to communicate with the facility’ s computer system, which communication is established according to methods well known to those of ordinary skill in the art.
  • the computer of the inventive system and method can be configured to store the top number of positions, shots of the week or the like from any game play contest.
  • the highlight or tracer shot can be streamed to any monitor in the driving range 10 or via a suitable app. The app would further allow the guest 300 to share his/her post- experience on social media or otherwise.
  • the instant system should not be seen as being limited to creating a composite video of the path of a struck golf ball that is overlain with a video of a golfer hitting the ball.
  • the same technology could be applied to individuals who are hitting a baseball, rolling a bowling ball, etc.
  • the point of view of the composite video could originate from behind or atop the individual who is participating in this activity.
  • Those of ordinary skill in the art will be readily able to adapt the techniques taught herein to other sports and other objects hit, thrown, or rolled, etc.
  • the term“computer” may refer, but is not limited to a laptop or desktop computer, or a mobile device, such as a desktop, laptop, tablet, cellular phone, smart phone, personal media user (e.g ., iPod), wearable computer, implantable computer, or the like.
  • Such computing devices may operate using one or more operating systems, including, but not limited to, Windows, MacOS, Linux, Unix, iOS, Android, Chrome OS, Windows Mobile, Windows CE, Windows Phone OS, Blackberry OS, and the like.
  • mobile device may refer, but is not limited to any computer, as defined herein, that is not fixed in one location.
  • mobile devices include smart phones, personal media users, portable digital assistants, tablet computers, wearable computers, implanted computers, and laptop computers.
  • the system and process described herein may be deployed in part or in whole through network infrastructures.
  • the network infrastructure may include elements such as computing devices, servers, routers, hubs, firewalls, clients, personal computers, communication devices, routing devices and other active and passive devices, modules and/or components as known in the art.
  • the computing and/or non-computing device(s) associated with the network infrastructure may include, apart from other components, a storage medium such as flash memory, buffer, stack, RAM, ROM and the like.
  • the processes, methods, program codes, instructions described herein and elsewhere may be executed by one or more of the network infrastructural elements.
  • the computer software, program codes, and/or instructions may be stored and/or accessed on machine readable media that may include: computer components, devices, and recording media that retain digital data used for computing for some interval of time; semiconductor storage known as random access memory (RAM); mass storage typically for more permanent storage, such as optical discs, forms of magnetic storage like hard disks, tapes, drums, cards and other types; processor registers, cache memory, volatile memory, non-volatile memory; optical storage such as CD, DVD; removable media such as flash memory (e.g.
  • RAM random access memory
  • mass storage typically for more permanent storage, such as optical discs, forms of magnetic storage like hard disks, tapes, drums, cards and other types
  • processor registers cache memory, volatile memory, non-volatile memory
  • optical storage such as CD, DVD
  • removable media such as flash memory (e.g.
  • USB sticks or keys floppy disks, magnetic tape, paper tape, punch cards, standalone RAM disks, Zip drives, removable mass storage, off-line, and the like; other computer memory such as dynamic memory, static memory, read/write storage, mutable storage, read only, random access, sequential access, location addressable, file addressable, content addressable, network attached storage, storage area network, bar codes, magnetic ink, and the like.
  • the systems and/or processes described herein, and steps thereof, may be realized in hardware, software or any combination of hardware and software suitable for a particular application.
  • the hardware may include a general-purpose computer and/or dedicated computing device or specific computing device or particular aspect or component of a specific computing device.
  • the processes may be realized in one or more microprocessors, microcontrollers, embedded microcontrollers, programmable digital signal processors or other programmable device, along with internal and/or external memory.
  • the processes may also, or instead, be embodied in an application specific integrated circuit, a programmable gate array, programmable array logic, or any other device or combination of devices that may be configured to process electronic signals. It will further be appreciated that one or more of the processes may be realized as a computer executable code capable of being executed on a machine-readable medium.
  • the computer executable code may be created using a structured programming language such as C, an object oriented programming language such as .NET and C++, a lightweight data-interchange programming language such as JavaScript Object Notation (JSON) data-interchange format over HTTP POST request/response, or any other high-level or low-level programming language (including assembly languages, hardware description languages, and database programming languages and technologies) that may be stored, compiled or interpreted to run on one of the above devices, as well as heterogeneous combinations of processors, processor architectures, or combinations of different hardware and software, or any other machine capable of executing program instructions.
  • a structured programming language such as C
  • an object oriented programming language such as .NET and C++
  • JSON JavaScript Object Notation
  • each process described above and combinations thereof may be embodied in computer executable code that, when executing on one or more computing devices, performs the steps thereof.
  • the processes may be embodied in systems that perform the steps thereof, and may be distributed across devices in a number of ways, or all of the functionality may be integrated into a dedicated, standalone device or other hardware.
  • the means for performing the steps associated with the processes described above may include any of the hardware and/or software described above. All such permutations and combinations are intended to fall within the scope of the present disclosure.
  • Processes of the instant disclosure may be implemented by performing or completing manually, automatically, or a combination thereof, selected steps or tasks.
  • process may refer to manners, means, techniques and procedures for accomplishing a given task including, but not limited to, those manners, means, techniques and procedures either known to, or readily developed from known manners, means, techniques and procedures by practitioners of the art to which the invention belongs.

Landscapes

  • Health & Medical Sciences (AREA)
  • Physical Education & Sports Medicine (AREA)
  • General Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Studio Devices (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

This invention generally relates to an automated visual enhancement camera system and method, and more particular to an automated visual enhancement camera system and method that enhances guest experience by offering "TV style" view of a guest hitting a golf ball with shot tracer and scoring overlay and by allowing guest to share the experience on social media.

Description

AUTOMATED VISUAL ENHANCEMENT CAMERA SYSTEM AND PROCESS
CROSS REFERENCE TO RELATED APPLICATIONS
[0001] The application claims the benefit of and priority to U.S. Provisional Patent
Application No. 62/650,730, filed March 30, 2018, and incorporates by reference said provisional application in its entirety.
BACKGROUND OF THE INVENTION
1. Field of the Invention.
[0002] This invention relates generally to an automated visual enhancement camera system and method and, more particularly, to systems and methods of automatically augmenting a video of an individual who is striking or throwing an object with the travel path of the object that is struck or thrown.
2. Description of the Related Art.
[0003] The game of golf has remained a popular hobby and recreational activity since it was invented several centuries ago. Part of the popularity of golf comes from pursuing mastery of its various skills. Improving such skills requires frequent and consistent practice. Driving ranges are common venues used for such practice. At typical driving ranges, golfers can practice their swing. Recently, businesses have begun to open more advanced driving ranges focused on entertainment, and therefore feature restaurants, bars, and innovative new golf gaming formats to allow serious golfers and non-golfers to enjoy a recreational version of the sport.
[0004] In parallel to the appearance of such new golfmg/entertainment facilities, various technologies have been employed to assist golfers in improving their game or enhancing the typical practice round. Such technologies include using RF chips, radar, lasers, or optical cameras to track the golfer’s swing and the flight path of the golf ball, and to provide the golfer with useful feedback regarding both. Unfortunately, while each such technology is well-suited for tracking particular parameters of the golf swing or path of the golf ball, none is capable of uninterrupted tracking and providing the golfer with a comprehensive view of their swing and the resulting golf shot. More importantly, systems that provide for such functionality typically involve manual intervention whereby another guest or coach is involved in enhancing the video or picture of the guest’s swing and shot. Accordingly, there is a need for a system and method to utilize the parameters captured by each such technology across a plurality of sensors and present the resulting information in a meaningful manner to the guest and use the entirety of the data points generated to automate the process of collection and presentation to the guest. The invention disclosed herein is focused on solving such long-felt needs and providing the techniques to thereby fulfill those needs.
[0005] It is therefore desirable to provide an automated visual enhancement camera system and method.
[0006] It is further desirable to provide an automated visual enhancement camera system and method that enhances guest experience by offering“TV style” view of a guest hitting a golf ball with shot tracer and scoring overlay.
[0007] It is still further desirable to provide an automated visual enhancement camera system and method that enhances guest experience by allowing the guest to share the enhanced gameplay experience via the numerous electronic channels for distribution such as social media, text messaging, email, etc.
[0008] Before proceeding to a detailed description of the invention, however, it should be noted and remembered that the description of the invention which follows, together with the accompanying drawings, should not be construed as limiting the invention to the examples (or embodiments) shown and described. This is so because those skilled in the art to which the invention pertains will be able to devise other forms of this invention within the ambit of the appended claims. SUMMARY OF THE INVENTION
[0009] In general, the invention relates to an automated visual enhancement camera system and method, and more particular to an automated visual enhancement camera system and method that enhances guest experience by offering a view of a guest hitting a golf ball with shot tracer and scoring overlay of a previously struck golf ball and by allowing guest to share the experience on social media.
[0010] More particularly, some embodiments provide an automated visual enhancement camera system and method that enhances a guest’s experience by offering short video clip or picture view of a guest engaging in entertainment or sports activities that is enhanced with computer generated overlays of a ball and resulting score, personal record, etc. which can then be shared by the guest to friends by mobile phone, PC, social media links and similar methods of digital conveyance. In particular, this invention automatically creates a video clip or still image featuring a guest in a social golf range hitting a golf ball, with the flight of the golf ball and contextually relevant statistics (such as distance, resulting points scored, etc.) rendered into the clip which is then delivered to the guest for sharing by mobile phone, tablet, computer or other electronic means.
[0011] In some variations the guest will be hitting a golf ball in a multi-level, multi- bay golf and entertainment facility. In such an arrangement, the guest might desire the composite video that contains an overlay of the shot to be shared with others in the facility. In some variations, the sharing might be facility wide or in bay only, and in other cases the sharing might involve direct transmission of the enhanced clip or picture directly to other designated guests, some of whom might be in competition with the sharer. In still other variations, the guest might request that the video that includes the traced travel path of the ball be uploaded to a social media account of his or her choice, which might include the social media account of the driving range, the guest’s own personal social media account, etc. In some embodiments, uploading of the video plus the travel path will occur automatically without intervention by the guest except, perhaps, to review the clip or picture and approve its distribution to the channel offered by the invention from a list of such channels.
[0012] In some embodiments, the system collects video clips or pictures of multiple shots of the guest and ranks these relative to the guest’s personal history of play, the history of all of the guests playing the game, etc., and uses pre-established criteria to suggest a choice of clips or pictures to the guest, who can then and thereafter review the clips to choose those to be shared. In some cases, this selection might be done automatically (e.g., the trial with the highest score if scoring is enabled).
[0013] In some cases, the video that is provided to the guest might include, in addition to a trace of the shot, a score, shot statistics or other graphical elements created by the software. In one preferred embodiment, the score might be determined based on distance to a fixed target (e.g., the pin), the flight distance of the ball, the length of the ground path, the total distance traveled, the maximum height of the path, etc. Some variations will allow the guest to use the score to compete with one or more other guests who are present at that golfing facility or even at a remote facility. Additionally, in some cases if the guest has several recorded shots the associated software might rank those shots based on the score and suggest the best one to save or upload.
[0014] In other variations augmented reality (“A.R” or“AR”) might be used to display the path of the ball to the guest using a handheld, personal mobile device or headset. That is, a guest who is provided with an AR headset might see the path of the ball drawn on a real-time view of the driving range. In some cases, if the computer power is available, the ball’s path will be traced in real time and displayed within the AR headset. In other embodiments, the path of the ball will be displayed within the AR headset some time after the ball is struck (e.g., a replay) to allow time for the path to be calculated. In other variations, all of the shots by all of the guests in a venue could be displayed simultaneously, giving the guest a view of multiple balls in flight on the AR device of choice and/or the composite AR video might be transmitted to other / designated users (e.g., competitors) or uploaded to a server from which it can be viewed by others (e.g., to social media).
[0015] The foregoing has outlined in broad terms some of the more important features of the invention disclosed herein so that the detailed description that follows may be more clearly understood, and so that the contribution of the instant inventors to the art may be better appreciated. The instant invention is not to be limited in its application to the details of the construction and to the arrangements of the components set forth in the following description or illustrated in the drawings. Rather, the invention is capable of other embodiments and of being practiced and carried out in various other ways not specifically enumerated herein. Finally, it should be understood that the phraseology and terminology employed herein are for the purpose of description and should not be regarded as limiting, unless the specification specifically so limits the invention.
BRIEF DESCRIPTION OF THE DRAWINGS
[0016] These and further aspects of the invention are described in detail in the following examples and accompanying drawings.
[0017] Fig. 1 illustrates a rear perspective view showing an example of an automated visual enhancement camera system in accordance with an illustrative embodiment of the system and process disclosed herein.
[0018] Fig. 2 is a top perspective view of the automated visual enhancement camera system shown in Figure 1.
[0019] Fig. 3 contains a schematic illustration of an operating logic suitable for use with an embodiment.
[0020] Fig. 4 contains a schematic illustration of a guest participating in an embodiment with Fig. 4A illustrating the guest as s/he swings at the ball and Fig. 4B illustrating an outcome after the ball has been landed and a score has been awarded.
[0021] Fig. 5 (i.e., Fig. 5A and 5B) contains a more detailed schematic illustration of an operating logic suitable for use with an embodiment.
DETAILED DESCRIPTION OF THE INVENTION
[0022] While this invention is susceptible of embodiment in many different forms, there is shown in the drawings, and will herein be described hereinafter in detail, some specific embodiments of the instant invention. It should be understood, however, that the present disclosure is to be considered an exemplification of the principles of the invention and is not intended to limit the invention to the specific embodiments or algorithms so described.
[0023] The invention relates to an automated visual enhancement camera system and method, and more particular to an automated visual enhancement camera system and method that enhances guest experience by offering“TV style” view of a guest hitting a golf ball with shot tracer and scoring overlay and by allowing guest to share the resulting composite video as represented by that experience on social media.
[0024] Figure 1 shows a driving range 10 that includes at least one hitting station 100, at least one golf ball 110, at least one golf club 120, and a range surface 200 that is proximate to the hitting station 100. The hitting station 100 is positioned at one end of the range surface 200 and contains at least one tee box therein (not pictured). It will be understood that a guest
300 standing in the hitting station 100 may swing the golf club 120 to hit the golf ball 110 over and onto the range surface 200. Note that in certain especially preferred arrangements, the hitting station 100 will be one of many such stations that are contained within a multi-level multi-bay driving range. Those of ordinary skill in the art will recognize that such facilities can be found in most major U.S. cities and elsewhere around the world.
[0025] Note that the term“hitting station” should be broadly construed as the starting location for a guest who is being videoed interacting with an object with the expectation that the path of the object that is hit, thrown, or rolled will be tracked and overlaid on the video of the guest. [0026] Turning to Figure 2, shown therein is schematic representation of a plan (top down) view of the path that the golf ball 110 travels from the point of impact with the golf club 120 (referred to as the origination point 160) to the point that the golf ball 110 initially impacts the range surface 200 (referred to as the impact point 170). The path the golf ball 110 travels from the origination point 160 to the impact point 170 is referred to as the flight path 130. The path that the golf ball 110 travels from the impact point 170 to the point it comes to rest on the range surface 200 (referred to as the resting point 180) is referred to as the ground path 140. The total travel path 150 refers to the complete path that the golf ball 110 travels after the origination point 150 to the resting point 180, and is equivalent to the combination of the flight path 130 and the ground path 140. Figure 2 depicts the flight path 130, ground path 140 and total travel path 150 of a golf ball 110.
[0027] Figures 1 and 2 exemplify an embodiment of the inventive system configured to track the total travel path 150 of the golf balls 110 used at a driving range 10 and to display that total travel path 150 to the guest 300. The system preferably includes one or more digital video cameras and/or digital video recorder system 410 in the rear of the hitting station 100 that face toward the range surface 200, a plurality of sensors 420 and 430 that are advantageously positioned downfield of the guest 300, a display device 450, and a computer having a CPU / processor and access to a locally stored or remotely stored database. The information that is captured might be stored locally or transmitted to a remote location (either in real time or subsequent transmission) by a wired or wireless connection to a central server that receives and stores and/or processes that information. Of course, those of ordinary skill in the art will recognize that the computer might be connected by wires or wirelessly to a local or wide area network (“LAN” or“WAN”). Additionally, in some embodiments the computer will be in electronic communication with the Internet and programmable to store and retrieve information from that source. [0028] The digital camera / recorder 410 system is configured in some embodiments to continuously record activity in the hitting station 110, and may be positioned approximately ten (10) to fifteen (15) feet behind the guest 300. It will be understood that by those skilled in the art that there are numerous types of video cameras, recorders, sensors and other technologies available for recording the guest 300 hitting the golf ball 110 from the hitting station 100. It should also be understood that each such recorder 410 assembly might be connected via a wire or wirelessly to one or more other computers via a LAN or WAN and possibly the Internet as well.
[0029] Each sensor in the plurality of sensors 420/430 is configured to record certain parameters about the total travel path 150 of a struck golf ball. Such parameters may include, without any limitation, the detection of the moment of impact, the origination point 150, the launch angle of the flight path 130, side spin of the golf ball 110, vertical spin of the golf ball 110, initial location of the golf ball 110, the impact point 160, speed/velocity of the golf ball 100 on the flight path 130, the three-dimensional coordinates of the flight path 130, the three- dimensional coordinates of the ground path 140, and the resting point 180. In addition, certain other sensors that may be situated proximate to the guest 300 may be configured to detect other parameters related to the golf swing of the guest 300, including but not limited to the guest’s stance and location within the hitting station 100, the path of the moving club, the club speed/velocity, etc.
[0030] It will be understood that by those skilled in the art that there are numerous types of sensors and technologies available for the detection of parameters, including for example and without limitation, infrared beam sensors, radar sensors, pressure sensors, sound sensors, laser sensors, and cameras (both infrared and visible light). It will be further understood that certain sensors are capable of detecting a subset of the total parameters available about the total travel path 150. In some embodiments, the sensors might be any suitable sensor that can be used to detect the movement of an object through three-dimensional space, such as GPS, LIDAR, radar, optical or other sensors positioned on the range building, around the range, and/or on the moving target.
[0031] It will be understood that numerous embodiments of the system are possible by including different types of cameras 410 and/or sensors 420 and 430 in the plurality of sensors, and positioning those cameras and sensors at different places around the driving range 10.
[0032] The database of the computer stores all parameters necessary for the system, which may include the size, shape and location of the hitting stations, the location of each of the cameras in the hitting stations, the video that each of the cameras records, the location of each of the sensors in the plurality of sensors, the parameters that each of the sensors in the plurality of sensors can detect, the location and boundaries of the range surface, and the number, expected distance and trajectory of shots hit with the selected golf club. Such parameters are retrieved by the processor as needed to operate the system.
[0033] In one embodiment, during game play the camera 410 is positioned approximately ten (10) to fifteen (15) feet behind the mat in the hitting station 100, and the camera 410 is configured to continuously capture the golf swing of the guest 300 while hitting the golf ball 110. The tracking sensors 420 and 430 are configured to detect and report ball launch position and ball flight position to the computer. The computer with game software and/or the sensors 420 and 430 are configured to log in-game results, such as hit a bull’s eye, a card, a green or the like depending upon the type of game being played.
[0034] In some embodiments the computer compiles golf shot data for each guest, and scores or grades ball flight / shot results by guest according to a variety of different game goals. The computer can grade or score ball flights/shots in a variety of manners, such as scoring on a five (5) point scale (l=terrible, 3=average, 5=outstanding). In some cases, a video of the guest’s swing that also shows the ball trajectory (discussed further below) might be provided to the guest might include, in addition to a trace of the shot, a score of some sort. The score might be determined based on a distance from a fixed target (e.g., the pin), the flight distance of the ball, the length of the ground path, the total distance traveled, the maximum height of the path, etc. Some variations will allow the guest to use the score to compete with one or more other guests who are present at that driving facility or even at a remote facility. Those of ordinary skill in the art will readily be able to devise systems of scoring that could be used either by the guest for personal improvement or in a competition of some sort.
[0035] In addition, the computer can be configured to score game play relative to the guest’s typical golf shot and frequency of a shot within“conforming shot characteristics” and/or skill level selected in the particular game. Moreover, the computer may compare shot data to a“perfect” shot that launches and flies with characteristics similar to those for PGA or LPGA guests hitting the same club, and the guest may then earn a“Pro” badge for each club if PGA/LPGA tag hits.
[0036] The automated visual enhancement camera system and method allows the guest 300 to review the video recorded by the camera 410, which shows the guest 300 swinging the golf club 120 from behind, and based on the computer calculations, the display 450 shows the trajectory of the golf ball 110 via highlight or“tracer” from the impact point 160 until the resting point 180 on the range surface 200. In addition, the display 450 in conjunction with the camera 410 can be configured to display in-game results as part of the video feed. Moreover, the system and method can show in-game context or leaderboard and/or present a social media options to the guest 300. The game play can be further enhanced by enabling the guest 300 to also earn a“Social Butterfly” badge or other badge for sharing shots on social media.
[0037] In some embodiments the guest might desire that the video with the trajectory overlay should be shared with others in the facility or elsewhere. In some variations, the sharing might be facility wide or in bay only, and in other cases the sharing might be directed toward certain other designated guests, some of whom might be in competition with the sharer, e.g., attempting to get the best score on a scored embodiment. In still other variations, the guest might request that the video that includes the traced travel path of the ball be uploaded to a social media account of his or her choice, which might include the social media account of the driving range, the guest’s own personal social media account, etc. In some embodiments, the uploading of the video plus travel path will occur automatically without intervention by the guest except, perhaps, to indicate to the driving range computer system that such has been requested.
[0038] In some embodiments, multiple golf ball trajectories of the guest might be collected and the user might be allowed to choose a“best” shot or outcome for sharing with others. In some cases, this selection might be done automatically (e.g., the drive with the highest score might be automatically chosen if scoring is enabled).
[0039] Turning next to Fig.3, this figure contains an embodiment of an operating logic suitable for use with the instant disclosure. In this variation, the guest will be recognized (box 305) which might involve logging into the range computer system, presenting a fob or barcode that is recognized, etc. Forms of identifying an individual to a computer system are well known and need not be further described here. The digital video recording system and sensors will need to be activated (box 310). That might happen after the guest is identified or before. Either approach could readily be used.
[0040] The guest can now strike the ball and its flight path will be captured using the video and sensors described previously according to methods well known to those of ordinary skill in the art (box 315). The information provided by video and sensors will then be used to calculate the 3D path of the ball (box 320) and the calculated path will be used to overlay a video of the guest striking the ball (box 325), where is the path would typically be displayed from the point of view of the location of the video recording system that was used. In some embodiments, the video that is used will be taken from the video recording system 410 that is situated behind the guest. In other embodiments, the video might come from one or more video recording systems that are situated elsewhere. Of course, those of ordinary skill in the art will understand how the path of an object moving through 3D space may be projecting onto the frames of a video recording, given the location from which the video was recorded. As such, that aspect of the invention will not be discussed further here. Of course, in some cases there might be additional video recording systems situated within the hitting station. A video recording system that was situated above the guest would make it easier to review certain aspects of the guest’s swing and could be added (e.g., as picture-in-picture) to the recorded video from elsewhere in the hitting box if that were desired.
[0041] If scoring is enabled for this user (the“YES” branch of decision box 330) some of the video and/or sensors will be used to determine a score for this particular flight event (box 335). As described previously, this score might be determined many different ways. The score that is determined might be presented to the guest by overlaying the score on the video, transmitted it to the guest via a text message, email, etc. However, in most cases the score will be made a part of the video in some way (box 335) if the guest has elected to participate in a game.
[0042] Whether or not the guest is participating in a game, the composite video that includes at least a representation of the track of the ball will be presented to the guest. This might be done using a video display device 450 that is situated in the hitting box. It might also be done, in addition or alternatively, by transmitting it (e.g., via Wi-Fi, Bluetooth, etc.) the video to the guest’s smart phone device, or by link to a computer or networked storage device maintained at the golf range or in the cloud.
[0043] After viewing the video, the guest will be given the option (the“YES” branch of decision item 345) to share the video with others. As explained previously, the shared video might go to others who are competing (or not) with that guest at the same facility, to others who the elsewhere, and/or to a social media account. If the guest has elected“automatic posting”, the decision item 346 will be bypassed and the controlling software will proceed to transmit the video to the selected display devices / users and/or to a social media platform. With respect to the social media platform, if the transmission is to be to the guest’s own account, identifying information would need to be provided to the controlling software that would enable such a posting. On the other hand, if the social media account is one controlled by driving range personnel, then the video could be automatically uploaded to that account without further input from the guest.
[0044] The guest might determine to hit another ball (the“YES” branch of decision item 355). This could be for many reasons, but among them are that the guest is attempting to get a better score than the previous attempt or the video was for some other reason unacceptable. In some case, one or more previous attempts might be saved by the controlling computer system so that the guest would have the option of selecting which one was preferred for sharing with others or selecting one or more videos for which should be saved for personal review in the future.
[0045] If guest has determined not to have additional hit tracked and scored (the“NO” branch of decision item 355) the software will, in some embodiments, save some or all of the guest’s video(s) to local, remote, or cloud-based storage according to methods well known to those of ordinary skill in the art. In other embodiments, the software will simply reset (return to box 305) and prepare for the next guest.
[0046] Turning next to Fig. 4, this figure contains a schematic representation of a guest who is participating in an activity where the final resting position of the golf ball 110 is awarded a score based on its distance from a target 385. In Fig. 4A the guest 300 is shown to be swinging along arc 380 at the ball 110. In this embodiment, the flight path of the ball 150 results in a landing as shown in Fig. 4B and the resulting score / message which will be displayed to the guest on a display device in connection with the composite video which also shows the flight path of the ball 110.
[0047] Figs. 5A and 5B contains a more detailed operating logic suitable with an embodiment. In practice, a guest will arrive at a facility that utilizes an embodiment and be assigned a bay, enter it, and log into the facility computer (boxes 502-506). The software necessary to implement a particular game will be loaded and made available to each guest (if there are more than one) that is participating (e.g., if a competition is taking place, box 514). The video recording system and sensors will be read in anticipation of the guest hitting the ball (box 538). As is generally indicated, preferably the bay will have been calibrated to the location where the ball is placed (box 536).
[0048] As the recording of video and senor data takes place, the guest will hit the ball (box 532) and tracking of the flight of the ball will begin (box 540). The sensor and video information will be used to render the flight of the ball in the game environment and the result, preferably including a score, will be displayed to the user (box 516) and the recording / tracking will stop (box 534). Preferably, the resulting video stream will be marked with the start time of the event (e.g.“at +x seconds” from the start of the recording). The guest will be given the option of tracking another effort (boxes 518 and 520) and, if the guest so desires, decision item 510 will return to the start of the process (box 508). If the guest is done, the video clip will be marked with user identification, session, date, etc., and be saved to disk (box 546). In some variations, shot ranks will be applied based on the guest, group in session, etc., and for the venue, game, practice, age of the guest, etc., and clips are generated using pre-set criteria.
[0049] The guest may be offered a choice to share the only (or a selected one of a plurality) of clips with others (boxes 548, 522, 524, and 512). The guest will be shown the clip that is proposed to be transmitted and given the option of how to deliver a link to it (e.g., SMS, Facebook, phone app, etc.). If the guest elects to share the clip that had been reviewed, preferably the clip will be compressed (box 550) and an endpoint link generated to transfer to guest’s choice of recipients. The link will be transmitted to each recipient (box 552). The guest will then be offered the option to create another video (box 526) and, if that is declined, the game will end (box 528).
[0050] At the conclusion of a gaming session, recording will end (box 544), all clips will be saved and associated with the particular guest and session (box 554), the final rankings (based on game score) will be retrieved (box 570) and those values will be combined with the video clips and moved to storage, after which each guest will be offered a choice of the recorded clips.
[0051] Additionally, note that any of the steps 502, 504, 506, 508, 510, and 512 might be either signaled to the instant system by using a terminal proximate to the bay where the guest is situated or, in some alternatives, these sorts of steps might be performed using the guest’s smart phone or other mobile device which has been configured to communicate with the facility’ s computer system, which communication is established according to methods well known to those of ordinary skill in the art.
[0052] In addition, the computer of the inventive system and method can be configured to store the top number of positions, shots of the week or the like from any game play contest. In addition, the highlight or tracer shot can be streamed to any monitor in the driving range 10 or via a suitable app. The app would further allow the guest 300 to share his/her post- experience on social media or otherwise.
[0053] Further, the instant system should not be seen as being limited to creating a composite video of the path of a struck golf ball that is overlain with a video of a golfer hitting the ball. The same technology could be applied to individuals who are hitting a baseball, rolling a bowling ball, etc. Further, the point of view of the composite video could originate from behind or atop the individual who is participating in this activity. Those of ordinary skill in the art will be readily able to adapt the techniques taught herein to other sports and other objects hit, thrown, or rolled, etc.
[0054] As used herein, the term“computer” may refer, but is not limited to a laptop or desktop computer, or a mobile device, such as a desktop, laptop, tablet, cellular phone, smart phone, personal media user ( e.g ., iPod), wearable computer, implantable computer, or the like. Such computing devices may operate using one or more operating systems, including, but not limited to, Windows, MacOS, Linux, Unix, iOS, Android, Chrome OS, Windows Mobile, Windows CE, Windows Phone OS, Blackberry OS, and the like.
[0055] As used herein, the term“mobile device” may refer, but is not limited to any computer, as defined herein, that is not fixed in one location. Examples of mobile devices include smart phones, personal media users, portable digital assistants, tablet computers, wearable computers, implanted computers, and laptop computers.
[0056] The system and process described herein may be deployed in part or in whole through network infrastructures. The network infrastructure may include elements such as computing devices, servers, routers, hubs, firewalls, clients, personal computers, communication devices, routing devices and other active and passive devices, modules and/or components as known in the art. The computing and/or non-computing device(s) associated with the network infrastructure may include, apart from other components, a storage medium such as flash memory, buffer, stack, RAM, ROM and the like. The processes, methods, program codes, instructions described herein and elsewhere may be executed by one or more of the network infrastructural elements.
[0057] The computer software, program codes, and/or instructions may be stored and/or accessed on machine readable media that may include: computer components, devices, and recording media that retain digital data used for computing for some interval of time; semiconductor storage known as random access memory (RAM); mass storage typically for more permanent storage, such as optical discs, forms of magnetic storage like hard disks, tapes, drums, cards and other types; processor registers, cache memory, volatile memory, non-volatile memory; optical storage such as CD, DVD; removable media such as flash memory (e.g. USB sticks or keys), floppy disks, magnetic tape, paper tape, punch cards, standalone RAM disks, Zip drives, removable mass storage, off-line, and the like; other computer memory such as dynamic memory, static memory, read/write storage, mutable storage, read only, random access, sequential access, location addressable, file addressable, content addressable, network attached storage, storage area network, bar codes, magnetic ink, and the like.
[0058] The systems and/or processes described herein, and steps thereof, may be realized in hardware, software or any combination of hardware and software suitable for a particular application. The hardware may include a general-purpose computer and/or dedicated computing device or specific computing device or particular aspect or component of a specific computing device. The processes may be realized in one or more microprocessors, microcontrollers, embedded microcontrollers, programmable digital signal processors or other programmable device, along with internal and/or external memory. The processes may also, or instead, be embodied in an application specific integrated circuit, a programmable gate array, programmable array logic, or any other device or combination of devices that may be configured to process electronic signals. It will further be appreciated that one or more of the processes may be realized as a computer executable code capable of being executed on a machine-readable medium.
[0059] The computer executable code may be created using a structured programming language such as C, an object oriented programming language such as .NET and C++, a lightweight data-interchange programming language such as JavaScript Object Notation (JSON) data-interchange format over HTTP POST request/response, or any other high-level or low-level programming language (including assembly languages, hardware description languages, and database programming languages and technologies) that may be stored, compiled or interpreted to run on one of the above devices, as well as heterogeneous combinations of processors, processor architectures, or combinations of different hardware and software, or any other machine capable of executing program instructions.
[0060] Thus, in one aspect, each process described above and combinations thereof may be embodied in computer executable code that, when executing on one or more computing devices, performs the steps thereof. In another aspect, the processes may be embodied in systems that perform the steps thereof, and may be distributed across devices in a number of ways, or all of the functionality may be integrated into a dedicated, standalone device or other hardware. In another aspect, the means for performing the steps associated with the processes described above may include any of the hardware and/or software described above. All such permutations and combinations are intended to fall within the scope of the present disclosure.
[0061] It is to be understood that the terms“including”,“comprising”,“consisting” and grammatical variants thereof do not preclude the addition of one or more components, features, steps, or integers or groups thereof and that the terms are to be construed as specifying components, features, steps or integers.
[0062] If the specification or claims refer to“an additional” element, that does not preclude there being more than one of the additional element.
[0063] It is to be understood that where the claims or specification refer to“a” or“an” element, such reference is not be construed that there is only one of that element.
[0064] It is to be understood that where the specification states that a component, feature, structure, or characteristic“may”, “might”, “can” or“could” be included, that particular component, feature, structure, or characteristic is not required to be included. [0065] It is to be understood that were the specification or claims refer to relative terms, such as“front,”“rear,”“lower,”“upper,”“horizontal,”“vertical,”“above,”“below,”“up,” “down,”“top,”“bottom,”“left,” and“right” as well as derivatives thereof (e.g.,“horizontally,” “downwardly,”“upwardly” etc.), such reference is used for the sake of clarity and not as terms of limitation, and should be construed to refer to the orientation as then described or as shown in the drawings under discussion. These relative terms are for convenience of description and do not require that the apparatus be constructed or the process to be operated in a particular orientation.
[0066] Where applicable, although state diagrams, flow diagrams or both may be used to describe embodiments, the invention is not limited to those diagrams or to the corresponding descriptions. For example, flow need not move through each illustrated box or state, or in exactly the same order as illustrated and described.
[0067] Processes of the instant disclosure may be implemented by performing or completing manually, automatically, or a combination thereof, selected steps or tasks.
[0068] The term“process” may refer to manners, means, techniques and procedures for accomplishing a given task including, but not limited to, those manners, means, techniques and procedures either known to, or readily developed from known manners, means, techniques and procedures by practitioners of the art to which the invention belongs.
[0069] It should be noted that where reference is made herein to a process comprising two or more defined steps, the defined steps can be carried out in any order or simultaneously (except where context excludes that possibility), and the process can also include one or more other steps which are carried out before any of the defined steps, between two of the defined steps, or after all of the defined steps (except where context excludes that possibility). [0070] Still further, additional aspects of the instant invention may be found in one or more appendices attached hereto and/or filed herewith, the disclosures of which are incorporated herein by reference as if fully set out at this point.
[0071] Thus, the present invention is well adapted to carry out the objects and attain the ends and advantages mentioned above as well as those inherent therein. While the inventive concept has been described and illustrated herein by reference to certain illustrative embodiments in relation to the drawings attached thereto, various changes and further modifications, apart from those shown or suggested herein, may be made therein by those of ordinary skill in the art, without departing from the spirit of the inventive concept the scope of which is to be determined by the following claims.

Claims

WHAT IS CLAIMED IS:
1. An automated visual enhancement camera system, comprising:
(a) a hitting station;
(b) a tee box within said hitting station for use by a guest when the guest is striking a golf ball;
(c) at least one digital video camera positioned at a rear of said hitting station and oriented toward a range surface proximate to said hitting station, said at least one digital video camera at least for capturing a digital video of the guest when the guest strikes the golf ball;
(d) at least one sensor remote from said at least one digital video camera, said at least one sensor oriented to follow a flight of the golf ball toward the range surface after it is struck by the guest;
(e) a computer in communication with said at least one sensor and said at least one digital video camera, said computer containing programming instructions executable by said computer comprising the steps of:
(1) using said at least sensor and said at least one digital video camera to calculate a 3D flight path of said struck golf ball,
(2) overlaying said digital video with said calculated 3D flight path of said struck golf ball, thereby creating a composite video, and
(f) displaying for the user said composite video on said display device.
2. A method of creating a video work, comprising the steps of:
(a) orienting a video camera to include an image of a guest;
(b) orienting at least one sensor remote from said guest to sense a golf ball struck by said guest; (c) allowing the guest to strike the golf ball in a direction of said sensor while said video camera is recording said guest;
(d) receiving from said at least one sensor a plurality of digital values representative of a flight of said struck golf ball;
(e) receiving from said at least one video camera a video of said guest striking the ball;
(f) using said received plurality of digital values representative of a flight of said struck golf ball and said received video of said guest striking the ball to calculate a total travel path of the struck golf ball;
(g) overlaying said video of said guest striking the ball with a representation of at least a portion of said total travel path of the struck golf ball, thereby creating a composite video; and
(h) displaying to the guest said composite video.
3. The method according to claim 2, wherein step (g) comprises the steps of:
(gl) using at least a portion of said total travel path of the struck golf ball to automatically assign a score to the guest’s struck golf ball; and,
(g2) displaying to the guest said assigned score and said composite video.
3. The method according to claim 2, wherein step (g) comprises the steps of:
(gl) using at least a portion of said total travel path of the struck golf ball to automatically assign a score to the guest’s struck golf ball; and,
(g2) displaying to the guest said assigned score and said composite video.
4. The method according to claim 2, wherein step (h) comprises the step of: (hl) displaying to the guest said composite video on the guest’s display device.
5. The method according to claim 4, wherein the guest’s display device is a smart phone.
6. The method according to claim 2, further comprising the steps of:
(i) allowing the guest to select one or more recipients of said composite video; and
(j) transmitting said composite video to each of said one or more recipients.
7. The method according to claim 6, wherein step (k) wherein at least one of said one or more recipients is a social media platform.
8. The method according to claim 6, wherein step (k) is performed automatically without intervention by the guest.
9. The method according to claim 2, further comprising the step of:
(i) storing said composite video.
10. The method according to claim 2, wherein at least steps (c) through (h) are performed a plurality of times, thereby producing a plurality of composite videos.
11. The method according to claim 10, wherein the guest is allowed to choose a best one of said plurality of composite videos.
12. The method according to claim 10, wherein each of said plurality of composite videos is assigned a score and wherein a best one of said plurality of composite videos is selected automatically based on a highest score of the plurality of videos.
13. The method according to claim 11, further comprising the steps of:
(1) allowing the guest to select one or more recipients of said best one of said plurality of composite videos; and
(2) transmitting said best one of said plurality of composite videos to each of said one or more recipients.
14. An automated visual enhancement camera system for capturing a guest’s performance while hitting, throwing, or rolling an object, comprising:
(a) a hitting station, said hitting station providing a starting location for the guest’s performance;
(b) at least one digital video camera positioned to capture the guest’s performance within the hitting station and to capture the path of the hit, thrown, or rolled object;
(b) at least one sensor remote from said at least one digital video camera, said at least one sensor oriented to follow a path of said hit, thrown, or rolled object after it is hit, thrown or rolled away by the guest;
(c) a computer in communication with said at least one sensor and said at least one digital video camera, said computer containing programming instructions executable by said computer comprising the steps of:
(1) using said at least sensor and said at least one digital video camera to calculate a 3D path of said hit, thrown, or rolled object, (2) overlaying said digital video with said calculated 3D flight path of said struck golf ball, thereby creating a composite video, and
(f) displaying for the user said composite video on said display device.
15. The automated visual enhancement camera system according to claim 14, wherein said object is a golf ball and said digital video captures images of the guest hitting the golf ball.
EP19776315.4A 2018-03-30 2019-04-01 Automated visual enhancement camera system and process Withdrawn EP3773946A4 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201862650730P 2018-03-30 2018-03-30
PCT/US2019/025208 WO2019191769A1 (en) 2018-03-30 2019-04-01 Automated visual enhancement camera system and process

Publications (2)

Publication Number Publication Date
EP3773946A1 true EP3773946A1 (en) 2021-02-17
EP3773946A4 EP3773946A4 (en) 2022-01-12

Family

ID=68054586

Family Applications (1)

Application Number Title Priority Date Filing Date
EP19776315.4A Withdrawn EP3773946A4 (en) 2018-03-30 2019-04-01 Automated visual enhancement camera system and process

Country Status (6)

Country Link
US (1) US20190299056A1 (en)
EP (1) EP3773946A4 (en)
JP (1) JP2021531052A (en)
KR (1) KR20200139754A (en)
CN (1) CN112218692A (en)
WO (1) WO2019191769A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102505470B1 (en) * 2021-04-05 2023-03-03 이재복 Management system of screen golf using LiDAR sensor and big-data

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5342054A (en) * 1993-03-25 1994-08-30 Timecap, Inc. Gold practice apparatus
US20030109322A1 (en) * 2001-06-11 2003-06-12 Funk Conley Jack Interactive method and apparatus for tracking and analyzing a golf swing in a limited space with swing position recognition and reinforcement
US20060063574A1 (en) * 2003-07-30 2006-03-23 Richardson Todd E Sports simulation system
WO2009020886A1 (en) * 2007-08-03 2009-02-12 Pro Tee Systems, Inc. Golf gaming systems and methods
US9661894B2 (en) * 2008-02-20 2017-05-30 Nike, Inc. Systems and methods for storing and analyzing golf data, including community and individual golf data collection and storage at a central hub
TWI481438B (en) * 2009-12-31 2015-04-21 Golfzon Co Ltd Apparatus and method for virtual golf simulation
KR100970677B1 (en) * 2009-12-31 2010-07-15 (주) 골프존 Virtual golf simulation device providing putting-guide
KR101270489B1 (en) * 2010-05-06 2013-06-03 이재복 HMD for golf simulation
US9604142B2 (en) * 2010-08-26 2017-03-28 Blast Motion Inc. Portable wireless mobile device motion capture data mining system and method
FR3007294B1 (en) * 2013-06-25 2015-07-31 Jean-Pierre Dolige DATA COLLECTION SYSTEM FOR GOLF
WO2015155725A1 (en) * 2014-04-09 2015-10-15 Glen Abbott As Trustee For The Abbott Family Trust Method of sharing action highlights and a sports complex for providing shareable action
US9555284B2 (en) * 2014-09-02 2017-01-31 Origin, Llc Multiple sensor tracking system and method
KR101713029B1 (en) * 2014-12-15 2017-04-06 주식회사 코드컴 Golf score management system

Also Published As

Publication number Publication date
EP3773946A4 (en) 2022-01-12
WO2019191769A1 (en) 2019-10-03
US20190299056A1 (en) 2019-10-03
CN112218692A (en) 2021-01-12
KR20200139754A (en) 2020-12-14
JP2021531052A (en) 2021-11-18

Similar Documents

Publication Publication Date Title
US11941915B2 (en) Golf game video analytic system
US9975031B2 (en) Public safety and commercial delivery management system integrating activity and event performance data collection
US20230122348A1 (en) Artificial intelligence-enabled golf course
US11956572B2 (en) Autonomous golf competition systems and methods
US20150189243A1 (en) Automated video production system
JP2023169203A5 (en)
US20200038743A1 (en) Gaming apparatus and a method for operating a game
US11729490B2 (en) Autonomous digital media processing systems and methods
WO2015155725A1 (en) Method of sharing action highlights and a sports complex for providing shareable action
US20220355210A1 (en) Virtual sports device and virtual sports system
US20210383124A1 (en) Autonomous activity monitoring system and method
US20190299056A1 (en) Automated visual enhancement camera system and process
US20230381625A1 (en) Autonomous digital media processing systems and methods
JPWO2021248050A5 (en)
KR20230136883A (en) Golf ball position tracking system and method using artificial intelligence algorithm
KR20210055243A (en) A billiard room video system that enables simulation games based on real shot images
Zaman Comprehensive Study on Sports Technology
CA3208026A1 (en) Autonomous digital media processing systems and methods
KR20240035784A (en) Virtual golf device and virtual golf system providing the play review information

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20201029

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20211210

RIC1 Information provided on ipc code assigned before grant

Ipc: A63B 71/06 20060101ALI20211206BHEP

Ipc: A63B 57/00 20150101ALI20211206BHEP

Ipc: H04N 7/18 20060101ALI20211206BHEP

Ipc: A63B 24/00 20060101ALI20211206BHEP

Ipc: G06T 11/60 20060101AFI20211206BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20220716