US20230388640A1 - Portable system including motorized base controller and transmitter for tracking a moving target - Google Patents
Portable system including motorized base controller and transmitter for tracking a moving target Download PDFInfo
- Publication number
- US20230388640A1 US20230388640A1 US18/225,434 US202318225434A US2023388640A1 US 20230388640 A1 US20230388640 A1 US 20230388640A1 US 202318225434 A US202318225434 A US 202318225434A US 2023388640 A1 US2023388640 A1 US 2023388640A1
- Authority
- US
- United States
- Prior art keywords
- smart device
- gps
- motor
- base unit
- smart phone
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000000386 athletic effect Effects 0.000 claims abstract description 20
- 238000004891 communication Methods 0.000 claims description 28
- 230000015654 memory Effects 0.000 claims description 13
- 239000000872 buffer Substances 0.000 claims description 7
- 239000006260 foam Substances 0.000 claims description 5
- 239000004033 plastic Substances 0.000 claims description 5
- 229920003023 plastic Polymers 0.000 claims description 5
- 238000003384 imaging method Methods 0.000 claims description 4
- 229920001971 elastomer Polymers 0.000 claims description 2
- 230000006870 function Effects 0.000 description 18
- 238000000034 method Methods 0.000 description 15
- 230000001681 protective effect Effects 0.000 description 8
- 230000008859 change Effects 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 230000008901 benefit Effects 0.000 description 5
- 238000010276 construction Methods 0.000 description 5
- 238000012937 correction Methods 0.000 description 5
- -1 polypropylene Polymers 0.000 description 4
- 101100182248 Caenorhabditis elegans lat-2 gene Proteins 0.000 description 3
- 239000004698 Polyethylene Substances 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 210000000245 forearm Anatomy 0.000 description 3
- 229920000573 polyethylene Polymers 0.000 description 3
- 101100182247 Caenorhabditis elegans lat-1 gene Proteins 0.000 description 2
- 229920002943 EPDM rubber Polymers 0.000 description 2
- LYCAIKOWRPUZTN-UHFFFAOYSA-N Ethylene glycol Chemical compound OCCO LYCAIKOWRPUZTN-UHFFFAOYSA-N 0.000 description 2
- 239000004721 Polyphenylene oxide Substances 0.000 description 2
- 239000004743 Polypropylene Substances 0.000 description 2
- 229920002877 acrylic styrene acrylonitrile Polymers 0.000 description 2
- 238000013459 approach Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 210000003414 extremity Anatomy 0.000 description 2
- 229920005669 high impact polystyrene Polymers 0.000 description 2
- 239000004797 high-impact polystyrene Substances 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 229920003229 poly(methyl methacrylate) Polymers 0.000 description 2
- 239000004417 polycarbonate Substances 0.000 description 2
- 229920000515 polycarbonate Polymers 0.000 description 2
- 239000004926 polymethyl methacrylate Substances 0.000 description 2
- 229920006380 polyphenylene oxide Polymers 0.000 description 2
- 229920001155 polypropylene Polymers 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 206010013082 Discomfort Diseases 0.000 description 1
- JOYRKODLDBILNP-UHFFFAOYSA-N Ethyl urethane Chemical compound CCOC(N)=O JOYRKODLDBILNP-UHFFFAOYSA-N 0.000 description 1
- WHXSMMKQMYFTQS-UHFFFAOYSA-N Lithium Chemical compound [Li] WHXSMMKQMYFTQS-UHFFFAOYSA-N 0.000 description 1
- 239000004677 Nylon Substances 0.000 description 1
- 229920002292 Nylon 6 Polymers 0.000 description 1
- 229920002302 Nylon 6,6 Polymers 0.000 description 1
- 239000004952 Polyamide Substances 0.000 description 1
- 239000004793 Polystyrene Substances 0.000 description 1
- 229920000535 Tan II Polymers 0.000 description 1
- 150000001241 acetals Chemical class 0.000 description 1
- NIXOWILDQLNWCW-UHFFFAOYSA-N acrylic acid group Chemical group C(C=C)(=O)O NIXOWILDQLNWCW-UHFFFAOYSA-N 0.000 description 1
- 239000004676 acrylonitrile butadiene styrene Substances 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 238000005452 bending Methods 0.000 description 1
- 230000010267 cellular communication Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- WGCNASOHLSPBMP-UHFFFAOYSA-N hydroxyacetaldehyde Natural products OCC=O WGCNASOHLSPBMP-UHFFFAOYSA-N 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 229910052744 lithium Inorganic materials 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 229920001778 nylon Polymers 0.000 description 1
- 238000011022 operating instruction Methods 0.000 description 1
- 238000011017 operating method Methods 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 238000004091 panning Methods 0.000 description 1
- 229920002647 polyamide Polymers 0.000 description 1
- 229920000728 polyester Polymers 0.000 description 1
- 229920005644 polyethylene terephthalate glycol copolymer Polymers 0.000 description 1
- 229920001470 polyketone Polymers 0.000 description 1
- 229920000642 polymer Polymers 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 230000000153 supplemental effect Effects 0.000 description 1
- 229920002994 synthetic fiber Polymers 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000001755 vocal effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/765—Interface circuits between an apparatus for recording and another apparatus
- H04N5/77—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
- H04N5/772—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera the recording apparatus and the television camera being placed in the same enclosure
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/695—Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B24/00—Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
- A63B24/0003—Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B24/00—Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
- A63B24/0021—Tracking a path or terminating locations
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B71/00—Games or sports accessories not covered in groups A63B1/00 - A63B69/00
- A63B71/08—Body-protectors for players or sportsmen, i.e. body-protecting accessories affording protection of body parts against blows or collisions
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S19/00—Satellite radio beacon positioning systems; Determining position, velocity or attitude using signals transmitted by such systems
- G01S19/01—Satellite radio beacon positioning systems transmitting time-stamped messages, e.g. GPS [Global Positioning System], GLONASS [Global Orbiting Navigation Satellite System] or GALILEO
- G01S19/13—Receivers
- G01S19/14—Receivers specially adapted for specific applications
- G01S19/19—Sporting applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/69—Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
- H04N7/185—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source from a mobile camera, e.g. for remote control
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B24/00—Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
- A63B24/0021—Tracking a path or terminating locations
- A63B2024/0025—Tracking the path or location of one or more users, e.g. players of a game
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2220/00—Measuring of physical parameters relating to sporting activity
- A63B2220/10—Positions
- A63B2220/12—Absolute positions, e.g. by using GPS
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B17/00—Details of cameras or camera bodies; Accessories therefor
- G03B17/56—Accessories
- G03B17/561—Support related camera accessories
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/51—Housings
Definitions
- the present invention relates to motion tracking and, more particularly, to a motion tracking solution capable of allowing a videographer to record high-quality video of an athlete participating in a sporting event.
- U.S. Pat. No. 5,179,421 to Parker et al. (ParkerVision, Inc.) issued Jan. 12, 1993 shows a camera tracker with a remote that a user can put on the belt or in a pocket and have a camera follow the user around by focusing on the remote, panning 360° in the horizontal and tilting in the vertical position.
- the remote includes an IR transmitter and tracking is accomplished with an array of receivers that find the “peak” and track the remote by repetitively calculating the angular displacement with respect to a reference angle to provide direction and rate of movement.
- the IR sensor requires line of sight and is therefore not usable for a sport played on a field with many players.
- United States Patent Application 20110228098 by Lamb et al. published Sep. 22, 2011 shows a method to track an object with a video camera by a combination of using an IR sensor to determine a position of a tracking tag with an infrared (IR) transmitter; and automatically adjusting orientation of the camera as a function of the position of the IR transmitter as it follows movement of the object and the position of a recognized feature within the field of view.
- IR infrared red light sources
- U.S. Pat. No. 10,560,621 to Rao et al. shows a tracker for controlling a remote camera through a network.
- the tracker may be a mobile device 102 ( FIG. 1 ) which can include an accelerometer, a gyroscope, a global positioning system (GPS) module, magnetometer, and digital compass, for example, and is coupled with face detection module used to track a location and/or an orientation of the face of the user and uses the zoom control of the mobile device 102 .
- the tracking signal is transmitted by network connection to a server which controls a remote camera similar to a web cam and used in video conferencing. Face detection on a crowded fast-moving sports field is not practical. For this application the device will not operate properly. It is more intended for use with a single target and web conferencing.
- U.S. Pat. Nos. 9,007,476 and 9,294,669 both to Glover (H4 Engineering) issued Apr. 14, 2015 and Mar. 22, 2016 show a remotely controlled automatic camera tracking system.
- the patents show the basic method of using a motorized base to mount and orient a camera based on signals sent from a remote tracking tag.
- the remote tag and base utilizes GPS data for location calculation, which has been used for many years for tracking purposes.
- the Glover et al patents allow for the calculation to take place in the remote control rather than the base to reduce power usage in the remote sensor and allows the user to start and stop a traditional camera or camcorder attached to the base and also control of zoom functions in the camera if possible.
- the Glover et al patents also utilize an armband for the transmitter. Tracking tags worn by the person or player that look like a small black box worn on the arm of a player with a strap or arm band will not be accepted by the game officials (referees), and a tracking tag attached to the uniform will also cause discomfort to the player and reduce their playing level. A tracking tag integral to an athletic pad would be more appropriate for most sports or other activities.
- What is needed is an economical and efficient tracking solution that provides precise initial calibration of the relative positions of the base unit and GPS-transmitting tracking tag, and which then uses it in combination with refined tracking method to provide smooth tracking of an athlete in motion, even when that athlete is mixed in with other participants wearing similar uniforms and at long distances.
- the remote target sensor needs to be constructed and packaged such that the unit can be worn by athletes participating in sports without infringing on the sports guidelines and rules for proper uniforms and equipment and creates no issues with sports officials and referees. Systems requiring direct line of sight (IR systems) or facial recognition or imaging technologies will not work when applied to a crowded sport field (soccer, lacrosse, football, etc.).
- the present solution utilizes improved control in the base station coupled with a sport-appropriate GPS remote tracker tag and the sensors and invokes control capabilities available in existing “smart devices” such as smart phones. People will use the cameras on their phones for the recording and the system will use it for operation. By utilizing the “smart” phone the videographer also gets to use the other “smart phone” functions to easily edit and share video files via the internet—easily send videos to coaches for example.
- An object of this invention is therefore to overcome the foregoing inconveniences by providing a system with a motorized base unit with a smart device mount for automatically orienting the smart device camera toward a moving target and taking pictures or video.
- smart device means any electronic device having an on-board processor and memory, and an on-board camera, and being capable of communicating to other smart devices or networks via a wireless protocol such as Bluetooth, Zigbee, NFC, Wi-Fi, LiFi, 5G, etc.
- a “portable smart device” means any hand-carried smart device.
- a “smart phone” means any smart device with cellular communication capability.
- the motorized base unit tracks a moving target with the smart device and takes pictures or video.
- the target e.g., a child playing soccer
- wears a tracking tag comprising a GPS chip and transmitter packaged inside an athletic pad, e.g., a shin pad for soccer.
- the base unit receives the transmitted GPS data and orients the smartphone camera at the target.
- the base unit includes a main controller with microprocessor for calculating an updated pointing angle and angular velocity for the smart phone based on update location information from the remote tag sensor.
- the current pointing direction of the smart phone is provided via an orientation sensor mounted to the smartphone mounting bracket.
- the orientation sensor is a potentiometer that provides absolute rotation-position information on the mounting bracket.
- the current pointing direction of the smart phone is provided directly by the smart phone itself, and is transmitted wirelessly to the base controller
- the orientation data from the smart phone may include true and magnetic compass heading and yaw, pitch and roll data.
- the orientation data from the sensor and from the smart phone provides information about the orientation of the smart phone device, and thereby provides intermittently-updated pointing direction as the motor rotates.
- the current location data of the base unit is wirelessly transmitted from the smart device to the base unit main controller, or alternatively is obtained locally from a GPS receiver mounted in the base unit.
- the base unit main microprocessor controller can calculate the correct angle that the smart phone should be directed to or “pointed at” to have the target in line and pointed to by the smart phone camera. This new pointing direction is translated to a control signal that turns an electric stepper motor. As the process is repeated, the smart phone device will “follow” or track the target.
- the video functions in existing smart phone devices can be employed and the video files saved on the smart phone for future viewing, editing, emailing, uploading to social media etc.
- a specialized software application may be installed in the smart device to take advantage of the present system capabilities.
- the smart phone App includes a “Highlight” mode of operation by which it continuously buffers video for a selectable amount of time (e.g., 10 seconds, 30 seconds, etc.) as set by the user.
- a selectable amount of time e.g. 10 seconds, 30 seconds, etc.
- the videographer presses a “highlights” button the selected duration of buffered video, as set by the user, is constantly and temporarily held in memory via FIFO (first in, first out) arrangement.
- the App will continue recording for a user specified amount of time (45 secs, 2 minutes etc.) and upon completion this second video file is automatically appended to the first video file held in the buffer memory, the combination of the appended first and second video files being saved as a single recorded video file that includes both video before the record button was pressed and the video recorded thereafter.
- the video file is saved to the smart phone device camera roll and also available for emailing or texting to anyone. This feature allows users who are slow to react to nevertheless recapture a great moment and append it to their recorded video.
- the base unit is portable, battery operated, and sized such that it can be easily transported and mounted on a traditional standard tripod.
- the tracking tag (GPS, communication chips, battery) is packaged into an athletic pad that the target subject wears during a sporting event or any event.
- the tracking tag is a shin pad for soccer.
- the tracking tag may alternately be an elbow pad for use in lacrosse, a leg pad for use in football, or any other general-purpose athletic pad for use with other sports without departing from the scope or spirit of the invention.
- FIG. 1 is a side perspective view of the system for automatically orienting a smartphone camera toward a moving target and taking pictures or video according to an embodiment of the invention.
- FIG. 2 is an opposite side perspective view of the system of FIG. 1 .
- FIG. 3 is an internal view of the base unit 2 .
- FIG. 4 is a side perspective view of the athletic pad 10 according to an embodiment of the invention.
- FIG. 5 is an opposite side perspective view of the athletic pad 10 of FIG. 4 .
- FIG. 6 is a perspective view of the athletic pad 10 with foam layer 74 removed to expose GPS tracking module 12 .
- FIGS. 7 - 9 shows a flow chart illustrating the base unit 2 startup procedure.
- FIG. 10 shows a flow chart illustrating the base unit 2 operating procedure.
- FIG. 11 is an enlarged view of an auxiliary mounting bracket suitable for larger devices, e.g., iPad®, tablets, etc.
- FIGS. 12 - 14 are three perspective views of an auxiliary mounting bracket for camcorders.
- FIG. 15 shows the remote communicating architecture with GPS tracking module 12 communicating to motorized base unit 2 and the base station communicating to smart phone device
- FIG. 16 shows the remote communicating architecture with GPS tracking module 12 communicating directly to the smartphone 3 , and smart phone 3 communicating to motorized base station.
- FIG. 17 is a side perspective view of an embodiment of the athletic pad 10 configured as a shin pad.
- the present invention is a motion tracking solution capable of allowing a videographer to record high-quality video of an athlete participating in a sporting event.
- An athlete e.g., a child playing soccer
- wears a tracking tag comprising a GPS chip and transmitter.
- the GPS tracking tag periodically transmits GPS data to a base unit, which receives the transmitted GPS data and automatically orients the smartphone camera toward the moving athlete for taking pictures or video.
- the base unit generally includes a housing, an articulating smartphone mounting bracket mounted to the housing, a stepper-motor for turning the mounting bracket, and an orientation (pointing direction) sensor for determining current pointing direction of the smart phone, a processor including memory and associated electronics, and optionally a GPS chip.
- Current location data of the base unit is wirelessly transmitted from the smart device to the base unit, or alternatively is obtained locally from the GPS receiver mounted in the base unit.
- Current location of the remote target sensor is wirelessly transmitted from the target to the base unit.
- the orientation sensor mounted to the smartphone mounting bracket
- the orientation sensor provides continuously-updated rotation-position information of the mounting bracket
- the smart phone data transmitted wirelessly to the base controller includes true and magnetic compass heading and yaw, pitch and roll. data.
- the combined orientation data allows extremely accurate calculation and continuous updating of the current pointing angular direction of the smart device even as the motor rotates.
- the base unit processor calculates 1) an updated (delta) pointing angle; and 2) an updated (delta) angular velocity for the smart phone based on updated location information from the GPS tracking tag.
- the base unit processor is able to calculate the correct angle that the smart phone should be directed to or “pointed at”, and also the velocity needed, so as to keep the target centered in the smart phone camera field of view.
- This new pointing direction and velocity are translated to a pulse-width-modulated (PWM) control signal that turns the stepper motor. The process repeats, resulting in the smart phone “following” or tracking the target.
- PWM pulse-width-modulated
- Video functions in the smart phone can be actuated and the video files saved on the smart phone for future viewing, editing, emailing, uploading to social media etc.
- the device is portable, battery operated, and sized such that it can be easily transported and mounted on a traditional standard tripod.
- the tracking tag (GPS, communication chips, battery) is packaged in an athletic pad that the target subject wears as part of their standard uniform.
- FIGS. 1 , 2 and 15 are perspective views of the system for automatically orienting smartphone 3 camera including an athletic protective pad 10 with integral GPS tracking module 12 .
- Tracking module 12 periodically transmits GPS data to a base unit 2 , which receives the transmitted GPS data and automatically orients the smartphone 3 camera toward the moving athlete for taking pictures or video.
- the base unit 2 generally includes a housing 22 , an articulating smartphone mounting bracket 24 mounted to the housing 22 , a stepper-motor 49 (inside housing 220 ) for turning the mounting bracket 24 , and an orientation or pointing direction sensor 29 (also inside housing 22 ) for determining current pointing direction of the smart phone 3 .
- the pointing sensor 29 is mounted proximate the shaft 26 and is connected via a timing belt assembly to the stepper motor 49 , and it updates the current pointing direction as the step motor 49 rotates.
- a processor 42 resides inside housing 22 including memory and associated electronics.
- GPS tracking module 12 communicates wirelessly with motorized base unit 2 .
- the processor 42 commands and drives the stepper motor 49 based on a calculated distance, direction and velocity.
- new target GPS data is sent from the remote GPS tracking tag 12 to the base unit 2 wirelessly.
- Base unit 2 processor compares the new target sensor GPS location data to the old target GPS data, in addition to the location of the base unit 2 and the current pointing angle of the smartphone 3 , and computes a new pointing angle and the velocity for the smart phone device.
- the new angle/velocity is calculated and the motor is controlled and rotates to this new angular velocity.
- the process is repeated, and the smart phone 3 will “follow” or track the target smoothly and accurately.
- the video functions in the smart phone 3 can be employed and the video files saved on the smart phone 3 for future viewing, editing, emailing, uploading to social media etc.
- the smart phone 3 may be any of various “smart” phone devices (Apple iPhone, Samsung Galaxy, LG and others), and is preferably equipped with an installed software App provided as part of the system herein to control said video and other functions.
- the function of the pointing direction sensor 29 monitoring angle of shaft 26 may be replaced or supplemented by the smartphone 3 itself which wirelessly transmits to the base unit 2 controller orientation data, including true and magnetic compass heading and yaw, pitch and roll data, thereby providing information about the orientation of the smart phone device and allowing calculation of pointing angle via an installed App (provided that the smart phone 3 is of a type having an internal compass and can output orientation).
- enclosure 22 houses a multi-layer PC assembly including a main board (middle) seating primary electronic devices including processor 42 , motor driver controller 45 , and wireless communication devices 46 , 47 .
- One wireless communication device 46 communicates with the tracking module 12 and one 47 with the smart phone 3 .
- the wireless communication devices 46 , 47 are 900 Mhz radio transceivers but could alternately be Bluetooth, WIFI, ZigBee etc.
- Adjustable device mounting bracket 24 rotates above housing 22 on shaft 26 for generic use with a variety of smart phone devices 3 , and the shaft 26 protrudes down through main board to a lower board containing low voltage electric stepper motor 49 , and rechargeable battery 41 .
- Shaft 26 is preferably journaled into a bearing 53 on the lower board for frictionless rotation.
- the shaft 26 is damped. This is accomplished with a belt-drive inclusive of a rubber belt 57 connected between a small pulley 58 on the motor 49 shaft and a large pulley 56 on the shaft 26 of the adjustable device mounting bracket 24 , the pulley size differential providing speed reduction and increased torque.
- a spur gear, worm gear, gear motor or other method of speed reduction could be used.
- Battery 41 is connected to a charging controller IC chip 43 that manages and recharges the battery 41 by attaching a cable as is typical for charging smart phones by the user.
- a charging controller IC chip 43 that manages and recharges the battery 41 by attaching a cable as is typical for charging smart phones by the user.
- a mini-USB connection is very commonly used for this purpose.
- Motor driver controller 45 may be a commercially-available two-axis motor controller/driver module capable of supporting a bi-phase bipolar stepper motor 49 , a variety of which are commercially available. For example, a Toshiba TB67S128FTG microstepping bipolar stepper motor drive controller 45 will suffice.
- a second motor and motor driver controller 45 (or a second motor and dual-motor 3-axis motor driver controller) can be added to additionally provide control and position along vertical axes, thereby allowing the smart device to track up and down vertically in conjunction with the horizontal.
- the very same approach to control can be used for vertical operation, thereby allowing the device to track in three-dimensions.
- An optional GPS chip 48 may be provided on the main board to provide current location data of the base unit 2 to processor 42 .
- location data for the base unit 2 is wirelessly transmitted from the smart device mounted in bracket 24 to the base unit 2 .
- the location data for the base unit 2 must be accurate for present purposes and many smart devices employ low grade GPS chips that do not provide the requisite accuracy.
- more accurate location data of the base unit 2 can be obtained locally from the GPS receiver 48 mounted in the base unit 2 , can be obtained remotely from a cellular service, or from any other third party source of more accurate location data.
- orientation sensor 29 The initial orientation and pointing direction of smartphone mounting bracket 24 is unknown at startup and so the smartphone device mounting bracket 24 may be manually aligned with the remote target sensor (orientation sensor 29 ).
- a detent button 44 is positioned on housing 22 and may be pressed to indicate alignment. Alternatively, a soft button 44 may be provided by the App on smart phone 3 for interaction with the user.
- Switch 44 causes the current pointing angle to be captured using orientation sensor 29 , and used alone or in conjunction with the angular pointing direction calculated from the orientation data provided by the smart phone and transmitted wirelessly to the base controller (true and magnetic compass heading and yaw, pitch and roll data).
- orientation sensor 29 is a potentiometer mounted to the bottom of the smart phone mounting bracket shaft 26 .
- the potentiometer 29 is a variable resistance device that provides absolute position information with a shaft and with three wires connected to it.
- One wire is the nominal system control voltage for the system—3.3 VDC or 5 VDC
- the other wire is system voltage ground
- the third wire is referred to as the “wiper” which is a variable resistance/voltage output.
- the variable voltage output provides an absolute value of the current shaft position and thereby the pointing direction of the smart phone device mounting bracket 24 .
- the potentiometer-type pointing direction sensor 29 offers the advantage of not requiring a homing sequence or similar initial location calibration as would be required when using relative positioning devices like encoders. Also, using an absolute positioning device like the potentiometer for pointing direction sensor 29 ensures that the unit never loses its location pointing direction or gets “lost” even with disruptions during use, which is not true of systems using relative pointing devices. The benefits of a continuously-variable potentiometer sensor 29 become essential when tracking a fast-moving target with a camera.
- the pointing angle of the smart phone mounting bracket 24 may be obtained from the smart phone 3 directly using its available magnetometer output (compass) and orientation data calculated internally in the smart phone device utilizing the internal sensors magnetometer, gyroscope, accelerometer and calculated values for pitch, yaw, and roll of the smart phone device.
- the smart phone orientation data is transmitted wirelessly to the main controller in the base unit 2 via bluetooth or other similar wireless connections. In this case no orientation sensor 29 is required.
- both orientation data sources are used as a cross-check and backup and provide information for drift compensation and error checking.
- additional information from the smart phone 3 including Quaternion (orientation), Accelerometer, and Gyroscope data are used to determine current pointing angle and mounting bracket angular velocity to improve target tracking.
- housing 22 is preferably equipped with a base mounting bracket 60 suitable for releasable mounting on a conventional tripod.
- FIGS. 4 - 6 illustrate one example of the athletic protective pad 10 with integral GPS tracking module 12 .
- the athletic protective pad 10 comprises a suitable hard yet resilient synthetic material able to withstand the bending and harsh impacts inherent to competition.
- Such materials are known in the art, and include nylon, polypropylene (PP), polyethylene (PE), amorphous polar plastics (e.g., polycarbonate (PC)), polymethylmethacrylate (PMMA), polystyrene (PS), high impact polystyrene (HIPS), polyphenylene oxide (PPO), glycol modified polyethylene teraphthalate (PETG), acrylonitrile butadiene styrene (ABS), semicrystalline polar plastics (e.g., polyester PET and PBT), polyamide (e.g., Nylon 6 and Nylon 66), urethane, polyketone, polybutylerie terephalate, acetals (e.g., DelrinTM by DuPont), acrylic, acrylic-s
- the protective pad 10 is molded in a partial convex arch to conform to a limb such as, for example, the elbow, forearm or shin, as illustrated, and preferably includes four molded recesses 72 open inwardly to the arch for seating the electrical components of GPS tracking module 12 .
- the electrical components of GPS tracking module 12 are individually seated in the molded recesses 72 , adhered (or molded) therein, and covered by a protective foam padding layer 74 as seen in FIG. 5 .
- the athletic protective pad may be modified in construction and form to serve as a shin pad, elbow pad, forearm pad or leg pad as required for different sports but of similar construction and function as noted herein.
- FIG. 6 shows the electrical submodules of GPS tracking module 12 individually seated in their four molded recesses 72 .
- They include a commercially available GPS module 76 that can track multiple satellites and do minimally several updates a second for high speed, high sensitivity tracking.
- a preferred GPS module 76 is built around the MTK3339 chipset, which can track up to 22 satellites on 66 channels, is low-power, has a high-sensitivity receiver, built in antenna, and can do up to ten location updates a second.
- the GPS module 76 is connected to a processor module 78 with integrated wireless transceiver.
- An ARMTM Cortex M0+ Wireless Microcontroller with SX1231 transceiver is well-suited inasmuch as it is a long range 900 Mhz packet radio transceiver for better range than Bluetooth yet without the high power requirements of WiFi (although either Bluetooth or WiFi may suffice).
- the processor/transceiver module 78 and GPS module 76 are connected to a battery 79 , such as a 3.7V lithium polymer battery, and all the foregoing components 76 - 79 are connected through a detent activation switch 77 .
- switch 77 When switch 77 is activated the GPS module 76 immediately begins logging GPS coordinates and timestamps, and transceiver 77 periodically transmits this GPS/timing data (up to ten times a second) to base unit 2 .
- the GPS coordinates with timestamps are received by transceiver 59 and are communicated to the base station processor 42 .
- the base station processor 42 uses the GPS location/timing data from GPS tracking module 12 to calculate a pointing angle between the motorized base unit 2 and the GPS tracking module 12 using trigonometric math equations.
- the current pointing angle of the smart phone 3 is known from the orientation sensor 29 or internal Magnetometer and other resident sensors (e.g., on-board compass) in the smart phone device.
- the GPS tracking module 12 moves, and new GPS coordinates and timestamps are transmitted ten times a second to the base unit 2 .
- the base unit 2 processor computes a new required pointing angle and velocity needed to reorient and control smart phone mounting bracket 24 .
- the pointing angle value is used to position the motor shaft 26 and “point” the smart phone device mounting bracket 24
- the computed velocity is used to calculate the needed speed of the motor 49 to reorient smart phone mounting bracket 24 and thereby the smart phone 3 to track the target.
- the smart phone 3 effectively and smoothly follows or “tracks” the remote GPS tracking module 12 as it moves. Tracking as a function of velocity is superior to prior art units that do not control based on velocity but rather use only point-to-point movements.
- the foregoing technique is implemented by software resident in the base station processor 42 .
- FIGS. 7 - 10 are flow charts of the software sequence.
- step 100 turning on the base unit via switch 44 (of FIGS. 1 - 3 ) commences initial start operation (later on—alignment operation).
- step 110 the user initiates their smartphone 3 App.
- the user receives operating instruction using the screen of the smart phone and enables camera view.
- step 120 the user mounts the smart phone 3 on the bracket 22 of base unit 2 .
- the smartphone 3 establishes a wireless connection with the base unit 2 via wireless communication devices 44 , 46 .
- the base unit 2 processor 42 begins capturing GPS location data from the smart phone 3 .
- the initial smart phone GPS location data is used to fix the smart phone location relative to the base unit 2 location, and when suitable this is stored as “base station location.” Again, an on board GPS chip 48 in the motorized base unit 2 may also be used to provide the base unit location.
- the GPS tracking tag 12 is actuated via switch 77 ( FIG. 6 ), and wireless communications are established from base unit 2 to GPS tracking tag 12 via radio 78 .
- the initial GPS tracking module 12 location is stored as “position 1 target sensor”.
- Program flow proceeds to FIG. 8 , where at step 180 the base unit 2 processor 42 polls the smart phone 3 for orientation data and its GPS coordinate data.
- a typical smart phone has many sensors including three accelerometers (one for every axis, x, y and z), a gyroscope, and a magnetometer.
- the gyroscope detects the orientation of the phone (pitch, roll and yaw around an axis) and the magnetometer provide pointing direction as compass heading data.
- some smart phones may lack a suitable magnetometer and gyroscope output and cannot provide orientation data.
- step 195 base unit 2 processor 42 calculates the horizontal bearing of the GPS tracking module 12 from the base unit 2 using GPS values “base station location” and “position 1 target sensor”, using a math formula and longitude and latitude values.
- the base unit 2 processor 42 polls the smart phone 3 for its gyroscope/compass heading and GPS data, and at step 210 processor 42 compares its calculated bearing from the base unit 2 to the GPS tracking tag 10 to the gyroscope/compass heading transmitted from smart phone 3 , and calculates a “correction angle.”
- processor 42 translates the “correction angle” into pulse commands (number and direction of pulses required to cause the motor 49 to adjust the correction angle, e.g., 200 pulses clockwise to turn one half revolution).
- Processor 41 sends a complete set of pulse commands (number, direction, rate) to the motor driver controller 45 which controls the motor 49 to implement the pulse-width modulated (PWM) command set.
- PWM pulse-width modulated
- GPS tracking module 12 offers many advantages including not requiring the GPS tracking module 12 to be collocated or calibrated at the base unit 2 .
- the initial pointing angle is known and videography can begin without any initial alignment procedure.
- Using the gyro/compass data from the smart phone 3 facilitates an AUTO-alignment function (described below in regard to FIGS. 7 - 8 ).
- the system can be turned on and operation started with the GPS tracking module 12 being located anywhere in the general area. Consequently a sports player wearing the athletic pad 10 can already be on the playing field when the system is turned on and the system will start normally.
- step 190 the user is prompted on their smart phone 3 to manually turn the smart phone mounting bracket 24 until the target (athlete) is centered in the field of view (and appears centrally on the smart phone 3 viewing screen).
- the smart phone App provides some functionality including a “Target Aligned” button, and at step 200 this is pressed to indicate manual alignment.
- the processor 42 reads the smart phone mounting bracket 24 position from the shaft-mounted potentiometer and stores this value as “first pointing angle.”
- the smart phone mounting bracket 24 is properly positioned and processor 42 stores initial alignment position as the “first pointing angle.”
- Process flow proceeds to FIG. 9 , where the user is prompted by the smart phone 3 App to indicate “Tracking Mode Only?” (versus live photography). This is important inasmuch as the base unit 2 can be used for pointing conventional cameras and video recorders, mounting them in bracket 24 and using the smart phone 3 as a remote control. “Tracking Mode” simply tells the smart phone 3 that it is being used as such. However, if at step 225 the user responds “No” then the smart phone 3 enables video recording functions of the smart phone camera.
- step 300 the processor 42 waits for base unit 2 to receive new GPS data and timestamp from GPS tracking module 12 .
- base unit 2 processor 42 stores “position 2 target sensor” and time, and uses the new GPS tracking module 12 coordinates and time at step 310 to calculate the new distance of the GPS tracking module 12 from the base unit 2 .
- Processor 41 checks for bad data by comparing each calculated new distance to a maximum threshold, and discards any calculated new distance that exceeds the threshold.
- the maximum threshold is set based on the maximum possible distance that a target is expected to move per time increment and reflects a rule of reason Being that an athlete is physically capable of only moving in small incremental distances and angular changes within each time increment, processor 41 checks for large changes in location data and this data is assumed to be “bad.” All invalid data is disregarded and not used to make changes to the current velocity value and the processor 42 waits for base unit 2 to receive new GPS data and timestamp from GPS tracking module 12 . Other values are checked like the time value from the GPS for example and values outside of expected values and not used—no change in the time value for example or a zero-value returned from the GPS coordinates is considered invalid and skipped.
- processor 42 reads the current pointing angle from smart phone mounting bracket 24 orientation sensor 29 and/or captures the current compass heading and smart phone orientation data from smart phone 3 as explained in regard to FIGS. 7 - 10 .
- processor 42 calculates a new delta angle change from the “first pointing angle” to the “second pointing angle.”
- Processor 41 also calculates from the timestamps a new velocity value based on rate of change from the “first pointing angle” to the “second pointing angle” and updates the velocity value accordingly.
- Control of the motor 49 is critical to providing good tracking and keeping the target and the smart phone mounting bracket 24 aligned.
- the bae unit 2 processor 42 receives new updated GPS location data from the GPS tracking module 12 and, coupled with the GPS location for the base unit 2 (derived from the smart phone 3 ), and the current pointing angle for the smart phone mounting bracket 24 , a new “delta” pointing angle and new “delta” angular speed is calculated.
- the delta pointing angle is calculated by the processor 42 using the following equation with longitude and latitude data derived from the corresponding GPS data for the GPS tracking module 12 and base unit 2 :
- the correction angle is calculated as the new required position or bearing versus the previous bearing or pointing angle.
- the time from the last GPS data and the new GPS is stored and compared.
- the delta angle for correction may be 2 degrees.
- the rate of the movement of the smart phone mounting bracket 24 from point to point is determined from the calculated target velocity and used to set the speed to match the target movement rate, thereby providing smooth video and excellent tracking.
- the timestamps of that data are also communicated to the processor 42 (or smart phone directly). This allows calculation of timing differential and then the actual speed of the moving target.
- processor 42 translates the “delta velocity” and “delta angle” into pulse rate commands (number and direction of pulses required to cause the motor 49 to adjust the delta angle velocity).
- the motor controller circuit board 45 is sent a continuous stream of pulses from the main microprocessor 42 using a variable continuous PWM (pulse width modulated) output.
- the frequency of the PWM is varied based on the calculated target speed. This provide for smooth tracking of the remote target athlete (lacrosse or soccer player for example).
- the processor 42 checks the calculated PWM values and dynamically adjusts the microstepping factor on the motor control board 45 to ensure the motor 42 is operating in its ideal frequency range (known as “variable dynamic microstepping”).
- Microstepping is a way of controlling a stepper motor more smoothly than in full steps, e.g., the motor may be microstepped using 1/32 steps. Microstepping results in less vibration, makes noiseless stepping possible, and makes smaller step angles, lower speeds and better positioning possible. The net result is vastly better video quality.
- stepper motors have an optimum range of operational frequencies. The calculated velocity value may vary greatly depending on the difference in target minimum and maximum speeds, the distance from the target to the base unit 2 and smart phone mounting bracket 24 , etc.
- Stepper motors operate best in a certain range of speeds and also when controlled with a PWM frequency within a certain frequency range.
- the motor controller 45 can be configured to operate in micro-stepping mode.
- Microstepping is a technique where the motor control board can make the stepper motor operate in such a way that additional steps are allowed within the same number of “real steps” (microsteps) to provide better control and operation at lower speeds.
- the present invention takes advantage of these factors and provides variable dynamic stepper motor mode control to provide the best possible control and smoothest operation. If the required speed is high for example, the main microprocessor controller will place the motor control board ( 15 ) in a lower or even full step (1:1) control mode so the stepper motor goes faster for a given PWM output and keeps the PWM frequency range in the best operating range for the stepper motor and calculated by the main processor ( 12 ). If the speed is required to be slow, the microprocessor will determine this and change the mode to a higher ( 1/32 for example which drives the motor 32 times slower for a given PWM frequency than operating in full step mode) microstepping mode again keeping the PWM frequency in the optimal range. This variable dynamic microstepping minimizes steps while maintaining them within the motors optimum range.
- Processor 41 sends a complete set of microstep pulse commands (number, direction, rate) to the motor driver controller 45 which controls the motor 49 to implement the pulse-width modulated (PWM) command set.
- PWM pulse-width modulated
- processor 42 update the previous time, distance, location, pointing angle, and velocity with new values and continuously repeats the process of FIG. 10 .
- the wireless communications between the remote communicating GPS tracking module 12 and base unit 2 are “paired” together automatically at start to ensure that only communication with said transmitter and “paired” receiver are used, and to allow multiple units to operate in the same area without interfering with the operation of other units.
- data is sent by wireless communications between the smart phone 3 and base unit 2 and there are paired together to ensure only communication with each other, and to allow multiple units to operate in the same area without interfering with the operation of other units.
- a wired connection may be used by a wired connection (Apple lightning connector as an example).
- the installed software App provided as part of the system includes a specialized “highlights” mode of operation.
- This mode is selected via the software App via the user screen on the smart phone or via a pushbutton on the base station or via a verbal command to the smart phone device.
- the smart phone camera continuously buffers (temporarily saving a set amount of) video, the buffer size being configured during setup.
- the buffer size may be any time value from 10 seconds to 30 minutes.
- FIG. 11 is an enlarged view of an exemplary adjustable device mounting bracket 24 which rotates above housing 22 on shaft 26 for generic use with a variety of smart phone devices 3 .
- the mounting bracket 24 generally comprises an expandable spring-loaded frame for gripping a variety of smart phone devices 3 , tablets, cameras etc., no matter their size differential.
- the mounting bracket 24 provides full rearward access to the touchscreen of the smart phone 3 for manipulating camera functions and or the App, and full frontal clearance for the camera field of view.
- a clamping-type frame with fixed horizontal struts and adjustable vertical struts is best suited.
- FIGS. 12 - 14 are three perspective views of an auxiliary mounting bracket 24 for camcorders.
- the mounting bracket generally comprises an expandable spring-loaded frame for gripping a variety of camcorders.
- a clamping-type frame with fixed horizontal struts and adjustable vertical struts is best suited.
- an electronic compass may be added to the base unit 2 to provide the compass information for the main microprocessor 42 .
- the compass information may be likewise communicated to the processor 42 via a wired or wireless connection and the auto alignment process will proceed as noted above.
- the base unit 2 may be passive and merely transfer location and pointing angle data to the smart phone 3 located in bracket 24 , allowing the smart phone 3 to complete the foregoing calculations and transmit final PWM data back to the base motor controller using the App (software program running on the smart phone 3 ). Compass heading data and other available data is already captured and available in the smart phone device. The resulting calculated required motor position and velocity commands are then sent to the microprocessor 42 in the base unit 2 .
- the GPS tracking module 12 may communicate directly to the smart phone 3 located in bracket 24 rather than to and through the base unit 2 , using the built-in wireless communication interfaces in the smart phone 3 .
- FIG. 16 shows the remote communicating architecture with GPS tracking module 12 communicating directly to the smartphone 3 . This will allow the smart phone 3 to complete the foregoing calculations and transmit final simplified PWM data back to the base 2 motor controller 45 using the App (software program running on the smart phone 3 ). GPS data, compass heading data and other available data is already captured and available in the smart phone device. The resulting calculated required motor position and velocity commands are then sent to a simplified microprocessor 42 in the base unit 2 eliminating the need for the base unit 2 controller to communicate with the remote target sensor and streamlining the operation of the system.
- the distance value (and delta distances) from base unit 2 to GPS tracking module 12 is communicated to the smart phone 3 via wireless communication as noted prior, and the value is used by the App operating on the smart phone to determine the best possible zoom value for the integrated video camera in the smart phone 3 .
- the App operating on the smart phone may simply suggest an external lens available for use with smart phone 3 to enhance the range of the video camera functions.
- the present invention may also call upon the voice interaction and recognition capabilities of the smart phone 3 to provide hands free control of the system during operation. For example, when the target athlete does something very good the user simply speaks to the device at the time and says “Highlight”. The location and time in the video recording are noted for quick reference and locating later during viewing time. Other commands are including “Pause”, “Restart”, etc.
- the present invention may utilize the image recognition capabilities of the smart phone 3 to provide an additional or supplemental means of target tracking at closer distances. If the controller or smart phone determines that the remote target sensor is sufficiently close where GPS locating may not be best method and the internal image recognition in the smart phone is operating, the system will switch over to image recognition tracking on the fly and determine the best pointing angle for the smart phone device and command the motor accordingly and also switch back when the distance is further and best suited for GPS control.
- the motorized base unit 2 receives the transmitted GPS, orientation, and timestamp data and orients the smartphone camera at the target to provide smoother more accurate tracking of an athlete in motion.
- FIG. 17 is a side perspective view of an embodiment of the athletic pad 10 configured as a shin pad. Design and construction is similar to the embodiment of FIG.
Abstract
A system including a motorized base unit with a smart device mount for automatically orienting the smart device camera toward a moving target to track the moving target and take pictures or video. The target (e.g., a child playing soccer) wears a tracking tag comprising a GPS chip and transmitter packaged inside an athletic pad. The base unit includes a motorized mast for mounting a smart device. The base unit receives the transmitted GPS data, calculates updated pointing angle and angular velocity for the smart phone based on update location information from the remote tag sensor, calculates the correct angle that the smart phone should be pointed at, translates the new pointing directions to a control signal that turns the mast, which in turn causes the smart device camera to “follow” or track the target.
Description
- The present application is a division of U.S. patent application Ser. No. 17/316,837 filed May 11, 2021, which in turn derives priority from U.S. provisional application Ser. No. 63/023,408 filed 12 May 2020.
- The present invention relates to motion tracking and, more particularly, to a motion tracking solution capable of allowing a videographer to record high-quality video of an athlete participating in a sporting event.
- As long as people have been participating in sporting events and activities, people have wanted to record their activities for viewing later and capturing these moments to share and to capture fond memories. This is particularly true for parents of children participating in youth sports who want to record their children playing. Solutions to date have been generally unsatisfactory for providing high quality at a low cost and ease of use for the player. For example, hiring a professional videographer to record the event generally provides a satisfactory solution for the quality of the video recording, but unsatisfactory in terms of the cost. As such, the primary solution to this problem has been for the parent to be the videographer. While satisfactory in terms of the cost, this compromises recording quality and detracts from the parents viewing experiencing. Also the existing location transmitter packaging has been non-compliant with uniform requirements and uncomfortable for the athlete. Various device-based tracking solutions have been proposed to assist with videography but have not provided a satisfactory solution.
- For example, U.S. Pat. No. 5,179,421 to Parker et al. (ParkerVision, Inc.) issued Jan. 12, 1993 shows a camera tracker with a remote that a user can put on the belt or in a pocket and have a camera follow the user around by focusing on the remote, panning 360° in the horizontal and tilting in the vertical position. The remote includes an IR transmitter and tracking is accomplished with an array of receivers that find the “peak” and track the remote by repetitively calculating the angular displacement with respect to a reference angle to provide direction and rate of movement. The IR sensor requires line of sight and is therefore not usable for a sport played on a field with many players.
- United States Patent Application 20110228098 by Lamb et al. published Sep. 22, 2011 shows a method to track an object with a video camera by a combination of using an IR sensor to determine a position of a tracking tag with an infrared (IR) transmitter; and automatically adjusting orientation of the camera as a function of the position of the IR transmitter as it follows movement of the object and the position of a recognized feature within the field of view. Systems that use infrared red light sources (IR) require line of sight to the target, which makes it impossible to track a participant on a crowded sports field and is limited for outdoor usage and range, and therefore not a good use for the application.
- U.S. Pat. No. 10,560,621 to Rao et al. (Symbol Technologies) issued 11 Feb. 2020 shows a tracker for controlling a remote camera through a network. Here the tracker may be a mobile device 102 (
FIG. 1 ) which can include an accelerometer, a gyroscope, a global positioning system (GPS) module, magnetometer, and digital compass, for example, and is coupled with face detection module used to track a location and/or an orientation of the face of the user and uses the zoom control of the mobile device 102. The tracking signal is transmitted by network connection to a server which controls a remote camera similar to a web cam and used in video conferencing. Face detection on a crowded fast-moving sports field is not practical. For this application the device will not operate properly. It is more intended for use with a single target and web conferencing. - U.S. Pat. No. 9,697,427 to Stout et al. (Jigabot, Ltd.) issued 4 Jul. 2017 shows system for tracking a cinematography target using multiple IR emitters worn by a target subject. Again, this system (as with any IR system) requires line of sight to the target which will be impossible on a crowded sports field and limited for outdoor usage and range.
- U.S. Pat. Nos. 9,007,476 and 9,294,669 both to Glover (H4 Engineering) issued Apr. 14, 2015 and Mar. 22, 2016 show a remotely controlled automatic camera tracking system. The patents show the basic method of using a motorized base to mount and orient a camera based on signals sent from a remote tracking tag. The remote tag and base utilizes GPS data for location calculation, which has been used for many years for tracking purposes. The Glover et al patents allow for the calculation to take place in the remote control rather than the base to reduce power usage in the remote sensor and allows the user to start and stop a traditional camera or camcorder attached to the base and also control of zoom functions in the camera if possible. Although a good approach, it is not necessary and adds to the complexity of the system and reduces reliability. It does not utilize the functions available in a smart phone as proposed here and the integrated sensors and blue tooth connections to the control base which can provide increased integration and control of the built-in camera in the smart phone. The Glover et al patents also utilize an armband for the transmitter. Tracking tags worn by the person or player that look like a small black box worn on the arm of a player with a strap or arm band will not be accepted by the game officials (referees), and a tracking tag attached to the uniform will also cause discomfort to the player and reduce their playing level. A tracking tag integral to an athletic pad would be more appropriate for most sports or other activities.
- U.S. Pat. Nos. 8,704,904 and 9,253,376 and 9,800,769 to Boyle et al. (H4 Engineering) issued Apr. 22, 2014, 2 Feb. 2016 and 24 Oct. 2017, respectively show a system for automatic pointing of a camera using an initial calibration where remote unit is collocated (this was corrected later to allow for 2 sensors—one in the remote and one in the base eliminating the need for collocated sensor to start) with the base unit and utilizes GPS tracking and coupled with IR sensors, collimated light beams or imaging software all of which require line of sight to the target and thereby not useful on a crowded sports field with many players wearing the same uniforms or helmets. In addition, the GPS tag worn by the target is not sport appropriate and may cause issues with the game officials and general discomfort
- U.S. Pat. No. 10,560,621 to Rao et al. issued Feb. 11, 2020 supplements the motion tracking component with image recognition. The computational overhead required for real time image processing is huge, and so the foregoing are only partial solutions and the range of use is limited and not sufficient for an outdoor sporting event (football field) with many similar people in identical uniforms.
- What is needed is an economical and efficient tracking solution that provides precise initial calibration of the relative positions of the base unit and GPS-transmitting tracking tag, and which then uses it in combination with refined tracking method to provide smooth tracking of an athlete in motion, even when that athlete is mixed in with other participants wearing similar uniforms and at long distances. The remote target sensor needs to be constructed and packaged such that the unit can be worn by athletes participating in sports without infringing on the sports guidelines and rules for proper uniforms and equipment and creates no issues with sports officials and referees. Systems requiring direct line of sight (IR systems) or facial recognition or imaging technologies will not work when applied to a crowded sport field (soccer, lacrosse, football, etc.). The present solution utilizes improved control in the base station coupled with a sport-appropriate GPS remote tracker tag and the sensors and invokes control capabilities available in existing “smart devices” such as smart phones. People will use the cameras on their phones for the recording and the system will use it for operation. By utilizing the “smart” phone the videographer also gets to use the other “smart phone” functions to easily edit and share video files via the internet—easily send videos to coaches for example.
- An object of this invention is therefore to overcome the foregoing inconveniences by providing a system with a motorized base unit with a smart device mount for automatically orienting the smart device camera toward a moving target and taking pictures or video.
- For purposes of definition, “smart device” means any electronic device having an on-board processor and memory, and an on-board camera, and being capable of communicating to other smart devices or networks via a wireless protocol such as Bluetooth, Zigbee, NFC, Wi-Fi, LiFi, 5G, etc.
- A “portable smart device” means any hand-carried smart device.
- A “smart phone” means any smart device with cellular communication capability.
- The motorized base unit tracks a moving target with the smart device and takes pictures or video. The target (e.g., a child playing soccer) wears a tracking tag comprising a GPS chip and transmitter packaged inside an athletic pad, e.g., a shin pad for soccer. The base unit receives the transmitted GPS data and orients the smartphone camera at the target. The base unit includes a main controller with microprocessor for calculating an updated pointing angle and angular velocity for the smart phone based on update location information from the remote tag sensor. The current pointing direction of the smart phone is provided via an orientation sensor mounted to the smartphone mounting bracket. The orientation sensor is a potentiometer that provides absolute rotation-position information on the mounting bracket. Alternatively (or additionally), the current pointing direction of the smart phone is provided directly by the smart phone itself, and is transmitted wirelessly to the base controller The orientation data from the smart phone may include true and magnetic compass heading and yaw, pitch and roll data. Collectively, the orientation data from the sensor and from the smart phone provides information about the orientation of the smart phone device, and thereby provides intermittently-updated pointing direction as the motor rotates. In addition, the current location data of the base unit is wirelessly transmitted from the smart device to the base unit main controller, or alternatively is obtained locally from a GPS receiver mounted in the base unit. Given 1) the current location of the base unit; 2) the current pointing angle of the smartphone device; and 3) the GPS location of the remote target sensor, the base unit main microprocessor controller can calculate the correct angle that the smart phone should be directed to or “pointed at” to have the target in line and pointed to by the smart phone camera. This new pointing direction is translated to a control signal that turns an electric stepper motor. As the process is repeated, the smart phone device will “follow” or track the target. The video functions in existing smart phone devices can be employed and the video files saved on the smart phone for future viewing, editing, emailing, uploading to social media etc. In addition, a specialized software application (App) may be installed in the smart device to take advantage of the present system capabilities.
- The smart phone App includes a “Highlight” mode of operation by which it continuously buffers video for a selectable amount of time (e.g., 10 seconds, 30 seconds, etc.) as set by the user. When the videographer presses a “highlights” button the selected duration of buffered video, as set by the user, is constantly and temporarily held in memory via FIFO (first in, first out) arrangement. Given the foregoing, when the “record” button is pressed, the App will continue recording for a user specified amount of time (45 secs, 2 minutes etc.) and upon completion this second video file is automatically appended to the first video file held in the buffer memory, the combination of the appended first and second video files being saved as a single recorded video file that includes both video before the record button was pressed and the video recorded thereafter. The video file is saved to the smart phone device camera roll and also available for emailing or texting to anyone. This feature allows users who are slow to react to nevertheless recapture a great moment and append it to their recorded video.
- The base unit is portable, battery operated, and sized such that it can be easily transported and mounted on a traditional standard tripod. The tracking tag (GPS, communication chips, battery) is packaged into an athletic pad that the target subject wears during a sporting event or any event. In an embodiment, the tracking tag is a shin pad for soccer. However, the tracking tag may alternately be an elbow pad for use in lacrosse, a leg pad for use in football, or any other general-purpose athletic pad for use with other sports without departing from the scope or spirit of the invention.
- Additional aspects of the present invention will become evident upon reviewing the embodiments described in the specification and the claims taken in conjunction with the accompanying figures, wherein like numerals designate like elements, and wherein:
-
FIG. 1 is a side perspective view of the system for automatically orienting a smartphone camera toward a moving target and taking pictures or video according to an embodiment of the invention. -
FIG. 2 is an opposite side perspective view of the system ofFIG. 1 . -
FIG. 3 is an internal view of thebase unit 2. -
FIG. 4 is a side perspective view of theathletic pad 10 according to an embodiment of the invention. -
FIG. 5 is an opposite side perspective view of theathletic pad 10 ofFIG. 4 . -
FIG. 6 is a perspective view of theathletic pad 10 withfoam layer 74 removed to exposeGPS tracking module 12. -
FIGS. 7-9 shows a flow chart illustrating thebase unit 2 startup procedure. -
FIG. 10 shows a flow chart illustrating thebase unit 2 operating procedure. -
FIG. 11 is an enlarged view of an auxiliary mounting bracket suitable for larger devices, e.g., iPad®, tablets, etc. -
FIGS. 12-14 are three perspective views of an auxiliary mounting bracket for camcorders. -
FIG. 15 shows the remote communicating architecture withGPS tracking module 12 communicating tomotorized base unit 2 and the base station communicating to smart phone device -
FIG. 16 shows the remote communicating architecture withGPS tracking module 12 communicating directly to thesmartphone 3, andsmart phone 3 communicating to motorized base station. -
FIG. 17 is a side perspective view of an embodiment of theathletic pad 10 configured as a shin pad. - The present invention is a motion tracking solution capable of allowing a videographer to record high-quality video of an athlete participating in a sporting event. An athlete (e.g., a child playing soccer) wears a tracking tag comprising a GPS chip and transmitter. The GPS tracking tag periodically transmits GPS data to a base unit, which receives the transmitted GPS data and automatically orients the smartphone camera toward the moving athlete for taking pictures or video. The base unit generally includes a housing, an articulating smartphone mounting bracket mounted to the housing, a stepper-motor for turning the mounting bracket, and an orientation (pointing direction) sensor for determining current pointing direction of the smart phone, a processor including memory and associated electronics, and optionally a GPS chip.
- Current location data of the base unit is wirelessly transmitted from the smart device to the base unit, or alternatively is obtained locally from the GPS receiver mounted in the base unit. Current location of the remote target sensor is wirelessly transmitted from the target to the base unit. The orientation sensor (mounted to the smartphone mounting bracket) provides continuously-updated rotation-position information of the mounting bracket, while the smart phone data transmitted wirelessly to the base controller includes true and magnetic compass heading and yaw, pitch and roll. data. The combined orientation data allows extremely accurate calculation and continuous updating of the current pointing angular direction of the smart device even as the motor rotates. Given 1) the realtime location of the base unit; 2) the realtime pointing angle of the smartphone device; and 3) the GPS location of the remote target sensor, the base unit processor calculates 1) an updated (delta) pointing angle; and 2) an updated (delta) angular velocity for the smart phone based on updated location information from the GPS tracking tag. By using the current location data of the base unit which is wirelessly transmitted from the smart phone device to the main controller in the base (or derived from an onboard GPS receiver on the base unit main controller) and current pointing angle of the smartphone device coupled with the GPS location of the remote target sensor, the base unit processor is able to calculate the correct angle that the smart phone should be directed to or “pointed at”, and also the velocity needed, so as to keep the target centered in the smart phone camera field of view. This new pointing direction and velocity are translated to a pulse-width-modulated (PWM) control signal that turns the stepper motor. The process repeats, resulting in the smart phone “following” or tracking the target. Video functions in the smart phone can be actuated and the video files saved on the smart phone for future viewing, editing, emailing, uploading to social media etc. The device is portable, battery operated, and sized such that it can be easily transported and mounted on a traditional standard tripod. The tracking tag (GPS, communication chips, battery) is packaged in an athletic pad that the target subject wears as part of their standard uniform.
-
FIGS. 1, 2 and 15 are perspective views of the system for automatically orientingsmartphone 3 camera including an athleticprotective pad 10 with integralGPS tracking module 12.Tracking module 12 periodically transmits GPS data to abase unit 2, which receives the transmitted GPS data and automatically orients thesmartphone 3 camera toward the moving athlete for taking pictures or video. Thebase unit 2 generally includes ahousing 22, an articulatingsmartphone mounting bracket 24 mounted to thehousing 22, a stepper-motor 49 (inside housing 220) for turning the mountingbracket 24, and an orientation or pointing direction sensor 29 (also inside housing 22) for determining current pointing direction of thesmart phone 3. In the illustrated embodiment the pointingsensor 29 is mounted proximate theshaft 26 and is connected via a timing belt assembly to thestepper motor 49, and it updates the current pointing direction as thestep motor 49 rotates. One skilled in the art will understand that the function of thepointing direction sensor 29 may be replaced or supplemented with an existing compass integral to the smartphone. In addition, aprocessor 42 resides insidehousing 22 including memory and associated electronics. - In operation, given the communication architecture of
FIG. 15 ,GPS tracking module 12 communicates wirelessly withmotorized base unit 2. Theprocessor 42 commands and drives thestepper motor 49 based on a calculated distance, direction and velocity. As the target moves, new target GPS data is sent from the remoteGPS tracking tag 12 to thebase unit 2 wirelessly.Base unit 2 processor compares the new target sensor GPS location data to the old target GPS data, in addition to the location of thebase unit 2 and the current pointing angle of thesmartphone 3, and computes a new pointing angle and the velocity for the smart phone device. The new angle/velocity is calculated and the motor is controlled and rotates to this new angular velocity. Upon receipt of new target sensor GPS location data, the process is repeated, and thesmart phone 3 will “follow” or track the target smoothly and accurately. The video functions in thesmart phone 3 can be employed and the video files saved on thesmart phone 3 for future viewing, editing, emailing, uploading to social media etc. - The
smart phone 3 may be any of various “smart” phone devices (Apple iPhone, Samsung Galaxy, LG and others), and is preferably equipped with an installed software App provided as part of the system herein to control said video and other functions. - In an embodiment the function of the
pointing direction sensor 29 monitoring angle ofshaft 26 may be replaced or supplemented by thesmartphone 3 itself which wirelessly transmits to thebase unit 2 controller orientation data, including true and magnetic compass heading and yaw, pitch and roll data, thereby providing information about the orientation of the smart phone device and allowing calculation of pointing angle via an installed App (provided that thesmart phone 3 is of a type having an internal compass and can output orientation). - As seen in
FIG. 3 ,enclosure 22 houses a multi-layer PC assembly including a main board (middle) seating primary electronicdevices including processor 42,motor driver controller 45, andwireless communication devices wireless communication device 46 communicates with thetracking module 12 and one 47 with thesmart phone 3. In a preferred embodiment of the present invention, thewireless communication devices - Adjustable
device mounting bracket 24 rotates abovehousing 22 onshaft 26 for generic use with a variety ofsmart phone devices 3, and theshaft 26 protrudes down through main board to a lower board containing low voltageelectric stepper motor 49, andrechargeable battery 41.Shaft 26 is preferably journaled into a bearing 53 on the lower board for frictionless rotation. In addition, for vibration-free operation theshaft 26 is damped. This is accomplished with a belt-drive inclusive of arubber belt 57 connected between asmall pulley 58 on themotor 49 shaft and alarge pulley 56 on theshaft 26 of the adjustabledevice mounting bracket 24, the pulley size differential providing speed reduction and increased torque. In another embodiment a spur gear, worm gear, gear motor or other method of speed reduction could be used. -
Battery 41 is connected to a chargingcontroller IC chip 43 that manages and recharges thebattery 41 by attaching a cable as is typical for charging smart phones by the user. For example, a mini-USB connection is very commonly used for this purpose. -
Motor driver controller 45 may be a commercially-available two-axis motor controller/driver module capable of supporting a bi-phasebipolar stepper motor 49, a variety of which are commercially available. For example, a Toshiba TB67S128FTG microstepping bipolar steppermotor drive controller 45 will suffice. - In an alternate embodiment a second motor and motor driver controller 45 (or a second motor and dual-motor 3-axis motor driver controller) can be added to additionally provide control and position along vertical axes, thereby allowing the smart device to track up and down vertically in conjunction with the horizontal. The very same approach to control can be used for vertical operation, thereby allowing the device to track in three-dimensions.
- An
optional GPS chip 48 may be provided on the main board to provide current location data of thebase unit 2 toprocessor 42. Preferably, as indicated above, location data for thebase unit 2 is wirelessly transmitted from the smart device mounted inbracket 24 to thebase unit 2. However, the location data for thebase unit 2 must be accurate for present purposes and many smart devices employ low grade GPS chips that do not provide the requisite accuracy. One skilled in the art will understand that more accurate location data of thebase unit 2 can be obtained locally from theGPS receiver 48 mounted in thebase unit 2, can be obtained remotely from a cellular service, or from any other third party source of more accurate location data. - The initial orientation and pointing direction of
smartphone mounting bracket 24 is unknown at startup and so the smartphonedevice mounting bracket 24 may be manually aligned with the remote target sensor (orientation sensor 29). Adetent button 44 is positioned onhousing 22 and may be pressed to indicate alignment. Alternatively, asoft button 44 may be provided by the App onsmart phone 3 for interaction with the user.Switch 44 causes the current pointing angle to be captured usingorientation sensor 29, and used alone or in conjunction with the angular pointing direction calculated from the orientation data provided by the smart phone and transmitted wirelessly to the base controller (true and magnetic compass heading and yaw, pitch and roll data). In anembodiment orientation sensor 29 is a potentiometer mounted to the bottom of the smart phone mountingbracket shaft 26. Thepotentiometer 29 is a variable resistance device that provides absolute position information with a shaft and with three wires connected to it. One wire is the nominal system control voltage for the system—3.3 VDC or 5 VDC, the other wire is system voltage ground and the third wire is referred to as the “wiper” which is a variable resistance/voltage output. As the shaft rotates, the resistance varies between the “wiper” and the system voltage and ground and the voltage output on the “wiper” terminal varies accordingly. The variable voltage output provides an absolute value of the current shaft position and thereby the pointing direction of the smart phonedevice mounting bracket 24. The potentiometer-typepointing direction sensor 29 offers the advantage of not requiring a homing sequence or similar initial location calibration as would be required when using relative positioning devices like encoders. Also, using an absolute positioning device like the potentiometer for pointingdirection sensor 29 ensures that the unit never loses its location pointing direction or gets “lost” even with disruptions during use, which is not true of systems using relative pointing devices. The benefits of a continuously-variable potentiometer sensor 29 become essential when tracking a fast-moving target with a camera. In another embodiment, the pointing angle of the smartphone mounting bracket 24 may be obtained from thesmart phone 3 directly using its available magnetometer output (compass) and orientation data calculated internally in the smart phone device utilizing the internal sensors magnetometer, gyroscope, accelerometer and calculated values for pitch, yaw, and roll of the smart phone device. The smart phone orientation data is transmitted wirelessly to the main controller in thebase unit 2 via bluetooth or other similar wireless connections. In this case noorientation sensor 29 is required. In a preferred embodiment (described in detail below) both orientation data sources are used as a cross-check and backup and provide information for drift compensation and error checking. In another embodiment, additional information from thesmart phone 3 including Quaternion (orientation), Accelerometer, and Gyroscope data are used to determine current pointing angle and mounting bracket angular velocity to improve target tracking. - In addition,
housing 22 is preferably equipped with abase mounting bracket 60 suitable for releasable mounting on a conventional tripod. -
FIGS. 4-6 illustrate one example of the athleticprotective pad 10 with integralGPS tracking module 12. The athleticprotective pad 10 comprises a suitable hard yet resilient synthetic material able to withstand the bending and harsh impacts inherent to competition. Such materials are known in the art, and include nylon, polypropylene (PP), polyethylene (PE), amorphous polar plastics (e.g., polycarbonate (PC)), polymethylmethacrylate (PMMA), polystyrene (PS), high impact polystyrene (HIPS), polyphenylene oxide (PPO), glycol modified polyethylene teraphthalate (PETG), acrylonitrile butadiene styrene (ABS), semicrystalline polar plastics (e.g., polyester PET and PBT), polyamide (e.g., Nylon 6 and Nylon 66), urethane, polyketone, polybutylerie terephalate, acetals (e.g., Delrin™ by DuPont), acrylic, acrylic-styrene-acrylonitrile (ASA), metallocene ethylene-propylene-diene terpolymer (EPDM) Nordel™ by DuPont), or composites. - The
protective pad 10 is molded in a partial convex arch to conform to a limb such as, for example, the elbow, forearm or shin, as illustrated, and preferably includes four molded recesses 72 open inwardly to the arch for seating the electrical components ofGPS tracking module 12. One skilled in the art will understand that other electronic component mounting schemes may be used. The electrical components ofGPS tracking module 12 are individually seated in the molded recesses 72, adhered (or molded) therein, and covered by a protectivefoam padding layer 74 as seen inFIG. 5 . The athletic protective pad may be modified in construction and form to serve as a shin pad, elbow pad, forearm pad or leg pad as required for different sports but of similar construction and function as noted herein. -
FIG. 6 shows the electrical submodules ofGPS tracking module 12 individually seated in their four molded recesses 72. They include a commerciallyavailable GPS module 76 that can track multiple satellites and do minimally several updates a second for high speed, high sensitivity tracking. Apreferred GPS module 76 is built around the MTK3339 chipset, which can track up to 22 satellites on 66 channels, is low-power, has a high-sensitivity receiver, built in antenna, and can do up to ten location updates a second. TheGPS module 76 is connected to aprocessor module 78 with integrated wireless transceiver. An ARM™ Cortex M0+ Wireless Microcontroller with SX1231 transceiver is well-suited inasmuch as it is a long range 900 Mhz packet radio transceiver for better range than Bluetooth yet without the high power requirements of WiFi (although either Bluetooth or WiFi may suffice). The processor/transceiver module 78 andGPS module 76 are connected to abattery 79, such as a 3.7V lithium polymer battery, and all the foregoing components 76-79 are connected through adetent activation switch 77. Whenswitch 77 is activated theGPS module 76 immediately begins logging GPS coordinates and timestamps, andtransceiver 77 periodically transmits this GPS/timing data (up to ten times a second) tobase unit 2. - At the base unit 2 (
FIG. 3 ) the GPS coordinates with timestamps are received bytransceiver 59 and are communicated to thebase station processor 42. - In sum, the
base station processor 42 uses the GPS location/timing data fromGPS tracking module 12 to calculate a pointing angle between themotorized base unit 2 and theGPS tracking module 12 using trigonometric math equations. The current pointing angle of thesmart phone 3 is known from theorientation sensor 29 or internal Magnetometer and other resident sensors (e.g., on-board compass) in the smart phone device. As the athlete moves, theGPS tracking module 12 moves, and new GPS coordinates and timestamps are transmitted ten times a second to thebase unit 2. Each time, thebase unit 2 processor computes a new required pointing angle and velocity needed to reorient and control smartphone mounting bracket 24. The pointing angle value is used to position themotor shaft 26 and “point” the smart phonedevice mounting bracket 24, and the computed velocity is used to calculate the needed speed of themotor 49 to reorient smartphone mounting bracket 24 and thereby thesmart phone 3 to track the target. As the data is updated and angle and velocity recalculated, thesmart phone 3 effectively and smoothly follows or “tracks” the remoteGPS tracking module 12 as it moves. Tracking as a function of velocity is superior to prior art units that do not control based on velocity but rather use only point-to-point movements. The foregoing technique is implemented by software resident in thebase station processor 42.FIGS. 7-10 are flow charts of the software sequence. - With reference to
FIG. 7 , atstep 100 turning on the base unit via switch 44 (ofFIGS. 1-3 ) commences initial start operation (later on—alignment operation). Atstep 110 the user initiates theirsmartphone 3 App. The user receives operating instruction using the screen of the smart phone and enables camera view. Next, atstep 120 the user mounts thesmart phone 3 on thebracket 22 ofbase unit 2. Atstep 130 thesmartphone 3 establishes a wireless connection with thebase unit 2 viawireless communication devices step 140 thebase unit 2processor 42 begins capturing GPS location data from thesmart phone 3. Atstep 150 the initial smart phone GPS location data is used to fix the smart phone location relative to thebase unit 2 location, and when suitable this is stored as “base station location.” Again, an onboard GPS chip 48 in themotorized base unit 2 may also be used to provide the base unit location. Atstep 160 theGPS tracking tag 12 is actuated via switch 77 (FIG. 6 ), and wireless communications are established frombase unit 2 toGPS tracking tag 12 viaradio 78. Atstep 170 the initialGPS tracking module 12 location is stored as “position 1 target sensor”. - Program flow proceeds to
FIG. 8 , where atstep 180 thebase unit 2processor 42 polls thesmart phone 3 for orientation data and its GPS coordinate data. A typical smart phone has many sensors including three accelerometers (one for every axis, x, y and z), a gyroscope, and a magnetometer. The gyroscope detects the orientation of the phone (pitch, roll and yaw around an axis) and the magnetometer provide pointing direction as compass heading data. However, some smart phones may lack a suitable magnetometer and gyroscope output and cannot provide orientation data. Ifsmart phone 3 has a suitable magnetometer and gyroscope output then flow proceed to step 195 wherebase unit 2processor 42 calculates the horizontal bearing of theGPS tracking module 12 from thebase unit 2 using GPS values “base station location” and “position 1 target sensor”, using a math formula and longitude and latitude values. - At
step 205 thebase unit 2processor 42 polls thesmart phone 3 for its gyroscope/compass heading and GPS data, and atstep 210processor 42 compares its calculated bearing from thebase unit 2 to theGPS tracking tag 10 to the gyroscope/compass heading transmitted fromsmart phone 3, and calculates a “correction angle.” Atstep 225processor 42 translates the “correction angle” into pulse commands (number and direction of pulses required to cause themotor 49 to adjust the correction angle, e.g., 200 pulses clockwise to turn one half revolution).Processor 41 sends a complete set of pulse commands (number, direction, rate) to themotor driver controller 45 which controls themotor 49 to implement the pulse-width modulated (PWM) command set.Processor 41 stores this initial alignment position as the “first pointing angle.” - One skilled in the art should understand that using two sets of GPS data available from both the smart phone 3 (or base unit 2) plus
GPS tracking module 12 offers many advantages including not requiring theGPS tracking module 12 to be collocated or calibrated at thebase unit 2. The same is true of the use of gyroscope/compass data from thesmart phone 3 as this allows thebase unit 2 to know in which direction the smartphone mounting bracket 24 andsmart phone 3 are actually pointing. Thus, by utilizing the gyro/compass data from thesmart phone 3 the initial pointing angle is known and videography can begin without any initial alignment procedure. Using the gyro/compass data from thesmart phone 3 facilitates an AUTO-alignment function (described below in regard toFIGS. 7-8 ). The system can be turned on and operation started with theGPS tracking module 12 being located anywhere in the general area. Consequently a sports player wearing theathletic pad 10 can already be on the playing field when the system is turned on and the system will start normally. - On the other hand, if
smart phone 3 lacks a gyroscope and magnetometer output and cannot provide orientation data, flow proceeds to step 190 where the user is prompted on theirsmart phone 3 to manually turn the smartphone mounting bracket 24 until the target (athlete) is centered in the field of view (and appears centrally on thesmart phone 3 viewing screen). The smart phone App provides some functionality including a “Target Aligned” button, and atstep 200 this is pressed to indicate manual alignment. Atstep 210 theprocessor 42 reads the smartphone mounting bracket 24 position from the shaft-mounted potentiometer and stores this value as “first pointing angle.” - In either foregoing case of manual alignment or automatic alignment, the smart
phone mounting bracket 24 is properly positioned andprocessor 42 stores initial alignment position as the “first pointing angle.” Process flow proceeds toFIG. 9 , where the user is prompted by thesmart phone 3 App to indicate “Tracking Mode Only?” (versus live photography). This is important inasmuch as thebase unit 2 can be used for pointing conventional cameras and video recorders, mounting them inbracket 24 and using thesmart phone 3 as a remote control. “Tracking Mode” simply tells thesmart phone 3 that it is being used as such. However, if atstep 225 the user responds “No” then thesmart phone 3 enables video recording functions of the smart phone camera. - With alignment operation complete, program flow proceeds to
FIG. 10 and normal operation. Atstep 300 theprocessor 42 waits forbase unit 2 to receive new GPS data and timestamp fromGPS tracking module 12. When it does, then atstep 310base unit 2processor 42 stores “position 2 target sensor” and time, and uses the newGPS tracking module 12 coordinates and time atstep 310 to calculate the new distance of theGPS tracking module 12 from thebase unit 2.Processor 41 checks for bad data by comparing each calculated new distance to a maximum threshold, and discards any calculated new distance that exceeds the threshold. The maximum threshold is set based on the maximum possible distance that a target is expected to move per time increment and reflects a rule of reason Being that an athlete is physically capable of only moving in small incremental distances and angular changes within each time increment,processor 41 checks for large changes in location data and this data is assumed to be “bad.” All invalid data is disregarded and not used to make changes to the current velocity value and theprocessor 42 waits forbase unit 2 to receive new GPS data and timestamp fromGPS tracking module 12. Other values are checked like the time value from the GPS for example and values outside of expected values and not used—no change in the time value for example or a zero-value returned from the GPS coordinates is considered invalid and skipped. - At
step 320processor 42 reads the current pointing angle from smartphone mounting bracket 24orientation sensor 29 and/or captures the current compass heading and smart phone orientation data fromsmart phone 3 as explained in regard toFIGS. 7-10 . - At
step 330processor 42 calculates a new delta angle change from the “first pointing angle” to the “second pointing angle.”Processor 41 also calculates from the timestamps a new velocity value based on rate of change from the “first pointing angle” to the “second pointing angle” and updates the velocity value accordingly. - Control of the
motor 49 is critical to providing good tracking and keeping the target and the smartphone mounting bracket 24 aligned. As thebae unit 2processor 42 receives new updated GPS location data from theGPS tracking module 12 and, coupled with the GPS location for the base unit 2 (derived from the smart phone 3), and the current pointing angle for the smartphone mounting bracket 24, a new “delta” pointing angle and new “delta” angular speed is calculated. The delta pointing angle is calculated by theprocessor 42 using the following equation with longitude and latitude data derived from the corresponding GPS data for theGPS tracking module 12 and base unit 2: -
New bearing calculated=a tan 2(y,x) -
- where
-
y=sin(lon2−lon1)*cos(lat2) and -
x=cos(lat1)*sin(lat2)−sin(lat1)*cos(lat2)*cos(lon2−lon1) - After a new bearing is calculated as above, the correction angle is calculated as the new required position or bearing versus the previous bearing or pointing angle. The time from the last GPS data and the new GPS is stored and compared. In an example the delta angle for correction may be 2 degrees. The corresponding pulses required for the PWM signals for
stepper motor 49 to match the required target location are calculated as steps required=degrees required*steps/degrees*, and the motordriver circuit board 45 is commanded to provide the required number of pulses to themotor 49 to change and rotate the direction of the smartphone mounting bracket 24 such that it points in the new required pointing angle to align with the remote target sensor. The rate of the movement of the smartphone mounting bracket 24 from point to point is determined from the calculated target velocity and used to set the speed to match the target movement rate, thereby providing smooth video and excellent tracking. - In addition it is desirable to match the moving velocity of the target athlete rather than simply rotating the smart
phone mounting bracket 24 from point to point. Consequently, In addition to the GPS data, the timestamps of that data are also communicated to the processor 42 (or smart phone directly). This allows calculation of timing differential and then the actual speed of the moving target. - Next at
step 340processor 42 translates the “delta velocity” and “delta angle” into pulse rate commands (number and direction of pulses required to cause themotor 49 to adjust the delta angle velocity). The motorcontroller circuit board 45 is sent a continuous stream of pulses from themain microprocessor 42 using a variable continuous PWM (pulse width modulated) output. The frequency of the PWM is varied based on the calculated target speed. This provide for smooth tracking of the remote target athlete (lacrosse or soccer player for example). - Importantly, at
step 350 theprocessor 42 checks the calculated PWM values and dynamically adjusts the microstepping factor on themotor control board 45 to ensure themotor 42 is operating in its ideal frequency range (known as “variable dynamic microstepping”). Microstepping is a way of controlling a stepper motor more smoothly than in full steps, e.g., the motor may be microstepped using 1/32 steps. Microstepping results in less vibration, makes noiseless stepping possible, and makes smaller step angles, lower speeds and better positioning possible. The net result is vastly better video quality. On the other hand, stepper motors have an optimum range of operational frequencies. The calculated velocity value may vary greatly depending on the difference in target minimum and maximum speeds, the distance from the target to thebase unit 2 and smartphone mounting bracket 24, etc. Stepper motors operate best in a certain range of speeds and also when controlled with a PWM frequency within a certain frequency range. Themotor controller 45 can be configured to operate in micro-stepping mode. Microstepping is a technique where the motor control board can make the stepper motor operate in such a way that additional steps are allowed within the same number of “real steps” (microsteps) to provide better control and operation at lower speeds. For example, a stepper motor designed for 200 steps per revolution can be controlled to operate with ⅛ microstepping, for example. This would make it such that thestepper motor 42 would now require 200×8=1600 steps per revolution or conversely, the motor would operate at slower speed (⅛) when provided with a same given PWM pulse frequency operating in full step mode. The present invention takes advantage of these factors and provides variable dynamic stepper motor mode control to provide the best possible control and smoothest operation. If the required speed is high for example, the main microprocessor controller will place the motor control board (15) in a lower or even full step (1:1) control mode so the stepper motor goes faster for a given PWM output and keeps the PWM frequency range in the best operating range for the stepper motor and calculated by the main processor (12). If the speed is required to be slow, the microprocessor will determine this and change the mode to a higher ( 1/32 for example which drives the motor 32 times slower for a given PWM frequency than operating in full step mode) microstepping mode again keeping the PWM frequency in the optimal range. This variable dynamic microstepping minimizes steps while maintaining them within the motors optimum range. -
Processor 41 sends a complete set of microstep pulse commands (number, direction, rate) to themotor driver controller 45 which controls themotor 49 to implement the pulse-width modulated (PWM) command set. - Finally, at
step 360processor 42 update the previous time, distance, location, pointing angle, and velocity with new values and continuously repeats the process ofFIG. 10 . - Preferably, the wireless communications between the remote communicating
GPS tracking module 12 andbase unit 2 are “paired” together automatically at start to ensure that only communication with said transmitter and “paired” receiver are used, and to allow multiple units to operate in the same area without interfering with the operation of other units. Similarly, data is sent by wireless communications between thesmart phone 3 andbase unit 2 and there are paired together to ensure only communication with each other, and to allow multiple units to operate in the same area without interfering with the operation of other units. Alternatively, a wired connection may be used by a wired connection (Apple lightning connector as an example). - Inasmuch as the present invention is designed to track an individual player, the installed software App provided as part of the system includes a specialized “highlights” mode of operation. This mode is selected via the software App via the user screen on the smart phone or via a pushbutton on the base station or via a verbal command to the smart phone device. In this mode of operation, the smart phone camera continuously buffers (temporarily saving a set amount of) video, the buffer size being configured during setup. The buffer size may be any time value from 10 seconds to 30 minutes. When the player wearing the GPS tracking pad does something that the videographer likes and would like to capture, they press the “highlights” button and the buffered video immediately preceding and following is saved as a recorded video file (for example, the previous 2 minutes so the user can see the play developing, and also the next 5 minutes or any time until the highlights button is pressed again or the highlight function times out and stops automatically as set up in the configuration file for the APP software by the user (5 minutes for example)). This reduces the video file sizes and allow the user to get the highlights they want rather than having to review and entire game video file.
-
FIG. 11 is an enlarged view of an exemplary adjustabledevice mounting bracket 24 which rotates abovehousing 22 onshaft 26 for generic use with a variety ofsmart phone devices 3. The mountingbracket 24 generally comprises an expandable spring-loaded frame for gripping a variety ofsmart phone devices 3, tablets, cameras etc., no matter their size differential. Importantly, the mountingbracket 24 provides full rearward access to the touchscreen of thesmart phone 3 for manipulating camera functions and or the App, and full frontal clearance for the camera field of view. A clamping-type frame with fixed horizontal struts and adjustable vertical struts is best suited. -
FIGS. 12-14 are three perspective views of anauxiliary mounting bracket 24 for camcorders. As before the mounting bracket generally comprises an expandable spring-loaded frame for gripping a variety of camcorders. A clamping-type frame with fixed horizontal struts and adjustable vertical struts is best suited. - In another embodiment of the invention an electronic compass may be added to the
base unit 2 to provide the compass information for themain microprocessor 42. The compass information may be likewise communicated to theprocessor 42 via a wired or wireless connection and the auto alignment process will proceed as noted above. - In still another embodiment of the invention, the
base unit 2 may be passive and merely transfer location and pointing angle data to thesmart phone 3 located inbracket 24, allowing thesmart phone 3 to complete the foregoing calculations and transmit final PWM data back to the base motor controller using the App (software program running on the smart phone 3). Compass heading data and other available data is already captured and available in the smart phone device. The resulting calculated required motor position and velocity commands are then sent to themicroprocessor 42 in thebase unit 2. - In still another embodiment of the invention, the
GPS tracking module 12 may communicate directly to thesmart phone 3 located inbracket 24 rather than to and through thebase unit 2, using the built-in wireless communication interfaces in thesmart phone 3.FIG. 16 shows the remote communicating architecture withGPS tracking module 12 communicating directly to thesmartphone 3. This will allow thesmart phone 3 to complete the foregoing calculations and transmit final simplified PWM data back to thebase 2motor controller 45 using the App (software program running on the smart phone 3). GPS data, compass heading data and other available data is already captured and available in the smart phone device. The resulting calculated required motor position and velocity commands are then sent to asimplified microprocessor 42 in thebase unit 2 eliminating the need for thebase unit 2 controller to communicate with the remote target sensor and streamlining the operation of the system. - In yet another embodiment the distance value (and delta distances) from
base unit 2 toGPS tracking module 12 is communicated to thesmart phone 3 via wireless communication as noted prior, and the value is used by the App operating on the smart phone to determine the best possible zoom value for the integrated video camera in thesmart phone 3. Alternatively, the App operating on the smart phone may simply suggest an external lens available for use withsmart phone 3 to enhance the range of the video camera functions. The present invention may also call upon the voice interaction and recognition capabilities of thesmart phone 3 to provide hands free control of the system during operation. For example, when the target athlete does something very good the user simply speaks to the device at the time and says “Highlight”. The location and time in the video recording are noted for quick reference and locating later during viewing time. Other commands are including “Pause”, “Restart”, etc. - In another embodiment, the present invention may utilize the image recognition capabilities of the
smart phone 3 to provide an additional or supplemental means of target tracking at closer distances. If the controller or smart phone determines that the remote target sensor is sufficiently close where GPS locating may not be best method and the internal image recognition in the smart phone is operating, the system will switch over to image recognition tracking on the fly and determine the best pointing angle for the smart phone device and command the motor accordingly and also switch back when the distance is further and best suited for GPS control. - In all the foregoing embodiments the
motorized base unit 2 receives the transmitted GPS, orientation, and timestamp data and orients the smartphone camera at the target to provide smoother more accurate tracking of an athlete in motion. - Having now fully set forth the preferred embodiment and certain modifications of the concept underlying the present invention, various other embodiments as well as certain variations and modifications of the embodiments shown and described will obviously occur to those skilled in the art upon becoming familiar with the concept. For example, as indicated above the athletic
protective pad 10 may be modified in construction and form to serve as a shin pad, elbow pad, forearm pad or leg pad as required for different sports but of similar construction and function as noted herein.FIG. 17 is a side perspective view of an embodiment of theathletic pad 10 configured as a shin pad. Design and construction is similar to the embodiment ofFIG. 5 except that dimensions and shape, e.g., of the protectivefoam padding layer 74, may change to suit the nature of the limb to be protected, and various straps or other attachment devices may be used without departing from the scope and spirit of the invention. For example, two or more sets of hook-and-loop attachment straps 20 may be utilized for securement. - It is to be understood, therefore, that the invention may be practiced other than as specifically set forth herein.
Claims (20)
1. A system for photographing a moving athlete with a portable smart device having a camera, comprising:
an athletic pad configured for protecting said athlete, said athletic pad including,
a resilient plastic shell,
a foam pad attached to said plastic shell,
a GPS tracking module embedded in said plastic shell and covered by said foam pad, said GPS tracking module being configured for periodically transmitting GPS data; and
a base unit for photographing said moving athlete in motion, including,
a housing,
a wireless communication transceiver mounted in said housing and in communication with said GPS tracking module and configured for periodically receiving said transmitted GPS data,
a motor driver circuit mounted in said housing,
a motor in communication with said motor driver circuit,
a smart device mounting bracket in operative engagement with the shaft of said motor and including a cradle extending externally of said smart device for gripping said smart device,
a potentiometer mounted in said housing and configured for outputting a continuously-variable signal corresponding to an orientation of said smart device mounting bracket,
a processor mounted in said housing and in communication with transceiver and motor driver circuit, said processor comprising software instructions for executing the steps of periodically inputting the GPS data from said GPS tracking module, periodically inputting the orientation data from said potentiometer, calculating a delta angle and delta velocity when said athletic pad moves, converting said delta angle and delta velocity to pulse-width modulated (PWM) commands, and outputting said PWM commands to said motor driver;
whereby the portable device camera tracks said moving athlete for imaging when said smart device is mounted in said cradle.
2. The system according to claim 1 , wherein said delta velocity increases when target movement rate increases.
3. The system according to claim 1 , wherein said motor is a stepper motor.
4. The system according to claim 1 , wherein said potentiometer is mounted proximate the motor shaft.
5. The system according to claim 1 , wherein said potentiometer is connected to said motor by a rubber belt.
6. The system according to claim 1 , wherein said processor comprises software instructions for executing a step of periodically inputting GPS data from said GPS tracking module.
7. The system according to claim 6 , wherein the software instructions execute a step of periodically inputting orientation data from said potentiometer.
8. The system according to claim 6 , wherein the software instructions execute a step of periodically inputting orientation data transmitted wirelessly from said smart device.
9. The system according to claim 7 , wherein the software instructions execute a step of periodically inputting orientation data transmitted wirelessly from said smart device, and the orientation data from the both the smart device and potentiometer are used to determine said delta angle and delta velocity.
10. The system according to claim 1 , wherein said base unit further comprises a GPS receiver chip and said processor comprises software instructions for periodically inputting GPS data from said base unit GPS receiver.
11. A system for photographing a moving target with a portable smart device having a camera, comprising:
a GPS tracking module including a GPS receiver for periodically communicating GPS data,
and
a base unit, including,
a housing,
a wireless communication transceiver mounted in said housing and in communication with said GPS tracking module and configured for periodically receiving said transmitted GPS data,
a motor driver circuit mounted in said housing,
a motor in communication with said motor driver circuit,
a smart device mounting bracket in operative engagement with the shaft of said motor and including a cradle extending externally of said smart device for gripping said smart device,
said wireless communication transceiver mounted in said housing also being in communication with said smart device for periodically receiving location data there from
a processor mounted in said housing an in communication with said transceiver and motor driver circuit, said processor comprising software instructions for executing the steps of periodically inputting the GPS data from said GPS tracking module, periodically inputting orientation of said smart device, calculating distance and velocity when said target moves, converting said distance and velocity to an output signal for driving said motor driver;
whereby the portable device camera tracks said moving target for imaging when said smart device is mounted in said cradle.
12. The system according to claim 11 , wherein said orientation of said smart device is inputted from an orientation sensor mounted proximate the motor shaft.
13. The system according to claim 11 , wherein said orientation of said smart device is transmitted wirelessly from the smart device.
14. The system according to claim 11 , wherein said orientation of said smart device is inputted from an orientation sensor mounted proximate the motor shaft and is transmitted wirelessly from the smart device.
15. A system for photographing a moving target, comprising:
a GPS tracking module including a GPS receiver for periodically communicating GPS data;
a base unit, including,
a housing,
a wireless communication transceiver mounted in said housing and in communication with said GPS tracking module and configured for periodically receiving said transmitted GPS data,
a motor driver circuit mounted in said housing,
a motor in communication with said motor driver circuit,
a smart device mounting bracket in operative engagement with the shaft of said motor and including a cradle extending externally of said housing and configured for mounting a portable smart device, and
a processor mounted in said housing an in communication with said transceiver, said processor comprising software instructions for executing the steps of periodically inputting the GPS data from said GPS tracking module, calculating pointing direction and velocity when said target moves, and converting said pointing direction and velocity to an output signal for driving said motor driver; and
a portable smart device having a camera, a processor, memory, and a software application stored in said memory, whereby the portable device camera tracks said moving target for imaging when said smart device is mounted in said base unit cradle.
16. The system according to claim 15 , wherein the software application stored in the smart device memory continuously buffers a sequence of video frames from said camera.
17. The system according to claim 16 , wherein the software application stored in the smart device memory continuously buffers a sequence of video frames from said camera on a first-in first-out (FIFO) basis.
18. The system according to claim 16 , wherein the software application stored in the smart device memory includes a user-selectable time preset for said sequence of buffered video frames.
19. The system according to claim 16 , wherein the software application stored in the smart device memory includes a user-selectable video capture mode.
20. The system according to claim 19 , wherein the software application stored in the smart device memory appends said buffered preset length of video from said camera to video taken in said video capture mode.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US18/225,434 US20230388640A1 (en) | 2020-05-12 | 2023-07-24 | Portable system including motorized base controller and transmitter for tracking a moving target |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US202063023408P | 2020-05-12 | 2020-05-12 | |
US17/316,837 US11711616B2 (en) | 2020-05-12 | 2021-05-11 | Portable system including motorized base controller and transmitter for tracking a moving target |
US18/225,434 US20230388640A1 (en) | 2020-05-12 | 2023-07-24 | Portable system including motorized base controller and transmitter for tracking a moving target |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/316,837 Division US11711616B2 (en) | 2020-05-12 | 2021-05-11 | Portable system including motorized base controller and transmitter for tracking a moving target |
Publications (1)
Publication Number | Publication Date |
---|---|
US20230388640A1 true US20230388640A1 (en) | 2023-11-30 |
Family
ID=78512106
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/316,837 Active 2041-07-29 US11711616B2 (en) | 2020-05-12 | 2021-05-11 | Portable system including motorized base controller and transmitter for tracking a moving target |
US18/225,434 Pending US20230388640A1 (en) | 2020-05-12 | 2023-07-24 | Portable system including motorized base controller and transmitter for tracking a moving target |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/316,837 Active 2041-07-29 US11711616B2 (en) | 2020-05-12 | 2021-05-11 | Portable system including motorized base controller and transmitter for tracking a moving target |
Country Status (1)
Country | Link |
---|---|
US (2) | US11711616B2 (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2022175287A (en) * | 2021-05-13 | 2022-11-25 | キヤノン株式会社 | Imaging apparatus, control method thereof, and program |
Family Cites Families (43)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5179421A (en) | 1990-08-20 | 1993-01-12 | Parkervision, Inc. | Remote tracking system particularly for moving picture cameras and method |
US20020057217A1 (en) * | 2000-06-23 | 2002-05-16 | Milnes Kenneth A. | GPS based tracking system |
US7893959B2 (en) * | 2002-01-22 | 2011-02-22 | Sanyo Electric Co., Ltd. | Video display system for correcting the position and size of mask images |
JP2004112615A (en) * | 2002-09-20 | 2004-04-08 | Victor Co Of Japan Ltd | Automatic tracking video camera system |
US20080002031A1 (en) * | 2005-05-06 | 2008-01-03 | John-Paul P. Cana | Multi-axis control of a fixed or moving device based on a wireless tracking location of one or many target devices |
JP2009008842A (en) * | 2007-06-27 | 2009-01-15 | Fujifilm Corp | Photographing system, photographing device, method and program |
TWI369135B (en) * | 2007-12-31 | 2012-07-21 | Nat Applied Res Lab Nat Ct For High Performance Computing | Camera control system capable of positioning and tracking object in space and method thereof |
CN201178470Y (en) * | 2008-04-15 | 2009-01-07 | 北京中大育盟教育科技有限公司 | Video automatic tracking apparatus |
US20110199482A1 (en) * | 2009-10-07 | 2011-08-18 | Morgan Arthur C | Long Range Day/Night Surveillance Video Camera |
WO2011100480A1 (en) | 2010-02-10 | 2011-08-18 | Brian Lamb | Automatic motion tracking, event detection and video image capture and tagging |
US8702516B2 (en) * | 2010-08-26 | 2014-04-22 | Blast Motion Inc. | Motion event recognition system and method |
US10560621B2 (en) | 2010-11-19 | 2020-02-11 | Symbol Technologies, Llc | Methods and apparatus for controlling a networked camera |
US8704904B2 (en) * | 2011-12-23 | 2014-04-22 | H4 Engineering, Inc. | Portable system for high quality video recording |
BR112014017773A8 (en) * | 2012-01-18 | 2017-07-11 | Nike Innovate Cv | ACTIVITY POINTS |
EP2820837A4 (en) | 2012-03-01 | 2016-03-09 | H4 Eng Inc | Apparatus and method for automatic video recording |
WO2013131100A1 (en) * | 2012-03-02 | 2013-09-06 | H4 Engineering, Inc. | Multifunction automatic video recording device |
CA2867127A1 (en) * | 2012-03-13 | 2013-09-19 | H4 Engineering, Inc. | System and method for video recording and webcasting sporting events |
JP5994306B2 (en) * | 2012-03-15 | 2016-09-21 | ソニー株式会社 | Information processing apparatus, information processing system, and program |
US20130300832A1 (en) * | 2012-05-14 | 2013-11-14 | Sstatzz Oy | System and method for automatic video filming and broadcasting of sports events |
EP2870748A4 (en) | 2012-07-06 | 2016-03-09 | H4 Eng Inc | A remotely controlled automatic camera tracking system |
US9697427B2 (en) | 2014-01-18 | 2017-07-04 | Jigabot, LLC. | System for automatically tracking a target |
US9457228B2 (en) * | 2013-07-09 | 2016-10-04 | Aditi Sinha | Sport training equipment |
JP6269014B2 (en) * | 2013-12-13 | 2018-01-31 | ソニー株式会社 | Focus control device and focus control method |
US9495759B2 (en) * | 2014-02-26 | 2016-11-15 | Apeiros, Llc | Mobile, wearable, automated target tracking system |
CN106033612B (en) * | 2015-03-09 | 2019-06-04 | 杭州海康威视数字技术股份有限公司 | A kind of method for tracking target, device and system |
DE102015003383A1 (en) * | 2015-03-17 | 2016-09-22 | Hendrik Hoppenworth | Shinguards with integrated multimodal sensor system (ShinGuardEA4ST - Shin Guard Embedded Analytics for Soccer Talents) |
EP3317880A1 (en) * | 2015-07-03 | 2018-05-09 | H4 Engineering, Inc. | Tracking camera network |
CN104922890B (en) * | 2015-07-06 | 2017-10-17 | 王继军 | Smart motion protector |
US9610476B1 (en) * | 2016-05-02 | 2017-04-04 | Bao Tran | Smart sport device |
US10735659B2 (en) * | 2016-03-17 | 2020-08-04 | Flir Systems, Inc. | Rotation-adaptive video analytics camera and method |
CH711985B1 (en) * | 2016-04-15 | 2017-06-30 | Njiki Samuel | Shin guards customized and connected by an electronic chip to measure various parameters and usable in the fields of sport and health. |
WO2017197174A1 (en) * | 2016-05-11 | 2017-11-16 | H4 Engineering, Inc. | Apparatus and method for automatically orienting a camera at a target |
CN106645152A (en) * | 2016-12-08 | 2017-05-10 | 苏州德创测控科技有限公司 | Image collection device |
IT201700009363A1 (en) * | 2017-01-30 | 2018-07-30 | Virtual Innovation Center Srl | Automatic tracking system and method for the video recording of sporting events, in particular football matches at 5, 7 or 11. |
US20190234131A1 (en) * | 2018-01-29 | 2019-08-01 | Greenshpon Engineering Works Ltd. | Automatic door control |
US10602929B1 (en) * | 2018-04-13 | 2020-03-31 | Justin McKay | Smart athletic wear and related method of use |
US20200329203A1 (en) * | 2018-12-06 | 2020-10-15 | Heimavista Inc. | System and method for panning shot with image-stabilizing function |
US20200186720A1 (en) * | 2018-12-06 | 2020-06-11 | Heimavista Inc. | System and method for object tracking with image-stabilizing function |
US10855926B2 (en) * | 2018-12-06 | 2020-12-01 | Heimavista Inc. | Automatic object tracking system and automatic object tracking method |
US11159734B2 (en) * | 2018-12-06 | 2021-10-26 | Heimavista Inc. | Automatic object tracking system and automatic object tracking method |
FR3095956A1 (en) * | 2019-05-15 | 2020-11-20 | Vbkam | Intelligent shin guard |
ES1242231Y (en) * | 2019-10-15 | 2020-08-10 | Tangibles Smart Tech Sl | INTELLIGENT SHIN GUARD |
CA3096312C (en) * | 2020-10-19 | 2021-12-28 | Light Wave Technology Inc. | System for tracking a user during a videotelephony session and method ofuse thereof |
-
2021
- 2021-05-11 US US17/316,837 patent/US11711616B2/en active Active
-
2023
- 2023-07-24 US US18/225,434 patent/US20230388640A1/en active Pending
Also Published As
Publication number | Publication date |
---|---|
US20210360161A1 (en) | 2021-11-18 |
US11711616B2 (en) | 2023-07-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9253376B2 (en) | Portable video recording system with automatic camera orienting and velocity regulation of the orienting for recording high quality video of a freely moving subject | |
US9495759B2 (en) | Mobile, wearable, automated target tracking system | |
US20230388640A1 (en) | Portable system including motorized base controller and transmitter for tracking a moving target | |
US9723192B1 (en) | Application dependent video recording device architecture | |
US8482612B2 (en) | System and method for location tracking | |
US9800769B2 (en) | Apparatus and method for automatic video recording | |
US9294669B2 (en) | Remotely controlled automatic camera tracking system | |
JP2015513858A (en) | Multi-function automatic video recorder | |
WO2015017572A1 (en) | Orientation control of an image sensor of a portable digital video camera | |
CN103336532B (en) | The support device of 3D visual-aural system and 3D visual-aural system | |
CN106370184A (en) | Automatically tracking shooting method of unmanned aerial vehicle, unmanned aerial vehicle and mobile terminal equipment | |
JP2015080186A (en) | Automatic positioning tracking photographing system and automatic positioning tracking photographing method | |
JP2004112615A (en) | Automatic tracking video camera system | |
JP3918053B2 (en) | Small mobile devices | |
JPS62243480A (en) | Automatic zooming tracking camera and range | |
EP3422693A1 (en) | Application dependent video recording device architecture | |
CN212660222U (en) | Digital tactical wearing equipment for police dog | |
CN116017301A (en) | Indoor high-precision positioning-based intelligent tracking recording and broadcasting camera setting method | |
Sato et al. | On Automatic Flying Distance Measurement on Ski Jumper's Motion Monitoring System | |
TWM430092U (en) | Monitoring apparatus and system with remote control over a network | |
KR20130064533A (en) | Attachable patch-type camera |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |