US20140204230A1 - Portable high quality automated video recording system - Google Patents
Portable high quality automated video recording system Download PDFInfo
- Publication number
- US20140204230A1 US20140204230A1 US14/223,803 US201414223803A US2014204230A1 US 20140204230 A1 US20140204230 A1 US 20140204230A1 US 201414223803 A US201414223803 A US 201414223803A US 2014204230 A1 US2014204230 A1 US 2014204230A1
- Authority
- US
- United States
- Prior art keywords
- camera
- location
- remote unit
- subject
- remote device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 claims abstract description 98
- 230000033001 locomotion Effects 0.000 claims abstract description 61
- 230000000694 effects Effects 0.000 claims description 12
- 230000007246 mechanism Effects 0.000 claims description 5
- 230000001419 dependent effect Effects 0.000 claims description 3
- 241001465754 Metazoa Species 0.000 abstract description 5
- 230000008569 process Effects 0.000 description 23
- 238000010586 diagram Methods 0.000 description 22
- 230000008859 change Effects 0.000 description 15
- 230000008901 benefit Effects 0.000 description 13
- 238000004891 communication Methods 0.000 description 12
- 230000006870 function Effects 0.000 description 11
- 238000005516 engineering process Methods 0.000 description 8
- JTJMJGYZQZDUJJ-UHFFFAOYSA-N phencyclidine Chemical compound C1CCCCN1C1(C=2C=CC=CC=2)CCCCC1 JTJMJGYZQZDUJJ-UHFFFAOYSA-N 0.000 description 8
- 230000001133 acceleration Effects 0.000 description 7
- 239000003550 marker Substances 0.000 description 6
- 238000012545 processing Methods 0.000 description 6
- 238000013459 approach Methods 0.000 description 5
- 238000012937 correction Methods 0.000 description 5
- 238000005259 measurement Methods 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 5
- 238000004091 panning Methods 0.000 description 5
- 238000004364 calculation method Methods 0.000 description 4
- 238000004519 manufacturing process Methods 0.000 description 4
- 230000003466 anti-cipated effect Effects 0.000 description 3
- 230000001276 controlling effect Effects 0.000 description 3
- 230000003028 elevating effect Effects 0.000 description 3
- 239000000243 solution Substances 0.000 description 3
- 230000005236 sound signal Effects 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 208000012661 Dyskinesia Diseases 0.000 description 2
- 206010029216 Nervousness Diseases 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 239000003086 colorant Substances 0.000 description 2
- 230000003111 delayed effect Effects 0.000 description 2
- 238000011423 initialization method Methods 0.000 description 2
- 230000005855 radiation Effects 0.000 description 2
- 238000001454 recorded image Methods 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 230000002441 reversible effect Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 206010016338 Feeling jittery Diseases 0.000 description 1
- 241000282412 Homo Species 0.000 description 1
- 208000003028 Stuttering Diseases 0.000 description 1
- 230000004397 blinking Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000007123 defense Effects 0.000 description 1
- 230000000994 depressogenic effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000005670 electromagnetic radiation Effects 0.000 description 1
- 230000003760 hair shine Effects 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 238000001746 injection moulding Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000003278 mimic effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000000465 moulding Methods 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 229920000642 polymer Polymers 0.000 description 1
- 229920002635 polyurethane Polymers 0.000 description 1
- 239000004814 polyurethane Substances 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
- 210000000707 wrist Anatomy 0.000 description 1
Images
Classifications
-
- H04N5/23203—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
- H04N23/681—Motion detection
- H04N23/6812—Motion detection based on additional sensors, e.g. acceleration sensors
Definitions
- a surfer may wish to capture his surfing experience for later enjoyment or to improve his or her surfing technique.
- a father may wish to record his son's winning touchdown in a football game.
- a mother may wish to capture her daughter's record-breaking gymnastics performance.
- the camera is typically, and sometimes for best results, relatively far away from the participant, or more generally, the subject.
- a second person is needed to control and position the camera. Because humans are imperfect, the quality of the recorded video may not be ideal. For example, the camera operator or cameraman may have an unsteady hand making the recorded video too shaky and unbearable to watch. Additionally, the cameraman may become tired or distracted and may not keep the subject in the view field of the camera. In this situation, the cameraman may fail to capture an exciting or interesting moment. Further, some subjects may not have a second person willing to operate the camera. In this case, the individual loses the chance to record him or herself.
- this invention provides a portable system for automated orientation of a camera to point at a freely moving target, such system comprising a positioner to orient the camera; a remote unit that obtains location information; and a base station configured to command the positioner to orient the camera at the freely moving target and to regulate the velocity of the orienting; wherein the base station comprises a receiver to receive the location information from the remote unit; wherein location information received by the base station when the remote unit is collocated with the camera is stored and used as the location of the camera by the base station; and wherein the base station commands the positioner to orient the camera at the freely moving target using location information received from the remote unit when the remote unit is collocated with the freely moving target and the location of the camera received by the base station when the remote unit is collocated with the camera.
- this invention provides a method of automatically following a freely moving target with a camera, such method comprising the steps of setting up a camera associated with a positioning device wherein the positioning device is capable of receiving commands to orient the camera; collocating a remote unit that obtains location information with the camera and storing location information obtained as the location of the camera; moving the remote unit to a location away from the camera such that the remote unit is at or near the center of the field of view of the camera; determining the initial pointing angle of the camera using the stored location of the camera and the stored location of the remote unit; periodically receiving signals relevant to the location of the remote unit as the remote unit is associated with the freely moving target and transmitting information related to the location of the remote unit to the positioning device; periodically determining turning angle and velocity values for orienting the camera to remain pointed at the remote unit based in part on the initial pointing angle of the camera; and commanding the positioning device to orient the camera based on the determined turning angle and velocity values.
- this invention provides a system comprising a first component sized so as to be portable and stationary when the first component is assembled for use; the first component connectable with a camera, wherein the camera, when connected, is turnable; a second component that is associated with a recording subject; wherein the first component comprises a receiver to receive information regarding the location of the first component and the location of the second component; wherein the first component turns the camera using location information received by the receiver such that the camera optically follows the subject moving to different locations and wherein the first component turns the camera around at least one axis based at least in part on the velocity of the subject.
- This invention also provides each and every novel feature, element, combination, step, and/or method disclosed or suggested herein.
- FIG. 1 shows an overview of the automatic recording system according to a preferred embodiment of the present invention.
- FIG. 2 shows a simplified block diagram illustrating the components of an automatic recording system according to a preferred embodiment of the present invention.
- FIG. 3 shows a schematic diagram illustrating the electronic components of the remote device of an automatic recording system according to a preferred embodiment of the present invention.
- FIG. 4 shows a schematic diagram illustrating the electronic components of the orientation controller of an automatic recording system according to a preferred embodiment of the present invention.
- FIG. 5 is a schematic diagram illustrating various adjustment features of an automatic recording system according to a preferred embodiment of the present invention.
- FIG. 6 shows an overhead schematic diagram illustrating an embodiment of the feedback light source of an automatic recording system according to a preferred embodiment of the present invention.
- FIG. 7 shows an overhead schematic diagram illustrating another embodiment of the feedback light of an automatic recording system according to a preferred embodiment of the present invention.
- FIG. 8 shows an overhead schematic diagram illustrating yet another embodiment of the feedback light of an automatic recording system according to a preferred embodiment of the present invention.
- FIG. 9 shows a schematic diagram illustrating error issues encountered in determining the position of the components of an automatic recording system.
- FIG. 10 shows a schematic diagram illustrating a motor assembly of an automatic recording system according to a preferred embodiment of the present invention.
- FIG. 11 shows an overhead schematic diagram illustrating a preferred embodiment of the setup light of an automatic recording system according to a preferred embodiment of the present invention.
- FIG. 12 shows a flowchart illustrating an automatic recording method according to a preferred embodiment of the present invention.
- FIG. 13 shows a flowchart illustrating an automatic recording system initialization method according to a preferred embodiment of the present invention.
- FIG. 14 shows a diagram illustrating the relationship between an initial determined reference angle and the angle determined for a subject that has moved.
- FIG. 15 shows a flowchart illustrating an automatic recording method according to a preferred embodiment of the present invention.
- FIG. 16 shows a flowchart illustrating a method of backlash compensation according to a preferred embodiment of the present invention.
- FIG. 17 shows a flowchart illustrating a method of measuring the backlash after power-up according to a preferred embodiment of the present invention.
- the present invention relates to systems and methods of automatically orienting a pointing device (also called a directional device or pointer) such as a camera. More particularly, the present invention relates to a system and method that automatically orients a directional device, such as a camera, based on receiving periodic updates of location information of a freely moving subject and converting the location information into commands that change the orientation of the directional device such that the directional device substantially points at the subject. It is noted that the subject may be human, animal, or an object.
- the system controls the velocity of orientation changes in order to point the pointer at the subject in a smooth and controlled way.
- the pointing device is a camera and the system may be used for automatic video recording of a freely moving subject. Controlling velocity is particularly useful in such an embodiment because it helps to produce high quality video recordings without jerky camera artifacts.
- a preferred embodiment of the present invention relates to systems and methods of automatically pointing a device, such as a camera, at a freely moving subject using location coordinates based on transmissions received from satellite-based and/or earth-based transmitters.
- One major advantage of the systems and methods of the present invention is the ability to record a freely moving subject automatically without the need for a person to handle the camera.
- Another major advantage of the present invention is the ability to produce video recordings of a subject's activity from the perspective of a spectator, a competition judge, fans, etc., without engaging the services of a cameraman.
- the systems and methods of the present invention may be used to memorialize countless activities such as surfing, kiteboarding, skateboarding, motocross racing, golfing, playing soccer, playing tennis, snowboarding, skiing, studying animal behavior, dramatic arts, weddings, concerts, birthday parties, etc.
- a plurality of devices embodying the inventive systems and methods hereof may be set up at locations of interest to record multiple subjects engaged in an activity. The video recorded in such a scenario may then be processed to combine the footage of the activity participants.
- Automatic recording by a camera of a person engaged in an activity is a complex task.
- Such a task requires an initialization where the pointing direction of the camera, the location of the camera and the location of the subject become known in absolute terms and or relative to one another; the camera must be oriented such that it initially points substantially at the subject.
- the camera orientation must be updated in a controlled manner such that the camera continues to substantially point at the subject in real time or near real time as the subject changes locations.
- the camera movements should be made in a way that the resulting recording will be enjoyable for viewers.
- the “enjoyability” will be referred to herein as “high quality video recording” (HQVR).
- High quality video recording relates to the way camera motion is handled and not necessarily to the qualities of the camera (i.e., camera resolution, quality of the camera optics, or adjustability of parameters including lens aperture, focus and zoom).
- a preferred embodiment of the present invention comprises of one or more devices that receive signals from a constellation of satellites that are parts of a Global Positioning System (sometimes referred to herein as “GPS”).
- GPS Global Positioning System
- the GPS signals are registered by the device or devices and the location coordinates of one or more system components are determined.
- GPS refers to the Global Positioning System maintained by the United States Department of Defense. It is noted that the systems and methods of the present invention may be used with signals received from other and/or multiple satellite-based positioning systems, partially terrestrial positioning systems, or fully terrestrial positioning systems. As will be discussed further herein, appropriately located GPS units will generate location coordinates of the subject to be recorded and of the camera that does the recording.
- a preferred embodiment of the invention also includes devices that receive location data or correction factors from GPS units and transmit the received data to different parts of the automatic recording system and/or receive the signals from another transmitting unit. These devices are also sometimes referred to by the acronym UART (Universal Asynchronous Receiver/Transmitter). These devices will be referred to herein as transceivers.
- UART Universal Asynchronous Receiver/Transmitter
- a preferred embodiment of the present invention also includes one or more devices that receive a plurality of location data, as well as other information regarding current and past camera direction. These devices include central processing units (CPU) or microcontroller units (MCU). The CPU and/or MCU generate instructions, based on the location data and other information, for a positioner to point an associated camera in the direction of a subject.
- CPU central processing units
- MCU microcontroller units
- the positioner preferably comprises one or more motors to orient an associated camera such that a given frame recorded includes the subject.
- the motor or motors that move the camera are preferably equipped with one or more encoded wheels (together with the necessary light sources and sensors) employed to make the camera positioning and motor movements sufficiently precise.
- a high degree of precision of camera movements is essential for the appropriate control of both the camera orientation and the camera movement velocity as the camera moves.
- the systems and methods of the present invention make camera movements classified as HQVR using instructions that mimic movements that would be imparted to the camera by a highly skilled cameraman.
- movement of the subject detected by a GPS unit and transmitted to a CPU is considered “movement” only when the subject moves beyond a predetermined distance from the center of the camera view.
- a “deadband” within which movements of the subject are detected but do not result in movement of the camera is included in the systems and methods of the present invention. Utilization of a deadband contributes to high quality video recording.
- the acceleration/deceleration and movement speed of the camera are controlled when the movements of the subject are outside of the deadband by the systems and methods of the present invention.
- the goal is to keep the subject substantially within the recording frame.
- a preferred embodiment of the present invention includes camera movement controls for the camera movement speed that cause the camera initially to accelerate quickly but smoothly and then to slow when the camera approaches the pointing direction of the subject.
- a preferred embodiment of the present invention also comprises systems and methods to compensate for inherent system lag between the time a subject changes location in real time and the delayed time in which the camera orientation begins to change in response to the detected subject location change.
- a preferred embodiment of the present invention accounts for the possibility that GPS location data may be missing (for example, due to a communication error between the GPS satellites and the GPS sensor or between parts of the inventive system).
- the systems and methods of the present invention ignore brief periods of data loss. When the data loss exceeds a preset time limit, the camera either stays in place or returns to the last known position of the subject.
- a preferred embodiment of the present invention automatically controls camera orientations as well as the functions of the camera (e.g., camera zoom level). For example, if location coordinates from the remote device are missing for some period of time, the camera may be instructed to zoom out to increase the probability of retaining the subject in the camera view until receipt of location data resumes.
- control of the zoom feature of the camera is employed by the system as a method to keep the subject inside the frame when the subject moves fast.
- FIG. 1 shows automatic recording system 10 , one preferred embodiment of an automatic pointing system.
- Automatic recording system 10 is preferably configured to detect the location of and track subject 12 .
- subject 12 may be, for example, a participant in a sporting event. It is noted that the subject to be tracked and recorded by automatic recording system 10 may also be an animal or an object.
- Automatic recording system 10 preferably includes remote device 16 (which may also be referred to herein as remote unit 16 ).
- Remote device 16 is preferably a wearable element that may be temporarily secured to the subject.
- the remote device preferably comprises a housing or enclosure for necessary electronic components and a means to secure the housing to subject 12 .
- a strap system is used to secure the remote unit 16 to subject 12 during use.
- the remote unit 16 is secured to the subject 12 through other means such as a clasp, mount, pouch, or suction cup.
- the subject 12 and remote device 16 may be co-located by strapping the remote device 16 to the subject 12 .
- the subject wears the remote device on his or her arm.
- the remote device 16 may be connected to other portions of the subject's body, apparel, or equipment used in performing the activity to be recorded.
- the remote device may be connected with a surfboard and not necessarily to the human, object, or animal riding the surfboard.
- subject 12 together with associated remote device 16 will be referred to as the target.
- Automatic recording system 10 further comprises orientation controller 70 .
- Orientation controller 70 is preferably sized to be portable.
- orientation controller 70 may have a height of about five inches, a width of about three inches, and a depth of about three inches. These exemplary dimensions permit orientation controller to be conveniently stored in, for example, an airline carry-on travel bag. Such dimensions may be altered to make the orientation controller smaller or even larger so long as the device may be ported easily from location to location.
- the components which connect with orientation controller 70 are also similarly portable.
- Camera 46 is preferably connected to orientation controller 70 , as shown.
- Camera 46 may be a video camera, a still photograph camera, a smart phone, a tablet computing device, or any other attachable recording device.
- Orientation controller 70 is preferably mounted on tripod 34 (embodying herein a stand to support the positioner). In the embodiment shown in FIG. 1 , tripod 34 comprises upwardly extending mast 36 .
- Orientation controller 70 is preferably connected to mast 36 of tripod 34 . It is noted that there are a variety of tripods in the marketplace.
- Orientation controller 70 is preferably designed to engage the typical connection interfaces of tripods.
- the tripod 34 is replaced by other means for providing a portable platform capable of being temporarily fixed relative to earth such as, for example, a weighted block, a mounting strap such as to mount orientation controller 70 to a fixed object like a pole or bar, or a suction cup.
- a portable platform capable of being temporarily fixed relative to earth
- a weighted block such as to mount orientation controller 70 to a fixed object like a pole or bar, or a suction cup.
- the pointing device (a camera, for example) is an integral component of orientation controller 70 .
- camera 46 points along relative position pointing vector 48 as depicted.
- the zoom level of camera 46 is preferably set such that subject 12 is sufficiently within the field of view 60 of camera 46 and based on the precision limitations of the inventive system. A more detailed discussion of the zoom level adjustment with respect to the movement of the subject is included below.
- Orientation controller 70 is preferably equipped with light source 38 , as shown.
- Light source 38 provides feedback to subject 12 .
- light source 38 is a light emitting diode (LED).
- LED light emitting diode
- Light source 38 preferably emits a light beam that is preferably collimated (collimated light beam 64 ) and is directed in a direction which sufficiently corresponds to the axis of the camera lens direction.
- the collimation of light source 38 may be fixed or zoom dependent.
- the collimation of light source 38 is preferably fixed for a typical zoom camera angle (about five degrees with a variance of about two degrees in typical surfing applications, for example).
- the collimation angle may be adjusted by moving light source 38 closer or farther relative to a collimating edge, or collimating edges.
- the collimation is substantially in one dimension only, meaning that the light beam is only substantially collimated in the direction corresponding to the panning movement of orientation controller 70 .
- the collimation may be in two dimensions corresponding to the panning movement of orientation controller 70 and further corresponding to the camera tilt angle that may be manually or automatically adjustable.
- the two dimensional collimator may be an opening shaped as a square, a circle, etc.
- Orientation controller 70 of automatic recording system 10 preferably comprises receiving/transmitting antenna 71 , as shown.
- Receiving/transmitting antenna 71 is preferably mounted to orientation controller 70 in such a way as to maintain an optimum radiation pattern relative to remote device 16 which is free to move.
- the optimum radiation pattern is achieved when receiving/transmitting antenna 71 is oriented so that the direction in which receiving/transmitting antenna 71 is most effective is in the direction of the camera lens axis. Put another way, the optimum position of receiving/transmitting antenna 71 is, for most antennas, perpendicular to the direction in which it transmits. In certain embodiments the optimum antenna 71 position is maintained automatically.
- Achieving HQVR requires precise control of camera 46 as it tracks subject 12 .
- the precision of the orientation of camera 46 depends on several factors. These factors include at least the following: (1) the precision with which the locations involved in aiming camera 46 are determined; (2) the precision of determining the initial camera orientation; (3) the precision of the movement of the motor or motors that points camera 46 ; (4) the lag time and the rate of updating of the location of the target; (5) the angular velocity of the of the camera movements; and (6) the quality and reliability of the communication link between various parts of the system such as between, for example, orientation controller 70 and remote device 16 .
- the necessary precision of the orientation of camera 46 depends on the angle of its field of view 60 ; this angle is adjusted when the zoom is set.
- the camera's field of view is preferably set or controlled, automatically or otherwise, based, in part, on consideration of the known orientation precision of the automatic recording system.
- differential GPS, real time kinematic phase correction, and other correction methods are used to improve precision of location determination when using GPS for determining camera orientation.
- camera 46 is mounted on orientation controller 70 that only provides automatic panning of camera 46 .
- the tilt and zoom of camera 46 are manually controlled and set by the user prior to recording. This embodiment can be adequate for recording, for example, surfing in the ocean.
- the focus of camera 46 may be camera controlled (i.e., using an autofocus feature of a commercial camera) or manually adjusted and set to a particular focal distance (such as the maximum setting to prevent camera 46 from focusing on an object in the foreground that is not the intended subject 12 of the recording).
- the focus is automatically controlled by the system based on the locations of the camera 46 and remote device 16 .
- additional manual adjustments may be made prior to recording. For example, the height of camera 46 may be adjusted with mast 36 and the tilt of the camera may be adjusted to a constant tilt position using a camera attachment device between orientation controller 70 and camera 46 .
- camera 46 is mounted on orientation controller 70 using a camera attachment device that comprises standard female-male attachment fasteners that are typically used for attachment to tripods. Some cameras, such as smart phones, may not be equipped with standard tripod attachment devices. To connect these types of cameras, a custom camera attachment device or adapter is preferably provided.
- the camera attachment device is preferably designed to be permanently or temporarily affixed to orientation controller 70 and preferably contains lock and quick-release mechanisms.
- Tripods are commonly equipped with bubble levels.
- tripod 34 preferably comprises one or more levels to level orientation controller 70 .
- Orientation controller 70 or camera 46 may also preferably comprise a bubble or electronic level to assist in leveling automatic recording system 10 or in generating level footage as a result of using the automatic recording system.
- the system may also be manually sufficiently leveled by noting the view field of the camera 60 and adjusting components of the system, such as tripod 34 , accordingly.
- FIG. 2 shows a simplified block diagram illustrating the components of an automatic recording system according to a preferred embodiment of the present invention.
- Orientation controller 70 comprises two major components, namely positioner 32 and base station 18 .
- Base station 18 comprises electronic components to communicate with remote device 16 and to process the data received from remote device 16 to control positioner 32 .
- Positioner 32 orients camera 46 so that remote device 16 is sufficiently within field of view 60 of camera 46 .
- FIG. 3 shows a schematic diagram illustrating the electronic components of the remote device of an automatic recording system according to a preferred embodiment of the present invention.
- Remote device 16 preferably comprises GPS unit 22 which receives signals (illustrated as signal 20 ) from a positioning system.
- the signals are provided by GPS and/or other similar satellite systems (or partially or fully terrestrial systems).
- the purpose of the signals is to determine a location of the signal receiver in terms of earth-centered, earth-fixed (ECEF) coordinates. It is noted that receivers and decoders that work with signals from alternative or additional positioning systems may be used as well.
- ECEF earth-centered, earth-fixed
- the ECEF coordinates are preferably transmitted to microcontroller (MCU) 66 .
- Microcontroller 66 is preferably programmed to receive ECEF coordinate data, to parse the data, and to send the data to transceiver 24 .
- microcontroller 66 also receives data from on/off button 72 , setup button 74 , and transceiver 24 .
- Transceiver 24 receives and sends radio signals 50 and 52 , respectively, to a transceiver associated with orientation controller 70 .
- Transceiver 24 also sends data to and receives data from microcontroller 66 .
- Microcontroller 66 also sends data to the status indicator LED 84 , as shown.
- remote device 16 The electronic components of remote device 16 are preferably powered by a rechargeable battery 76 .
- a battery charge indicator 82 is provided, as shown.
- the power requirements of GPS units are strict.
- remote device 16 may comprise other electronic elements, such as filters, to meet the appropriate power requirements.
- the electronic components of remote device 16 are preferably housed in enclosure 77 .
- Enclosure 77 of remote device 16 may be made using injection molding techniques or other similar molding techniques and may be made of a polymer, such as polyurethane.
- Enclosure 77 is preferably equipped with fastener 78 to attach remote device 16 to the body or clothing of subject 12 .
- Remote device 16 may be attached to the leg, arm, wrist, etc., of subject 12 . Additionally, remote device 16 may be attached to sporting equipment used by subject 12 . Further, remote device 16 may be connected with any object that is, or is part of, the subject of the recording.
- Enclosure 77 is also preferably provided with two openings for charging contacts 80 .
- Enclosure 77 is preferably sufficiently waterproof and is capable of surviving certain impacts.
- the LED indicators, or light therefrom, associated with remote device 16 are visible through transparent or translucent areas of enclosure 77 .
- the materials and the construction of remote device 16 ensure that the device will float in water.
- remote device 16 is preferably equipped with additional input and/or output means.
- the additional input and/or output means may include buttons, switches, speakers or other means of vibration creation, touchscreens, or the like.
- These additional input means give subject 12 the ability to communicate with, receive information from and give commands to base station 18 using remote device 16 .
- These commands are essentially manual overrides and may include, for example, (1) initialize, (2) pan right, (3) pan left, (4) begin recording, (5) stop recording, and (6) zoom in/out.
- One reason for initiating one or more of the listed commands is that the subject receives feedback from orientation controller 70 regarding the state of the system such as the state of recording. It is noted that some of the listed commands require ability to control the camera.
- remote device 16 may be equipped with a “marker” button, or control. Operating the marker control preferably sends a signal to base station 18 causing positioner 32 to quickly move the camera away from its present position and then back to its prior position. The camera should be moved to a sufficient degree and/or with sufficient speed so that the camera field of view change is noticeably distinct from the prior field of view.
- This feature provides at least one major advantage in that these camera movements may be used efficiently to find interesting or important recorded video footage. For example, when engaged in surfing, the subject may catch a wave and, when he has completed his run, he may initiate the above-described marker function.
- the remote device could include camera control buttons, switches, etc.
- remote device 16 is preferably equipped with a “record last” button or control. Such a control would send a command to camera 46 to store the last N minutes of footage as a separate file. N, the number of minutes to be stored, may be selected during setup from an array of choices (e.g., 1, 2, 3, or 4 minutes or other selectable values) or by inputting a specific number of minutes.
- remote device 16 may contain a display for real time or delayed playback of recorded video using communication technology known to those having skill in the art which would allow footage recorded by the camera to be displayed on the remote device.
- voice recognition means are provided for speaking commands to control base station 18 via remote device 16 .
- One advantage of the ability to start and stop recording by speaking commands is that a surfer, for example, could say “RECORD” when he begins to paddle toward a wave and say “STOP” when he has completed surfing a wave. This would eliminate the need to watch long stretches of video (which may span hours) to select only those sections that will be of interest to the surfer.
- the automated recording system can be used to record during several hours of activity, such as a surf session, to ensure the highest likelihood of capturing unexpected events.
- One or more of the above embodiments for marking important events may be implemented to ease the editing burden after use of the automated recording system.
- FIG. 4 shows a schematic diagram illustrating the electronic components of the orientation controller of an automatic recording system according to a preferred embodiment of the present invention.
- Orientation controller 70 preferably comprises base station 18 and positioner 32 (see FIG. 2 ).
- orientation controller 70 may include GPS unit 26 that receives signals (depicted as signal 20 ) from GPS satellites or similar positioning system.
- the ECEF coordinates are transmitted within base station 18 to a central processing unit (CPU) 30 that is programmed to receive the coordinate data together with data from on/off button 86 , setup button 88 , and transceiver 28 .
- Transceiver 28 sends and receives radio signals 50 and 52 , respectively, to and from remote device 16 .
- Transceiver 28 also sends data to and receives data from CPU 30 .
- CPU 30 also sends data to pan drive 42 .
- Pan drive 42 may include means, such as encoded wheels and related sensing devices (not shown), to control motion of output shaft 68 . It is noted that other embodiments of the invention may incorporate a tilt drive and the statements made herein concerning the pan drive are applicable to the tilt drive as well.
- base station 18 The electronic parts of base station 18 are powered by battery 90 which is preferably rechargeable.
- a charge indicator LED 92 is provided to indicate whether battery 90 needs charging.
- the power requirements of GPS unit 26 are strict and electronic elements including filters may be provided to meet the necessary power requirements.
- Both the elements of base station 18 and positioner 32 are preferably housed in a common enclosure (enclosure 100 ).
- Positioner 32 preferably comprises pan drive 42 and turning shaft 68 .
- Enclosure 100 is preferably equipped with fastener 98 (shown schematically in FIG. 4 ).
- fastener 98 couples orientation controller 70 to a mounting base (embodied in FIG. 1 as tripod 34 ) such that output shaft 68 turns relative to orientation controller 70 .
- fastener 98 is coupled to output shaft 68 and mounting base 34 such that orientation controller 70 , which is coupled to pan drive 42 , moves relative to the mounting base 34 which is fixed relative to earth during use.
- Enclosure 100 preferably has two openings for charging pins 94 to which an appropriate charger may be attached.
- Appropriate circuitry within base station 18 preferably provides electricity for charging contacts 96 .
- remote device 16 may be charged through orientation controller 70 by engaging charging pins 80 of remote device (see FIG. 3 ) with charging contacts 96 .
- Pan drive 42 is preferably coupled to driving shaft 68 through a gearbox that preferably includes elements to compensate for rotational play.
- camera 46 is firmly attached to orientation controller 70 using a camera attachment device (not shown) or by integration of a camera into orientation controller 70 .
- Pan drive 42 moves the orientation controller 70 together with camera 46 based on commands it receives from CPU 30 as discussed further below.
- orientation controller 70 is preferably outfitted with light source 38 .
- Light source 38 is preferably recessed on enclosure 100 .
- Light source 38 preferably shines a collimated light beam along pointing vector 48 (see FIG. 1 ).
- Light source 38 is preferably an LED powered by battery 90 .
- subject 12 can only see the light beam emanating from light source 38 when he or she is in field of view 60 of camera 46 .
- Light source 38 is preferably recessed, so that an opening on the front of enclosure 100 functions as a collimator.
- Light source 38 provides visual confirmation to subject 12 that orientation controller 70 or positioner 32 is properly pointing camera 46 substantially in his direction.
- Base station 18 comprises status indicator LED 102 , as shown.
- the status of base station 18 may be determined by observing changes in status indicator LED 102 (e.g., changing of color, blinking, etc.).
- orientation controller 70 may also be equipped with other light sources used during setup/initialization of the system.
- the location of orientation controller 70 is stationary during recording and location updates from GPS unit 26 are used to implement a differential GPS method, a real time kinematic phase corrective method, and/or other location correction methods such as coordination with GPS unit 22 of remote device 16 as to which satellite or other signals to use for location calculations to improve the precision of the relative location determination of remote device 16 .
- base station 18 is not equipped with a GPS unit. In such an embodiment, GPS unit 26 is not present. Thus, base station 18 performs no location update regarding its own location during recording.
- base station 18 may be a separate unit from positioner 32 such that base station 18 and positioner 32 are not housed in a single enclosure.
- base station 18 and positioner 32 in the same enclosure is convenient and efficient for some embodiments. It is noted however, that the present invention includes embodiments where a single base station controls multiple positioners and cameras. Further, the base station may be a separate unit located some distance from the positioner it controls. In these embodiments, additional signal transmission systems are provided to establish communication between the base station and the one or more positioners and cameras.
- FIG. 5 is a schematic diagram illustrating various adjustment features of an automatic recording system according to a preferred embodiment of the present invention.
- FIG. 5 depicts one preferred embodiment of the present invention illustrating positioner 32 mounted on a mounting base.
- the mounting base shown in FIG. 5 is tripod 34 . It is noted that other mounting bases may be used.
- An elevating mast 36 is preferably included to raise and lower positioner 32 , as shown.
- Mast 36 allows for manual adjustment of the camera orientation as an override of the orientation controller 70 that may be used, for example, to have the subject intentionally off center in the frame of the camera.
- Mast 36 may be integral to tripod 34 or it may be a separate attachable component.
- positioner 32 includes an integrated gimbaled platform 40 .
- Gimbaled platform 40 is preferably mounted atop elevating mast 36 , as shown. In those embodiments in which the mounting base does not include an elevating mast 36 , positioner 32 may be mounted directly to the mounting base. Camera 46 is preferably mounted to gimbaled platform 40 . Positioner 32 also preferably comprises pan drive 42 to pan camera 46 and tilt drive 44 to tilt camera 46 . The tilt axis is perpendicular to the plane of the schematic of FIG. 5 , and if the camera 46 is tilted, the camera axis will be no longer horizontal as shown.
- FIG. 6 shows an overhead schematic diagram illustrating an embodiment of the feedback light source of an automatic recording system according to a preferred embodiment of the present invention.
- FIG. 7 shows an overhead schematic diagram illustrating another embodiment of the feedback light of an automatic recording system according to a preferred embodiment of the present invention.
- FIG. 8 shows an overhead schematic diagram illustrating yet another embodiment of the feedback light of an automatic recording system according to a preferred embodiment of the present invention.
- the embodiments of FIGS. 6 , 7 , and 8 show different ways in which the subject of the recording may be informed that camera 46 continues to substantially point at him or her. Because the subject of the recording will be some distance away from camera 46 , a feedback system to let the subject know that the system is working properly is advantageous.
- FIGS. 6 , 7 , and 8 are top down views of the positioner 32 with camera 46 and feedback light sources 38 and 39 . All parts shown in these drawings are not necessarily in the same horizontal plane.
- collimated light beam 64 is provided by collimated light beam 64 .
- collimated light beam 64 is emitted by light source 38 which may be an LED, or other light source.
- Field of view 60 of camera 46 and collimated light beam 64 are characterized by having substantially the same angle and pointing in the same direction.
- a corresponding control is provided to adjust the collimation angle of light source 38 .
- This control may be a motor that moves light source 38 farther from the collimating slit or edge for narrower zoom angles (when the camera zooms in).
- two lights sources are used, namely light source 38 and light source 39 , as shown.
- the light sources are preferably LEDs emitting different light colors.
- Light source 38 emits a first color and light source 39 emits a second color that is distinct from the first color of light source 38 .
- collimated light beam 64 of light source 38 is wider than that of light source 39 .
- Collimated light beam 64 preferably corresponds to the zoom angle of the camera.
- Collimated light beam 65 is preferably substantially narrower than collimated light beam 64 , as shown. Both collimated light beams preferably point in the direction the camera is pointing, as shown.
- subject 12 will know that he or she is in the field of view of camera 46 when he or she sees the light color of light source 38 . If subject 12 is centered, i.e., the subject is close to the middle of the field of view of camera 46 , he or she will see light of mixed color. If the subject sees no light, then he or she knows that he or she is not in the field of view of camera 46 .
- the light beams of light source 38 and light source 39 are positioned so that they point to the left and right, respectively, of camera 46 .
- this arrangement there is a narrow area which corresponds to the camera axis where the beams of light from both light sources are visible.
- the light sources are different colors the aforementioned narrow area appears as a mixed color.
- the subject 12 is off center, the subject knows in which direction camera 46 is off, namely off to the left or off to the right. Based on this feedback, subject 12 may elect to re-initialize the automatic recording system 10 so that he or she is in the center of the field of view of camera 46 .
- the systems and methods hereof must take into consideration various factors including the uncertainties of the location of camera 46 and of remote device 16 .
- the distance between remote device 16 and camera 46 that is required for setup and operation is determined by the knowable or known uncertainties of the locations of the camera and remote device. Larger distances and wider field of view 60 are required for embodiments relying on less precise locations.
- the camera's field of view may be set to a zoom angle of about five degrees with the camera about 200 to 800 feet from the surfer. In this case, at least a precision on the order of about ⁇ 2.5 degrees is desirable. With the assumption that the uncertainty of the location of remote device 16 with respect to camera 46 is about ⁇ 8 feet, then the necessary minimum operating distance to achieve precision on the order of about ⁇ 2.5 degrees is about 183 feet (calculated as 8 feet/tan(2.5 degrees). If the location of remote device 16 is 99 percent of the time within the about ⁇ 8 feet boundary, subject 12 will be inside the field of view of the camera 60 99 percent of the time. Applicant has observed that inherent error related to GPS positioning gives some uncertainty regarding the orientation of the camera. In circumstances where the camera is near the remote device (e.g., less than about 183 feet in the above example), the inherent error in GPS position will decrease the precision desired to keep the subject in the field of view of the camera and will lower the probability of capturing high quality videos.
- FIG. 9 shows a schematic diagram illustrating error issues encountered in determining the position of the components of an automatic recording system. More particularly, FIG. 9 illustrates the concept of angular uncertainty (denoted as 6 a ) caused by inherent GPS uncertainty.
- the systems and methods of the present invention may rely on GPS data to determine angular movements that will cause a camera to keep pointing in the direction of a moving subject. GPS uncertainties are different in orthogonal directions. Thus, the area of uncertainty around a location obtained from GPS may be represented by “error bubble” 310 and 320 . In a worst case scenario, the maximum uncertainty extends the distance measured by the longer diameter of the error bubbles on opposing sides of the actual location of remote device 16 and camera 46 , as shown. This distance is referenced as extreme direction 49 .
- the uncertainty using an exemplary inexpensive GPS unit is about eight feet or about 2.5 meters but can be less than that. With this level of uncertainty, it is possible that pointing vector 48 may be pointing in any direction between the extreme directions 49 .
- D 0 value 366.5 feet. It is noted that if a GPS unit with lesser uncertainty is employed, the distance D 0 may be reduced. Another way to decrease D 0 is to use less “tight” shots (i.e., shots that are “zoomed” out) with high resolution and edit the video in post-production.
- FIG. 10 shows a schematic diagram illustrating a motor assembly of an automatic recording system according to a preferred embodiment of the present invention.
- Positioner 32 (see FIG. 2 ) preferably comprises at least one motor assembly as described herein.
- the rotor shaft of motor 250 is shaft 200 which, as a driving (input) shaft, is connected to gearbox 210 .
- Gearbox 210 significantly reduces the angular velocity of the driven (output) shaft 220 that turns an attached pointer (e.g., a camera).
- Driving shaft 200 and potentially driven shaft 220 are equipped with encoded wheels 230 and 240 , respectively. When referring to encoded wheels, reference is also made to encoded wheel systems.
- Optical encoded wheel systems include light sources, detectors, and processing means that are commonly used with optical encoded wheels for detecting their movements, counting marker strips, etc.
- Encoded wheel systems are not limited to optical means of detecting shaft movement, and can be capacitive as well as magnetic.
- One preferred exemplary embodiment of the gear reduction value is 540 ⁇ with encoded wheel 230 on driving shaft 200 having 100 markers.
- the gear reduction value is the ratio between rotations per minute on driving and driven shafts.
- the angular movement of driven shaft 220 when motor (driving) shaft 200 moves from one code strip of encoded wheel 230 to the next is about 1/54000 part of a turn, i.e., 0.0067 degrees.
- a motor assembly such as the one depicted in FIG. 10 may have a backlash introduced by gearbox 210 and by any coupling elements between shafts 200 and 220 and gearbox 210 .
- gearbox 210 may be necessary to eliminate rotational play, or backlash, or compensate for it.
- One solution for eliminating rotational play is to use a substantially direct drive connection between the motor and pointer.
- HQVR it is necessary to be able to move the camera both fast and slow. For example, the angular velocity for tracking a surfer who moves at about one foot per second at a distance of 600 feet from the camera is about 0.1 degrees per second.
- a gearbox or other similar device is preferably connected between the driving (input) and driven (output) shafts to sufficiently reduce the angular velocity of the driven shaft.
- the gearbox tolerances introduce rotational play.
- the rotational play may increase over time due to wear and tear of the gears.
- One solution to reduce rotational play of gearboxes is to always rotate the driven shaft in the same direction when approaching a desired angular position.
- the camera should move smoothly in more than one direction (if panning, to the left and right); thus, the aforementioned “same direction” method is not applicable.
- Another possible solution for reducing rotational play is to use a static load, for example, a tensioning spring.
- a static load increases the required motor torque.
- One embodiment of the present invention preferably uses one or two encoded wheels to generate information concerning the angular position of a shaft and to control rotary motion. Further, the automatic recording system of the present invention is configured to compensate for some or all backlash as will be discussed further below.
- the automatic recording system embodiment of the present invention compensates for backlash every time the base station 18 sends a command to positioner 32 that includes a change of direction of turning the camera.
- the advantage of this approach is that the system is not “catching up” after backlash occurs, but rather acts in a preventative manner.
- the backlash for the particular gearbox and related system components used is determined during manufacturing. The process is illustrated by the flow chart shown in FIG. 16 . Once determined, a set value of the backlash is included when programming the firmware that controls CPU 30 of base station 18 (refer to FIG. 16 , see step 300 ).
- a second encoded wheel (encoded wheel 240 ) is preferably attached to output shaft 220 .
- This embodiment is illustrated by the flowchart shown in FIG. 17 .
- the process illustrated in FIG. 17 provides the information to start the process of FIG. 16 at step 300 .
- the steps of the process shown in FIG. 16 are carried out after the steps of FIG. 17 are completed.
- the second encoded wheel 240 ( FIG. 10 ) is not included.
- Second encoded wheel 240 is preferably used during a startup protocol for positioner 32 and both encoded wheel systems are enabled (step 305 and step 310 , FIG.
- Motor (input) shaft 200 is turned in one direction and the encoded wheel system registers the turning of the output shaft 220 in step 315 . The motor is then stopped and both encoded wheels are reset in steps 320 and 325 . Next, the turning direction of motor (input) shaft 200 is reversed and the encoded wheel system reads the position of motor (input) shaft 200 at the moment when turning of the encoded wheel 240 of the output shaft 220 is detected, step 330 .
- encoded wheel 240 preferably has 100 markings around the wheel corresponding to an angular distance of about 3.6 degrees per marking.
- motor 250 is turned in one direction an angle sufficient to start moving output shaft 220 .
- the movement of the output shaft is monitored using the second encoded wheel 240 .
- the turning of motor 250 is stopped when the output shaft is just past the edge of a coding strip (step 315 ).
- the positions of both encoded wheels 230 and 240 are set to zero (steps 320 and 325 ).
- motor 250 is started again and instructed to move in the opposite direction. Because of the backlash experience, output shaft 220 and encoded wheel 240 do not start turning immediately.
- Motor 250 keeps turning and at the moment when encoded wheel 240 on driven (output) shaft 220 starts turning, the new position of encoded wheel 230 on input shaft 200 is registered (step 330 ).
- the turning angle of the input shaft is measured and recorded at step 335 .
- the mechanical ratio between the pulse numbers registered on the driving (input) and driven (output) shafts is calculated at step 340 .
- the mechanical ratio can be set as a constant in the firmware.
- the backlash is calculated to be the number of driving shaft pulses registered less the encoder pulse ratio (step 345 ) and set as the backlash value until the next power up of the system (step 350 ).
- the precision of this measurement depends on the width of the edge of the markings of second encoded wheel 240 and the definition of the light beam used for the detection of the movement of this encoded wheel. In Applicant's experience, the uncertainty of the backlash measurement is less than about 0.1 degrees. This backlash measurement procedure is preferably carried out every time the system is powered up and its value is saved for the recording session.
- the motor driving shaft 200 is turned to the backlash limit, i.e., to the position where turning further would begin turning the driven (output) shaft 220 (step 360 ).
- This motor position corresponds to the current direction received from the base station 18 (step 365 ).
- the firmware of the base station decides whether a rotation direction change has occurred, step 380 . If it has, the motor shaft is rotated in the reverse direction, adding the backlash, step 390 . Otherwise the rotation occurs in the previous direction and backlash is not added, step 395 .
- At least one advantage of the other backlash compensation process described is that the system keeps up with any changes in the backlash that may occur over the lifetime of system due to normal wear and tear.
- FIG. 11 shows an overhead schematic diagram illustrating a preferred embodiment of the setup (initialization) light of an automatic recording system according to the present invention. More particularly, positioner 32 and camera 46 are shown equipped with collimated light source 260 that may be used during the initialization or setup of automatic recording system 10 . (It is noted that orientation controller 70 of FIG. 1 could be shown in FIG. 11 instead of positioner 32 as the unit performing the functions described here). The relative orientations of the positioner 32 and camera 46 are preferably fixed for the initialization process. This collimation is accomplished by blocking a portion of the light from light source 260 . As shown in FIG. 11 , light source 260 is preferably collimated such that light beam 270 is delimited on one side.
- direction 280 is parallel with pointing vector 48 of camera 46 .
- the remote device is preferably placed at location 290 .
- Location 290 will be typically about 100 to 500 feet away from camera 46 .
- a user encountering the light at location A and location B will notice a difference in the characteristic of the light at each location.
- the light at location B at the other side 285 of the light beam is easily distinguishable from the light at location A because at location B the light is far from the area where camera 46 is pointing.
- the subject can find the center of the view field of the camera by finding location A.
- the present invention includes both systems and methods for high quality video recording.
- HQVR may be achieved with a combination of three complex strategies, each involving a number of steps.
- a first strategy is the establishment of a reference camera orientation using an initialization or setup procedure.
- a second strategy is the establishment of unique communication between a remote device and a base station.
- a third strategy is the use of the flow of the angular information regarding the movements of the subject to actually move the camera to follow the subject.
- a preferred embodiment of the present invention employs all three of these strategies thereby achieving a high level of HQVR.
- the relative positions of camera 46 and subject 12 may be determined from signals received by GPS units in base station 18 and remote device 16 where camera 46 is at the location of base station 18 and remote device 16 is located with subject 12 .
- the direction of camera 46 may be known in absolute terms (i.e., relative to directions like horizontal, north, etc.) using a set of devices such as a level, a compass, gyroscopes, and the like.
- the direction of camera 46 may also be known in relative terms (i.e., with reference to an initial direction).
- the setup procedure of the system is a method of finding and saving the initial direction of camera 46 without using devices that determine the absolute direction of camera 46 .
- the transceivers 24 and 28 of remote device 16 and base station 18 are accomplished using transceivers 24 and 28 of remote device 16 and base station 18 (see FIG. 3 and FIG. 4 ).
- the transceivers must be able to communicate with each other while ignoring signals from other similar units which may be operating in the same vicinity. For example, multiple automatic recording systems 10 may be set up on the same beach in close proximity.
- Unique communication is also necessary when multiple base stations and/or multiple remote devices are employed as parts of a single system.
- the communication between base station 18 and remote device 16 preferably occurs using a radio link which operates at the ultra-high frequency (UHF) range (e.g., 2.4 GHz). At the nominal 2.4 GHz, a transmitter actually has a multiplicity of separate exact frequencies called channels at which it operates.
- UHF ultra-high frequency
- Each channel is close to 2.4 GHz but slightly off from one other so that crosstalk is eliminated.
- Data is sent over the radio link every time GPS unit 22 refreshes coordinates (about every 10 to 500 microseconds). Each transmission lasts a very small length of time. Nevertheless, there is a small probability that messages from devices sent over the same channel may “collide” (i.e., arrive during time periods that overlap). These colliding messages cannot be interpreted. Thus, they are ignored by the system. If multiple devices broadcast on the same channel and keep sending messages at constant time intervals, it is possible that a whole series of communications may “collide”. This is avoided by implementing a random delay in the time each message is sent. The delay time is preferably short compared to the GPS refresh time but long compared to the duration time of each message.
- Transceiver 22 of remote device 16 preferably generates a random identification number (ID) that is placed within each data packet sent to base station 18 .
- ID random identification number
- Base station 18 registers the ID during a pairing process and ignores any data packets that do not have the correct random ID.
- messages from base station 18 to remote device 16 include the same ID and communication packets with a different ID are ignored.
- a new random ID is preferably generated each time the remote device is powered up. Therefore, pairing must take place so the base station “knows” what the new ID is each time the remote device is turned on.
- both base station 18 and remote device 16 use the same default radio channel (e.g., channel one). The user pushes simultaneously a button on the remote device and on the base station.
- the base station and remote device set the random ID for the session. Once this is accomplished, they switch to a different radio channel selected randomly by the base station. If two users are pairing separate systems simultaneously, the systems will recognize this scenario and wait until the users try to pair the device again.
- the channels that are used for normal operation mode are different from the channel used for pairing. Since pairing only takes a brief period of time, the channel used for it will generally be relatively quiet. It is a manufacturing decision whether the pairing is initiated by the remote device 16 (as described above) or by the base station 18 .
- the base station 18 and remote device 16 have a quasi-continuous flow of location coordinates of the remote device 16 and subject 12 .
- This information is converted into a quasi-continuously updated series of angles of pointing vector 48 . It is noted that simply giving commands to electrical motors to move camera 46 to keep up with the angles will not result in HQVR due to the issues addressed above (for example, backlash, GPS uncertainty, jumpiness, etc.).
- FIG. 12 shows a flowchart illustrating an automatic recording method according to a preferred embodiment of the present invention.
- the process illustrated in FIG. 12 occurs when CPU 30 of base station 18 has data concerning the location and orientation of camera 46 .
- the method illustrated by FIG. 12 assumes that in the initial orientation of the camera pointing sufficiently in the direction of the subject has been previously saved and communication between base station 18 and remote device 16 has been previously established.
- a new or updated location of remote device 16 (which is collocated with the subject of the recording) is obtained.
- objects are collocated when the distance between the objects is much less than the usual location determination error observed when using the locating devices described herein (e.g., GPS devices).
- the remote device 16 may be worn by the subject, and, when so worn, the remote device 16 is collocated with the subject. Additionally, when two objects are described as being in close proximity with one another they are also considered to be collocated.
- step 420 the new or updated location of remote device 16 is transmitted to base station 18 .
- the new or updated coordinates of remote device 16 are used to compute an angle for orienting camera 46 to track subject 12 (step 430 ).
- decision points for various data stream occurrences such as missing data points, steady or unchanged subject locations, small movement by the subject, fast movements by the subject, and the like.
- step 440 the computed data is converted into a command, or drive signal, sent by CPU 30 to positioner 32 to move camera 46 to a new angle in accordance with the updated position of remote device 16 .
- the CPU sends appropriate commands, such as zoom in or zoom out, to the appropriate function of the camera.
- the process illustrated in FIG. 12 is repeated every time a location update is generated in remote device 16 .
- the updating frequency for the process of FIG. 12 depends on the GPS unit or units employed.
- the updating frequency is preferably in the 2 to 100 Hertz range.
- the substantially continuous updating of the location coordinate data allows substantially continuous tracking and continuous visual contact of subject 12 by camera 46 .
- subject 12 collated with remote device 16
- his, her, or its movement is characterized by an s(t) function, i.e., the location in time.
- the velocity v(t) is the first derivative and the acceleration a(t) is the second derivative of this function; both are computed by the CPU using routine techniques.
- a camera direction error caused by the time lag present from the time when the location measurement is taken until the time when camera 46 points to the location.
- This time lag depends on (1) the processing speed of the GPS unit(s), (2) the processing speeds of microcontroller 66 , CPU 30 and transceivers 24 and 28 , and (3) the mechanical speed of positioner 32 . (Zooming and the speed of zoom adjustment may also play a role in the quality of aiming camera 46 ). The longer it takes for automatic recording system 10 to process and transmit data in response to the measured location of remote device 16 and the slower the mechanical components of positioner 32 react, the larger the camera direction error may be.
- the error may be reduced by estimating the anticipated position of the target based on past location, velocity, and acceleration information and instructing the positioner to move to the anticipated position. Therefore, the CPU 30 is preferably programmed to predict “current” positions of the target based on recent past s, v, and a values.
- the velocity with which the positioner moves is proportional to the size of the angle between current angle and the angle of the most recently determined target location. (Note that the current angle of the positioner may lag behind the angle that corresponds to the “current” position of the target). Using anticipated positions provides for faster camera movement when necessary but may sometimes result is overshooting errors.
- CPU 30 preferably employs a process to estimate or predict the magnitude of the positioning error of the remote device 16 .
- a signal is sent to camera 46 to adjust the camera zoom so that the field of view is sufficiently wide. For example, at high or fast changing velocities, the likely pointing error may increase.
- CPU 30 preferably sends a signal to the camera to zoom out.
- the velocity of the subject 12 may also be viewed in comparison with the field of view 60 when the distance between the camera and the target are taken into account. For example, if the target is at a distance of 600 feet from the camera and the field of view is five degrees, then the distance between the edges of the viewed region is about 52 feet.
- the subject may get to the edge of the field of view before the automatic recording system 10 reacts to the sudden motion.
- the camera 46 should zoom out and possibly zoom back in when it has caught up with the subject based on the subject's most recent location, velocity, and acceleration data.
- FIG. 13 shows a flowchart illustrating an automatic recording system initialization method according to a preferred embodiment of the present invention.
- the process of FIG. 13 begins with step 110 .
- the automatic recording system 10 is powered on and the remote device 16 is placed in close proximity to camera 46 .
- remote device 16 may be held above camera 46 .
- the common location of camera 46 and of remote device 16 is determined using GPS unit 22 associated with remote device 16 . This information is transmitted to CPU 30 of base station 18 in step 130 where it is stored as the location of the camera (step 140 ).
- the user—with remote device 16 moveses away from camera 46 (step 150 ). The user preferably moves at least the minimum distance determined by the desired precision as noted in the discussion above.
- a feedback signal may be used to alert the user whether or not the user should proceed to the next step, or the user may count steps taken or estimate the distance in any other way he or she chooses. If the user is not far enough from camera 46 , then step 150 is repeated until the distance condition is satisfied (step 160 ). Once satisfied, the process may continue. In step 170 , the user finds the position where remote unit 16 is at or near the center of field of view 60 of camera 46 . There are multiple ways this may be accomplished. Refer at least to FIGS. 6 , 7 , 8 , and 11 , their related discussion, and further descriptions below.
- step 180 the location of remote device 16 is saved (step 190 ).
- the saved locations of camera 46 (see step 140 ) and remote device 16 are then used to compute an initial camera angle in an ECEF coordinate system.
- automatic recording system 10 is initialized and recording may proceed.
- FIG. 14 shows a diagram illustrating the relationship between an initial determined reference angle and the angle determined for a subject that has moved.
- the location of the camera 46 is obtained and stored (steps 110 , 120 , 130 , and 140 ); this location is denoted in FIG. 14 as (x 1 ,y 1 ).
- the location of remote device 16 determined at a distance away from camera 46 (step 190 ); the location of remote device 16 at this time is denoted as (x 2 ,y 2 ).
- the angle ⁇ 2 may be calculated in a predetermined (ECEF) coordinate system x,y.
- subject 12 will be at new locations.
- subject 12 may be at a new location denoted as (x,y).
- the corresponding orientation of the camera may be calculated as the angular change ⁇ .
- ⁇ 2 is set to zero and all subsequent turning angles are computed with reference to this original orientation.
- One method of computing the angles illustrated in FIG. 14 would use a formula that first calculates distance per degree for the latitude and longitude location obtained from the GPS units, converts the locations defined by latitude and longitude into Cartesian coordinates, and then uses geometric relationships to arrive at the desired result.
- the conversion to Cartesian coordinates may also take into account the ellipsoidal shape of the earth and altitude data as well.
- this method is unnecessarily complex.
- the distances between the camera and the remote device are very small compared to the distances computed as intermediate data.
- the result of a calculation is a small number that is obtained as a difference of large numbers, very small relative errors in the large numbers can cause significant errors. This is remedied by using numbers with ten significant digits.
- Another method uses a simpler approach and computes the angles in a more direct manner. For example, the calculation of the angular change may be done using the following formula:
- Positioner 32 preferably has a marker or indicator that designates the front of positioner 32 .
- Camera 46 is mounted on positioner 32 such that the optical axis of camera 46 is positioned in a way that corresponds to the marker or indicator or the camera is otherwise integrated into the system in a manner which accomplishes this orientation requirement.
- the relative positions of positioner 32 and camera 46 are fixed.
- the user moves away from the camera to an appropriate distance and finds point A (see FIG. 11 ) by visually assessing the transition in the visibility of the light source 260 .
- a light sensing instrument such as, for example, a photodiode, may be employed to find point A automatically.
- light source 260 is preferably collimated. Collimated light beam 270 is parallel to pointing vector 48 . The user may now accomplish step 170 by finding the area of highest light intensity.
- light sensors such as photodiodes, may be used to further automate step 170 .
- step 170 Another alternative method to accomplish step 170 is to position remote device 16 away from camera 46 at a distance determined by the required precision (steps 150 and 160 ). Next, camera 46 is turned manually or through control commands until remote device 16 is in the center of the camera's field of view 60 . Pushing a function (setup or initialize) button on base station 18 or on remote device 16 now tells CPU 30 that camera 46 is oriented toward the remote device 16 (step 190 ) and saves remote device's location coordinates for establishing the reference orientation.
- a function setup or initialize
- remote device 16 is equipped with a display. Pictures of footage taken by the camera will be shown on the display in real time. Further, the remote device may have controls that cause camera 46 to turn in different directions. The user, after putting sufficient distance between him or her and camera 46 (step 160 ), may direct the camera 46 to turn until he or she is found properly centered in the picture or footage displayed on the remote device.
- FIG. 15 shows a flowchart illustrating an automatic recording system method according to a preferred embodiment of the present invention. More particularly, FIG. 15 illustrates the process used to generate movement commands to move positioner 32 .
- CPU 30 determines whether or not the location of the remote device has been updated. CPU 30 waits until the location of the remote device has been updated.
- the positioner command output returns camera 46 to the last detected position of subject 12 .
- “too long” may be defined, for example, as missing two to ten consecutive updates or about 500 milliseconds to 2.5 seconds if the normal updating frequency is five Hertz.
- step 530 the updated location coordinates are recalculated in terms of angular orientation of camera 46 .
- step 540 the difference of the updated and previous orientations is compared to a deadband to decide whether the change in the orientation warrants camera movement. As an example, if the angular change is less than about 0.1 degrees, the camera does not move. This feature prevents unnecessary small movements that could result in video that stutters. To further illustrate this concept, if subject 12 is a speed skater and the remote device 16 is attached to his or her arm, left to right arm swings would occur nearly every second. It would be very unpleasant to watch a video in which the camera follows these arm swing movements.
- an effective driving voltage is computed as shown in step 150 .
- Proportional-integral-derivative methods may be applied in this step.
- the effective driving voltage is preferably proportional to the angle between the new target angle and current camera orientation.
- a deadband may be accomplished using some or all of the angular latency due to gearbox backlash as described above.
- the new camera angle is calculated in step 560 (the angle calculated in step 530 is one input for the calculation in step 560 ). At velocities that exceed a particular limit, it is expected that the camera movement lags substantially behind subject 12 . To correct for this lag, a subsequent position may be predicted based on the last two, three, or more angular positions. This can be predicted using velocities and accelerations computed based on the last three or more data points.
- the driving voltage applied will be higher (and the camera movement will be faster) if the angular change is greater. If the camera orientation has been lagging, the camera movement will be even faster.
- V is preferably updated frequently. For example, if the target angle is updated at five Hertz, V may be updated at 200 Hertz.
- the movement preferably slows to avoid overshooting.
- the edge of the deadband may be recalculated when the subject moves past the deadband boundary.
- the deadband may move slower than the target in some circumstances so that even moderate movement in the same direction moves the camera and similar movement in the reverse direction does not. This approach reduces unnecessary camera movements and the jitteriness of the recording to a significant extent.
- a mechanical deadband is also capable of achieving this.
- pulse width modulation may be applied either alone or in combination with adjusting the voltage.
- Other control approaches may be employed in different embodiments of the invention depending on the type of motors used in the positioner to orient the camera.
- the velocities of stepper motors may be controlled by adjusting the time interval between step or microstep commands.
- Open loop control which eliminates the need for an encoded wheel, may also be used by keeping track of step count and direction.
- step 570 the target angle is modified based on the known or estimated backlash of the driving motor and gearbox. See FIG. 10 and the accompanying discussion for more detailed information concerning backlash compensation.
- step 580 the effective voltage and target angle are output to the positioner as there are two command parameters regulating a motor as, for example, a pan drive. In embodiments where multiple drives are available, each drive receives commands that result from similar processing.
- CPU 30 may also deliver drive signals directly to the camera so that the zoom, and therefore the field of view, is adjusted. Such adjustment will depend on the distance between the camera and the subject, the velocity of the subject, or whether the signal about the subject's location is available or has been missing for a period of time.
- the backlash and deadband feature have similar effects on camera movement in that both instances there is a change in the angular position of the subject that does not immediately translate to camera movement.
- one embodiment of the present invention may include a backlash compensation value set to be less than the true angle of backlash. This creates a “mechanical deadband” which is equal to the true backlash angle minus the programmed backlash angle.
- both the deadband feature and the backlash compensation are eliminated.
- a “negative deadband” feature is implemented by setting the deadband value to be negative. In this embodiment, the camera leads the moving target by the absolute value of the negative deadband. This is desirable in applications in which the subject does not change directions frequently.
- the value of the negative deadband could also be a function of velocity and/or acceleration of the subject.
- the backlash compensation value is programmed to be a larger value than the true backlash value.
- the camera leads the moving target by the difference between the programmed backlash value and the true backlash value.
- the value of backlash could be a function of the target's velocity and/or acceleration. For example, if the target changed direction and was moving quickly in the new direction, the value of backlash compensation could be calculated to be a larger value so that the camera catches up to the target more quickly. This is advantageous in applications where the target changes directions frequently and moves fast. After the subject has moved in one direction, a change of direction may result in drastic lagging of the camera behind the subject.
- Backlash overcompensation and negative deadband are similar in their effect to predict a location for the subject that is further along the direction of current movement.
- the camera angle intentionally lags behind the current target angle.
- the amount of lag time should be at least equal to the time between target location updates. For example, if the positioner receives updated target location information at a rate of 5 Hertz, then the camera should lag behind the target by at least 200 milliseconds.
- the advantage of this embodiment is that new target location information is available before the camera reaches the most current target data point allowing for smoother panning velocity to be achieved.
- orientation controller 70 may be equipped with a number of security features.
- the system may contain an accelerometer that is turned on when the initialization or set up is completed and turned off by the user at the end of a recording session.
- the accelerometer senses vertical movement of the orientation controller 70 that would occur if it was stolen.
- the user is preferably alerted by, for example, an alarm which may be audible, visual, or both.
- status indicator LED 84 on the remote device 16 may begin flashing to alarm the user.
- the orientation controller 70 is also preferably equipped with a mechanical fastener that connects it to an auger secured in the ground as well as with a lock that secures the camera 46 to the auger. Additionally, for those embodiments which have a GPS sensor associated with the camera, the orientation controller, base station, or positioner, the location of the orientation controller may be traced using the GPS sensor or could be used to detect theft when the GPS unit detects a location that is outside the error bubble of the camera location determined during initialization.
- a single positioner and a single camera may be used to track multiple remote devices. For example, at a sporting event, multiple subjects may be within the camera view. An optimal direction for the camera may be computed based on the locations of the multiple remote devices and the location of the camera so that multiple targets appear within the field of view of the camera. Additionally, an appropriate zoom may be combined with the computed optimal direction to maximize the number of targets appearing in the field of view of the camera.
- a process is preferably employed in which the positioner moves the camera to capture all of the multiple targets in its field of view if possible. If not all targets are able to be captured in the camera's field of view, some of the targets are selected. In such an embodiment, a selection of the targets must be made.
- the selected target or targets may be determined by several alternative methods including the following:
- a target may be designated as a “primary” target.
- the “primary” target is tracked.
- the system adjusts orientation and/or camera zoom to capture both the “primary” target and nearby secondary target(s).
- the “primary” target may be tracked when possible. If the primary target cannot be tracked (e.g., because the signal from its remote device is missing), then a secondary target is tracked. This method is applicable for multiple ranked targets as well.
- Targets for tracking based on attributes of their movement. For example, one selection scheme may be based on target velocity such that the target with the highest detectable speed is tracked. This method is applicable, for example, when multiple surfers are in the ocean, wearing remote devices that communicate with the same base station. The surfer who moves the fastest will be tracked. According to another embodiment, targets moving faster than a preset minimum speed are tracked. For example, the system may track a surfer moving faster than a particular speed (and likely to be riding a wave) over a surfer who is relatively stationary. According to another embodiment, multiple cameras may be set up along a path for recording a single target that moves large distances. In such an embodiment, an appropriately configured base station serves all positioners and cameras.
- the base station is not collocated with all or with any of the positioners and cameras.
- the positions and initial orientations of each camera are determined during a setup procedure that is appropriately modified from the setup method described for a single positioner embodiment (see, for example, FIG. 13 and the accompanying discussion).
- Each positioner also incorporates a transceiver to receive commands and provide feedback.
- the positioners may also be equipped with GPS units which makes the setup procedure more efficient. The GPS equipped positioners transmit their location coordinates to the base station.
- the automatic video recording system comprises multiple remote devices and multiple positioners and cameras.
- a series of cameras may be set up along a downhill ski run, a golf course, or other venue. Additionally, multiple subjects have their own associated remote devices.
- the location coordinates, initial orientation, and field of view of each camera are determined during setup.
- a base station sends commands to each positioner and camera to follow and to record targets as they appear in each camera's field of view. The methods described below for the case of a single camera and multiple targets are applied for target selection for each camera.
- automatic recording system may be equipped with GPS units programmed such that the remote device(s) and base station recognize which satellites they receive signals from at a particular point of time.
- the list of satellites may be compared and the largest common set of satellites may be used to compute location based on the data received from the largest common set of GPS satellites.
- GPS unit A may have received signals from satellites 1, 2, 3, 4, 5, 6, and 7;
- GPS unit B may have received signals from satellites 3, 4, 5, 6, 7, 8, 9, and 10.
- the largest common set of satellites is satellites 3, 4, 5, 6, and 7.
- the largest common set of satellites may vary every time data from satellites are refreshed.
- the orientation controller incorporates an array of two or more directional receivers, such as antennae or microphones, oriented in different directions and the remote device transmits signals (electromagnetic or sound signals) corresponding to the receiver types.
- the direction of the remote device with respect to the orientation controller may be determined from the strengths of the signals received by the receivers at the orientation controller.
- the Doppler shift may be used to determine if the remote device is moving closer or farther from the camera.
- the information obtained may be used either as a replacement of GPS sensors or in addition to GPS technology. GPS technology has distinct advantages outdoors. In those circumstances where GPS signals may not be available (e.g., indoors or between buildings), electromagnetic or sound signal orienting may be used. These technologies may also be used in combination with the GPS technology.
- the orientation controller preferably comprises an electromagnetic frequency sensor, for example a charge-coupled device.
- a charge-coupled device detects an electromagnetic waveform that is emitted by the remote device.
- the electromagnetic waveform emitted by the remote device could be a specific frequency.
- Other electromagnetic radiation that is not emitted by the remote device is preferably filtered out.
- the charge-coupled device is preferably optimized to only detect the frequency or frequencies emitted by the remote device. Using a charge-coupled device as a position sensitive detector permits the direction of the remote device to be determined so that the camera may be oriented automatically at the target.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Studio Devices (AREA)
Abstract
Description
- This application is a continuation of U.S. patent application Ser. No. 13/726,203, filed Dec. 23, 2012, titled “Portable System for High Quality Video Recording”, which application claims the benefit of U.S. Provisional Patent Application No. 61/580,080, filed Dec. 23, 2011; U.S. Provisional Patent Application No. 61/580,084, filed Dec. 23, 2011; U.S. Provisional Patent Application No. 61/580,093, filed Dec. 23, 2011; U.S. Provisional Patent Application No. 61/580,101, filed Dec. 23, 2011; U.S. Provisional Patent Application No. 61/580,112, filed Dec. 23, 2011; U.S. Provisional Patent Application No. 61/580,115, filed Dec. 23, 2011 and U.S. Provisional Patent Application No. 61/745,346, filed Dec. 21, 2012, the contents all of which are incorporated herein by this reference and are not admitted to be prior art with respect to the present invention by the mention in this cross-reference section.
- Recording a person participating in an activity is an important task. A surfer may wish to capture his surfing experience for later enjoyment or to improve his or her surfing technique. A father may wish to record his son's winning touchdown in a football game. A mother may wish to capture her daughter's record-breaking gymnastics performance. In these examples, the camera is typically, and sometimes for best results, relatively far away from the participant, or more generally, the subject. To record the subject, a second person is needed to control and position the camera. Because humans are imperfect, the quality of the recorded video may not be ideal. For example, the camera operator or cameraman may have an unsteady hand making the recorded video too shaky and unbearable to watch. Additionally, the cameraman may become tired or distracted and may not keep the subject in the view field of the camera. In this situation, the cameraman may fail to capture an exciting or interesting moment. Further, some subjects may not have a second person willing to operate the camera. In this case, the individual loses the chance to record him or herself.
- In accordance with a preferred embodiment hereof, this invention provides a portable system for automated orientation of a camera to point at a freely moving target, such system comprising a positioner to orient the camera; a remote unit that obtains location information; and a base station configured to command the positioner to orient the camera at the freely moving target and to regulate the velocity of the orienting; wherein the base station comprises a receiver to receive the location information from the remote unit; wherein location information received by the base station when the remote unit is collocated with the camera is stored and used as the location of the camera by the base station; and wherein the base station commands the positioner to orient the camera at the freely moving target using location information received from the remote unit when the remote unit is collocated with the freely moving target and the location of the camera received by the base station when the remote unit is collocated with the camera.
- In accordance with another preferred embodiment hereof, this invention provides a method of automatically following a freely moving target with a camera, such method comprising the steps of setting up a camera associated with a positioning device wherein the positioning device is capable of receiving commands to orient the camera; collocating a remote unit that obtains location information with the camera and storing location information obtained as the location of the camera; moving the remote unit to a location away from the camera such that the remote unit is at or near the center of the field of view of the camera; determining the initial pointing angle of the camera using the stored location of the camera and the stored location of the remote unit; periodically receiving signals relevant to the location of the remote unit as the remote unit is associated with the freely moving target and transmitting information related to the location of the remote unit to the positioning device; periodically determining turning angle and velocity values for orienting the camera to remain pointed at the remote unit based in part on the initial pointing angle of the camera; and commanding the positioning device to orient the camera based on the determined turning angle and velocity values.
- In accordance with yet another preferred embodiment hereof, this invention provides a system comprising a first component sized so as to be portable and stationary when the first component is assembled for use; the first component connectable with a camera, wherein the camera, when connected, is turnable; a second component that is associated with a recording subject; wherein the first component comprises a receiver to receive information regarding the location of the first component and the location of the second component; wherein the first component turns the camera using location information received by the receiver such that the camera optically follows the subject moving to different locations and wherein the first component turns the camera around at least one axis based at least in part on the velocity of the subject.
- This invention also provides each and every novel feature, element, combination, step, and/or method disclosed or suggested herein.
-
FIG. 1 shows an overview of the automatic recording system according to a preferred embodiment of the present invention. -
FIG. 2 shows a simplified block diagram illustrating the components of an automatic recording system according to a preferred embodiment of the present invention. -
FIG. 3 shows a schematic diagram illustrating the electronic components of the remote device of an automatic recording system according to a preferred embodiment of the present invention. -
FIG. 4 shows a schematic diagram illustrating the electronic components of the orientation controller of an automatic recording system according to a preferred embodiment of the present invention. -
FIG. 5 is a schematic diagram illustrating various adjustment features of an automatic recording system according to a preferred embodiment of the present invention. -
FIG. 6 shows an overhead schematic diagram illustrating an embodiment of the feedback light source of an automatic recording system according to a preferred embodiment of the present invention. -
FIG. 7 shows an overhead schematic diagram illustrating another embodiment of the feedback light of an automatic recording system according to a preferred embodiment of the present invention. -
FIG. 8 shows an overhead schematic diagram illustrating yet another embodiment of the feedback light of an automatic recording system according to a preferred embodiment of the present invention. -
FIG. 9 shows a schematic diagram illustrating error issues encountered in determining the position of the components of an automatic recording system. -
FIG. 10 shows a schematic diagram illustrating a motor assembly of an automatic recording system according to a preferred embodiment of the present invention. -
FIG. 11 shows an overhead schematic diagram illustrating a preferred embodiment of the setup light of an automatic recording system according to a preferred embodiment of the present invention. -
FIG. 12 shows a flowchart illustrating an automatic recording method according to a preferred embodiment of the present invention. -
FIG. 13 shows a flowchart illustrating an automatic recording system initialization method according to a preferred embodiment of the present invention. -
FIG. 14 shows a diagram illustrating the relationship between an initial determined reference angle and the angle determined for a subject that has moved. -
FIG. 15 shows a flowchart illustrating an automatic recording method according to a preferred embodiment of the present invention. -
FIG. 16 shows a flowchart illustrating a method of backlash compensation according to a preferred embodiment of the present invention. -
FIG. 17 shows a flowchart illustrating a method of measuring the backlash after power-up according to a preferred embodiment of the present invention. - The present invention relates to systems and methods of automatically orienting a pointing device (also called a directional device or pointer) such as a camera. More particularly, the present invention relates to a system and method that automatically orients a directional device, such as a camera, based on receiving periodic updates of location information of a freely moving subject and converting the location information into commands that change the orientation of the directional device such that the directional device substantially points at the subject. It is noted that the subject may be human, animal, or an object.
- In a preferred embodiment, the system controls the velocity of orientation changes in order to point the pointer at the subject in a smooth and controlled way. Controlling the acceleration—generally speaking, the time derivatives of velocity—is considered to be encompassed by the concept of controlling velocity.
- In a preferred embodiment the pointing device is a camera and the system may be used for automatic video recording of a freely moving subject. Controlling velocity is particularly useful in such an embodiment because it helps to produce high quality video recordings without jerky camera artifacts.
- A preferred embodiment of the present invention relates to systems and methods of automatically pointing a device, such as a camera, at a freely moving subject using location coordinates based on transmissions received from satellite-based and/or earth-based transmitters.
- One major advantage of the systems and methods of the present invention is the ability to record a freely moving subject automatically without the need for a person to handle the camera. Another major advantage of the present invention is the ability to produce video recordings of a subject's activity from the perspective of a spectator, a competition judge, fans, etc., without engaging the services of a cameraman. The systems and methods of the present invention may be used to memorialize countless activities such as surfing, kiteboarding, skateboarding, motocross racing, golfing, playing soccer, playing tennis, snowboarding, skiing, studying animal behavior, dramatic arts, weddings, concerts, birthday parties, etc. Additionally, a plurality of devices embodying the inventive systems and methods hereof may be set up at locations of interest to record multiple subjects engaged in an activity. The video recorded in such a scenario may then be processed to combine the footage of the activity participants.
- The process of generating recorded images, or a recorded image series, that may be played back and viewed and that, for the viewer, appears either as a continuous motion picture, or as a series of photographs, is generally referred to as video recording, videotaping, filming, etc. It is noted that these terms apply to such a process without regard to the actual recording device, its type of memory, recording medium, or means of recording, and further without regard to whether the images are actually saved or not.
- Automatic recording by a camera of a person engaged in an activity (or, more generally, an object moving around without a predetermined path) is a complex task. Such a task requires an initialization where the pointing direction of the camera, the location of the camera and the location of the subject become known in absolute terms and or relative to one another; the camera must be oriented such that it initially points substantially at the subject. Next, the camera orientation must be updated in a controlled manner such that the camera continues to substantially point at the subject in real time or near real time as the subject changes locations. The camera movements should be made in a way that the resulting recording will be enjoyable for viewers. The “enjoyability” will be referred to herein as “high quality video recording” (HQVR). High quality video recording relates to the way camera motion is handled and not necessarily to the qualities of the camera (i.e., camera resolution, quality of the camera optics, or adjustability of parameters including lens aperture, focus and zoom).
- There are at least two main components that contribute to high quality video recording: 1) the precision with which the camera is oriented (i.e., keeping the subject well positioned within the shot) and 2) the smoothness of the camera motion during filming (i.e., avoiding unnecessary jerkiness, jumpiness, vibration, etc.). Using the systems and methods of the present invention will result in high quality video recording.
- A preferred embodiment of the present invention comprises of one or more devices that receive signals from a constellation of satellites that are parts of a Global Positioning System (sometimes referred to herein as “GPS”). The GPS signals are registered by the device or devices and the location coordinates of one or more system components are determined. In most uses, “GPS” refers to the Global Positioning System maintained by the United States Department of Defense. It is noted that the systems and methods of the present invention may be used with signals received from other and/or multiple satellite-based positioning systems, partially terrestrial positioning systems, or fully terrestrial positioning systems. As will be discussed further herein, appropriately located GPS units will generate location coordinates of the subject to be recorded and of the camera that does the recording.
- A preferred embodiment of the invention also includes devices that receive location data or correction factors from GPS units and transmit the received data to different parts of the automatic recording system and/or receive the signals from another transmitting unit. These devices are also sometimes referred to by the acronym UART (Universal Asynchronous Receiver/Transmitter). These devices will be referred to herein as transceivers.
- A preferred embodiment of the present invention also includes one or more devices that receive a plurality of location data, as well as other information regarding current and past camera direction. These devices include central processing units (CPU) or microcontroller units (MCU). The CPU and/or MCU generate instructions, based on the location data and other information, for a positioner to point an associated camera in the direction of a subject.
- As discussed further herein, the positioner preferably comprises one or more motors to orient an associated camera such that a given frame recorded includes the subject. Further, the motor or motors that move the camera are preferably equipped with one or more encoded wheels (together with the necessary light sources and sensors) employed to make the camera positioning and motor movements sufficiently precise.
- A high degree of precision of camera movements is essential for the appropriate control of both the camera orientation and the camera movement velocity as the camera moves. The systems and methods of the present invention make camera movements classified as HQVR using instructions that mimic movements that would be imparted to the camera by a highly skilled cameraman. In that regard, movement of the subject detected by a GPS unit and transmitted to a CPU is considered “movement” only when the subject moves beyond a predetermined distance from the center of the camera view. In other words, a “deadband” within which movements of the subject are detected but do not result in movement of the camera is included in the systems and methods of the present invention. Utilization of a deadband contributes to high quality video recording.
- The acceleration/deceleration and movement speed of the camera are controlled when the movements of the subject are outside of the deadband by the systems and methods of the present invention. When the camera moves, the goal is to keep the subject substantially within the recording frame. A preferred embodiment of the present invention includes camera movement controls for the camera movement speed that cause the camera initially to accelerate quickly but smoothly and then to slow when the camera approaches the pointing direction of the subject. A preferred embodiment of the present invention also comprises systems and methods to compensate for inherent system lag between the time a subject changes location in real time and the delayed time in which the camera orientation begins to change in response to the detected subject location change.
- In addition, a preferred embodiment of the present invention accounts for the possibility that GPS location data may be missing (for example, due to a communication error between the GPS satellites and the GPS sensor or between parts of the inventive system). The systems and methods of the present invention ignore brief periods of data loss. When the data loss exceeds a preset time limit, the camera either stays in place or returns to the last known position of the subject.
- A preferred embodiment of the present invention automatically controls camera orientations as well as the functions of the camera (e.g., camera zoom level). For example, if location coordinates from the remote device are missing for some period of time, the camera may be instructed to zoom out to increase the probability of retaining the subject in the camera view until receipt of location data resumes. In some embodiments of the invention, control of the zoom feature of the camera is employed by the system as a method to keep the subject inside the frame when the subject moves fast.
- The above-noted features are implemented in various embodiments of the systems and methods of the present invention. A discussion of the accompanying figures and specific embodiments of the systems and methods of the present invention follows.
-
FIG. 1 showsautomatic recording system 10, one preferred embodiment of an automatic pointing system.Automatic recording system 10 is preferably configured to detect the location of and track subject 12. As discussed above, subject 12 may be, for example, a participant in a sporting event. It is noted that the subject to be tracked and recorded byautomatic recording system 10 may also be an animal or an object. -
Automatic recording system 10 preferably includes remote device 16 (which may also be referred to herein as remote unit 16).Remote device 16 is preferably a wearable element that may be temporarily secured to the subject. According to one preferred embodiment hereof, the remote device preferably comprises a housing or enclosure for necessary electronic components and a means to secure the housing to subject 12. According to a preferred embodiment, a strap system is used to secure theremote unit 16 to subject 12 during use. According to other preferred embodiments, theremote unit 16 is secured to the subject 12 through other means such as a clasp, mount, pouch, or suction cup. To track the subject, the subject must be co-located with the remote device or in a known location relative to theremote device 16. According to a preferred embodiment hereof, the subject 12 andremote device 16 may be co-located by strapping theremote device 16 to the subject 12. - As shown in
FIG. 1 , the subject wears the remote device on his or her arm. Theremote device 16 may be connected to other portions of the subject's body, apparel, or equipment used in performing the activity to be recorded. For example, in a surfing scenario, the remote device may be connected with a surfboard and not necessarily to the human, object, or animal riding the surfboard. For convenience, subject 12 together with associatedremote device 16 will be referred to as the target. -
Automatic recording system 10 further comprisesorientation controller 70.Orientation controller 70 is preferably sized to be portable. For example,orientation controller 70 may have a height of about five inches, a width of about three inches, and a depth of about three inches. These exemplary dimensions permit orientation controller to be conveniently stored in, for example, an airline carry-on travel bag. Such dimensions may be altered to make the orientation controller smaller or even larger so long as the device may be ported easily from location to location. The components which connect withorientation controller 70 are also similarly portable. -
Camera 46 is preferably connected toorientation controller 70, as shown.Camera 46 may be a video camera, a still photograph camera, a smart phone, a tablet computing device, or any other attachable recording device.Orientation controller 70 is preferably mounted on tripod 34 (embodying herein a stand to support the positioner). In the embodiment shown inFIG. 1 ,tripod 34 comprises upwardly extendingmast 36.Orientation controller 70 is preferably connected tomast 36 oftripod 34. It is noted that there are a variety of tripods in the marketplace.Orientation controller 70 is preferably designed to engage the typical connection interfaces of tripods. In another embodiment, thetripod 34 is replaced by other means for providing a portable platform capable of being temporarily fixed relative to earth such as, for example, a weighted block, a mounting strap such as to mountorientation controller 70 to a fixed object like a pole or bar, or a suction cup. In still other embodiments the pointing device (a camera, for example) is an integral component oforientation controller 70. - When
orientation controller 70 is set up,camera 46 points along relativeposition pointing vector 48 as depicted. The zoom level ofcamera 46 is preferably set such that subject 12 is sufficiently within the field ofview 60 ofcamera 46 and based on the precision limitations of the inventive system. A more detailed discussion of the zoom level adjustment with respect to the movement of the subject is included below. -
Orientation controller 70 is preferably equipped withlight source 38, as shown.Light source 38 provides feedback to subject 12. According to one preferred embodiment,light source 38 is a light emitting diode (LED).Light source 38 preferably emits a light beam that is preferably collimated (collimated light beam 64) and is directed in a direction which sufficiently corresponds to the axis of the camera lens direction. The collimation oflight source 38 may be fixed or zoom dependent. - The collimation of
light source 38 is preferably fixed for a typical zoom camera angle (about five degrees with a variance of about two degrees in typical surfing applications, for example). The collimation angle may be adjusted by movinglight source 38 closer or farther relative to a collimating edge, or collimating edges. - In one preferred embodiment, the collimation is substantially in one dimension only, meaning that the light beam is only substantially collimated in the direction corresponding to the panning movement of
orientation controller 70. As will be discussed further herein, during filming, when subject 12 sees the light fromlight source 38, he or she knows that the camera is sufficiently pointing at him or her. In another embodiment, the collimation may be in two dimensions corresponding to the panning movement oforientation controller 70 and further corresponding to the camera tilt angle that may be manually or automatically adjustable. The two dimensional collimator may be an opening shaped as a square, a circle, etc. -
Orientation controller 70 ofautomatic recording system 10 preferably comprises receiving/transmittingantenna 71, as shown. Receiving/transmittingantenna 71 is preferably mounted toorientation controller 70 in such a way as to maintain an optimum radiation pattern relative toremote device 16 which is free to move. The optimum radiation pattern is achieved when receiving/transmittingantenna 71 is oriented so that the direction in which receiving/transmittingantenna 71 is most effective is in the direction of the camera lens axis. Put another way, the optimum position of receiving/transmittingantenna 71 is, for most antennas, perpendicular to the direction in which it transmits. In certain embodiments theoptimum antenna 71 position is maintained automatically. - Achieving HQVR requires precise control of
camera 46 as it tracks subject 12. The precision of the orientation ofcamera 46 depends on several factors. These factors include at least the following: (1) the precision with which the locations involved in aimingcamera 46 are determined; (2) the precision of determining the initial camera orientation; (3) the precision of the movement of the motor or motors that pointscamera 46; (4) the lag time and the rate of updating of the location of the target; (5) the angular velocity of the of the camera movements; and (6) the quality and reliability of the communication link between various parts of the system such as between, for example,orientation controller 70 andremote device 16. - The necessary precision of the orientation of
camera 46 depends on the angle of its field ofview 60; this angle is adjusted when the zoom is set. Put another way, for best results, the camera's field of view is preferably set or controlled, automatically or otherwise, based, in part, on consideration of the known orientation precision of the automatic recording system. - In some embodiments of the present invention, differential GPS, real time kinematic phase correction, and other correction methods are used to improve precision of location determination when using GPS for determining camera orientation.
- In one embodiment of the present invention,
camera 46 is mounted onorientation controller 70 that only provides automatic panning ofcamera 46. In this embodiment, the tilt and zoom ofcamera 46 are manually controlled and set by the user prior to recording. This embodiment can be adequate for recording, for example, surfing in the ocean. The focus ofcamera 46 may be camera controlled (i.e., using an autofocus feature of a commercial camera) or manually adjusted and set to a particular focal distance (such as the maximum setting to preventcamera 46 from focusing on an object in the foreground that is not the intended subject 12 of the recording). In a preferred embodiment, the focus is automatically controlled by the system based on the locations of thecamera 46 andremote device 16. Further, additional manual adjustments may be made prior to recording. For example, the height ofcamera 46 may be adjusted withmast 36 and the tilt of the camera may be adjusted to a constant tilt position using a camera attachment device betweenorientation controller 70 andcamera 46. - In the embodiment illustrated in
FIG. 1 ,camera 46 is mounted onorientation controller 70 using a camera attachment device that comprises standard female-male attachment fasteners that are typically used for attachment to tripods. Some cameras, such as smart phones, may not be equipped with standard tripod attachment devices. To connect these types of cameras, a custom camera attachment device or adapter is preferably provided. The camera attachment device is preferably designed to be permanently or temporarily affixed toorientation controller 70 and preferably contains lock and quick-release mechanisms. - Tripods are commonly equipped with bubble levels. For best results tripod 34 preferably comprises one or more levels to
level orientation controller 70.Orientation controller 70 orcamera 46 may also preferably comprise a bubble or electronic level to assist in levelingautomatic recording system 10 or in generating level footage as a result of using the automatic recording system. The system may also be manually sufficiently leveled by noting the view field of thecamera 60 and adjusting components of the system, such astripod 34, accordingly. -
FIG. 2 shows a simplified block diagram illustrating the components of an automatic recording system according to a preferred embodiment of the present invention.Orientation controller 70 comprises two major components, namelypositioner 32 andbase station 18.Base station 18 comprises electronic components to communicate withremote device 16 and to process the data received fromremote device 16 to controlpositioner 32.Positioner 32 orientscamera 46 so thatremote device 16 is sufficiently within field ofview 60 ofcamera 46. -
FIG. 3 shows a schematic diagram illustrating the electronic components of the remote device of an automatic recording system according to a preferred embodiment of the present invention.Remote device 16 preferably comprisesGPS unit 22 which receives signals (illustrated as signal 20) from a positioning system. The signals are provided by GPS and/or other similar satellite systems (or partially or fully terrestrial systems). The purpose of the signals is to determine a location of the signal receiver in terms of earth-centered, earth-fixed (ECEF) coordinates. It is noted that receivers and decoders that work with signals from alternative or additional positioning systems may be used as well. - The ECEF coordinates are preferably transmitted to microcontroller (MCU) 66.
Microcontroller 66 is preferably programmed to receive ECEF coordinate data, to parse the data, and to send the data totransceiver 24. As shown inFIG. 3 ,microcontroller 66 also receives data from on/offbutton 72,setup button 74, andtransceiver 24.Transceiver 24 receives and sends radio signals 50 and 52, respectively, to a transceiver associated withorientation controller 70.Transceiver 24 also sends data to and receives data frommicrocontroller 66.Microcontroller 66 also sends data to thestatus indicator LED 84, as shown. - The electronic components of
remote device 16 are preferably powered by arechargeable battery 76. Abattery charge indicator 82 is provided, as shown. Generally speaking, the power requirements of GPS units are strict. Those having skill in the art will understand thatremote device 16 may comprise other electronic elements, such as filters, to meet the appropriate power requirements. - The electronic components of
remote device 16 are preferably housed inenclosure 77.Enclosure 77 ofremote device 16 may be made using injection molding techniques or other similar molding techniques and may be made of a polymer, such as polyurethane. -
Enclosure 77 is preferably equipped withfastener 78 to attachremote device 16 to the body or clothing ofsubject 12.Remote device 16 may be attached to the leg, arm, wrist, etc., ofsubject 12. Additionally,remote device 16 may be attached to sporting equipment used by subject 12. Further,remote device 16 may be connected with any object that is, or is part of, the subject of the recording. -
Enclosure 77 is also preferably provided with two openings for chargingcontacts 80.Enclosure 77 is preferably sufficiently waterproof and is capable of surviving certain impacts. The LED indicators, or light therefrom, associated withremote device 16 are visible through transparent or translucent areas ofenclosure 77. Preferably, the materials and the construction ofremote device 16 ensure that the device will float in water. - In one preferred embodiment of the present invention,
remote device 16 is preferably equipped with additional input and/or output means. The additional input and/or output means may include buttons, switches, speakers or other means of vibration creation, touchscreens, or the like. These additional input means give subject 12 the ability to communicate with, receive information from and give commands tobase station 18 usingremote device 16. These commands are essentially manual overrides and may include, for example, (1) initialize, (2) pan right, (3) pan left, (4) begin recording, (5) stop recording, and (6) zoom in/out. One reason for initiating one or more of the listed commands is that the subject receives feedback fromorientation controller 70 regarding the state of the system such as the state of recording. It is noted that some of the listed commands require ability to control the camera. In those embodiments where the automated recording system does not include camera control,remote device 16 may be equipped with a “marker” button, or control. Operating the marker control preferably sends a signal tobase station 18 causingpositioner 32 to quickly move the camera away from its present position and then back to its prior position. The camera should be moved to a sufficient degree and/or with sufficient speed so that the camera field of view change is noticeably distinct from the prior field of view. This feature provides at least one major advantage in that these camera movements may be used efficiently to find interesting or important recorded video footage. For example, when engaged in surfing, the subject may catch a wave and, when he has completed his run, he may initiate the above-described marker function. As noted, the remote device could include camera control buttons, switches, etc. In one preferred embodiment,remote device 16 is preferably equipped with a “record last” button or control. Such a control would send a command tocamera 46 to store the last N minutes of footage as a separate file. N, the number of minutes to be stored, may be selected during setup from an array of choices (e.g., 1, 2, 3, or 4 minutes or other selectable values) or by inputting a specific number of minutes. In yet another embodiment,remote device 16 may contain a display for real time or delayed playback of recorded video using communication technology known to those having skill in the art which would allow footage recorded by the camera to be displayed on the remote device. In still another embodiment of the present invention, voice recognition means are provided for speaking commands to controlbase station 18 viaremote device 16. One advantage of the ability to start and stop recording by speaking commands is that a surfer, for example, could say “RECORD” when he begins to paddle toward a wave and say “STOP” when he has completed surfing a wave. This would eliminate the need to watch long stretches of video (which may span hours) to select only those sections that will be of interest to the surfer. The automated recording system can be used to record during several hours of activity, such as a surf session, to ensure the highest likelihood of capturing unexpected events. One or more of the above embodiments for marking important events may be implemented to ease the editing burden after use of the automated recording system. -
FIG. 4 shows a schematic diagram illustrating the electronic components of the orientation controller of an automatic recording system according to a preferred embodiment of the present invention.Orientation controller 70 preferably comprisesbase station 18 and positioner 32 (seeFIG. 2 ). Although not necessary for certain embodiments of the present invention,orientation controller 70 may includeGPS unit 26 that receives signals (depicted as signal 20) from GPS satellites or similar positioning system. The ECEF coordinates are transmitted withinbase station 18 to a central processing unit (CPU) 30 that is programmed to receive the coordinate data together with data from on/offbutton 86, setup button 88, andtransceiver 28.Transceiver 28 sends and receives radio signals 50 and 52, respectively, to and fromremote device 16.Transceiver 28 also sends data to and receives data fromCPU 30.CPU 30 also sends data to pandrive 42. Pan drive 42 may include means, such as encoded wheels and related sensing devices (not shown), to control motion ofoutput shaft 68. It is noted that other embodiments of the invention may incorporate a tilt drive and the statements made herein concerning the pan drive are applicable to the tilt drive as well. - The electronic parts of
base station 18 are powered bybattery 90 which is preferably rechargeable. Acharge indicator LED 92 is provided to indicate whetherbattery 90 needs charging. As noted above with respect toremote device 16, the power requirements ofGPS unit 26 are strict and electronic elements including filters may be provided to meet the necessary power requirements. Both the elements ofbase station 18 andpositioner 32 are preferably housed in a common enclosure (enclosure 100).Positioner 32 preferably comprisespan drive 42 and turningshaft 68.Enclosure 100 is preferably equipped with fastener 98 (shown schematically inFIG. 4 ). In the embodiment shown inFIG. 4 ,fastener 98couples orientation controller 70 to a mounting base (embodied inFIG. 1 as tripod 34) such thatoutput shaft 68 turns relative toorientation controller 70. In still another embodiment,fastener 98 is coupled tooutput shaft 68 and mountingbase 34 such thatorientation controller 70, which is coupled to pandrive 42, moves relative to the mountingbase 34 which is fixed relative to earth during use. -
Enclosure 100 preferably has two openings for chargingpins 94 to which an appropriate charger may be attached. Appropriate circuitry withinbase station 18 preferably provides electricity for chargingcontacts 96. In the embodiment shown inFIGS. 3 and 4 ,remote device 16 may be charged throughorientation controller 70 by engaging chargingpins 80 of remote device (seeFIG. 3 ) with chargingcontacts 96. - Pan drive 42 is preferably coupled to driving
shaft 68 through a gearbox that preferably includes elements to compensate for rotational play. In a preferred embodiment,camera 46 is firmly attached toorientation controller 70 using a camera attachment device (not shown) or by integration of a camera intoorientation controller 70. Pan drive 42 moves theorientation controller 70 together withcamera 46 based on commands it receives fromCPU 30 as discussed further below. - As discussed above,
orientation controller 70 is preferably outfitted withlight source 38.Light source 38 is preferably recessed onenclosure 100.Light source 38 preferably shines a collimated light beam along pointing vector 48 (seeFIG. 1 ).Light source 38 is preferably an LED powered bybattery 90. With reference toFIG. 1 , subject 12 can only see the light beam emanating fromlight source 38 when he or she is in field ofview 60 ofcamera 46.Light source 38 is preferably recessed, so that an opening on the front ofenclosure 100 functions as a collimator.Light source 38 provides visual confirmation to subject 12 thatorientation controller 70 orpositioner 32 is properly pointingcamera 46 substantially in his direction. -
Base station 18 comprisesstatus indicator LED 102, as shown. When setting up or initializingautomatic recording system 10, the status ofbase station 18 may be determined by observing changes in status indicator LED 102 (e.g., changing of color, blinking, etc.). In other embodiments,orientation controller 70 may also be equipped with other light sources used during setup/initialization of the system. - In one preferred embodiment of the present invention, the location of
orientation controller 70 is stationary during recording and location updates fromGPS unit 26 are used to implement a differential GPS method, a real time kinematic phase corrective method, and/or other location correction methods such as coordination withGPS unit 22 ofremote device 16 as to which satellite or other signals to use for location calculations to improve the precision of the relative location determination ofremote device 16. In another embodiment of the present invention,base station 18 is not equipped with a GPS unit. In such an embodiment,GPS unit 26 is not present. Thus,base station 18 performs no location update regarding its own location during recording. In another embodiment of the present invention,base station 18 may be a separate unit frompositioner 32 such thatbase station 18 andpositioner 32 are not housed in a single enclosure. Havingbase station 18 andpositioner 32 in the same enclosure is convenient and efficient for some embodiments. It is noted however, that the present invention includes embodiments where a single base station controls multiple positioners and cameras. Further, the base station may be a separate unit located some distance from the positioner it controls. In these embodiments, additional signal transmission systems are provided to establish communication between the base station and the one or more positioners and cameras. -
FIG. 5 is a schematic diagram illustrating various adjustment features of an automatic recording system according to a preferred embodiment of the present invention.FIG. 5 depicts one preferred embodiment of the presentinvention illustrating positioner 32 mounted on a mounting base. The mounting base shown inFIG. 5 istripod 34. It is noted that other mounting bases may be used. An elevatingmast 36 is preferably included to raise andlower positioner 32, as shown.Mast 36 allows for manual adjustment of the camera orientation as an override of theorientation controller 70 that may be used, for example, to have the subject intentionally off center in the frame of the camera.Mast 36 may be integral totripod 34 or it may be a separate attachable component. Preferably,positioner 32 includes anintegrated gimbaled platform 40.Gimbaled platform 40 is preferably mounted atop elevatingmast 36, as shown. In those embodiments in which the mounting base does not include an elevatingmast 36,positioner 32 may be mounted directly to the mounting base.Camera 46 is preferably mounted togimbaled platform 40.Positioner 32 also preferably comprises pan drive 42 to pancamera 46 and tilt drive 44 to tiltcamera 46. The tilt axis is perpendicular to the plane of the schematic ofFIG. 5 , and if thecamera 46 is tilted, the camera axis will be no longer horizontal as shown. -
FIG. 6 shows an overhead schematic diagram illustrating an embodiment of the feedback light source of an automatic recording system according to a preferred embodiment of the present invention.FIG. 7 shows an overhead schematic diagram illustrating another embodiment of the feedback light of an automatic recording system according to a preferred embodiment of the present invention.FIG. 8 shows an overhead schematic diagram illustrating yet another embodiment of the feedback light of an automatic recording system according to a preferred embodiment of the present invention. The embodiments ofFIGS. 6 , 7, and 8 show different ways in which the subject of the recording may be informed thatcamera 46 continues to substantially point at him or her. Because the subject of the recording will be some distance away fromcamera 46, a feedback system to let the subject know that the system is working properly is advantageous.FIGS. 6 , 7, and 8 are top down views of thepositioner 32 withcamera 46 and feedbacklight sources - In the embodiment shown in
FIG. 6 , the feedback is provided by collimatedlight beam 64. As discussed above, collimatedlight beam 64 is emitted bylight source 38 which may be an LED, or other light source. Field ofview 60 ofcamera 46 and collimatedlight beam 64 are characterized by having substantially the same angle and pointing in the same direction. If the automatic recording system is equipped with automatic zoom control ofcamera 46, a corresponding control is provided to adjust the collimation angle oflight source 38. This control may be a motor that moveslight source 38 farther from the collimating slit or edge for narrower zoom angles (when the camera zooms in). - Turning now to
FIG. 7 , in the embodiment shown, two lights sources are used, namelylight source 38 andlight source 39, as shown. The light sources are preferably LEDs emitting different light colors.Light source 38 emits a first color andlight source 39 emits a second color that is distinct from the first color oflight source 38. In this embodiment, collimatedlight beam 64 oflight source 38 is wider than that oflight source 39. Collimatedlight beam 64 preferably corresponds to the zoom angle of the camera. Collimatedlight beam 65 is preferably substantially narrower than collimatedlight beam 64, as shown. Both collimated light beams preferably point in the direction the camera is pointing, as shown. In this embodiment, subject 12 will know that he or she is in the field of view ofcamera 46 when he or she sees the light color oflight source 38. If subject 12 is centered, i.e., the subject is close to the middle of the field of view ofcamera 46, he or she will see light of mixed color. If the subject sees no light, then he or she knows that he or she is not in the field of view ofcamera 46. - Turning now to the embodiment illustrated in
FIG. 8 , the light beams oflight source 38 andlight source 39 are positioned so that they point to the left and right, respectively, ofcamera 46. In this arrangement, there is a narrow area which corresponds to the camera axis where the beams of light from both light sources are visible. When the light sources are different colors the aforementioned narrow area appears as a mixed color. When the subject 12 is off center, the subject knows in whichdirection camera 46 is off, namely off to the left or off to the right. Based on this feedback, subject 12 may elect to re-initialize theautomatic recording system 10 so that he or she is in the center of the field of view ofcamera 46. - In order for
automatic recording system 10 to operate properly in realistic circumstances, the systems and methods hereof must take into consideration various factors including the uncertainties of the location ofcamera 46 and ofremote device 16. The distance betweenremote device 16 andcamera 46 that is required for setup and operation is determined by the knowable or known uncertainties of the locations of the camera and remote device. Larger distances and wider field ofview 60 are required for embodiments relying on less precise locations. - Taking into account a typical example of recording surfing, the camera's field of view may be set to a zoom angle of about five degrees with the camera about 200 to 800 feet from the surfer. In this case, at least a precision on the order of about ±2.5 degrees is desirable. With the assumption that the uncertainty of the location of
remote device 16 with respect tocamera 46 is about ±8 feet, then the necessary minimum operating distance to achieve precision on the order of about ±2.5 degrees is about 183 feet (calculated as 8 feet/tan(2.5 degrees). If the location ofremote device 16 is 99 percent of the time within the about ±8 feet boundary, subject 12 will be inside the field of view of thecamera 60 99 percent of the time. Applicant has observed that inherent error related to GPS positioning gives some uncertainty regarding the orientation of the camera. In circumstances where the camera is near the remote device (e.g., less than about 183 feet in the above example), the inherent error in GPS position will decrease the precision desired to keep the subject in the field of view of the camera and will lower the probability of capturing high quality videos. -
FIG. 9 shows a schematic diagram illustrating error issues encountered in determining the position of the components of an automatic recording system. More particularly,FIG. 9 illustrates the concept of angular uncertainty (denoted as 6 a) caused by inherent GPS uncertainty. The systems and methods of the present invention may rely on GPS data to determine angular movements that will cause a camera to keep pointing in the direction of a moving subject. GPS uncertainties are different in orthogonal directions. Thus, the area of uncertainty around a location obtained from GPS may be represented by “error bubble” 310 and 320. In a worst case scenario, the maximum uncertainty extends the distance measured by the longer diameter of the error bubbles on opposing sides of the actual location ofremote device 16 andcamera 46, as shown. This distance is referenced asextreme direction 49. The uncertainty using an exemplary inexpensive GPS unit is about eight feet or about 2.5 meters but can be less than that. With this level of uncertainty, it is possible that pointingvector 48 may be pointing in any direction between theextreme directions 49. The δα uncertainty is determined by the GPS uncertainty of E0=8 feet and by the distance betweencamera 46 andremote device 16. For example, if the desired angular precision is δα=2.5 degrees, then the necessary distance (D0) betweenbase station 18 andremote device 16 may be calculated as follows: -
D 0=2E 0/tan(δα) - Substituting the value of 8 feet for E0 and the value of 2.5 degrees for δα results in a D0 value of 366.5 feet. It is noted that if a GPS unit with lesser uncertainty is employed, the distance D0 may be reduced. Another way to decrease D0 is to use less “tight” shots (i.e., shots that are “zoomed” out) with high resolution and edit the video in post-production.
- Another issue with GPS units is their step size. Although the uncertainty in location is about eight feet, consecutive readings are typically only one eight inch step apart. So, while the subject may not be at the center of the frame all the time, movements as small as six inches may be detected. Hence the angular precision of the camera movements must be much better than the δα=2.5 degree value noted in the example above. If the camera-to-subject distance is 500 feet, the eight inch GPS step corresponds to an angle of about 0.076 degrees. If the movements of a camera are in steps similar to this value or larger than this value, the viewer of the recording may notice a jerkiness as the camera follows the movements of a subject. In Applicant's experience, in order to obtain smooth, high quality videos it is best to have the ability to turn the camera in angular steps less than about 0.1 degrees and embodiments of the present system and method accomplish step sizes of about 0.05 degrees. This is accomplished using inexpensive motors equipped with gearboxes and employing optical encoded wheel technology as discussed further herein.
-
FIG. 10 shows a schematic diagram illustrating a motor assembly of an automatic recording system according to a preferred embodiment of the present invention. Positioner 32 (seeFIG. 2 ) preferably comprises at least one motor assembly as described herein. The rotor shaft ofmotor 250 isshaft 200 which, as a driving (input) shaft, is connected togearbox 210.Gearbox 210 significantly reduces the angular velocity of the driven (output)shaft 220 that turns an attached pointer (e.g., a camera). Drivingshaft 200 and potentially drivenshaft 220 are equipped with encodedwheels wheel 230 on drivingshaft 200 having 100 markers. The gear reduction value is the ratio between rotations per minute on driving and driven shafts. Thus, the angular movement of drivenshaft 220 when motor (driving)shaft 200 moves from one code strip of encodedwheel 230 to the next is about 1/54000 part of a turn, i.e., 0.0067 degrees. - Using a motor assembly such as the one depicted in
FIG. 10 may have a backlash introduced bygearbox 210 and by any coupling elements betweenshafts gearbox 210. To make camera movements sufficiently precise, it may be necessary to eliminate rotational play, or backlash, or compensate for it. One solution for eliminating rotational play is to use a substantially direct drive connection between the motor and pointer. However, for HQVR, it is necessary to be able to move the camera both fast and slow. For example, the angular velocity for tracking a surfer who moves at about one foot per second at a distance of 600 feet from the camera is about 0.1 degrees per second. When using inexpensive motors, a gearbox or other similar device is preferably connected between the driving (input) and driven (output) shafts to sufficiently reduce the angular velocity of the driven shaft. The gearbox tolerances, however, introduce rotational play. Moreover, the rotational play may increase over time due to wear and tear of the gears. One solution to reduce rotational play of gearboxes is to always rotate the driven shaft in the same direction when approaching a desired angular position. However, when filming a freely moving object, the camera should move smoothly in more than one direction (if panning, to the left and right); thus, the aforementioned “same direction” method is not applicable. Another possible solution for reducing rotational play is to use a static load, for example, a tensioning spring. However, use of a static load increases the required motor torque. - One embodiment of the present invention preferably uses one or two encoded wheels to generate information concerning the angular position of a shaft and to control rotary motion. Further, the automatic recording system of the present invention is configured to compensate for some or all backlash as will be discussed further below.
- The automatic recording system embodiment of the present invention compensates for backlash every time the
base station 18 sends a command topositioner 32 that includes a change of direction of turning the camera. The advantage of this approach is that the system is not “catching up” after backlash occurs, but rather acts in a preventative manner. - According to one preferred embodiment, the backlash for the particular gearbox and related system components used is determined during manufacturing. The process is illustrated by the flow chart shown in
FIG. 16 . Once determined, a set value of the backlash is included when programming the firmware that controlsCPU 30 of base station 18 (refer toFIG. 16 , see step 300). - According to another preferred embodiment of the present invention, a second encoded wheel (encoded wheel 240) is preferably attached to
output shaft 220. This embodiment is illustrated by the flowchart shown inFIG. 17 . With respect to the preferred embodiment including encodedwheel 240, the process illustrated inFIG. 17 provides the information to start the process ofFIG. 16 atstep 300. For those embodiments including the second encoded wheel, the steps of the process shown inFIG. 16 are carried out after the steps ofFIG. 17 are completed. In the embodiment where the backlash is determined during manufacturing, the second encoded wheel 240 (FIG. 10 ) is not included. Second encodedwheel 240 is preferably used during a startup protocol forpositioner 32 and both encoded wheel systems are enabled (step 305 and step 310,FIG. 17 ). Motor (input)shaft 200 is turned in one direction and the encoded wheel system registers the turning of theoutput shaft 220 instep 315. The motor is then stopped and both encoded wheels are reset insteps shaft 200 is reversed and the encoded wheel system reads the position of motor (input)shaft 200 at the moment when turning of the encodedwheel 240 of theoutput shaft 220 is detected,step 330. To illustrate this, a numerical example follows. For example, encodedwheel 240 preferably has 100 markings around the wheel corresponding to an angular distance of about 3.6 degrees per marking. For the backlash measurement,motor 250 is turned in one direction an angle sufficient to start movingoutput shaft 220. The movement of the output shaft is monitored using the second encodedwheel 240. The turning ofmotor 250 is stopped when the output shaft is just past the edge of a coding strip (step 315). The positions of both encodedwheels steps 320 and 325). Next,motor 250 is started again and instructed to move in the opposite direction. Because of the backlash experience,output shaft 220 and encodedwheel 240 do not start turning immediately.Motor 250 keeps turning and at the moment when encodedwheel 240 on driven (output)shaft 220 starts turning, the new position of encodedwheel 230 oninput shaft 200 is registered (step 330). The turning angle of the input shaft is measured and recorded atstep 335. The mechanical ratio between the pulse numbers registered on the driving (input) and driven (output) shafts is calculated atstep 340. Alternatively, the mechanical ratio can be set as a constant in the firmware. The backlash is calculated to be the number of driving shaft pulses registered less the encoder pulse ratio (step 345) and set as the backlash value until the next power up of the system (step 350). The precision of this measurement depends on the width of the edge of the markings of second encodedwheel 240 and the definition of the light beam used for the detection of the movement of this encoded wheel. In Applicant's experience, the uncertainty of the backlash measurement is less than about 0.1 degrees. This backlash measurement procedure is preferably carried out every time the system is powered up and its value is saved for the recording session. - After the backlash is determined, the
motor driving shaft 200 is turned to the backlash limit, i.e., to the position where turning further would begin turning the driven (output) shaft 220 (step 360). This motor position corresponds to the current direction received from the base station 18 (step 365). When a new direction vector is determined instep 370, the firmware of the base station decides whether a rotation direction change has occurred,step 380. If it has, the motor shaft is rotated in the reverse direction, adding the backlash,step 390. Otherwise the rotation occurs in the previous direction and backlash is not added,step 395. - Using a constant backlash value during the lifetime of the recording system has the advantage of making the system simpler and more affordable. At least one advantage of the other backlash compensation process described is that the system keeps up with any changes in the backlash that may occur over the lifetime of system due to normal wear and tear.
-
FIG. 11 shows an overhead schematic diagram illustrating a preferred embodiment of the setup (initialization) light of an automatic recording system according to the present invention. More particularly,positioner 32 andcamera 46 are shown equipped with collimatedlight source 260 that may be used during the initialization or setup ofautomatic recording system 10. (It is noted thatorientation controller 70 ofFIG. 1 could be shown inFIG. 11 instead ofpositioner 32 as the unit performing the functions described here). The relative orientations of thepositioner 32 andcamera 46 are preferably fixed for the initialization process. This collimation is accomplished by blocking a portion of the light fromlight source 260. As shown inFIG. 11 ,light source 260 is preferably collimated such thatlight beam 270 is delimited on one side. When this is done,direction 280 is parallel with pointingvector 48 ofcamera 46. The remote device is preferably placed atlocation 290.Location 290 will be typically about 100 to 500 feet away fromcamera 46. A user encountering the light at location A and location B will notice a difference in the characteristic of the light at each location. The light at location B at theother side 285 of the light beam is easily distinguishable from the light at location A because at location B the light is far from the area wherecamera 46 is pointing. The subject can find the center of the view field of the camera by finding location A. - As stated herein, the present invention includes both systems and methods for high quality video recording. HQVR may be achieved with a combination of three complex strategies, each involving a number of steps. A first strategy is the establishment of a reference camera orientation using an initialization or setup procedure. A second strategy is the establishment of unique communication between a remote device and a base station. A third strategy is the use of the flow of the angular information regarding the movements of the subject to actually move the camera to follow the subject. A preferred embodiment of the present invention employs all three of these strategies thereby achieving a high level of HQVR.
- An essential requirement for recording using the systems and methods hereof is that the camera point substantially towards the subject. To achieve this, the relative positions of the camera and the subject must be known and the pointing direction of the camera must be known. The systems “know” this information by measuring and determining this information and storing what is determined in an appropriately programmed microcontroller or computer. The relative positions of
camera 46 and subject 12 may be determined from signals received by GPS units inbase station 18 andremote device 16 wherecamera 46 is at the location ofbase station 18 andremote device 16 is located with subject 12. The direction ofcamera 46 may be known in absolute terms (i.e., relative to directions like horizontal, north, etc.) using a set of devices such as a level, a compass, gyroscopes, and the like. The direction ofcamera 46 may also be known in relative terms (i.e., with reference to an initial direction). The setup procedure of the system is a method of finding and saving the initial direction ofcamera 46 without using devices that determine the absolute direction ofcamera 46. - Unique communication between a remote device and a base station is accomplished using
transceivers remote device 16 and base station 18 (seeFIG. 3 andFIG. 4 ). The transceivers must be able to communicate with each other while ignoring signals from other similar units which may be operating in the same vicinity. For example, multipleautomatic recording systems 10 may be set up on the same beach in close proximity. Unique communication is also necessary when multiple base stations and/or multiple remote devices are employed as parts of a single system. The communication betweenbase station 18 andremote device 16 preferably occurs using a radio link which operates at the ultra-high frequency (UHF) range (e.g., 2.4 GHz). At the nominal 2.4 GHz, a transmitter actually has a multiplicity of separate exact frequencies called channels at which it operates. Each channel is close to 2.4 GHz but slightly off from one other so that crosstalk is eliminated. Data is sent over the radio link everytime GPS unit 22 refreshes coordinates (about every 10 to 500 microseconds). Each transmission lasts a very small length of time. Nevertheless, there is a small probability that messages from devices sent over the same channel may “collide” (i.e., arrive during time periods that overlap). These colliding messages cannot be interpreted. Thus, they are ignored by the system. If multiple devices broadcast on the same channel and keep sending messages at constant time intervals, it is possible that a whole series of communications may “collide”. This is avoided by implementing a random delay in the time each message is sent. The delay time is preferably short compared to the GPS refresh time but long compared to the duration time of each message. -
Transceiver 22 ofremote device 16 preferably generates a random identification number (ID) that is placed within each data packet sent tobase station 18.Base station 18 registers the ID during a pairing process and ignores any data packets that do not have the correct random ID. Likewise, messages frombase station 18 toremote device 16 include the same ID and communication packets with a different ID are ignored. A new random ID is preferably generated each time the remote device is powered up. Therefore, pairing must take place so the base station “knows” what the new ID is each time the remote device is turned on. To establish first communication after power up, bothbase station 18 andremote device 16 use the same default radio channel (e.g., channel one). The user pushes simultaneously a button on the remote device and on the base station. While both buttons are depressed, the base station and remote device set the random ID for the session. Once this is accomplished, they switch to a different radio channel selected randomly by the base station. If two users are pairing separate systems simultaneously, the systems will recognize this scenario and wait until the users try to pair the device again. The channels that are used for normal operation mode are different from the channel used for pairing. Since pairing only takes a brief period of time, the channel used for it will generally be relatively quiet. It is a manufacturing decision whether the pairing is initiated by the remote device 16 (as described above) or by thebase station 18. - Once setup and pairing has been established, the
base station 18 andremote device 16 have a quasi-continuous flow of location coordinates of theremote device 16 and subject 12. This information is converted into a quasi-continuously updated series of angles of pointingvector 48. It is noted that simply giving commands to electrical motors to movecamera 46 to keep up with the angles will not result in HQVR due to the issues addressed above (for example, backlash, GPS uncertainty, jumpiness, etc.). -
FIG. 12 shows a flowchart illustrating an automatic recording method according to a preferred embodiment of the present invention. The process illustrated inFIG. 12 occurs whenCPU 30 ofbase station 18 has data concerning the location and orientation ofcamera 46. The method illustrated byFIG. 12 assumes that in the initial orientation of the camera pointing sufficiently in the direction of the subject has been previously saved and communication betweenbase station 18 andremote device 16 has been previously established. - In step 410, a new or updated location of remote device 16 (which is collocated with the subject of the recording) is obtained. For the purposes of this disclosure, objects are collocated when the distance between the objects is much less than the usual location determination error observed when using the locating devices described herein (e.g., GPS devices). Furthermore, when two objects are described as associated with one another they are also considered to be collocated. As noted above, the
remote device 16 may be worn by the subject, and, when so worn, theremote device 16 is collocated with the subject. Additionally, when two objects are described as being in close proximity with one another they are also considered to be collocated. - Next, in
step 420, the new or updated location ofremote device 16 is transmitted tobase station 18. The new or updated coordinates ofremote device 16 are used to compute an angle for orientingcamera 46 to track subject 12 (step 430). In a preferred embodiment, decision points for various data stream occurrences, such as missing data points, steady or unchanged subject locations, small movement by the subject, fast movements by the subject, and the like. Instep 440, the computed data is converted into a command, or drive signal, sent byCPU 30 topositioner 32 to movecamera 46 to a new angle in accordance with the updated position ofremote device 16. In those embodiments where the CPU also controls camera functions, the CPU sends appropriate commands, such as zoom in or zoom out, to the appropriate function of the camera. The process illustrated inFIG. 12 is repeated every time a location update is generated inremote device 16. - It is noted that the process illustrated in
FIG. 12 assumes that the orientation ofcamera 46 is known at the start of the process. If the orientation is not automatically known such as by sensing, an initialization or setup process is necessary to start process ofFIG. 12 . - The updating frequency for the process of
FIG. 12 depends on the GPS unit or units employed. The updating frequency is preferably in the 2 to 100 Hertz range. The substantially continuous updating of the location coordinate data allows substantially continuous tracking and continuous visual contact of subject 12 bycamera 46. As subject 12 (collocated with remote device 16) moves, his, her, or its movement is characterized by an s(t) function, i.e., the location in time. The velocity v(t) is the first derivative and the acceleration a(t) is the second derivative of this function; both are computed by the CPU using routine techniques. - As discussed above, there may be a camera direction error caused by the time lag present from the time when the location measurement is taken until the time when
camera 46 points to the location. This time lag depends on (1) the processing speed of the GPS unit(s), (2) the processing speeds ofmicrocontroller 66,CPU 30 andtransceivers positioner 32. (Zooming and the speed of zoom adjustment may also play a role in the quality of aiming camera 46). The longer it takes forautomatic recording system 10 to process and transmit data in response to the measured location ofremote device 16 and the slower the mechanical components ofpositioner 32 react, the larger the camera direction error may be. In applications where this error is significant, the error may be reduced by estimating the anticipated position of the target based on past location, velocity, and acceleration information and instructing the positioner to move to the anticipated position. Therefore, theCPU 30 is preferably programmed to predict “current” positions of the target based on recent past s, v, and a values. The velocity with which the positioner moves is proportional to the size of the angle between current angle and the angle of the most recently determined target location. (Note that the current angle of the positioner may lag behind the angle that corresponds to the “current” position of the target). Using anticipated positions provides for faster camera movement when necessary but may sometimes result is overshooting errors. - In one preferred embodiment,
CPU 30 preferably employs a process to estimate or predict the magnitude of the positioning error of theremote device 16. When the magnitude of the positioning error has been estimated, a signal is sent tocamera 46 to adjust the camera zoom so that the field of view is sufficiently wide. For example, at high or fast changing velocities, the likely pointing error may increase. When this occursCPU 30 preferably sends a signal to the camera to zoom out. The velocity of the subject 12 may also be viewed in comparison with the field ofview 60 when the distance between the camera and the target are taken into account. For example, if the target is at a distance of 600 feet from the camera and the field of view is five degrees, then the distance between the edges of the viewed region is about 52 feet. If the subject is capable of accelerating to a velocity such that they cover a distance of about 26 feet within the known lag time of the system, such as one second, the subject may get to the edge of the field of view before theautomatic recording system 10 reacts to the sudden motion. In this case, preferably, thecamera 46 should zoom out and possibly zoom back in when it has caught up with the subject based on the subject's most recent location, velocity, and acceleration data. -
FIG. 13 shows a flowchart illustrating an automatic recording system initialization method according to a preferred embodiment of the present invention. The process ofFIG. 13 begins withstep 110. Instep 110, theautomatic recording system 10 is powered on and theremote device 16 is placed in close proximity tocamera 46. For example,remote device 16 may be held abovecamera 46. Instep 120, the common location ofcamera 46 and ofremote device 16 is determined usingGPS unit 22 associated withremote device 16. This information is transmitted toCPU 30 ofbase station 18 instep 130 where it is stored as the location of the camera (step 140). Next, the user—withremote device 16—moves away from camera 46 (step 150). The user preferably moves at least the minimum distance determined by the desired precision as noted in the discussion above. Once the user is a sufficient distance fromcamera 46, a feedback signal may be used to alert the user whether or not the user should proceed to the next step, or the user may count steps taken or estimate the distance in any other way he or she chooses. If the user is not far enough fromcamera 46, then step 150 is repeated until the distance condition is satisfied (step 160). Once satisfied, the process may continue. Instep 170, the user finds the position whereremote unit 16 is at or near the center of field ofview 60 ofcamera 46. There are multiple ways this may be accomplished. Refer at least toFIGS. 6 , 7, 8, and 11, their related discussion, and further descriptions below. - Once the user is satisfied that his or her position is appropriate (step 180), the location of
remote device 16 is saved (step 190). The saved locations of camera 46 (see step 140) andremote device 16 are then used to compute an initial camera angle in an ECEF coordinate system. At this point,automatic recording system 10 is initialized and recording may proceed. -
FIG. 14 shows a diagram illustrating the relationship between an initial determined reference angle and the angle determined for a subject that has moved. With reference toFIG. 13 , the location of thecamera 46 is obtained and stored (steps FIG. 14 as (x1,y1). Later in the setup procedure illustrated inFIG. 14 , the location ofremote device 16 determined at a distance away from camera 46 (step 190); the location ofremote device 16 at this time is denoted as (x2,y2). With this information, the angle α2 may be calculated in a predetermined (ECEF) coordinate system x,y. As video recording proceeds and as subject 12 moves, subject 12 will be at new locations. For example, subject 12 may be at a new location denoted as (x,y). The corresponding orientation of the camera may be calculated as the angular change Δα. To compute the angular change, α2 is set to zero and all subsequent turning angles are computed with reference to this original orientation. It should be noted that while the x,y notations suggest Cartesian coordinates, other coordinate systems may be used. - One method of computing the angles illustrated in
FIG. 14 would use a formula that first calculates distance per degree for the latitude and longitude location obtained from the GPS units, converts the locations defined by latitude and longitude into Cartesian coordinates, and then uses geometric relationships to arrive at the desired result. The conversion to Cartesian coordinates may also take into account the ellipsoidal shape of the earth and altitude data as well. However, for most the systems and methods of the present invention, this method is unnecessarily complex. In the systems and methods of the present invention, the distances between the camera and the remote device are very small compared to the distances computed as intermediate data. When the result of a calculation is a small number that is obtained as a difference of large numbers, very small relative errors in the large numbers can cause significant errors. This is remedied by using numbers with ten significant digits. - Another method uses a simpler approach and computes the angles in a more direct manner. For example, the calculation of the angular change may be done using the following formula:
-
- The formula is substituted with xi=RA, and yi=RBicosAi, where R=6370 kilometers (corresponding to the radius of the Earth in spherical approximation), A stands for latitude, B stands for longitude, and i stands for 1 or 2 as necessary. This formula would perform poorly if it were used for the determination of the location of any of the system's components on the Earth, but works perfectly well for calculating the relative positions of the components of
automatic recording system 10 and, therefore, also for the angle between them. - One preferred method of determining the initial direction of the camera during the setup procedure (
step 170 inFIG. 13 ) is making use of the setup light source illustrated inFIG. 11 as follows.Positioner 32 preferably has a marker or indicator that designates the front ofpositioner 32.Camera 46 is mounted onpositioner 32 such that the optical axis ofcamera 46 is positioned in a way that corresponds to the marker or indicator or the camera is otherwise integrated into the system in a manner which accomplishes this orientation requirement. The relative positions ofpositioner 32 andcamera 46 are fixed. After the location ofcamera 46 has been determined and saved, the user moves away from the camera to an appropriate distance and finds point A (seeFIG. 11 ) by visually assessing the transition in the visibility of thelight source 260. Alternatively, a light sensing instrument, such as, for example, a photodiode, may be employed to find point A automatically. - In an alternate embodiment,
light source 260 is preferably collimated. Collimatedlight beam 270 is parallel to pointingvector 48. The user may now accomplishstep 170 by finding the area of highest light intensity. Again, light sensors, such as photodiodes, may be used to further automatestep 170. - Another alternative method to accomplish
step 170 is to positionremote device 16 away fromcamera 46 at a distance determined by the required precision (steps 150 and 160). Next,camera 46 is turned manually or through control commands untilremote device 16 is in the center of the camera's field ofview 60. Pushing a function (setup or initialize) button onbase station 18 or onremote device 16 now tellsCPU 30 thatcamera 46 is oriented toward the remote device 16 (step 190) and saves remote device's location coordinates for establishing the reference orientation. - In another alternative embodiment,
remote device 16 is equipped with a display. Pictures of footage taken by the camera will be shown on the display in real time. Further, the remote device may have controls that causecamera 46 to turn in different directions. The user, after putting sufficient distance between him or her and camera 46 (step 160), may direct thecamera 46 to turn until he or she is found properly centered in the picture or footage displayed on the remote device. -
FIG. 15 shows a flowchart illustrating an automatic recording system method according to a preferred embodiment of the present invention. More particularly,FIG. 15 illustrates the process used to generate movement commands to movepositioner 32. Instep 510,CPU 30 then determines whether or not the location of the remote device has been updated.CPU 30 waits until the location of the remote device has been updated. - If the wait exceeds a predetermined amount of time or is too long, the positioner command output returns
camera 46 to the last detected position ofsubject 12. Here “too long” may be defined, for example, as missing two to ten consecutive updates or about 500 milliseconds to 2.5 seconds if the normal updating frequency is five Hertz. - Next, in
step 530, the updated location coordinates are recalculated in terms of angular orientation ofcamera 46. Insubsequent step 540, the difference of the updated and previous orientations is compared to a deadband to decide whether the change in the orientation warrants camera movement. As an example, if the angular change is less than about 0.1 degrees, the camera does not move. This feature prevents unnecessary small movements that could result in video that stutters. To further illustrate this concept, ifsubject 12 is a speed skater and theremote device 16 is attached to his or her arm, left to right arm swings would occur nearly every second. It would be very unpleasant to watch a video in which the camera follows these arm swing movements. If subject 12 moves outside of the deadband, an effective driving voltage is computed as shown instep 150. Proportional-integral-derivative methods (PID methods) may be applied in this step. The effective driving voltage is preferably proportional to the angle between the new target angle and current camera orientation. Alternatively, a deadband may be accomplished using some or all of the angular latency due to gearbox backlash as described above. - The new camera angle is calculated in step 560 (the angle calculated in
step 530 is one input for the calculation in step 560). At velocities that exceed a particular limit, it is expected that the camera movement lags substantially behindsubject 12. To correct for this lag, a subsequent position may be predicted based on the last two, three, or more angular positions. This can be predicted using velocities and accelerations computed based on the last three or more data points. - Returning to step 550, after the location update is received, the driving voltage applied will be higher (and the camera movement will be faster) if the angular change is greater. If the camera orientation has been lagging, the camera movement will be even faster. The voltage is calculated as V=K·(camera angle−target angle), where K is a proportionality constant. V is preferably updated frequently. For example, if the target angle is updated at five Hertz, V may be updated at 200 Hertz.
- When
camera 46 gets close to the target orientation, the movement preferably slows to avoid overshooting. The edge of the deadband may be recalculated when the subject moves past the deadband boundary. The deadband may move slower than the target in some circumstances so that even moderate movement in the same direction moves the camera and similar movement in the reverse direction does not. This approach reduces unnecessary camera movements and the jitteriness of the recording to a significant extent. A mechanical deadband is also capable of achieving this. - While the application of using voltage to control motor speeds is generally straightforward, alternative methods may be utilized. For example, pulse width modulation may be applied either alone or in combination with adjusting the voltage. Other control approaches may be employed in different embodiments of the invention depending on the type of motors used in the positioner to orient the camera. For example, the velocities of stepper motors may be controlled by adjusting the time interval between step or microstep commands. Open loop control, which eliminates the need for an encoded wheel, may also be used by keeping track of step count and direction.
- In
step 570 the target angle is modified based on the known or estimated backlash of the driving motor and gearbox. SeeFIG. 10 and the accompanying discussion for more detailed information concerning backlash compensation. Instep 580 the effective voltage and target angle are output to the positioner as there are two command parameters regulating a motor as, for example, a pan drive. In embodiments where multiple drives are available, each drive receives commands that result from similar processing.CPU 30 may also deliver drive signals directly to the camera so that the zoom, and therefore the field of view, is adjusted. Such adjustment will depend on the distance between the camera and the subject, the velocity of the subject, or whether the signal about the subject's location is available or has been missing for a period of time. - The backlash and deadband feature have similar effects on camera movement in that both instances there is a change in the angular position of the subject that does not immediately translate to camera movement. Knowing this, one embodiment of the present invention may include a backlash compensation value set to be less than the true angle of backlash. This creates a “mechanical deadband” which is equal to the true backlash angle minus the programmed backlash angle. In another embodiment of the present invention, both the deadband feature and the backlash compensation are eliminated. In yet another embodiment of the present invention, a “negative deadband” feature is implemented by setting the deadband value to be negative. In this embodiment, the camera leads the moving target by the absolute value of the negative deadband. This is desirable in applications in which the subject does not change directions frequently. The value of the negative deadband could also be a function of velocity and/or acceleration of the subject.
- In another embodiment of the invention, the backlash compensation value is programmed to be a larger value than the true backlash value. In this embodiment, the camera leads the moving target by the difference between the programmed backlash value and the true backlash value. The value of backlash could be a function of the target's velocity and/or acceleration. For example, if the target changed direction and was moving quickly in the new direction, the value of backlash compensation could be calculated to be a larger value so that the camera catches up to the target more quickly. This is advantageous in applications where the target changes directions frequently and moves fast. After the subject has moved in one direction, a change of direction may result in drastic lagging of the camera behind the subject. Backlash overcompensation and negative deadband are similar in their effect to predict a location for the subject that is further along the direction of current movement.
- In another embodiment, the camera angle intentionally lags behind the current target angle. The amount of lag time should be at least equal to the time between target location updates. For example, if the positioner receives updated target location information at a rate of 5 Hertz, then the camera should lag behind the target by at least 200 milliseconds. The advantage of this embodiment is that new target location information is available before the camera reaches the most current target data point allowing for smoother panning velocity to be achieved.
- It is noted that the embodiments described with respect to backlash correction could be used individually or in combination.
- In a preferred embodiment of the present invention,
orientation controller 70 may be equipped with a number of security features. For example, the system may contain an accelerometer that is turned on when the initialization or set up is completed and turned off by the user at the end of a recording session. The accelerometer senses vertical movement of theorientation controller 70 that would occur if it was stolen. When the accelerometer senses the vertical movement, the user is preferably alerted by, for example, an alarm which may be audible, visual, or both. For example,status indicator LED 84 on the remote device 16 (seeFIG. 3 ) may begin flashing to alarm the user. Theorientation controller 70 is also preferably equipped with a mechanical fastener that connects it to an auger secured in the ground as well as with a lock that secures thecamera 46 to the auger. Additionally, for those embodiments which have a GPS sensor associated with the camera, the orientation controller, base station, or positioner, the location of the orientation controller may be traced using the GPS sensor or could be used to detect theft when the GPS unit detects a location that is outside the error bubble of the camera location determined during initialization. - According to another embodiment of the present invention, a single positioner and a single camera may be used to track multiple remote devices. For example, at a sporting event, multiple subjects may be within the camera view. An optimal direction for the camera may be computed based on the locations of the multiple remote devices and the location of the camera so that multiple targets appear within the field of view of the camera. Additionally, an appropriate zoom may be combined with the computed optimal direction to maximize the number of targets appearing in the field of view of the camera. A process is preferably employed in which the positioner moves the camera to capture all of the multiple targets in its field of view if possible. If not all targets are able to be captured in the camera's field of view, some of the targets are selected. In such an embodiment, a selection of the targets must be made. The selected target or targets may be determined by several alternative methods including the following:
- (1) Maximizing the number of targets able to be captured in the field of view at a preset minimum zoom.
- (2) Using a hierarchy of targets. For example, a target may be designated as a “primary” target. The “primary” target is tracked. When additional targets are in the vicinity of the “primary” target, the system adjusts orientation and/or camera zoom to capture both the “primary” target and nearby secondary target(s). Alternately, the “primary” target may be tracked when possible. If the primary target cannot be tracked (e.g., because the signal from its remote device is missing), then a secondary target is tracked. This method is applicable for multiple ranked targets as well.
- (3) Selecting targets for tracking based on attributes of their movement. For example, one selection scheme may be based on target velocity such that the target with the highest detectable speed is tracked. This method is applicable, for example, when multiple surfers are in the ocean, wearing remote devices that communicate with the same base station. The surfer who moves the fastest will be tracked. According to another embodiment, targets moving faster than a preset minimum speed are tracked. For example, the system may track a surfer moving faster than a particular speed (and likely to be riding a wave) over a surfer who is relatively stationary. According to another embodiment, multiple cameras may be set up along a path for recording a single target that moves large distances. In such an embodiment, an appropriately configured base station serves all positioners and cameras. Further, the base station is not collocated with all or with any of the positioners and cameras. The positions and initial orientations of each camera are determined during a setup procedure that is appropriately modified from the setup method described for a single positioner embodiment (see, for example,
FIG. 13 and the accompanying discussion). Each positioner also incorporates a transceiver to receive commands and provide feedback. The positioners may also be equipped with GPS units which makes the setup procedure more efficient. The GPS equipped positioners transmit their location coordinates to the base station. - In another embodiment of the invention, the automatic video recording system comprises multiple remote devices and multiple positioners and cameras. For example, a series of cameras may be set up along a downhill ski run, a golf course, or other venue. Additionally, multiple subjects have their own associated remote devices. The location coordinates, initial orientation, and field of view of each camera are determined during setup. A base station sends commands to each positioner and camera to follow and to record targets as they appear in each camera's field of view. The methods described below for the case of a single camera and multiple targets are applied for target selection for each camera.
- In another embodiment, automatic recording system may be equipped with GPS units programmed such that the remote device(s) and base station recognize which satellites they receive signals from at a particular point of time. The list of satellites may be compared and the largest common set of satellites may be used to compute location based on the data received from the largest common set of GPS satellites. For example, for GPS units A and B, GPS unit A may have received signals from satellites 1, 2, 3, 4, 5, 6, and 7; GPS unit B may have received signals from
satellites 3, 4, 5, 6, 7, 8, 9, and 10. The largest common set of satellites is satellites 3, 4, 5, 6, and 7. The largest common set of satellites may vary every time data from satellites are refreshed. - In another embodiment, the orientation controller incorporates an array of two or more directional receivers, such as antennae or microphones, oriented in different directions and the remote device transmits signals (electromagnetic or sound signals) corresponding to the receiver types. The direction of the remote device with respect to the orientation controller may be determined from the strengths of the signals received by the receivers at the orientation controller. In an embodiment utilizing sound signals, and since the frequency of the transmitted signal would be known, the Doppler shift may be used to determine if the remote device is moving closer or farther from the camera. The information obtained may be used either as a replacement of GPS sensors or in addition to GPS technology. GPS technology has distinct advantages outdoors. In those circumstances where GPS signals may not be available (e.g., indoors or between buildings), electromagnetic or sound signal orienting may be used. These technologies may also be used in combination with the GPS technology.
- In another embodiment of the automatic recording system, the orientation controller preferably comprises an electromagnetic frequency sensor, for example a charge-coupled device. A charge-coupled device detects an electromagnetic waveform that is emitted by the remote device. The electromagnetic waveform emitted by the remote device could be a specific frequency. Other electromagnetic radiation that is not emitted by the remote device is preferably filtered out. The charge-coupled device is preferably optimized to only detect the frequency or frequencies emitted by the remote device. Using a charge-coupled device as a position sensitive detector permits the direction of the remote device to be determined so that the camera may be oriented automatically at the target.
- Available technology permits using touch sensors and voice commands to activate (turn on) and generally communicate with electronic devices such as the remote device. Such commands may also be easily transmitted to a base station. Use of such technology may be utilized in embodiments of the invention.
- Different preferred embodiments, methods, applications, advantages, and features of this invention have been described above; however, these particular embodiments, methods, applications, advantages, and features should not be construed as being the only ones that constitute the practice of the invention. Indeed, it is understood that the broadest scope of this invention includes modifications. Further, many other applications and advantages of applicant's invention will be apparent to those skilled in the art from the above descriptions and the below claims.
Claims (21)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/223,803 US9253376B2 (en) | 2011-12-23 | 2014-03-24 | Portable video recording system with automatic camera orienting and velocity regulation of the orienting for recording high quality video of a freely moving subject |
Applications Claiming Priority (9)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201161580115P | 2011-12-23 | 2011-12-23 | |
US201161580112P | 2011-12-23 | 2011-12-23 | |
US201161580080P | 2011-12-23 | 2011-12-23 | |
US201161580101P | 2011-12-23 | 2011-12-23 | |
US201161580093P | 2011-12-23 | 2011-12-23 | |
US201161580084P | 2011-12-23 | 2011-12-23 | |
US201261745346P | 2012-12-21 | 2012-12-21 | |
US13/726,203 US8704904B2 (en) | 2011-12-23 | 2012-12-23 | Portable system for high quality video recording |
US14/223,803 US9253376B2 (en) | 2011-12-23 | 2014-03-24 | Portable video recording system with automatic camera orienting and velocity regulation of the orienting for recording high quality video of a freely moving subject |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/726,203 Continuation US8704904B2 (en) | 2011-12-23 | 2012-12-23 | Portable system for high quality video recording |
Publications (2)
Publication Number | Publication Date |
---|---|
US20140204230A1 true US20140204230A1 (en) | 2014-07-24 |
US9253376B2 US9253376B2 (en) | 2016-02-02 |
Family
ID=48654162
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/726,203 Active US8704904B2 (en) | 2011-12-23 | 2012-12-23 | Portable system for high quality video recording |
US13/726,451 Active 2033-01-20 US9160899B1 (en) | 2011-12-23 | 2012-12-24 | Feedback and manual remote control system and method for automatic video recording |
US14/223,803 Active US9253376B2 (en) | 2011-12-23 | 2014-03-24 | Portable video recording system with automatic camera orienting and velocity regulation of the orienting for recording high quality video of a freely moving subject |
Family Applications Before (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/726,203 Active US8704904B2 (en) | 2011-12-23 | 2012-12-23 | Portable system for high quality video recording |
US13/726,451 Active 2033-01-20 US9160899B1 (en) | 2011-12-23 | 2012-12-24 | Feedback and manual remote control system and method for automatic video recording |
Country Status (6)
Country | Link |
---|---|
US (3) | US8704904B2 (en) |
EP (1) | EP2795891B1 (en) |
JP (1) | JP6227553B2 (en) |
AU (1) | AU2012358176C1 (en) |
CA (1) | CA2860383A1 (en) |
WO (1) | WO2013096953A1 (en) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20160134801A1 (en) * | 2014-11-11 | 2016-05-12 | Canon Kabushiki Kaisha | Image pickup apparatus and control method thereof |
US10281554B2 (en) * | 2015-03-09 | 2019-05-07 | Hangzhou Hikvision Digital Technology Co., Ltd. | Method, device and system for target tracking |
US10291725B2 (en) | 2012-11-21 | 2019-05-14 | H4 Engineering, Inc. | Automatic cameraman, automatic recording system and automatic recording network |
US20190230260A1 (en) * | 2018-01-23 | 2019-07-25 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Camera assembly and electronic device |
US10677887B2 (en) | 2016-05-11 | 2020-06-09 | H4 Engineering, Inc. | Apparatus and method for automatically orienting a camera at a target |
US10728488B2 (en) | 2015-07-03 | 2020-07-28 | H4 Engineering, Inc. | Tracking camera network |
US11395954B2 (en) | 2020-05-08 | 2022-07-26 | Cheer Match Media, LLC | Methods and apparatus for emulating live performance routine competition conditions without live competition staging |
Families Citing this family (47)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8704904B2 (en) | 2011-12-23 | 2014-04-22 | H4 Engineering, Inc. | Portable system for high quality video recording |
EP2618566A1 (en) * | 2012-01-23 | 2013-07-24 | FilmMe Group Oy | Controlling controllable device during performance |
WO2013131036A1 (en) | 2012-03-01 | 2013-09-06 | H4 Engineering, Inc. | Apparatus and method for automatic video recording |
WO2014008504A1 (en) * | 2012-07-06 | 2014-01-09 | H4 Engineering, Inc. | A remotely controlled automatic camera tracking system |
US9030606B2 (en) | 2013-03-14 | 2015-05-12 | Gopro, Inc. | Wireless camera housing illuminators |
EP2974269B1 (en) | 2013-03-15 | 2018-07-25 | Freefly Systems Inc. | Method and system for enabling pointing control of an actively stabilized camera |
US9761248B2 (en) * | 2013-04-26 | 2017-09-12 | Nec Corporation | Action analysis device, action analysis method, and action analysis program |
AU2014262897B2 (en) | 2013-05-04 | 2018-03-22 | Christopher Decharms | Mobile security technology |
WO2014181324A1 (en) | 2013-05-05 | 2014-11-13 | Trax Technology Solutions Pte Ltd. | System and method of monitoring retail units |
JP2015082807A (en) * | 2013-10-24 | 2015-04-27 | ソニー株式会社 | Information processing equipment, information processing method, and program |
JP6338356B2 (en) * | 2013-11-13 | 2018-06-06 | キヤノン株式会社 | IMAGING DEVICE, EXTERNAL DEVICE, IMAGING SYSTEM, IMAGING DEVICE CONTROL METHOD, EXTERNAL DEVICE CONTROL METHOD, IMAGING SYSTEM CONTROL METHOD, AND PROGRAM |
US20150187101A1 (en) * | 2013-12-30 | 2015-07-02 | Trax Technology Solutions Pte Ltd. | Device and method with orientation indication |
US20150193909A1 (en) | 2014-01-09 | 2015-07-09 | Trax Technology Solutions Pte Ltd. | Method and device for panoramic image processing |
WO2015114621A1 (en) | 2014-02-02 | 2015-08-06 | Trax Technology Solutions Pte. Ltd. | System and method for panoramic image processing |
US20150335948A1 (en) * | 2014-05-21 | 2015-11-26 | Rip Curl International Pty Ltd | Methods and Systems for Processing Sporting Performance Data |
US10402777B2 (en) | 2014-06-18 | 2019-09-03 | Trax Technology Solutions Pte Ltd. | Method and a system for object recognition |
USD750693S1 (en) | 2014-07-03 | 2016-03-01 | H4 Engineering, Inc. | Electronic communication device with wearable housing |
AU2015330646A1 (en) * | 2014-10-10 | 2017-06-01 | Livebarn Inc. | System and method for optical player tracking in sports venues |
WO2016134031A1 (en) * | 2015-02-17 | 2016-08-25 | Alpinereplay, Inc | Systems and methods to control camera operations |
US11571143B2 (en) | 2015-02-19 | 2023-02-07 | 6Degrees Ltd. | Remote controlled physical activity monitoring |
US9900511B2 (en) | 2015-04-10 | 2018-02-20 | Freefly Systems, Inc. | Method, system, and device for controlling a stabilized camera remotely |
CN105141828A (en) * | 2015-07-08 | 2015-12-09 | 成都西可科技有限公司 | Method for carrying out recording of motion camera by automatically adjusting view angle after locking scene |
US20170070668A1 (en) * | 2015-09-09 | 2017-03-09 | Fortemedia, Inc. | Electronic devices for capturing images |
US20170186291A1 (en) * | 2015-12-24 | 2017-06-29 | Jakub Wenus | Techniques for object acquisition and tracking |
US10506201B2 (en) * | 2016-03-23 | 2019-12-10 | Purdue Research Foundation | Public safety camera identification and monitoring system and method |
US10341617B2 (en) * | 2016-03-23 | 2019-07-02 | Purdue Research Foundation | Public safety camera identification and monitoring system and method |
US10368037B2 (en) * | 2016-03-23 | 2019-07-30 | Purdue Research Foundation | Public safety camera monitoring system and method |
US20180220105A1 (en) * | 2017-02-01 | 2018-08-02 | Wipro Limited | Smart portable orientation device |
KR20180098079A (en) * | 2017-02-24 | 2018-09-03 | 삼성전자주식회사 | Vision-based object recognition device and method for controlling thereof |
CN107145162B (en) * | 2017-04-10 | 2020-12-18 | 北京小鸟看看科技有限公司 | Camera angle adjusting method and system and virtual reality system |
EP3396226B1 (en) * | 2017-04-27 | 2023-08-23 | Advanced Digital Broadcast S.A. | A method and a device for adjusting a position of a display screen |
JP6914737B2 (en) * | 2017-06-02 | 2021-08-04 | 旭化成エレクトロニクス株式会社 | Drives, devices, drive systems, drive methods, and programs |
EP3422693A1 (en) | 2017-06-29 | 2019-01-02 | H4 Engineering, Inc. | Application dependent video recording device architecture |
USD847948S1 (en) | 2017-10-19 | 2019-05-07 | Tallgrass, Llc | Fire hydrant shaped lawn sprinkler |
US10377321B2 (en) | 2017-10-27 | 2019-08-13 | Google Llc | Releasable zero backlash passive locking mechanism for a vehicle mounted rotary camera mast |
EP3495835A1 (en) * | 2017-12-07 | 2019-06-12 | Rohde & Schwarz GmbH & Co. KG | Direction finding system as well as method for locating a source of a target signal |
US10950003B2 (en) * | 2018-03-29 | 2021-03-16 | Pelco, Inc. | Method of aligning two separated cameras matching points in the view |
US10674152B2 (en) * | 2018-09-18 | 2020-06-02 | Google Llc | Efficient use of quantization parameters in machine-learning models for video coding |
CN111291585B (en) * | 2018-12-06 | 2023-12-08 | 杭州海康威视数字技术股份有限公司 | GPS-based target tracking system, method and device and ball machine |
US11917287B2 (en) * | 2019-07-31 | 2024-02-27 | Virtualine Pty Ltd | System for aligning an item along a path in an area |
KR102161306B1 (en) * | 2019-09-17 | 2020-10-05 | 주식회사 영국전자 | Pan Angle Calibration Method in Image of Mobile PTZ Camera |
US11412149B1 (en) * | 2019-10-10 | 2022-08-09 | Mehul Gandhi | Autonomous positioning system for in interchangeable camera devices |
DE102019134014A1 (en) * | 2019-12-11 | 2021-06-17 | Arnold & Richter Cine Technik Gmbh & Co. Betriebs Kg | Remote control unit for a video camera |
US11003059B1 (en) | 2020-02-29 | 2021-05-11 | Rohan Taylor | Dynograph device |
US11711616B2 (en) * | 2020-05-12 | 2023-07-25 | Electroapp, Llc | Portable system including motorized base controller and transmitter for tracking a moving target |
CN114488201A (en) * | 2020-10-23 | 2022-05-13 | 神讯电脑(昆山)有限公司 | Information acquisition device and operation method thereof, and control method of positioning unit |
JP7347731B2 (en) * | 2021-01-16 | 2023-09-20 | 協栄精工株式会社 | Golf digest creation system, mobile photography unit and digest creation device |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5447278A (en) * | 1993-12-30 | 1995-09-05 | Xerox Corporation | Tape drive and cassette with precise registration |
US6258007B1 (en) * | 1999-05-27 | 2001-07-10 | Teijin Seiki Boston, Inc | Multi-sensor harmonic drive actuator arrangement assembly |
US8100591B2 (en) * | 2010-05-14 | 2012-01-24 | Chapman/Leonard Studio Equipment, Inc. | Dual loop camera stabilization systems and methods |
US8473103B2 (en) * | 2009-01-27 | 2013-06-25 | Fanuc Robotics America, Inc. | Secondary position feedback control of a robot |
Family Cites Families (138)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3469148A (en) | 1967-11-08 | 1969-09-23 | Gen Motors Corp | Protectively covered hybrid microcircuits |
US4041507A (en) | 1975-07-02 | 1977-08-09 | W. Haking Industries, Ltd. | Camera for underwater and above water use |
DE2650524B1 (en) | 1976-11-04 | 1978-01-12 | Preussag Ag | Underwater camera |
JPS53164140U (en) | 1977-05-30 | 1978-12-22 | ||
US4814711A (en) | 1984-04-05 | 1989-03-21 | Deseret Research, Inc. | Survey system and method for real time collection and processing of geophysicals data using signals from a global positioning satellite network |
US4683729A (en) | 1985-06-24 | 1987-08-04 | Rogers Kermett A | Anti-theft apparatus for a riding saddle |
DE3703436A1 (en) * | 1987-02-05 | 1988-08-18 | Rheinmetall Gmbh | Image-type gun laying practice system - has camera sending image to weapon monitor with simultaneous target disc control |
US4980871A (en) * | 1989-08-22 | 1990-12-25 | Visionary Products, Inc. | Ultrasonic tracking system |
US5572317A (en) * | 1990-05-31 | 1996-11-05 | Parkervision, Inc. | Remote-controlled tracking system for tracking a remote control unit and positioning and operating a camera and method |
US5179421A (en) * | 1990-08-20 | 1993-01-12 | Parkervision, Inc. | Remote tracking system particularly for moving picture cameras and method |
US5073824A (en) | 1990-06-15 | 1991-12-17 | Vertin Gregory D | Remote control and camera combination |
AU661825B2 (en) | 1990-08-08 | 1995-08-10 | Digital Arts Film & Television Pty Ltd | Motion control system for cinematography |
CA2081041C (en) * | 1992-01-03 | 1996-08-06 | Robert Louis Beecher | Camera field of view indicator |
US5363297A (en) | 1992-06-05 | 1994-11-08 | Larson Noble G | Automated camera-based tracking system for sports contests |
GB9308952D0 (en) | 1993-04-30 | 1993-06-16 | Philips Electronics Uk Ltd | Tracking objects in video sequences |
US5463432A (en) | 1993-05-24 | 1995-10-31 | Kahn; Philip | Miniature pan/tilt tracking mount |
EP0662600A4 (en) | 1993-06-10 | 1997-02-12 | Oh Yoh Keisoku Kenkyusho Kk | Apparatus for measuring position of moving object. |
FR2707159B1 (en) | 1993-07-09 | 1995-09-08 | Peaudouce | Disposable absorbent hygiene article. |
US5438357A (en) * | 1993-11-23 | 1995-08-01 | Mcnelley; Steve H. | Image manipulating teleconferencing system |
EP0660131A1 (en) | 1993-12-23 | 1995-06-28 | Karl Osen | Camera guidance system |
US5491632A (en) | 1994-05-26 | 1996-02-13 | General Motors Corporation | Rotary encoder with neutral position |
US6002428A (en) | 1994-10-21 | 1999-12-14 | Sanyo Electric Co., Ltd. | Motion vector detection circuit and object tracking camera device utilizing the same |
US5640007A (en) | 1995-06-21 | 1997-06-17 | Limitorque Corporation | Optical encoder comprising a plurality of encoder wheels |
US5912980A (en) | 1995-07-13 | 1999-06-15 | Hunke; H. Martin | Target acquisition and tracking |
JP4079463B2 (en) | 1996-01-26 | 2008-04-23 | ソニー株式会社 | Subject detection apparatus and subject detection method |
US6173066B1 (en) | 1996-05-21 | 2001-01-09 | Cybernet Systems Corporation | Pose determination and tracking by matching 3D objects to a 2D sensor |
US5878151A (en) | 1996-10-31 | 1999-03-02 | Combustion Engineering, Inc. | Moving object tracking |
CN1120629C (en) | 1997-02-06 | 2003-09-03 | 皇家菲利浦电子有限公司 | Image segmentation and object tracking method and corresponding system |
US5973732A (en) | 1997-02-19 | 1999-10-26 | Guthrie; Thomas C. | Object tracking system for monitoring a controlled space |
GB2324428A (en) | 1997-04-17 | 1998-10-21 | Sharp Kk | Image tracking; observer tracking stereoscopic display |
US6355881B1 (en) | 1997-05-05 | 2002-03-12 | Brant P. Braeges | Means for sealing an electronic or optical component within an enclosure housing |
US6188777B1 (en) | 1997-08-01 | 2001-02-13 | Interval Research Corporation | Method and apparatus for personnel detection and tracking |
JP3481430B2 (en) | 1997-09-11 | 2003-12-22 | 富士通株式会社 | Mobile tracking device |
CN1178467C (en) * | 1998-04-16 | 2004-12-01 | 三星电子株式会社 | Method and apparatus for automatically tracing moving object |
KR100295201B1 (en) | 1998-05-25 | 2001-09-17 | 이정훈 | Location tracking relay broadcasting system |
US6690978B1 (en) | 1998-07-08 | 2004-02-10 | Jerry Kirsch | GPS signal driven sensor positioning system |
US6795110B1 (en) | 1999-06-15 | 2004-09-21 | Philip Kossin | Weatherproof and watertight digital electronic camera, including a solid or fluid-filled digital camera operating at great depths |
US7920163B1 (en) | 1999-06-15 | 2011-04-05 | Tessera International, Inc. | Sealed, waterproof digital electronic camera system and method of fabricating same |
US6172640B1 (en) | 1999-06-18 | 2001-01-09 | Jennifer Durst | Pet locator |
TW519826B (en) | 1999-11-29 | 2003-02-01 | Koninkl Philips Electronics Nv | Personality-based intelligent camera system |
US6596976B2 (en) | 1999-12-07 | 2003-07-22 | American Gnc Corporation | Method and system for pointing and stabilizing a device |
US6909381B2 (en) | 2000-02-12 | 2005-06-21 | Leonard Richard Kahn | Aircraft collision avoidance system |
AU2001247315A1 (en) | 2000-03-10 | 2001-09-24 | Sensormatic Electronics Corporation | Method and apparatus for object tracking and detection |
GB2360972A (en) | 2000-04-05 | 2001-10-10 | Nokia Mobile Phones Ltd | Portable electronic apparatus with a moulded cover |
US20020005902A1 (en) | 2000-06-02 | 2002-01-17 | Yuen Henry C. | Automatic video recording system using wide-and narrow-field cameras |
US7006950B1 (en) | 2000-06-12 | 2006-02-28 | Siemens Corporate Research, Inc. | Statistical modeling and performance characterization of a real-time dual camera surveillance system |
EP1305898B1 (en) | 2000-06-23 | 2010-10-27 | Sportvision Inc. | Gps based tracking system |
EP1168830A1 (en) | 2000-06-30 | 2002-01-02 | Wells & Verne Investments Ltd | Computer aided image capturing system |
US6519860B1 (en) | 2000-10-19 | 2003-02-18 | Sandia Corporation | Position feedback control system |
JP4107810B2 (en) | 2001-03-21 | 2008-06-25 | 株式会社リコー | Waterproof case for mobile devices |
GB2373943A (en) | 2001-03-28 | 2002-10-02 | Hewlett Packard Co | Visible and infrared imaging camera |
GB2373942A (en) | 2001-03-28 | 2002-10-02 | Hewlett Packard Co | Camera records images only when a tag is present |
US20030169339A1 (en) | 2001-10-01 | 2003-09-11 | Digeo. Inc. | System and method for tracking an object during video communication |
JP4147054B2 (en) | 2002-05-17 | 2008-09-10 | オリンパス株式会社 | Stereoscopic observation device |
US6751409B2 (en) | 2002-05-31 | 2004-06-15 | Fuji Photo Film Co., Ltd. | Exterior case of electronic appliance |
US20040006424A1 (en) | 2002-06-28 | 2004-01-08 | Joyce Glenn J. | Control system for tracking and targeting multiple autonomous objects |
US6972787B1 (en) | 2002-06-28 | 2005-12-06 | Digeo, Inc. | System and method for tracking an object with multiple cameras |
JP2004112615A (en) * | 2002-09-20 | 2004-04-08 | Victor Co Of Japan Ltd | Automatic tracking video camera system |
US7349008B2 (en) | 2002-11-30 | 2008-03-25 | Microsoft Corporation | Automated camera management system and method for capturing presentations using videography rules |
KR100507780B1 (en) | 2002-12-20 | 2005-08-17 | 한국전자통신연구원 | Apparatus and method for high-speed marker-free motion capture |
US6952646B2 (en) | 2003-05-14 | 2005-10-04 | Chang Industry, Inc. | Tracking device and associated system and method |
JP2005020205A (en) * | 2003-06-24 | 2005-01-20 | Casio Comput Co Ltd | Picture photographing device |
US20050014458A1 (en) | 2003-07-16 | 2005-01-20 | Chen-Hung Hung | Supporting device for grinding ceramic elements |
CA2445814A1 (en) | 2003-10-20 | 2005-04-20 | Colin Wishart | Automated audio/video recording system |
GB2423837B (en) * | 2003-10-23 | 2007-09-05 | Tsx Products Corp | An apparatus for automatically pointing a device at a target |
US7081822B2 (en) | 2003-12-18 | 2006-07-25 | Se-Kure Controls, Inc. | Sensing assembly for article to be monitored |
JP4385768B2 (en) * | 2004-01-09 | 2009-12-16 | 株式会社デンソー | Motor control device |
JP4414773B2 (en) | 2004-01-15 | 2010-02-10 | オリンパス株式会社 | Waterproof drop structure for sound generation or sound collection member and electronic device having the same |
JP4478510B2 (en) | 2004-06-03 | 2010-06-09 | キヤノン株式会社 | Camera system, camera, and camera control method |
US7060921B2 (en) | 2004-08-25 | 2006-06-13 | Sony Corporation | Water-resistant case for electronic devices |
US7204107B2 (en) | 2004-08-26 | 2007-04-17 | Se-Kure Controls, Inc. | Adjustable tethering system for securing an article |
US20080105527A1 (en) | 2004-09-16 | 2008-05-08 | Steven Andrew Leftly | Switches and Devices for Integrated Soft Component Systems |
US7426338B2 (en) | 2004-11-29 | 2008-09-16 | Olympus Imaging Corp. | Switch mechanism usable underwater |
JP4413771B2 (en) | 2004-12-28 | 2010-02-10 | Hoya株式会社 | Camera with waterproof function |
JP2006243074A (en) | 2005-02-28 | 2006-09-14 | Olympus Imaging Corp | Water-proof housing |
EP1864505B1 (en) | 2005-03-29 | 2020-01-15 | Sportvu Ltd. | Real-time objects tracking and motion capture in sports events |
US7239975B2 (en) | 2005-04-02 | 2007-07-03 | American Gnc Corporation | Method and system for automatic stabilization and pointing control of a device |
US20080002031A1 (en) * | 2005-05-06 | 2008-01-03 | John-Paul P. Cana | Multi-axis control of a fixed or moving device based on a wireless tracking location of one or many target devices |
GB0510312D0 (en) | 2005-05-20 | 2005-06-29 | Wearable Technologies Ltd | Garment |
US7672781B2 (en) | 2005-06-04 | 2010-03-02 | Microstrain, Inc. | Miniaturized wireless inertial sensing system |
CN101222957B (en) | 2005-07-14 | 2012-01-11 | 查尔斯·D·休斯顿 | GPS based spectator and participant sport system and method |
US8471812B2 (en) | 2005-09-23 | 2013-06-25 | Jesse C. Bunch | Pointing and identification device |
US7728264B2 (en) | 2005-10-05 | 2010-06-01 | Raytheon Company | Precision targeting |
US20070146484A1 (en) | 2005-11-16 | 2007-06-28 | Joshua Horton | Automated video system for context-appropriate object tracking |
US7450835B2 (en) * | 2005-12-14 | 2008-11-11 | Lackey Robert C | Tripod device for mounting a camera and tracking movable objects |
US7508352B2 (en) | 2006-01-18 | 2009-03-24 | Motorola, Inc. | Embedded assembly including moveable element and antenna element |
JP4241742B2 (en) | 2006-01-31 | 2009-03-18 | パナソニック株式会社 | Automatic tracking device and automatic tracking method |
EP1998567B1 (en) * | 2006-03-15 | 2016-04-27 | Omron Corporation | Tracking device, tracking method, tracking device control program, and computer-readable recording medium |
ES2369495T3 (en) | 2006-03-31 | 2011-12-01 | Checkpoint Systems, Inc. | SYSTEM TO SET AND EXHIBIATE PROMOTION ITEMS. |
US20070238073A1 (en) * | 2006-04-05 | 2007-10-11 | The United States Of America As Represented By The Secretary Of The Navy | Projectile targeting analysis |
DE602007010753D1 (en) | 2006-04-21 | 2011-01-05 | Faro Tech Inc | CAMERA-DRIVEN DEVICE FOR TARGET MEASUREMENT AND TARGET TRACKING WITH SIX FREEDOM RATES AND ROTATABLE MIRROR |
JP4611932B2 (en) * | 2006-05-17 | 2011-01-12 | 日本電信電話株式会社 | Moving body following photographing projection device |
US20070292118A1 (en) | 2006-06-14 | 2007-12-20 | Sony Ericsson Mobile Communications Ab | Underwater image capture |
KR101186608B1 (en) | 2006-07-14 | 2012-09-27 | 엘지전자 주식회사 | Mobile communication device |
US7843322B2 (en) | 2006-08-14 | 2010-11-30 | Honeywell International Inc. | Instant messaging applications in security systems |
DE112007001950T5 (en) | 2006-08-21 | 2009-07-02 | Innotec Corporation, Zeeland | Electrical device with platinum-free mounting arrangement for electrical components |
US7578357B2 (en) | 2006-09-12 | 2009-08-25 | Black & Decker Inc. | Driver with external torque value indicator integrated with spindle lock and related method |
CN101155297A (en) * | 2006-09-29 | 2008-04-02 | 欧普罗科技股份有限公司 | Monitoring camera and system combining laser positioning |
JP2008227877A (en) | 2007-03-13 | 2008-09-25 | Hitachi Ltd | Video information processor |
US7712933B2 (en) | 2007-03-19 | 2010-05-11 | Interlum, Llc | Light for vehicles |
US8408773B2 (en) | 2007-03-19 | 2013-04-02 | Innotec Corporation | Light for vehicles |
US7730852B2 (en) | 2007-05-18 | 2010-06-08 | Kramer Robert H | Portable animal restraint and feeding station |
RU2463663C2 (en) | 2007-05-31 | 2012-10-10 | Панасоник Корпорэйшн | Image capturing apparatus, additional information providing and additional information filtering system |
EP2232592B1 (en) | 2007-12-12 | 2013-07-17 | Innotec Corporation | Method for overmolding a circuit board |
TWI369135B (en) * | 2007-12-31 | 2012-07-21 | Nat Applied Res Lab Nat Ct For High Performance Computing | Camera control system capable of positioning and tracking object in space and method thereof |
US20090206077A1 (en) | 2008-02-19 | 2009-08-20 | Daymen Photo Marketing Lp, A Canadian Limited Partnership | Protective Camera Enclosure |
US7547875B1 (en) | 2008-05-29 | 2009-06-16 | Delta Electronics, Inc. | Absolute type encoder apparatus and method for operating the same |
US20090300101A1 (en) | 2008-05-30 | 2009-12-03 | Carl Johan Freer | Augmented reality platform and method using letters, numbers, and/or math symbols recognition |
EP2506032B1 (en) | 2008-06-18 | 2013-10-02 | Saab Ab | Validity check of vehicle position information |
FR2933511A1 (en) * | 2008-07-04 | 2010-01-08 | Optinnova | INTERACTIVE VISUALIZATION DEVICE AND METHOD USING DETECTION CAMERA AND OPTICAL POINTER |
US9185361B2 (en) | 2008-07-29 | 2015-11-10 | Gerald Curry | Camera-based tracking and position determination for sporting events using event information and intelligence data extracted in real-time from position information |
US8760520B2 (en) * | 2008-11-10 | 2014-06-24 | Eduard Levin | System and method for tracking and monitoring personnel and equipment |
US9141860B2 (en) | 2008-11-17 | 2015-09-22 | Liveclips Llc | Method and system for segmenting and transmitting on-demand live-action video in real-time |
US8274544B2 (en) | 2009-03-23 | 2012-09-25 | Eastman Kodak Company | Automated videography systems |
US8237771B2 (en) | 2009-03-26 | 2012-08-07 | Eastman Kodak Company | Automated videography based communications |
US8374495B2 (en) | 2009-06-04 | 2013-02-12 | Sanwa Technologies Limited | User-configurable waterproof camera case |
US8253792B2 (en) | 2009-08-28 | 2012-08-28 | GM Global Technology Operations LLC | Vision system for monitoring humans in dynamic environments |
KR101048856B1 (en) * | 2009-09-04 | 2011-07-13 | 주식회사 에스원 | Image Intrusion Detection System and Method Using Dot Lighting |
JP5514506B2 (en) | 2009-10-21 | 2014-06-04 | 株式会社日立国際電気 | Intruder monitoring system and intruder monitoring method |
US9602776B2 (en) * | 2010-02-02 | 2017-03-21 | Verizon Patent And Licensing Inc. | Accessing web-based cameras arranged by category |
US20110228098A1 (en) | 2010-02-10 | 2011-09-22 | Brian Lamb | Automatic motion tracking, event detection and video image capture and tagging |
US8953117B2 (en) | 2010-03-19 | 2015-02-10 | Balboa Water Group, Inc. | Vented waterproof touch screen panel |
US8525340B2 (en) | 2010-06-11 | 2013-09-03 | Premitec, Inc. | Flexible electronic devices and related methods |
TWI448803B (en) | 2010-12-31 | 2014-08-11 | Altek Corp | Water-proofing image-capturing apparatus |
US20120262618A1 (en) | 2011-04-14 | 2012-10-18 | Amphibian Labs Llc | Waterproof case for hand held computing device |
US8995713B2 (en) | 2011-04-25 | 2015-03-31 | Fujitsu Limited | Motion tracking using identifying feature requiring line of sight of camera |
US9025948B2 (en) | 2011-06-20 | 2015-05-05 | A.G. Findings & Mfg. Co., Inc. | Camera protection module for portable device case |
TW201303469A (en) | 2011-07-14 | 2013-01-16 | Altek Corp | Water-proofing camera |
US8750674B2 (en) * | 2011-09-26 | 2014-06-10 | Intellectual Ventures Fund 83 Llc | Remotely controllable digital video camera system |
US8704904B2 (en) | 2011-12-23 | 2014-04-22 | H4 Engineering, Inc. | Portable system for high quality video recording |
CA2866131A1 (en) | 2012-03-02 | 2013-06-09 | H4 Engineering, Inc. | Multifunction automatic video recording device |
USD684210S1 (en) | 2012-03-05 | 2013-06-11 | H4 Engineering, Inc. | Camera mounting and positioning device |
USD703719S1 (en) | 2012-03-05 | 2014-04-29 | H4 Engineering, Inc. | Electronic communication device |
USD704762S1 (en) | 2012-03-06 | 2014-05-13 | H4 Engineering, Inc. | Mounting and positioning unit for electronic recording device |
US20130242105A1 (en) | 2012-03-13 | 2013-09-19 | H4 Engineering, Inc. | System and method for video recording and webcasting sporting events |
US20130278845A1 (en) | 2012-04-18 | 2013-10-24 | Kent Displays Incorporated | Embedded electrooptical display |
WO2013181644A1 (en) | 2012-06-01 | 2013-12-05 | Treefrog Developments, Inc. | Housing for an electronic device with camera, microphone and flash isolation |
US20140226062A1 (en) | 2013-02-11 | 2014-08-14 | Matthew B. Parrill | Protective cover for an electronic device |
-
2012
- 2012-12-23 US US13/726,203 patent/US8704904B2/en active Active
- 2012-12-24 EP EP12859195.5A patent/EP2795891B1/en not_active Not-in-force
- 2012-12-24 AU AU2012358176A patent/AU2012358176C1/en not_active Ceased
- 2012-12-24 JP JP2014549000A patent/JP6227553B2/en active Active
- 2012-12-24 WO PCT/US2012/071565 patent/WO2013096953A1/en active Application Filing
- 2012-12-24 CA CA2860383A patent/CA2860383A1/en not_active Abandoned
- 2012-12-24 US US13/726,451 patent/US9160899B1/en active Active
-
2014
- 2014-03-24 US US14/223,803 patent/US9253376B2/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5447278A (en) * | 1993-12-30 | 1995-09-05 | Xerox Corporation | Tape drive and cassette with precise registration |
US6258007B1 (en) * | 1999-05-27 | 2001-07-10 | Teijin Seiki Boston, Inc | Multi-sensor harmonic drive actuator arrangement assembly |
US8473103B2 (en) * | 2009-01-27 | 2013-06-25 | Fanuc Robotics America, Inc. | Secondary position feedback control of a robot |
US8100591B2 (en) * | 2010-05-14 | 2012-01-24 | Chapman/Leonard Studio Equipment, Inc. | Dual loop camera stabilization systems and methods |
Non-Patent Citations (1)
Title |
---|
ECODRIVE03 Drive for General Automation With Fieldbus-Interface; 2000; Rexroth Indramat GmbH; pages 224 and 278 * |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10291725B2 (en) | 2012-11-21 | 2019-05-14 | H4 Engineering, Inc. | Automatic cameraman, automatic recording system and automatic recording network |
US20160134801A1 (en) * | 2014-11-11 | 2016-05-12 | Canon Kabushiki Kaisha | Image pickup apparatus and control method thereof |
US9794465B2 (en) * | 2014-11-11 | 2017-10-17 | Canon Kabushiki Kaisha | Image pickup apparatus and control method thereof |
US10281554B2 (en) * | 2015-03-09 | 2019-05-07 | Hangzhou Hikvision Digital Technology Co., Ltd. | Method, device and system for target tracking |
US10728488B2 (en) | 2015-07-03 | 2020-07-28 | H4 Engineering, Inc. | Tracking camera network |
US11412171B2 (en) | 2015-07-03 | 2022-08-09 | H4 Engineering, Inc. | Tracking camera network |
US10677887B2 (en) | 2016-05-11 | 2020-06-09 | H4 Engineering, Inc. | Apparatus and method for automatically orienting a camera at a target |
US11300650B2 (en) | 2016-05-11 | 2022-04-12 | H4 Engineering, Inc. | Apparatus and method for automatically orienting a camera at a target |
US20190230260A1 (en) * | 2018-01-23 | 2019-07-25 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Camera assembly and electronic device |
US10516814B2 (en) * | 2018-01-23 | 2019-12-24 | Guangdong Oppo Mobile Telecommunicaitons Corp., Ltd. | Camera assembly and electronic device |
US11395954B2 (en) | 2020-05-08 | 2022-07-26 | Cheer Match Media, LLC | Methods and apparatus for emulating live performance routine competition conditions without live competition staging |
US11673037B2 (en) | 2020-05-08 | 2023-06-13 | Cheer Match Media, LLC | Emulation of live performance routine competition conditions without live competition staging methods and apparatus |
Also Published As
Publication number | Publication date |
---|---|
JP6227553B2 (en) | 2017-11-08 |
AU2012358176A1 (en) | 2014-08-14 |
AU2012358176B2 (en) | 2016-07-28 |
EP2795891A4 (en) | 2015-11-04 |
WO2013096953A1 (en) | 2013-06-27 |
JP2015501118A (en) | 2015-01-08 |
CA2860383A1 (en) | 2013-06-27 |
US9160899B1 (en) | 2015-10-13 |
US8704904B2 (en) | 2014-04-22 |
EP2795891A1 (en) | 2014-10-29 |
US9253376B2 (en) | 2016-02-02 |
AU2012358176C1 (en) | 2016-12-15 |
US20130162852A1 (en) | 2013-06-27 |
EP2795891B1 (en) | 2018-01-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9253376B2 (en) | Portable video recording system with automatic camera orienting and velocity regulation of the orienting for recording high quality video of a freely moving subject | |
US9800769B2 (en) | Apparatus and method for automatic video recording | |
US9313394B2 (en) | Waterproof electronic device | |
US20180130214A1 (en) | Mobile, wearable, automated target tracking system | |
US9723192B1 (en) | Application dependent video recording device architecture | |
US11300650B2 (en) | Apparatus and method for automatically orienting a camera at a target | |
US20190313020A1 (en) | Mobile Tracking Camera Device | |
US20230388640A1 (en) | Portable system including motorized base controller and transmitter for tracking a moving target | |
US20060171705A1 (en) | Automatic tracking system | |
EP3422693A1 (en) | Application dependent video recording device architecture | |
WO1992004641A1 (en) | Smart tracking system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: H4 ENGINEERING, INC., TEXAS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BOYLE, CHRISTOPHER T.;TAYLOR, SCOTT K.;SAMMONS, ALEXANDER G.;AND OTHERS;REEL/FRAME:032511/0661 Effective date: 20140324 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
FEPP | Fee payment procedure |
Free format text: SURCHARGE FOR LATE PAYMENT, SMALL ENTITY (ORIGINAL EVENT CODE: M2554); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YR, SMALL ENTITY (ORIGINAL EVENT CODE: M2551); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY Year of fee payment: 4 |
|
FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
FEPP | Fee payment procedure |
Free format text: 7.5 YR SURCHARGE - LATE PMT W/IN 6 MO, SMALL ENTITY (ORIGINAL EVENT CODE: M2555); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YR, SMALL ENTITY (ORIGINAL EVENT CODE: M2552); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY Year of fee payment: 8 |