US20200053290A1 - Stabilized gimbal system with unlimited field of regard - Google Patents

Stabilized gimbal system with unlimited field of regard Download PDF

Info

Publication number
US20200053290A1
US20200053290A1 US16/658,089 US201916658089A US2020053290A1 US 20200053290 A1 US20200053290 A1 US 20200053290A1 US 201916658089 A US201916658089 A US 201916658089A US 2020053290 A1 US2020053290 A1 US 2020053290A1
Authority
US
United States
Prior art keywords
gimbal
axis
axes
payload
inertial
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US16/658,089
Inventor
Gunnar G. Ristroph
Jason M. Raycroft
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
General Atomics Aeronautical Systems Inc
Original Assignee
Ijk Controls LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ijk Controls LLC filed Critical Ijk Controls LLC
Priority to US16/658,089 priority Critical patent/US20200053290A1/en
Assigned to IJK Controls LLC reassignment IJK Controls LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: RAYCROFT, JASON M., RISTROPH, GUNNAR G.
Publication of US20200053290A1 publication Critical patent/US20200053290A1/en
Assigned to GENERAL ATOMICS AERONAUTICAL SYSTEMS, INC. reassignment GENERAL ATOMICS AERONAUTICAL SYSTEMS, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: IJK CONTROLS, LLC
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/64Imaging systems using optical elements for stabilisation of the lateral and angular position of the image
    • G02B27/644Imaging systems using optical elements for stabilisation of the lateral and angular position of the image compensating for large deviations, e.g. maintaining a fixed line of sight while a vehicle on which the system is mounted changes course
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/69Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
    • H04N5/23296
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/64Imaging systems using optical elements for stabilisation of the lateral and angular position of the image
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/54Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/55Optical parts specially adapted for electronic image sensors; Mounting thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/58Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/68Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/681Motion detection
    • H04N23/6812Motion detection based on additional sensors, e.g. acceleration sensors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/68Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/682Vibration or motion blur correction
    • H04N23/685Vibration or motion blur correction performed by mechanical compensation
    • H04N5/2253
    • H04N5/2254
    • H04N5/2259
    • H04N5/23258
    • H04N5/2328

Definitions

  • the disclosure relates to gimbal systems. More specifically, the disclosure relates to stabilized gimbal systems with unlimited fields of regard.
  • the goal of a gimbal system is to control the orientation of a payload such as a camera, antenna, simulation object, or sensor.
  • a payload such as a camera, antenna, simulation object, or sensor.
  • Many gimbals control only the pointing of a payload, but cannot arbitrarily control the payload's orientation.
  • Cameras for example, may be pointed by a gimbal system even when the gimbal system cannot control the orientation of the camera about the camera axis.
  • a gimbal can be made to stabilize a payload in inertial space. Further, the pointing and orientation of a payload can be commanded and controlled in inertial space.
  • Gimbal systems have limitations in their ability to orient payloads.
  • One limitation can come from mechanical limits to the extent of travel as part of the gimbal structure interferes with itself in certain orientations.
  • Another limitation occurs when the payload interferes with the gimbal structure or the payload's line-of-sight is obscured by the gimbal structure.
  • Another limitation occurs when the wires or cables connecting different axes wrap up and do not allow the gimbal to rotate further.
  • Yet another limitation to gimbal system performance occurs when one axis of a gimbal rotates in a way that causes another axis to lose its ability to effect payload orientation or stability, resulting in a loss of control authority known as “gimbal lock.”
  • FIG. 1 shows a four-axis gimbal system in accordance with one or more embodiments.
  • FIG. 2A shows a control system for a gimbal system in accordance with one or more embodiments.
  • FIG. 2B shows a control system for a gimbal system in accordance with one or more embodiments.
  • FIG. 3 shows a gimbal system with a camera mounted to the final axis in accordance with one or more embodiments.
  • FIG. 4A shows the configuration of a gimbal system with a camera mounted to the final axis in accordance with one or more embodiments.
  • FIG. 4B shows the configuration of a gimbal system with a camera mounted to the final axis in accordance with one or more embodiments.
  • FIG. 4C shows the configuration of a gimbal system with a camera mounted to the final axis in accordance with one or more embodiments.
  • FIG. 4D shows the configuration of a gimbal system with a camera mounted to the final axis in accordance with one or more embodiments.
  • FIG. 5A shows the configuration of a gimbal system with a camera mounted to the final axis in accordance with one or more embodiments.
  • FIG. 5B shows the configuration of a gimbal system with a camera mounted to the final axis in accordance with one or more embodiments.
  • FIG. 5C shows the configuration of a gimbal system with a camera mounted to the final axis in accordance with one or more embodiments.
  • FIG. 6 shows a flowchart illustrating the process of operating a gimbal structure with four or more axes in accordance with one or more embodiments.
  • FIG. 7 shows a computer system in accordance with one or more embodiments.
  • Methods, structures, apparatuses, modules, and/or other components described herein may be enabled and operated using hardware circuitry, including but not limited to transistors, operational amplifiers, logic gates, and/or electrical circuits such as application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), digital signal processors (DSPs), and/or other dedicated or shared processors now known or later developed.
  • ASICs application-specific integrated circuits
  • FPGAs field-programmable gate arrays
  • DSPs digital signal processors
  • Such components may also be provided using firmware, software, and/or a combination of hardware, firmware, and/or software.
  • the operations, methods, and processes disclosed herein may be embodied as code and/or data, which may be stored on a non-transitory computer-readable storage medium for use by a computer system.
  • the computer-readable storage medium may correspond to volatile memory, non-volatile memory, hard disk drives (HDDs), solid-state drives (SSDs), hybrid disk drives (HDDs), magnetic tape, compact discs (CDs), digital video discs (DVDs), and/or other media capable of storing code and/or data now known or later developed.
  • HDDs hard disk drives
  • SSDs solid-state drives
  • HDDs hybrid disk drives
  • CDs compact discs
  • DVDs digital video discs
  • the disclosed embodiments relate to a gimbal system that allows a payload to be orientated in any attitude without mechanical limits, interference between the payload and gimbal structure, or gimbal lock. This is accomplished with a four-axis gimbal system and control system, which allow for unlimited range of motion in all rotational degrees of freedom.
  • the control system is further augmented with inertial stabilization to allow a payload to be isolated from the rotational motion of a vehicle or other object to which the gimbal structure is mounted.
  • FIG. 1 shows a four-axis gimbal system in accordance with one or more embodiments.
  • the gimbal system includes a base 1 that is attached via a bearing to a first rotating segment 2 , which rotates about an axis 3 relative to base 1 .
  • a second rotating segment 4 is attached via a bearing to the first rotating segment 2 and rotates about an axis 5 relative to the first rotating segment 2 .
  • a third rotating segment 6 is attached via a bearing to the second rotating segment 4 and rotates about an axis 7 .
  • a fourth and final rotating segment 8 is attached via a bearing to the third rotating segment 6 and rotates about an axis 9 .
  • a payload may be attached to the final rotating segment 8 .
  • Base 1 may be attached to a moving ground, sea or air vehicle, jib, suspension cables or other platform.
  • Rotating segments 2 , 4 , 6 , and 8 may be made of metal, composite or other materials and connected by rotating joints. A means to convey signal across each rotating joint may be fitted. Continuous rotation on axes 3 , 5 and 9 may allow unrestricted rotational motion and stabilization of the payload.
  • slip rings, rotary joints, and/or other mechanisms that allow unlimited rotation of joints attached to one or more axes 3 , 5 , 7 and 9 may be used to enable rotation of the gimbal system in every degree of freedom without limit.
  • Such slip rings, rotary joints, and/or other mechanisms may convey power, control, feedback, sensor and video signals in both directions.
  • a particular geometry of axes 3 , 5 , 7 , and 9 may enable the payload to be placed in any orientation, independently of the orientation of base 1 .
  • First, axis 5 may always be perpendicular to axis 3 .
  • Second, axis 7 may always be perpendicular to axis 5 .
  • Third, axis 9 may always be perpendicular to axis 7 .
  • the payload may be “yawed” by moving either axis 3 or axis 7 .
  • the payload may be “pitched” by moving axis 5 .
  • the payload may be “rolled” by moving axis 9 .
  • the payload can be “yawed” by moving axis 5 , “pitched” my moving axis 7 and “rolled” by moving either axis 3 or axis 9 .
  • Each of the gimbal axes 3 , 5 , 7 and 9 is fitted with a motor (or other actuator) and encoder (or resolver or other angular feedback device) for active control of the gimbal system.
  • the particular embodiment in FIG. 1 makes use of a large-diameter motor, slip ring, and encoder for axis 9 , but other design variations are possible that maintain the same fundamental gimbal geometry and properties.
  • axis 9 may use a cantilevered motor, slip ring, and/or encoder of much smaller diameter.
  • axis 9 may use a cantilevered small-diameter slip ring and encoder and a large-diameter motor.
  • the gimbal system may be made to rotate continuously on three of the four axes.
  • axis 3 , axis 5 and axis 9 rotate continuously while axis 7 requires only limited rotation.
  • the continuous-rotation axes 3 , 5 and 7 may be fitted with slip-rings or rotary joints to convey signal or power through the gimbal system, the other axes (e.g., axis 7 ), and to the payload.
  • a “gimbal lock” problem may occur if axes 3 , 5 , 7 and 9 are aligned in the same plane such that control authority was lost in one dimension. For example, such a configuration would occur if, referring to the configuration of FIG. 1 , segment 6 were rotated about axis 7 until axis 9 is aligned with axis 5 . In this configuration, there is no way to roll the payload. Thus, the gimbal system is capable of getting in to a configuration that results in “gimbal lock.” This particular gimbal configuration may also be undesirable because the payload is now pointed into the gimbal structure, which obscures the line-of-sight of the payload. Consequently, two problems (obscuration by gimbal structure and gimbal lock) may result from the same gimbal configuration.
  • the gimbal system of FIG. 1 is operated using a control system that actively works to avoid configurations that result in gimbal lock and/or blocking of the payload's line-of-sight while still pointing the payload in the desired direction.
  • a control system that actively works to avoid configurations that result in gimbal lock and/or blocking of the payload's line-of-sight while still pointing the payload in the desired direction.
  • the control systems described below may be used to control the gimbal system in which axis 7 includes a large-diameter hollow mechanism and axis 9 has a limited rotation.
  • the control systems may be used with gimbal systems that include additional axes of rotation fitted within or outside axes 3 , 5 , 7 , and/or 9 , resulting in five or more total axes of rotation.
  • FIG. 2A An exemplary control system for the four-axis gimbal system of FIG. 1 is shown in FIG. 2A .
  • FIG. 2A includes a control system 10 that receives command input signals 11 from a user control 12 through a device such as a joystick controller, control console, and/or another computer.
  • Command input signals 11 may provide the desired motion of a camera or other payload disposed within the gimbal system in any of several possible coordinate systems, including, but not limited to, line-of-sight inertial rates, absolute Earth relative positions, and/or horizon-relative angular rates.
  • a trajectory generation block 13 may smooth command input signals 11 and provide inertial rate commands to a stabilization feedback filter 14 . More specifically, trajectory generation block 13 may take payload motion commands in a user-provided coordinate system (e.g., from user control 12 ) and convert them into an inertial stabilization coordinate system. In the most basic user control mode, three inertial angular rates may be passed unmodified to stabilization feedback filter 14 . In more complex modes, the gimbal system may be commanded in Earth-relative or point-of-view modes that require different transformations to generate the desired behavior for the stabilization rate commands.
  • Stabilization feedback filter 14 may also use feedback in the form of inertial rates 15 sensed by gyroscopes, accelerometers, and/or other inertial sensors in an inertial measurement unit 16 on the gimbal system. Inertial rates 15 may be used as feedback, and the commanded stabilization rates may be used as the command for a feedback loop or feedback filter in stabilization feedback filter 14 .
  • a proportional-integral-derivative (PID) controller may be used within stabilization feedback filter 14 to provide stabilization to the gimbal system. Advanced features such as limiting, notch filters, high-order filters, feedforward, etc. may also be added for additional performance.
  • stabilization feedback filter 14 includes three independent PID-type feedback controllers, one for each feedback axis. Note that if the gimbal system is not made to be stabilized, stabilization feedback filter 14 may be omitted altogether, and trajectory generation block 13 may provide commands to relative rate feedback filter 17 directly.
  • Inertial measurement unit 16 may provide inertial angular rate measurements for stabilization by stabilization feedback filter 14 .
  • Inertial measurement unit 16 may be replaced by gyroscopic sensing of inertial angular rates in all three feedback axes. Fewer than three axes of gyroscopic sensing may interfere with full feedback stabilization in all degrees of rotational freedom, while only two axes of inertial sensing may be required in applications in which roll stabilization is not required.
  • Relative rate feedback filter 17 may generate motor commands 18 to a number of motors coupled to the gimbal axes 3 , 5 , 7 and 9 through an inverse dynamics transform 19 .
  • Relative rate feedback filter 17 may use a PID-type controller with additional features such as limiting, notch filters, etc.
  • Relative rate feedback filter 17 may use feedback in the form of angular measurements or angular rate measurements 20 from encoders 21 that include angular sensors and/or angular rate sensors such as tachometers.
  • relative rate feedback filter 17 is composed of four independent PID-type feedback controllers that use relative (not inertial) angle or angular rate feedback.
  • Such relative angular rate measurements 20 may be provided by encoders 21 , resolvers and/or similar devices.
  • encoders 21 may use optical sensors and rotating disks mounted on axes 3 , 5 , 7 and 9 to measure the rotational positions of axes 3 , 5 , 7 and 9 and provide the rotational positions as relative angular rate measurements 20 .
  • the four PID-type feedback controllers of relative rate feedback filter 17 may then be commanded by summing the various input commands going into relative rate feedback filter 17 : stabilization feedback filter 14 output, a follower feedback filter 22 output, base rate rejection feedforward 24 and command following feedforward 25 .
  • stabilization feedback filter 14 output stabilization feedback filter 14 output
  • follower feedback filter 22 output base rate rejection feedforward 24
  • command following feedforward 25 command following feedforward 25 .
  • An inverse dynamics transform 19 may compute the required motor torques 18 to achieve gimbal axis (e.g., axes 3 , 5 , 7 , and 9 ) angular accelerations. This may be accomplished by inverting the forward rigid body dynamics of the gimbal system. Note that these dynamics may vary with gimbal configuration and so depend on the various gimbal angles. Thus, the current gimbal angles as reported by encoders 21 or resolvers may be used in this transform. The full inverse dynamics may be simplified using small-angle trigonometric approximations, look-up tables, gain scheduling, and/or other techniques used to speed computer processing.
  • Follower feedback filter 22 may use the position of a limited-angle axis, such as axis 7 in FIG. 1 , as feedback to a PID-type controller with additional features such as limiting, notch filters, etc., to command a relative rate to a redundant axis, such as axis 3 in FIG. 1 , so that the limited-angle axis remains in the center of its travel.
  • follower feedback filter 22 may prevent the gimbal system from approaching gimbal lock and the line-of-sight of the payload from being obscured by the gimbal structure. This may be achieved with a feedback loop that has an unchanging command to “center” the limited-angle gimbal axis.
  • the relative angle formed by two rotating segments along the axis may be driven from a non-zero value to a zero value, as described in further detail below with respect to FIGS. 4A-4B .
  • Advanced gain sloping, scheduling, or other techniques may also be used to tune the behavior of follower feedback filter 22 .
  • An additional inertial measurement unit 23 may be fitted to base 1 and used to improve stabilization performance using a base rate rejection feedforward mapping 24 .
  • the angular rate outputs from inertial measurement unit 23 may be used in base rate rejection feedforward 24 mapping to help remove angular motion of base 1 .
  • Base rate rejection feedforward block 24 may include a kinematics transform that computes relative angular rates of the gimbal system to cancel angular rates of base 1 .
  • Inertial measurement unit 23 may be a device such as vertical gyroscope or attitude reference system with similar outputs, or inertial measurement unit 23 may be implemented with gyroscopic and attitude sensors.
  • command following feedforward block 25 may be used to control system 10 .
  • Command following feedforward block 25 may compute gimbal angle relative rates to achieve the desired inertial rates, under the assumption that base 1 is not moving. If the feedback gyroscope or inertial measurement unit 16 is present and stabilization feedback filter 14 is used, command following feedforward block 25 may optionally be used to improve control performance.
  • One advantage of the control scheme in FIG. 2A is that it allows the individual control elements to be designed and tested separately, with all elements providing input to relative rate feedback filter 17 .
  • FIG. 2B shows an alternative control system 26 that achieves substantially the same result as control system 10 of FIG. 2A : control over an unlimited field of regard of a payload disposed within the gimbal system.
  • Control system 26 uses the same input signals 11 from user control 12 , physical sensors including inertial measurement units 23 and 16 and encoders 21 , and the same motor command structure 18 .
  • the operation of trajectory generation block 13 is similar and accommodates similar user control modes.
  • relative rate feedback filter 17 may be omitted.
  • a modified stabilization feedback filter 27 generates a number of commands 28 to an inverse kinematics transform block 29 .
  • Commands 28 may be in the form of angular accelerations in the stabilization coordinate frame.
  • stabilization feedback filter 27 may include three independent PID-type feedback control loops. Each loop may use measured inertial rates from inertial measurement unit 16 to achieve the desired inertial rates as computed by trajectory generation block 13 . The outputs of these control loops may include commands 28 containing angular accelerations in inertial space.
  • Inverse kinematics transform block 29 may transform commands 28 to angular accelerations 30 along the gimbal axes 3 , 5 , 7 , and 9 . More specifically, inverse kinematics transform block 29 may convert angular accelerations from inertial space to gimbal axis angular accelerations 30 . This may be accomplished by inverting the kinematic relationships, which depend on the current gimbal angles. Thus, the gimbal angles reported by encoders 21 or similar devices may be used to compute this transform. As before, inverse dynamics transform block 29 may correctly account for the gimbal rigid body dynamics and motor dynamics to command motors 18 on the gimbal system.
  • a modified follower feedback filter 31 may ensure that the “following” axis moves to achieve the effect of avoiding gimbal lock and obscuration of the payload's line-of-sight by the gimbal system.
  • follower feedback filter 31 may command the outer gimbal to avoid the gimbal lock position.
  • follower feedback filter 13 may use a PID-type control loop based on feedback from encoders 21 to keep the appropriate gimbal axis centered, such that the relative angle across the axis is driven to zero.
  • follower feedback filter 31 may also serve to precisely position the payload using input from a payload attitude estimation filter 32 .
  • Attitude estimation filter 32 may use various inputs from the physical sensors to produce an estimate of the attitude of the payload.
  • attitude estimation filter 32 may use inertial sensing, including accelerometers or other attitude sensors that are mounted to either the gimbal system or base 1 .
  • Attitude estimation filter 32 may also use Global Positioning System (GPS) data, inertial navigation output or a vertical gyroscope-type sensor. This can be used in some control modes in trajectory generator 13 .
  • GPS Global Positioning System
  • the attitude estimate may also include absolute position feedback to position loops in the follower feedback filter 31 to ensure proper pointing of the payload.
  • Attitude estimation filter 32 may also be added to control system 10 of FIG. 2A in a similar fashion.
  • output from attitude estimation filter 32 may be used to point the payload relative to a coordinate system such as Earth, estimate a horizon and control roll of the payload relative to the horizon, and/or perform other positioning or orientation of the payload.
  • control systems of FIG. 2A-2B may be implemented in a variety of ways.
  • one or both control systems may be provided by a combination of components, including an embedded controller, microprocessor, computer system, field-programmable gate array (FPGA), application-specific integrated circuit (ASIC), digital circuit, analog circuit, and/or one or more software modules.
  • the control system(s) may additionally, or alternatively, execute on a dedicated processor mounted anywhere within the gimbal structure, a remote processing or computer system, and/or a processing system that is integrated with the payload.
  • the control system(s) may also be fitted with a variety of safety and diagnostic features, including, but not limited to, fault detection, graphical orientation representations, and/or bode plot visualization for tuning and auto-tuning.
  • the control system(s) may further be fitted with a variety of features for command input, including, but not limited to: image-based tracking; geo-pointing at fixed coordinates; geo-pointing at coordinates that are moving and reported by a moving target; radio, infrared or light beacon tracking; joystick rate control input; pointing slaved to another device; wheel input devices; and/or motion capture input devices.
  • FIG. 3 shows the gimbal system of FIG. 1 with a camera 33 mounted to the final axis 9 in accordance with one or more embodiments.
  • axis 9 may include a large-diameter hollow mechanism, which may allow a payload represented by camera 33 to be positioned in the center of axis 9 .
  • the orientation of camera 33 may be controlled without limitation by the gimbal system and a control system, such as control systems 10 and 26 of FIGS. 2A-2B .
  • FIGS. 4A-4D The action of the control system and corresponding follower feedback filter (e.g., follower feedback filters 22 and 31 ) in positioning camera 33 is shown in FIGS. 4A-4D .
  • follower feedback filter e.g., follower feedback filters 22 and 31
  • FIGS. 4A-4D The action of the control system and corresponding follower feedback filter (e.g., follower feedback filters 22 and 31 ) in positioning camera 33 is shown in FIGS. 4A-4D .
  • the control system may measure the angles of axes 3 , 5 , 7 , and 9 using encoders 21 and move axis 3 in a counterclockwise direction 40 to avoid this condition while counter-moving the other axes 5 , 7 , and 9 to maintain camera 33 in the same orientation and line-of-sight, resulting in the configuration shown in FIG.
  • the control system may cancel out the torque on an inner axis 7 of the gimbal system by commanding a counteracting torque on an outer axis 3 .
  • a non-zero relative angle across axis 7 i.e., the angle between segments 4 and 6
  • FIG. 4A may be driven to a zero relative angle in FIG. 4B by rotating axis 3 and making counter-rotations with the remaining axes 5 , 7 , and 9 to hold the payload in the same position.
  • Such reaction torque cancellation may be performed immediately without waiting for feedback from encoders 21 and/or inertial measurement unit 16 to improve the performance of the gimbal system.
  • the follower feedback filter and entire control system may move all axes 3 , 5 , 7 and 9 , including rotating axis 3 in a direction 42 that counteracts the rotation of axis 7 , such that axis 7 is re-centered (i.e., the angle between segments 4 and 6 is zero) and camera 33 maintains stable orientation and line-of-sight, resulting in the configuration shown in FIG. 4D .
  • Base 1 may be oriented in any attitude and may change attitude arbitrarily as the gimbal system and control system continue to stabilize the line of sight, as shown in FIGS. 5A-5C .
  • the control system may generate commands to motors 18 to move axes 3 , 5 , 7 and 9 , achieve unlimited control of camera 33 , and maintain the orientation and line-of-sight of camera 33 as base 1 rotates from behind camera 33 to in front of axis 5 (e.g., to isolate camera 33 from the rotational motion of a vehicle to which base 1 is mounted).
  • the gimbal system and corresponding control system may be implemented or controlled in various ways.
  • the gimbal system may be controlled from a remote location through a cable or through a wireless link.
  • Wireless links may also be used to convey encoder feedback, gimbal control systems, inertial feedback, motor commands or payload data back and forth, in place of slip rings or other mechanisms.
  • Motors used to actuate the gimbal axes may include direct drive motors, a variety of geared or belt-driven mechanisms, piezo actuators, hydraulic actuators, and/or other types of actuation mechanisms or systems.
  • the gimbal structure may be fitted with passive shock or vibration isolators between the base and the first axis (e.g., axis 3 ), between any axes, or between the payload and the gimbal structure.
  • the gimbal structure may additionally be fitted with actively controlled translation axes to provide some translational motion control.
  • the axes of the illustrated gimbal structure intersect at one point, other embodiments may have non-intersecting axes, such as one or more axes that are offset from other axes in the gimbal system.
  • the subsequent axes e.g., axes 5 , 7 , 9
  • other embodiments may have geometries with subsequent axes that are not perpendicular to one another.
  • the gimbal system may also be fitted with various features for achieving balance.
  • the gimbal system may further be fitted with various features for allowing the quick modification of the gimbal system to better accommodate payloads of various sizes, such as extendable pieces to increase the distance between axes 3 and 5 .
  • the gimbal system may be fitted with features for quick-releasing the gimbal structure from a variety of mounts for various vehicles, objects, bases, human body or hand use.
  • the gimbal system may also be fitted with various features for quick-releasing the payload.
  • the gimbal system may be fitted with various features to allow the rapid reconfiguration between the various embodiments discussed here. Examples include externally mounted quickly removable slip rings, rotary joints, quick release mounts for wireless transmitters and quick release, quick disconnect inertial sensors for stabilized and/or non-stabilized applications.
  • the gimbal structure may be built with a variety of materials and components, including, but not limited to, metals, plastics, carbon fiber, graphite, and/or composite materials.
  • the gimbal design may allow for internal wiring and internal mounting of electronic components for sensing, control and processing.
  • the gimbal structure may be fitted with a coudé path across one or more axes.
  • the gimbal structure may further be fitted with safety features such as brakes, stow pins, hard stops on limited rotation axes, emergency or disable switches and handling features such as handles and grips.
  • FIG. 6 shows a flowchart illustrating the process of operating a gimbal structure with four or more axes in accordance with one or more embodiments.
  • one or more of the steps may be omitted, repeated, and/or performed in a different order. Accordingly, the specific arrangement of steps shown in FIG. 6 should not be construed as limiting the scope of the embodiments.
  • inputs are read from a set of encoders on the axes and a set of inertial sensors mounted to the gimbal structure (operation 602 ).
  • the inputs may include relative angular rate measurements from the encoders and/or inertial rate measurements from the inertial sensors.
  • Command input containing a desired inertial rate for the gimbal structure is also read (operation 604 ).
  • the command input may be provided through a joystick controller, control console, computer system, electronic device, and/or other device.
  • a first feedback loop is used to compute a set of motor commands to achieve the desired inertial rate (operation 606 ).
  • the motor commands may be calculated using one or more PID-type feedback controllers that use inertial and/or relative angular rates to provide stabilization to the gimbal system and/or cancel angular base rates of the gimbal structure's base.
  • An inverse dynamics transform may also be applied to the relative angular rate measurements to produce motor torques for achieving angular accelerations of the axes.
  • An estimated attitude of the gimbal structure is then inputted into a second feedback control loop (operation 608 ), and the motor commands are updated with the second feedback control loop to prevent the gimbal structure from obscuring the line-of-sight of a payload mounted to the gimbal structure and from entering a gimbal lock configuration (operation 610 ).
  • the attitude may be estimated using input from accelerometers, gyroscopes, attitude sensors, GPS receivers, and/or other physical or inertial sensors.
  • the attitude estimate may also include absolute position feedback to ensure proper pointing of the payload.
  • the attitude estimate may be provided to the second feedback control loop to “center” one or more axes in the gimbal structure so that the gimbal structure does not obscure the payload's line-of-sight and avoids a gimbal lock configuration.
  • FIG. 7 shows a computer system 700 in accordance with one or more embodiments.
  • Computer system 700 includes a processor 702 , memory 704 , storage 706 , and/or other components found in electronic computing devices.
  • Processor 702 may support parallel processing and/or multi-threaded operation with other processors in computer system 700 .
  • Computer system 700 may also include input/output (I/O) devices such as a keyboard 708 , a mouse 710 , and a display 712 .
  • I/O input/output
  • Computer system 700 may include functionality to execute various components of the present embodiments.
  • computer system 700 may include an operating system (not shown) that coordinates the use of hardware and software resources on computer system 700 , as well as one or more applications that perform specialized tasks for the user.
  • applications may obtain the use of hardware resources on computer system 700 from the operating system, as well as interact with the user through a hardware and/or software framework provided by the operating system.
  • computer system 700 provides a system for operating a gimbal structure with four or more axes.
  • the system may include a control system that controls the gimbal structure to provide unrestricted orientation and rotational motion of a payload mounted to an axis in the four or more axes, independently of an orientation of a base of the gimbal structure. More specifically, the control system may read inputs from a set of encoders on the four or more axes and a set of inertial sensors mounted to the gimbal structure. Next, the control system may read command input containing a desired inertial rate for the gimbal structure.
  • the control system may then compute a set of motor commands with a first feedback control loop to achieve the desired inertial rate. Finally, the control system may update the motor commands with a second feedback control loop to prevent the gimbal structure from obscuring a line-of-sight of a payload mounted to the gimbal structure and from entering a gimbal lock configuration.
  • one or more components of computer system 700 may be remotely located and connected to the other components over a network.
  • Portions of the present embodiments e.g., payload, gimbal structure, control system, sensors, etc.
  • the present embodiments may also be located on different nodes of a distributed system that implements the embodiments.
  • the present embodiments may be implemented using a cloud computing system that processes inputs from encoders and/or inertial sensors mounted to a remote gimbal structure and outputs motor commands to achieve a desired inertial rate and prevent the gimbal structure from obscuring the payload's line-of-sight and entering a gimbal lock configuration.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Gyroscopes (AREA)
  • Studio Devices (AREA)

Abstract

The disclosed embodiments provide a system for controlling orientation of a payload. The system includes a gimbal structure with four or more axes. The system also includes a control system that controls the gimbal structure to provide unrestricted orientation and rotational motion of the payload mounted to an axis in the four or more axes, independently of an orientation of a base of the gimbal structure.

Description

    RELATED APPLICATIONS
  • This application is a continuation of U.S. application Ser. No. 15/268,635, Attorney Docket Number IJK.0002, entitled “Stabilized Gimbal System with Unlimited Field of Regard,” by inventors Gunnar G. Ristroph and Jason M. Raycroft, filed 19 Sep. 2016, which claims the benefit of U.S. Provisional Application No. 62/219,807, Attorney Docket Number IJK.0002P, entitled “Stabilized Gimbal System with Unlimited Field of Regard,” by inventors Gunnar G. Ristroph and Jason M. Raycroft, filed 17 Sep. 2015.
  • BACKGROUND Field
  • The disclosure relates to gimbal systems. More specifically, the disclosure relates to stabilized gimbal systems with unlimited fields of regard.
  • Related Art
  • In general, the goal of a gimbal system is to control the orientation of a payload such as a camera, antenna, simulation object, or sensor. Many gimbals control only the pointing of a payload, but cannot arbitrarily control the payload's orientation. Cameras, for example, may be pointed by a gimbal system even when the gimbal system cannot control the orientation of the camera about the camera axis. By augmenting gimbal systems with sensors and control schemes, a gimbal can be made to stabilize a payload in inertial space. Further, the pointing and orientation of a payload can be commanded and controlled in inertial space.
  • Gimbal systems have limitations in their ability to orient payloads. One limitation can come from mechanical limits to the extent of travel as part of the gimbal structure interferes with itself in certain orientations. Another limitation occurs when the payload interferes with the gimbal structure or the payload's line-of-sight is obscured by the gimbal structure. Another limitation occurs when the wires or cables connecting different axes wrap up and do not allow the gimbal to rotate further. Yet another limitation to gimbal system performance occurs when one axis of a gimbal rotates in a way that causes another axis to lose its ability to effect payload orientation or stability, resulting in a loss of control authority known as “gimbal lock.”
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 shows a four-axis gimbal system in accordance with one or more embodiments.
  • FIG. 2A shows a control system for a gimbal system in accordance with one or more embodiments.
  • FIG. 2B shows a control system for a gimbal system in accordance with one or more embodiments.
  • FIG. 3 shows a gimbal system with a camera mounted to the final axis in accordance with one or more embodiments.
  • FIG. 4A shows the configuration of a gimbal system with a camera mounted to the final axis in accordance with one or more embodiments.
  • FIG. 4B shows the configuration of a gimbal system with a camera mounted to the final axis in accordance with one or more embodiments.
  • FIG. 4C shows the configuration of a gimbal system with a camera mounted to the final axis in accordance with one or more embodiments.
  • FIG. 4D shows the configuration of a gimbal system with a camera mounted to the final axis in accordance with one or more embodiments.
  • FIG. 5A shows the configuration of a gimbal system with a camera mounted to the final axis in accordance with one or more embodiments.
  • FIG. 5B shows the configuration of a gimbal system with a camera mounted to the final axis in accordance with one or more embodiments.
  • FIG. 5C shows the configuration of a gimbal system with a camera mounted to the final axis in accordance with one or more embodiments.
  • FIG. 6 shows a flowchart illustrating the process of operating a gimbal structure with four or more axes in accordance with one or more embodiments.
  • FIG. 7 shows a computer system in accordance with one or more embodiments.
  • In the figures, like elements are denoted by like reference numerals.
  • DETAILED DESCRIPTION
  • In the following detailed description, numerous specific details are set forth to provide a thorough understanding of the disclosed embodiments. However, it will be apparent to those skilled in the art that the disclosed embodiments may be practiced without these specific details. In other instances, well-known features have not been described in detail to avoid unnecessarily complicating the description.
  • Methods, structures, apparatuses, modules, and/or other components described herein may be enabled and operated using hardware circuitry, including but not limited to transistors, operational amplifiers, logic gates, and/or electrical circuits such as application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), digital signal processors (DSPs), and/or other dedicated or shared processors now known or later developed. Such components may also be provided using firmware, software, and/or a combination of hardware, firmware, and/or software.
  • The operations, methods, and processes disclosed herein may be embodied as code and/or data, which may be stored on a non-transitory computer-readable storage medium for use by a computer system. The computer-readable storage medium may correspond to volatile memory, non-volatile memory, hard disk drives (HDDs), solid-state drives (SSDs), hybrid disk drives (HDDs), magnetic tape, compact discs (CDs), digital video discs (DVDs), and/or other media capable of storing code and/or data now known or later developed. When the computer system reads and executes the code and/or data stored on the computer-readable storage medium, the computer system performs the methods and processes embodied in the code and/or data.
  • The disclosed embodiments relate to a gimbal system that allows a payload to be orientated in any attitude without mechanical limits, interference between the payload and gimbal structure, or gimbal lock. This is accomplished with a four-axis gimbal system and control system, which allow for unlimited range of motion in all rotational degrees of freedom. The control system is further augmented with inertial stabilization to allow a payload to be isolated from the rotational motion of a vehicle or other object to which the gimbal structure is mounted.
  • FIG. 1 shows a four-axis gimbal system in accordance with one or more embodiments. The gimbal system includes a base 1 that is attached via a bearing to a first rotating segment 2, which rotates about an axis 3 relative to base 1. A second rotating segment 4 is attached via a bearing to the first rotating segment 2 and rotates about an axis 5 relative to the first rotating segment 2. A third rotating segment 6 is attached via a bearing to the second rotating segment 4 and rotates about an axis 7. A fourth and final rotating segment 8 is attached via a bearing to the third rotating segment 6 and rotates about an axis 9. A payload may be attached to the final rotating segment 8.
  • Base 1 may be attached to a moving ground, sea or air vehicle, jib, suspension cables or other platform. Rotating segments 2, 4, 6, and 8 may be made of metal, composite or other materials and connected by rotating joints. A means to convey signal across each rotating joint may be fitted. Continuous rotation on axes 3, 5 and 9 may allow unrestricted rotational motion and stabilization of the payload. For example, slip rings, rotary joints, and/or other mechanisms that allow unlimited rotation of joints attached to one or more axes 3, 5, 7 and 9 may be used to enable rotation of the gimbal system in every degree of freedom without limit. Such slip rings, rotary joints, and/or other mechanisms may convey power, control, feedback, sensor and video signals in both directions.
  • A particular geometry of axes 3, 5, 7, and 9 may enable the payload to be placed in any orientation, independently of the orientation of base 1. First, axis 5 may always be perpendicular to axis 3. Second, axis 7 may always be perpendicular to axis 5. Third, axis 9 may always be perpendicular to axis 7.
  • Control authority over all three rotational degrees of freedom of the payload's line-of-sight is always possible. In the configuration shown in FIG. 1, the payload may be “yawed” by moving either axis 3 or axis 7. The payload may be “pitched” by moving axis 5. The payload may be “rolled” by moving axis 9. In the configuration shown in FIG. 4D, the payload can be “yawed” by moving axis 5, “pitched” my moving axis 7 and “rolled” by moving either axis 3 or axis 9.
  • Each of the gimbal axes 3, 5, 7 and 9 is fitted with a motor (or other actuator) and encoder (or resolver or other angular feedback device) for active control of the gimbal system. The particular embodiment in FIG. 1 makes use of a large-diameter motor, slip ring, and encoder for axis 9, but other design variations are possible that maintain the same fundamental gimbal geometry and properties. For example, axis 9 may use a cantilevered motor, slip ring, and/or encoder of much smaller diameter. In another example, axis 9 may use a cantilevered small-diameter slip ring and encoder and a large-diameter motor.
  • To achieve unlimited range of motion in every circumstance, the gimbal system may be made to rotate continuously on three of the four axes. In the embodiment shown in FIG. 1, axis 3, axis 5 and axis 9 rotate continuously while axis 7 requires only limited rotation. The continuous-rotation axes 3, 5 and 7 may be fitted with slip-rings or rotary joints to convey signal or power through the gimbal system, the other axes (e.g., axis 7), and to the payload.
  • A “gimbal lock” problem may occur if axes 3, 5, 7 and 9 are aligned in the same plane such that control authority was lost in one dimension. For example, such a configuration would occur if, referring to the configuration of FIG. 1, segment 6 were rotated about axis 7 until axis 9 is aligned with axis 5. In this configuration, there is no way to roll the payload. Thus, the gimbal system is capable of getting in to a configuration that results in “gimbal lock.” This particular gimbal configuration may also be undesirable because the payload is now pointed into the gimbal structure, which obscures the line-of-sight of the payload. Consequently, two problems (obscuration by gimbal structure and gimbal lock) may result from the same gimbal configuration.
  • In one or more embodiments, the gimbal system of FIG. 1 is operated using a control system that actively works to avoid configurations that result in gimbal lock and/or blocking of the payload's line-of-sight while still pointing the payload in the desired direction. Those skilled in the art will appreciate that other four-axis gimbal geometries are possible, and that a similar control scheme may be used to prevent gimbal lock and obscuring of the payload's line-of-sight with such geometries. For example, the control systems described below may be used to control the gimbal system in which axis 7 includes a large-diameter hollow mechanism and axis 9 has a limited rotation. Similarly, the control systems may be used with gimbal systems that include additional axes of rotation fitted within or outside axes 3, 5, 7, and/or 9, resulting in five or more total axes of rotation.
  • An exemplary control system for the four-axis gimbal system of FIG. 1 is shown in FIG. 2A. In particular, FIG. 2A includes a control system 10 that receives command input signals 11 from a user control 12 through a device such as a joystick controller, control console, and/or another computer. Command input signals 11 may provide the desired motion of a camera or other payload disposed within the gimbal system in any of several possible coordinate systems, including, but not limited to, line-of-sight inertial rates, absolute Earth relative positions, and/or horizon-relative angular rates.
  • A trajectory generation block 13 may smooth command input signals 11 and provide inertial rate commands to a stabilization feedback filter 14. More specifically, trajectory generation block 13 may take payload motion commands in a user-provided coordinate system (e.g., from user control 12) and convert them into an inertial stabilization coordinate system. In the most basic user control mode, three inertial angular rates may be passed unmodified to stabilization feedback filter 14. In more complex modes, the gimbal system may be commanded in Earth-relative or point-of-view modes that require different transformations to generate the desired behavior for the stabilization rate commands.
  • Stabilization feedback filter 14 may also use feedback in the form of inertial rates 15 sensed by gyroscopes, accelerometers, and/or other inertial sensors in an inertial measurement unit 16 on the gimbal system. Inertial rates 15 may be used as feedback, and the commanded stabilization rates may be used as the command for a feedback loop or feedback filter in stabilization feedback filter 14. A proportional-integral-derivative (PID) controller may be used within stabilization feedback filter 14 to provide stabilization to the gimbal system. Advanced features such as limiting, notch filters, high-order filters, feedforward, etc. may also be added for additional performance.
  • In one or more embodiments, stabilization feedback filter 14 includes three independent PID-type feedback controllers, one for each feedback axis. Note that if the gimbal system is not made to be stabilized, stabilization feedback filter 14 may be omitted altogether, and trajectory generation block 13 may provide commands to relative rate feedback filter 17 directly.
  • Inertial measurement unit 16 may provide inertial angular rate measurements for stabilization by stabilization feedback filter 14. Inertial measurement unit 16 may be replaced by gyroscopic sensing of inertial angular rates in all three feedback axes. Fewer than three axes of gyroscopic sensing may interfere with full feedback stabilization in all degrees of rotational freedom, while only two axes of inertial sensing may be required in applications in which roll stabilization is not required.
  • Relative rate feedback filter 17 may generate motor commands 18 to a number of motors coupled to the gimbal axes 3, 5, 7 and 9 through an inverse dynamics transform 19. Relative rate feedback filter 17 may use a PID-type controller with additional features such as limiting, notch filters, etc. Relative rate feedback filter 17 may use feedback in the form of angular measurements or angular rate measurements 20 from encoders 21 that include angular sensors and/or angular rate sensors such as tachometers.
  • In one or more embodiments, relative rate feedback filter 17 is composed of four independent PID-type feedback controllers that use relative (not inertial) angle or angular rate feedback. Such relative angular rate measurements 20 may be provided by encoders 21, resolvers and/or similar devices. For example, encoders 21 may use optical sensors and rotating disks mounted on axes 3, 5, 7 and 9 to measure the rotational positions of axes 3, 5, 7 and 9 and provide the rotational positions as relative angular rate measurements 20. The four PID-type feedback controllers of relative rate feedback filter 17 may then be commanded by summing the various input commands going into relative rate feedback filter 17: stabilization feedback filter 14 output, a follower feedback filter 22 output, base rate rejection feedforward 24 and command following feedforward 25. Each of these features or input command sources may be enabled or disabled individually.
  • An inverse dynamics transform 19 may compute the required motor torques 18 to achieve gimbal axis (e.g., axes 3, 5, 7, and 9) angular accelerations. This may be accomplished by inverting the forward rigid body dynamics of the gimbal system. Note that these dynamics may vary with gimbal configuration and so depend on the various gimbal angles. Thus, the current gimbal angles as reported by encoders 21 or resolvers may be used in this transform. The full inverse dynamics may be simplified using small-angle trigonometric approximations, look-up tables, gain scheduling, and/or other techniques used to speed computer processing.
  • Follower feedback filter 22 may use the position of a limited-angle axis, such as axis 7 in FIG. 1, as feedback to a PID-type controller with additional features such as limiting, notch filters, etc., to command a relative rate to a redundant axis, such as axis 3 in FIG. 1, so that the limited-angle axis remains in the center of its travel. Follower feedback filter 22 may prevent the gimbal system from approaching gimbal lock and the line-of-sight of the payload from being obscured by the gimbal structure. This may be achieved with a feedback loop that has an unchanging command to “center” the limited-angle gimbal axis. During such “centering,” the relative angle formed by two rotating segments along the axis may be driven from a non-zero value to a zero value, as described in further detail below with respect to FIGS. 4A-4B. Advanced gain sloping, scheduling, or other techniques may also be used to tune the behavior of follower feedback filter 22.
  • An additional inertial measurement unit 23 may be fitted to base 1 and used to improve stabilization performance using a base rate rejection feedforward mapping 24. In particular, the angular rate outputs from inertial measurement unit 23 may be used in base rate rejection feedforward 24 mapping to help remove angular motion of base 1. Base rate rejection feedforward block 24 may include a kinematics transform that computes relative angular rates of the gimbal system to cancel angular rates of base 1. Inertial measurement unit 23 may be a device such as vertical gyroscope or attitude reference system with similar outputs, or inertial measurement unit 23 may be implemented with gyroscopic and attitude sensors.
  • If no feedback gyroscope or inertial measurement unit 16 is present, a command following feedforward block 25 may be used to control system 10. Command following feedforward block 25 may compute gimbal angle relative rates to achieve the desired inertial rates, under the assumption that base 1 is not moving. If the feedback gyroscope or inertial measurement unit 16 is present and stabilization feedback filter 14 is used, command following feedforward block 25 may optionally be used to improve control performance. One advantage of the control scheme in FIG. 2A is that it allows the individual control elements to be designed and tested separately, with all elements providing input to relative rate feedback filter 17.
  • FIG. 2B shows an alternative control system 26 that achieves substantially the same result as control system 10 of FIG. 2A: control over an unlimited field of regard of a payload disposed within the gimbal system. Control system 26 uses the same input signals 11 from user control 12, physical sensors including inertial measurement units 23 and 16 and encoders 21, and the same motor command structure 18. The operation of trajectory generation block 13 is similar and accommodates similar user control modes.
  • In control system 26 of FIG. 2B, relative rate feedback filter 17 may be omitted. A modified stabilization feedback filter 27 generates a number of commands 28 to an inverse kinematics transform block 29. Commands 28 may be in the form of angular accelerations in the stabilization coordinate frame. For example, stabilization feedback filter 27 may include three independent PID-type feedback control loops. Each loop may use measured inertial rates from inertial measurement unit 16 to achieve the desired inertial rates as computed by trajectory generation block 13. The outputs of these control loops may include commands 28 containing angular accelerations in inertial space.
  • Inverse kinematics transform block 29 may transform commands 28 to angular accelerations 30 along the gimbal axes 3, 5, 7, and 9. More specifically, inverse kinematics transform block 29 may convert angular accelerations from inertial space to gimbal axis angular accelerations 30. This may be accomplished by inverting the kinematic relationships, which depend on the current gimbal angles. Thus, the gimbal angles reported by encoders 21 or similar devices may be used to compute this transform. As before, inverse dynamics transform block 29 may correctly account for the gimbal rigid body dynamics and motor dynamics to command motors 18 on the gimbal system.
  • A modified follower feedback filter 31 may ensure that the “following” axis moves to achieve the effect of avoiding gimbal lock and obscuration of the payload's line-of-sight by the gimbal system. In particular, follower feedback filter 31 may command the outer gimbal to avoid the gimbal lock position. To do so, follower feedback filter 13 may use a PID-type control loop based on feedback from encoders 21 to keep the appropriate gimbal axis centered, such that the relative angle across the axis is driven to zero. Follower feedback filter 31 may also serve to precisely position the payload using input from a payload attitude estimation filter 32.
  • Attitude estimation filter 32 may use various inputs from the physical sensors to produce an estimate of the attitude of the payload. For example, attitude estimation filter 32 may use inertial sensing, including accelerometers or other attitude sensors that are mounted to either the gimbal system or base 1. Attitude estimation filter 32 may also use Global Positioning System (GPS) data, inertial navigation output or a vertical gyroscope-type sensor. This can be used in some control modes in trajectory generator 13. The attitude estimate may also include absolute position feedback to position loops in the follower feedback filter 31 to ensure proper pointing of the payload. Attitude estimation filter 32 may also be added to control system 10 of FIG. 2A in a similar fashion. In turn, output from attitude estimation filter 32 may be used to point the payload relative to a coordinate system such as Earth, estimate a horizon and control roll of the payload relative to the horizon, and/or perform other positioning or orientation of the payload.
  • Those skilled in the art will appreciate that the control systems of FIG. 2A-2B may be implemented in a variety of ways. For example, one or both control systems may be provided by a combination of components, including an embedded controller, microprocessor, computer system, field-programmable gate array (FPGA), application-specific integrated circuit (ASIC), digital circuit, analog circuit, and/or one or more software modules. The control system(s) may additionally, or alternatively, execute on a dedicated processor mounted anywhere within the gimbal structure, a remote processing or computer system, and/or a processing system that is integrated with the payload. The control system(s) may also be fitted with a variety of safety and diagnostic features, including, but not limited to, fault detection, graphical orientation representations, and/or bode plot visualization for tuning and auto-tuning. The control system(s) may further be fitted with a variety of features for command input, including, but not limited to: image-based tracking; geo-pointing at fixed coordinates; geo-pointing at coordinates that are moving and reported by a moving target; radio, infrared or light beacon tracking; joystick rate control input; pointing slaved to another device; wheel input devices; and/or motion capture input devices.
  • FIG. 3 shows the gimbal system of FIG. 1 with a camera 33 mounted to the final axis 9 in accordance with one or more embodiments. As mentioned above, axis 9 may include a large-diameter hollow mechanism, which may allow a payload represented by camera 33 to be positioned in the center of axis 9. The orientation of camera 33 may be controlled without limitation by the gimbal system and a control system, such as control systems 10 and 26 of FIGS. 2A-2B.
  • The action of the control system and corresponding follower feedback filter (e.g., follower feedback filters 22 and 31) in positioning camera 33 is shown in FIGS. 4A-4D. In FIG. 4A, continued turning of axis 7 so that camera 33 points to the right will cause the gimbal structure to enter the field-of-view of camera 33 and the gimbal system to enter a gimbal lock position. The control system may measure the angles of axes 3, 5, 7, and 9 using encoders 21 and move axis 3 in a counterclockwise direction 40 to avoid this condition while counter-moving the other axes 5, 7, and 9 to maintain camera 33 in the same orientation and line-of-sight, resulting in the configuration shown in FIG. 4B. In other words, the control system may cancel out the torque on an inner axis 7 of the gimbal system by commanding a counteracting torque on an outer axis 3. Thus, a non-zero relative angle across axis 7 (i.e., the angle between segments 4 and 6) in FIG. 4A may be driven to a zero relative angle in FIG. 4B by rotating axis 3 and making counter-rotations with the remaining axes 5, 7, and 9 to hold the payload in the same position. Such reaction torque cancellation may be performed immediately without waiting for feedback from encoders 21 and/or inertial measurement unit 16 to improve the performance of the gimbal system.
  • Similarly, in FIG. 4C, continued turning of axis 7 in a counterclockwise direction may cause the field of view of camera 33 to be obscured by the gimbal structure. To prevent such obscuration, the follower feedback filter and entire control system may move all axes 3, 5, 7 and 9, including rotating axis 3 in a direction 42 that counteracts the rotation of axis 7, such that axis 7 is re-centered (i.e., the angle between segments 4 and 6 is zero) and camera 33 maintains stable orientation and line-of-sight, resulting in the configuration shown in FIG. 4D.
  • Base 1 may be oriented in any attitude and may change attitude arbitrarily as the gimbal system and control system continue to stabilize the line of sight, as shown in FIGS. 5A-5C. In FIGS. 5A-5C, the control system may generate commands to motors 18 to move axes 3, 5, 7 and 9, achieve unlimited control of camera 33, and maintain the orientation and line-of-sight of camera 33 as base 1 rotates from behind camera 33 to in front of axis 5 (e.g., to isolate camera 33 from the rotational motion of a vehicle to which base 1 is mounted).
  • Those skilled in the art will appreciate that the gimbal system and corresponding control system may be implemented or controlled in various ways. First, the gimbal system may be controlled from a remote location through a cable or through a wireless link. Wireless links may also be used to convey encoder feedback, gimbal control systems, inertial feedback, motor commands or payload data back and forth, in place of slip rings or other mechanisms. Motors used to actuate the gimbal axes may include direct drive motors, a variety of geared or belt-driven mechanisms, piezo actuators, hydraulic actuators, and/or other types of actuation mechanisms or systems.
  • Second, the gimbal structure may be fitted with passive shock or vibration isolators between the base and the first axis (e.g., axis 3), between any axes, or between the payload and the gimbal structure. The gimbal structure may additionally be fitted with actively controlled translation axes to provide some translational motion control.
  • Although the axes of the illustrated gimbal structure intersect at one point, other embodiments may have non-intersecting axes, such as one or more axes that are offset from other axes in the gimbal system. Similarly, although the subsequent axes (e.g., axes 5, 7, 9) of the gimbal structure are perpendicular to one another, other embodiments may have geometries with subsequent axes that are not perpendicular to one another.
  • The gimbal system may also be fitted with various features for achieving balance. The gimbal system may further be fitted with various features for allowing the quick modification of the gimbal system to better accommodate payloads of various sizes, such as extendable pieces to increase the distance between axes 3 and 5.
  • The gimbal system may be fitted with features for quick-releasing the gimbal structure from a variety of mounts for various vehicles, objects, bases, human body or hand use. The gimbal system may also be fitted with various features for quick-releasing the payload.
  • The gimbal system may be fitted with various features to allow the rapid reconfiguration between the various embodiments discussed here. Examples include externally mounted quickly removable slip rings, rotary joints, quick release mounts for wireless transmitters and quick release, quick disconnect inertial sensors for stabilized and/or non-stabilized applications.
  • The gimbal structure may be built with a variety of materials and components, including, but not limited to, metals, plastics, carbon fiber, graphite, and/or composite materials. The gimbal design may allow for internal wiring and internal mounting of electronic components for sensing, control and processing.
  • The gimbal structure may be fitted with a coudé path across one or more axes. The gimbal structure may further be fitted with safety features such as brakes, stow pins, hard stops on limited rotation axes, emergency or disable switches and handling features such as handles and grips.
  • FIG. 6 shows a flowchart illustrating the process of operating a gimbal structure with four or more axes in accordance with one or more embodiments. In one or more embodiments, one or more of the steps may be omitted, repeated, and/or performed in a different order. Accordingly, the specific arrangement of steps shown in FIG. 6 should not be construed as limiting the scope of the embodiments.
  • Initially, inputs are read from a set of encoders on the axes and a set of inertial sensors mounted to the gimbal structure (operation 602). The inputs may include relative angular rate measurements from the encoders and/or inertial rate measurements from the inertial sensors. Command input containing a desired inertial rate for the gimbal structure is also read (operation 604). For example, the command input may be provided through a joystick controller, control console, computer system, electronic device, and/or other device.
  • Next, a first feedback loop is used to compute a set of motor commands to achieve the desired inertial rate (operation 606). For example, the motor commands may be calculated using one or more PID-type feedback controllers that use inertial and/or relative angular rates to provide stabilization to the gimbal system and/or cancel angular base rates of the gimbal structure's base. An inverse dynamics transform may also be applied to the relative angular rate measurements to produce motor torques for achieving angular accelerations of the axes.
  • An estimated attitude of the gimbal structure is then inputted into a second feedback control loop (operation 608), and the motor commands are updated with the second feedback control loop to prevent the gimbal structure from obscuring the line-of-sight of a payload mounted to the gimbal structure and from entering a gimbal lock configuration (operation 610). For example, the attitude may be estimated using input from accelerometers, gyroscopes, attitude sensors, GPS receivers, and/or other physical or inertial sensors. The attitude estimate may also include absolute position feedback to ensure proper pointing of the payload. In turn, the attitude estimate may be provided to the second feedback control loop to “center” one or more axes in the gimbal structure so that the gimbal structure does not obscure the payload's line-of-sight and avoids a gimbal lock configuration.
  • FIG. 7 shows a computer system 700 in accordance with one or more embodiments. Computer system 700 includes a processor 702, memory 704, storage 706, and/or other components found in electronic computing devices. Processor 702 may support parallel processing and/or multi-threaded operation with other processors in computer system 700. Computer system 700 may also include input/output (I/O) devices such as a keyboard 708, a mouse 710, and a display 712.
  • Computer system 700 may include functionality to execute various components of the present embodiments. In particular, computer system 700 may include an operating system (not shown) that coordinates the use of hardware and software resources on computer system 700, as well as one or more applications that perform specialized tasks for the user. To perform tasks for the user, applications may obtain the use of hardware resources on computer system 700 from the operating system, as well as interact with the user through a hardware and/or software framework provided by the operating system.
  • In one or more embodiments, computer system 700 provides a system for operating a gimbal structure with four or more axes. The system may include a control system that controls the gimbal structure to provide unrestricted orientation and rotational motion of a payload mounted to an axis in the four or more axes, independently of an orientation of a base of the gimbal structure. More specifically, the control system may read inputs from a set of encoders on the four or more axes and a set of inertial sensors mounted to the gimbal structure. Next, the control system may read command input containing a desired inertial rate for the gimbal structure. The control system may then compute a set of motor commands with a first feedback control loop to achieve the desired inertial rate. Finally, the control system may update the motor commands with a second feedback control loop to prevent the gimbal structure from obscuring a line-of-sight of a payload mounted to the gimbal structure and from entering a gimbal lock configuration.
  • In addition, one or more components of computer system 700 may be remotely located and connected to the other components over a network. Portions of the present embodiments (e.g., payload, gimbal structure, control system, sensors, etc.) may also be located on different nodes of a distributed system that implements the embodiments. For example, the present embodiments may be implemented using a cloud computing system that processes inputs from encoders and/or inertial sensors mounted to a remote gimbal structure and outputs motor commands to achieve a desired inertial rate and prevent the gimbal structure from obscuring the payload's line-of-sight and entering a gimbal lock configuration.
  • Although the disclosed embodiments have been described with respect to a limited number of embodiments, those skilled in the art, having benefit of this disclosure, will appreciate that many modifications and changes may be made without departing from the spirit and scope of the disclosed embodiments. Accordingly, the above disclosure is to be regarded in an illustrative rather than a restrictive sense. The scope of the embodiments is defined by the appended claims.

Claims (20)

What is claimed is:
1. A gimbal system, comprising:
a gimbal structure with four or more axes; and
a control system that controls the gimbal structure to provide unrestricted orientation and rotational motion of a payload mounted to an axis in the four or more axes, independently of an orientation of a base of the gimbal structure.
2. The gimbal system of claim 1, further comprising:
a mechanism for enabling unlimited rotation of a joint fitted to one or more axes of the gimbal system.
3. The gimbal system of claim 1, further comprising:
one or more inertial sensors that provide inertial angular rate measurements for stabilization of the payload by the gimbal structure and the control system.
4. The gimbal system of claim 3, wherein the control system is configured to use the inertial angular rate measurements to estimate a horizon and control a roll of the payload relative to the horizon.
5. The gimbal system of claim 3, wherein the control system is configured to use the inertial angular rate measurements to estimate the attitude of the payload and point the payload relative to a coordinate system.
6. The gimbal system of claim 1, wherein the control system is further configured to prevent the gimbal structure from obstructing a line-of-sight of the payload or attaining a gimbal lock configuration.
7. The gimbal system of claim 1, wherein the payload comprises a camera.
8. The gimbal system of claim 1, wherein the four or more axes comprise:
a first axis;
a second axis that is perpendicular to the first axis;
a third axis that is perpendicular to the second axis; and
a fourth axis that is perpendicular to the third axis.
9. The gimbal system of claim 8,
wherein the fourth axis comprises a large-diameter hollow mechanism within which the payload is mounted, and
wherein the third axis has limited rotation.
10. The gimbal system of claim 8,
wherein the third axis has a large-diameter hollow mechanism, and
wherein the fourth axis has limited rotation.
11. The gimbal system of claim 8, wherein the gimbal structure further comprises:
one or more additional axes of rotation fitted within or outside the first, second, third, and fourth axes of the gimbal structure.
12. The gimbal system of claim 1, wherein the control system comprises:
a relative rate feedback filter that generates commands to one or more motors coupled to the four or more axes through an inverse dynamics transform.
13. The gimbal system of claim 1, wherein the control system comprises:
a stabilization feedback filter that stabilizes the gimbal system based on inertial rates from one or more inertial measurement units coupled to the gimbal system.
14. The gimbal system of claim 1, wherein the control system comprises:
a follower feedback filter that centers an axis of the gimbal system to prevent gimbal lock in the gimbal system and obscuration of a line-of-sight of the payload by the gimbal system.
15. A method for controlling a gimbal structure with four or more axes, comprising:
reading inputs from a set of encoders on the four or more axes and a set of inertial sensors mounted to the gimbal structure;
reading command input comprising a desired inertial rate for the gimbal structure;
computing, by a processor, a set of motor commands with a first feedback control loop to achieve the desired inertial rate; and
updating the motor commands with a second feedback control loop to prevent the gimbal structure from:
obscuring a line-of-sight of a payload mounted to the gimbal structure; and
entering a gimbal lock configuration.
16. The method of claim 15, further comprising:
inputting an estimated attitude of the gimbal structure into the second feedback control loop prior to updating the motor commands with the second feedback control loop.
17. The method of claim 15, wherein the inputs comprise:
a relative angular rate measurement from the encoders; and
an inertial rate measurement from the inertial sensors.
18. The method of claim 17, wherein computing the set of motor commands to achieve the desired inertial rate comprises:
applying an inverse dynamics transform to the relative angular rate measurement to produce a motor torque for achieving an angular acceleration of an axis in the four or more axes.
19. A non-transitory computer-readable storage medium containing instructions embodied therein for causing a computer system to perform a method for controlling a gimbal structure with four or more axes, the method comprising:
reading inputs from a set of encoders on the four or more axes and a set of inertial sensors mounted to the gimbal structure;
reading command input comprising a desired inertial rate for the gimbal structure;
computing, by a processor, a set of motor commands with a first feedback control loop to achieve the desired inertial rate; and
updating the motor commands with a second feedback control loop to prevent the gimbal structure from:
obscuring a line-of-sight of a payload mounted to the gimbal structure; and
entering a gimbal lock configuration.
20. The non-transitory computer-readable storage medium of claim 19, the method further comprising:
inputting an estimated attitude of the gimbal structure into the second feedback control loop prior to updating the motor commands with the second feedback control loop.
US16/658,089 2015-09-17 2019-10-20 Stabilized gimbal system with unlimited field of regard Abandoned US20200053290A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US16/658,089 US20200053290A1 (en) 2015-09-17 2019-10-20 Stabilized gimbal system with unlimited field of regard

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201562219807P 2015-09-17 2015-09-17
US15/268,635 US10455158B2 (en) 2015-09-17 2016-09-19 Stabilized gimbal system with unlimited field of regard
US16/658,089 US20200053290A1 (en) 2015-09-17 2019-10-20 Stabilized gimbal system with unlimited field of regard

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US15/268,635 Continuation US10455158B2 (en) 2015-09-17 2016-09-19 Stabilized gimbal system with unlimited field of regard

Publications (1)

Publication Number Publication Date
US20200053290A1 true US20200053290A1 (en) 2020-02-13

Family

ID=63355891

Family Applications (2)

Application Number Title Priority Date Filing Date
US15/268,635 Active US10455158B2 (en) 2015-09-17 2016-09-19 Stabilized gimbal system with unlimited field of regard
US16/658,089 Abandoned US20200053290A1 (en) 2015-09-17 2019-10-20 Stabilized gimbal system with unlimited field of regard

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US15/268,635 Active US10455158B2 (en) 2015-09-17 2016-09-19 Stabilized gimbal system with unlimited field of regard

Country Status (1)

Country Link
US (2) US10455158B2 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11317025B1 (en) * 2021-11-02 2022-04-26 Sergii Tartyshnikov Movie camera stabilization and control system
EP4332587A1 (en) * 2022-08-30 2024-03-06 Aptiv Technologies Limited Sensor mounting device for radar testing

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10581160B2 (en) 2016-12-16 2020-03-03 Gopro, Inc. Rotational wireless communication system
CN108427407B (en) * 2017-02-13 2021-03-05 昊翔电能运动科技(昆山)有限公司 Holder control method, holder control system and holder equipment
CN109923852B (en) * 2017-01-24 2021-09-17 深圳市大疆灵眸科技有限公司 Method, system, and medium for query response by camera mounted on pan/tilt head
US10491824B2 (en) * 2017-09-26 2019-11-26 Gopro, Inc. Combined mechanical and electronic image stabilization
US11496684B2 (en) * 2017-12-11 2022-11-08 Gopro, Inc. Combined mechanical and electronic image stabilization
US10827123B1 (en) 2018-01-05 2020-11-03 Gopro, Inc. Modular image capture systems
CN210670256U (en) * 2019-10-10 2020-06-02 北京小米移动软件有限公司 Camera module and electronic equipment
UA125742C2 (en) * 2021-08-27 2022-05-25 Сергій Олександрович Тартишніков Systems for stabilizing and controlling a movie camera

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7000883B2 (en) * 2003-01-17 2006-02-21 The Insitu Group, Inc. Method and apparatus for stabilizing payloads, including airborne cameras
US20100079101A1 (en) * 2005-04-27 2010-04-01 Sidman Adam D Handheld or vehicle-mounted platform stabilization system
GB2464147A (en) * 2008-05-29 2010-04-14 Knowles Kevin Three Degree-of-Freedom Parallel Spherical Mechanism for Payload Orienting Applications
US20110304736A1 (en) * 2010-06-15 2011-12-15 Flir Systems, Inc. Gimbal positioning with target velocity compensation
US9094605B2 (en) * 2003-09-04 2015-07-28 Chapman/Leonard Studio Equipment, Inc Stabilized camera platform system
US20150290804A1 (en) * 2012-10-19 2015-10-15 Kabushiki Kaisha Kobe Seiko Sho (Kobe Steel, Ltd.) Weaving control device for articulated robot

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4989466A (en) * 1989-08-02 1991-02-05 Goodman Ronald C Gyroscopically stabilized sensor positioning system
WO2016007669A1 (en) * 2014-07-08 2016-01-14 Flir Systems, Inc. Gimbal system with imbalance compensation

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7000883B2 (en) * 2003-01-17 2006-02-21 The Insitu Group, Inc. Method and apparatus for stabilizing payloads, including airborne cameras
US9094605B2 (en) * 2003-09-04 2015-07-28 Chapman/Leonard Studio Equipment, Inc Stabilized camera platform system
US20100079101A1 (en) * 2005-04-27 2010-04-01 Sidman Adam D Handheld or vehicle-mounted platform stabilization system
GB2464147A (en) * 2008-05-29 2010-04-14 Knowles Kevin Three Degree-of-Freedom Parallel Spherical Mechanism for Payload Orienting Applications
US20110304736A1 (en) * 2010-06-15 2011-12-15 Flir Systems, Inc. Gimbal positioning with target velocity compensation
US20150290804A1 (en) * 2012-10-19 2015-10-15 Kabushiki Kaisha Kobe Seiko Sho (Kobe Steel, Ltd.) Weaving control device for articulated robot

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11317025B1 (en) * 2021-11-02 2022-04-26 Sergii Tartyshnikov Movie camera stabilization and control system
EP4332587A1 (en) * 2022-08-30 2024-03-06 Aptiv Technologies Limited Sensor mounting device for radar testing

Also Published As

Publication number Publication date
US20180255247A1 (en) 2018-09-06
US10455158B2 (en) 2019-10-22

Similar Documents

Publication Publication Date Title
US10455158B2 (en) Stabilized gimbal system with unlimited field of regard
US11199858B2 (en) Thrust vectored multicopters
KR102322149B1 (en) Platform stabilization system
US10281930B2 (en) Gimbaled universal drone controller
US20190113922A1 (en) Method and system for stabilizing a payload
Li et al. A vision-guided autonomous quadrotor in an air-ground multi-robot system
CN110329550B (en) Attitude control for agile satellite applications
US11209118B2 (en) Support and stabilization systems
Kumar et al. A novel single thruster control strategy for spacecraft attitude stabilization
WO1999030876A1 (en) Spherical mobile robot
US20090281660A1 (en) Gunshot detection stabilized turret robot
JP7084168B2 (en) Methods and equipment for minimizing the command dynamics of artificial satellites
JP6792965B2 (en) Vehicle attitude control
JP4191588B2 (en) Satellite tracking antenna controller
US11886182B2 (en) Systems and methods of detecting intent of spatial control
Zhang et al. Multi-sensory motion estimation and control of a mini-quadrotor in an air-ground multi-robot system
JP2009190506A (en) Posture control device for artificial satellite and posture control method of artificial satellite
Locke et al. High-performance two-axis gimbal system for free space laser communications onboard unmanned aircraft systems
Flores et al. Improving Optical Flow Sensor Using a Gimbal for Quadrotor Navigation in GPS-Denied Environment
Santana et al. Hovering control of a miniature helicopter attached to a platform
Zhang et al. Agile Pointing Control Method for a New Type of Satellite-borne Flexible Cable Parallel Platform
Bellar et al. Tree axis attitude control using sliding mode for LEO microsatellite
Jotov et al. INVESTIGATION OF THE DEVELOPMENT OF TELEMANIPULETING SYSTEM IN 6 DOF MOBILE ROBOT
Bejar et al. Centralized Control of Helicopters with Manipulators
Gullapalli et al. Stability Studies Of Solar Optical Telescope Dynamics

Legal Events

Date Code Title Description
AS Assignment

Owner name: IJK CONTROLS LLC, TEXAS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:RISTROPH, GUNNAR G.;RAYCROFT, JASON M.;REEL/FRAME:050768/0635

Effective date: 20160916

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

AS Assignment

Owner name: GENERAL ATOMICS AERONAUTICAL SYSTEMS, INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:IJK CONTROLS, LLC;REEL/FRAME:052829/0278

Effective date: 20200520

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION