EP3091249A1 - Isolation systems for image data gathering devices - Google Patents

Isolation systems for image data gathering devices Download PDF

Info

Publication number
EP3091249A1
EP3091249A1 EP16168614.2A EP16168614A EP3091249A1 EP 3091249 A1 EP3091249 A1 EP 3091249A1 EP 16168614 A EP16168614 A EP 16168614A EP 3091249 A1 EP3091249 A1 EP 3091249A1
Authority
EP
European Patent Office
Prior art keywords
damper
vehicle
adaptive
isr
recited
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP16168614.2A
Other languages
German (de)
French (fr)
Other versions
EP3091249B1 (en
Inventor
Haftay Hailu
Ian P. HUMPHREY
Michael C. MARDEN
Mario PIERI
Joanna LANGWORTHY
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Goodrich Corp
Original Assignee
Goodrich Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Goodrich Corp filed Critical Goodrich Corp
Publication of EP3091249A1 publication Critical patent/EP3091249A1/en
Application granted granted Critical
Publication of EP3091249B1 publication Critical patent/EP3091249B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64DEQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENTS OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
    • B64D47/00Equipment not otherwise provided for
    • B64D47/08Arrangements of cameras
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60GVEHICLE SUSPENSION ARRANGEMENTS
    • B60G15/00Resilient suspensions characterised by arrangement, location or type of combined spring and vibration damper, e.g. telescopic type
    • B60G15/02Resilient suspensions characterised by arrangement, location or type of combined spring and vibration damper, e.g. telescopic type having mechanical spring
    • B60G15/06Resilient suspensions characterised by arrangement, location or type of combined spring and vibration damper, e.g. telescopic type having mechanical spring and fluid damper
    • B60G15/067Resilient suspensions characterised by arrangement, location or type of combined spring and vibration damper, e.g. telescopic type having mechanical spring and fluid damper characterised by the mounting on the vehicle body or chassis of the spring and damper unit
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60GVEHICLE SUSPENSION ARRANGEMENTS
    • B60G17/00Resilient suspensions having means for adjusting the spring or vibration-damper characteristics, for regulating the distance between a supporting surface and a sprung part of vehicle or for locking suspension during use to meet varying vehicular or surface conditions, e.g. due to speed or load
    • B60G17/015Resilient suspensions having means for adjusting the spring or vibration-damper characteristics, for regulating the distance between a supporting surface and a sprung part of vehicle or for locking suspension during use to meet varying vehicular or surface conditions, e.g. due to speed or load the regulating means comprising electric or electronic elements
    • B60G17/016Resilient suspensions having means for adjusting the spring or vibration-damper characteristics, for regulating the distance between a supporting surface and a sprung part of vehicle or for locking suspension during use to meet varying vehicular or surface conditions, e.g. due to speed or load the regulating means comprising electric or electronic elements characterised by their responsiveness, when the vehicle is travelling, to specific motion, a specific condition, or driver input
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F16ENGINEERING ELEMENTS AND UNITS; GENERAL MEASURES FOR PRODUCING AND MAINTAINING EFFECTIVE FUNCTIONING OF MACHINES OR INSTALLATIONS; THERMAL INSULATION IN GENERAL
    • F16FSPRINGS; SHOCK-ABSORBERS; MEANS FOR DAMPING VIBRATION
    • F16F15/00Suppression of vibrations in systems; Means or arrangements for avoiding or reducing out-of-balance forces, e.g. due to motion
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F16ENGINEERING ELEMENTS AND UNITS; GENERAL MEASURES FOR PRODUCING AND MAINTAINING EFFECTIVE FUNCTIONING OF MACHINES OR INSTALLATIONS; THERMAL INSULATION IN GENERAL
    • F16FSPRINGS; SHOCK-ABSORBERS; MEANS FOR DAMPING VIBRATION
    • F16F15/00Suppression of vibrations in systems; Means or arrangements for avoiding or reducing out-of-balance forces, e.g. due to motion
    • F16F15/02Suppression of vibrations of non-rotating, e.g. reciprocating systems; Suppression of vibrations of rotating systems by use of members not moving with the rotating systems
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F16ENGINEERING ELEMENTS AND UNITS; GENERAL MEASURES FOR PRODUCING AND MAINTAINING EFFECTIVE FUNCTIONING OF MACHINES OR INSTALLATIONS; THERMAL INSULATION IN GENERAL
    • F16FSPRINGS; SHOCK-ABSORBERS; MEANS FOR DAMPING VIBRATION
    • F16F9/00Springs, vibration-dampers, shock-absorbers, or similarly-constructed movement-dampers using a fluid or the equivalent as damping medium
    • F16F9/32Details
    • F16F9/53Means for adjusting damping characteristics by varying fluid viscosity, e.g. electromagnetically
    • F16F9/532Electrorheological [ER] fluid dampers
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B15/00Special procedures for taking photographs; Apparatus therefor
    • G03B15/006Apparatus mounted on flying objects
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R11/00Arrangements for holding or mounting articles, not otherwise provided for
    • B60R11/04Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64UUNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
    • B64U20/00Constructional aspects of UAVs
    • B64U20/80Arrangement of on-board electronics, e.g. avionics systems or wiring
    • B64U20/87Mounting of imaging devices, e.g. mounting of gimbals
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64UUNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
    • B64U2101/00UAVs specially adapted for particular uses or applications
    • B64U2101/30UAVs specially adapted for particular uses or applications for imaging, photography or videography
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64UUNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
    • B64U2101/00UAVs specially adapted for particular uses or applications
    • B64U2101/30UAVs specially adapted for particular uses or applications for imaging, photography or videography
    • B64U2101/31UAVs specially adapted for particular uses or applications for imaging, photography or videography for surveillance
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F16ENGINEERING ELEMENTS AND UNITS; GENERAL MEASURES FOR PRODUCING AND MAINTAINING EFFECTIVE FUNCTIONING OF MACHINES OR INSTALLATIONS; THERMAL INSULATION IN GENERAL
    • F16FSPRINGS; SHOCK-ABSORBERS; MEANS FOR DAMPING VIBRATION
    • F16F13/00Units comprising springs of the non-fluid type as well as vibration-dampers, shock-absorbers, or fluid springs
    • F16F13/04Units comprising springs of the non-fluid type as well as vibration-dampers, shock-absorbers, or fluid springs comprising both a plastics spring and a damper, e.g. a friction damper
    • F16F13/06Units comprising springs of the non-fluid type as well as vibration-dampers, shock-absorbers, or fluid springs comprising both a plastics spring and a damper, e.g. a friction damper the damper being a fluid damper, e.g. the plastics spring not forming a part of the wall of the fluid chamber of the damper
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F16ENGINEERING ELEMENTS AND UNITS; GENERAL MEASURES FOR PRODUCING AND MAINTAINING EFFECTIVE FUNCTIONING OF MACHINES OR INSTALLATIONS; THERMAL INSULATION IN GENERAL
    • F16FSPRINGS; SHOCK-ABSORBERS; MEANS FOR DAMPING VIBRATION
    • F16F9/00Springs, vibration-dampers, shock-absorbers, or similarly-constructed movement-dampers using a fluid or the equivalent as damping medium
    • F16F9/32Details
    • F16F9/3292Sensor arrangements
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B2205/00Adjustment of optical system relative to image or object surface other than for focusing
    • G03B2205/0007Movement of one or more optical elements for control of motion blur

Definitions

  • the present disclosure relates to imaging, and more particularly to vibration isolation systems for image data gathering devices.
  • Vehicles commonly employ imaging systems in terrestrial, marine, and aerospace applications to gather information relating to the environment surrounding the vehicle.
  • some types of aircraft are configured to carry one or more intelligence, surveillance, and reconnaissance (ISR) systems that acquire image data of terrain overflown by the aircraft.
  • ISR intelligence, surveillance, and reconnaissance
  • the quality of the image data acquired by the aircraft is typically influenced by the effectiveness of how well the ISR system is isolated from the aircraft mounting the ISR system, both in terms of discrete shock events and repetitive impulses from vibratory forces.
  • isolation devices are included either on the aircraft, on an intermediate structure connected between the aircraft and the ISR system, or as structures integrated into the ISR system to isolate the ISR system from shock and/or vibrational signatures that are characteristic of a specific type of aircraft.
  • Such isolators may be tuned for a specific range of shock and vibration exhibited by a certain type of aircraft, such as during takeoff, cruise, and landing flight regimes.
  • An image gathering system includes an intelligence, surveillance and reconnaissance (ISR) system, an isolation system with an adaptive damper, and a controller operatively associated with the adaptive damper.
  • the adaptive damper has a vehicle coupling and a payload coupling, and the payload coupling is connected to the ISR system.
  • the controller is operatively associated with the adaptive damper to change a damping characteristic of the adaptive damper based on an expected vibration signature of a vehicle coupled to the isolation system through the vehicle coupling of the adaptive damper.
  • the controller can include a module with machine-readable instructions recorded on the module to receive an input indicating a vehicle type, e.g. aircraft type, that the system is (or is to be) connected to and adapt the damping characteristics of the damper such that the ISR system is isolated from a vibration disturbance type that is unique to the indicated vehicle type. For example, if the input indicates that the system is to be flown on a Bell 206 helicopter, the controller can be configured to change the damping characteristics of the adaptive damper such that the ISR system is isolated from vibration disturbance characteristic of Bell 206 helicopters.
  • a vehicle type e.g. aircraft type
  • the system can also include one or more vibration sensors that are communicative with the module, and the instructions can further cause the module to receive vibration data from the sensor and change the damping characteristics using the received vibration data. It is contemplated that the vibration sensor provide vibration information relating to internal and external shocks experienced by a vehicle coupled to the system, such as shocks experienced while an aircraft is in a takeoff or landing flight regime.
  • the adaptive damper can include a variable damper with first and second damping coefficients.
  • the first damping coefficient can be associated with a first vehicle type and the second damping coefficient can be associated with a second vehicle type.
  • the adaptive damper can include a fluid damper.
  • the adaptive damper can include both a tunable passive damping element and an active damping element.
  • the ISR system have six degrees of freedom relative to a vehicle mounting the ISR system, and the damper can include between six and ten dampers arranged to isolate the ISR system relative to each of the six degrees of freedom.
  • a mount can be connected to the vehicle coupling of the damper, such as a gimbal pivotally supporting the ISR system.
  • the ISR system can include at least one of an optical, radar, or infrared image data collection apparatus.
  • a method of isolating an ISR system from vibration includes receiving input identifying a vehicle vibration signature from a plurality of predetermined vehicle vibration signatures, adjusting a damping response of an adaptive damper connected to the ISR system based on the identified vehicle vibration signal, and isolating the ISR system using the adaptive damper.
  • the method can also include receiving vibration data from a vibration sensor coupled to a vehicle connected to the ISR system and/or the ISR system, and can further include actively damping the ISR system based on the received vibration data.
  • FIG. 1 a partial view of an exemplary embodiment of an image gathering system in accordance with the disclosure is shown in Fig. 1 and is designated generally by reference character 100.
  • FIGs. 2-4 Other embodiments of image gathering systems and methods of isolating such systems from vibration in accordance with the disclosure, or aspects thereof, are provided in Figs. 2-4 , as will be described.
  • the systems and methods described herein can be used for adapting image gathering system for use on more than one platform, such as different types of aircraft with different vibration profiles.
  • image gathering system 100 includes an intelligence, surveillance and reconnaissance (ISR) system 102, an isolation system 104 and a controller 106.
  • ISR system 102 includes one or more of an optical, radar or infrared image collection apparatus 108.
  • Isolation system 104 includes at least one adaptive damper 110 that couples ISR system 102 to a vehicle 10, and in the illustrated exemplary embodiment includes six dampers.
  • Controller 106 is operably associated with adaptive damper 110 to change a damping coefficient of adaptive damper 110 based on an expected vibration profile of a vehicle to which image gathering system 100 is connected, e.g. vehicle 10.
  • isolation system 104 can include one, two, or more dampers, as suitable for an intended application.
  • vehicle 10 is a first vehicle having a first vibration signature that is characteristic of a specific type of vehicle.
  • the first vibration signature is different from a second vibration signature associated with a second vehicle 20.
  • vehicle 10 can be a rotary wing aircraft with four blades that has a repetitive vibration signature with a frequency spike equivalent to four times the rotational speed of a main rotor shaft of the aircraft.
  • Vehicle 20 can be a rotary wing aircraft with two blades and having a repetitive vibration signature with a frequency spike at two the rotational speed of aircraft main rotor shaft.
  • Isolation system 104 can be configured to damp vibrations associated with both vibration signatures. This enables employment of image gathering system 100 on both types of aircraft without having to dedicate the tuning setup of isolation system 104 to a specific type of aircraft, thereby providing operational flexibility to the user.
  • a mount 112 can be connected between adaptive damper 110 and vehicle 10.
  • ISR system 102 may also include or more gimbals 114 supporting collection apparatus 108.
  • ISR system 102 is damped within six degrees of freedom.
  • isolation system 104 includes a power supply 118 that is connected to controller 106.
  • Power supply 118 may provide power to controller 106 and/or distribute power to one or more dampers 110 having an active damping element 116 (shown in Fig. 2 ).
  • isolation system 104 includes a vibration sensor 120 such as an accelerometer. Accelerometer 120 is connected to controller 106 and configured to provide vibration data to controller 106. Controller 106 receives the data and alters the damping response to the isolation system 104 using the data. For example, controller 106 may initiate active damping of ISR system 102 in the event that data received from accelerometer 120 indicates that vehicle 10 has experienced an internal or external shock. Examples of internal shocks include transitions from one flight regime to another, e.g. from standstill to takeoff, takeoff to cruise, or cruise to landing. Controller 106 may also cause ISR system to cease imaging and/or place itself into a protected configuration in the event that the vibration data exceeds a predetermined level.
  • a vibration sensor 120 such as an accelerometer. Accelerometer 120 is connected to controller 106 and configured to provide vibration data to controller 106. Controller 106 receives the data and alters the damping response to the isolation system 104 using the data. For example, controller 106 may initiate active damping of ISR system 102 in the event that data
  • Adaptive damper 110 includes a payload coupling 122, a vehicle coupling 124, active damper 116, a passive damper 126.
  • Payload coupling 122 connects to ISR system 102 (shown in Fig. 1 ).
  • Vehicle coupling 124 connects to either mount 112 (shown in Fig. 1 ) or directly to vehicle 10 (shown in Fig. 1 ), depending on the configuration and placement of damper 110.
  • Adaptive damper 110 may be a variable damper, meaning that a damping coefficient of adaptive damper 110 can be adjusted based on a signal received from controller 106 (shown in Fig. 1 ).
  • adaptive damper 110 may include a fluid damping element where fluid flow properties within adaptive damper 110 change based on a command signal from controller 106. It is also contemplated that adaptive damper 110 may employ one or more controlled valves, magnetorheological elements, or electrorheological elements.
  • Method 200 includes input identifying a vehicle vibration signature from a plurality of predetermined vehicle vibration signatures as shown with box 210.
  • Method 200 also includes adjusting a damping response of a damper, e.g. adaptive damper 110, connected to the ISR system based on a vibration signal the identified vehicle, as shown with box 220, and isolating the ISR system vibrations associated with the vehicle, such as by altering the damping coefficient of an adaptive damper, e.g. adaptive damper 110.
  • Method 200 also includes changing the damping response (damping coefficient) from that suitable for a first vehicle to a second vehicle, e.g. from first vehicle 10 to second vehicle 20, as shown with arrow 250.
  • Method 200 can also include receiving vibration data from a sensor, e.g. vibration sensor 120, coupled to the vehicle, as shown with box 230.
  • Method 200 may further include changing the damping coefficient of the damper using the vibration data, such as by ceasing image data collection, placing the ISR system into a protected state, or adaptively damping a disturbance to the ISR system, as shown with box 240.
  • Such active adaptive damping may be in response to internal or external vibration experienced by the vehicle, as shown with arrow 260.
  • Controller 106 includes a module 130 communicative with a user interface 132 and a memory 134.
  • Memory 134 has a plurality of program modules 136 recorded thereon that contain instructions that, when read by module 106, cause module 106 to undertake the operations described above.
  • One or more program modules 106 may include, for example, damping coefficients assignable to dampers 110 for specific types of vehicles. This enables a user (or a computer program) to identify a vehicle type to which image gathering system 100 (shown in Fig. 1 ) is attached using user interface 132 and have module 130 change the damping performance of any one or all of dampers 110.
  • the methods and systems of the present disclosure provide adaptive image gathering systems with superior properties including the ability to be employed on different types of vehicles (platforms) without hardware or software changes. This enables the user to employ the system on multiple platforms without the need for specialized technical assistance to change the configuration of the image gathering system or maintain a suite of image gathering systems for use on different platforms within a fleet.
  • the user may change the payload (i.e. ISR system 102) for different missions in the field by updating or selecting different sets of adaption parameters.
  • the image gathering system allows for slowly adjusting the jitter or smear in imaging data acquired with the ISR system depending on the flight regime and sensor modality.
  • the adaptive damping system may be commanded perform at its softest state to provide the lowest amount of jitter or smear, thereby providing relatively high image quality. It is contemplated that controller 106 (shown in Fig. 1 ) may determine the optimum damping characteristic during image data collection and cause the adaptive isolation system to damp the ISR system using the adaptive dampers during image data collection.

Abstract

An image gathering system (100) includes an intelligence, surveillance and reconnaissance (ISR) device (102), an isolation system (104) with a damper (110), and a controller (106) operatively associated with the damper. The damper has a vehicle coupling (124) and a payload coupling (122), and the payload coupling is connected to the ISR system. The controller is operatively associated with the damper to change the damping coefficient of the damper based on an expected vibration signature of a vehicle (10, 20) coupled to the isolation system through the vehicle coupling of the damper.

Description

    BACKGROUND OF THE DISCLOSURE Field of the Disclosure
  • The present disclosure relates to imaging, and more particularly to vibration isolation systems for image data gathering devices.
  • Description of Related Art
  • Vehicles commonly employ imaging systems in terrestrial, marine, and aerospace applications to gather information relating to the environment surrounding the vehicle. For example, some types of aircraft are configured to carry one or more intelligence, surveillance, and reconnaissance (ISR) systems that acquire image data of terrain overflown by the aircraft. The quality of the image data acquired by the aircraft is typically influenced by the effectiveness of how well the ISR system is isolated from the aircraft mounting the ISR system, both in terms of discrete shock events and repetitive impulses from vibratory forces. Since some ISR systems are more sensitive to such shocks and vibration than others, isolation devices are included either on the aircraft, on an intermediate structure connected between the aircraft and the ISR system, or as structures integrated into the ISR system to isolate the ISR system from shock and/or vibrational signatures that are characteristic of a specific type of aircraft. Such isolators may be tuned for a specific range of shock and vibration exhibited by a certain type of aircraft, such as during takeoff, cruise, and landing flight regimes.
  • Such conventional methods and systems have generally been considered satisfactory for their intended purpose. However, there is still a need in the art for improved isolation devices and isolation systems that provide platform flexibility. The present disclosure provides a solution for this need.
  • SUMMARY OF THE DISCLOSURE
  • An image gathering system includes an intelligence, surveillance and reconnaissance (ISR) system, an isolation system with an adaptive damper, and a controller operatively associated with the adaptive damper. The adaptive damper has a vehicle coupling and a payload coupling, and the payload coupling is connected to the ISR system. The controller is operatively associated with the adaptive damper to change a damping characteristic of the adaptive damper based on an expected vibration signature of a vehicle coupled to the isolation system through the vehicle coupling of the adaptive damper.
  • In certain embodiments, the controller can include a module with machine-readable instructions recorded on the module to receive an input indicating a vehicle type, e.g. aircraft type, that the system is (or is to be) connected to and adapt the damping characteristics of the damper such that the ISR system is isolated from a vibration disturbance type that is unique to the indicated vehicle type. For example, if the input indicates that the system is to be flown on a Bell 206 helicopter, the controller can be configured to change the damping characteristics of the adaptive damper such that the ISR system is isolated from vibration disturbance characteristic of Bell 206 helicopters.
  • In accordance with certain embodiments, the system can also include one or more vibration sensors that are communicative with the module, and the instructions can further cause the module to receive vibration data from the sensor and change the damping characteristics using the received vibration data. It is contemplated that the vibration sensor provide vibration information relating to internal and external shocks experienced by a vehicle coupled to the system, such as shocks experienced while an aircraft is in a takeoff or landing flight regime.
  • It is also contemplated that, in accordance with certain embodiments, the adaptive damper can include a variable damper with first and second damping coefficients. The first damping coefficient can be associated with a first vehicle type and the second damping coefficient can be associated with a second vehicle type. The adaptive damper can include a fluid damper. The adaptive damper can include both a tunable passive damping element and an active damping element. The ISR system have six degrees of freedom relative to a vehicle mounting the ISR system, and the damper can include between six and ten dampers arranged to isolate the ISR system relative to each of the six degrees of freedom. A mount can be connected to the vehicle coupling of the damper, such as a gimbal pivotally supporting the ISR system. It is also contemplated that, in accordance with certain embodiments, the ISR system can include at least one of an optical, radar, or infrared image data collection apparatus.
  • In an aspect, a method of isolating an ISR system from vibration includes receiving input identifying a vehicle vibration signature from a plurality of predetermined vehicle vibration signatures, adjusting a damping response of an adaptive damper connected to the ISR system based on the identified vehicle vibration signal, and isolating the ISR system using the adaptive damper. In certain embodiments, the method can also include receiving vibration data from a vibration sensor coupled to a vehicle connected to the ISR system and/or the ISR system, and can further include actively damping the ISR system based on the received vibration data.
  • These and other features of the systems and methods of the subject disclosure will become more readily apparent to those skilled in the art from the following detailed description of the preferred embodiments taken in conjunction with the drawings.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • So that those skilled in the art to which the subject disclosure appertains will readily understand how to make and use the devices and methods of the subject disclosure without undue experimentation, embodiments thereof will be described in detail herein below with reference to certain figures, wherein:
    • Fig. 1 is a schematic view of an exemplary embodiment of an exemplary image gathering system constructed in accordance with the present disclosure, showing an intelligence, surveillance and reconnaissance (ISR) system connected to an isolation system with a controller;
    • Fig. 2 is a schematic view of a damper of the isolation system of Fig. 1, showing passive and adaptive damping elements of the damper;
    • Fig. 3 is a diagram of a method of isolating an ISR system from vibration using the isolation system shown in Fig. 1; and
    • Fig. 4 is a schematic view of the controller of Fig. 1, showing a module communicative with both a memory and a vibration sensor.
    DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • Reference will now be made to the drawings wherein like reference numerals identify similar structural features or aspects of the subject disclosure. For purposes of explanation and illustration, and not limitation, a partial view of an exemplary embodiment of an image gathering system in accordance with the disclosure is shown in Fig. 1 and is designated generally by reference character 100. Other embodiments of image gathering systems and methods of isolating such systems from vibration in accordance with the disclosure, or aspects thereof, are provided in Figs. 2-4, as will be described. The systems and methods described herein can be used for adapting image gathering system for use on more than one platform, such as different types of aircraft with different vibration profiles.
  • As shown in Fig. 1, image gathering system 100 includes an intelligence, surveillance and reconnaissance (ISR) system 102, an isolation system 104 and a controller 106. ISR system 102 includes one or more of an optical, radar or infrared image collection apparatus 108. Isolation system 104 includes at least one adaptive damper 110 that couples ISR system 102 to a vehicle 10, and in the illustrated exemplary embodiment includes six dampers. Controller 106 is operably associated with adaptive damper 110 to change a damping coefficient of adaptive damper 110 based on an expected vibration profile of a vehicle to which image gathering system 100 is connected, e.g. vehicle 10. It is to be appreciated and understood that isolation system 104 can include one, two, or more dampers, as suitable for an intended application.
  • It is contemplated that vehicle 10 is a first vehicle having a first vibration signature that is characteristic of a specific type of vehicle. The first vibration signature is different from a second vibration signature associated with a second vehicle 20. For example, vehicle 10 can be a rotary wing aircraft with four blades that has a repetitive vibration signature with a frequency spike equivalent to four times the rotational speed of a main rotor shaft of the aircraft. Vehicle 20 can be a rotary wing aircraft with two blades and having a repetitive vibration signature with a frequency spike at two the rotational speed of aircraft main rotor shaft. Isolation system 104 can be configured to damp vibrations associated with both vibration signatures. This enables employment of image gathering system 100 on both types of aircraft without having to dedicate the tuning setup of isolation system 104 to a specific type of aircraft, thereby providing operational flexibility to the user.
  • A mount 112 can be connected between adaptive damper 110 and vehicle 10. In embodiments, ISR system 102 may also include or more gimbals 114 supporting collection apparatus 108. In certain embodiments, ISR system 102 is damped within six degrees of freedom.
  • In embodiments, isolation system 104 includes a power supply 118 that is connected to controller 106. Power supply 118 may provide power to controller 106 and/or distribute power to one or more dampers 110 having an active damping element 116 (shown in Fig. 2).
  • In certain embodiments isolation system 104 includes a vibration sensor 120 such as an accelerometer. Accelerometer 120 is connected to controller 106 and configured to provide vibration data to controller 106. Controller 106 receives the data and alters the damping response to the isolation system 104 using the data. For example, controller 106 may initiate active damping of ISR system 102 in the event that data received from accelerometer 120 indicates that vehicle 10 has experienced an internal or external shock. Examples of internal shocks include transitions from one flight regime to another, e.g. from standstill to takeoff, takeoff to cruise, or cruise to landing. Controller 106 may also cause ISR system to cease imaging and/or place itself into a protected configuration in the event that the vibration data exceeds a predetermined level.
  • With reference to Fig. 2, adaptive damper 110 is shown. Adaptive damper 110 includes a payload coupling 122, a vehicle coupling 124, active damper 116, a passive damper 126. Payload coupling 122 connects to ISR system 102 (shown in Fig. 1). Vehicle coupling 124 connects to either mount 112 (shown in Fig. 1) or directly to vehicle 10 (shown in Fig. 1), depending on the configuration and placement of damper 110.
  • Adaptive damper 110 may be a variable damper, meaning that a damping coefficient of adaptive damper 110 can be adjusted based on a signal received from controller 106 (shown in Fig. 1). For example, adaptive damper 110 may include a fluid damping element where fluid flow properties within adaptive damper 110 change based on a command signal from controller 106. It is also contemplated that adaptive damper 110 may employ one or more controlled valves, magnetorheological elements, or electrorheological elements.
  • With reference to Fig. 3, a method 200 of isolating an ISR system, e.g. ISR system 102, from a vehicle, e.g. vehicle 10, is shown. Method 200 includes input identifying a vehicle vibration signature from a plurality of predetermined vehicle vibration signatures as shown with box 210. Method 200 also includes adjusting a damping response of a damper, e.g. adaptive damper 110, connected to the ISR system based on a vibration signal the identified vehicle, as shown with box 220, and isolating the ISR system vibrations associated with the vehicle, such as by altering the damping coefficient of an adaptive damper, e.g. adaptive damper 110. Method 200 also includes changing the damping response (damping coefficient) from that suitable for a first vehicle to a second vehicle, e.g. from first vehicle 10 to second vehicle 20, as shown with arrow 250.
  • Method 200 can also include receiving vibration data from a sensor, e.g. vibration sensor 120, coupled to the vehicle, as shown with box 230. Method 200 may further include changing the damping coefficient of the damper using the vibration data, such as by ceasing image data collection, placing the ISR system into a protected state, or adaptively damping a disturbance to the ISR system, as shown with box 240. Such active adaptive damping may be in response to internal or external vibration experienced by the vehicle, as shown with arrow 260.
  • With reference to Fig. 4, controller 106 is shown. Controller 106 includes a module 130 communicative with a user interface 132 and a memory 134. Memory 134 has a plurality of program modules 136 recorded thereon that contain instructions that, when read by module 106, cause module 106 to undertake the operations described above. One or more program modules 106 may include, for example, damping coefficients assignable to dampers 110 for specific types of vehicles. This enables a user (or a computer program) to identify a vehicle type to which image gathering system 100 (shown in Fig. 1) is attached using user interface 132 and have module 130 change the damping performance of any one or all of dampers 110.
  • The methods and systems of the present disclosure, as described above and shown in the drawings, provide adaptive image gathering systems with superior properties including the ability to be employed on different types of vehicles (platforms) without hardware or software changes. This enables the user to employ the system on multiple platforms without the need for specialized technical assistance to change the configuration of the image gathering system or maintain a suite of image gathering systems for use on different platforms within a fleet. In embodiments, the user may change the payload (i.e. ISR system 102) for different missions in the field by updating or selecting different sets of adaption parameters. In certain embodiments, the image gathering system allows for slowly adjusting the jitter or smear in imaging data acquired with the ISR system depending on the flight regime and sensor modality. For example, the adaptive damping system may be commanded perform at its softest state to provide the lowest amount of jitter or smear, thereby providing relatively high image quality. It is contemplated that controller 106 (shown in Fig. 1) may determine the optimum damping characteristic during image data collection and cause the adaptive isolation system to damp the ISR system using the adaptive dampers during image data collection.
  • While the apparatus and methods of the subject disclosure have been shown and described with reference to preferred embodiments, those skilled in the art will readily appreciate that changes and/or modifications may be made thereto without departing from the scope of the subject disclosure.

Claims (15)

  1. An image gathering system (100), comprising:
    an intelligence, surveillance and reconnaissance (ISR) system (102);
    an isolation system (104) having at least one adaptive damper (110), wherein the adaptive damper has vehicle (124) and payload (122) couplings, the payload coupling being connected to the ISR system; and
    a controller (106) operatively associated with the adaptive damper to change a damping characteristic of the adaptive damper based on an expected vibration signature of a vehicle (10, 20) coupled to the isolation system through the adaptive damper vehicle coupling.
  2. An image gathering system (100) as recited in claim 1, wherein the adaptive damper (110) comprises a variable damper with a first and second damping characteristics, the first damping coefficient being associated with a first vehicle type (10) and the second damping coefficient being associated with a second vehicle type (20).
  3. An image gathering system (100) as recited in claim 1 or 2, wherein the adaptive damper comprises a variable fluid damper.
  4. An image gathering system as recited in claim 1, 2 or 3, wherein the ISR system (102) has six degrees of freedom relative to a vehicle (10, 20) mounting the ISR system, and the isolation system comprises between six and ten adaptive dampers (110) arranged to isolate the ISR system relative to each of the six degrees of freedom.
  5. An image gathering system (100) as recited in any preceding claim, further including a vibration sensor (120) communicative with the controller (106) to receive information relating to vehicle vibration and external shocks.
  6. An image gathering system (100) as recited in any preceding claim, further including a mount (112) connected to the vehicle coupling (124) of the adaptive damper (110).
  7. An image gathering system (100) as recited in any preceding claim, wherein the isolation system (104) includes four adaptive dampers (110).
  8. An image gathering system (100) as recited in any preceding claim, further including a power supply (118) connected to the controller (106).
  9. An image gathering system (100) as recited in any preceding claim, wherein the ISR system (102) comprises an optical, radar, or infrared image collection apparatus (108).
  10. An image gathering system (100) as recited in any preceding claim, wherein the controller (106) further comprises a processor communicative with a memory (134), the memory having instructions recorded thereon that, when read by the processor, cause the processor to:
    receive an input indicating a vehicle type;
    change the damping coefficient of the adaptive damper (110) such that ISR system (102) is isolated from a vibration signature associated with the vehicle type.
  11. An image gathering system (100) as recited in claim 10, wherein the instructions further cause the processor to receive vibration data from a vibration sensor (120) communicative with the processor, and change a damping characteristic of the adaptive damper (110) using the received vibration data.
  12. An image gathering system (100), comprising:
    an intelligence, surveillance and reconnaissance (ISR) system (102);
    an isolation system (104) having at least one adaptive damper (110) and a vibration sensor (120),
    wherein the adaptive damper has vehicle (124) and payload (122) couplings, the payload coupling being connected to the ISR system,
    wherein the vibration sensor is configured mechanically couple to a vehicle (10, 20); and
    a controller (106) communicative with the vibration sensor and operatively associated with the damper to change a damping coefficient of the damper based on an expected vibration signature of a vehicle coupled to the isolation system through damper vehicle coupling and vibration data received from the vibration sensor.
  13. An image gathering system (100) as recited in claim 12, wherein the adaptive damper (110) comprises a variable damper with a first and second damping coefficients, the first damping coefficient being associated with a first (10) vehicle type and the second damping coefficient being associated with a second (20) vehicle type.
  14. An image gathering system (100) as recited in claim 12 or 13, wherein the adaptive damper (110) comprises an adaptive damping element (110) and an active damping element (116).
  15. An image gathering system (100) as recited in claim 12, 13 or 14, wherein the adaptive damper (110) comprises a variable fluid damper.
EP16168614.2A 2015-05-06 2016-05-06 Isolation systems for image data gathering devices Active EP3091249B1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US14/705,191 US9682786B2 (en) 2015-05-06 2015-05-06 Isolation systems for image data gathering devices

Publications (2)

Publication Number Publication Date
EP3091249A1 true EP3091249A1 (en) 2016-11-09
EP3091249B1 EP3091249B1 (en) 2019-11-06

Family

ID=56296458

Family Applications (1)

Application Number Title Priority Date Filing Date
EP16168614.2A Active EP3091249B1 (en) 2015-05-06 2016-05-06 Isolation systems for image data gathering devices

Country Status (2)

Country Link
US (1) US9682786B2 (en)
EP (1) EP3091249B1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109578507A (en) * 2019-01-25 2019-04-05 吉林大学 A kind of main passive absorber of three axis rotation aerial camera

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111624877B (en) * 2020-04-28 2022-07-05 北京控制工程研究所 Spacecraft three-super-control self-adaptive variable-stiffness variable-damping full-frequency-band disturbance suppression method

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU2010201262A1 (en) * 2009-04-01 2010-10-21 Autogyro Ag Gyroplane
EP2357098A2 (en) * 2010-02-05 2011-08-17 Fox Factory, Inc. Method and apparatus for suspension adjustment
US20120263445A1 (en) * 2011-04-13 2012-10-18 Beasley Ronald L Device for supporting a camera in a helicopter
US20130277500A1 (en) * 2012-04-19 2013-10-24 Kirk A. Miller Shock-resistant device and method
WO2013192370A2 (en) * 2012-06-21 2013-12-27 Google Inc. Tunable vibration dampers
US20150088378A1 (en) * 2012-03-29 2015-03-26 Toyota Jidosha Kabushiki Kaisha Road surface condition estimating apparatus

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6145393A (en) 1998-11-27 2000-11-14 Canton; Dino Floated gimbal optical platform
US6752250B2 (en) * 2001-09-27 2004-06-22 Northrop Grumman Corporation Shock, vibration and acoustic isolation system
WO2006044476A2 (en) * 2004-10-12 2006-04-27 Robert Vernon Vanman Method of and system for mobile surveillance and event recording
US20060226289A1 (en) 2005-04-06 2006-10-12 Emiph, Llc Method and apparatus for an adaptive suspension support system
US7703291B2 (en) * 2005-04-15 2010-04-27 March Networks Corporation Contained environmental control system for mobile event data recorder
US8473163B2 (en) * 2007-02-02 2013-06-25 Techno-Sciences, Inc. Method of determining impact severity and adaptive impact attenuation
US8091833B2 (en) * 2008-02-29 2012-01-10 Insitu, Inc. Vibration isolation devices and associated systems and methods
US8829899B2 (en) * 2010-01-15 2014-09-09 Vale S.A. Pneumatic vibration damping apparatus
US8711223B2 (en) * 2011-06-21 2014-04-29 Flir Systems, Inc. Vehicle-mounted camera stabilized passively by vibration isolators
US9051986B2 (en) * 2013-03-15 2015-06-09 Bell Helicopter Textron Inc. Hybrid fluid elastomeric damper
US9348197B2 (en) * 2013-12-24 2016-05-24 Pv Labs Inc. Platform stabilization system
US8972125B1 (en) 2014-01-14 2015-03-03 Caterpillar Inc. Operator induced oscillation filter to prevent instability from operator

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU2010201262A1 (en) * 2009-04-01 2010-10-21 Autogyro Ag Gyroplane
EP2357098A2 (en) * 2010-02-05 2011-08-17 Fox Factory, Inc. Method and apparatus for suspension adjustment
US20120263445A1 (en) * 2011-04-13 2012-10-18 Beasley Ronald L Device for supporting a camera in a helicopter
US20150088378A1 (en) * 2012-03-29 2015-03-26 Toyota Jidosha Kabushiki Kaisha Road surface condition estimating apparatus
US20130277500A1 (en) * 2012-04-19 2013-10-24 Kirk A. Miller Shock-resistant device and method
WO2013192370A2 (en) * 2012-06-21 2013-12-27 Google Inc. Tunable vibration dampers

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109578507A (en) * 2019-01-25 2019-04-05 吉林大学 A kind of main passive absorber of three axis rotation aerial camera

Also Published As

Publication number Publication date
EP3091249B1 (en) 2019-11-06
US20160325848A1 (en) 2016-11-10
US9682786B2 (en) 2017-06-20

Similar Documents

Publication Publication Date Title
US11884385B2 (en) Active vibration control system with non-concentric revolving masses
US10507920B2 (en) Systems and methods for lifting body vibration control
CN103192986B (en) Rotorcraft vibration suppression system in a four corner pylon mount configuration
US3703999A (en) Wide band stabilizer
WO2017179160A1 (en) Unmanned aircraft vibration-damping structure
US9284048B2 (en) Global airframe health characterization
US11060658B2 (en) Gimbal stabilization system and method
EP2639154B1 (en) Dual frequency damper for an aircraft
EP3091249B1 (en) Isolation systems for image data gathering devices
EP3150489A1 (en) Unified control of multiple active systems for helicopter vibration supression
KR101656841B1 (en) An antivibration suspension device for a mechanical element, and an aircraft
CN101809354A (en) Be used to improve the method and apparatus that vibration is isolated
US8888037B2 (en) Antivibration suspension means for a tie bar of an aircraft power transmission gearbox, an antivibration suspension device, and an aircraft
US11548626B2 (en) Tuned mass damper for aircraft
US8740133B2 (en) Aircraft including an engine controlled by synchrophasing
US20160137318A1 (en) Triple flywheel assembly with attitude jitter minimization
US20200262548A1 (en) Low-vibration drone
US9625284B2 (en) Shock mount in environment sensor protector for non-isolated systems
US20180051765A1 (en) Liquid Inertia Vibration Elimination System
EP2610172A1 (en) System and method of tuning a liquid inertia vibration eliminator
Zhu et al. Longitudinal–lateral velocity control design and implementation for a model-scaled unmanned helicopter
Loewen Isolating components from UAV vibration
Semke Vibration reduction for camera systems onboard small unmanned aircraft
Nonnenmacher et al. System architecture of HALAS—a helicopter slung load stabilisation and positioning system
WO2019019397A1 (en) Unmanned aerial vehicle arm assembly, unmanned aerial vehicle frame, and unmanned aerial vehicle

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20170509

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

RIC1 Information provided on ipc code assigned before grant

Ipc: F16F 15/02 20060101AFI20181107BHEP

Ipc: F16F 9/53 20060101ALI20181107BHEP

Ipc: G03B 15/00 20060101ALI20181107BHEP

Ipc: F16F 9/32 20060101ALI20181107BHEP

Ipc: F16F 15/00 20060101ALI20181107BHEP

Ipc: B60G 17/016 20060101ALI20181107BHEP

Ipc: F16F 13/06 20060101ALI20181107BHEP

Ipc: B64D 47/08 20060101ALI20181107BHEP

Ipc: B60R 11/04 20060101ALI20181107BHEP

Ipc: B60G 15/06 20060101ALI20181107BHEP

INTG Intention to grant announced

Effective date: 20181210

GRAJ Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted

Free format text: ORIGINAL CODE: EPIDOSDIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20190516

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

Ref country code: AT

Ref legal event code: REF

Ref document number: 1199137

Country of ref document: AT

Kind code of ref document: T

Effective date: 20191115

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602016023598

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20191106

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191106

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191106

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191106

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191106

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191106

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200206

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200306

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200206

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191106

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200207

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191106

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200306

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191106

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191106

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191106

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191106

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191106

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191106

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191106

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602016023598

Country of ref document: DE

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1199137

Country of ref document: AT

Kind code of ref document: T

Effective date: 20191106

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191106

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191106

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20200807

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191106

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191106

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602016023598

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191106

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200531

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200531

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191106

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20200531

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200506

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200506

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200531

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201201

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191106

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191106

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191106

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191106

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230522

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20230420

Year of fee payment: 8

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20230420

Year of fee payment: 8