EP3494048B1 - Véhicule sans pilote - Google Patents

Véhicule sans pilote Download PDF

Info

Publication number
EP3494048B1
EP3494048B1 EP17748795.6A EP17748795A EP3494048B1 EP 3494048 B1 EP3494048 B1 EP 3494048B1 EP 17748795 A EP17748795 A EP 17748795A EP 3494048 B1 EP3494048 B1 EP 3494048B1
Authority
EP
European Patent Office
Prior art keywords
vehicle
head
sensor
vehicle control
stabilisation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP17748795.6A
Other languages
German (de)
English (en)
Other versions
EP3494048A1 (fr
Inventor
Michael Alexander SNOOK
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Blue Bear Systems Research Ltd
Original Assignee
Blue Bear Systems Research Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Blue Bear Systems Research Ltd filed Critical Blue Bear Systems Research Ltd
Publication of EP3494048A1 publication Critical patent/EP3494048A1/fr
Application granted granted Critical
Publication of EP3494048B1 publication Critical patent/EP3494048B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64CAEROPLANES; HELICOPTERS
    • B64C17/00Aircraft stabilisation not otherwise provided for
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/0094Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64CAEROPLANES; HELICOPTERS
    • B64C1/00Fuselages; Constructional features common to fuselages, wings, stabilising surfaces or the like
    • B64C1/28Parts of fuselage relatively movable to improve pilots view
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64UUNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
    • B64U20/00Constructional aspects of UAVs
    • B64U20/80Arrangement of on-board electronics, e.g. avionics systems or wiring
    • B64U20/87Mounting of imaging devices, e.g. mounting of gimbals
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64UUNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
    • B64U10/00Type of UAV
    • B64U10/25Fixed-wing aircraft
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64UUNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
    • B64U2101/00UAVs specially adapted for particular uses or applications
    • B64U2101/30UAVs specially adapted for particular uses or applications for imaging, photography or videography
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B15/00Special procedures for taking photographs; Apparatus therefor
    • G03B15/006Apparatus mounted on flying objects

Definitions

  • Embodiments relate to unmanned vehicles (UVs) such as, for example, unmanned air vehicles (UAVs), unmanned surface vehicles (USVs) and unmanned Ground vehicles (UGVs)
  • UVs unmanned vehicles
  • UAVs unmanned air vehicles
  • USVs unmanned surface vehicles
  • UGVs unmanned Ground vehicles
  • the camera tends to be attached to the tilt drive, with the other rotational axis being parallel to either the UV's roll or yaw axis.
  • the former configuration ensures a consistent aerodynamic profile during operation but is complicated for image orientation.
  • the latter maintains image orientation but at the expense of a physical roll axis due to gimbal size and weight constraints.
  • sensors used during flight have their attitudes changed. Such manoeuvring can adversely affect the readings from those sensors, which may lead to the flight control system operating using anomalous or otherwise noisy or inaccurate data.
  • an airspeed monitoring sensor associated with a pitot that is located on a tail, during a high alpha manoeuvre, or other manoeuvre, that creates turbulent airflow over that pitot, the airspeed sensor will not give an accurate indication of airspeed. Consequently, the flight control system may unnecessarily take action to address any perceived loss or gain of airspeed.
  • embodiments provide a method for controlling a vehicle comprising a body, a neck, a head and a vehicle control system; in which the body comprises vehicle control planes/vehicle control actuators for influencing vehicle movement; the vehicle control actuators being responsive to the vehicle control system, the method comprising measuring, using one or more than one sensor housed within the head, a characteristic associated with the vehicle, the vehicle control system being responsive to the one or more than one sensor, and controlling a first stabilisation mechanism of the neck, using a vehicle stabilisation system responsive to the one or more than one sensor, to maintain a head attitude decoupled from, or independent of, variations in body attitude.
  • Embodiments provide a vehicle comprising a body, a neck, a head and a vehicle control system; in which the body comprises vehicle control planes/vehicle control actuators for influencing vehicle movement; the vehicle control actuators being responsive to the vehicle control system, the head comprises one or more than one sensor for measuring a characteristic associated with the vehicle, the vehicle control system being responsive to the one or more than one sensor, the neck is coupled between the body and the head in which the neck comprises a first stabilisation mechanism arranged, responsive to a vehicle stabilisation system responsive to the one or more than one sensor, to maintain a head attitude decoupled from or independently of variations in body attitude.
  • Figure 1 shows an inertial frame 100.
  • the inertial frame 100 comprises three mutually orthogonal axes 102 to 106; namely, an x-axis 102, a y-axis 104 and a z-axis 106, otherwise known as roll, pitch and yaw axes respectively.
  • Figure 2 depicts view 200 of a pair of UAVs with gimbals.
  • the pair of UAVs comprises a first UAV 202.
  • the first UAV 202 bears a respective gimbal 204.
  • the gimbal 204 can be rotated about a pair of mutually orthogonal axes 206 and 208.
  • a first axis 206 is oriented longitudinally parallel to a roll axis 102 of the first UAV 202.
  • a second axis 208 of the pair of mutually orthogonal axes is oriented parallel to the pitch axis 104 in a plane parallel to the x-y plane.
  • the pair of UAVs comprises a second UAV 210.
  • the second UAV 210 bears a respective gimbal 212.
  • the gimbal 212 can be rotated about a pair of mutually orthogonal axes 214 and 216.
  • a first axis 214 is oriented parallel to a yaw axis 106 of the second UAV 210.
  • a second axis 216 of the pair of mutually orthogonal axes is oriented parallel to the pitch axis 104 and within a plane parallel to the x-y plane.
  • the first 202 and second 210 UAVs potentially suffer from the above problems.
  • FIG. 3 depicts shows a first UAV 300 according to embodiments.
  • the UAV 300 comprises left 302 and right 304 wings disposed either side of a central body 306.
  • the central body 306 also bears a tail 308 as well as left 310 and right 312 ailerons.
  • the UAV 300 has a means of propulsion, which, in the illustrated embodiment, comprises a pair of propellers 314 and 316 driven by respective engines (not shown).
  • the UAV 300 comprises a head 318.
  • the head 318 is stabilised relative to the remainder of the UAV 300.
  • the head 318 can be arranged to maintain a given attitude relative to an external frame of reference 320 notwithstanding changes in the UAV's attitude.
  • Figure 4 schematically illustrates a view 400 of the head 318.
  • a first view 402 depicts the housing for the head 318.
  • An embodiment of the housing comprises left 404 and right 406 face housing portions and a neck housing portion 408.
  • Embodiments can be realised in which the face housing portions 404 and 406 are arranged to bear one or more than one aperture for one or more than one respective sensor (not shown). In the embodiment depicted, three such apertures 410 to 414 are shown. The three apertures 410 to 414 can be arranged to bear vision sensors. In the embodiment illustrated, the three apertures 410 to 414 can be arranged to bear respective cameras. Embodiments can, alternatively or additionally, be arranged to support one or more than one further sensor. In the illustrated embodiment, such a further sensor can comprise an airspeed sensor 416 is also carried by the head 318. The air speed sensor 416 can be realised using a differential air speed sensor and an associated pitot.
  • the head 318 comprises a neck 418 to be housed within the neck housing portion 408.
  • the neck 418 comprises a pedestal 420 mounted on a mount or plate 422.
  • the pedestal 420 is rotatable about a pedestal axis 424.
  • the pedestal 420 is pivotally coupled, via a pedestal link 426 and a rotatable arm 428, to a transducer bearing frame 430.
  • the transducer bearing frame 430 is arranged to carry a respective transducer (431.1 shown in figure 5 ) that drives the rotatable arm 428 to move the head 318 in the xz-plane about a respective axis 432 that is substantially parallel to the xy-plane.
  • Embodiments can be realised in which the transducer 431.1 is a thin profile servo, which is relatively shallow and has a high torque output. It can be appreciated that the pedestal link 426 is coupled to an anchor position on the pedestal 420. Embodiments can be realised in which the anchor is disposed towards the bottom of the pedestal. It will be appreciated that rotation of the rotatable arm 428 moves the transducer bearing frame 430 with respect to the pedestal 420. The pedestal 420 is rotatable about the pedestal axis 424 via a respective transducer (431.4 as shown in figure 5 or 660 as shown in figure 6C ) and associated link such as, for example, link 654.
  • the transducer bearing frame 430 is also arranged to carry one or more further transducers.
  • the transducer bearing frame 430 is arranged to carry two further transducers (431.2 and 431.3 shown in figure 5 ).
  • the transducers 431.2 and 431.3 are think profile servos, which are relatively shallow and that have a high torque output.
  • the two further transducers are coupled, via respective rotatable arms 434 and 436 and respective links 438 and 440 to a roll actuator bearing frame 442.
  • the roll actuator bearing frame 442 carries a roll actuator 443 such as, for example, a low profile servo.
  • the roll actuator 443 is a piezoelectric roll actuator.
  • a first link 438 of the respective links 438 and 440 is arranged to rotate the roll actuator bearing frame 442 about a respective axis 444.
  • the respective axis 444 can be parallel to the z axis 106.
  • a second link 440 of the respective links 438 and 440 is arranged to rotate the roll actuator bearing frame 442 about a respective axis 446.
  • the respective axis can be parallel to the y axis 104.
  • the two axes 432 and 446 are coplanar.
  • the two axes 432 and 446 can be coplanar within a plane parallel to the xy-plane.
  • the roll actuator 443 is arranged to carry a sensor mounting frame 448.
  • the roll actuator 443 is arranged to pivot the sensor mounting frame 448 about a roll actuator axis 450.
  • the sensor mounting frame 448 is arranged to carry one or more than one sensor.
  • the one or more than one sensor can comprise at least one or more of a Global Positioning System (GPS) unit 452, one or a number of vision sensors 454 to 458, an inertial measurement unit (IMU) 460, one or more processors 462 such as, for example, one or more vision processors, an air data sensor 416 such as, for example, a differential air data sensor and a sensor integration board 464 taken jointly and severally in any and all permutations.
  • GPS Global Positioning System
  • IMU inertial measurement unit
  • processors 462 such as, for example, one or more vision processors
  • an air data sensor 416 such as, for example, a differential air data sensor and a sensor integration board 464 taken jointly and severally in any and all per
  • transducers 431.1 to 431.4 are operable cooperatively or in a complementary manner.
  • transducers 431.3 and 431.4 which control movement about respective axes 444 and 424, can be operated in a complementary manner such that rotation about one axis of the axes via one transducer is mirrored by a complementary rotation about the other axis of the axes via the other transducer.
  • the combination of the complementary rotations results in a linear translation of the head to the left or right.
  • the complementary rotations can also maintain the head orientation in a given direction notwithstanding the rotations.
  • transducers 431.1 and 431.2 which control movement about respective axes 432 and 446, can be operated in a complementary manner such that rotation about one axis of the axes via one transducer is mirrored by a complementary rotation about the other axis of the axes via the other transducer.
  • the combination of the complementary rotations results in a linear translation of the head upwards or downwards.
  • the complementary rotations can also maintain the head orientation in a given direction notwithstanding the rotations. Therefore, linear translations can be realised using the respective combinations of the transducers 431.1 to 431.4.
  • Such linear translations can be orthogonal linear translations.
  • FIG 5 there is shown a schematic view 500 of the neck 418.
  • Common references numerals used in figures 4 and 5 refer to the same entities.
  • the neck 602 can be an embodiment of any other neck described herein or as shown in or described with reference to figure 4 .
  • the neck 602 comprises a pedestal 604 mounted on a mount or plate 606.
  • the pedestal 604 is rotatable about a pedestal axis 608.
  • the pedestal 604 is pivotally coupled, via a pedestal link 610 and a rotatable arm 612, to a transducer bearing frame 614.
  • the transducer mounting frame 614 is arranged to carry a respective transducer (431.1 shown in figure 5 ) that drives the rotatable arm 612 to move the head 318 in the xz-plane about a respective axis 616 that is parallel to the xy-plane.
  • a respective transducer 431.1 shown in figure 5
  • the pedestal link 610 is coupled to the bottom of the pedestal such that rotation of the rotatable arm 612 moves the transducer bearing frame 614 with respect to the pedestal 604.
  • the transducer bearing frame 614 is also arranged to carry one or more further transducers.
  • the transducer bearing frame 614 is arranged to carry two further transducers 431.2 and 431.3 shown in figure 5 .
  • the two further transducers 431.2 and 431.3 are coupled, via respective rotatable arms 618 and 620 and respective links 622 and 624 to a roll actuator bearing frame 626.
  • the roll actuator bearing frame 626 carries a roll actuator 627.
  • the roll actuator 627 is a piezoelectric roll actuator.
  • a first link 622 of the respective links 622 and 624 is arranged to rotate the roll actuator bearing frame 626 about a respective axis 628.
  • the respective axis 628 can be parallel to the z axis 106.
  • a second link 624 of the respective links 622 and 624 is arranged to rotate the roll actuator bearing frame 626 about a respective axis 630.
  • the respective axis 630 can be parallel to the y axis 104. In the embodiment illustrated the two axes 616 and 630 can be coplanar within a plane parallel to the xy-plane.
  • the roll actuator 627 is arranged to carry a sensor mounting frame 632.
  • the roll actuator 627 is arranged to pivot the sensor mounting frame 632 about a roll actuator axis 634.
  • the sensor mounting frame 632 is arranged to carry one or more than one sensor.
  • the one or more than one sensor can comprise at least one or more of a GPS unit 636, one or a number of vision sensors 638 to 642, an inertial measurement unit 644, one or more processors 646 such as, for example, one or more vision processors, an air data sensor and pitot 648 such as, for example, a differential air data sensor and a sensor integration board 650 taken jointly and severally in any and all permutations.
  • embodiments are provided with a further link 654 that is driven by a respective rotatable arm 656 to rotate the pedestal 604 about the axis 608 by rotation of the rotatable arm 656 about a respective axis 658 via a respective transducer 660.
  • FIG. 7A and 7B there are shown views 700 of a further embodiment of a head 702.
  • the head 702 comprises at least one or more than one of the above described sensors contained within the head housing 704. Smaller sensors are used within the head 702 to allow the head housing 704 to have a smaller form factor.
  • the head 702 bears a number of external sensors.
  • the external sensors comprise at least one or more than one of a vision sensor 706, or other electromagnetic wave sensors, and an air speed sensor and pitot 708.
  • Embodiments can be realised in which a pair of vision sensors, or other electromagnetic wave sensors, are used.
  • the pair of sensors can have at least one or more than one of overlapping fields of view or non-overlapping fields of view and variable fields of view.
  • the head 702 comprises a neck 710.
  • the neck 710 comprises a plurality of transducers.
  • two transducers 712 and 714 are provided.
  • the transducers 712 and 714 can be mounted such that their respective outputs are orthogonal to one another.
  • the transducers 712 to 714 drive respective arms 716 and 718.
  • the arms 716 and 718 are coupled via respective connectors 720 and 722 to respective link arms 724 and 726.
  • the link arms 724 and 726 form part of respective t-pieces 728 and 730.
  • the t-pieces 728 and 730 can be rotated about respective axes 732 and 734 in response to rotation of the arms 716 and 718.
  • the t-pieces 728 and 730 can be realised as assemblies, as shown in figure 7A and 7B , or as unitary structures, as depicted in figure 8 .
  • the t-pieces 728 and 730 are connected to respective links. It can be appreciated that a first t-piece 728 is connected to respective links 736 and 738. The links 736 and 738, in response to rotation of the first t-piece 728, control or at least influence rotation of the head within a respective plane.
  • the respective plane can be a plane that is parallel to the xy-plane.
  • a second t-piece 730 is connected to respective links 740 and 742.
  • the links 740 and 742 in response to rotation of the second t-piece 730, control or at least influence rotation of the head within a respective plane.
  • the respective plane can be a plane that is parallel to the xz-plane.
  • the links 736, 738, 740, 742 are coupled to respective anchor points 744 to 750 on respective mounting plates 752 and 754.
  • the ends of the links 736 to 742 distal to the anchor points are coupled to the respective t-pieces via hook and eye arrangements, with the links bearing the hooks and the t-pieces having the eyes.
  • the mounting plates 752 and 754 are flexibly coupled, via respective flexible couples 756 and 758, to a transducer bearing frame 760 for carrying the above transducers 712 and 714.
  • the couples 756 and 758 have predetermined degrees of freedom such as, for example, two degrees of freedom.
  • the two degrees of freedom can comprise pan and tilt.
  • Embodiments can additionally, or alternatively, restrict or otherwise not provide one or more than one selected degree of freedom such as, for example, a roll. Therefore, embodiments can be realised in which couples 756 and 758 provide pan and tilt but not roll. Embodiments can be realised in which the flexible couples 756 and 758 can be realised via elastically deformable members such as, for example, elongate rubber members or a joint assembly. Embodiments can be realised in which the links 736 to 742 and anchor points 744 to 750 are realised using ball and socket arrangements. Embodiments can be realised in which anchor points or anchor joints can be elastically deformable members.
  • the links 736 to 742 can be adjustable to vary or set a characteristic of the links 736 to 742. Such as characteristic can comprise, for example, the length of a link. The adjustments can be used to bias the head towards or into a predetermined position or attitude.
  • Figure 8 depicts a schematic view 800 of the neck 702 of figures 7A and 7B .
  • Reference numerals common to figures 7A and 7B and figure 8 refer to the same elements.
  • Figures 9A to 9F illustrate views 900 a head and neck assembly according to an embodiment.
  • Reference numerals common to figures 7A and 7B and figure 9 refer to the same elements.
  • FIG 10 shows an underside view 1000 of a UAV 1002 according to the embodiments.
  • the UAV 10002 comprises a head 1004.
  • the UAV 1002 and head 1004 can be a UAV or head as described above, or in this specification.
  • the head 1004 is shown as being directed leftward. At least one of position and movement of the head 1004 influences the operation or attitude of the UAV, that is, head 1004 is operable as a control surface such that orienting the head 1004 in a given direction steers or otherwise urges the UAV 1002 in that direction.
  • FIGS 11A to 11B illustrate views 1100 of an assembled head 1102 according to embodiments.
  • the head carries one or more than one sensor.
  • the sensors can comprise flight control sensors such as, for example, a global positioning system sensor 1104 (GPS) for generating GPS data such as, for example, GPS position data, a sensor integration board 1106, an air speed or air flow sensor 1108, one or more than one vision sensor 1110, 1112, a processor board 1114 bearing one or more than one processor, an IMU 1116, a pitot 1107 an associated with the air speed sensor 1108 that uses differential pressures taken from conduits of the pitot 1107.
  • GPS global positioning system sensor 1104
  • IMU 1116 IMU 1116
  • pitot 1107 an associated with the air speed sensor 1108 that uses differential pressures taken from conduits of the pitot 1107.
  • An elastically deformable chord 1118 is coupled between the head and a chord anchor such as, for example, a mounting plate 1120, to bias the head towards or into a predetermined position.
  • a chord anchor such as, for example, a mounting plate 1120
  • the predetermined position is a straight-forward position in which the longitudinal axis of the head is collinear with, or parallel to, the x axis of the UAV.
  • Figure 12 depicts a view 1200 of a sensor integration board 1202 according to embodiments.
  • the sensor integration board 1202 can be an embodiment of any sensor board described in this specification such as, for example, sensor integration board 1106.
  • the sensor integration board 1202 is operatively coupled to, or otherwise interacts with, a plurality of sensors.
  • the plurality of sensors can comprise at least one or more than one of the above described GPS sensor 1104, the pitot 1107, the air speed or air flow sensor 1108, the one or more than one vision sensor 1110, 1112, the processor board 1114 bearing the one or more than one processor, and the IMU 1116.
  • the one or more than one processor can be arranged to process image data derived from the vision sensors 1110 and 1112.
  • Embodiments can also provide an optical sensor 1214 such as, for example, a high acuity sensor.
  • the sensor integration board 1202 is arranged to process data associated with the at least one or more than one sensor.
  • the sensor integration board comprises a processor 1204 arranged to process the data 1206 associated with the at least one or more than one sensor.
  • the data 1206 comprises attitude data derived from, or associated with, the IMU 1116.
  • the processor 1204 and sensor integration board 1202 are embodiments of a vehicle stabilization system that is arranged to control the transducers in the neck to maintain a target or desired head attitude.
  • the target or desired head attitude can be maintained in a manner that is decoupled from, or notwithstanding, variations in the vehicle's body attitude.
  • the sensor integration board is arranged to forward data associated with, or directed to, the vehicle's flight controller 1212 for use in controlling the operation of the vehicle.
  • attitude data 1206 will vary as the vehicle manoeuvres.
  • vehicle manoeuvres that induce vibrations can adversely affect the data output by the IMU 1116.
  • an initial bias or setting of the IMU gyroscopes or accelerometers might be adversely affect by temperature and/or mechanical stress on the system.
  • IMU sensors such as, for example, gyroscopes or accelerometers, can be subject to a change in bias stemming from how one or more than on sensors of the IMU sensors experiences acceleration.
  • Such a change in bias can occur, for example, is a Micro Electro Mechanical System (MEMS) gyroscope experiences acceleration in the direction of the gyroscope axis.
  • the at least one or more than one processor, or a separate processor such as, for example, a sensor integration board processor 1204, is arranged to process the attitude data 1206 to determine whether or not, and, if so, what, control signals 1208 could be output to the various transducers associated with the above necks to change the attitude of the head relative to the body to maintain the head in, or substantially in, a stable position relative to an external or world coordinate system.
  • the attitude data derived from the IMU 1116 is used to maintain a constant or substantially constant head attitude notwithstanding changes in the overall attitude of the vehicle.
  • flight controller or flight control system and vehicle stabilisation system have been described distinctly, embodiments can be realised in which the flight control system and the vehicle stabilisation system are realised using the same hardware and software, that is, they can be realised as distinct, separate, entities or realised using common entities.
  • control signals 1208 are arranged to implement complementary or inverse operations to those changes or variations sensed by the IMU 1116.
  • Embodiments can be realised in which the data associated with the IMU 1116 carried by the head is used in conjunction with data associated with a further IMU (not shown) carried by the body.
  • the data from the two IMUs could be processed by the processor 1206 to produce suitable control signals 1208 for use in maintaining head attitude.
  • one or more than one embodiment described herein can use sensors carried by the vehicle body for a predetermined or respective flight envelope for flight control and sensors carried by the stabilised head for a further flight envelope that involves more extreme angles and/or manoeuvring rates.
  • the weight or influence given by the flight controller 1212 to data produced by one or more than one body based sensor and one or more than one stabilised sensor can be arranged to vary with variations in at least one or more than one of vehicle attitude, demand, manoeuvring rates and neck position taken jointly and severally in any and all combinations.
  • Embodiments can use Pulse Width Modulation (PWM) signals as control signals for controlling the transducers.
  • PWM Pulse Width Modulation
  • maintaining head attitude comprises maintaining a predetermined or target head attitude or maintaining a predetermined or target head attitude to within predetermined tolerances.
  • the control signals 1208 are distributed to the various transducers using a servo distribution board 1210.
  • Figure 13 depicts a view 1300 of first 1302 and second 1304 flowcharts.
  • the first flowchart is associated with the operation of the IMU or IMUs, in the case where multiple IMUs are used.
  • the IMU 1116 is initialized at 1306.
  • the IMU 1116 is arranged to generate and output IMU data associated with the attitude of a respective head.
  • the IMU data 1206 is output to the processor 1204.
  • the processor 1204 receives the IMU data at 1310 and generates, at 1312, control signals, or data from which such control signals can be derived, for controlling the transducers to maintain head attitude.
  • the IMU data can be produced by a single IMU such as the above described IMU 1116, or the IMU data can be produced by multiple IMUs such as, for example, one carried by the head and one carried by the body.
  • the processing depicted in the flowcharts can be realised using associated software or hardware, or a combination of software or hardware.
  • Software is an embodiment of machine readable/executable instruction.
  • the flow charts of figure 13 are embodiments of measuring, using one or more than one sensor housed within a head, a characteristic associated with the vehicle.
  • outputting control signals, or data from which such control signals can be derived, for controlling the transducers to maintain head attitude is an embodiment of controlling a first stabilization mechanism of the neck, using the vehicle control system, to maintain a head attitude.
  • Such maintaining a head attitude can be decoupled from, or be realised independently of, variations in body attitude.
  • Figure 14 is a block diagram illustrating components able to read instructions from a machine-readable or computer-readable medium (e.g., a machine-readable storage medium) and perform any one or more of the methodologies discussed herein.
  • figure 14 shows a diagrammatic representation of hardware resources 1400 including one or more processors (or processor cores) 1410, one or more memory/storage devices 1420, and one or more communication resources 1430, each of which are communicatively coupled via a bus 1440 that can be used to realise for example, the sensor integration board or flight control system.
  • hardware resources 1400 including one or more processors (or processor cores) 1410, one or more memory/storage devices 1420, and one or more communication resources 1430, each of which are communicatively coupled via a bus 1440 that can be used to realise for example, the sensor integration board or flight control system.
  • the processors 1410 may include, for example, a processor 1412 and a processor 1414.
  • the memory/storage devices 1420 may include main memory, disk storage, or any suitable combination thereof.
  • the communication resources 1430 may include interconnection and/or network interface components or other suitable devices to communicate with one or more peripheral devices 1404 and/or one or more databases 1406 via a network 1408.
  • the communication resources 1430 may include wired communication components (e.g., for coupling via a Universal Serial Bus (USB)), cellular communication components, Near Field Communication (NFC) components, Bluetooth® components (e.g., Bluetooth® Low Energy), Wi-Fi® components, and other communication components.
  • wired communication components e.g., for coupling via a Universal Serial Bus (USB)
  • cellular communication components e.g., for coupling via a Universal Serial Bus (USB)
  • NFC Near Field Communication
  • Bluetooth® components e.g., Bluetooth® Low Energy
  • Wi-Fi® components e.g., Wi-Fi® components
  • Instructions 1450 may comprise software, a program, an application, an applet, an app, or other executable code for causing at least any of the processors 1410 to perform any one or more of the methodologies discussed herein.
  • the instructions 1450 may reside, completely or partially, within at least one of the processors 1410 (e.g., within the processor's cache memory), the memory/storage devices 1420, or any suitable combination thereof.
  • any portion of the instructions 1450 may be transferred to the hardware resources 1400 from any combination of the peripheral devices 1404 and/or the databases 1406. Accordingly, the memory of processors 1410, the memory/storage devices 1420, the peripheral devices 1404, and the databases 1406 are examples of computer-readable and machine-readable media.

Landscapes

  • Engineering & Computer Science (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Mechanical Engineering (AREA)
  • Remote Sensing (AREA)
  • Microelectronics & Electronic Packaging (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Toys (AREA)
  • Motorcycle And Bicycle Frame (AREA)

Claims (15)

  1. Procédé de commande d'un véhicule comprenant un corps, un col, une tête (318) et un système de commande de véhicule ; ledit corps comprenant des plans de commande de véhicule/actionneurs de commande de véhicule pour influencer le mouvement du véhicule ; les actionneurs de commande de véhicule étant sensibles au système de commande de véhicule, le procédé comprenant
    a. la mesure, à l'aide d'un ou plusieurs capteurs logés dans la tête, d'une caractéristique associée au véhicule, le système de commande du véhicule étant sensible auxdits un ou plusieurs capteurs, et
    b. la commande d'un premier mécanisme de stabilisation du col (418), à l'aide d'un système de stabilisation de véhicule sensible auxdits un ou plusieurs capteurs, pour maintenir une attitude de tête découplée ou indépendante des variations d'attitude du corps.
  2. Procédé selon la revendication 1, ladite commande dudit premier mécanisme de stabilisation comprenant la fourniture d'au moins trois degrés de liberté.
  3. Procédé selon la revendication 2, dans lequel lesdits au moins trois degrés de liberté comprennent au moins une translation linéaire.
  4. Procédé selon l'une quelconque des revendications précédentes, dans lequel le col comprend un second mécanisme de stabilisation couplé en série au premier mécanisme de stabilisation entre la tête et le corps, et ledit procédé comprenant en outre l'actionnement, à l'aide du système de commande de véhicule, des premier et second mécanismes de stabilisation d'au moins une manière parmi une manière complémentaire ou une manière coopérative.
  5. Procédé selon l'une quelconque des revendications précédentes, comprenant l'actionnement, en réponse au système de commande de véhicule, du mécanisme de stabilisation d'une manière complémentaire/opposée par rapport aux variations d'attitude du corps.
  6. Procédé selon l'une quelconque des revendications précédentes, dans lequel la mesure, à l'aide d'un ou plusieurs capteurs, d'une caractéristique associée au véhicule comprend au moins une détermination parmi
    a. la détermination, à l'aide d'un capteur GPS, de données de position GPS,
    b. la détermination, à l'aide d'un capteur de vitesse, de données de vitesse (vitesse aérodynamique, vitesse au sol),
    c. la détermination, à l'aide d'une unité de mesure inertielle, de données de mesure inertielle, et/ou
    d. la détermination, à l'aide d'un capteur basé sur la vision, de l'état par rapport à l'environnement.
  7. Procédé selon la revendication 6, lesdits un ou plusieurs capteurs étant le capteur GPS; le capteur GPS ayant un champ de vision dans lequel un ou plusieurs signaux GPS peuvent être reçus pour déterminer des données de position GPS, le procédé comprenant le contrôle de la direction du champ de vision.
  8. Procédé selon la revendication 7, comprenant la commande de la direction du champ de vision pour maintenir la réception d'un nombre prédéterminé de signaux GPS ou le déplacement de la tête dans l'attitude de la tête à partir d'une attitude courante (regard) avant de maintenir la tête dans l'attitude de tête.
  9. Programme exécutable par machine comprenant des instructions conçues, lorsqu'elles sont exécutées, pour mettre en œuvre un procédé selon l'une quelconque des revendications précédentes.
  10. Véhicule comprenant un corps, un col (418), une tête (318) et un système de commande de véhicule ; dans lequel le corps comprend des plans de commande de véhicule/actionneurs de commande de véhicule pour influencer le mouvement du véhicule; les actionneurs de commande de véhicule étant sensibles au système de commande de véhicule, la tête comprend un ou plusieurs capteurs pour mesurer une caractéristique associée au véhicule, le système de commande de véhicule étant sensible à un ou plusieurs capteurs, le col (418) est couplé entre le corps et la tête dans lequel le col comprend un premier mécanisme de stabilisation conçu, en réponse à un système de stabilisation de véhicule sensible à un ou plusieurs capteurs, pour maintenir une attitude de tête découplée ou indépendamment des variations de l'attitude du corps.
  11. Véhicule selon la revendication 10, dans lequel les premiers mécanismes de stabilisation sont conçus pour fournir au moins trois degrés de liberté, comprenant un ou plusieurs parmi le pivotement, l'inclinaison et le roulis.
  12. Véhicule selon la revendication 11, dans lequel lesdits au moins trois degrés de liberté comprennent au moins une translation linéaire, et ladite au moins une translation linéaire comprenant deux translations linéaires orthogonales.
  13. Véhicule selon l'une quelconque des revendications 10 à 12, dans lequel le col comprend un second mécanisme de stabilisation couplé en série au premier mécanisme de stabilisation entre la tête et le corps, et ledit système de commande du véhicule étant conçu pour actionner les premier et second mécanismes de stabilisation d'au moins une manière parmi une manière complémentaire ou une manière coopérative.
  14. Véhicule selon la revendication 13, dans lequel le système de commande de véhicule est conçu pour actionner les premier et second mécanismes de stabilisation d'une manière complémentaire pour réaliser au moins l'une parmi une première translation linéaire et une seconde translation linéaire ou de manière coopérative pour réaliser au moins l'un d'un pivotement, d'une inclinaison et d'un roulis.
  15. Véhicule selon l'une quelconque des revendications 10 à 14, dans lequel le système de commande du véhicule est conçu pour actionner le mécanisme de stabilisation d'une manière complémentaire/opposée par rapport à des variations d'attitude du corps.
EP17748795.6A 2016-08-05 2017-08-07 Véhicule sans pilote Active EP3494048B1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB1613503.0A GB2552936B (en) 2016-08-05 2016-08-05 Unmanned vehicle with a stabilised head
PCT/EP2017/069964 WO2018024915A1 (fr) 2016-08-05 2017-08-07 Véhicule sans pilote

Publications (2)

Publication Number Publication Date
EP3494048A1 EP3494048A1 (fr) 2019-06-12
EP3494048B1 true EP3494048B1 (fr) 2020-09-23

Family

ID=59523161

Family Applications (1)

Application Number Title Priority Date Filing Date
EP17748795.6A Active EP3494048B1 (fr) 2016-08-05 2017-08-07 Véhicule sans pilote

Country Status (3)

Country Link
EP (1) EP3494048B1 (fr)
GB (1) GB2552936B (fr)
WO (1) WO2018024915A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108725743B (zh) * 2018-06-14 2023-07-14 中国水利水电科学研究院 一种仰首式手抛小型固定翼无人机机身

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR1401997A (fr) * 1964-04-06 1965-06-11 Aviation Louis Breguet Sa Perfectionnements apportés aux avions rapides
US3433439A (en) * 1967-05-22 1969-03-18 Boeing Co Sectional articulated fuselage forebody for high-speed aircraft
GB2161774B (en) * 1983-07-15 1987-03-11 Flight Refueling Ltd An aircraft and a system including aircraft borne apparatus
US6129308A (en) * 1998-09-21 2000-10-10 Northrop Grumman Corporation Delta-shaped aircraft with variable camber fuselage and wing
US7000883B2 (en) * 2003-01-17 2006-02-21 The Insitu Group, Inc. Method and apparatus for stabilizing payloads, including airborne cameras
GB0310324D0 (en) * 2003-05-03 2003-06-11 Morgans Simon C The independently moveable aircraft nose driven by pumps/motors connected to its steering
US20140231578A1 (en) * 2012-06-19 2014-08-21 Bae Systems Information And Electronic Systems Integration Inc. Stabilized uav platform with fused ir and visible imagery
CN205186550U (zh) * 2015-12-11 2016-04-27 深圳市科卫泰实业发展有限公司 三轴自稳云台装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Also Published As

Publication number Publication date
GB2552936B (en) 2019-04-17
WO2018024915A1 (fr) 2018-02-08
GB2552936A (en) 2018-02-21
EP3494048A1 (fr) 2019-06-12

Similar Documents

Publication Publication Date Title
CN112020465B (zh) 用于飞行器的推力分配
EP3529683B1 (fr) Multicoptères à vecteur poussée
US10281930B2 (en) Gimbaled universal drone controller
CN107531325B (zh) 无人飞行器
JP7374517B2 (ja) 衝突耐性のある推進力およびコントローラを備えた無人航空機
Fuller et al. Controlling free flight of a robotic fly using an onboard vision sensor inspired by insect ocelli
JP6409503B2 (ja) 観測装置
US20220137643A1 (en) Aircraft control method and aircraft
US11060658B2 (en) Gimbal stabilization system and method
CN104335128B (zh) 用于用侧风和加速度计偏差估计和补偿来控制多旋翼的旋翼无人机的方法
US11809203B2 (en) Method and computer program for controlling tilt angle of main rotor on basis of pitch attitude control signal low-speed flight state, and vertical take-off and landing aircraft
US20070030174A1 (en) Heading reference command and control algorithm and cueing systems and methods for aircraft turn-to-target maneuvers
US11958604B2 (en) Unmanned aerial vehicle and method for controlling gimbal thereof
JP6536043B2 (ja) 飛行体
US20170147007A1 (en) Tether orientation sensor for controlling the position of a tethered aircraft
WO2019016930A1 (fr) Dispositif de traitement de données, dispositif de commande d'entraînement, corps mobile, procédé de traitement de données, procédé de commande d'entraînement et support de stockage
CN110377058B (zh) 一种飞行器的偏航角修正方法、装置及飞行器
JP6536042B2 (ja) 飛行体
EP3494048B1 (fr) Véhicule sans pilote
KR20230133301A (ko) 페이로드 안정화를 위한 시스템 및 방법
KR20150107662A (ko) 모듈화된 쿼드 로터 제어 시스템 및 그의 제어 방법
Zhu et al. Longitudinal–lateral velocity control design and implementation for a model-scaled unmanned helicopter
US20190193840A1 (en) Optimally Stabilized Multi Rotor Aircraft
Nonnenmacher et al. System architecture of HALAS—a helicopter slung load stabilisation and positioning system
US12125395B2 (en) Navigation devices

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20190305

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20200422

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602017024186

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1316163

Country of ref document: AT

Kind code of ref document: T

Effective date: 20201015

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201224

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201223

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200923

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200923

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200923

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201223

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1316163

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200923

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200923

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200923

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20200923

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200923

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200923

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210125

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200923

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200923

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200923

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200923

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210123

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200923

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200923

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200923

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602017024186

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200923

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200923

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200923

26N No opposition filed

Effective date: 20210624

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200923

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200923

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20210831

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210831

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210831

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210807

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210807

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210831

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200923

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200923

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20170807

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200923

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200923

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20240604

Year of fee payment: 8

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200923

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240814

Year of fee payment: 8

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20240813

Year of fee payment: 8