EP2993105A3 - Optical route examination system and method - Google Patents

Optical route examination system and method Download PDF

Info

Publication number
EP2993105A3
EP2993105A3 EP15184083.2A EP15184083A EP2993105A3 EP 2993105 A3 EP2993105 A3 EP 2993105A3 EP 15184083 A EP15184083 A EP 15184083A EP 2993105 A3 EP2993105 A3 EP 2993105A3
Authority
EP
European Patent Office
Prior art keywords
vehicle
optical route
examination system
route examination
image data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP15184083.2A
Other languages
German (de)
French (fr)
Other versions
EP2993105A2 (en
EP2993105B1 (en
Inventor
Nidhi Naithani
Dattaraj Jagdish Rao
Scott Daniel Nelson
Nikhil Uday Naphade
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
General Electric Co
Original Assignee
General Electric Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US14/479,847 external-priority patent/US20150269722A1/en
Application filed by General Electric Co filed Critical General Electric Co
Publication of EP2993105A2 publication Critical patent/EP2993105A2/en
Publication of EP2993105A3 publication Critical patent/EP2993105A3/en
Application granted granted Critical
Publication of EP2993105B1 publication Critical patent/EP2993105B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B61RAILWAYS
    • B61LGUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
    • B61L23/00Control, warning or like safety means along the route or between vehicles or trains
    • B61L23/04Control, warning or like safety means along the route or between vehicles or trains for monitoring the mechanical state of the route
    • B61L23/041Obstacle detection
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B61RAILWAYS
    • B61LGUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
    • B61L23/00Control, warning or like safety means along the route or between vehicles or trains
    • B61L23/04Control, warning or like safety means along the route or between vehicles or trains for monitoring the mechanical state of the route
    • B61L23/042Track changes detection
    • B61L23/045Rail wear
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B61RAILWAYS
    • B61LGUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
    • B61L23/00Control, warning or like safety means along the route or between vehicles or trains
    • B61L23/04Control, warning or like safety means along the route or between vehicles or trains for monitoring the mechanical state of the route
    • B61L23/042Track changes detection
    • B61L23/047Track or rail movements
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B61RAILWAYS
    • B61LGUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
    • B61L23/00Control, warning or like safety means along the route or between vehicles or trains
    • B61L23/04Control, warning or like safety means along the route or between vehicles or trains for monitoring the mechanical state of the route
    • B61L23/042Track changes detection
    • B61L23/048Road bed changes, e.g. road bed erosion

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Traffic Control Systems (AREA)
  • Image Analysis (AREA)
  • Train Traffic Observation, Control, And Security (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
  • Image Processing (AREA)

Abstract

Optical route examination systems and methods described herein obtain image data of a field of view (108, 110) of a camera (106; 1606) disposed onboard a first vehicle (102; 1602) as the first vehicle (102; 1602) moves along a first route (120; 1620), and autonomously examine the image data onboard the first vehicle (102) to identify one or more of a feature of interest (200, 202, 204; 500; 804, 806, 808; 1000, 1002, 1004; 1100, 1102, 1104; 1704; 2002, 2006) or a designated object (200, 202, 204; 500; 804, 806, 808; 1000, 1002, 1004; 1100, 1102, 1104; 1704; 2002, 2006).
EP15184083.2A 2014-09-08 2015-09-07 Optical route examination system and method Active EP2993105B1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US14/479,847 US20150269722A1 (en) 2014-03-18 2014-09-08 Optical route examination system and method

Publications (3)

Publication Number Publication Date
EP2993105A2 EP2993105A2 (en) 2016-03-09
EP2993105A3 true EP2993105A3 (en) 2016-07-20
EP2993105B1 EP2993105B1 (en) 2017-11-29

Family

ID=54148336

Family Applications (1)

Application Number Title Priority Date Filing Date
EP15184083.2A Active EP2993105B1 (en) 2014-09-08 2015-09-07 Optical route examination system and method

Country Status (3)

Country Link
EP (1) EP2993105B1 (en)
JP (1) JP6697797B2 (en)
CN (1) CN105398471B (en)

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AT518373B1 (en) * 2016-02-24 2018-05-15 Plasser & Theurer Export Von Bahnbaumaschinen Gmbh Machine with stabilization unit and measuring method
AT518692B1 (en) * 2016-06-13 2019-02-15 Plasser & Theurer Exp Von Bahnbaumaschinen G M B H Method and system for maintaining a track for rail vehicles
CN110062727A (en) * 2016-10-20 2019-07-26 铁路视像有限公司 System and method for object and detection of obstacles and classification in the collision prevention of railway applications
EP3523177A2 (en) * 2016-12-07 2019-08-14 Siemens Mobility GmbH Method, system and track-bound vehicle, in particular rail vehicle, for recognizing obstacles in track-bound traffic, in particular in rail traffic
CN110325425A (en) * 2016-12-07 2019-10-11 西门子交通有限责任公司 For in railway traffic lane identification, method for distinguishing, equipment and rolling stock, especially rail vehicle are known particularly for the rail in rail traffic
CN107010085A (en) * 2017-03-29 2017-08-04 常洋 A kind of railway operation safety environmental monitoring and control system
AR112184A1 (en) * 2017-04-14 2019-10-02 Bayer Cropscience Lp VEGETATION DETECTION AND ALERT SYSTEM FOR A RAILWAY VEHICLE AND METHOD
JP2021511550A (en) * 2018-01-29 2021-05-06 レール ビジョン リミテッドRail Vision Ltd Lightweight and low F-number lens and its manufacturing method
JP7080706B2 (en) * 2018-04-20 2022-06-06 株式会社東芝 Orbit identification device
CN110979399B (en) * 2019-12-27 2021-09-28 郑州铁路职业技术学院 Dynamic detection method for high-speed railway track condition
RU2742960C1 (en) * 2020-09-25 2021-02-12 Акционерное общество "Научно-исследовательский и проектно-конструкторский институт информатизации, автоматизации и связи на железнодорожном транспорте" Onboard information system
GB2611818A (en) * 2021-10-18 2023-04-19 Three Smith Group Ltd Damage detection system
AT525703A1 (en) * 2021-12-01 2023-06-15 Track Machines Connected Ges M B H procedure for localization
CN115402365A (en) * 2022-07-22 2022-11-29 中车山东机车车辆有限公司 Flexible compensation structure of detection device for rail engineering vehicle

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0953491A1 (en) * 1998-04-27 1999-11-03 Azienda Trasporti Milanesi Method and apparatus to monitor anomalies in railway and tramway superstructures
US20070217670A1 (en) * 2006-03-02 2007-09-20 Michael Bar-Am On-train rail track monitoring system
US20120263342A1 (en) * 2011-04-15 2012-10-18 International Business Machines Corporation Method and system of rail component detection using vision technology

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030222981A1 (en) * 2002-06-04 2003-12-04 Kisak Jeffrey James Locomotive wireless video recorder and recording system
US7510142B2 (en) * 2006-02-24 2009-03-31 Stealth Robotics Aerial robot
JP4900810B2 (en) * 2007-03-30 2012-03-21 株式会社京三製作所 Train position detection device and train control device
EP2238758A4 (en) * 2008-01-24 2013-12-18 Micropower Technologies Inc Video delivery systems using wireless cameras
CN101634563A (en) * 2008-07-25 2010-01-27 比亚迪股份有限公司 Method, device and camera for achieving car navigation
DE102011006564A1 (en) * 2011-03-31 2012-10-04 Robert Bosch Gmbh Method for evaluating an image captured by a camera of a vehicle and image processing device
KR101350291B1 (en) * 2012-04-24 2014-01-10 유콘시스템 주식회사 Unmanned aerial vehicle system with cable connection equipment
KR20140017735A (en) * 2012-07-31 2014-02-12 인텔렉추얼디스커버리 주식회사 Wearable electronic device and method for controlling the same
US9308925B2 (en) * 2012-12-02 2016-04-12 General Electric Company System and method for inspection of wayside rail equipment
CN104386092B (en) * 2014-10-21 2017-02-22 卡斯柯信号有限公司 Automatic train protection system and method based on image identification and multi- perception fusion

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0953491A1 (en) * 1998-04-27 1999-11-03 Azienda Trasporti Milanesi Method and apparatus to monitor anomalies in railway and tramway superstructures
US20070217670A1 (en) * 2006-03-02 2007-09-20 Michael Bar-Am On-train rail track monitoring system
US20120263342A1 (en) * 2011-04-15 2012-10-18 International Business Machines Corporation Method and system of rail component detection using vision technology

Also Published As

Publication number Publication date
EP2993105A2 (en) 2016-03-09
JP2016058086A (en) 2016-04-21
EP2993105B1 (en) 2017-11-29
JP6697797B2 (en) 2020-05-27
CN105398471B (en) 2019-02-19
CN105398471A (en) 2016-03-16

Similar Documents

Publication Publication Date Title
EP2993105A3 (en) Optical route examination system and method
EP3391164A4 (en) Systems and methods for taking, processing, retrieving, and displaying images from unmanned aerial vehicles
CL2017000426A1 (en) Agronomic and agricultural monitoring methods using unmanned aerial systems
EP3548353A4 (en) System and method for estimating vehicular motion based on monocular video data
EP3552358A4 (en) Bandwidth constrained image processing for autonomous vehicles
EP3246664A3 (en) Information processing system and information display apparatus
WO2015123034A8 (en) Vehicle imaging system and method
EP3264364A4 (en) Unmanned aerial vehicle depth image acquisition method, device and unmanned aerial vehicle
EP3616020A4 (en) System and method for vehicle position and velocity estimation based on camera and lidar data
SG11202005399WA (en) Image based localization for unmanned aerial vehicles, and associated systems and methods
EP3610459A4 (en) System and apparatus for co-registration and correlation between multi-modal imagery and method for same
EP3101625A3 (en) Method and system of selecting a view from a plurality of cameras
EP3493554A4 (en) Unmanned aerial vehicle detection system and unmanned aerial vehicle detection method
EP4030405A3 (en) Vehicle control device, vehicle control method, information processing apparatus, and traffic information supplying system
WO2014127372A3 (en) Image analysis and measurement of biological samples
EP3367127A4 (en) Unmanned aerial vehicle (uav) and distance measuring and filtering device and method thereof and distance measurement method based on same
EP3188160A3 (en) Methods and apparatus for identifying terrain suitable for aircraft landing
EP3414641A4 (en) System and method for achieving fast and reliable time-to-contact estimation using vision and range sensor data for autonomous navigation
EP2736018A3 (en) Determining pushback direction
EP3538840A4 (en) Method and system for multiple f-number lens
EP3446617A4 (en) Endoscope system, image processing device, and image processing device operation method
EP3541161A4 (en) Stored image reclassification system and re-classification method
EP3432050A4 (en) Display imaging system and method, and vehicle carrying the system
EP3443416A4 (en) System and method for obtaining spherical panorama image
EP2955700A3 (en) Automated emergency response systems for a vehicle

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RIC1 Information provided on ipc code assigned before grant

Ipc: B61L 23/04 20060101AFI20160610BHEP

17P Request for examination filed

Effective date: 20170120

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

INTG Intention to grant announced

Effective date: 20171006

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 950090

Country of ref document: AT

Kind code of ref document: T

Effective date: 20171215

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602015006293

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20171129

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 950090

Country of ref document: AT

Kind code of ref document: T

Effective date: 20171129

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171129

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171129

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180228

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171129

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171129

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171129

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180228

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180301

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171129

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171129

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171129

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171129

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171129

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171129

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171129

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171129

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171129

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602015006293

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171129

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171129

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171129

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171129

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20180830

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171129

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171129

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20180930

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180907

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180907

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180930

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180930

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180930

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180930

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180907

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171129

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171129

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20150907

Ref country code: MK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20171129

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171129

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180329

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20190907

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190907

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20230926

Year of fee payment: 9