EP2652680A1 - Dispositif et procédé destinés à faciliter la réalisation d'une opération de maintenance et/ou de commande - Google Patents

Dispositif et procédé destinés à faciliter la réalisation d'une opération de maintenance et/ou de commande

Info

Publication number
EP2652680A1
EP2652680A1 EP10796006.4A EP10796006A EP2652680A1 EP 2652680 A1 EP2652680 A1 EP 2652680A1 EP 10796006 A EP10796006 A EP 10796006A EP 2652680 A1 EP2652680 A1 EP 2652680A1
Authority
EP
European Patent Office
Prior art keywords
camera
target device
component
maintenance
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP10796006.4A
Other languages
German (de)
English (en)
Inventor
Sascha Skorupa
Martin Schleyer
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Incca GmbH
Original Assignee
Incca GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Incca GmbH filed Critical Incca GmbH
Publication of EP2652680A1 publication Critical patent/EP2652680A1/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/53—Querying
    • G06F16/532—Query formulation, e.g. graphical querying
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/5854—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using shape and object relationship
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/20—Administration of product repair or maintenance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes

Definitions

  • the invention relates to a device for supporting the performance of a maintenance and / or operating procedure on a target device, a method for
  • At least one input device eg. As a keyboard or a touch screen
  • at least one output device for.
  • an LCD screen As an LCD screen.
  • Other facilities such as a speaker, a GPS receiver, etc. may be provided.
  • a current position is detected, for example, using a GPS receiver and the route guidance by means of an output device, such as the display device or a speaker is made.
  • the object is achieved by a device, in particular a smartphone, which has an input device for selecting a maintenance and / or
  • a camera for capturing a plurality of images
  • an analyzing means for analyzing the images and identifying an image of the constituent from the contour data in the images
  • a display device for displaying at least one of the captured images in conjunction with the identification of the marking device.
  • the mentioned target devices may preferably be a motor or an engine compartment.
  • the device according to the invention makes it possible to substantially facilitate maintenance and / or operating processes on these target devices.
  • the user is in particular enabled to find essential components for the maintenance and / or operating processes which are integrally connected to or belong to the target device.
  • an input device for example a touchscreen, a keyboard or any other operating element, is used to control a
  • the readout device determines stored
  • Contour data of the selected or assigned component Thereafter, it is possible for the user to capture images preferably from the target device with the camera, which then in turn can be evaluated by the analysis device.
  • the analysis device makes it possible to identify images of the component in the images on the basis of the contour data.
  • the marking device identifies the identified picture or partial picture of the component.
  • the display device displays at least one of the captured images in which the image of the
  • the user can select the maintenance procedure "oil change" by means of the input device, wherein the device according to the invention the
  • the input device receives an input from the user, it may be configured to receive any data from other devices or programs. This data can for example specify a maintenance and / or operating procedure or a specific component.
  • the device comprises a
  • Position determining device for detecting the orientation of the camera with respect to the target device and optionally the position of the camera with respect to the target device and a normalization device for imaging the images on a, preferably predetermined by the contour data, normalization plane. Since it is at the
  • Target devices and the components are mostly three-dimensional objects, but conventional cameras can only make two-dimensional recordings, it is extremely problematic to quickly identify pictures of the sought ingredient - preferably in real time - within the captured images.
  • the device can therefore have a position-determining device which determines an orientation of the camera and optionally a position thereof relative to the target device.
  • the exact or approximate actual orientation and / or actual positioning MEISSNER BOLTE M / INX-015-PC
  • the captured image data is normalized to lie in a predetermined normalization plane.
  • the recorded images can thus be transformed in such a way that their representation corresponds to a specific orientation or positioning of the camera.
  • this orientation is predetermined on the basis of a normalization plane, for example in conjunction with the contour data. In this respect, it can be assumed that the
  • the navigation device can be designed to set a desired position and / or a desired orientation of the camera (for better detection of the target device,
  • the navigation device can thus help to align the device, in particular the smartphone, in such a way that the camera can capture images containing the component to be found.
  • the smartphone in particular of the smartphone
  • the camera can capture images containing the component to be found.
  • Navigation device automatically aligns the camera accordingly.
  • the apparatus may comprise a storage means for storing the database containing a plurality of components of target devices and associated ones
  • Contour data includes. It is conceivable the necessary data from external
  • the device has a local memory containing necessary data.
  • This data may include the contour data, the normalization level, and / or the target device. It is also conceivable to organize the data hierarchically depending on a selected target device.
  • the device may include a communication device for polling
  • Information in particular additional information and / or contour data, include from a server.
  • the communication device for example, the above contour data, relationships between maintenance or
  • this additional information may be information that relates to the MEISSNER BOLTE M / INX-015-PC
  • the additional information indicates how the selected component is to be handled.
  • the already mentioned position determination device can be used to detect the
  • Tilt sensors or a GPS receiver are provided to detect the actual alignment data and actual position data.
  • the actual alignment data and actual position data of the camera can also be determined by means of image processing steps.
  • the position determination device can be designed to read out contour data of a multiplicity of different components assigned to the target device and to generate actual alignment data and actual position data of the camera on the basis of an alignment of the contour data with the captured images.
  • the device may comprise an additional information device, which
  • mapping of the constituent has been identified by the analyzer. It is thus possible to provide additional information that supplement, for example, the maintenance and / or operation. Specifically, it can be specified how to deal with a particular ingredient that has been detected.
  • the object is achieved by a method for carrying out a maintenance and / or operating procedure on a target device using a smartphone, the method comprising the following steps:
  • FIG. 2 is a rear view of the smartphone of FIG. 1; FIG.
  • FIG. 3 is a schematic representation of a read-out device
  • Navigation device communication device
  • Fig. 1 is displayed; MEISSNER BOLTE M / INX-015-PC
  • Fig. 5 is a schematic illustration of image processing steps performed by the smartphone of Fig. 1;
  • FIG. 6 shows a server for communication with the smartphone from FIG. 1.
  • FIG. 1 shows a smartphone 100 according to the invention in a front view.
  • Smartphone includes an antenna 191, a display device 200 and a
  • Input device 110 which has a plurality of keys 111, 11, by means of which a user can make inputs.
  • the display device 200 serves to output information.
  • the smartphone 100 has a processor 101 for processing programs and a memory device 120.
  • Memory device 120 may be used to program code from
  • the storage device 120 includes data for one
  • Fig. 2 shows a rear view of the smartphone 100 of Fig. 1.
  • the back of the smartphone 100 has a camera 105 for capturing image data Img l.
  • Smartphone 100 of FIG. 2 is oriented such that a schematically illustrated motor 30 can be detected as a target device by means of the camera 105.
  • the engine 30 has an oil filler neck 31 and a closure part 33.
  • an application that prompts the user such as one, runs on the described smartphone 100
  • the application prompts the user to open the hood and point his smartphone 100 at the engine compartment, then the application starts to capture image data Img 1 from the engine compartment, possibly including images of the engine 30 as shown in FIG. MEISSNER BOLTE M / INX-015-PC
  • the recorded image data Img l are displayed directly on the display device 200.
  • Display device 200 According to the invention, the current application recognizes whether or not the image data Imgl includes an image of the shutter member 32, and then designates this image.
  • the figure is characterized in that arrows 201, 20 point to the sought component, namely the closure member 32.
  • the contours of the sought component may be highlighted, for example, by a particular color. Also it would be conceivable, the sought after component
  • the application preferably issues instructions that allow the user to perform the selected maintenance operation. For example, the user may be prompted to unscrew the indicated closure member 32, indicated by arrows 201, 20, and refill oil as needed.
  • the processor 101 of the smartphone 100 implements a plurality of devices, which are shown schematically in FIG. 3
  • a normalization device 170 for normalizing the acquired image data Imgl, a navigation device 180 for finding a suitable orientation of the camera 105 and a communication device 190 may be provided.
  • FIG. 5 illustrates a possible image processing process which is used to identify the sought-after component-in the exemplary embodiment
  • Closing part 32 - passes through the marking device 150.
  • a plurality of image data Img l from the camera 105 is a plurality of image data Img l from the camera 105.
  • contour data Koni are read from the device database 123 via an identification number ID from the read-out device 130.
  • This contour data Koni can be vector data that maps the sought-after component in three-dimensional space with sufficient accuracy.
  • this can also be merely two-dimensional image data which shows the actually three-dimensional object, namely the closure part 32, from a given view in a (normalized) image.
  • the contour data Koni are also processed by the analysis device 140 and compared with the image data Imgl. As soon as the
  • Analyzer 140 within the image data Imgl discovers an image corresponding to the contour data Koni of the searched constituent, corresponding information is output to the identifier 150, which then performs an identification (eg, the label shown in Fig. 4).
  • the contour data Koni are present in two dimensions.
  • the captured image data Img l are using the
  • the normalization device 170 at least roughly knows the orientation and / or the position of the camera 105 with regard to the target device, for example the motor 30.
  • the device database 123 can be used with respect to the
  • Contour data Koni specify a normalization level.
  • Normalization device 170 determines to what extent the actual orientation of camera 105 deviates from a desired orientation of camera 105 and performs suitable transformations so that image data Img 1 can be compared with contour data Koni.
  • the actual orientation of the camera 105 may be adjusted by suitable sensors, e.g. As inclination sensors are detected.
  • suitable sensors e.g. As inclination sensors are detected.
  • the recorded image data Imgl can be used to determine the actual position and / or the actual orientation of the camera 105 in an iterative process.
  • certain color patterns
  • the usual components of an engine compartment are gray or black. Only a few areas differ significantly from these predominantly dark colors.
  • the car battery may be located on one side of the engine compartment while the blue wiper cap is on the other side.
  • the camera 105 detects one or both of these components, it is relatively easy to calculate a position and / or orientation of the camera 105.
  • This position can then be used to process the image data Img l for finding the contour data Koni.
  • this information obtained with respect to the actual position and / or the actual orientation of the camera 105 can be used to indicate to the user instructions on how to align the camera in a suitable manner to the target device - in the embodiment, the motor 30 -. and / or the sought-after component - in the exemplary embodiment, the closure part 32 - to capture.
  • arrows may appear at the edges that instruct the user to move the smartphone 100 to the left, right, up, or down.
  • the camera 105 may detect only the battery.
  • the navigation device 180 knows that the closure part 32 is located to the right of the battery. In this respect, it can output corresponding instructions so that the user moves the smartphone 100 to the right until the image data Imgl contains an image of the closure part 32.
  • corresponding instructions are output via a loudspeaker.
  • Position determining means 160 based on acquired image data coarse actual positions and / or actual orientations of the camera 105 can detect. Furthermore, he knows how the navigation device 180 has to process this data to the MEISSNER BOLTE M / INX-015-PC
  • Detection of the searched component and to select the maintenance and / or operation are necessary stored on the storage device 120.
  • a remote device for example a server 10 (see Fig. 6).
  • This polling operation may be performed by the communication device 190, which establishes a communication link to the server 10.
  • the server 10 has a transmitting / receiving unit.
  • the server has a server database 13, which may have a similar structure to the one
  • Device database 123 of the smartphone 100 is a registered trademark of the smartphone.
  • a smartphone a registered trademark of the smartphone.
  • the smartphone in particular the communication device 190, can interrogate the necessary data interactively from the server 10 and make it easier to find the component with it.
  • a portion of the data is local to the
  • Smartphone 100 saved. Further data, such as additional information Data are queried by the server 10. Preferably, these data can at least temporarily be temporarily stored on the smartphone 100, in particular on the memory device 120.
  • the keys 111, 11 are used to select a maintenance and / or operating procedure and / or a component. Theoretically, this selection could also be made using a touchscreen. Furthermore, this selection can be made by another application.
  • the application described can be designed to find components of the target device independently of a maintenance and / or operating procedure.
  • the user can directly input that he is looking for the closure part 32 of the oil filler neck 31.
  • the target device was a motor or engine compartment. It should be clear that the target device is any technical MEISSNER BOLTE M / INX-015-PC
  • Device such as a table fan, a coffee maker, a bicycle, or a chair can be.
  • a table fan such as a coffee maker, a bicycle, or a chair
  • the most diverse constellations with respect to the sought ingredient are conceivable. This can be, for example, a
  • Switch a screw, a connecting cable, etc. act.
  • Additional Information Data outputs as soon as the sought-after component is found.
  • This additional information can be in any format, eg. As image data, text data, video data, sound data, present and output in a suitable manner.

Abstract

La présente invention concerne un dispositif destiné à faciliter la réalisation d'une opération de maintenance et/ou de commande sur un appareil-cible (30), comprenant : - un appareil de saisie (110) destiné à sélectionner une opération de maintenance et/ou de commande et/ou un élément (32) de l'appareil-cible (30) dans une liste d'opérations de maintenance et/ou de commande et/ou d'éléments (32) stockée dans une base de données (13, 130); - un appareil de lecture (130) destiné à lire des données de contour (Kon1) de l'élément (32) sélectionné ou d'un élément (32) associé à l'opération de maintenance et/ou de commande; - une caméra (105) destinée à acquérir une pluralité d'images (Img1); - un appareil d'analyse (140) destiné à analyser les images (Img1) et à identifier une représentation de l'élément (32) à l'aide des données de contour (Kon1) dans les images (Img1); - un appareil de marquage (150) destiné à marquer la représentation identifiée de l'élément (32); - un appareil d'affichage (200) destiné à afficher au moins l'une des images obtenues en liaison avec le marquage fait par l'appareil de marquage (150). Une idée essentielle de la présente invention réside dans le fait qu'elle facilite considérablement pour l'utilisateur du dispositif la localisation de l'élément sélectionné.
EP10796006.4A 2010-12-13 2010-12-13 Dispositif et procédé destinés à faciliter la réalisation d'une opération de maintenance et/ou de commande Withdrawn EP2652680A1 (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/EP2010/069513 WO2012079617A1 (fr) 2010-12-13 2010-12-13 Dispositif et procédé destinés à faciliter la réalisation d'une opération de maintenance et/ou de commande

Publications (1)

Publication Number Publication Date
EP2652680A1 true EP2652680A1 (fr) 2013-10-23

Family

ID=43532730

Family Applications (1)

Application Number Title Priority Date Filing Date
EP10796006.4A Withdrawn EP2652680A1 (fr) 2010-12-13 2010-12-13 Dispositif et procédé destinés à faciliter la réalisation d'une opération de maintenance et/ou de commande

Country Status (2)

Country Link
EP (1) EP2652680A1 (fr)
WO (1) WO2012079617A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW201439928A (zh) * 2013-04-03 2014-10-16 Lumax Internat Corp Ltd 設備檢修方法及系統

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004042673A2 (fr) * 2002-11-04 2004-05-21 Imperial Vision Ltd. Identification automatique, en temps reel et complete de vehicules
US20050015370A1 (en) * 2003-07-14 2005-01-20 Stavely Donald J. Information management system and method
US20060240862A1 (en) * 2004-02-20 2006-10-26 Hartmut Neven Mobile image-based information retrieval system
US20070071323A1 (en) * 2005-09-26 2007-03-29 Cognisign Llc Apparatus and method for processing user-specified search image points
DE102006059663A1 (de) * 2006-12-18 2008-06-19 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Vorrichtung, Verfahren und Computerprogramm zum Identifizieren eines Verkehrszeichens in einem Bild
US20100086218A1 (en) * 2008-09-24 2010-04-08 Canon Kabushiki Kaisha Position and orientation measurement apparatus and method thereof
US20100241946A1 (en) * 2009-03-19 2010-09-23 Microsoft Corporation Annotating images with instructions
US20100239175A1 (en) * 2000-07-07 2010-09-23 Mitsubushi Denki Kabushiki Kaisha Method and apparatus for representing and searching for an object in an image
US20100260426A1 (en) * 2009-04-14 2010-10-14 Huang Joseph Jyh-Huei Systems and methods for image recognition using mobile devices

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009105559A (ja) * 2007-10-22 2009-05-14 Nec Saitama Ltd 撮影画像からの認識対象検出処理方法およびカメラ付き携帯型電子機器
GB2469860A (en) * 2009-04-30 2010-11-03 Luckybite Llp Apparatus for integrating with a handheld computing device.

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100239175A1 (en) * 2000-07-07 2010-09-23 Mitsubushi Denki Kabushiki Kaisha Method and apparatus for representing and searching for an object in an image
WO2004042673A2 (fr) * 2002-11-04 2004-05-21 Imperial Vision Ltd. Identification automatique, en temps reel et complete de vehicules
US20050015370A1 (en) * 2003-07-14 2005-01-20 Stavely Donald J. Information management system and method
US20060240862A1 (en) * 2004-02-20 2006-10-26 Hartmut Neven Mobile image-based information retrieval system
US20070071323A1 (en) * 2005-09-26 2007-03-29 Cognisign Llc Apparatus and method for processing user-specified search image points
DE102006059663A1 (de) * 2006-12-18 2008-06-19 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Vorrichtung, Verfahren und Computerprogramm zum Identifizieren eines Verkehrszeichens in einem Bild
US20100086218A1 (en) * 2008-09-24 2010-04-08 Canon Kabushiki Kaisha Position and orientation measurement apparatus and method thereof
US20100241946A1 (en) * 2009-03-19 2010-09-23 Microsoft Corporation Annotating images with instructions
US20100260426A1 (en) * 2009-04-14 2010-10-14 Huang Joseph Jyh-Huei Systems and methods for image recognition using mobile devices

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of WO2012079617A1 *

Also Published As

Publication number Publication date
WO2012079617A1 (fr) 2012-06-21

Similar Documents

Publication Publication Date Title
US11321583B2 (en) Image annotating method and electronic device
DE112017006448T5 (de) System und Verfahren zum Anzeigen von interessierenden Objekten an einem Ereignisort
DE102014213553B4 (de) Tracking-Unterstützungsvorrichtung, Tracking-Unterstützungssystem und Tracking-Unterstützungsverfahren
DE102011013760B4 (de) Verfahren, Vorrichtung und Computerprogrammprodukt zur Informationsvermittlung mittels erweiterter Realität im Zusammenhang mit einem Straßenfahrzeug
DE102019132052A1 (de) Intelligente Internet-der-Dinge-Menüs mit Kameras
DE102014213556A1 (de) Tracking-Unterstützungsvorrichtung, Tracking-Unterstützungssystem und Tracking-Unterstützungsverfahren
DE102015108498A1 (de) Bereitstellen einer fahrzeugbenutzerhandbuchinformation unter verwendung einer objekterkennung an einer mobilen einrichtung
DE102014213554A1 (de) Tracking-Unterstützungsvorrichtung, Tracking-Unterstützungssystem und Tracking-Unterstützungsverfahren
DE112011102043T5 (de) Objekterfassungsmetadaten
DE102014220302A1 (de) Echt-Zeit Mehr-Klassen Fahreraktions-Erkennung unter Verwendung eines Random Forest
DE102011085430A1 (de) Signaturbasiertes Auftragsüberwachungssystem und Verfahren für Drive-in-Dienstleistungen
DE102019102866A1 (de) Identifizierung eines Herstellungsteils unter Verwendung von Computervision und Maschinenlernen
DE102019220048A1 (de) Autonomes führen eines fahrzeugs zu einer gewünschten, mit einer fernvorrichtung ausgewählten parkposition
DE202015009148U1 (de) Automatische Bearbeitung von Bildern
DE202015009137U1 (de) Verwenden von Bildmerkmalen zur Extraktion von Ansichtsfenstern aus Bildern
DE102014204320A1 (de) Informationsabfrage durch Zeigen
DE112016001039T5 (de) Vorrichtung und Verfahren zur Extraktion eines interessierenden Bereichs
DE102015223427A1 (de) Vorrichtung und Verfahren zur Visualisierung und Dokumentation von Schäden
EP2813999B1 (fr) Système à réalité augmentée et procédé de production et d'affichage de représentations d'objet à réalité augmentée pour un véhicule
DE102021116356A1 (de) Einstellung von zielen in fahrzeugnavigationssystemen basierend auf bildmetadaten von tragbaren elektronischen vorrichtungen und von aufgenommenen bildern unter verwendung von nullklick-navigation
DE102019100512A1 (de) Selektives Anwenden von Farbe auf ein Bild
DE112011106058T5 (de) Bilderfassung mit virtuellem Verschluss
DE112021001023T5 (de) Datenerfassungssystem, informationsverarbeitungsvorrichtung, informationsverarbeitungsverfahren, programm
EP2652680A1 (fr) Dispositif et procédé destinés à faciliter la réalisation d'une opération de maintenance et/ou de commande
DE102009058142A1 (de) Verfahren, Vorrichtung und Computerprogrammprodukt zum Ausgeben von Bedieninformationen über Objekte eines Fahrzeugs

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20130710

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20140526

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20160419