EP2804164B1 - Method for control device and control device with recognition of environment and RFID sensor - Google Patents
Method for control device and control device with recognition of environment and RFID sensor Download PDFInfo
- Publication number
- EP2804164B1 EP2804164B1 EP13167617.3A EP13167617A EP2804164B1 EP 2804164 B1 EP2804164 B1 EP 2804164B1 EP 13167617 A EP13167617 A EP 13167617A EP 2804164 B1 EP2804164 B1 EP 2804164B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- recognised
- detected
- rfid signals
- assigned
- control device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Not-in-force
Links
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
- G08C17/00—Arrangements for transmitting signals characterised by the use of a wireless electrical link
-
- G—PHYSICS
- G08—SIGNALLING
- G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
- G08C2201/00—Transmission systems of control signals via wireless link
- G08C2201/30—User interface
-
- G—PHYSICS
- G08—SIGNALLING
- G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
- G08C2201/00—Transmission systems of control signals via wireless link
- G08C2201/70—Device selection
-
- G—PHYSICS
- G08—SIGNALLING
- G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
- G08C2201/00—Transmission systems of control signals via wireless link
- G08C2201/90—Additional features
- G08C2201/91—Remote control based on location and proximity
Definitions
- the present invention relates to a method of operating a hand-held device.
- the corresponding hand-held device is permanently programmed, i. Actuators and display elements of the hand-held device are certain functions (referred to in their entirety as a menu) permanently assigned.
- Such handheld devices can be formed, for example, wired.
- the handheld device can be specified as to which functionalities are to be assigned to the actuating elements and display elements of the handheld device.
- a hand-held device in which an image is detected by means of an image sensor arranged on the hand-held device and the detected image is compared with machine environments to be detected.
- the operating elements and display elements of the hand-held device are assigned a menu associated with the recognized machine environment. Otherwise, no menu is assigned to the operating elements and display elements of the hand-held device.
- EP 1 744 290 A2 is an operating method for a control unit for devices used in households - for example television and video equipment - is known in which an image is detected by means of an operating handset image sensor and RFID signals are detected by means arranged on the control handset RFID sensor. That covered Image is compared with images to be recognized. A1-ternatively or additionally, the detected RFID signals are compared with RFID signals to be detected. On the basis of the recognized images and signals, devices are determined which can be operated by a user of the hand-held device. These devices are offered to the user for selection.
- an operating method for a hand-held device in which an image is detected by means of an image sensor arranged on the hand-held unit.
- the captured image is compared with images to be recognized.
- the detected images are used to determine devices that a user of the handheld device can operate on. These devices are offered to the user for selection.
- the object of the present invention is to provide means by which it can be ensured in a safe and reliable manner that the above-mentioned safety regulations are met.
- Image recognition software is now very powerful. By way of example, reference is made to a face recognition on a smartphone (Samsung S3) and Microsoft Kinect. With such image recognition software can be on the basis of the captured image, the actual machine environment in which the handset is located, even if the image sensor is part of the control unit. For safety reasons, however, the assignment of the menu to the actuators and display elements of the hand-held device does not take place exclusively on the basis of the recognized machine environment. Rather, there is an additional comparison with the RFID signals. This combination results in a two-channel detection and detection of the actual machine environment and therefore meets the safety requirements.
- image and, to a greater extent, the term “RFID signals” are above and are also used below in the generic sense. So it does not matter if a single image is captured at a given time or if multiple images are captured. In an analogous manner, it does not matter whether at a certain time a single RFID signal is detected or whether multiple RFID signals are detected.
- the captured image may be determined as needed. Preferably, it is a depth image.
- Depth images are known per se.
- a depth image is a two-dimensionally spatially resolved image in which the individual picture elements of the depth image-optionally in addition to their image data value-are assigned a depth value which is characteristic of a distance from the image sensor system assigned to the respective picture element.
- the detection of such depth images is known to those skilled in the art.
- the image sensor can several comprise individual image sensors which detect the detected scene from different viewing directions.
- a suitable light source to project a stripe pattern (or another pattern) in the space detected by the image sensor system and to determine the respective distance on the basis of distortions of the pattern in the depth image captured by the image sensor system.
- the captured image and the detected RFID signals are transmitted from the control unit to a higher-level device and evaluated there.
- descriptions of the machine environments to be recognized and the RFID signals to be detected are stored in the control handset.
- the captured image It is possible first to evaluate the captured image and only then to compare the detected RFID signals with the associated RFID signals to be detected. Preferably, however, first the detected RFID signals are compared with the RFID signals to be detected, then, in the case of the coincidence of the detected RFID signals with RFID signals to be detected, a machine environment assigned to the matching RFID signals is preselected and finally becomes the captured image compared solely with the preselected machine environment. This procedure leads to an accelerated evaluation, because the comparison of the detected RFID signals is much easier to accomplish than the evaluation of the captured image.
- the possible menus are already stored in advance in the control unit and will later be assigned only to the actuators and display elements. Preferably, however, the menu is loaded only after the determination of the detected machine environment in the control pendant.
- the operating method according to the invention is carried out continuously. This leads in particular to the (desired) result that in the case that a previously given No longer exists, the previously valid menu is deactivated immediately.
- a corresponding message is preferably output via the display elements of the hand-held device.
- visible machine elements can preferably be moved in the recognized machine environment. Preferably, even only these machine elements are movable, so no other machine elements.
- An image sensor 2 is arranged on a control hand device, generally designated by the reference numeral 1.
- the image sensor 2 is detected at detection times - for example, every second - each (at least) an image B.
- the image sensor 2 is designed such that the captured image B is at least two-dimensionally spatially resolved.
- the captured image B is a depth image. In this case, the captured image B is even three-dimensionally spatially resolved.
- an RFID sensor 3 is further arranged.
- the RFID sensor 3 may be designed as a pure receiver.
- a signal emitted by an RFID transmitter 4 is received by means of the RFID sensor 3.
- the RFID sensor 3 may be formed as a combination of a transmitter with a receiver.
- a signal reflected by an RFID transponder 5 is received.
- the RFID transmitter 4 and the RFID transponder 5 are arranged at suitable locations of the corresponding machines.
- actuators 6 and display elements 7 are further arranged.
- Information can be output to a user 8 of the hand-held device 1 via the display elements 7 (for example, a display, number displays and / or illuminated buttons).
- the user 8 commands the handset 1 commands.
- the functionalities assigned to the actuators 6 are determined dynamically. Depending on the state of the hand-held device 1, a specific operating element 6 is thus assigned a first function, a second function and so on. Under certain circumstances, no function can be assigned to a specific actuating element 6.
- About the display elements 7 is displayed in each case whether and, if appropriate, which function is assigned to a particular control element 6 at a particular time in each case.
- the entirety of the functions assigned to the operating elements 6 at a specific time and the associated displays of the display elements 7 are referred to below as a menu.
- the assignment of the respective menu is, as is apparent from the above statements, dynamically in dependence on the captured image B and the detected RFID signals S.
- a program 9 is deposited.
- the program 9 comprises machine code 10, which can be executed directly by a processor 11 of the operator's handset 1.
- the program 9 is processed by the processor 11.
- the processor 11 controls the remaining components of the hand-held device 1, in particular the image sensor 2, the RFID sensor 3, actuators 6 and the display elements 7.
- the capture of the images B and the detection of the RFID signals S thus occur under execution of the program 9.
- the assignment of the functions to the actuators 6 and the associated control of the display elements 7 is carried out under execution of the program 9 and the corresponding control of the processor 11th
- the control pendant 1 is according to FIG. 2 being able to communicate with a controller 12 for a first machine 13.
- the control pendant 1 is according to FIG. 3 Furthermore, it is able to communicate with a control device 14 for a second machine 15.
- a control device 14 for a second machine 15.
- more than two control devices 12, 14 may be present, with which the control unit 1 can communicate.
- Descriptions of machine environments B 'to be recognized are defined. The descriptions can be of any nature. It can be two- or three-dimensional images or other descriptions.
- the machine environments B 'to be recognized are also assigned RFID signals S' to be recognized.
- the RFID signals S 'to be recognized are generally stored together with the descriptions of the machine environments B' to be recognized.
- the descriptions of the machine environments B 'to be recognized and the associated RFID signals S' to be recognized are as shown in FIG FIG. 1 stored in the control unit 1.
- the storage of the machine environments B 'to be detected and the RFID signals S' to be recognized can be effected, for example, in advance once by means of a line-less or line-connected connection to a server 16. A wireless communication is preferred.
- the machine environments B 'to be recognized are also assigned menus M'. It is possible that the menus M 'together are stored with the descriptions of the machine environments to be recognized B 'and the associated RFID signals to be recognized S', so for example also in the hand-held device 1. Preferably, however, the menus M 'are stored outside of the control unit 1, for example in the server 16 and / or in the control devices 12, 14. The communication with the server 16 or the control devices 12, 14 may alternatively be conducted or non-conducted.
- the hand-held device 1 operates in accordance with FIG. 4 as follows:
- an image B is acquired by means of the image sensor 2 in a step S1. Furthermore, RFID signals S are detected as part of step S1.
- a step S2 the captured image B and the detected RFID signals S are evaluated.
- the captured image is compared with machine environments B 'to be detected.
- the detected RFID signals S are compared with RFID signals S 'to be detected, which are assigned to the machine environments B' to be recognized.
- a step S3 it is checked whether the acquired image B coincides with one of the machine environments B 'to be detected and whether in addition the detected RFID signals S coincide with those RFID signals S' associated with the detected machine environment B '. If the test of step S3 is positive, the operating elements 6 and the display elements 7 of the control pendant 1 are assigned in a step S4 that menu M 'which is assigned to the recognized machine environment B'. If, on the other hand, the test of step S3 is negative, the operating elements 6 and display elements 7 of the handheld operating device 1 are not assigned a menu in a step S5. The validity of a previously assigned menu M 'is terminated, the corresponding assignment thus canceled. Preferably, in this case over the display elements 7 of the control panel 1 a corresponding message is issued. For example, a notification of the content can be displayed via a display that none of the machine environments B 'to be recognized has been detected.
- the machine environments B 'to be recognized and the RFID signals S' to be detected are preferably stored within the operator's handset device 1.
- the corresponding comparisons of step S3 are carried out within the hand-held device 1. In this case, they continue to be carried out (of course) during the execution of the program 9.
- the captured image B and the detected RFID signals S are sent to a corresponding evaluation device.
- the aforementioned server 16 transmitted and evaluated there.
- step S1 is thus returned.
- step S6 it is preferably checked in a step S6 whether the assignment of the menu M 'has changed or not. Only in the case of a change does the (new) assignment of the corresponding menu M 'take place. Otherwise, since the assignment of the corresponding menu M 'already exists, no action is required.
- Step S3 of FIG. 4 and 5 is preferably as shown in FIG FIG. 6 implemented as follows:
- step S5 is entered. If there is a match, the machine environment B 'to be recognized is preselected in a step S12, which is assigned to the recognized (ie matching) RFID signals S'. Then, in a step S13, the captured image B with the preselected machine environment B '- and only this machine environment B' - compared. If there is no match, step S5 is entered. If there is a match, the process goes to step S4 (or to step S6).
- the machine environments B 'to be recognized and the RFID signals S' to be detected are preferably stored in the hand-held device 1, they are preferably not the associated menus M '.
- the corresponding menu M ' is only loaded at one time by the server 16 or by the respective control device 12, 14 into the control pendant 1, to which step S3 has already been executed, the determination of the recognized machine environment B 'So already finished.
- the menus M ' are adapted to the respective machine environment B' to be recognized.
- the menus M ' may in particular be determined such that - see FIG. 2 and 3 -
- the actuators 6 respectively associated menu M 'in the detected machine environment B' visible machine elements 17 are movable.
- other functions may be implemented that are not associated with mechanical movements. As far as the mechanical method of machine elements 17 is concerned, however, preferably only the machine elements 17 visible in the recognized machine environment are movable.
- the present invention has many advantages.
- a secure and unambiguous recognition of the respective machine environment B 'in addition to assigned, reliable assignment of the corresponding menus M' is possible.
- the procedure according to the invention can be further extended by a user-related identification.
- the user 8 can additionally enter a code, even carry an RFID transmitter 4 or RFID transponder 5 or actuate a key switch on the hand-held device 1.
- the respective menu M ' may be user-specific in addition to the assignment to the respective machine environment B'.
- the actions triggered by the actuators 6 actions can be security relevant. It may therefore be necessary to design certain components of the hand-held device 1-for example the processor 11, the design of the actuating elements 6 or, for example, the image sensor 2 and / or the RFID sensor 3-redundantly in the sense of fault tolerance. Whether and, if so, which elements must be designed to be fail-safe can be decided as required. Redundant, fail-safe designs of devices and components are well known to those skilled in the art, so it may be waived by appropriate embodiments.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Selective Calling Equipment (AREA)
- User Interface Of Digital Computer (AREA)
Description
Die vorliegende Erfindung betrifft ein Betriebsverfahren für ein Bedienhandgerät.The present invention relates to a method of operating a hand-held device.
Bedienhandgeräte zur Bedienung von Maschinen sind allgemein bekannt.Handheld devices for operating machines are well known.
Im einfachsten Fall ist das entsprechende Bedienhandgerät fest programmiert, d.h. Betätigungselementen und Anzeigeelementen des Bedienhandgeräts sind bestimmte Funktionalitäten (in ihrer Gesamtheit als Menü bezeichnet) fest zugeordnet. Derartige Bedienhandgeräte können beispielsweise leitungsgebunden ausgebildet sein. In anderen Fällen kann dem Bedienhandgerät in Abhängigkeit von einer direkten oder indirekten Vorgabe eines Benutzers vorgegeben werden, welche Funktionalitäten den Betätigungselementen und Anzeigeelementen des Bedienhandgeräts zugeordnet werden sollen.In the simplest case, the corresponding hand-held device is permanently programmed, i. Actuators and display elements of the hand-held device are certain functions (referred to in their entirety as a menu) permanently assigned. Such handheld devices can be formed, for example, wired. In other cases, depending on a direct or indirect specification of a user, the handheld device can be specified as to which functionalities are to be assigned to the actuating elements and display elements of the handheld device.
Aus der
Aus der
Aus der
Bei der Steuerung industrieller Maschinen und Anlagen sind in erheblichem Umfang sicherheitsrelevante Vorschriften zu beachten. So dürfen beispielsweise mittels eines Bedienhandgeräts nur Bewegungen ausgeführt werden, die vom Bediener des Bedienhandgeräts einsehbar sind. Dies gilt ganz besonders bei reduzierter Sicherheit wie beispielsweise geöffneten beweglichen Schutzeinrichtungen.In the control of industrial machines and systems, safety-relevant regulations must be observed to a considerable extent. For example, only movements that can be viewed by the operator of the hand-held device may be carried out by means of a hand-held device. This is especially true at reduced safety such as open movable guards.
Die Aufgabe der vorliegenden Erfindung besteht darin, Möglichkeiten zu schaffen, mittels derer auf sichere und zuverlässige Weise gewährleistet werden kann, dass die oben genannten Sicherheitsvorschriften eingehalten werden.The object of the present invention is to provide means by which it can be ensured in a safe and reliable manner that the above-mentioned safety regulations are met.
Die Aufgabe wird durch ein Betriebsverfahren mit den Merkmalen des Anspruchs 1 gelöst. Vorteilhafte Ausgestaltungen des erfindungsgemäßen Betriebsverfahrens sind Gegenstand der abhängigen Ansprüche 2 bis 9.The object is achieved by an operating method with the features of
Erfindungsgemäß wird ein Betriebsverfahren für ein Bedienhandgerät geschaffen,
- bei dem mittels einer am Bedienhandgerät angeordneten Bildsensorik ein Bild erfasst wird und mittels einer am Bedienhandgerät angeordneten RFID-Sensorik RFID-Signale erfasst werden,
- bei dem das erfasste Bild mit zu erkennenden Maschinenumgebungen verglichen wird und die erfassten RFID-Signale mit den zu erkennenden Maschinenumgebungen zugeordneten zu erkennenden RFID-Signalen verglichen werden,
- bei dem in dem Fall, dass das erfasste Bild mit einer der zu erkennenden Maschinenumgebungen übereinstimmt und die erfassten RFID-Signale mit den der erkannten Maschinenumgebung zugeordneten zu erkennenden RFID-Signalen übereinstimmen, Betätigungselementen und Anzeigeelementen des Bedienhandgeräts ein der erkannten Maschinenumgebung zugeordnetes Menü zugeordnet wird und
- bei dem in den Fällen,
- -- dass das erfasste Bild mit keiner der zu erkennenden Maschinenumgebungen übereinstimmt,
- -- dass keine RFID-Signale erfasst werden und
- -- dass die erfassten RFID-Signale nicht mit den der erkannten Maschinenumgebung zugeordneten zu erkennenden RFID-Signalen übereinstimmen,
- in which an image is detected by means of an image sensor device arranged on the handheld device and RFID signals are detected by means of an RFID sensor system arranged on the handheld device,
- in which the captured image is compared with machine environments to be detected, and the detected RFID signals are compared with the RFID signals to be detected associated with the machine environments to be detected,
- in which, in the event that the captured image coincides with one of the machine environments to be detected and the detected RFID signals match the RFID signals associated with the detected machine environment, operating and display elements of the operator's handset are assigned a menu associated with the recognized machine environment;
- where in the cases
- - that the captured image does not match any of the machine environments to be detected,
- - that no RFID signals are detected and
- the detected RFID signals do not correspond to the RFID signals to be detected assigned to the recognized machine environment,
Bilderkennungssoftware ist inzwischen sehr leistungsfähig. Rein beispielhaft wird auf eine Gesichtserkennung bei einem Smartphone (Samsung S3) und auf Microsoft Kinect verwiesen. Mit derartiger Bilderkennungssoftware lässt sich anhand des erfassten Bildes die tatsächliche Maschinenumgebung, in welcher sich das Bedienhandgerät befindet, auch dann erkennen, wenn die Bildsensorik Bestandteil des Bedienhandgeräts ist. Aus Sicherheitsgründen erfolgt die Zuordnung des Menüs zu den Betätigungselementen und Anzeigeelementen des Bedienhandgeräts jedoch nicht ausschließlich anhand der erkannten Maschinenumgebung. Vielmehr erfolgt ein zusätzlicher Abgleich mit den RFID-Signalen. Diese Kombination stellt im Ergebnis eine Zweikanaligkeit bei der Erfassung und Ermittlung der tatsächlichen Maschinenumgebung dar und erfüllt daher die Sicherheitsvorschriften.Image recognition software is now very powerful. By way of example, reference is made to a face recognition on a smartphone (Samsung S3) and Microsoft Kinect. With such image recognition software can be on the basis of the captured image, the actual machine environment in which the handset is located, even if the image sensor is part of the control unit. For safety reasons, however, the assignment of the menu to the actuators and display elements of the hand-held device does not take place exclusively on the basis of the recognized machine environment. Rather, there is an additional comparison with the RFID signals. This combination results in a two-channel detection and detection of the actual machine environment and therefore meets the safety requirements.
Der Begriff "Bild" und in noch stärkerem Maße der Begriff "RFID-Signale" sind obenstehend und werden auch nachfolgend im generischen Sinne verwendet. Es kommt also nicht darauf an, ob zu einem bestimmten Zeitpunkt ein einzelnes Bild erfasst wird oder ob mehrere Bilder erfasst werden. In analoger Weise kommt es nicht darauf an, ob zu einem bestimmten Zeitpunkt ein einzelnes RFID-Signal erfasst wird oder ob mehrere RFID-Signale erfasst werden.The term "image" and, to a greater extent, the term "RFID signals" are above and are also used below in the generic sense. So it does not matter if a single image is captured at a given time or if multiple images are captured. In an analogous manner, it does not matter whether at a certain time a single RFID signal is detected or whether multiple RFID signals are detected.
Das erfasste Bild kann nach Bedarf bestimmt sein. Vorzugsweise handelt es sich um ein Tiefenbild. Tiefenbilder sind als solche an sich bekannt. Ein Tiefenbild ist, wie Fachleuten bekannt ist, ein zweidimensional ortsaufgelöstes Bild, bei welchem den einzelnen Bildelementen des Tiefenbildes - gegebenenfalls zusätzlich zu ihrem Bilddatenwert - ein Tiefenwert zugeordnet ist, der charakteristisch für einen dem jeweiligen Bildelement zugeordneten Abstand von der Bildsensorik ist. Die Erfassung derartiger Tiefenbilder ist Fachleuten als solche bekannt. Beispielsweise kann die Bildsensorik mehrere einzelne Bildsensoren umfassen, welche die erfasste Szene aus verschiedenen Blickrichtungen erfassen. Alternativ ist es beispielsweise möglich, mittels einer geeigneten Leuchtquelle ein Streifenmuster (oder ein anderes Muster) in den von der Bildsensorik erfassten Raum zu projizieren und anhand von Verzerrungen des Musters in dem von der Bildsensorik erfassten Tiefenbild den jeweiligen Abstand zu ermitteln.The captured image may be determined as needed. Preferably, it is a depth image. Depth images are known per se. As is known to those skilled in the art, a depth image is a two-dimensionally spatially resolved image in which the individual picture elements of the depth image-optionally in addition to their image data value-are assigned a depth value which is characteristic of a distance from the image sensor system assigned to the respective picture element. The detection of such depth images is known to those skilled in the art. For example, the image sensor can several comprise individual image sensors which detect the detected scene from different viewing directions. Alternatively, it is possible, for example, by means of a suitable light source to project a stripe pattern (or another pattern) in the space detected by the image sensor system and to determine the respective distance on the basis of distortions of the pattern in the depth image captured by the image sensor system.
Es ist möglich, dass das erfasste Bild und die erfassten RFID-Signale vom Bedienhandgerät an eine übergeordnete Einrichtung übermittelt werden und dort ausgewertet werden. Vorzugsweise jedoch sind Beschreibungen der zu erkennenden Maschinenumgebungen und die zu erkennenden RFID-Signale im Bedienhandgerät gespeichert.It is possible that the captured image and the detected RFID signals are transmitted from the control unit to a higher-level device and evaluated there. Preferably, however, descriptions of the machine environments to be recognized and the RFID signals to be detected are stored in the control handset.
Es ist möglich, zuerst das erfasste Bild auszuwerten und erst danach die erfassten RFID-Signale mit den zugehörigen zu erkennenden RFID-Signalen zu vergleichen. Vorzugsweise jedoch werden zuerst die erfassten RFID-Signale mit den zu erkennenden RFID-Signalen verglichen, wird sodann im Falle der Übereinstimmung der erfassten RFID-Signale mit zu erkennenden RFID-Signalen eine den übereinstimmenden RFID-Signalen zugeordnete zu erkennende Maschinenumgebung vorselektiert und wird schließlich das erfasste Bild ausschließlich mit der vorselektierten Maschinenumgebung verglichen. Diese Vorgehensweise führt zu einer beschleunigten Auswertung, weil der Vergleich der erfassten RFID-Signale erheblich einfacher zu bewerkstelligen ist als die Auswertung des erfassten Bildes.It is possible first to evaluate the captured image and only then to compare the detected RFID signals with the associated RFID signals to be detected. Preferably, however, first the detected RFID signals are compared with the RFID signals to be detected, then, in the case of the coincidence of the detected RFID signals with RFID signals to be detected, a machine environment assigned to the matching RFID signals is preselected and finally becomes the captured image compared solely with the preselected machine environment. This procedure leads to an accelerated evaluation, because the comparison of the detected RFID signals is much easier to accomplish than the evaluation of the captured image.
Es ist möglich, dass die möglichen Menüs bereits vorab im Bedienhandgerät gespeichert sind und später nur noch den Betätigungselementen und Anzeigeelementen zugeordnet werden. Vorzugsweise jedoch wird das Menü erst nach der Ermittlung der erkannten Maschinenumgebung in das Bedienhandgerät geladen.It is possible that the possible menus are already stored in advance in the control unit and will later be assigned only to the actuators and display elements. Preferably, however, the menu is loaded only after the determination of the detected machine environment in the control pendant.
Vorzugsweise wird das erfindungsgemäße Betriebsverfahren kontinuierlich ausgeführt. Dies führt insbesondere zu dem (erwünschten) Ergebnis, dass in dem Fall, dass eine zuvor gegebene Übereinstimmung nicht mehr länger besteht, das zuvor gültige Menü unverzüglich deaktiviert wird.Preferably, the operating method according to the invention is carried out continuously. This leads in particular to the (desired) result that in the case that a previously given No longer exists, the previously valid menu is deactivated immediately.
In dem Fall, dass den Betätigungselementen und Anzeigeelementen des Bedienhandgeräts kein Menü zugeordnet wird, wird über die Anzeigeelemente des Bedienhandgeräts vorzugsweise eine entsprechende Meldung ausgegeben. Dadurch ist für den Benutzer des Bedienhandgeräts sofort erkennbar, dass er momentan das Bedienhandgerät nicht zur Steuerung der Maschine verwenden kann. Die (fehlerhafte) Vermutung, das Bedienhandgerät sei defekt, wird dadurch vermieden.In the event that no menu is assigned to the operating elements and display elements of the hand-held device, a corresponding message is preferably output via the display elements of the hand-held device. As a result, it is immediately apparent to the user of the hand-held device that he can not currently use the hand-held device to control the machine. The (erroneous) assumption that the control unit is defective, is thereby avoided.
Mittels des den Betätigungselementen zugeordneten Menüs sind vorzugsweise in der erkannten Maschinenumgebung sichtbare Maschinenelemente verfahrbar. Vorzugsweise sind sogar ausschließlich diese Maschinenelemente verfahrbar, also keine anderen Maschinenelemente.By means of the menus associated with the actuators, visible machine elements can preferably be moved in the recognized machine environment. Preferably, even only these machine elements are movable, so no other machine elements.
Die Aufgabe wird weiterhin durch ein Bedienhandgerät mit den Merkmalen des Anspruchs 10 gelöst. Eine vorteilhafte Ausgestaltung des erfindungsgemäßen Bedienhandgeräts ist Gegenstand des abhängigen Anspruchs 11. Die entsprechenden Ausgestaltungen korrespondieren im wesentlichen mit denen des Betriebsverfahrens.The object is further achieved by a control unit with the features of
Die oben beschriebenen Eigenschaften, Merkmale und Vorteile dieser Erfindung sowie die Art und Weise, wie diese erreicht werden, werden klarer und deutlicher verständlich im Zusammenhang mit der folgenden Beschreibung der Ausführungsbeispiele, die in Verbindung mit den Zeichnungen näher erläutert werden. Hierbei zeigen in schematischer Darstellung:
- FIG 1
- ein Bedienhandgerät,
- FIG 2
und 3 - das Bedienhandgerät von
FIG 1 in einer ersten bzw. einer zweiten Maschinenumgebung und - FIG 4
bis 6 - Ablaufdiagramme.
- FIG. 1
- a hand-held device,
- FIGS. 2 and 3
- the control unit of
FIG. 1 in a first and a second machine environment and - FIGS. 4 to 6
- Flowcharts.
Gemäß
An dem Bedienhandgerät 1 ist weiterhin eine RFID-Sensorik 3 angeordnet. Mittels der RFID-Sensorik 3 werden in enger zeitlicher Kopplung zu den Erfassungszeitpunkten (d.h. entweder gleichzeitig oder unmittelbar zuvor oder unmittelbar danach) RFID-Signale S erfasst. Die RFID-Sensorik 3 kann als reiner Empfänger ausgebildet sein. Im diesem Fall wird mittels der RFID-Sensorik 3 ein von einem RFID-Sender 4 ausgesendetes Signal empfangen. Diese Situation ist - rein beispielhaft - in
An dem Bedienhandgerät 1 sind weiterhin Betätigungselemente 6 und Anzeigeelemente 7 angeordnet. Über die Anzeigeelemente 7 (beispielsweise ein Display, Zahlenanzeigen und/oder beleuchtete Tasten) können Informationen an einen Benutzer 8 des Bedienhandgeräts 1 ausgegeben werden. Über die Betätigungselemente 6 kann der Benutzer 8 dem Bedienhandgerät 1 Befehle vorgegeben. Die den Betätigungselementen 6 zugeordneten Funktionalitäten werden dynamisch bestimmt. Je nach Zustand des Bedienhandgeräts 1 ist einem bestimmten Betätigungselement 6 also eine erste Funktion, eine zweite Funktion usw. zugeordnet. Unter Umständen kann einem bestimmten Betätigungselement 6 auch keine Funktion zugeordnet sein. Über die Anzeigeelemente 7 wird jeweils angezeigt, ob und gegebenenfalls welche Funktion einem bestimmten Bedienelement 6 zu einem bestimmten Zeitpunkt jeweils zugeordnet ist. Die Gesamtheit der den Bedienelementen 6 zu einem bestimmten Zeitpunkt zugeordneten Funktionen und die zugehörigen Anzeigen der Anzeigeelemente 7 werden nachfolgend als Menü bezeichnet. Die Zuordnung des jeweiligen Menüs ist, wie sich aus den vorstehenden Ausführungen ergibt, dynamisch in Abhängigkeit von dem erfassten Bild B und den erfassten RFID-Signalen S.On the
Im Bedienhandgerät 1 ist ein Programm 9 hinterlegt. Das Programm 9 umfasst Maschinencode 10, der von einem Prozessor 11 des Bedienhandgeräts 1 unmittelbar ausführbar ist. Das Programm 9 wird von dem Prozessor 11 abgearbeitet. Unter Abarbeitung des Programms 9 steuert der Prozessor 11 die übrigen Komponenten des Bedienhandgeräts 1, besondere die Bildsensorik 2, die RFID-Sensorik 3, Betätigungselemente 6 und die Anzeigeelemente 7. Insbesondere die Erfassung der Bilder B und die Erfassung der RFID-Signale S erfolgen somit unter Abarbeitung des Programms 9. Auch die Zuordnung der Funktionen zu den Betätigungselementen 6 und die zugehörige Ansteuerung der Anzeigeelemente 7 erfolgt unter Abarbeitung des Programms 9 und die entsprechende Steuerung des Prozessors 11.In
Das Bedienhandgerät 1 ist gemäß
Es sind Beschreibungen von zu erkennenden Maschinenumgebungen B' definiert. Die Beschreibungen können beliebiger Natur sein. Es kann sich um zwei- oder dreidimensionale Bilder oder andersartige Beschreibungen handeln. Den zu erkennenden Maschinenumgebungen B' sind weiterhin zu erkennende RFID-Signale S' zugeordnet. Die zu erkennenden RFID-Signale S' sind in der Regel zusammen mit den Beschreibungen der zu erkennenden Maschinenumgebungen B' gespeichert. Vorzugsweise sind die Beschreibungen der zu erkennenden Maschinenumgebungen B' und die zugeordneten zu erkennenden RFID-Signale S' entsprechend der Darstellung von
Den zu erkennenden Maschinenumgebungen B' sind weiterhin Menüs M' zugeordnet. Es ist möglich, dass die Menüs M' zusammen mit den Beschreibungen der zu erkennenden Maschinenumgebungen B' und der zugeordneten zu erkennenden RFID-Signale S' gespeichert sind, also beispielsweise ebenfalls im Bedienhandgerät 1. Vorzugsweise sind jedoch die Menüs M' außerhalb des Bedienhandgeräts 1 gespeichert, beispielsweise in dem Server 16 und/oder in den Steuereinrichtungen 12, 14. Die Kommunikation mit dem Server 16 bzw. den Steuereinrichtungen 12, 14 kann alternativ leitungsgebunden oder leitungslos sein.The machine environments B 'to be recognized are also assigned menus M'. It is possible that the menus M 'together are stored with the descriptions of the machine environments to be recognized B 'and the associated RFID signals to be recognized S', so for example also in the hand-held
Das erfindungsgemäße Bedienhandgerät 1 arbeitet gemäß
Zu einem bestimmten Erfassungszeitpunkt wird mittels der Bildsensorik 2 in einem Schritt S1 ein Bild B erfasst. Weiterhin werden im Rahmen des Schrittes S1 RFID-Signale S erfasst.At a certain detection time, an image B is acquired by means of the
In einem Schritt S2 werden das erfasste Bild B und die erfassten RFID-Signale S ausgewertet. Insbesondere wird das erfasste Bild mit zu erkennenden Maschinenumgebungen B' verglichen. Weiterhin werden die erfassten RFID-Signale S mit zu erkennenden RFID-Signalen S' verglichen, die den zu erkennenden Maschinenumgebungen B' zugeordnet sind.In a step S2, the captured image B and the detected RFID signals S are evaluated. In particular, the captured image is compared with machine environments B 'to be detected. Furthermore, the detected RFID signals S are compared with RFID signals S 'to be detected, which are assigned to the machine environments B' to be recognized.
In einem Schritt S3 wird geprüft, ob das erfasste Bild B mit einer der zu erkennenden Maschinenumgebungen B' übereinstimmt und ob zusätzlich die erfassten RFID Signale S mit denjenigen RFID-Signalen S' übereinstimmen, die der erkannten Maschinenumgebung B' zugeordnet sind. Wenn die Prüfung des Schrittes S3 positiv verläuft, wird den Betätigungselementen 6 und den Anzeigeelementen 7 des Bedienhandgerätes 1 in einem Schritt S4 dasjenige Menü M' zugeordnet, das der erkannten Maschinenumgebung B' zugeordnet ist. Wenn die Prüfung des Schrittes S3 hingegen negativ verläuft, wird den Betätigungselementen 6 und Anzeigeelementen 7 des Bedienhandgeräts 1 in einem Schritt S5 kein Menü zugeordnet. Die Gültigkeit eines zuvor zugeordneten Menüs M' wird beendet, die entsprechende Zuordnung also aufgehoben. Vorzugsweise wird in diesem Fall über die Anzeigeelemente 7 des Bedienhandgeräts 1 eine entsprechende Meldung ausgegeben wird. Beispielsweise kann über ein Display eine Meldung des Inhalts angezeigt werden, dass keine der zu erkennenden Maschinenumgebungen B' erkannt wurde.In a step S3, it is checked whether the acquired image B coincides with one of the machine environments B 'to be detected and whether in addition the detected RFID signals S coincide with those RFID signals S' associated with the detected machine environment B '. If the test of step S3 is positive, the
Die zu erkennenden Maschinenumgebungen B' und die zu erkennenden RFID-Signale S' sind vorzugsweise innerhalb des Bedienhandgeräts 1 gespeichert. In diesem Fall erfolgen die entsprechenden Vergleiche des Schrittes S3 innerhalb des Bedienhandgeräts 1. Sie erfolgen in diesem Fall weiterhin (selbstverständlich) im Rahmen der Abarbeitung des Programms 9. Anderenfalls werden das erfasste Bild B und die erfassten RFID-Signale S an eine entsprechende Auswertungseinrichtung, beispielsweise den bereits erwähnten Server 16, übermittelt und dort ausgewertet.The machine environments B 'to be recognized and the RFID signals S' to be detected are preferably stored within the operator's
Die Vorgehensweise von
Der Schritt S3 der
Zuerst werden die erfassten RFID-Signale S in einem Schritt S11 mit den zu erkennenden RFID-Signalen S' verglichen. Ergibt sich hier keine Übereinstimmung, wird zum Schritt S5 übergegangen. Ergibt sich eine Übereinstimmung, wird in einem Schritt S12 diejenige zu erkennende Maschinenumgebung B' vorselektiert, die den erkannten (d.h. übereinstimmenden) RFID-Signalen S' zugeordnet ist. Sodann wird in einem Schritt S13 das erfasste Bild B mit der vorselektierten Maschinenumgebung B' - und nur dieser Maschinenumgebung B' - verglichen. Ergibt sich hier keine Übereinstimmung, wird zum Schritt S5 übergegangen. Ergibt sich eine Übereinstimmung, wird zum Schritt S4 (bzw. zum Schritt S6) übergegangen.First, the detected RFID signals S are compared with the RFID signals S 'to be detected in a step S11. If there is no match, step S5 is entered. If there is a match, the machine environment B 'to be recognized is preselected in a step S12, which is assigned to the recognized (ie matching) RFID signals S'. Then, in a step S13, the captured image B with the preselected machine environment B '- and only this machine environment B' - compared. If there is no match, step S5 is entered. If there is a match, the process goes to step S4 (or to step S6).
Wie bereits erwähnt, sind vorzugsweise zwar die zu erkennenden Maschinenumgebungen B' und die zu erkennenden RFID-Signale S' im Bedienhandgerät 1 gespeichert, nicht aber die zugehörigen Menüs M'. Vorzugsweise wird daher im Rahmen des Schrittes S4 das entsprechende Menü M' erst zu einem Zeitpunkt von dem Server 16 oder von der jeweiligen Steuereinrichtung 12, 14 in das Bedienhandgerät 1 geladen, zu dem der Schritt S3 bereits ausgeführt ist, die Ermittlung der erkannten Maschinenumgebung B' also bereits abgeschlossen ist. Das Laden des entsprechenden Menüs M' erfolgt - vorzugsweise, aber nicht zwangsweise - über eine leitungslose Kommunikationsverbindung.As already mentioned, although the machine environments B 'to be recognized and the RFID signals S' to be detected are preferably stored in the hand-held
Die Menüs M' sind auf die jeweilige zu erkennende Maschinenumgebung B' abgestimmt. Die Menüs M' können insbesondere derart bestimmt sein, dass - siehe die
Die vorliegende Erfindung weist viele Vorteile auf. Insbesondere ist eine sichere und eindeutige Erkennung der jeweiligen Maschinenumgebung B' nebst zugeordneter, sicherer Zuordnung der entsprechenden Menüs M' möglich. Weiterhin ergibt sich eine große Flexibilität bezüglich der möglichen zu erkennenden Maschinenumgebungen B' und der zugeordneten Menüs M'. Bei Bedarf kann die erfindungsgemäße Vorgehensweise weiterhin um eine benutzerbezogene Identifikation erweitert werden. Beispielsweise kann der Benutzer 8 zusätzlich einen Code eingeben, selbst einen RFID-Sender 4 oder RFID-Transponder 5 tragen oder einen am Bedienhandgerät 1 angeordneten SchlüsseLschalter betätigen. In diesem Fall kann das jeweilige Menü M' zusätzlich zur Zuordnung zur jeweiligen Maschinenumgebung B' benutzerspezifisch sein.The present invention has many advantages. In particular, a secure and unambiguous recognition of the respective machine environment B 'in addition to assigned, reliable assignment of the corresponding menus M' is possible. Furthermore, there is a great deal of flexibility with regard to the possible machine environments B 'to be recognized and the associated menus M'. If necessary, the procedure according to the invention can be further extended by a user-related identification. For example For example, the
Die mittels der Betätigungselemente 6 ausgelösten Aktionen können sicherheitsrelevant sein. Es kann daher erforderlich sein, gewisse Komponenten des Bedienhandgeräts 1 - beispielsweise den Prozessor 11, die Auslegung der Betätigungselemente 6 oder beispielsweise die Bildsensorik 2 und/oder die RFID-Sensorik 3 - redundant im Sinne einer Fehlersicherheit auszulegen. Ob und gegebenenfalls welche Elemente fehlersicher ausgelegt werden müssen, kann nach Bedarf entschieden werden. Redundante, fehlersichere Auslegungen von Geräten und Komponenten sind Fachleuten allgemein bekannt, so dass von entsprechenden Ausführungen hierzu abgesehen werden kann.The actions triggered by the
Obwohl die Erfindung im Detail durch das bevorzugte Ausführungsbeispiel näher illustriert und beschrieben wurde, so ist die Erfindung nicht durch die offenbarten Beispiele eingeschränkt und andere Variationen können vom Fachmann hieraus abgeleitet werden, ohne den Schutzumfang der Erfindung zu verlassen.Although the invention has been further illustrated and described in detail by the preferred embodiment, the invention is not limited by the disclosed examples, and other variations can be derived therefrom by those skilled in the art without departing from the scope of the invention.
Claims (11)
- Method for operating a manual control device (1),- wherein an image (B) is detected by means of a sensor system (2) disposed on the manual control device (1) and RFID signals (S) are detected by an RFID sensor system (3) disposed on the manual control device (1),- wherein the detected image (B) is compared with machine environments (B') to be recognised and the detected RFID signals (S) are compared with the RFID signals (S') to be recognised assigned to the machine environments (B') to be recognised,- characterised in that, in the event of the detected image (B) matching one of the machine environments (B') to be recognised and the detected RFID signals (S) matching the RFID signals (S') to be recognised assigned to the machine environments (B') to be recognised, actuation elements (6) and display elements (7) of the manual control device (1) are assigned a menu (M') assigned to the machine environment (B') recognised and- wherein, in the cases,-- in which the detected image (B) does not match any of the machine environments (B') to be recognised,-- in which no RFID signals (S) are detected and-- in which the detected RFID signals (S) do not match the RFID signals to be recognised (S') assigned to the recognised machine environment (B'),no menu is assigned to the actuation elements (6) and display elements (7) of the manual control device (1).
- Operating method according to claim 1,
characterised in that the detected image (3) is a depth image. - Operating method according to claim 1 or 2,
characterised in that descriptions of the machine environments (B') to be recognised and the RFID signals (S') to be recognised are stored in the manual control device (1). - Operating method according to claim 1, 2 or 3,
characterised in that first of all the detected RFID signals (S) are compared with the RFID signals (S') to be recognised, then, in the event of the RFID signals (S) detected matching the RFID signals (S') to be recognised, a machine environment (B') to be recognised assigned to the matching RFID signals (S') is pre-selected and finally the detected image (B) is exclusively compared with the pre-selected machine environment (B'). - Operating method according to one of the above claims,
characterised in that the menu (M') is only loaded into the manual control device (1) after the machine environment (B') recognised has been established. - Operating method according to one of the above claims,
characterised in that it is executed continuously. - Operating method according to one of the above claims,
characterised in that, in the event of the actuation elements (6) and display elements (7) of the manual control device (1) not being assigned any menu, an appropriate message is output via the display elements (7) of the manual control device (1). - Operating method according to one of the above claims,
characterised in that machine elements (17) visible in the recognised machine environment (B') are able to be moved by means of the menu (M') assigned to the actuation elements (6). - Method of operation according to claim 8,
characterised in that exclusively machine elements (17) visible in the recognised machine environment (B') are able to be moved by means of the menu (M') assigned to the actuation elements (6). - Manual control device,- wherein an image sensor system (2), an RFID sensor system (3), actuation elements (6) and display elements (7) are disposed on the manual control device,- wherein a program (9) is stored in the manual control device, which when processed by the image sensor system (2), detects an image (B) and RFID signals (S) are detected by the RFID sensor system (3) and- wherein, as part of the processing of the program (9), the detected image (B) is compared with machine environments (B') to be recognised and the detected RFID signals (S) are compared with the RFID signals (S') to be recognised assigned to the machine environments (B') to be recognised,- characterised in that, as part of the processing of the program (9), in the event of the detected image (B) matching one of the machine environments (B') to be recognised and the detected RFID signals (S) matching the RFID signals (S') to be recognised assigned to the recognised machine environment (B'), actuation elements (6) and display elements (7) of the manual control device (1) are assigned a menu (M') assigned to the recognised machine environment (B') and- wherein, as part of the processing of the program (9), in the cases,-- in which the detected image (B) does not match any of the machine environments (B') to be recognised,-- in which no RFID signals (S) are detected and-- in which the detected RFID signals (S) do not match the RFID signals to be recognised (S') assigned to the detected machine environment (B'),no menu is assigned to the actuation elements (6) and display elements (7) of the manual control device (1).
- Manual control device according to claim 10,
characterised in that the descriptions of the machine environments (B') to be recognised and of the RFID signals (S') assigned to the machine environments (B') to be recognised are stored in the manual control device and that, as part of the processing of the program (9) within the manual control device, the detected image (B) is compared with the machine environments (B') to be recognised, the detected RFID signals (S) are compared with the RFID signals (S') to be recognised and, on the basis of the comparisons made, a decision is taken as to whether and if necessary which menu (M') is assigned to the actuation elements (6) and display elements (7) of the manual control device.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP13167617.3A EP2804164B1 (en) | 2013-05-14 | 2013-05-14 | Method for control device and control device with recognition of environment and RFID sensor |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP13167617.3A EP2804164B1 (en) | 2013-05-14 | 2013-05-14 | Method for control device and control device with recognition of environment and RFID sensor |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2804164A1 EP2804164A1 (en) | 2014-11-19 |
EP2804164B1 true EP2804164B1 (en) | 2015-09-02 |
Family
ID=48325519
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP13167617.3A Not-in-force EP2804164B1 (en) | 2013-05-14 | 2013-05-14 | Method for control device and control device with recognition of environment and RFID sensor |
Country Status (1)
Country | Link |
---|---|
EP (1) | EP2804164B1 (en) |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7586398B2 (en) * | 1998-07-23 | 2009-09-08 | Universal Electronics, Inc. | System and method for setting up a universal remote control |
EP1744290B1 (en) * | 2005-07-15 | 2018-05-30 | Samsung Electronics Co., Ltd. | Integrated remote controller and method of selecting device controlled thereby |
JP4676303B2 (en) * | 2005-10-18 | 2011-04-27 | 株式会社日立製作所 | Terminal device |
DE102008021160A1 (en) | 2008-04-28 | 2009-10-29 | Beckhoff Automation Gmbh | remote control |
-
2013
- 2013-05-14 EP EP13167617.3A patent/EP2804164B1/en not_active Not-in-force
Also Published As
Publication number | Publication date |
---|---|
EP2804164A1 (en) | 2014-11-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3058427B1 (en) | Method and system for remotely operating a machine tool by means of a mobile communication device | |
DE102017120614B4 (en) | Robot system with a programming pendant that communicates with a robot controller | |
DE102014011802B4 (en) | Safe activation of a partially autonomous function of a motor vehicle via a portable communication device | |
EP3383598B1 (en) | Manipulator system and method for identifying operating devices | |
EP1367314A2 (en) | Device for monitoring the operating range of working means | |
DE102011090135A1 (en) | Device and method for safety-relevant input via a display device with touch input | |
EP3064050B1 (en) | Control system for an agricultural working device | |
DE102013008002A1 (en) | Remote control system for an injection molding machine | |
AT521872A1 (en) | Method for operating a machine control system and corresponding machine control system | |
EP2525268B1 (en) | Switching device for a machine, assembly and/or transport system | |
EP3150898B1 (en) | Method for automated control of a machine component | |
DE102009014574A1 (en) | security system | |
EP3575666B1 (en) | Device for protecting a hazardous area of a system | |
DE102012018713A1 (en) | Machine control and method for controlling a machine | |
EP4283179B1 (en) | Safety locking device | |
EP2804164B1 (en) | Method for control device and control device with recognition of environment and RFID sensor | |
DE102018109234A1 (en) | Device and method for controlling a crane system | |
DE102013219511A1 (en) | Method and device for operating an input device of an operating system, motor vehicle, computer program, computer program product | |
DE102016114805A1 (en) | Method and embedded system for monitoring, controlling or regulating a machine | |
DE102009031226A1 (en) | Safety light curtain for monitoring protection area to protect e.g. dangerous machine from unauthorized access, has evaluating unit, where threshold value is defined in unit, and warning signal is outputted during interruption of beams | |
DE202019103188U1 (en) | Safety switching element for machines or robots | |
EP3980223B1 (en) | Method and system for automatically securing the operation of a robot system, said operation being controlled by means of a mobile operating device | |
DE102017119275A1 (en) | light curtain | |
EP3627033B1 (en) | Device for protecting a hazardous area of a system | |
EP3513760B1 (en) | System for controlling a medical device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20130719 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
INTG | Intention to grant announced |
Effective date: 20150311 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 747058 Country of ref document: AT Kind code of ref document: T Effective date: 20150915 Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: GERMAN |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 502013001079 Country of ref document: DE Ref country code: CH Ref legal event code: NV Representative=s name: SIEMENS SCHWEIZ AG, CH |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150902 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150902 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151202 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151203 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150902 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D Ref country code: NL Ref legal event code: MP Effective date: 20150902 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150902 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150902 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150902 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150902 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150902 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160102 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150902 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150902 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150902 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 4 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160104 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150902 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 502013001079 Country of ref document: DE |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20160603 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150902 Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150902 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160531 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160514 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 5 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160514 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PCOW Free format text: NEW ADDRESS: WERNER-VON-SIEMENS-STRASSE 1, 80333 MUENCHEN (DE) |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20170514 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170514 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 6 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150902 Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20130514 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150902 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150902 Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150902 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150902 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150902 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150902 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150902 Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150902 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MM01 Ref document number: 747058 Country of ref document: AT Kind code of ref document: T Effective date: 20180514 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180514 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20210526 Year of fee payment: 9 Ref country code: IT Payment date: 20210525 Year of fee payment: 9 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20210720 Year of fee payment: 9 Ref country code: CH Payment date: 20210802 Year of fee payment: 9 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 502013001079 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220531 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220531 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220531 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221201 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220514 |