EP3569920B1 - Monitoring device and method for monitoring a monitored zone - Google Patents

Monitoring device and method for monitoring a monitored zone Download PDF

Info

Publication number
EP3569920B1
EP3569920B1 EP19184024.8A EP19184024A EP3569920B1 EP 3569920 B1 EP3569920 B1 EP 3569920B1 EP 19184024 A EP19184024 A EP 19184024A EP 3569920 B1 EP3569920 B1 EP 3569920B1
Authority
EP
European Patent Office
Prior art keywords
distance
time
light curtain
muting
zone
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP19184024.8A
Other languages
German (de)
French (fr)
Other versions
EP3569920A1 (en
Inventor
Mohammad Naser
Krishnan Ramanathan
Gianmarco Grange
Paolo Viviani
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Omron Europe BV
Original Assignee
Omron Europe BV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=62002331&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=EP3569920(B1) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Application filed by Omron Europe BV filed Critical Omron Europe BV
Publication of EP3569920A1 publication Critical patent/EP3569920A1/en
Application granted granted Critical
Publication of EP3569920B1 publication Critical patent/EP3569920B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F16ENGINEERING ELEMENTS AND UNITS; GENERAL MEASURES FOR PRODUCING AND MAINTAINING EFFECTIVE FUNCTIONING OF MACHINES OR INSTALLATIONS; THERMAL INSULATION IN GENERAL
    • F16PSAFETY DEVICES IN GENERAL; SAFETY DEVICES FOR PRESSES
    • F16P3/00Safety devices acting in conjunction with the control or operation of a machine; Control arrangements requiring the simultaneous use of two or more parts of the body
    • F16P3/12Safety devices acting in conjunction with the control or operation of a machine; Control arrangements requiring the simultaneous use of two or more parts of the body with means, e.g. feelers, which in case of the presence of a body part of a person in or near the danger zone influence the control or operation of the machine
    • F16P3/14Safety devices acting in conjunction with the control or operation of a machine; Control arrangements requiring the simultaneous use of two or more parts of the body with means, e.g. feelers, which in case of the presence of a body part of a person in or near the danger zone influence the control or operation of the machine the means being photocells or other devices sensitive without mechanical contact
    • F16P3/144Safety devices acting in conjunction with the control or operation of a machine; Control arrangements requiring the simultaneous use of two or more parts of the body with means, e.g. feelers, which in case of the presence of a body part of a person in or near the danger zone influence the control or operation of the machine the means being photocells or other devices sensitive without mechanical contact using light grids
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J19/00Accessories fitted to manipulators, e.g. for monitoring, for viewing; Safety devices combined with or specially adapted for use in connection with manipulators
    • B25J19/02Sensing devices
    • B25J19/021Optical sensing devices
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F16ENGINEERING ELEMENTS AND UNITS; GENERAL MEASURES FOR PRODUCING AND MAINTAINING EFFECTIVE FUNCTIONING OF MACHINES OR INSTALLATIONS; THERMAL INSULATION IN GENERAL
    • F16PSAFETY DEVICES IN GENERAL; SAFETY DEVICES FOR PRESSES
    • F16P3/00Safety devices acting in conjunction with the control or operation of a machine; Control arrangements requiring the simultaneous use of two or more parts of the body
    • F16P3/12Safety devices acting in conjunction with the control or operation of a machine; Control arrangements requiring the simultaneous use of two or more parts of the body with means, e.g. feelers, which in case of the presence of a body part of a person in or near the danger zone influence the control or operation of the machine
    • F16P3/14Safety devices acting in conjunction with the control or operation of a machine; Control arrangements requiring the simultaneous use of two or more parts of the body with means, e.g. feelers, which in case of the presence of a body part of a person in or near the danger zone influence the control or operation of the machine the means being photocells or other devices sensitive without mechanical contact
    • F16P3/147Safety devices acting in conjunction with the control or operation of a machine; Control arrangements requiring the simultaneous use of two or more parts of the body with means, e.g. feelers, which in case of the presence of a body part of a person in or near the danger zone influence the control or operation of the machine the means being photocells or other devices sensitive without mechanical contact using electro-magnetic technology, e.g. tags or radar
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01PMEASURING LINEAR OR ANGULAR SPEED, ACCELERATION, DECELERATION, OR SHOCK; INDICATING PRESENCE, ABSENCE, OR DIRECTION, OF MOVEMENT
    • G01P3/00Measuring linear or angular speed; Measuring differences of linear or angular speeds
    • G01P3/64Devices characterised by the determination of the time taken to traverse a fixed distance
    • G01P3/68Devices characterised by the determination of the time taken to traverse a fixed distance using optical means, i.e. using infrared, visible, or ultraviolet light

Definitions

  • the present invention relates to a monitoring device for monitoring a monitored zone.
  • the invention further relates to a method for monitoring the monitored zone.
  • a monitoring device can be used to protect a safety zone comprising a dangerous factory device at a manufacturing site.
  • the monitoring device may include a light curtain device for detecting the presence of an object along a boundary section of the safety zone. When an object is detected, a warning signal may be emitted or another protective measure may be performed. It can be desired to obtain further information about the object to thereby improve the monitoring of the monitored zone and increase the safety of the safety zone.
  • the document US 2017/0052278 A1 discloses a dynamic partial muting of a light curtain in accordance with a height of an object crossing the light curtain. Further, the document US 2009/0244551 A1 discloses a sensor apparatus for determining the shape of a load on a carrier device, in particular for determining whether the load has an overhang or not.
  • US 8 330 095 B2 discloses an optical scanning type photoelectric switch capable of preventing interference with another photoelectric switch by use of its own capability.
  • a further object of the present invention is to provide an improved method for monitoring the monitored zone.
  • a monitoring device for monitoring a monitored zone which is adjacent to a safety zone comprises:
  • Providing the monitoring device with a time-of-flight device is in particular advantageous in that further information on the object such as the distance to the object or the size of the object can be detected.
  • the information on the object can improve the understanding of what is happening in the monitored zone and in particular can improve the monitoring of the monitored zone.
  • the information on the object can be reflected in the evaluation result.
  • the evaluation result may help making decisions relating to the protection of the safety zone.
  • the safety zone can be a three dimensional or two-dimensional region. It may be at least partially delimited by the boundary section.
  • the safety zone is a dangerous zone, for example a dangerous zone of a factory arrangement comprising a dangerous factory device.
  • the safety zone can be a virtual zone, which does not have any physical boundaries.
  • the monitored zone and the safety zone may be adjacent zones touching each other along the boundary section.
  • the monitored zone can be a virtual zone, which does not have any physical boundaries.
  • the monitored zone and the safety zone can be three-dimensional zones.
  • the safety zone can be a zone which has to be protected, for example because is comprises a dangerous machine and/or should not be accessed by non-authorized persons.
  • the safety zone can be protected by monitoring the monitored zone, in particular by monitoring objects located in the monitored zone approaching the safety zone.
  • the boundary section may be a two-dimensional area or a one-dimensional line.
  • the boundary section is a plane delimiting the safety zone from the monitored zone.
  • the boundary section can be the boundary between the inside of the safety zone and the outside of the safety zone (monitored zone).
  • the boundary section may be a virtual area which is not defined by any physical boundaries.
  • the object can be any type of visible item.
  • it can be a manufactured object, a box, a human, a vehicle or the like.
  • the light curtain device may detect whether any object is touching the boundary section or not. It can be considered that an object is touching the boundary section if any part thereof is in contact with the boundary section. In particular, an object that crosses the boundary section touches the boundary section. For example, the object has to touch the boundary section to at least partially enter or leave the safety zone through the monitored zone.
  • the light curtain device can be arranged along the boundary section, in particular at an edge of the boundary section.
  • the light curtain device can comprise a least one light emitting element for emitting light beams, for example in a pulsed manner at predetermined frequency, as well as at least one light receiving element for receiving only light at the predetermined frequency.
  • a light emitting element for emitting light beams, for example in a pulsed manner at predetermined frequency
  • at least one light receiving element for receiving only light at the predetermined frequency.
  • the light curtain device can recognize the presence of the object touching the boundary section.
  • the light emitting element can emit the light along the boundary section, in particular such that the light is emitted along a grid that coincides with the boundary section.
  • the light emitting element is arranged on one side of the boundary section and the light receiving element is arranged on the other side of the boundary section.
  • the light curtain device may determine the light curtain signal, which for example indicates whether an object touches the boundary section or not.
  • the time-of-flight device may be a device using a time-of-flight method to determine the distance to the object.
  • the time-of-flight (ToF) device may emit a wave signal such as a light signal and calculate the distance to the object based on a time it takes to the wave signal to travel to the object and back to the time-of-flight device.
  • the distance to the object can designate the distance between the time-of-flight device and the object.
  • the distance to the object can be determined based on a single wave signal (light signal) emitted by the time-of-flight device.
  • the distance to the object can be determined individually based on each individual wave signal. It is also possible to determine the distance to the object based on a plurality, in particular based on all wave signals emitted by the time-of-flight device.
  • the time-of-flight device can be located at an edge of the boundary section, for example next to the light curtain device. Alternatively, it can be located anywhere inside or close to the monitored zone.
  • the wave signal emitted by the time-of-flight device are emitted in all directions or along one or several predetermined directions only.
  • the size of the object may be determined based on the difference in the time-of-flight of at least two wave signals emitted in the direction of the object, as will be described in greater detail below.
  • the evaluation device can receive a signal from the time-of-flight device including the detected distance to the object and/or the size of the object, and/or a signal from the light curtain device indicating whether the object touches the boundary section.
  • the evaluation device may evaluate this or these receives signal(s) and determine the evaluation result based thereon.
  • the evaluation device is implemented to calculate the evaluation result as a function of the distance between the time-of-flight device and the object and/or the size of the object determined by the time-of-flight device, and optionally as a function of a light curtain signal from the light curtain device.
  • the light curtain device and the time-of-flight device are used in combination to monitor the monitored zone.
  • the time-of-flight device may allow to monitor not only the boundary section itself but also its surroundings, in particular the monitored zone. Thereby, objects approaching the boundary section through the monitored zone may be detected and it can be possible to predict critical events occurring at the boundary section such as crossings of the boundary section.
  • the prediction of the critical events may depend on the distance to the object determined by the time-of-flight device.
  • information about the object such as the size of the object, can improve the monitoring of the monitored zone.
  • the protection of the safety zone can thereby be improved. In particular, it can be prevented that an unauthorised object enters the safety zone more reliably.
  • the process of temporarily deactivating the light curtain device performed by the muting device can be called "muting".
  • the muting function may be performed when the monitoring device recognizes that no critical event is occurring or about to occur. This can be the case when the evaluation device determines that the pattern corresponds to the predetermined pattern and/or that the object is an authorized object.
  • the muting can prevent the monitoring device from unnecessarily performing the predetermined protective measure.
  • the muting can be activated when the monitoring device recognises, based on the evaluation result, that the object passing the boundary section is moving away from the safety zone, that the object is a non-critical authorized object and/or when the object moves at a predetermined velocity. Further, muting can be inhibited when the evaluation result indicates that the object is very close from the safety zone, that the object is not an authorized object or the like.
  • the muting may be a muting of the entire light curtain device, for example of all light receiving elements of the light curtain device, and/or of only a part of the light curtain device, for example of only some of the light receiving elements of the light curtain device.
  • the height along which the muting of the light curtain device is performed is in particular called "muting height".
  • the evaluation device is further configured to determine a pattern indicating an evolution of the distance to the object as a function of time, to compare this pattern to a predetermined pattern and to emit the evaluation result based on a result of the comparison between the pattern and the predetermined pattern.
  • the pattern and the predetermined pattern can be time patterns describing how the distance to the object evolves with time.
  • the predetermined pattern can be a prestored pattern indicating how the distance to a standard authorized object evolves with time.
  • a standard object may for example be a box and/or an object manufactured by a factory arrangement.
  • the authorized object can further be an object which is expected and allowed to move within the monitored zone and/or in the safety zone. If the pattern determined by the evaluation unit differs from the predetermined pattern, this can be an indication that the object in the monitored zone is not an authorized object. In this case, the evaluation unit may recognize that the object is not authorized and emit an alarm and/or perform another protective measure to prevent the unauthorized object from entering the safety zone.
  • the evaluation device can determine the pattern based on a single wave signal (emitted and received light beams) of the time-of-flight device. In this case, the pattern can be determined for each wave signal of the time-of-flight device individually. Alternatively or in addition thereto, the evaluation device may determine the pattern based on a plurality of wave signals and/or based on all wave signals emitted by the time-of-flight device.
  • the monitoring device further comprises a protection device for performing a predetermined protective measure based on the evaluation result.
  • the evaluation device can send the evaluation result to the protection device.
  • the protection device may take a decision regarding a protective measure to be taken in view of the evaluation result. For example, if the evaluation result indicates an immediate danger, the protection device can perform an emergency protective measure. This can be the case when the result indicates that an object is entering the safety zone, in particular when an object touches the boundary section. In this case, the protection device may, as a protective measure, turn off and/or slow down any dangerous facilities (such as factory devices) located in the safety zone to avoid damaging the entering object.
  • the protection device can also, as another protective measure, provide a physical barrier to prevent the object from attaining the dangerous facilities of the safety zone.
  • the protection device can perform different types of predetermined protective measures.
  • the protection device determines the predetermined protective measure in accordance with the evaluation result.
  • the protection device can also choose to take no actions if the evaluation result is not critical, in particular if no object is detected at or close to the boundary section and/or if the object is an authorized object.
  • the emission of the warning signal can be an example of a predetermined protective measure.
  • the warning signal can be a light signal or a sound signal.
  • the protection device allows to protect the boundary section, the safety zone and/or the object by taking appropriate protective measures depending on the evaluation result.
  • the evaluation device is configured to determine a velocity of the object based on several consecutive distance measurements performed by the time-of-flight device; and/or the time-of-flight device is configured to determine a velocity of the object based on several consecutive distance measurements performed by the time-of-flight device and/or to transmit the determined velocity of the object to the evaluation device, in particular upon request from the evaluation device.
  • the evaluation device may determine the evaluation result based on the determined velocity information.
  • the velocity of the object is prestored for the evaluation unit to access. This can be the case when the object is displaced by a conveyor belt moving at a predefined velocity which corresponds to the velocity of the object.
  • the evaluation device and/or the time-of-flight device only determines the velocity of the object itself when there is no prestored velocity information. If there is a prestored velocity information, the evaluation device may access it to determine the evaluation result based thereon.
  • the evaluation device is configured to determine a first instant at which the object starts touching the boundary section and/or a second instant at which the object ends touching the boundary section based on the velocity of the object and to include an indication about the first instant and/or the second instant in the evaluation result.
  • the first instant can be a point in time, in particular in the future, at which the object will start touching the boundary section. This may be a time at which the object is first detectable by the light curtain device.
  • the second instant can be a point in time, in particular in the future, at which the object will stop touching the boundary section. This may be a time at which the object is last detectable by the light curtain device.
  • the first and second instants are predictions about the time during which the object will cross the boundary section.
  • the first and second instants are calculated using the velocity information of the object and assuming that the velocity of the object is constant.
  • the muting device is configured to determine the muting height of the light curtain device based on an information about the distance to the object included in the evaluation result.
  • the muting device is configured to determine the muting height of the light curtain device such that it is equal to a height of the object derived from the distance to the object included in the evaluation result.
  • the muting height is determined in accordance with the distance to the object, in particular with the height of the object.
  • the muting height is chosen to be equal to or greater than the height of the object determined from the distance to the object. If the muting height is equal to the height of the object, it can be avoided that an object, for example a person, hidden on top of the object, crosses the boundary section without being detected by the light curtain device. By optimizing the muting height, the safety of the safety zone can be further increased.
  • the muting device is configured to at least partially deactivate the light curtain device between the first instant and the second instant.
  • the time for muting the light curtain device along the muting height extends between the first and the second instant.
  • the muting of the light curtain device is limited to the duration during which the object actually crosses the boundary section, without being unnecessarily extended in time.
  • a muting time is optimized, hence improving the protection of the safety zone.
  • the time-of-flight device is configured to emit a plurality of parallel light beams and to determine the size of the object based on a number of light beams reflected by the object and received by the time-of-flight device.
  • the light beams can be wave signals emitted by the time-of flight device.
  • the parallel light beams can be emitted uniformly along the area covered by the time-of-flight device.
  • a same predetermined distance separates any two adjacent light beams of the time-of-flight device.
  • the size of the object can be determined as being the predetermined distance multiplied by the number of light beams reflected by the object and received by the time-of-flight device.
  • the protection device is configured to perform the protective measure when the evaluation result indicates that:
  • the protective measure can be performed.
  • the protective measure may be performed in accordance with the distance to the object. For example, when the distance to the object is between a first and a second threshold, the evaluation result can indicate that the object is in a warning zone and/or the protection device can emit an alarm as a protective measure. Further, if the distance to the object is smaller than the second threshold, the evaluation result can indicate that the object is in a danger zone and/or the protection device can deactivate the dangerous machines located in the safety zone as a protective measure. Further, when the distance to the object is determined to be greater than the first threshold, the evaluation result can indicate that the object is in a safe zone and/or the protection device may not perform any protective measure. In some embodiments, the protective measure is the prevention of the muting.
  • the protection device can perform an appropriate protective measure.
  • the monitoring device comprises a plurality of time-of-flight devices.
  • the plurality of time-of-flight devices are arranged such as to monitor the entire monitored area.
  • the use of several time-of-flight devices can be useful to obtain more information about the object such as its size and/or shape. This is particularly advantageous when the object has a complex or irregular shape.
  • the monitoring of the monitored area and/or the protection of the safety zone can be improved using a plurality of time-of-flight devices.
  • the respective devices of the monitoring device in particular the light curtain device, the time-of-flight device, the evaluation device, the protection device and the like, can be implemented in hardware and/or software.
  • the factory arrangement comprises:
  • the factory device is a manufacturing device, a conveyor belt or a packing device. It can comprise dangerous elements such as saws, drills, laser cutters and the like.
  • the factory device can be used to manufacture objects such as metal, plastic or wood objects and/or to pack them in boxes, for example in cardboard boxes.
  • a human enters in contact with the dangerous elements of the factory device as the human may injure himself.
  • the safety of the human and/or of the safety zone may be provided by the monitoring device already described above.
  • a method for monitoring a monitored zone which is adjacent to a safety zone comprises:
  • the method according to the third embodiment is implemented using the monitoring device according to the first aspect or according to an embodiment thereof.
  • Fig. 1 shows a monitoring device 1 according to a first embodiment.
  • the monitoring device 1 comprises a light curtain device 2, a time-of-flight device 3 and an evaluation device 4 connected to each other through cables 5.
  • the functionality of the monitoring device 1 will be described in view of Fig. 2 , which shows a factory arrangement 17 according to a first embodiment.
  • the factory arrangement 17 comprises the monitoring device 1 of Fig. 1 .
  • the monitoring device 1 is used to monitor a monitored zone 6.
  • the monitored zone 6 is adjacent to a safety zone 7.
  • the boundary between the monitored zone 6 and the safety zone 7 forms a boundary section 9.
  • the safety zone 7 corresponds to a dangerous zone comprising a dangerous factory device 22.
  • the factory device 22 is for example a laser cutter used to cut objects to be manufactured. It is desired that humans, for example technicians, stay outside the safety zone 7 to avoid getting injured by the laser cutter 22.
  • the factory arrangement 17 further comprises a conveyor belt 10 for transporting objects 8 between the monitored zone 6 and the safety zone 7.
  • the safety zone 7 is a virtual cuboid that is delimited by the boundary section 9 on one side.
  • the monitored zone 6 is also a virtual cuboid that is delimited by the boundary section 9 on one side.
  • the boundary section 9 is a plane. In the representation of Fig. 2 , the boundary section 9 extends along the y-z plane and is represented as a dashed-and dotted line while the remaining boundaries of the safety zone 7 and of the monitored zone are represented by dashed lines.
  • the monitoring device 1 of the factory arrangement can perform a method of monitoring a monitored zone 6. An example of such a method is shown in Fig. 3 .
  • the light curtain device 2 detects whether an object 8 touches the boundary section 9.
  • the light curtain device 2 comprises several light emitting elements 2a and several light receiving elements 2b which are not shown in Fig. 2 but visible on Fig. 6 .
  • the boundary section 9 extends between the light emitting element 2a and the light receiving elements 2b of the light curtain device 2.
  • the light emitting elements 2a emit light along the boundary section 9.
  • the light receiving elements 2b receive the light emitted as light beams by the light emitting elements 2a. If no or less light is received by the light receiving element 2b, it can be determined that the object 8 touches the light beams and hence the boundary section 9.
  • the object 8 is a box which is not touching the boundary section 3. Accordingly, the light curtain device 2 emits a light curtain signal indicating that no object 8 is touching or crossing the boundary section 9.
  • the time-of-flight device 3 is located at one edge of the boundary section 9.
  • a distance d to the object 8 and/or a size thereof is determined using the time-of-flight device 3.
  • the time-of-flight device 3 is used contemporaneously to the light curtain device 2.
  • the time-of-flight device 3 monitors the monitored zone 6 using light signals 23. When the object 8 is touched by the light signal 23, it reflects the light back towards the time-of-flight device 3.
  • the time-of-flight device 3 detects the light reflected back by the object 8 and calculates a distance d to the object 8 based on a time (time-of-flight) taken for the light signal 23 to travel from the time-of-flight device 3 to the object 8 and back.
  • the size of the object 8 is determined as shown in Fig. 4 .
  • the time-of-flight device 3 is seen from above.
  • the time-of-flight device 3 comprises a plurality (here seven) emission and reception units 13 for respectively emitting a light beam 11 and receiving a reflected light beam 12.
  • the time-of-flight of the light beams 12 which are reflected by the object 8 are considerably shorter than those which do get reflected by the conveyor belt 10 (not shown) rather than by the object 8.
  • the time-of-flight device 3 determines which received light beams 12 were reflected by the object 8 and which were not.
  • the time-of-flight device 3 calculates the size (along the y-direction) of the object 8 using the fact that neighboring emission and reception units 13 are evenly spaced by a predetermined distance ⁇ along the time-of-flight device 3.
  • a predetermined distance ⁇ along the time-of-flight device 3.
  • three light beams 12 are reflected by the object 8, so that the size of the object 8 along the y-direction is between 2 ⁇ and 3 ⁇ .
  • the information about the distance to the object 8 and the size of the object 8 is transmitted to the evaluation device 4 for evaluation.
  • the evaluation device 4 emits an evaluation result based on the distance to the object 8, the size of the object 8 and the light curtain signal.
  • the evaluation result provides information about the monitored zone 6, thereby facilitating the monitoring of the monitored zone 6 and the protection of the security zone 7.
  • Fig. 5 shows a monitoring device 1' according to a second embodiment.
  • the monitoring device 1' according to the second embodiment differs from the monitoring device 1 according to the first embodiment in that is further comprises a protection device 15 and a muting device 16.
  • the monitoring device 1' can be used monitor a monitored zone 6 according to the method of the first embodiment ( Fig. 3 ) or according to a method of a second embodiment ( Fig. 6 ).
  • the functionality of the monitoring device 1' will be described in view of the Fig. 5 - 10 .
  • a protective measure or a muting is performed.
  • the protective measure for example the emission of an alarm or a deactivation of the factory device 22, is performed by the protection device 15 to protect the safety zone 7 and/or the object 8.
  • the muting is an at least partial deactivation of the light curtain device 2 which is performed by the muting device 16. The decision about whether muting or a protective measure is to be performed is made in accordance with the evaluation result. The muting and the performing of the protective measure will be described in detail further below.
  • step S4 Once the step S4 has been performed and/or while it is still being performed, the steps S1 - S4 are cyclically repeated to constantly monitor the monitored zone 6.
  • Fig. 7 shows an example of how the evaluation result is determined in the step S3.
  • the evaluation device 4 determines whether the object 8 is closer to the boundary section 9 than allowed, in particular whether it is outside a safety zone SZ.
  • the safety zone SZ is shown in Fig 9 as a zone of the monitored zone 6 that is furthest away from the boundary section 2. If the evaluation device 4 determines that the distance d to the object 8 is greater than a first predefined distance threshold d 1 , at it is the case in Fig. 9 , it determines that the object 8 is located in the safety zone SZ. However, if the evaluation device 4 determines that the distance d to the object 8 is smaller than the first predefined distance threshold d 1 but larger than a second predefined distance threshold d 2 , it determines that the object 8 is located in the warning zone WZ.
  • the evaluation device 4 determines that the distance d to the object 8 is smaller than the second predefined distance threshold d 2 , it determines that the object 8 is located in the danger zone DZ.
  • the evaluation result is thus emitted in accordance with the zone SZ, WZ, DZ in which the object 8 is located.
  • the protection device 15 performs the protective measure in accordance with the zone SZ, WZ and DZ in which the object 8 is located.
  • the protection device 15 when the object 8 is not in the safety zone SZ, the protection device 15 emits an alarm signal as a protective measure in a step S32. Otherwise, if the object 8 is still in the safety zone SZ, the evaluation device 4 determines whether it recognizes the size of the object 8 in a step S33. In detail, the size of the object 8 determined by the time-of-flight device 3 ( Fig. 4 ) is compared to a predetermined size which is prestored in the evaluation unit 4. The predetermined size is the size of an authorized, "white-listed" object 8 which is allowed into the safety zone 7.
  • the protection device 15 emits an alarm signal as a protective measure in a step S32. Otherwise, the evaluation device 4 performs a pattern verification in a step S34.
  • Fig. 8 The pattern verification is described in detail in view of Fig. 8 .
  • the upper part of Fig. 8 (Fig. 8 (A) ) shows the factory arrangement 17 with the object 8 in four different positions P1 - P4 as it moves along a movement direction MD on the conveyor belt 10.
  • the bottom part of Fig. 8 (Fig. 8 (B) ) shows how the distance d to the object 8 determined by the time-of-flight device 3 changes with time as the object 8 moves towards the boundary section 9. This relationship between the distance d and the time is the pattern 14.
  • the evaluation device 4 can determine the pattern 14 based either on individual light signals 23 (namely based on one emitted beam 11 and one received beam 12 at a time) or based on several light signals 23.
  • the distance d is constant and has a value A. This corresponds to the standard distance between the time-of-flight device 3 and the conveyor belt 10 which is detected when no object 8 reflects the light beam 23 of the time-of-flight device 3.
  • the distance d to the object 8 decreases linearly. This corresponds to the light beam 23 getting reflected by a side 24 of the object 8.
  • the distance d to the object is constant at a value of approximatively A - h, with h being the height of the object 8. This corresponds to the light beam 23 being reflected by a top surface 25 of the object 8.
  • the evaluation device 4 determines the pattern of the object 8 and compares it to a predetermined pattern stored for authorized objects 8. If the patterns are identical, namely if the determined pattern is recognized, the muting device 16 performs the muting in a step S5. Otherwise, if the patterns are not identical, the protection device 15 emits an alarm signal as a protective measure in step S32.
  • the evaluation device 4 performs various verifications on the object 8 to determine whether it is allowed to enter the safety zone 8. If the object 8 is an authorized object 8 according to these verifications, the muting device 16 mutes or deactivates at least a part of the light curtain device 2 to let the object 8 enter the safety zone 7.
  • the muting device 16 performs the muting in accordance with the evaluation result, which indicates a height h of the object 8 as determined by the evaluation device 4.
  • the height of the object 8 is defined as the muting height h along which the light curtain device 2 is temporarily deactivated.
  • the bottom two light emitting elements 2a and the bottom two light receiving elements 2b are muted while the upper three light emitting elements 2a and the upper three light receiving elements 2b are not muted.
  • the muting is optimized to improve the protection of the safety zone 7.
  • the evaluation device 4 determines the muting height h using the Pythagorean theorem and/or trigonometry. To further improve the muting, the evaluation device 4 calculates a first and a second instant between which the object 8 will cross the boundary section 9 using an information about the velocity of the conveyor belt 10 and hence of the object 8. The indication about the first and second instants is included in the evaluation result. The muting device 16 then partially mutes the light curtain device 2 precisely during the first and second instants determined by the evaluation device 2. Thereby, the partial muting of the light curtain device 2 is further optimized, thus improving the protection of the safety zone 7.
  • Fig. 11 shows a factory arrangement 18 according to a second embodiment.
  • the factory arrangement 18 according to the second embodiment differs from the factory arrangement 17 according to the first embodiment 18 in that the time-of-flight device 3' is located at a distance D from the boundary section 9 rather than being located at an edge of the boundary section 9.
  • Fig. 12 shows a factory arrangement 19 according to a third embodiment.
  • the factory arrangement 19 according to the third embodiment differs from the factory arrangement 17 according to the first embodiment 18 in that it comprises two time-of-flight devices 3, 3' respectively located at a distance D from the boundary section 9 and at an edge of the boundary section 9. This allows a better monitoring of the monitored zone 6 because complex shapes of the object 8 can be accounted for.
  • the evaluation device 4 may calculate the velocity of the object 8 based on consecutive distance measurements made by the time-of-flight device 3 instead of obtaining it from a database.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Robotics (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Optical Radar Systems And Details Thereof (AREA)
  • Geophysics And Detection Of Objects (AREA)
  • Emergency Alarm Devices (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Radar Systems Or Details Thereof (AREA)
  • Guiding Agricultural Machines (AREA)

Description

  • The present invention relates to a monitoring device for monitoring a monitored zone. The invention further relates to a method for monitoring the monitored zone.
  • A monitoring device can be used to protect a safety zone comprising a dangerous factory device at a manufacturing site. The monitoring device may include a light curtain device for detecting the presence of an object along a boundary section of the safety zone. When an object is detected, a warning signal may be emitted or another protective measure may be performed. It can be desired to obtain further information about the object to thereby improve the monitoring of the monitored zone and increase the safety of the safety zone.
  • The document US 2017/0052278 A1 discloses a dynamic partial muting of a light curtain in accordance with a height of an object crossing the light curtain. Further, the document US 2009/0244551 A1 discloses a sensor apparatus for determining the shape of a load on a carrier device, in particular for determining whether the load has an overhang or not.
  • US 8 330 095 B2 discloses an optical scanning type photoelectric switch capable of preventing interference with another photoelectric switch by use of its own capability.
  • It is one object of the present invention to provide an improved monitoring device. A further object of the present invention is to provide an improved method for monitoring the monitored zone.
  • According to a first aspect, a monitoring device for monitoring a monitored zone which is adjacent to a safety zone is provided. The monitoring device comprises:
    • a light curtain device for detecting an object touching a boundary section located at a boundary between the monitored zone and the safety zone;
    • a time-of-flight device for detecting a distance to the object and/or a size of the object;
    • an evaluation device for emitting an evaluation result based on the distance to the object and/or on the size of the object determined by the time-of-flight device, and optionally based on a light curtain signal from the light curtain device; and
    • a muting device for temporarily deactivating the light curtain device along a muting height of the light curtain device as a function of the evaluation result.
  • Providing the monitoring device with a time-of-flight device is in particular advantageous in that further information on the object such as the distance to the object or the size of the object can be detected. The information on the object can improve the understanding of what is happening in the monitored zone and in particular can improve the monitoring of the monitored zone. The information on the object can be reflected in the evaluation result. The evaluation result may help making decisions relating to the protection of the safety zone. Thus, with the monitoring device according to the first aspect, a monitoring of the monitored zone and a protection of the safety zone can be improved.
  • The safety zone can be a three dimensional or two-dimensional region. It may be at least partially delimited by the boundary section. In embodiments, the safety zone is a dangerous zone, for example a dangerous zone of a factory arrangement comprising a dangerous factory device. The safety zone can be a virtual zone, which does not have any physical boundaries.
  • The monitored zone and the safety zone may be adjacent zones touching each other along the boundary section. The monitored zone can be a virtual zone, which does not have any physical boundaries. The monitored zone and the safety zone can be three-dimensional zones. The safety zone can be a zone which has to be protected, for example because is comprises a dangerous machine and/or should not be accessed by non-authorized persons. The safety zone can be protected by monitoring the monitored zone, in particular by monitoring objects located in the monitored zone approaching the safety zone.
  • The boundary section may be a two-dimensional area or a one-dimensional line. For example, the boundary section is a plane delimiting the safety zone from the monitored zone. The boundary section can be the boundary between the inside of the safety zone and the outside of the safety zone (monitored zone). The boundary section may be a virtual area which is not defined by any physical boundaries.
  • The object can be any type of visible item. For example, it can be a manufactured object, a box, a human, a vehicle or the like.
  • The light curtain device may detect whether any object is touching the boundary section or not. It can be considered that an object is touching the boundary section if any part thereof is in contact with the boundary section. In particular, an object that crosses the boundary section touches the boundary section. For example, the object has to touch the boundary section to at least partially enter or leave the safety zone through the monitored zone. The light curtain device can be arranged along the boundary section, in particular at an edge of the boundary section.
  • To detect the presence of an object touching the boundary section, the light curtain device can comprise a least one light emitting element for emitting light beams, for example in a pulsed manner at predetermined frequency, as well as at least one light receiving element for receiving only light at the predetermined frequency. In particular, when the beam of light emitted by the light emitting element is interrupted, for example due to the presence of an object touching the boundary section, no light or less light is received by the light receiving. In this case, the light curtain device can recognize the presence of the object touching the boundary section.
  • The light emitting element can emit the light along the boundary section, in particular such that the light is emitted along a grid that coincides with the boundary section. In embodiments, the light emitting element is arranged on one side of the boundary section and the light receiving element is arranged on the other side of the boundary section. The light curtain device may determine the light curtain signal, which for example indicates whether an object touches the boundary section or not.
  • The time-of-flight device may be a device using a time-of-flight method to determine the distance to the object. In particular, the time-of-flight (ToF) device may emit a wave signal such as a light signal and calculate the distance to the object based on a time it takes to the wave signal to travel to the object and back to the time-of-flight device. The distance to the object can designate the distance between the time-of-flight device and the object. The distance to the object can be determined based on a single wave signal (light signal) emitted by the time-of-flight device. In particular, the distance to the object can be determined individually based on each individual wave signal. It is also possible to determine the distance to the object based on a plurality, in particular based on all wave signals emitted by the time-of-flight device.
  • The time-of-flight device can be located at an edge of the boundary section, for example next to the light curtain device. Alternatively, it can be located anywhere inside or close to the monitored zone. In particular, the wave signal emitted by the time-of-flight device are emitted in all directions or along one or several predetermined directions only.
  • The size of the object may be determined based on the difference in the time-of-flight of at least two wave signals emitted in the direction of the object, as will be described in greater detail below.
  • The evaluation device can receive a signal from the time-of-flight device including the detected distance to the object and/or the size of the object, and/or a signal from the light curtain device indicating whether the object touches the boundary section. The evaluation device may evaluate this or these receives signal(s) and determine the evaluation result based thereon.
  • In embodiments, the evaluation device is implemented to calculate the evaluation result as a function of the distance between the time-of-flight device and the object and/or the size of the object determined by the time-of-flight device, and optionally as a function of a light curtain signal from the light curtain device.
  • In particular, the light curtain device and the time-of-flight device are used in combination to monitor the monitored zone. The time-of-flight device may allow to monitor not only the boundary section itself but also its surroundings, in particular the monitored zone. Thereby, objects approaching the boundary section through the monitored zone may be detected and it can be possible to predict critical events occurring at the boundary section such as crossings of the boundary section. The prediction of the critical events may depend on the distance to the object determined by the time-of-flight device. Further, information about the object, such as the size of the object, can improve the monitoring of the monitored zone. The protection of the safety zone can thereby be improved. In particular, it can be prevented that an unauthorised object enters the safety zone more reliably.
  • The process of temporarily deactivating the light curtain device performed by the muting device can be called "muting". The muting function may be performed when the monitoring device recognizes that no critical event is occurring or about to occur. This can be the case when the evaluation device determines that the pattern corresponds to the predetermined pattern and/or that the object is an authorized object.
  • The muting can prevent the monitoring device from unnecessarily performing the predetermined protective measure. For example, the muting can be activated when the monitoring device recognises, based on the evaluation result, that the object passing the boundary section is moving away from the safety zone, that the object is a non-critical authorized object and/or when the object moves at a predetermined velocity. Further, muting can be inhibited when the evaluation result indicates that the object is very close from the safety zone, that the object is not an authorized object or the like.
  • The muting may be a muting of the entire light curtain device, for example of all light receiving elements of the light curtain device, and/or of only a part of the light curtain device, for example of only some of the light receiving elements of the light curtain device. The height along which the muting of the light curtain device is performed is in particular called "muting height".
  • According to an embodiment, the evaluation device is further configured to determine a pattern indicating an evolution of the distance to the object as a function of time, to compare this pattern to a predetermined pattern and to emit the evaluation result based on a result of the comparison between the pattern and the predetermined pattern.
  • The pattern and the predetermined pattern can be time patterns describing how the distance to the object evolves with time. The predetermined pattern can be a prestored pattern indicating how the distance to a standard authorized object evolves with time. Such a standard object may for example be a box and/or an object manufactured by a factory arrangement. The authorized object can further be an object which is expected and allowed to move within the monitored zone and/or in the safety zone. If the pattern determined by the evaluation unit differs from the predetermined pattern, this can be an indication that the object in the monitored zone is not an authorized object. In this case, the evaluation unit may recognize that the object is not authorized and emit an alarm and/or perform another protective measure to prevent the unauthorized object from entering the safety zone.
  • The evaluation device can determine the pattern based on a single wave signal (emitted and received light beams) of the time-of-flight device. In this case, the pattern can be determined for each wave signal of the time-of-flight device individually. Alternatively or in addition thereto, the evaluation device may determine the pattern based on a plurality of wave signals and/or based on all wave signals emitted by the time-of-flight device.
  • According to a further embodiment, the monitoring device further comprises a protection device for performing a predetermined protective measure based on the evaluation result.
  • The evaluation device can send the evaluation result to the protection device. The protection device may take a decision regarding a protective measure to be taken in view of the evaluation result. For example, if the evaluation result indicates an immediate danger, the protection device can perform an emergency protective measure. This can be the case when the result indicates that an object is entering the safety zone, in particular when an object touches the boundary section. In this case, the protection device may, as a protective measure, turn off and/or slow down any dangerous facilities (such as factory devices) located in the safety zone to avoid damaging the entering object. The protection device can also, as another protective measure, provide a physical barrier to prevent the object from attaining the dangerous facilities of the safety zone.
  • Depending on the evaluation result, the protection device can perform different types of predetermined protective measures. In particular, the protection device determines the predetermined protective measure in accordance with the evaluation result. The protection device can also choose to take no actions if the evaluation result is not critical, in particular if no object is detected at or close to the boundary section and/or if the object is an authorized object.
  • The emission of the warning signal can be an example of a predetermined protective measure. The warning signal can be a light signal or a sound signal. The protection device allows to protect the boundary section, the safety zone and/or the object by taking appropriate protective measures depending on the evaluation result.
  • According to a further embodiment, the evaluation device is configured to determine a velocity of the object based on several consecutive distance measurements performed by the time-of-flight device; and/or the time-of-flight device is configured to determine a velocity of the object based on several consecutive distance measurements performed by the time-of-flight device and/or to transmit the determined velocity of the object to the evaluation device, in particular upon request from the evaluation device.
  • In particular, the evaluation device and/or the time-of-flight device determines the velocity v of the object by dividing a difference Δd between the two consecutive distance measurements by the time Δt between the two consecutive distance measurements. In other words, v= Δd/ Δt. The evaluation device may determine the evaluation result based on the determined velocity information.
  • In some embodiments, the velocity of the object is prestored for the evaluation unit to access. This can be the case when the object is displaced by a conveyor belt moving at a predefined velocity which corresponds to the velocity of the object. In particular, the evaluation device and/or the time-of-flight device only determines the velocity of the object itself when there is no prestored velocity information. If there is a prestored velocity information, the evaluation device may access it to determine the evaluation result based thereon.
  • According to a further embodiment, the evaluation device is configured to determine a first instant at which the object starts touching the boundary section and/or a second instant at which the object ends touching the boundary section based on the velocity of the object and to include an indication about the first instant and/or the second instant in the evaluation result.
  • The first instant can be a point in time, in particular in the future, at which the object will start touching the boundary section. This may be a time at which the object is first detectable by the light curtain device. The second instant can be a point in time, in particular in the future, at which the object will stop touching the boundary section. This may be a time at which the object is last detectable by the light curtain device. In other words, the first and second instants are predictions about the time during which the object will cross the boundary section. In particular, the first and second instants are calculated using the velocity information of the object and assuming that the velocity of the object is constant.
  • According to the present invention, the muting device is configured to determine the muting height of the light curtain device based on an information about the distance to the object included in the evaluation result.
  • Furthermore, according to the present invention, the muting device is configured to determine the muting height of the light curtain device such that it is equal to a height of the object derived from the distance to the object included in the evaluation result.
  • In particular, the muting height is determined in accordance with the distance to the object, in particular with the height of the object. For example, the muting height is chosen to be equal to or greater than the height of the object determined from the distance to the object. If the muting height is equal to the height of the object, it can be avoided that an object, for example a person, hidden on top of the object, crosses the boundary section without being detected by the light curtain device. By optimizing the muting height, the safety of the safety zone can be further increased.
  • According to a further embodiment, the muting device is configured to at least partially deactivate the light curtain device between the first instant and the second instant.
  • In particular, the time for muting the light curtain device along the muting height extends between the first and the second instant. Thus, the muting of the light curtain device is limited to the duration during which the object actually crosses the boundary section, without being unnecessarily extended in time. Thereby, a muting time is optimized, hence improving the protection of the safety zone.
  • According to a further embodiment, the time-of-flight device is configured to emit a plurality of parallel light beams and to determine the size of the object based on a number of light beams reflected by the object and received by the time-of-flight device.
  • The light beams can be wave signals emitted by the time-of flight device. For example, the parallel light beams can be emitted uniformly along the area covered by the time-of-flight device. In other words, a same predetermined distance separates any two adjacent light beams of the time-of-flight device. The size of the object can be determined as being the predetermined distance multiplied by the number of light beams reflected by the object and received by the time-of-flight device.
  • According to a further embodiment, the protection device is configured to perform the protective measure when the evaluation result indicates that:
    • the distance to the object is smaller and/or greater than a predefined distance threshold;
    • the size of the object differs from a predetermined size; and/or
    • the pattern differs from the predetermined pattern.
  • When the distance to the object is smaller and/or greater than a predefined distance threshold, this may indicate that the object is too close from the safety zone. In this case, the protective measure can be performed. The protective measure may be performed in accordance with the distance to the object. For example, when the distance to the object is between a first and a second threshold, the evaluation result can indicate that the object is in a warning zone and/or the protection device can emit an alarm as a protective measure. Further, if the distance to the object is smaller than the second threshold, the evaluation result can indicate that the object is in a danger zone and/or the protection device can deactivate the dangerous machines located in the safety zone as a protective measure. Further, when the distance to the object is determined to be greater than the first threshold, the evaluation result can indicate that the object is in a safe zone and/or the protection device may not perform any protective measure. In some embodiments, the protective measure is the prevention of the muting.
  • Further, when the evaluation result indicates that the size of the object differs from the predetermined size and/or that the pattern differs from the predetermined pattern, this may indicate that the object is not an authorized object. To protect the safety zone and/or the object, the protection device can perform an appropriate protective measure.
  • According to a further embodiment, the monitoring device comprises a plurality of time-of-flight devices. In particular, the plurality of time-of-flight devices are arranged such as to monitor the entire monitored area. The use of several time-of-flight devices can be useful to obtain more information about the object such as its size and/or shape. This is particularly advantageous when the object has a complex or irregular shape. The monitoring of the monitored area and/or the protection of the safety zone can be improved using a plurality of time-of-flight devices.
  • The respective devices of the monitoring device, in particular the light curtain device, the time-of-flight device, the evaluation device, the protection device and the like, can be implemented in hardware and/or software.
  • According to a second aspect, a factory arrangement is provided. The factory arrangement comprises:
    • a monitored zone delimited by at least one boundary section;
    • a safety zone delimited by the at least one boundary section and adjacent to the monitored zone, wherein, in the safety zone, at least one factory device is arranged and implemented to perform a predetermined function; and
    • a monitoring device according to the first aspect or according to an embodiment of the first aspect, implemented to detect an object located in the monitored zone.
  • For example, the factory device is a manufacturing device, a conveyor belt or a packing device. It can comprise dangerous elements such as saws, drills, laser cutters and the like. The factory device can be used to manufacture objects such as metal, plastic or wood objects and/or to pack them in boxes, for example in cardboard boxes. In particular, it should be avoided that a human enters in contact with the dangerous elements of the factory device as the human may injure himself. The safety of the human and/or of the safety zone may be provided by the monitoring device already described above.
  • According to a third embodiment, a method for monitoring a monitored zone which is adjacent to a safety zone is provided, The method comprises:
    • detecting whether an object touches a boundary section located at a boundary between the monitored zone and the safety zone;
    • detecting a distance to the object and/or a size of the object; and
    • emitting an evaluation result based on the distance to the object and/or on the size of the object, and optionally based on a light curtain signal indicating whether the object touches the boundary section; and
    • temporarily deactivating the light curtain device along a muting height of the light curtain device as a function of the evaluation result.
  • In particular, the method according to the third embodiment is implemented using the monitoring device according to the first aspect or according to an embodiment thereof.
  • The embodiments and features described with reference to the monitoring device according to the first aspect or according to an embodiment of the first aspect apply mutatis mutandis to the factory arrangement according to the second aspect and to the method according to the third aspect.
  • Further possible implementations or alternative solutions of the invention also encompass combinations - that are not explicitly mentioned herein - of features described above or below with regard to the embodiments. The person skilled in the art may also add individual or isolated aspects and features to the most basic form of the invention.
  • Further embodiments, features and advantages of the present invention will become apparent from the subsequent description and dependent claims, taken in conjunction with the accompanying drawings, in which:
  • Fig. 1
    shows a monitoring device according to a first embodiment;
    Fig. 2
    a factory arrangement according to a first embodiment;
    Fig. 3
    shows a method for monitoring a monitored zone according to a first embodiment;
    Fig. 4
    shows an example of a time-of-flight device;
    Fig. 5
    shows a monitoring device according to a second embodiment;
    Fig. 6
    shows a method for monitoring a monitored zone according to a second embodiment;
    Fig. 7
    shows an example of a method for determining an evaluation result;
    Fig. 8
    shows an example of a time pattern;
    Fig. 9
    shows another view of the factory arrangement according to the first embodiment;
    Fig. 10
    shows the factory arrangement according to the first embodiment with a partly muted light curtain device;
    Fig. 11
    shows a factory arrangement according to a second embodiment; and
    Fig. 12
    shows a factory arrangement according to a third embodiment.
  • In the Figures, like reference numerals designate like or functionally equivalent elements, unless otherwise indicated.
  • Fig. 1 shows a monitoring device 1 according to a first embodiment. The monitoring device 1 comprises a light curtain device 2, a time-of-flight device 3 and an evaluation device 4 connected to each other through cables 5. The functionality of the monitoring device 1 will be described in view of Fig. 2, which shows a factory arrangement 17 according to a first embodiment.
  • The factory arrangement 17 comprises the monitoring device 1 of Fig. 1. The monitoring device 1 is used to monitor a monitored zone 6. The monitored zone 6 is adjacent to a safety zone 7. The boundary between the monitored zone 6 and the safety zone 7 forms a boundary section 9. The safety zone 7 corresponds to a dangerous zone comprising a dangerous factory device 22. In the present example, the factory device 22 is for example a laser cutter used to cut objects to be manufactured. It is desired that humans, for example technicians, stay outside the safety zone 7 to avoid getting injured by the laser cutter 22. The factory arrangement 17 further comprises a conveyor belt 10 for transporting objects 8 between the monitored zone 6 and the safety zone 7.
  • The safety zone 7 is a virtual cuboid that is delimited by the boundary section 9 on one side. Similarly, the monitored zone 6 is also a virtual cuboid that is delimited by the boundary section 9 on one side. The boundary section 9 is a plane. In the representation of Fig. 2, the boundary section 9 extends along the y-z plane and is represented as a dashed-and dotted line while the remaining boundaries of the safety zone 7 and of the monitored zone are represented by dashed lines. The monitoring device 1 of the factory arrangement can perform a method of monitoring a monitored zone 6. An example of such a method is shown in Fig. 3.
  • In a step S1 of Fig. 3, the light curtain device 2 detects whether an object 8 touches the boundary section 9. The light curtain device 2 comprises several light emitting elements 2a and several light receiving elements 2b which are not shown in Fig. 2 but visible on Fig. 6. The boundary section 9 extends between the light emitting element 2a and the light receiving elements 2b of the light curtain device 2. The light emitting elements 2a emit light along the boundary section 9. The light receiving elements 2b receive the light emitted as light beams by the light emitting elements 2a. If no or less light is received by the light receiving element 2b, it can be determined that the object 8 touches the light beams and hence the boundary section 9. In Fig. 2, the object 8 is a box which is not touching the boundary section 3. Accordingly, the light curtain device 2 emits a light curtain signal indicating that no object 8 is touching or crossing the boundary section 9. In the example of Fig. 2, the time-of-flight device 3 is located at one edge of the boundary section 9.
  • In a step S2 of Fig. 3, a distance d to the object 8 and/or a size thereof is determined using the time-of-flight device 3. The time-of-flight device 3 is used contemporaneously to the light curtain device 2. The time-of-flight device 3 monitors the monitored zone 6 using light signals 23. When the object 8 is touched by the light signal 23, it reflects the light back towards the time-of-flight device 3. The time-of-flight device 3 detects the light reflected back by the object 8 and calculates a distance d to the object 8 based on a time (time-of-flight) taken for the light signal 23 to travel from the time-of-flight device 3 to the object 8 and back.
  • The size of the object 8 is determined as shown in Fig. 4. In the view of Fig. 4, the time-of-flight device 3 is seen from above. The time-of-flight device 3 comprises a plurality (here seven) emission and reception units 13 for respectively emitting a light beam 11 and receiving a reflected light beam 12. The time-of-flight of the light beams 12 which are reflected by the object 8 are considerably shorter than those which do get reflected by the conveyor belt 10 (not shown) rather than by the object 8. By comparing the time-of-flight of the individual received light beams 12, the time-of-flight device 3 determines which received light beams 12 were reflected by the object 8 and which were not. Based on the number of reflected light beams 12 reflected by the object, the time-of-flight device 3 calculates the size (along the y-direction) of the object 8 using the fact that neighboring emission and reception units 13 are evenly spaced by a predetermined distance α along the time-of-flight device 3. In the example of Fig. 4, three light beams 12 are reflected by the object 8, so that the size of the object 8 along the y-direction is between 2α and 3α.
  • The information about the distance to the object 8 and the size of the object 8 is transmitted to the evaluation device 4 for evaluation.
  • In a step S3 (Fig. 3), the evaluation device 4 emits an evaluation result based on the distance to the object 8, the size of the object 8 and the light curtain signal. The evaluation result provides information about the monitored zone 6, thereby facilitating the monitoring of the monitored zone 6 and the protection of the security zone 7.
  • Fig. 5 shows a monitoring device 1' according to a second embodiment. The monitoring device 1' according to the second embodiment differs from the monitoring device 1 according to the first embodiment in that is further comprises a protection device 15 and a muting device 16. The monitoring device 1' can be used monitor a monitored zone 6 according to the method of the first embodiment (Fig. 3) or according to a method of a second embodiment (Fig. 6).
  • In the following, the functionality of the monitoring device 1' will be described in view of the Fig. 5 - 10.
  • The steps S1 - S3 of the method according to the second embodiment (Fig. 6) are identical to the steps S1 - S3 described in view of Fig. 3. In a step S4 (Fig. 6), a protective measure or a muting is performed. In detail, the protective measure, for example the emission of an alarm or a deactivation of the factory device 22, is performed by the protection device 15 to protect the safety zone 7 and/or the object 8. The muting is an at least partial deactivation of the light curtain device 2 which is performed by the muting device 16. The decision about whether muting or a protective measure is to be performed is made in accordance with the evaluation result. The muting and the performing of the protective measure will be described in detail further below.
  • Once the step S4 has been performed and/or while it is still being performed, the steps S1 - S4 are cyclically repeated to constantly monitor the monitored zone 6.
  • Fig. 7 shows an example of how the evaluation result is determined in the step S3. In detail, in a step S31, the evaluation device 4 determines whether the object 8 is closer to the boundary section 9 than allowed, in particular whether it is outside a safety zone SZ.
  • The safety zone SZ is shown in Fig 9 as a zone of the monitored zone 6 that is furthest away from the boundary section 2. If the evaluation device 4 determines that the distance d to the object 8 is greater than a first predefined distance threshold d1, at it is the case in Fig. 9, it determines that the object 8 is located in the safety zone SZ. However, if the evaluation device 4 determines that the distance d to the object 8 is smaller than the first predefined distance threshold d1 but larger than a second predefined distance threshold d2, it determines that the object 8 is located in the warning zone WZ. Finally, if the evaluation device 4 determines that the distance d to the object 8 is smaller than the second predefined distance threshold d2, it determines that the object 8 is located in the danger zone DZ. The evaluation result is thus emitted in accordance with the zone SZ, WZ, DZ in which the object 8 is located. The protection device 15 performs the protective measure in accordance with the zone SZ, WZ and DZ in which the object 8 is located.
  • Thus, in the step S31 of Fig. 7, when the object 8 is not in the safety zone SZ, the protection device 15 emits an alarm signal as a protective measure in a step S32. Otherwise, if the object 8 is still in the safety zone SZ, the evaluation device 4 determines whether it recognizes the size of the object 8 in a step S33. In detail, the size of the object 8 determined by the time-of-flight device 3 (Fig. 4) is compared to a predetermined size which is prestored in the evaluation unit 4. The predetermined size is the size of an authorized, "white-listed" object 8 which is allowed into the safety zone 7.
  • If the determined size of the object 8 is not equal to the predetermined size, namely when the size is not recognized, the protection device 15 emits an alarm signal as a protective measure in a step S32. Otherwise, the evaluation device 4 performs a pattern verification in a step S34.
  • The pattern verification is described in detail in view of Fig. 8. The upper part of Fig. 8 (Fig. 8 (A)) shows the factory arrangement 17 with the object 8 in four different positions P1 - P4 as it moves along a movement direction MD on the conveyor belt 10. The bottom part of Fig. 8 (Fig. 8 (B)) shows how the distance d to the object 8 determined by the time-of-flight device 3 changes with time as the object 8 moves towards the boundary section 9. This relationship between the distance d and the time is the pattern 14. The evaluation device 4 can determine the pattern 14 based either on individual light signals 23 (namely based on one emitted beam 11 and one received beam 12 at a time) or based on several light signals 23.
  • In the regions 1 and 4 of the pattern 14, the distance d is constant and has a value A. This corresponds to the standard distance between the time-of-flight device 3 and the conveyor belt 10 which is detected when no object 8 reflects the light beam 23 of the time-of-flight device 3. In the region 2 of the pattern 14, the distance d to the object 8 decreases linearly. This corresponds to the light beam 23 getting reflected by a side 24 of the object 8. Finally, in the region 3 of the pattern 14, the distance d to the object is constant at a value of approximatively A - h, with h being the height of the object 8. This corresponds to the light beam 23 being reflected by a top surface 25 of the object 8.
  • In the step S34 of Fig. 7, the evaluation device 4 determines the pattern of the object 8 and compares it to a predetermined pattern stored for authorized objects 8. If the patterns are identical, namely if the determined pattern is recognized, the muting device 16 performs the muting in a step S5. Otherwise, if the patterns are not identical, the protection device 15 emits an alarm signal as a protective measure in step S32.
  • Thus, the evaluation device 4 performs various verifications on the object 8 to determine whether it is allowed to enter the safety zone 8. If the object 8 is an authorized object 8 according to these verifications, the muting device 16 mutes or deactivates at least a part of the light curtain device 2 to let the object 8 enter the safety zone 7.
  • The muting device 16 performs the muting in accordance with the evaluation result, which indicates a height h of the object 8 as determined by the evaluation device 4. In detail, the height of the object 8 is defined as the muting height h along which the light curtain device 2 is temporarily deactivated. In the example of Fig. 10, the bottom two light emitting elements 2a and the bottom two light receiving elements 2b are muted while the upper three light emitting elements 2a and the upper three light receiving elements 2b are not muted. Thus, the muting is optimized to improve the protection of the safety zone 7.
  • In the example of Fig. 10, the evaluation device 4 determines the muting height h using the Pythagorean theorem and/or trigonometry. To further improve the muting, the evaluation device 4 calculates a first and a second instant between which the object 8 will cross the boundary section 9 using an information about the velocity of the conveyor belt 10 and hence of the object 8. The indication about the first and second instants is included in the evaluation result. The muting device 16 then partially mutes the light curtain device 2 precisely during the first and second instants determined by the evaluation device 2. Thereby, the partial muting of the light curtain device 2 is further optimized, thus improving the protection of the safety zone 7.
  • Fig. 11 shows a factory arrangement 18 according to a second embodiment. The factory arrangement 18 according to the second embodiment differs from the factory arrangement 17 according to the first embodiment 18 in that the time-of-flight device 3' is located at a distance D from the boundary section 9 rather than being located at an edge of the boundary section 9.
  • Fig. 12 shows a factory arrangement 19 according to a third embodiment. The factory arrangement 19 according to the third embodiment differs from the factory arrangement 17 according to the first embodiment 18 in that it comprises two time-of-flight devices 3, 3' respectively located at a distance D from the boundary section 9 and at an edge of the boundary section 9. This allows a better monitoring of the monitored zone 6 because complex shapes of the object 8 can be accounted for.
  • Although the present invention has been described in accordance with preferred embodiments, it is obvious for the person skilled in the art that modifications are possible in all embodiments. For example, the evaluation device 4 may calculate the velocity of the object 8 based on consecutive distance measurements made by the time-of-flight device 3 instead of obtaining it from a database.
  • REFERENCE NUMERALS
  • 1, 1'
    monitoring device
    2
    light curtain device
    2a
    light emitting element
    2b
    light receiving element
    3, 3'
    time-of-flight device
    4
    evaluation device
    5
    cable
    6
    monitored zone
    7
    safety zone
    8
    object
    9
    boundary section
    10
    conveyor belt
    11
    emitted beam
    12
    reflected beam
    13
    emission/reception unit
    14
    pattern
    15
    protection device
    16
    muting device
    17 - 19
    factory arrangement
    22
    factory device
    23
    light signal
    24
    side
    25
    top surface
    α
    predetermined distance
    A
    beam distance
    d
    distance
    d1
    first predefined distance threshold
    d2
    second predefined distance threshold
    D
    distance
    DZ
    danger zone
    h
    height
    MD
    movement direction
    P1 - P3
    position
    SZ
    safety zone
    WZ
    warning zone
    S1 - S5
    method steps
    S31 - S34
    method steps

Claims (11)

  1. A monitoring device (1, 1') for monitoring a monitored zone (6) which is adjacent to a safety zone (7), wherein the monitoring device (1, 1') comprises:
    a light curtain device (2) for detecting an object (8) touching a boundary section (9) located at a boundary between the monitored zone (6) and the safety zone (7);
    a time-of-flight device (3, 3') for detecting a distance (d) to the object (8) and/or a size of the object (8);
    an evaluation device (4) for emitting an evaluation result based on the distance (d) to the object (8) and/or on the size of the object (8) determined by the time-of-flight device (3, 3'), and optionally based on a light curtain signal from the light curtain device (2); and
    a muting device (16) for temporarily deactivating the light curtain device (2) along a muting height (h) of the light curtain device (2) as a function of the evaluation result, wherein
    the muting device (16) is configured to determine the muting height (h) of the light curtain device (2) based on an information about the distance to the object (8) included in the evaluation result; and wherein
    the muting device (16) is configured to determine the muting height (h) of the light curtain device (2) such that it is equal to a height of the object (8) derived from the distance to the object (8) included in the evaluation result.
  2. The monitoring device according to claim 1, wherein
    the evaluation device (4) is further configured to determine a pattern (14) indicating an evolution of the distance (d) to the object (8) as a function of time, to compare this pattern (14) to a predetermined pattern and to emit the evaluation result based on a result of the comparison between the pattern (14) and the predetermined pattern.
  3. The monitoring device according to claim 1 or 2, further comprising a protection device (15) for performing a predetermined protective measure based on the evaluation result.
  4. The monitoring device according to one of claims 1 to 3, wherein:
    the evaluation device (4) is configured to determine a velocity of the object (8) based on several consecutive distance measurements performed by the time-of-flight device (3, 3'); and/or
    the time-of-flight device (3, 3') is configured to determine a velocity of the object (8) based on several consecutive distance measurements performed by the time-of-flight device (3, 3') and/or to transmit the determined velocity of the object (8) to the evaluation device (4), in particular upon request from the evaluation device (4).
  5. The monitoring device according to claim 4, wherein the evaluation device (4) is configured to determine a first instant at which the object (8) starts touching the boundary section (9) and/or a second instant at which the object (8) ends touching the boundary section (9) based on the velocity of the object (8) and to include an indication about the first instant and/or the second instant in the evaluation result.
  6. The monitoring device according to any one of claims 1 to 5, wherein the muting device (16) is configured to at least partially deactivate the light curtain device (2) between the first instant and the second instant.
  7. The monitoring device according to any one of claims 1 to 6, wherein the time-of-flight device (3, 3') is configured to emit a plurality of parallel light beams (11) and to determine the size of the object (8) based on a number of light beams (12) reflected by the object (8) and received by the time-of-flight device (3, 3').
  8. The monitoring device according to any one of claims 3 to 7, wherein the protection device (15) is configured to perform the protective measure when the evaluation result indicates that:
    the distance to the object (8) is smaller and/or greater than a predefined distance threshold (d1, d2);
    the size of the object (8) differs from a predetermined size; and/or
    the pattern (14) differs from the predetermined pattern (14).
  9. The monitoring device according to any one of claims 1 to 8, which comprises a plurality of time-of-flight devices (3, 3').
  10. A factory arrangement (17 - 19), comprising:
    a monitored zone (6) delimited by at least one boundary section (9);
    a safety zone (7) delimited by the boundary section (9) and adjacent to the monitored zone (6), wherein, in the safety zone (7), at least one factory device is arranged and implemented to perform a predetermined function; and
    a monitoring device (1, 1') according to any one claims 1 - 9, implemented to detect an object (8) located in the monitored zone (6).
  11. A method for monitoring a monitored zone (6) which is adjacent to a safety zone (7), the method comprising:
    detecting (S1) whether an object (8) touches a boundary section (9) located at a boundary between the monitored zone (6) and the safety zone (7);
    detecting (S2) a distance (d) to the object (8) and/or a size of the object (8); and
    emitting (S3) an evaluation result based on the distance (d) to the object (8) and/or on the size of the object (8), and optionally based on a light curtain signal indicating whether the object (8) touches the boundary section (9); and
    temporarily deactivating the light curtain device (2) along a muting height (h) of the light curtain device (2) as a function of the evaluation result, wherein
    the muting height (h) of the light curtain device (2) is determined based on an information about the distance to the object (8) included in the evaluation result; and wherein
    the muting height (h) of the light curtain device (2) is determined such that it is equal to a height of the object (8) derived from the distance to the object (8) included in the evaluation result.
EP19184024.8A 2018-02-08 2018-07-31 Monitoring device and method for monitoring a monitored zone Active EP3569920B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
IT201800002494A IT201800002494A1 (en) 2018-02-08 2018-02-08 Monitoring device for monitoring a boundary sector of a safety zone.
EP18425060.3A EP3524870B2 (en) 2018-02-08 2018-07-31 Monitoring device and method for monitoring a monitored zone

Related Parent Applications (2)

Application Number Title Priority Date Filing Date
EP18425060.3A Division-Into EP3524870B2 (en) 2018-02-08 2018-07-31 Monitoring device and method for monitoring a monitored zone
EP18425060.3A Division EP3524870B2 (en) 2018-02-08 2018-07-31 Monitoring device and method for monitoring a monitored zone

Publications (2)

Publication Number Publication Date
EP3569920A1 EP3569920A1 (en) 2019-11-20
EP3569920B1 true EP3569920B1 (en) 2020-07-22

Family

ID=62002331

Family Applications (3)

Application Number Title Priority Date Filing Date
EP19184024.8A Active EP3569920B1 (en) 2018-02-08 2018-07-31 Monitoring device and method for monitoring a monitored zone
EP18425060.3A Active EP3524870B2 (en) 2018-02-08 2018-07-31 Monitoring device and method for monitoring a monitored zone
EP19702303.9A Active EP3548792B1 (en) 2018-02-08 2019-02-06 Monitoring device for monitoring a boundary section of a safety zone

Family Applications After (2)

Application Number Title Priority Date Filing Date
EP18425060.3A Active EP3524870B2 (en) 2018-02-08 2018-07-31 Monitoring device and method for monitoring a monitored zone
EP19702303.9A Active EP3548792B1 (en) 2018-02-08 2019-02-06 Monitoring device for monitoring a boundary section of a safety zone

Country Status (6)

Country Link
US (1) US11248744B2 (en)
EP (3) EP3569920B1 (en)
JP (1) JP7165741B2 (en)
CN (1) CN111771079B (en)
IT (1) IT201800002494A1 (en)
WO (1) WO2019154862A1 (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102019206010A1 (en) * 2019-04-26 2020-10-29 Kuka Aktiengesellschaft Method and system for monitoring a robot arrangement
DE102019127373A1 (en) * 2019-10-10 2021-04-15 Dücker conveyor systems GmbH Safety device for securing a danger point, method for controlling a safety device, computer program product and computer-readable recording medium
KR20210061103A (en) * 2019-11-19 2021-05-27 엘지전자 주식회사 Mobile robot and method for operating the same
DE202020101548U1 (en) * 2020-03-23 2020-04-02 Leuze Electronic Gmbh + Co. Kg Monitoring device for securing access to a danger zone with a safety sensor
EP3886068A1 (en) * 2020-03-23 2021-09-29 Leuze electronic GmbH + Co. KG Monitoring device and method for operating same
DE202020102721U1 (en) * 2020-05-14 2020-12-23 Leuze Electronic Gmbh + Co. Kg Monitoring device
EP3910228B1 (en) * 2020-05-14 2023-08-02 Leuze electronic GmbH + Co. KG Monitoring device and method for operating same
CN113740355B (en) * 2020-05-29 2023-06-20 清华大学 Boundary protection method and system for ray detection robot
CN118176383A (en) * 2021-10-29 2024-06-11 鲍勃斯脱里昂公司 Safety system for a conversion machine

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6737970B2 (en) 2000-05-26 2004-05-18 Sick Ag Opto-electronic apparatus for monitoring and detection of intrusion of an object
DE202004020863U1 (en) 2004-09-17 2006-04-06 Sick Ag Safety device used in dangerous work area has upper and lower securing systems that generate signals used in determining position of object within dangerous work area
EP1793244A2 (en) 2005-11-18 2007-06-06 Datasensor S.p.A. System and method of automatically controlling temporary deactivation of a photoelectric barrier
EP2180348B1 (en) 2008-10-22 2011-02-16 Sick Ag Safety light curtain and corresponding method for monitoring a protection area
US8330095B2 (en) 2009-01-31 2012-12-11 Keyence Corporation Safety photoelectric switch
US20170052278A1 (en) 2015-08-17 2017-02-23 Rockwell Automation Safety Ag Dynamic light curtain muting system and method
DE102016116350B3 (en) 2016-09-01 2017-12-14 Sick Ag monitoring device

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE4233810C2 (en) 1992-10-07 2000-02-03 Sick Ag Monitoring device for work machines
WO2001059473A2 (en) 2000-02-08 2001-08-16 Cambridge Consultants Limited Methods and apparatus for obtaining positional information
DE10152543A1 (en) 2001-10-24 2003-05-08 Sick Ag Method and device for controlling a safety-relevant function of a machine
US6859164B2 (en) * 2002-03-01 2005-02-22 Hitachi, Ltd. Detecting system
JP2005045712A (en) * 2003-07-25 2005-02-17 Mitsubishi Electric Corp Monitor system
DE102004041821A1 (en) * 2004-08-27 2006-03-16 Abb Research Ltd. Device and method for securing a machine-controlled handling device
DE102005050824A1 (en) 2004-11-17 2006-05-24 Heidelberger Druckmaschinen Ag Dangerous area protecting method for use in sheet rotation printing machine, involves monitoring dangerous area by sensor, detecting position of object penetrating cross section and activating machine based on detected position
DE102005038019A1 (en) 2005-08-09 2007-02-15 Cedes Ag Sensor device for detecting an overhang at the loading of a carrier device
DE102005061868A1 (en) * 2005-12-23 2007-07-05 Robert Bosch Gmbh Device for determining an object, e.g. a water pipe in a wall, comprises a display for displaying a property of the object and a control unit for controlling the display depending on phase information
DE202006012351U1 (en) 2006-02-25 2006-10-19 Leuze Lumiflex Gmbh + Co. Kg Optical sensor e.g. light grid, for monitoring fire break in e.g. conveyor belt, has analysis unit to analyze characteristics, where region of fire break is bridged by acquiring non-safety critical objects to restrict report generation
DE102007041664A1 (en) * 2006-09-04 2008-04-03 Robert Bosch Gmbh Monitoring device for machine tool i.e. stationary circular saw bench, has detection unit for detecting using condition in machine tool based on detection of human or animal tissue, and sensor arranged above or below working surface
DE102007013299A1 (en) 2007-03-06 2008-09-11 Cedes Ag Sensor device and system with a conveyor and a sensor device
DE102010007520B3 (en) 2010-02-11 2011-05-05 Sick Ag Safety control with a large number of connections for sensors
US20110298579A1 (en) * 2010-06-08 2011-12-08 Cedes Safety & Automation Ag Dynamically adaptable safety zones
DE102010050547A1 (en) 2010-11-05 2012-05-10 Kuka Laboratories Gmbh Method and device for safety monitoring of a robot
DE102012007520B3 (en) 2012-04-17 2013-08-08 Heraeus Quarzglas Gmbh & Co. Kg Process for the production of a cylindrical component from fluorine-containing synthetic quartz glass
US10215852B1 (en) * 2015-10-05 2019-02-26 Google Llc Robotic radar assistance
EP3252364B1 (en) * 2016-05-31 2019-03-27 Inxpect S.p.A. Radar apparatus for forming a protection linear barrier and related system
TWM589336U (en) * 2018-08-27 2020-01-11 信錦企業股份有限公司 Detecting system
DE102019206297A1 (en) * 2019-05-02 2020-04-16 elumatec AG Access security device, profile processing center and method for securing access to a profile processing center

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6737970B2 (en) 2000-05-26 2004-05-18 Sick Ag Opto-electronic apparatus for monitoring and detection of intrusion of an object
EP1164556B1 (en) 2000-05-26 2005-07-27 Sick AG Opto-electronic intruder alarm apparatus
DE202004020863U1 (en) 2004-09-17 2006-04-06 Sick Ag Safety device used in dangerous work area has upper and lower securing systems that generate signals used in determining position of object within dangerous work area
EP1793244A2 (en) 2005-11-18 2007-06-06 Datasensor S.p.A. System and method of automatically controlling temporary deactivation of a photoelectric barrier
EP2180348B1 (en) 2008-10-22 2011-02-16 Sick Ag Safety light curtain and corresponding method for monitoring a protection area
US8330095B2 (en) 2009-01-31 2012-12-11 Keyence Corporation Safety photoelectric switch
US20170052278A1 (en) 2015-08-17 2017-02-23 Rockwell Automation Safety Ag Dynamic light curtain muting system and method
DE102016116350B3 (en) 2016-09-01 2017-12-14 Sick Ag monitoring device

Also Published As

Publication number Publication date
EP3524870A1 (en) 2019-08-14
CN111771079A (en) 2020-10-13
EP3524870B1 (en) 2020-11-04
IT201800002494A1 (en) 2019-08-08
US11248744B2 (en) 2022-02-15
JP7165741B2 (en) 2022-11-04
EP3524870B2 (en) 2023-08-02
EP3569920A1 (en) 2019-11-20
EP3548792A1 (en) 2019-10-09
US20200400275A1 (en) 2020-12-24
WO2019154862A1 (en) 2019-08-15
JP2021513634A (en) 2021-05-27
CN111771079B (en) 2023-07-11
EP3548792B1 (en) 2019-12-25

Similar Documents

Publication Publication Date Title
EP3569920B1 (en) Monitoring device and method for monitoring a monitored zone
US10695908B2 (en) Access protection system
US20200340622A1 (en) Mechanized area controller
US7031807B2 (en) Device and method for securing apparatuses with parts freely movable in space
CA2734873C (en) Radio-frequency identification (rfid) safety system
JP2010503096A (en) Machine tool monitoring device
US9737992B2 (en) Automatic automated installation
EP3459893B1 (en) Elevator sensor array system
EP1833747B1 (en) Elevator safety systems
EP3252364B1 (en) Radar apparatus for forming a protection linear barrier and related system
JP5964636B2 (en) Intrusion monitoring device
JP6011568B2 (en) Passenger conveyor human detection device
CN109716010A (en) Security component and warehousing system for warehousing system
EP4163670A2 (en) A radar system for controlling accesses to an environment
KR100898483B1 (en) Elevator appararus and method of preventing injury to a person riding on top of elevator car in a low-overhead elevator apparatus
KR102087714B1 (en) Object Detection Apparatus for the surroundings of a work truck and method thereof

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20190702

AC Divisional application: reference to earlier application

Ref document number: 3524870

Country of ref document: EP

Kind code of ref document: P

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20191217

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAJ Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted

Free format text: ORIGINAL CODE: EPIDOSDIGR1

GRAL Information related to payment of fee for publishing/printing deleted

Free format text: ORIGINAL CODE: EPIDOSDIGR3

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

INTC Intention to grant announced (deleted)
GRAR Information related to intention to grant a patent recorded

Free format text: ORIGINAL CODE: EPIDOSNIGR71

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AC Divisional application: reference to earlier application

Ref document number: 3524870

Country of ref document: EP

Kind code of ref document: P

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

INTG Intention to grant announced

Effective date: 20200616

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602018006292

Country of ref document: DE

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1293722

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200815

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1293722

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200722

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200722

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200722

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200722

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200722

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200722

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201123

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201022

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201022

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201023

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200722

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200722

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200722

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200722

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201122

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200722

REG Reference to a national code

Ref country code: DE

Ref legal event code: R026

Ref document number: 602018006292

Country of ref document: DE

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20200731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200731

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200722

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200722

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200722

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200722

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200722

PLBI Opposition filed

Free format text: ORIGINAL CODE: 0009260

PLAX Notice of opposition and request to file observation + time limit sent

Free format text: ORIGINAL CODE: EPIDOSNOBS2

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200731

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200722

26 Opposition filed

Opponent name: SICK AG

Effective date: 20210422

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200722

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200922

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200731

PLBB Reply of patent proprietor to notice(s) of opposition received

Free format text: ORIGINAL CODE: EPIDOSNOBS3

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20200722

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210731

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200722

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200722

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200722

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200722

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200722

REG Reference to a national code

Ref country code: DE

Ref legal event code: R100

Ref document number: 602018006292

Country of ref document: DE

PLCK Communication despatched that opposition was rejected

Free format text: ORIGINAL CODE: EPIDOSNREJ1

PLBN Opposition rejected

Free format text: ORIGINAL CODE: 0009273

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: OPPOSITION REJECTED

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20220731

27O Opposition rejected

Effective date: 20221004

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200722

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240716

Year of fee payment: 7

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20240731

Year of fee payment: 7