EP3894349B1 - Container-loading system and method for monitoring operation therein - Google Patents

Container-loading system and method for monitoring operation therein Download PDF

Info

Publication number
EP3894349B1
EP3894349B1 EP20718553.9A EP20718553A EP3894349B1 EP 3894349 B1 EP3894349 B1 EP 3894349B1 EP 20718553 A EP20718553 A EP 20718553A EP 3894349 B1 EP3894349 B1 EP 3894349B1
Authority
EP
European Patent Office
Prior art keywords
container
working area
crane
person
loading
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP20718553.9A
Other languages
German (de)
French (fr)
Other versions
EP3894349C0 (en
EP3894349A1 (en
Inventor
David Moosbrugger
Andreas NATTER
Lars Ambrosy
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hans Kuenz GmbH
LASE Industrielle Lasertechnik GmbH
Original Assignee
Hans Kuenz GmbH
LASE Industrielle Lasertechnik GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hans Kuenz GmbH, LASE Industrielle Lasertechnik GmbH filed Critical Hans Kuenz GmbH
Publication of EP3894349A1 publication Critical patent/EP3894349A1/en
Application granted granted Critical
Publication of EP3894349C0 publication Critical patent/EP3894349C0/en
Publication of EP3894349B1 publication Critical patent/EP3894349B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B66HOISTING; LIFTING; HAULING
    • B66CCRANES; LOAD-ENGAGING ELEMENTS OR DEVICES FOR CRANES, CAPSTANS, WINCHES, OR TACKLES
    • B66C13/00Other constructional features or details
    • B66C13/18Control systems or devices
    • B66C13/46Position indicators for suspended loads or for crane elements
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B66HOISTING; LIFTING; HAULING
    • B66CCRANES; LOAD-ENGAGING ELEMENTS OR DEVICES FOR CRANES, CAPSTANS, WINCHES, OR TACKLES
    • B66C19/00Cranes comprising trolleys or crabs running on fixed or movable bridges or gantries
    • B66C19/002Container cranes
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B66HOISTING; LIFTING; HAULING
    • B66CCRANES; LOAD-ENGAGING ELEMENTS OR DEVICES FOR CRANES, CAPSTANS, WINCHES, OR TACKLES
    • B66C19/00Cranes comprising trolleys or crabs running on fixed or movable bridges or gantries
    • B66C19/007Cranes comprising trolleys or crabs running on fixed or movable bridges or gantries for containers

Definitions

  • the invention relates to a container loading system and a method for operational monitoring with the features of the preambles of the independent claims.
  • a container bridge (STS (Ship-To-Shore) Crane) loads standardized ISO containers from the ship to land, either directly onto trucks, or it transfers the containers to transport vehicles, in particular automated guided vehicles (AGV). Guided Vehicle), which are often designed as straddle carriers and automatically pick up the containers and drive them to a destination. The area on which the AGVs drive is closed to people for safety reasons.
  • STS Chip-To-Shore
  • AGV automated guided vehicles
  • the destination can e.g. This could, for example, be a land-based interim storage facility in which rail-mounted gantry cranes (RMG; Rail Mounted Gantry) or rubber-tired gantry cranes (RTG; Rubber Tired Gantry) unload containers for interim storage.
  • RMG Rail Mounted Gantry
  • RMG Rubber Tired Gantry
  • Vehicles for the road transport of containers are available as trucks with or without a trailer, as well as articulated vehicles consisting of a truck tractor and a container chassis attached like a normal semi-trailer, or as terminal trucks with a terminal trailer.
  • the driver or another person In the case of a loading order for road transport, the driver or another person must walk around the vehicle and unlock the twistlocks on the vehicle before or after loading or unloading lock.
  • the driver When loading a terminal trailer, the driver must check whether the so-called IBCs (Inter Box Connectors, which hold containers together on a ship) have been removed. People can move freely in the space below the crane.
  • IBCs Inter Box Connectors, which hold containers together on a ship
  • the DE 10 2006 044187 A1 discloses a container loading system and a method with the features of the preambles of the independent claims.
  • the EP 2 724 972 B1 discloses a container loading system and a method for the computer-aided determination of the position in which an ISO container is to be placed on a carrier vehicle using a crane, based on a cloud of measuring points representing the top of the carrier vehicle, which is obtained by scanning the carrier vehicle from above from a height of at least 5 meters can be obtained with a 3D laser scanner or two 3D laser scanners mounted at a distance.
  • the proposed 3D laser scanner is formed from a 2D laser scanner, which can be pivoted using a servo motor and is here a time-of-flight infrared laser scanner with a distance resolution of approximately 10 mm. This resolution is required to identify and locate twist locks on the carrier vehicle and to be able to calculate container target position data from this.
  • Such 3D laser scanning provides an essentially complete image of the measurement scene in the form of relatively dense three-dimensional point clouds.
  • Camera-based systems with image analysis can be used to monitor the danger area for people who are in it during the automatic loading or unloading of road transport vehicles in order to trigger an alarm or emergency stop if necessary. Due to inadequacies of such systems or e.g. However, due to restricted visibility and/or adverse weather conditions, false positive or false negative hazard detections can occur, resulting in personal injury and corresponding downtime. Therefore, it is It would be desirable to be able to recognize and locate people in the work area in at least one additional way and thus ensure special redundancy.
  • the invention is based on the object of improving occupational safety when loading containers with acceptable effort.
  • the laser scanners are of a type adapted to scan the work surface simultaneously in several spaced planes or lines, emitting a fan of diverging planes of light beams or a fan of diverging individual light beams.
  • the planes or lines are at a distance from one another that is in at least one direction on the floor, e.g. B. in the longitudinal direction of the loading position and / or transversely to it, is larger than 10 and smaller than 30 centimeters.
  • a person recognition unit that is set up to scan the laser scanner(s) at least once during a container loading process to be carried out in order to obtain a measurement point cloud; in the measurement point cloud obtained in this way, e.g. B. to identify the work area and the loading area of the road transport vehicle by averaging and/or eliminating outliers; to determine whether in the measurement point cloud there is at least one or, in a preferred embodiment, at least two adjacent measurement points located more than 0.5 meters or alternatively more than 1 meter above the identified work surface or the identified loading area, and if there is at least one such measurement point to output a person probable signal, which indicates that there is probably a person at the corresponding location.
  • each of the laser scanners is a 3D multilayer scanner.
  • a 3D multi-level scanner or 3D multi-layer scanner is commercially available and is e.g. B. in the EP 2 983 030 A2 described, which reveals that in many applications there is a desire to capture the environment in more than just a single plane, especially in mobile applications, such as driverless vehicles, where there is a requirement to recognize the ground with edges and shoulders as well as objects , which protrude into the driving area at different heights.
  • the sensor as a whole or the rotating mirror is also periodically tilted, it is sufficient if not an entire area of space can be monitored, but only a few layers layered on top of each other.
  • the invention includes the new purpose of multilayer laser scanners, not to use them to detect objects that lie more or less horizontally in front of the scanner by layering the scanning planes on top of each other, but rather to detect people who are more or less vertically below the scanner, in container handling zones, with the scanning levels stacked next to each other.
  • multilayer laser scanners not to use them to detect objects that lie more or less horizontally in front of the scanner by layering the scanning planes on top of each other, but rather to detect people who are more or less vertically below the scanner, in container handling zones, with the scanning levels stacked next to each other.
  • 3D array scanners As an alternative to multilayer laser scanners, so-called 3D array scanners or flash LiDAR devices can also be used for the invention.
  • Such devices have an array of laser diodes that simultaneously emit a fan of diverging individual light beams, whereby a complete 3D image is immediately available.
  • a z. B. a 2 x 2 meter person stay zone is marked on the work surface, and the safety device only allows crane movements if a person probable signal is issued for the person stay zone, but not for the rest of the work area, thereby detecting that there are people in the person stay zone, but there is no person in the rest of the work area.
  • the work surface is divided into several zones, namely at least one inner zone which includes at least the loading position, i.e. H. either equal to or greater than the loading position, and an outer zone extending around and adjacent to the inner zone.
  • at least one measuring point is more than 0.5 meters (or alternatively more than 1 meter) above the identified work surface or the identified loading area, a person probable signal is issued .
  • the crane movement is slowed down or stopped.
  • the location and size of the zones into which the work area is divided can be dynamically changed during operation of the system and adapted to the location and direction of movement of a container that has just been loaded.
  • an emergency stop does not have to take place immediately, but a gradual reaction can take place, e.g. B. initially a mere warning when it is detected that a person is approaching the outer zone, then a slower operation of the crane when the person enters the outer zone, and an emergency stop only when the person enters the inner one Zone enters.
  • one or more 3D laser scanners being used from a height above the floor that exceeds the height of an ISO container by several times during a container loading, setting down or lifting process the work surface can be scanned in three dimensions from above
  • the laser scanner or scanners are scanned the work surface with a fan of diverging planes of light beams or a fan of diverging individual light beams simultaneously in several spaced-apart planes or lines in order to achieve a
  • the planes or lines at the height of the work surface being at a distance from one another which is dimensioned such that a person standing on the work surface is hit by at least one plane of light rays or at least one of the individual light rays.
  • the work area is first identified in the measurement point cloud obtained in this way. It is then determined whether there are at least one or more measurement points in the measurement point cloud that are typical for a person standing on the identified work surface. If there is one or, in preferred embodiments, at least two adjacent such measuring points, the crane movement is slowed or stopped.
  • crane movements are not slowed down or stopped, but remain permitted if one or more measuring points typical of a person standing on the identified work surface are for a predetermined area at the edge of the work surface, but not for a central one Area of the work surface can be determined.
  • a plurality of zones are defined within the work surface, namely at least an inner zone directly below a container hanging on the crane and an outer zone extending around and adjacent to the inner zone.
  • Crane movements are only permitted if one or more measuring points that are typical of a person standing on the identified work area are not determined in the inner or outer zone.
  • Crane movements are slowed down if one or more measuring points typical of a person standing on the identified work surface are determined in the outer zone and not in the inner zone. Crane movements are stopped when one or more measuring points typical of a person standing on the identified work surface are detected in the inner zone.
  • Human activity is required for the loading of goods in the area (portal) of a ship-to-shore crane (STS crane) in container ports.
  • This can e.g. B. Be a signaller for trucks, or people who remove the so-called IBCs (Inter Box Connectors, which hold containers standing on top of each other on a ship together) from the containers before they are placed on the ground or on a truck chassis.
  • IBCs Inter Box Connectors, which hold containers standing on top of each other on a ship together
  • These people can move freely in the portal area. Limited visibility, carelessness and/or adverse weather conditions can result in personal injury and therefore downtime when setting down or picking up the load.
  • a redundant system for object detection and tracking in a defined workspace is proposed. In this way, the whereabouts of every person in the danger area can be determined and, in the event of danger, for example.
  • B. the hoist function of the crane can be stopped. The system is able to detect and locate people in the work area while containers are being loaded and continuously return their position to the crane control.
  • Fig. 1 shows a lower part of a container crane, here an RMG gantry crane 1, which can travel on rails on a floor 2 of a port or other container handling point and which forms a loading facility or part of it.
  • a work surface 3 on the floor 2 which is in Fig. 2 is shown from above, to the same scale as in Fig. 1 .
  • the truck 5 has a loading area 5a and a driver's cab 5b.
  • the container crane can also be an RTG crane or an STS crane.
  • the work area to be monitored in which people can and may stay, can e.g. B. be a cuboid, which is delimited by the floor 2 and by two vertical supports 6, 7 and cross beams 8 of the gantry crane 1.
  • the work space to be monitored can also be smaller and extend above a work surface 3, that doesn't quite reach the supports, such as: Am Fig. 2 , which the situation of Fig. 1 on the same scale in plan view.
  • the working surface 3 extends between the vertical supports 6, 7 of the gantry crane 1.
  • container cranes such as a so-called cantilever RMG crane, which deposits containers over the side, or with an STS crane
  • the The work surface can also be completely or partially outside the crane supports, in the case of an STS crane in its so-called backreach area.
  • two 3D laser scanners 10 are mounted, which are set up to monitor the work area by scanning the work surface 3, including the truck 5 standing on it, in three dimensions from above.
  • a 3D laser scanner 10 at a height of z. B. 10 or 20 meters close to a front left vertical support 6 and to a rear right vertical support that comes from the in Fig. 1 visible front right vertical support 7 is covered, i.e. close to two diagonal vertical supports 6, 7, so that the 3D laser scanners 10 lie vertically above two diagonal corners of the work surface 3, as in Fig. 2 indicated.
  • the two 3D laser scanners 10 are further apart than the diagonal of the marked loading position 4 measures.
  • the laser scanners 10 are each a 3D multilayer scanner or alternatively a 3D array scanner or flash LiDAR device.
  • the laser scanners 10 can - as in this exemplary embodiment - be expediently attached to the crane, but embodiments are also possible in which the laser scanners are attached to pillars or light poles, which can already be present on the company premises, provided they are close enough to the work area lie and do not hinder the crane's operation. In any case, the laser scanners 10 will scan the work surface 3 predominantly not exactly from above, but more or less obliquely from above.
  • the laser scanners 10 are also designed and oriented so that they cover the entire work surface 3 - with the exception of those between the levels or lines of the Laser scanner 10 existing gaps - can fully monitor, each of the two laser scanners 10 being responsible for one of two L-shaped subzones 11, 12, which complement each other to form a rectangle corresponding to the work surface 3 around the loading position 4. This avoids shading of parts of the work surface 3 by the truck 5 or a container 9 standing on it or hanging vertically above it.
  • the scanning planes preferably run parallel to the longitudinal direction of the loading position 4.
  • the loading system described above can also use another crane instead of the gantry crane 1, such as. B. have a container bridge, which transports containers from the ship directly to the truck or vice versa.
  • truck lanes and truck loading positions can run across the quay or in the longitudinal direction.
  • a person recognition unit allows the laser scanner 10 to continuously carry out scans during a container loading process, e.g. B. one every second or every tenth of a second.
  • a measurement point cloud in which the floor 2 or the work surface 3 and the loading area 5a of the truck 5 are identified is sufficient.
  • the work space could be divided into many virtual cuboids with dimensions adapted to the resolution of the laser scanner 10, and the tops of all cuboids into which a measuring point falls are then taken as the profile of the bottom of the work surface 3 and the loading area 5a of the truck 5 , after eliminating cuboids that easily represent the driver's cab 5b.
  • a person probable signal is output, which indicates that there is probably a person at this location.
  • an object probable signal can be output if there is a measuring point or cuboid that is less than 0.5 meters, but e.g. B. is more than 30 centimeters above the identified work surface or the identified loading area, since in this case there is probably an object on the floor or on the loading area that does not belong there and e.g. B. represents a tripping hazard or an obstacle to setting down.
  • a safety device ensures that the crane movement stops and sends a request to a control station or to the crane operator and/or to the truck driver to clarify the situation .
  • the truck driver is therefore not allowed to be on the work surface 3 so that loading can be carried out quickly. However, it may be in the driver's cab 5b of the truck 5 or outside the work area 3.
  • the driver is or is encouraged to go to a personal stay zone 13 measuring approximately 2 x 2 meters before the loading process, which is marked on the floor in a corner of the work surface 3, as in Fig. 2 illustrated.
  • the crane activity is only permitted as long as it is recognized by the laser scanner 10 that there is probably a person in the people's stay zone 13, but not on the work surface 3 or on the loading area 5a of the truck 5.
  • Embodiments additionally determine whether there are at least one or more measuring points in the measuring point cloud that are typical for the truck 5 and in particular for its driver's cab 5b and whose locations in the measuring point cloud change over time. This shows that the truck 5 is moving during a container lowering or lifting process, e.g. B. because the driver carelessly sets off too early so that crane movements can be stopped in time.
  • FIG. 3 A further exemplary embodiment will now be explained, which - like the previous exemplary embodiment - is not only particularly suitable for operational monitoring of work areas of gantry cranes or container bridges, but also for other work areas in the port where containers are or are being deposited.
  • This can e.g. This could, for example, be a work area on the ship where containers are briefly placed in order to assemble or remove Inter Box Connectors by hand.
  • systems and methods described here can also be used in other areas in container handling areas in ports or elsewhere, even where people do not actually have access, but e.g. B. could accidentally get into fully automated work areas.
  • Fig. 3 shows from above a work surface 3 under a container crane, which is just like in the exemplary embodiment of Fig. 2 is rectangular, with a length and width that matches the size of the container crane used here.
  • Laser scanner 10 scans the entire work surface 3 of Fig. 3 again and again from above, e.g. B. ten times per second, and in particular detect a container 9, which is hanging here on the crane at a height at which the container 9 could now or at least after further lowering collide with a person standing or walking unfavorably on the work surface 3, as well a person 16 who is here in a corner of the Work surface 3 is standing.
  • the laser scanners 10 record the directions and speeds of movement of the container 9 and the person 16, which in Fig. 3 are shown as motion vectors using arrows.
  • an inner zone 14 is virtually formed horizontally around the container 9, and an outer zone 15 is virtually formed horizontally around the inner zone 14.
  • the inner zone 14 and the outer zone 15 can be smaller than in Fig. 3 shown, e.g. B. such that the inner zone 14 of the loading position 4 in Fig. 2 corresponds and the outer zone 15 corresponds to the two sub-zones 11, 12 in Fig. 2 corresponds.
  • the inner zone 14 and the outer zone 15 are made larger in the direction of movement, the faster the container 9 moves, as in Fig. 3 illustrated.
  • Such a zone or safety zone that dynamically changes depending on the direction and speed of movement can also be placed around the person 16 (in Fig. 3 not shown), with which the movement of the person 16 can be anticipated. If the recognized person 16 is in a danger area, i.e. the inner zone 14 and/or the outer zone 15, or the safety zone around the person 16 begins to penetrate into the outer zone 15, or conversely, the container 9 approaches the person 16 , the corresponding movements of the trolley, hoist and chassis of the crane are slowed down or stopped.
  • the laser scanners 10 scan in the same way as in the exemplary embodiment of Figures 1 and 2 the work surface 3 with a fan of diverging planes of light rays or individual light rays simultaneously in several spaced-apart planes or lines in order to obtain a measuring point cloud, the planes or lines at the height of the work surface 3 being at a distance from one another which is dimensioned in this way is that a person standing on the work surface of at least one plane is hit by light rays or at least one of the individual light rays (step S1 in Fig. 4 ).
  • the planes or lines at the height of the work surface 3 should be on the floor in at least one direction, e.g. B. in the longitudinal direction of the loading position and / or transversely to it, not larger than 30 centimeters, although smaller minimum distances such as. B. 10 or 20 centimeters or any intermediate values are possible.
  • the work surface 3 is also identified in the measurement point cloud obtained in step S1 (step S2 in Fig. 4 ).
  • step S3 in Fig. 4 It is then determined whether there are at least one or more measurement points in the measurement point cloud that are typical for a person standing on the identified work surface (step S3 in Fig. 4 ). If no such measurement point is determined, it goes back to step S1 to obtain a new measurement point cloud.
  • the crane movement can be slowed down or stopped without any further conditions (step S4 in Fig. 4 ), e.g. B. if the work surface 3 is designed from the outset so that no person should stay there as long as the container 9 is moving, or z. B. in special cases such as test or calibration runs.
  • step S3 it is preferably additionally determined whether the person 16 or their own security zone is in the outer zone 15 and not in the inner zone 14 or whether it overlaps with it. If so, crane movements are slowed down in step S4. In addition, in step S3 it is determined whether the person 16 or their own security zone is in the inner zone 14 or overlaps with it. If so, crane movements are stopped in step S4. This means that crane movements are only permitted if the person 16 or their own safety zone is not in the inner or outer zone.
  • Warning signals are preferably also issued when the person 16 approaches the outer zone 15 and before crane movements are slowed down.
  • steps S2 and S3 or S3 and S4 it can also be determined whether there are measurement points in the measurement point cloud that are typical for the truck 5 or its driver's cab 5b and / or loading area 5a and whose locations in the measurement point cloud change over time change. If this is the case, this indicates that the truck 5 is moving, after which crane movements are also stopped.
  • the method described above can be expanded to also detect foreign objects in the work area, in particular those that are larger than, for example, B. 30 centimeters to slow down or stop crane movements if necessary, so that the crane operator or person 16 has the opportunity to clarify the situation.
  • Objects that have been accidentally left lying can occur not only on work surfaces 3, but also on truck loading areas 5a, and with the method described, material damage can be avoided when the container is set down.
  • Objects in the work area can be distinguished and classified accordingly not only by their perceived size, but also by the fact that people working there often move around.
  • the means and methods described above which are provided as hardware and software, can be linked to other hardware components and software algorithms for person and object recognition in order to produce a redundant overall system.
  • the availability and thus also the security of the system are increased.
  • cameras can also be used to monitor the presence of people in safe or unsafe areas can be detected.
  • RFID Radio Frequency Identification
  • locations of people in the work area e.g. B. can be recognized using triangulation based on signals that are sent back by an RFID transponder that people are supposed to carry with them, although there can also be people in a container terminal who do not carry an RFID transponder, which is of course important for laser-based person recognition is not necessary.
  • Each of the different systems works independently and provides the aforementioned information about recognized people. However, the data from the individual systems can be merged in an evaluation software. If at least one system reports a dangerous situation, instructions for suitable countermeasures to avoid the dangerous situation are sent to the crane control system. Ideally, all existing systems report the same information. For availability and safety in dangerous situations, it is sufficient if one of the systems reports a dangerous situation. Such a laser camera, laser RFID or laser camera RFID fusion also facilitates occupational safety certification.

Description

Gebiet der ErfindungField of invention

Die Erfindung betrifft eine Container-Verladeanlage und ein Verfahren zur Betriebsüberwachung mit den Merkmalen der Oberbegriffe der unabhängigen Patentansprüche.The invention relates to a container loading system and a method for operational monitoring with the features of the preambles of the independent claims.

Technischer HintergrundTechnical background

In einem Container-Terminal lädt eine Containerbrücke (engl. STS (Ship-To-Shore) Crane) genormte ISO-Container vom Schiff an Land, entweder direkt auf LKW, oder sie übergibt die Container an Transportfahrzeuge, insbesondere fahrerlose Transportfahrzeuge (AGV; Automated Guided Vehicle), die oft als Portalhubwagen ausgebildet sind und die Container automatisch aufnehmen und zu einem Bestimmungsort fahren. Die Fläche, auf der die AGV fahren, ist zur Sicherheit für Personen gesperrt.In a container terminal, a container bridge (STS (Ship-To-Shore) Crane) loads standardized ISO containers from the ship to land, either directly onto trucks, or it transfers the containers to transport vehicles, in particular automated guided vehicles (AGV). Guided Vehicle), which are often designed as straddle carriers and automatically pick up the containers and drive them to a destination. The area on which the AGVs drive is closed to people for safety reasons.

Der Bestimmungsort kann z. B. ein landseitiges Zwischenlager sein, in dem schienengebundene Portalkräne (RMG; Rail Mounted Gantry) oder gummibereifte Portalkräne (RTG; Rubber Tyred Gantry) Container zur Zwischenlagerung abladen.The destination can e.g. This could, for example, be a land-based interim storage facility in which rail-mounted gantry cranes (RMG; Rail Mounted Gantry) or rubber-tired gantry cranes (RTG; Rubber Tired Gantry) unload containers for interim storage.

Innerhalb oder außerhalb des Portals gibt es Übergabespuren, über die Container angeliefert oder abgeholt werden. Die Übergabe erfolgt unter manueller Kransteuerung durch einen Kranführer.There are transfer lanes inside or outside the portal through which containers are delivered or picked up. The handover takes place under manual crane control by a crane operator.

Fahrzeuge für den Straßentransport von Containern gibt es als LKW mit oder ohne Anhänger sowie als Sattelkraftfahrzeuge bestehend aus einer LKW-Zugmaschine und einem wie ein normaler Sattelauflieger angehängten Containerchassis oder als Terminal-LKW mit Terminal-Anhänger. Bei einem Verladeauftrag für Straßentransport muss der Fahrer oder eine andere Person vor bzw. nach dem Be- oder Entladen um das Fahrzeug herum gehen und die Twistlocks am Fahrzeug entriegeln oder verriegeln. Bei einem Verladeauftrag mit Terminal-Anhänger muss der Fahrer kontrollieren, ob die so genannten IBCs (Inter Box Connectoren, die Container auf einem Schiff zusammenhalten) entfernt worden sind. Die Personen können sich frei in dem Raum unterhalb des Krans bewegen.Vehicles for the road transport of containers are available as trucks with or without a trailer, as well as articulated vehicles consisting of a truck tractor and a container chassis attached like a normal semi-trailer, or as terminal trucks with a terminal trailer. In the case of a loading order for road transport, the driver or another person must walk around the vehicle and unlock the twistlocks on the vehicle before or after loading or unloading lock. When loading a terminal trailer, the driver must check whether the so-called IBCs (Inter Box Connectors, which hold containers together on a ship) have been removed. People can move freely in the space below the crane.

Die DE 10 2006 044187 A1 offenbart eine Container-Verladeanlage und ein Verfahren mit den Merkmalen der Oberbegriffe der unabhängigen Patentansprüche.The DE 10 2006 044187 A1 discloses a container loading system and a method with the features of the preambles of the independent claims.

Die EP 2 724 972 B1 offenbart eine Container-Verladeanlage und ein Verfahren zur rechnergestützten Bestimmung der Position, in der ein ISO-Container mittels eines Krans auf ein Trägerfahrzeug aufzusetzen ist, anhand einer die Oberseite des Trägerfahrzeugs repräsentierenden Wolke von Messpunkten, die durch Abtasten des Trägerfahrzeugs von oben aus einer Höhe von mindestens 5 Metern mit einem 3D-Laserscanner oder zwei im Abstand angebrachten 3D-Laserscannern gewonnen werden. Der vorgeschlagene 3D-Laserscanner ist aus einem 2D-Laserscanner gebildet, der mittels eines Servomotors schwenkbar ist und hier ein Laufzeit-Infrarot-Laserscanner mit einer Abstandsauflösung von ungefähr 10 mm ist. Diese Auflösung wird benötigt, um Twistlocks am Trägerfahrzeug zu identifizieren und lokalisieren und daraus Container-Zielpositionsdaten berechnen zu können.The EP 2 724 972 B1 discloses a container loading system and a method for the computer-aided determination of the position in which an ISO container is to be placed on a carrier vehicle using a crane, based on a cloud of measuring points representing the top of the carrier vehicle, which is obtained by scanning the carrier vehicle from above from a height of at least 5 meters can be obtained with a 3D laser scanner or two 3D laser scanners mounted at a distance. The proposed 3D laser scanner is formed from a 2D laser scanner, which can be pivoted using a servo motor and is here a time-of-flight infrared laser scanner with a distance resolution of approximately 10 mm. This resolution is required to identify and locate twist locks on the carrier vehicle and to be able to calculate container target position data from this.

Ein derartiges 3D-Laserscanning liefert ein im Wesentlichen vollständiges Abbild der Messszene in Form von relativ dichten dreidimensionalen Punktwolken.Such 3D laser scanning provides an essentially complete image of the measurement scene in the form of relatively dense three-dimensional point clouds.

Dieses und andere Verfahren ermöglichen es inzwischen, grundsätzlich auch die Krantätigkeit bei der LKW-Abfertigung weitgehend zu automatisieren, doch muss dabei unbedingt die Arbeitssicherheit gewährleistet sein, die bislang z. B. dadurch erreicht wird, dass der Kranführer einer Person im Arbeitsbereich wie z. B. einem LKW-Fahrer Funkkontakt hält und Anweisungen geben und empfangen kann.This and other processes now make it possible to largely automate the crane work in truck handling, but it is essential that occupational safety is guaranteed, which has so far been the case, for example. B. is achieved by the crane operator being in the work area such as. B. maintains radio contact with a truck driver and can give and receive instructions.

Zur Überwachung des Gefahrenbereichs auf Personen, die sich beim automatischen Be- oder Entladen von Straßentransportfahrzeugen darin aufhalten, um nötigenfalls einen Alarm oder Notstopp auszulösen, kann man kamerabasierte Systeme mit Bildauswertung verwenden. Aufgrund von Unzulänglichkeiten solcher Systeme oder z. B. durch Sichteinschränkungen und/oder widrige Wetterbedingungen kann es jedoch zu falsch positiven oder falsch negativen Gefahrenerkennungen und in der Folge zu Personenschäden und entsprechenden Ausfallzeiten kommen. Daher ist es wünschenswert, Personen im Arbeitsbereich auf mindestens eine weitere Art erkennen und lokalisieren zu können und damit für besondere Redundanz zu sorgen.Camera-based systems with image analysis can be used to monitor the danger area for people who are in it during the automatic loading or unloading of road transport vehicles in order to trigger an alarm or emergency stop if necessary. Due to inadequacies of such systems or e.g. However, due to restricted visibility and/or adverse weather conditions, false positive or false negative hazard detections can occur, resulting in personal injury and corresponding downtime. Therefore, it is It would be desirable to be able to recognize and locate people in the work area in at least one additional way and thus ensure special redundancy.

In der Messpunktwolke eines 3D-Laserscanners zur Positionsbestimmung von Containern und LKW könnte man prinzipiell auch erkennen, ob irgendwo etwas im Weg steht, was dort nicht hin gehört, jedoch ist die Zeit, die es braucht, um einen derartigen relativ hoch aufgelösten Scan zu gewinnen, um mehrere Größenordnungen zu lang, um auch die Anwesenheit von Personen im Arbeitsbereich erkennen zu können, zumal wenn sie sich bewegen. Insbesondere müssen bislang verwendete 3D-Laserscanner als Ganzes von einer Position in die nächste gedreht werden, wo sie jeweils kurz stehen bleiben, um ein Schnittprofil zu gewinnen. Man könnte allenfalls erwägen, sehr viele einzelne 3D-Laserscanner zu verwenden, die jeweils nur einen kleinen Ausschnitt der Szenerie betrachten, doch würde so etwas den apparativen und rechnerischen Aufwand vervielfachen.In principle, you could also see in the measurement point cloud of a 3D laser scanner for determining the position of containers and trucks whether there is something in the way that doesn't belong there, but the time it takes to obtain such a relatively high-resolution scan is , several orders of magnitude too long to be able to detect the presence of people in the work area, especially if they are moving. In particular, the 3D laser scanners used so far have to be rotated as a whole from one position to the next, where they stop briefly in order to obtain a cutting profile. At best, one could consider using a large number of individual 3D laser scanners, each of which only looks at a small section of the scene, but such a thing would multiply the equipment and computational effort.

Kurzdarstellung der ErfindungBrief description of the invention

Der Erfindung liegt die Aufgabe zu Grunde, die Arbeitssicherheit bei der Containerverladung mit akzeptablen Aufwand zu verbessern.The invention is based on the object of improving occupational safety when loading containers with acceptable effort.

Diese Aufgabe wird durch eine Container-Verladeanlage und ein Verfahren mit den in den unabhängigen Patentansprüchen angegebenen Merkmalen gelöst. Vorteilhafte Weiterbildungen der Erfindung sind in den abhängigen Patentansprüchen angegeben.This task is solved by a container loading system and a method with the features specified in the independent patent claims. Advantageous developments of the invention are specified in the dependent claims.

Gemäß der Erfindung sind die Laserscanner von einem Typ, der dafür eingerichtet ist, die Arbeitsfläche gleichzeitig in mehreren voneinander beabstandeten Ebenen oder Linien abzutasten, wobei er einen Fächer von divergierenden Ebenen von Lichtstrahlen oder einen Fächer von divergierenden Einzel-Lichtstrahlen aussendet. Auf Höhe der Arbeitsfläche haben die Ebenen oder Linien einen Abstand voneinander, der in mindestens einer Richtung auf dem Boden, z. B. in Längsrichtung der Ladeposition und/oder quer dazu, größer als 10 und kleiner als 30 Zentimeter ist.According to the invention, the laser scanners are of a type adapted to scan the work surface simultaneously in several spaced planes or lines, emitting a fan of diverging planes of light beams or a fan of diverging individual light beams. At the height of the work surface, the planes or lines are at a distance from one another that is in at least one direction on the floor, e.g. B. in the longitudinal direction of the loading position and / or transversely to it, is larger than 10 and smaller than 30 centimeters.

Außerdem gibt es eine Personenerkennungseinheit, die dafür eingerichtet ist, den oder die Laserscanner während eines Containerverladevorgangs mindestens einen Scan durchführen zu lassen, um eine Messpunktwolke zu gewinnen; in der so gewonnenen Messpunktwolke, z. B. durch Mittelwertbildung und/oder Eliminieren von Ausreißern, die Arbeitsfläche und die Ladefläche des Straßentransportfahrzeugs zu identifizieren; zu ermitteln, ob es in der Messpunktwolke mindestens einen oder in einer bevorzugten Ausführungsform mindestens zwei benachbarte mehr als 0,5 Meter oder alternativ mehr als 1 Meter über der identifizierten Arbeitsfläche oder der identifizierten Ladefläche liegende Messpunkte gibt, und wenn es mindestens einen derartigen Messpunkt gibt, ein Person-Wahrscheinlich-Signal auszugeben, welches anzeigt, dass sich an dem entsprechenden Ort wahrscheinlich eine Person befindet.There is also a person recognition unit that is set up to scan the laser scanner(s) at least once during a container loading process to be carried out in order to obtain a measurement point cloud; in the measurement point cloud obtained in this way, e.g. B. to identify the work area and the loading area of the road transport vehicle by averaging and/or eliminating outliers; to determine whether in the measurement point cloud there is at least one or, in a preferred embodiment, at least two adjacent measurement points located more than 0.5 meters or alternatively more than 1 meter above the identified work surface or the identified loading area, and if there is at least one such measurement point to output a person probable signal, which indicates that there is probably a person at the corresponding location.

Außerdem gibt es eine Sicherheitseinrichtung, die dafür eingerichtet ist, die Kranbewegung zu verlangsamen oder zu stoppen, wenn das Person-Wahrscheinlich-Signal ausgegeben wird, wobei zunächst oder zusätzlich ein Warnsignal ausgegeben werden kann.There is also a safety device designed to slow or stop the crane movement when the person-probable signal is issued, whereby a warning signal can be issued first or in addition.

In einer bevorzugten Ausführungsform ist jeder der Laserscanner ein 3D-Multilayer-Scanner. Ein derartiger Scanner, auch 3D-Mehrebenenscanner oder 3D-Mehrschichtscanner genannt, ist im Handel erhältlich und ist z. B. in der EP 2 983 030 A2 beschrieben, welche offenbart, dass in vielen Anwendungen der Wunsch besteht, das Umfeld nicht nur in einer einzigen Ebene zu erfassen, insbesondere in mobilen Anwendungen, etwa bei führerlosen Fahrzeugen, wo die Anforderung besteht, den Boden mit Kanten und Absätzen ebenso zu erkennen wie Objekte, die in unterschiedlichen Höhen in den Fahrbereich ragen. Statt dreidimensionale Scanner zu verwenden, in denen der Sensor als Ganzes oder der Drehspiegel zusätzlich periodisch verkippt wird, genüge es, wenn nicht ein ganzer Raumbereich, sondern nur einige übereinander geschichtete Ebenen überwacht werden können.In a preferred embodiment, each of the laser scanners is a 3D multilayer scanner. Such a scanner, also called a 3D multi-level scanner or 3D multi-layer scanner, is commercially available and is e.g. B. in the EP 2 983 030 A2 described, which reveals that in many applications there is a desire to capture the environment in more than just a single plane, especially in mobile applications, such as driverless vehicles, where there is a requirement to recognize the ground with edges and shoulders as well as objects , which protrude into the driving area at different heights. Instead of using three-dimensional scanners in which the sensor as a whole or the rotating mirror is also periodically tilted, it is sufficient if not an entire area of space can be monitored, but only a few layers layered on top of each other.

Die Erfindung beinhaltet den neuen Einsatzzweck von Multilayer-Laserscannern, diese nicht zur Erkennung von Objekten zu verwenden, die mehr oder weniger horizontal vor dem Scanner liegen, indem die Scanebenen übereinander geschichtet sind, sondern zur Erkennung von Personen, die sich mehr oder weniger vertikal unter dem Scanner befinden, in Containerumschlagzonen, wobei die Scanebenen nebeneinander geschichtet sind. Anders als bei herkömmlichem 3D-Laserscanning erhält man nur ein unvollständiges Abbild der Messszene, was bei geeigneter Wahl der Abstände zwischen den Ebenen jedoch ausreicht, um zu erkennen, ob sich in der Messszene wahrscheinlich eine Person befindet oder nicht, und dieses Abbild der Messszene erhält man in einer sehr kurzer Zeit, die höchstens in der Größenordnung 1/10 Sekunde und oft noch viel weniger liegt, so dass auch die Erkennung von sich bewegenden Personen möglich ist.The invention includes the new purpose of multilayer laser scanners, not to use them to detect objects that lie more or less horizontally in front of the scanner by layering the scanning planes on top of each other, but rather to detect people who are more or less vertically below the scanner, in container handling zones, with the scanning levels stacked next to each other. Unlike conventional 3D laser scanning, you only get an incomplete image of the measurement scene, which is possible if the distances are chosen appropriately However, between the levels is sufficient to recognize whether there is probably a person in the measurement scene or not, and this image of the measurement scene is obtained in a very short time, which is at most in the order of 1/10 of a second and often much less , so that the detection of moving people is also possible.

Alternativ zu Multilayer-Laserscannern können für die Erfindung auch sog. 3D-Array-Scanner oder Flash-LiDAR-Geräte verwendet werden. Derartige Geräte besitzen ein Array von Laserdioden, die gleichzeitig einen Fächer von divergierenden Einzel-Lichtstrahlen aussenden, wobei sofort ein komplettes 3D-Bild zur Verfügung steht.As an alternative to multilayer laser scanners, so-called 3D array scanners or flash LiDAR devices can also be used for the invention. Such devices have an array of laser diodes that simultaneously emit a fan of diverging individual light beams, whereby a complete 3D image is immediately available.

In bevorzugten Ausführungsformen ist nahe an einem Rand oder einer Ecke der Arbeitsfläche eine z. B. 2 x 2 Meter messende Personenaufenthaltszone auf der Arbeitsfläche markiert, und die Sicherheitseinrichtung erlaubt Kranbewegungen nur dann, wenn für die Personenaufenthaltszone, aber nicht für die übrige Arbeitsfläche ein Person-Wahrscheinlich-Signal ausgegeben und damit detektiert wird, dass sich in der Personenaufenthaltszone, aber nicht in der übrigen Arbeitsfläche eine Person befindet.In preferred embodiments, a z. B. a 2 x 2 meter person stay zone is marked on the work surface, and the safety device only allows crane movements if a person probable signal is issued for the person stay zone, but not for the rest of the work area, thereby detecting that there are people in the person stay zone, but there is no person in the rest of the work area.

In bevorzugten Ausführungsformen ist die Arbeitsfläche in mehrere Zonen unterteilt, nämlich mindestens in eine innere Zone, die mindestens die Ladeposition umfasst, d. h. entweder der Ladeposition entspricht oder größer ist, und eine äußere Zone, die sich um die innere Zone herum erstreckt und daran angrenzt. Während eines Containerverladevorgangs werden mehrere zeitlich aufeinander folgende Scans durchgeführt, und wenn mindestens ein mehr als 0,5 Meter (oder alternativ mehr als 1 Meter) über der identifizierten Arbeitsfläche oder der identifizierten Ladefläche liegender Messpunkt ermittelt wird, wird ein Person-Wahrscheinlich-Signal ausgegeben.In preferred embodiments, the work surface is divided into several zones, namely at least one inner zone which includes at least the loading position, i.e. H. either equal to or greater than the loading position, and an outer zone extending around and adjacent to the inner zone. During a container loading process, several consecutive scans are carried out and if at least one measuring point is more than 0.5 meters (or alternatively more than 1 meter) above the identified work surface or the identified loading area, a person probable signal is issued .

Zusätzlich wird geprüft, ob sich der Ort eines derartigen Messpunktes in der Messpunktwolke mit der Zeit ändert. Wenn ja, kann ein Bewegte-Person-Wahrscheinlich-Signal ausgegeben werden.In addition, it is checked whether the location of such a measuring point in the measuring point cloud changes over time. If so, a moving person probable signal can be issued.

Je nachdem, für welche der beiden Zonen welche der beiden Arten von Signalen ausgegeben werden, wird die Kranbewegung verlangsamt oder gestoppt. Dabei können Ort und Größe der Zonen, in die die Arbeitsfläche unterteilt ist, während des Betriebs der Anlage dynamisch geändert und an Ort und Bewegungsrichtung eines gerade verladenen Containers angepasst werden.Depending on which of the two zones which of the two types of signals are issued, the crane movement is slowed down or stopped. Included The location and size of the zones into which the work area is divided can be dynamically changed during operation of the system and adapted to the location and direction of movement of a container that has just been loaded.

Anders als bei herkömmlichen Sicherheits- und Kollisionsvermeidungssystemen muss somit nicht sofort ein Not-Aus erfolgen, sondern es kann eine stufenweise Reaktion erfolgen, z. B. zunächst eine bloße Warnung, wenn erkannt wird, dass sich eine Person der äußeren Zone nähert, dann ein langsameres Arbeiten des Krans, wenn die Person in die äußere Zone eintritt, und ein Not-Aus erst dann, wenn die Person in die innere Zone eintritt.Unlike conventional safety and collision avoidance systems, an emergency stop does not have to take place immediately, but a gradual reaction can take place, e.g. B. initially a mere warning when it is detected that a person is approaching the outer zone, then a slower operation of the crane when the person enters the outer zone, and an emergency stop only when the person enters the inner one Zone enters.

Bei dem Verfahren zur Betriebsüberwachung einer Arbeitsfläche auf einem Boden unterhalb eines Containerkrans, wobei aus einer Höhe über dem Boden, die ein Mehrfaches der Höhe eines ISO-Containers übersteigt, während eines Containerverlade-, -absetz- oder -anhebevorgangs ein oder mehrere 3D-Laserscanner die Arbeitsfläche in drei Dimensionen von oben abtasten gelassen werden, werden gemäß der Erfindung der oder die Laserscanner die Arbeitsfläche mit einem Fächer von divergierenden Ebenen von Lichtstrahlen oder einem Fächer von divergierenden Einzel-Lichtstrahlen gleichzeitig in mehreren voneinander beabstandeten Ebenen oder Linien abtasten gelassen, um eine Messpunktwolke zu gewinnen, wobei die Ebenen oder Linien auf Höhe der Arbeitsfläche einen Abstand voneinander haben, der so bemessen ist, dass eine auf der Arbeitsfläche stehende Person von mindestens einer Ebene von Lichtstrahlen oder mindestens einem der Einzel-Lichtstrahlen getroffen wird. In der so gewonnenen Messpunktwolke wird zunächst die Arbeitsfläche identifiziert. Danach wird ermittelt, ob es in der Messpunktwolke mindestens einen oder mehrere Messpunkte gibt, der oder die für eine auf der identifizierten Arbeitsfläche stehende Person typisch sind. Wenn es einen oder in bevorzugten Ausführungsformen mindestens zwei benachbarte derartige Messpunkte gibt, wird die Kranbewegung verlangsamt oder gestoppt.In the method for operational monitoring of a work area on a floor below a container crane, one or more 3D laser scanners being used from a height above the floor that exceeds the height of an ISO container by several times during a container loading, setting down or lifting process the work surface can be scanned in three dimensions from above, according to the invention the laser scanner or scanners are scanned the work surface with a fan of diverging planes of light beams or a fan of diverging individual light beams simultaneously in several spaced-apart planes or lines in order to achieve a To obtain a measurement point cloud, the planes or lines at the height of the work surface being at a distance from one another which is dimensioned such that a person standing on the work surface is hit by at least one plane of light rays or at least one of the individual light rays. The work area is first identified in the measurement point cloud obtained in this way. It is then determined whether there are at least one or more measurement points in the measurement point cloud that are typical for a person standing on the identified work surface. If there is one or, in preferred embodiments, at least two adjacent such measuring points, the crane movement is slowed or stopped.

In bevorzugten Ausführungsformen werden Kranbewegungen nicht verlangsamt oder gestoppt, sondern bleiben erlaubt, wenn ein oder mehrere Messpunkte, der oder die für eine auf der identifizierten Arbeitsfläche stehende Person typisch sind, für einen vorbestimmten Bereich am Rand der Arbeitsfläche, aber nicht für einen zentralen Bereich der Arbeitsfläche ermittelt werden.In preferred embodiments, crane movements are not slowed down or stopped, but remain permitted if one or more measuring points typical of a person standing on the identified work surface are for a predetermined area at the edge of the work surface, but not for a central one Area of the work surface can be determined.

In bevorzugten Ausführungsformen sind innerhalb der Arbeitsfläche mehrere Zonen definiert, nämlich mindestens eine innere Zone direkt unterhalb eines am Kran hängenden Containers sowie eine äußere Zone, die sich um die innere Zone herum erstreckt und daran angrenzt. Kranbewegungen werden nur dann erlaubt, wenn ein oder mehrere Messpunkte, der oder die für eine auf der identifizierten Arbeitsfläche stehende Person typisch sind, nicht in der inneren oder der äußeren Zone ermittelt werden. Kranbewegungen werden verlangsamt, wenn ein oder mehrere Messpunkte, der oder die für eine auf der identifizierten Arbeitsfläche stehende Person typisch sind, in der äußeren und nicht in der inneren Zone ermittelt werden. Kranbewegungen werden gestoppt, wenn ein oder mehrere Messpunkte, der oder die für eine auf der identifizierten Arbeitsfläche stehende Person typisch sind, in der inneren Zone ermittelt werden.In preferred embodiments, a plurality of zones are defined within the work surface, namely at least an inner zone directly below a container hanging on the crane and an outer zone extending around and adjacent to the inner zone. Crane movements are only permitted if one or more measuring points that are typical of a person standing on the identified work area are not determined in the inner or outer zone. Crane movements are slowed down if one or more measuring points typical of a person standing on the identified work surface are determined in the outer zone and not in the inner zone. Crane movements are stopped when one or more measuring points typical of a person standing on the identified work surface are detected in the inner zone.

Weitere Merkmale und Vorteile der Erfindung ergeben sich aus den abhängigen Patentansprüchen sowie aus der folgenden Beschreibung von Ausführungsbeispielen anhand der Zeichnungen.Further features and advantages of the invention result from the dependent patent claims and from the following description of exemplary embodiments based on the drawings.

Kurzbeschreibung der ZeichnungenBrief description of the drawings

Fig. 1Fig. 1
zeigt eine schematische Seitenansicht eines unteren Teils eines schienengebundenen Portalkrans, in dem sich eine Arbeitsfläche am Boden eines zu überwachenden Arbeitsraums befindet;shows a schematic side view of a lower part of a rail-mounted gantry crane, in which a work surface is located at the floor of a work space to be monitored;
Fig. 2Fig. 2
zeigt eine schematische Draufsicht auf die Arbeitsfläche von Fig. 1;shows a schematic top view of the work surface of Fig. 1 ;
Fig. 3Fig. 3
zeigt eine schematische Draufsicht auf eine Arbeitsfläche unter einem Containerkran mit dynamisch veränderlichen Zonen; undshows a schematic top view of a work area under a container crane with dynamically changing zones; and
Fig. 4Fig. 4
zeigt ein Flussdiagramm eines Verfahren zur Betriebsüberwachung einer Arbeitsfläche unterhalb eines Containerkrans.shows a flowchart of a method for monitoring the operation of a work area below a container crane.
Detaillierte BeschreibungDetailed description

Für die Verladung von Gütern im Bereich (Portal) eines Ship-to-Shore-Krans (STS-Kran) in Containerhäfen ist die Tätigkeit von Menschen erforderlich. Das können z. B. Einweiser für LKW sein, oder auch Personen, welche die so genannten IBCs (Inter Box Connectoren, diese halten übereinander stehende Container auf einem Schiff zusammen) von den Containern entfernen, bevor diese auf den Boden oder auf ein LKW-Chassis gestellt werden. Diese Personen können sich frei im Portalbereich bewegen. Durch Sichteinschränkungen, Unachtsamkeit und/oder widrige Wetterbedingungen kann es beim Absetzen oder Aufnehmen der Last zu Personenschäden und damit zu Ausfallzeiten kommen.Human activity is required for the loading of goods in the area (portal) of a ship-to-shore crane (STS crane) in container ports. This can e.g. B. Be a signaller for trucks, or people who remove the so-called IBCs (Inter Box Connectors, which hold containers standing on top of each other on a ship together) from the containers before they are placed on the ground or on a truck chassis. These people can move freely in the portal area. Limited visibility, carelessness and/or adverse weather conditions can result in personal injury and therefore downtime when setting down or picking up the load.

Um Unfälle mit Personen zu verhindern, wird ein redundantes System zur Objekterkennung und -verfolgung in einem definierten Arbeitsraum vorgeschlagen. So kann der Aufenthaltsort jeder Person im Gefahrenbereich bestimmt und in einem Gefahrenfall z. B. die Hubwerksfunktion des Krans gestoppt werden. Das System ist in der Lage, Personen im Arbeitsraum während des Verladens von Containern zu erkennen, zu lokalisieren und kontinuierlich deren Position an die Kransteuerung zurückzugeben.To prevent accidents involving people, a redundant system for object detection and tracking in a defined workspace is proposed. In this way, the whereabouts of every person in the danger area can be determined and, in the event of danger, for example. B. the hoist function of the crane can be stopped. The system is able to detect and locate people in the work area while containers are being loaded and continuously return their position to the crane control.

Fig. 1 zeigt einen unteren Teils eines Containerkrans, hier eines RMG-Portalkrans 1, der auf Schienen auf einem Boden 2 eines Hafens oder sonstigen Containerumschlagplatzes fahren kann und der eine Verladeanlage oder einen Teil davon bildet. Unterhalb des Portalkrans 1 befindet sich am Boden 2 eine Arbeitsfläche 3, die in Fig. 2 von oben gezeigt ist, im gleichen Maßstab wie in Fig. 1. Auf der Arbeitsfläche 3 ist mindestens eine längliche Ladeposition 4 (Fig. 2) für einen LKW 5 oder dergleichen markiert. Der LKW 5 hat eine Ladefläche 5a und ein Führerhaus 5b. Fig. 1 shows a lower part of a container crane, here an RMG gantry crane 1, which can travel on rails on a floor 2 of a port or other container handling point and which forms a loading facility or part of it. Below the gantry crane 1 there is a work surface 3 on the floor 2, which is in Fig. 2 is shown from above, to the same scale as in Fig. 1 . On the work surface 3 there is at least one elongated loading position 4 ( Fig. 2 ) marked for a truck 5 or the like. The truck 5 has a loading area 5a and a driver's cab 5b.

Alternativ kann der Containerkran auch ein RTG-Kran oder ein STS-Kran sein.Alternatively, the container crane can also be an RTG crane or an STS crane.

Der zu überwachende Arbeitsraum, in dem sich Personen aufhalten können und dürfen, kann z. B. ein Quader sein, der von dem Boden 2 sowie von je zwei Vertikalstützen 6, 7 und Querträgern 8 des Portalkrans 1 begrenzt wird. Zum Beispiel bei weit auseinander stehenden Vertikalstützen 6, 7 kann der zu überwachende Arbeitsraum aber auch kleiner sein und sich oberhalb einer Arbeitsfläche 3 erstrecken, die nicht ganz bis zu den Stützen reicht, wie z. B. in Fig. 2, welche die Situation von Fig. 1 in gleichem Maßstab in Draufsicht zeigt.The work area to be monitored, in which people can and may stay, can e.g. B. be a cuboid, which is delimited by the floor 2 and by two vertical supports 6, 7 and cross beams 8 of the gantry crane 1. For example, with vertical supports 6, 7 that are far apart, the work space to be monitored can also be smaller and extend above a work surface 3, that doesn't quite reach the supports, such as: Am Fig. 2 , which the situation of Fig. 1 on the same scale in plan view.

In dem Ausführungsbeispiel erstreckt sich die Arbeitsfläche 3 zwischen den Vertikalstützen 6, 7 des Portalkrans 1. Bei anderen Typen von Containerkränen, etwa einem sog. Cantilever-RMG-Kran, der Container über die Seite absetzt, oder bei einem STS-Kran, kann die Arbeitsfläche auch ganz oder teilweise außerhalb der Kranstützen liegen, bei einem STS-Kran in dessen sog. Backreach-Bereich.In the exemplary embodiment, the working surface 3 extends between the vertical supports 6, 7 of the gantry crane 1. With other types of container cranes, such as a so-called cantilever RMG crane, which deposits containers over the side, or with an STS crane, the The work surface can also be completely or partially outside the crane supports, in the case of an STS crane in its so-called backreach area.

In einer Höhe über dem Boden 2, die ein Mehrfaches der Höhe eines ISO-Containers übersteigt, wie er in Fig. 1 als ein von oben kommender Container 9 angedeutet ist, sind zwei 3D-Laserscanner 10 montiert, die dafür eingerichtet sind, den Arbeitsraum zu überwachen, indem sie die Arbeitsfläche 3 einschließlich des darauf stehenden LKW 5 in drei Dimensionen von oben abtasten.At a height above ground 2 that is several times the height of an ISO container as in Fig. 1 as a container 9 coming from above is indicated, two 3D laser scanners 10 are mounted, which are set up to monitor the work area by scanning the work surface 3, including the truck 5 standing on it, in three dimensions from above.

Insbesondere befindet sich je ein 3D-Laserscanner 10 in einer Höhe von z. B. 10 oder 20 Meter nahe an einer vorderen linken Vertikalstütze 6 und an einer hinteren rechten Vertikalstütze, die von der in Fig. 1 sichtbaren vorderen rechten Vertikalstütze 7 verdeckt wird, also nahe an zwei diagonal stehenden Vertikalstützen 6, 7, so dass die 3D-Laserscanner 10 senkrecht über zwei diagonalen Ecken der Arbeitsfläche 3 liegen, wie in Fig. 2 angedeutet. Dabei liegen die zwei 3D-Laserscanner 10 weiter auseinander als die Diagonale der markierten Ladeposition 4 misst.In particular, there is a 3D laser scanner 10 at a height of z. B. 10 or 20 meters close to a front left vertical support 6 and to a rear right vertical support that comes from the in Fig. 1 visible front right vertical support 7 is covered, i.e. close to two diagonal vertical supports 6, 7, so that the 3D laser scanners 10 lie vertically above two diagonal corners of the work surface 3, as in Fig. 2 indicated. The two 3D laser scanners 10 are further apart than the diagonal of the marked loading position 4 measures.

Die Laserscanner 10 sind jeweils ein 3D-Multilayer-Scanner oder alternativ ein 3D-Array-Scanner oder Flash-LiDAR-Gerät. Die Laserscanner 10 können - wie in diesem Ausführungsbeispiel - zweckmäßig am Kran befestigt sein, doch sind auch Ausführungsformen möglich, in denen die Laserscanner auf Pfeilern oder Lichtmasten befestigt sind, die auch schon auf dem Betriebsgelände vorhanden sein können, sofern diese nahe genug an der Arbeitsfläche liegen und die Krantätigkeit nicht behindern. In jedem Fall werden die Laserscanner 10 die Arbeitsfläche 3 jedenfalls überwiegend nicht genau von oben, sondern mehr oder weniger schräg von oben abtasten.The laser scanners 10 are each a 3D multilayer scanner or alternatively a 3D array scanner or flash LiDAR device. The laser scanners 10 can - as in this exemplary embodiment - be expediently attached to the crane, but embodiments are also possible in which the laser scanners are attached to pillars or light poles, which can already be present on the company premises, provided they are close enough to the work area lie and do not hinder the crane's operation. In any case, the laser scanners 10 will scan the work surface 3 predominantly not exactly from above, but more or less obliquely from above.

Die Laserscanner 10 sind außerdem so ausgelegt und orientiert, dass sie die ganze Arbeitsfläche 3 - mit Ausnahme der durch zwischen den Ebenen oder Linien der Laserscanner 10 vorhandenen Lücken - vollständig überwachen können, wobei jeder der beiden Laserscanner 10 für eine von zwei L-förmigen Teilzonen 11, 12 verantwortlich ist, die sich zu einem der Arbeitsfläche 3 entsprechenden Rechteck um die Ladeposition 4 herum ergänzen. Dadurch wird eine Abschattung von Teilen der Arbeitsfläche 3 durch den LKW 5 oder einen darauf stehenden oder vertikal darüber hängenden Container 9 vermieden. Im Falle von 3D-Multilayer-Scannern verlaufen die Scanebenen bevorzugt parallel zur Längsrichtung der Ladeposition 4.The laser scanners 10 are also designed and oriented so that they cover the entire work surface 3 - with the exception of those between the levels or lines of the Laser scanner 10 existing gaps - can fully monitor, each of the two laser scanners 10 being responsible for one of two L-shaped subzones 11, 12, which complement each other to form a rectangle corresponding to the work surface 3 around the loading position 4. This avoids shading of parts of the work surface 3 by the truck 5 or a container 9 standing on it or hanging vertically above it. In the case of 3D multilayer scanners, the scanning planes preferably run parallel to the longitudinal direction of the loading position 4.

Die oben beschriebene Verladeanlage kann anstelle des Portalkrans 1 auch einen anderen Kran wie z. B. eine Containerbrücke aufweisen, welche Container vom Schiff direkt auf LKW oder umgekehrt befördert. In einem derartigen Fall können LKW-Fahrspuren und LKW-Ladepositionen quer zum Kai oder in Längsrichtung dazu verlaufen.The loading system described above can also use another crane instead of the gantry crane 1, such as. B. have a container bridge, which transports containers from the ship directly to the truck or vice versa. In such a case, truck lanes and truck loading positions can run across the quay or in the longitudinal direction.

Im Betrieb der in Figuren 1 und 2 gezeigten Container-Verladeanlage lässt eine Personenerkennungseinheit die Laserscanner 10 während eines Containerverladevorgangs laufend Scans durchführen, z. B. jede Sekunde oder jede zehntel Sekunde einen. Im Prinzip genügt eine Messpunktwolke, in der der Boden 2 bzw. die Arbeitsfläche 3 und sowie die Ladefläche 5a des LKW 5 identifiziert werden.In the operation of the in Figures 1 and 2 In the container loading system shown, a person recognition unit allows the laser scanner 10 to continuously carry out scans during a container loading process, e.g. B. one every second or every tenth of a second. In principle, a measurement point cloud in which the floor 2 or the work surface 3 and the loading area 5a of the truck 5 are identified is sufficient.

Dies könnte rechnerisch auf verschiedene Arten geschehen, die grundsätzlich äquivalent sind. So könnte man alle Messpunkte, die außerhalb der vorbekannten Umrisse der Ladeposition 4 liegen, als die Arbeitsfläche 3 bildend ansehen, und die Ladefläche 5a des LKW 5 gewinnt man dann, indem man von den innerhalb der Umrisse der Ladeposition 4 liegenden Messpunkten nur solche auswählt, die in einer dafür typischen Höhe über dem Boden 2 liegen, also etwa 1 Meter über dem Boden 2. Dies eliminiert auch Messpunkte, die vom Führerhaus 5b des LKW 5 stammen. Alternativ könnte man den Arbeitsraum in viele virtuelle Quader mit an die Auflösung der Laserscanner 10 angepassten Abmessungen unterteilen, und die Oberseiten aller Quader, in die ein Messpunkt fällt, nimmt man dann als das Profil des Bodens der Arbeitsfläche 3 und der Ladefläche 5a des LKW 5, nachdem man Quader eliminiert hat, die leicht erkennbar das Führerhaus 5b repräsentieren.This could be done computationally in a number of ways that are fundamentally equivalent. So one could view all measuring points that lie outside the previously known outline of the loading position 4 as forming the work surface 3, and the loading area 5a of the truck 5 is then obtained by selecting only those measuring points lying within the outline of the loading position 4, which are at a typical height above the ground 2, i.e. about 1 meter above the ground 2. This also eliminates measuring points that come from the driver's cab 5b of the truck 5. Alternatively, the work space could be divided into many virtual cuboids with dimensions adapted to the resolution of the laser scanner 10, and the tops of all cuboids into which a measuring point falls are then taken as the profile of the bottom of the work surface 3 and the loading area 5a of the truck 5 , after eliminating cuboids that easily represent the driver's cab 5b.

Anschließend wird ermittelt, ob es in der Messpunktwolke mindestens einen mehr als 0,5 Meter über der identifizierten Arbeitsfläche oder der identifizierten Ladefläche liegenden Messpunkt gibt, oder äquivalent dazu, ob es einen obersten Quader gibt, der mehr als 0,5 Meter darüber hinaus ragt. Statt einer Mindesthöhe von 0,5 Meter könnte man auch eine andere Mindesthöhe nehmen, ab der Messpunkte berücksichtigt werden, z. B. 0,7 oder 1 Meter.It is then determined whether there is at least one more than one in the measurement point cloud There is a measuring point 0.5 meters above the identified work surface or the identified loading area, or equivalently, whether there is a top cuboid that protrudes more than 0.5 meters above it. Instead of a minimum height of 0.5 meters, you could also use a different minimum height from which measuring points are taken into account, e.g. B. 0.7 or 1 meter.

Wenn es einen derartigen Messpunkt oder Quader gibt, wird ein Person-Wahrscheinlich-Signal ausgegeben, welches anzeigt, dass sich an diesem Ort wahrscheinlich eine Person befindet. Zusätzlich kann ein Gegenstand-Wahrscheinlich-Signal ausgegeben werden, wenn es einen Messpunkt oder Quader gibt, der weniger als 0,5 Meter, aber z. B. mehr als 30 Zentimeter über der identifizierten Arbeitsfläche oder der identifizierten Ladefläche liegt, da in diesem Fall wahrscheinlich irgendein Gegenstand auf dem Boden oder auf der Ladefläche liegt, der dort nicht hin gehört und z. B. eine Stolperfalle oder ein Absetzhindernis darstellt.If there is such a measurement point or cuboid, a person probable signal is output, which indicates that there is probably a person at this location. In addition, an object probable signal can be output if there is a measuring point or cuboid that is less than 0.5 meters, but e.g. B. is more than 30 centimeters above the identified work surface or the identified loading area, since in this case there is probably an object on the floor or on the loading area that does not belong there and e.g. B. represents a tripping hazard or an obstacle to setting down.

Wird ein Person-Wahrscheinlich-Signal oder Gegenstand-Wahrscheinlich-Signal ausgegeben, sorgt eine Sicherheitseinrichtung dafür, dass die Kranbewegung stoppt, und sendet eine Aufforderung an einen Steuerstand bzw. an den Kranführer und/oder an den LKW-Fahrer, die Situation zu klären.If a person probable signal or object probable signal is issued, a safety device ensures that the crane movement stops and sends a request to a control station or to the crane operator and/or to the truck driver to clarify the situation .

Somit darf sich der LKW-Fahrer in diesem Ausführungsbeispiel nicht auf der Arbeitsfläche 3 befinden, damit die Verladung zügig durchgeführt wird. Er darf sich jedoch im Führerhaus 5b des LKW 5 oder außerhalb der Arbeitsfläche 3 befinden.In this exemplary embodiment, the truck driver is therefore not allowed to be on the work surface 3 so that loading can be carried out quickly. However, it may be in the driver's cab 5b of the truck 5 or outside the work area 3.

In einer Weiterbildung dieses Ausführungsbeispiels oder nachfolgend beschriebener Ausführungsbeispiele ist oder wird der Fahrer dazu angehalten, sich vor dem Verladevorgang in eine ca. 2 x 2 Meter messende Personenaufenthaltszone 13 zu begeben, die in einer Ecke der Arbeitsfläche 3 auf dem Boden markiert ist, wie in Fig. 2 veranschaulicht. Die Krantätigkeit wird nur solange erlaubt, wie mittels der Laserscanner 10 erkannt wird, dass sich wahrscheinlich eine Person in der Personenaufenthaltszone 13 befindet, aber nicht auf der Arbeitsfläche 3 oder auf der Ladefläche 5a des LKW 5.In a further development of this exemplary embodiment or of the exemplary embodiments described below, the driver is or is encouraged to go to a personal stay zone 13 measuring approximately 2 x 2 meters before the loading process, which is marked on the floor in a corner of the work surface 3, as in Fig. 2 illustrated. The crane activity is only permitted as long as it is recognized by the laser scanner 10 that there is probably a person in the people's stay zone 13, but not on the work surface 3 or on the loading area 5a of the truck 5.

In einer Weiterbildung dieses Ausführungsbeispiels oder nachfolgend beschriebener Ausführungsbeispiele wird zusätzlich ermittelt, ob es in der Messpunktwolke mindestens einen oder mehrere Messpunkte gibt, der oder die für den LKW 5 und insbesondere für dessen Führerhaus 5b typisch sind und deren Orte in der Messpunktwolke sich mit der Zeit ändern. Daran kann erkannt werden, dass sich der LKW 5 während eines Containerabsetz- oder -anhebevorgangs bewegt, z. B. weil der Fahrer unachtsamerweise zu früh losfährt, so dass Kranbewegungen rechtzeitig gestoppt werden können.In a further development of this exemplary embodiment or described below Embodiments additionally determine whether there are at least one or more measuring points in the measuring point cloud that are typical for the truck 5 and in particular for its driver's cab 5b and whose locations in the measuring point cloud change over time. This shows that the truck 5 is moving during a container lowering or lifting process, e.g. B. because the driver carelessly sets off too early so that crane movements can be stopped in time.

Anhand von Fig. 3 wird nun weiteres Ausführungsbeispiel erläutert, welches sich - wie auch das vorhergehende Ausführungsbeispiel - nicht nur besonders für die Betriebsüberwachung von Arbeitsbereichen von Portalkränen oder Containerbrücken eignet, sondern auch für andere Arbeitsbereiche im Hafen, wo Container abgesetzt oder werden.Based on Fig. 3 A further exemplary embodiment will now be explained, which - like the previous exemplary embodiment - is not only particularly suitable for operational monitoring of work areas of gantry cranes or container bridges, but also for other work areas in the port where containers are or are being deposited.

Dies kann z. B. ein Arbeitsbereich auf dem Schiff sein, in dem Container kurz abgesetzt werden, um Inter Box Connectoren von Hand zu montieren oder zu entfernen.This can e.g. This could, for example, be a work area on the ship where containers are briefly placed in order to assemble or remove Inter Box Connectors by hand.

Darüber hinaus können die hier beschriebenen Anlagen und Verfahren auch in anderen Bereichen in Containerumschlagplätzen in Häfen oder anderswo eingesetzt werden, und zwar auch dort, wo Personen eigentlich keinen Zugang haben, aber z. B. versehentlich in vollautomatisierte Arbeitsbereiche gelangen könnten.In addition, the systems and methods described here can also be used in other areas in container handling areas in ports or elsewhere, even where people do not actually have access, but e.g. B. could accidentally get into fully automated work areas.

Ein derartiges verallgemeinertes Verfahren wird nachfolgend anhand von Figuren 3 und 4 beschrieben.Such a generalized procedure is described below using Figures 3 and 4 described.

Fig. 3 zeigt von oben eine Arbeitsfläche 3 unter einem Containerkran, die ebenso wie in dem Ausführungsbeispiel von Fig. 2 rechteckig ist, mit einer zu der Größe des vorliegend verwendeten Containerkrans passenden Länge und Breite. Fig. 3 shows from above a work surface 3 under a container crane, which is just like in the exemplary embodiment of Fig. 2 is rectangular, with a length and width that matches the size of the container crane used here.

Laserscanner 10 tasten die ganze Arbeitsfläche 3 von Fig. 3 immer wieder von oben ab, z. B. zehn Mal pro Sekunde, und erfassen dabei insbesondere einen Container 9, der hier in einer Höhe am Kran hängt, in der der Container 9 jetzt oder zumindest nach weiterem Absenken mit einer ungünstig auf der Arbeitsfläche 3 stehenden oder laufenden Person kollidieren könnte, sowie eine Person 16, die hier in einer Ecke der Arbeitsfläche 3 steht. Außerdem erfassen die Laserscanner 10 die Bewegungsrichtungen und Bewegungsgeschwindigkeiten des Containers 9 und der Person 16, welche in Fig. 3 mittels Pfeilen als Bewegungsvektoren dargestellt sind.Laser scanner 10 scans the entire work surface 3 of Fig. 3 again and again from above, e.g. B. ten times per second, and in particular detect a container 9, which is hanging here on the crane at a height at which the container 9 could now or at least after further lowering collide with a person standing or walking unfavorably on the work surface 3, as well a person 16 who is here in a corner of the Work surface 3 is standing. In addition, the laser scanners 10 record the directions and speeds of movement of the container 9 and the person 16, which in Fig. 3 are shown as motion vectors using arrows.

Auf der Arbeitsfläche 3 werden virtuell mehrere dynamisch veränderliche Zonen erzeugt, um mehrstufige Gefahrenbereiche und/oder Sicherheitsbereiche zu bilden. Zum Beispiel wird horizontal rings um den Container 9 virtuell eine innere Zone 14 gebildet, und horizontal rings um die innere Zone 14 wird virtuell eine äußere Zone 15 gebildet.Several dynamically changing zones are virtually created on the work surface 3 in order to form multi-level danger areas and/or safety areas. For example, an inner zone 14 is virtually formed horizontally around the container 9, and an outer zone 15 is virtually formed horizontally around the inner zone 14.

Solange sich der Container 9 nicht bewegt, können die innere Zone 14 und die äußere Zone 15 kleiner sein als in Fig. 3 dargestellt, z. B. derart, dass die innere Zone 14 der Ladeposition 4 in Fig. 2 entspricht und die äußere Zone 15 den beiden Teilzonen 11, 12 in Fig. 2 entspricht. Wenn sich der Container 9 in einer Horizontalrichtung bewegt, werden die innere Zone 14 und die äußere Zone 15 in Richtung der Bewegung größer gemacht, und zwar um so mehr, je schneller sich der Container 9 bewegt, wie in Fig. 3 veranschaulicht.As long as the container 9 does not move, the inner zone 14 and the outer zone 15 can be smaller than in Fig. 3 shown, e.g. B. such that the inner zone 14 of the loading position 4 in Fig. 2 corresponds and the outer zone 15 corresponds to the two sub-zones 11, 12 in Fig. 2 corresponds. When the container 9 moves in a horizontal direction, the inner zone 14 and the outer zone 15 are made larger in the direction of movement, the faster the container 9 moves, as in Fig. 3 illustrated.

Eine derartige in Abhängigkeit von Bewegungsrichtung und -geschwindigkeit dynamisch veränderliche Zone oder Sicherheitszone kann auch um die Person 16 herum gelegt werden (in Fig. 3 nicht gezeigt), womit die Bewegung der Person 16 antizipiert werden kann. Befindet sich die erkannte Person 16 in einem Gefahrenbereich, also der inneren Zone 14 und/oder der äußeren Zone 15, oder beginnt die Sicherheitszone um die Person 16 herum, in die äußere Zone 15 einzudringen, oder nähert sich umgekehrt der Container 9 der Person 16, werden die entsprechenden Verfahrbewegungen von Trolley, Hubwerk und Fahrwerk des Krans verlangsamt oder gestoppt.Such a zone or safety zone that dynamically changes depending on the direction and speed of movement can also be placed around the person 16 (in Fig. 3 not shown), with which the movement of the person 16 can be anticipated. If the recognized person 16 is in a danger area, i.e. the inner zone 14 and/or the outer zone 15, or the safety zone around the person 16 begins to penetrate into the outer zone 15, or conversely, the container 9 approaches the person 16 , the corresponding movements of the trolley, hoist and chassis of the crane are slowed down or stopped.

Insbesondere tasten die Laserscanner 10 ebenso wie in dem Ausführungsbeispiel von Figuren 1 und 2 die Arbeitsfläche 3 mit einem Fächer von divergierenden Ebenen von Lichtstrahlen oder Einzel-Lichtstrahlen gleichzeitig in mehreren voneinander beabstandeten Ebenen oder Linien ab, um daraus eine Messpunktwolke zu gewinnen, wobei die Ebenen oder Linien auf Höhe der Arbeitsfläche 3 einen Abstand voneinander haben, der so bemessen ist, dass eine auf der Arbeitsfläche stehende Person von mindestens einer Ebene von Lichtstrahlen oder mindestens einem der Einzel-Lichtstrahlen getroffen wird (Schritt S1 in Fig. 4).In particular, the laser scanners 10 scan in the same way as in the exemplary embodiment of Figures 1 and 2 the work surface 3 with a fan of diverging planes of light rays or individual light rays simultaneously in several spaced-apart planes or lines in order to obtain a measuring point cloud, the planes or lines at the height of the work surface 3 being at a distance from one another which is dimensioned in this way is that a person standing on the work surface of at least one plane is hit by light rays or at least one of the individual light rays (step S1 in Fig. 4 ).

Um eine auf der Arbeitsfläche stehende Person unter Verwendung von relativ wenigen Ebenen oder Linien mit ausreichender Zuverlässigkeit erkennen zu können, sollten die Ebenen oder Linien auf Höhe der Arbeitsfläche 3 in mindestens einer Richtung auf dem Boden, z. B. in Längsrichtung der Ladeposition und/oder quer dazu, nicht größer als 30 Zentimeter sein, wobei aber auch kleinere Mindestabstände wie z. B. 10 oder 20 Zentimeter oder irgendwelche Zwischenwerte möglich sind.In order to be able to recognize a person standing on the work surface with sufficient reliability using relatively few planes or lines, the planes or lines at the height of the work surface 3 should be on the floor in at least one direction, e.g. B. in the longitudinal direction of the loading position and / or transversely to it, not larger than 30 centimeters, although smaller minimum distances such as. B. 10 or 20 centimeters or any intermediate values are possible.

In der im Schritt S1 gewonnenen Messpunktwolke wird auch die Arbeitsfläche 3 identifiziert (Schritt S2 in Fig. 4).The work surface 3 is also identified in the measurement point cloud obtained in step S1 (step S2 in Fig. 4 ).

Anschließend wird ermittelt, ob es in der Messpunktwolke mindestens einen oder mehrere Messpunkte gibt, der oder die für eine auf der identifizierten Arbeitsfläche stehende Person typisch sind (Schritt S3 in Fig. 4). Wenn kein derartiger Messpunkt ermittelt wird, geht es zum Schritt S1 zurück, um eine neue Messpunktwolke zu gewinnen.It is then determined whether there are at least one or more measurement points in the measurement point cloud that are typical for a person standing on the identified work surface (step S3 in Fig. 4 ). If no such measurement point is determined, it goes back to step S1 to obtain a new measurement point cloud.

Wenn ein derartiger Messpunkt ermittelt wird, kann die Kranbewegung ohne weitere Bedingungen verlangsamt oder gestoppt werden (Schritt S4 in Fig. 4), z. B. wenn die Arbeitsfläche 3 von vornherein so ausgelegt ist, dass sich dort keine Person aufhalten sollte, solange sich der Container 9 bewegt, oder z. B. in Sonderfällen wie Test- oder Kalibrierungsfahrten.If such a measuring point is determined, the crane movement can be slowed down or stopped without any further conditions (step S4 in Fig. 4 ), e.g. B. if the work surface 3 is designed from the outset so that no person should stay there as long as the container 9 is moving, or z. B. in special cases such as test or calibration runs.

Vorzugsweise wird im Schritt S3 jedoch zusätzlich ermittelt, ob sich die Person 16 oder deren eigene Sicherheitszone in der äußeren Zone 15 und nicht in der inneren Zone 14 befindet oder damit überschneidet. Wenn ja, werden im Schritt S4 Kranbewegungen verlangsamt. Zusätzlich wird im Schritt S3 ermittelt, ob sich die Person 16 oder deren eigene Sicherheitszone in der inneren Zone 14 befindet oder damit überschneidet. Wenn ja, werden im Schritt S4 Kranbewegungen gestoppt. Das heißt, Kranbewegungen werden nur dann erlaubt, wenn sich die Person 16 oder deren eigene Sicherheitszone nicht in der inneren oder der äußeren Zone befindet.However, in step S3 it is preferably additionally determined whether the person 16 or their own security zone is in the outer zone 15 and not in the inner zone 14 or whether it overlaps with it. If so, crane movements are slowed down in step S4. In addition, in step S3 it is determined whether the person 16 or their own security zone is in the inner zone 14 or overlaps with it. If so, crane movements are stopped in step S4. This means that crane movements are only permitted if the person 16 or their own safety zone is not in the inner or outer zone.

Vorzugsweise werden auch Warnsignale ausgegeben, und zwar schon dann, wenn sich die Person 16 der äußeren Zone 15 nähert und bevor Kranbewegungen verlangsamt werden.Warning signals are preferably also issued when the person 16 approaches the outer zone 15 and before crane movements are slowed down.

Zwischen den Schritten S2 und S3 oder S3 und S4 kann zusätzlich ermittelt werden, ob es in der Messpunktwolke Messpunkte gibt, die für den LKW 5 bzw. dessen Führerhaus 5b und/oder Ladefläche 5a typisch sind und deren Orte in der Messpunktwolke sich mit der Zeit ändern. Wenn dies der Fall ist, deutet dies darauf hin, dass sich der LKW 5 bewegt, woraufhin Kranbewegungen ebenfalls gestoppt werden.Between steps S2 and S3 or S3 and S4 it can also be determined whether there are measurement points in the measurement point cloud that are typical for the truck 5 or its driver's cab 5b and / or loading area 5a and whose locations in the measurement point cloud change over time change. If this is the case, this indicates that the truck 5 is moving, after which crane movements are also stopped.

Das vorstehend beschriebene Verfahren kann ebenso wie das erste Ausführungsbeispiel daraufhin erweitert werden, auch Fremd-Gegenstände im Arbeitsraum zu erkennen, insbesondere solche, die größer sind als z. B. 30 Zentimeter, um ggf. Kranbewegungen zu verlangsamen oder zu stoppen, so dass der Kranführer oder die Person 16 Gelegenheit bekommt, die Situation zu klären. Versehentlich liegen gebliebene Gegenstände kann es nicht nur auf Arbeitsflächen 3 geben, sondern auch auf LKW-Ladeflächen 5a, und mit dem beschriebenen Verfahren können somit auch Sachschäden beim Absetzen des Containers vermieden werden. Gegenstände im Arbeitsraum können nicht nur anhand ihrer erkannten Größe von Personen unterschieden und entsprechend klassifiziert werden, sondern auch daran, dass sich dort arbeitende Personen oft bewegen.The method described above, like the first exemplary embodiment, can be expanded to also detect foreign objects in the work area, in particular those that are larger than, for example, B. 30 centimeters to slow down or stop crane movements if necessary, so that the crane operator or person 16 has the opportunity to clarify the situation. Objects that have been accidentally left lying can occur not only on work surfaces 3, but also on truck loading areas 5a, and with the method described, material damage can be avoided when the container is set down. Objects in the work area can be distinguished and classified accordingly not only by their perceived size, but also by the fact that people working there often move around.

Für noch zuverlässigere Erkennung von Personen und Gegenständen im Arbeitsbereich können die oben beschriebenen Mittel und Verfahren, die als Hardware und Software bereitgestellt werden, mit anderen Hardwarekomponenten und Softwarealgorithmen zur Personen- und Objekterkennung verknüpft werden, um ein redundant arbeitendes Gesamtsystem herzustellen. Mittels unterschiedlicher Hardware- und Softwarekomponenten werden die Verfügbarkeit und damit auch die Sicherheit des Systems erhöht.For even more reliable recognition of people and objects in the work area, the means and methods described above, which are provided as hardware and software, can be linked to other hardware components and software algorithms for person and object recognition in order to produce a redundant overall system. Using different hardware and software components, the availability and thus also the security of the system are increased.

So können neben den beschriebenen 3D-Laserscannern 10, welche die Hauptkomponenten des beschriebenen Sicherheitssystems oder Kollisionsvermeidungssystems bilden, auch Kameras zum Einsatz kommen, mit denen die Anwesenheit von Personen in sicheren oder unsicheren Bereichen zusätzlich detektiert werden kann. Optional wäre es auch möglich, z. B. ein RFID (Radio Frequency Identification) System zu integrieren, wobei Orte von Personen im Arbeitsbereich z. B. mittels Triangulation anhand von Signalen erkannt werden, die von einem RFID-Transponder zurückgesandt werden, den Personen bei sich tragen sollen, wobei es in einem Containerterminal aber auch Personen geben kann, die keinen RFID-Transponder tragen, was für die laserbasierte Personenerkennung natürlich nicht nötig ist.In addition to the 3D laser scanners 10 described, which form the main components of the security system or collision avoidance system described, cameras can also be used to monitor the presence of people in safe or unsafe areas can be detected. Optionally it would also be possible, e.g. B. to integrate an RFID (Radio Frequency Identification) system, with locations of people in the work area e.g. B. can be recognized using triangulation based on signals that are sent back by an RFID transponder that people are supposed to carry with them, although there can also be people in a container terminal who do not carry an RFID transponder, which is of course important for laser-based person recognition is not necessary.

Jedes der verschiedenen Systeme arbeitet autark und liefert die zuvor genannten Informationen zu erkannten Personen. Die Daten der Einzelsysteme können aber in einer Auswertesoftware fusioniert werden. Sollte mindestens ein System eine Gefahrensituation melden, werden Anweisungen für geeignete Gegenmaßnahmen, um die Gefahrensituation zu vermeiden, an die Kran-Steuerung gesendet. Im Idealfall melden alle vorhandenen Systeme die gleichen Informationen. Für die Verfügbarkeit und Sicherheit in Gefahrensituationen genügt es, wenn eines der Systeme eine Gefahrensituation meldet. Eine derartige Fusion Laser-Kamera, Laser-RFID oder Laser-Kamera-RFID erleichtert auch die Arbeitssicherheitszertifizierung.Each of the different systems works independently and provides the aforementioned information about recognized people. However, the data from the individual systems can be merged in an evaluation software. If at least one system reports a dangerous situation, instructions for suitable countermeasures to avoid the dangerous situation are sent to the crane control system. Ideally, all existing systems report the same information. For availability and safety in dangerous situations, it is sufficient if one of the systems reports a dangerous situation. Such a laser camera, laser RFID or laser camera RFID fusion also facilitates occupational safety certification.

Claims (15)

  1. Container-loading system comprising a container crane (10) and a working area (3) accessible to persons on a ground (2) below the container crane (10), wherein at least one elongated loading position (4) for a container road transport vehicle (5) is marked on the working area (3) and wherein at a height above the ground (2) which exceeds a multiple of the height of an ISO container (9) one or more 3D laser scanners (10) are mounted which are adapted to scan the road transport vehicle (5) and the working area (3) from above in three dimensions, wherein the system comprises a person detection unit adapted to cause the laser scanner(s) (10) to perform at least one scan during a container loading operation in order to obtain a cloud of measurement points, characterized in that
    - one or more of the laser scanners (10) is/are of a type adapted to scan the working area (3) with a fan of diverging planes of light beams or a fan of diverging individual light beams simultaneously on a plurality of planes or lines spaced apart from each other in order to obtain the cloud of measurement points, wherein the planes or lines at the level of the working area (3) have a distance from each other which is greater than 10 and less than 30 centimeters in at least one direction on the ground (2);
    - the person detection unit is adapted to identify in the obtained cloud of measurement points the working area (3) and the loading area of the road transport vehicle (5); to determine whether there is at least one measurement point in the cloud of measurement points which is located more than 0.5 meters above the identified working area (3) or the identified loading area and, if there is at least one such measurement point, to issue a person-probable signal; and
    - the system comprises a safety device which is adapted to slow down or stop the crane movement when the person-probable signal is issued.
  2. Container-loading system according to claim 1 or 2, characterized in that close to a border or a corner of the working area (3) a person presence zone (13) is marked on the working area (3) and that the safety device is adapted to permit crane movements only when a person-probable signal is emitted for the person presence zone (13) but not for the rest of the working area (3).
  3. Container-loading system according to claim 1 or 2, characterized in that the working area (3) is divided into a plurality of zones, namely at least an inner zone (14) comprising at least the loading position (4) and an outer zone (15) extending around and adjoining the inner zone (14); in that the person detection unit is adapted to cause the laser scanner(s) (10) to perform a plurality of successive scans during a container loading operation and, if at least one measuring point lying more than 0.5 meters above the identified working area (3) or the identified loading area is determined, the location of which in the cloud of measurement points varies over time, to issue a moving-person-probable signal; and in that the safety device is adapted to decide whether the crane movement is to be slowed down or stopped depending on which of the two types of signals is issued for which of the two zones (14, 15).
  4. Container-loading system according to claim 3, characterized in that the person detection unit is adapted to dynamically vary the location and size of the zones (11, 12) into which the working area (3) is divided during operation of the system and, in particular, to adapt them to the location and direction of movement of a container (9) which is being loaded.
  5. Container-loading system according to one of the preceding claims, characterized in that the laser scanners (10) are attached to the container crane (10) or to pillars or poles standing firmly on the ground (2).
  6. Method for monitoring operation within a working area (3) on a ground (2) below a container crane (10), wherein from a height above the ground (2) which exceeds a multiple of the height of an ISO container (9), during a container loading, depositing or lifting operation, one or more 3D laser scanners (10) are caused to scan the working area (3) from above in three dimensions in order to obtain a cloud of measurement points,
    characterized by the following method steps:
    - causing the laser scanner(s) (10) to scan the working area (3) with a fan of diverging planes of light beams or a fan of diverging individual light beams simultaneously in a plurality of mutually spaced planes or lines in order to obtain the cloud of measurement points, wherein the planes or lines at the level of the working area (3) are spaced from one another by a distance which is dimensioned such that a person standing on the working area (3) is struck by at least one plane of light beams or at least one of the individual light beams (S1), and which distance is greater than 10 and less than 30 centimeters in at least one direction on the ground (2);
    - identifying (S2) the working area (3) in the obtained cloud of measurement points,
    - determining (S3) whether there is at least one measuring point in the cloud of measurement points which is typical for a person (16) standing on the identified working area (3) and is located more than 0.5 meters above the identified working area (3) or the identified loading surface, and
    - if there is such a measuring point, slowing down or stopping the crane movement (S4).
  7. Method according to claim 6, characterized in that crane movements are not slowed down or stopped but permitted if one or more measuring points, which are typical of a person standing in the identified working area (3), are determined for a predefined region at the border of the working area (3), but not for a central region of the working area (3).
  8. Method according to claim 6 or 7, characterized in that a plurality of zones are defined within the working area (3), namely at least one inner zone (14) below a container (9) suspended from a crane and an outer zone (15) extending around and adjoining the inner zone (14), wherein
    - crane movements are only permitted if one or more measuring points, which are typical of a person standing in the identified working area (3), are not determined in the inner zone (14) or the outer zone (15);
    - crane movements are slowed down if one or more measuring points, which are typical of a person standing in the identified working area (3), are determined in the outer zone (15) and not in the inner zone (14); and
    - crane movements are stopped when one or more measuring points, which are typical of a person standing in the identified working area (3), are determined in the inner zone (14).
  9. Method according to one of claims 6 to 8, characterized in that the location and size of the inner and outer zones (14, 15) are varied in dependence on the location and direction of movement of a container (9) which is being loaded.
  10. Method according to one of claims 6 to 9, characterized in that it is additionally determined whether there are at least one or more measurement point(s) in the cloud of measurement points which are typical of a foreign object, wherein a distinction is being made between detected persons and foreign objects on the basis of size and movement.
  11. Method according to one of claims 6 to 9, characterized in that it is additionally determined whether there is/are at least one or more measurement points in the cloud of measurement points which is/are typical of a truck (5) and in particular of its driver's cab (5b) and whose locations in the cloud of measurement points vary over time; and in that crane movements are also stopped if it is detected in the aforementioned manner that the truck (5) is moving during a container setting down or lifting operation.
  12. Method according to any one of claims 6 to 11, characterized in that it is performed in a container-loading system according to any one of claims 1 to 5.
  13. Loading system according to any of claims 1 to 2 or method according to any one of claims 6 to 11, characterized in that the or each of the laser scanner(s) (10) is a 3D multilayer scanner.
  14. Loading system according to any of claims 1 to 5 or method according to any one of claims 6 to 11, characterized in that the or each of the laser scanner(s) (10) is a 3D array scanner or a flash LiDAR device.
  15. Container-loading system according to one of claims 1 to 5, characterized in that it is adapted to perform the method according to one of claims 6 to 11.
EP20718553.9A 2020-03-02 2020-03-02 Container-loading system and method for monitoring operation therein Active EP3894349B1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/EP2020/000054 WO2021175403A1 (en) 2020-03-02 2020-03-02 Container-loading system and method for monitoring operation therein

Publications (3)

Publication Number Publication Date
EP3894349A1 EP3894349A1 (en) 2021-10-20
EP3894349C0 EP3894349C0 (en) 2024-01-03
EP3894349B1 true EP3894349B1 (en) 2024-01-03

Family

ID=70285602

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20718553.9A Active EP3894349B1 (en) 2020-03-02 2020-03-02 Container-loading system and method for monitoring operation therein

Country Status (3)

Country Link
EP (1) EP3894349B1 (en)
CN (1) CN115003617A (en)
WO (1) WO2021175403A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116452467B (en) * 2023-06-16 2023-09-22 山东曙岳车辆有限公司 Container real-time positioning method based on laser data

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102006035732B4 (en) * 2006-07-04 2008-09-04 Isam Ag Entladebrücke for loading and / or unloading the hold of a ship, vzw. with containers
DE102006044187A1 (en) * 2006-09-20 2008-04-03 Siemens Ag Method for operating an optical sensor attached to a transport device comprises assigning a functional module of a modular control unit to an operating mode of the sensor and further processing
DE102012020953B4 (en) * 2012-10-25 2016-03-10 LASE Industrielle Lasertechnik GmbH 3D laser scan measuring system for determining the position in which an ISO container is to be placed on a carrier vehicle
FI130426B (en) * 2014-06-30 2023-08-23 Konecranes Oyj Load transport by means of load handling equipment
DE102014111138A1 (en) 2014-08-05 2016-02-11 Sick Ag Multi-level scanner and method for capturing objects

Also Published As

Publication number Publication date
WO2021175403A1 (en) 2021-09-10
EP3894349C0 (en) 2024-01-03
CN115003617A (en) 2022-09-02
EP3894349A1 (en) 2021-10-20

Similar Documents

Publication Publication Date Title
EP2574587B1 (en) Method for determining a target position for a container spreader and the container spreader
EP2724972B1 (en) Method for determination of the position in which an ISO container is to be placed on a carrier vehicle, and 3D laser scan measurement system for the same
EP3000762B1 (en) Method for automatic, optical determination of a target position for a container lifting device
EP3583586B1 (en) Automatically guided transport vehicle for containers and method for operating the same and system with an automatically guided transport vehicle
EP2444320B1 (en) Freight loading system and method for detecting a movement of an item of freight on a freight deck
EP2487129B1 (en) Industrial truck maintenance scheduling control system in function of the encountered irregularities of the working surface
AT504557B1 (en) METHOD FOR NAVIGATING A TRANSPORT FOR GOODS
DE102007021693A1 (en) Auxiliary system for determining position of fork-lift truck in parking space, has unit for coupling and/or fixing position of vehicle, where determined position is corrected by relative positioning of vehicle relative to object
EP2385014B1 (en) Industrial truck with a device for identifying a loaded transport good and method for identifying a loaded transport good
EP3634901B1 (en) Automatically guided lifting gantry device for containers and method for operating such a lifting gantry device
WO1994005586A1 (en) Process and device for controlling a portainer
DE102018110852A1 (en) Device and method for securing a mechanically or automatically controlled moving device and sensor tile
EP0254192A2 (en) Method and device for driving vehicles and/or increasing the operators active and passive safety
EP3529194A1 (en) Arrangement of a gantry lifting device and of a row of spaced-apart marking elements
EP3894349B1 (en) Container-loading system and method for monitoring operation therein
EP3293046B1 (en) Vehicle superstructure
DE4403898A1 (en) Lifting appliance
DE102019109555A1 (en) Method for avoiding collisions in a driverless transport vehicle and a corresponding driverless transport vehicle
DE102020116239B4 (en) System and method with at least one spatially resolving sensor
DE10202399A1 (en) Positioning of transport vehicles in depot handling containers uses laser scanning system
EP2385013A1 (en) Industrial truck with a device for monitoring the load during transportation and method for monitoring the load.
EP4269319A2 (en) Conveying device for load carriers
EP4137437B1 (en) Method for operating an industrial vehicle
EP3915909B1 (en) Method for securing a logistics area
DE202007019542U1 (en) Auxiliary system for determining the position of a vehicle

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20201223

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230601

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20231002

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502020006621

Country of ref document: DE

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

U01 Request for unitary effect filed

Effective date: 20240108

P04 Withdrawal of opt-out of the competence of the unified patent court (upc) registered

Effective date: 20240116

U07 Unitary effect registered

Designated state(s): AT BE BG DE DK EE FI FR IT LT LU LV MT NL PT SE SI

Effective date: 20240119

U20 Renewal fee paid [unitary effect]

Year of fee payment: 5

Effective date: 20240125