EP2931649B1 - Rotating tower crane - Google Patents

Rotating tower crane Download PDF

Info

Publication number
EP2931649B1
EP2931649B1 EP13810895.6A EP13810895A EP2931649B1 EP 2931649 B1 EP2931649 B1 EP 2931649B1 EP 13810895 A EP13810895 A EP 13810895A EP 2931649 B1 EP2931649 B1 EP 2931649B1
Authority
EP
European Patent Office
Prior art keywords
load hook
image
camera
trolley
determining
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP13810895.6A
Other languages
German (de)
French (fr)
Other versions
EP2931649A1 (en
Inventor
Oliver Fenker
Michael PALBERG
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Liebherr Components Biberach GmbH
Original Assignee
Liebherr Components Biberach GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Liebherr Components Biberach GmbH filed Critical Liebherr Components Biberach GmbH
Priority to EP18163759.6A priority Critical patent/EP3354616B1/en
Publication of EP2931649A1 publication Critical patent/EP2931649A1/en
Application granted granted Critical
Publication of EP2931649B1 publication Critical patent/EP2931649B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B66HOISTING; LIFTING; HAULING
    • B66CCRANES; LOAD-ENGAGING ELEMENTS OR DEVICES FOR CRANES, CAPSTANS, WINCHES, OR TACKLES
    • B66C13/00Other constructional features or details
    • B66C13/18Control systems or devices
    • B66C13/46Position indicators for suspended loads or for crane elements
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B66HOISTING; LIFTING; HAULING
    • B66CCRANES; LOAD-ENGAGING ELEMENTS OR DEVICES FOR CRANES, CAPSTANS, WINCHES, OR TACKLES
    • B66C13/00Other constructional features or details
    • B66C13/16Applications of indicating, registering, or weighing devices
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B66HOISTING; LIFTING; HAULING
    • B66CCRANES; LOAD-ENGAGING ELEMENTS OR DEVICES FOR CRANES, CAPSTANS, WINCHES, OR TACKLES
    • B66C13/00Other constructional features or details
    • B66C13/18Control systems or devices
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B66HOISTING; LIFTING; HAULING
    • B66CCRANES; LOAD-ENGAGING ELEMENTS OR DEVICES FOR CRANES, CAPSTANS, WINCHES, OR TACKLES
    • B66C23/00Cranes comprising essentially a beam, boom, or triangular structure acting as a cantilever and mounted for translatory of swinging movements in vertical or horizontal planes or a combination of such movements, e.g. jib-cranes, derricks, tower cranes
    • B66C23/02Cranes comprising essentially a beam, boom, or triangular structure acting as a cantilever and mounted for translatory of swinging movements in vertical or horizontal planes or a combination of such movements, e.g. jib-cranes, derricks, tower cranes with non-adjustable and non-inclinable jibs mounted solely for slewing movements
    • B66C23/022Pivot axis common with column

Definitions

  • the present invention relates to a crane, in particular a tower crane, with a crane boom rotatable about an upright axis, on which a trolley is movably arranged, from which a lifting cable connected to a load hook runs, and a load hook position determining device for determining the load hook position.
  • a crane with a load hook position determining device for example, the font shows WO 91/14644 A1 ,
  • Tower cranes may have an at least approximately crane jib which is carried by a tower which extends upright and can be turned around the upright longitudinal axis of the tower.
  • the boom rotates relative to the tower, while in the case of a bottom turner, the entire tower and thus the arm articulated thereon are rotated.
  • the distance of the load hook from the tower axis can be adjusted by means of a trolley, which is movable along the boom, wherein the lifting cable connected to the load hook runs over the said trolley.
  • the hook position only relative to the trolley or crane, for example, to dampen oscillations, or it may also be an absolute load hook position required in the room, for example, an automated operation at Umtschvorticiann realize.
  • increased safety can also be achieved by determining the load hook position, since the load can be permanently monitored, whereby possibly a redundancy of the lowering depth sensor can also be achieved.
  • the DE 197 25 315 C2 describes a metallurgical crane with a relative to a support frame movable trolley from which runs the hoist. On the support frame several cameras are arranged, the field of view is large enough to detect the crane hook at different Katzfahrtechnik einen. In such a metallurgical crane, the positions to be approached are relatively rigid, so that the amount of image data to be processed remains manageable. If such a system were used in a tower crane, however, a flood of data that could hardly be processed would come about.
  • a tower crane is known, on the trolley, a downward-facing camera is mounted to the crane operator to display a video image of the load hook environment, so that the crane operator can better detect obstacles lying in the direction of movement.
  • This camera system is used to visualize obstacles or the settling or receiving area, which the crane operator has to control, but it is not the load hook position relative to the crane or determined absolutely in space.
  • the DE 41 90 587 C2 describes a shipping container crane in which a load hook position is determined by means of a camera which is attached to the suspension device for the crane rope. In this case, several upwardly radiating light sources are attached to the recorded containers, which are detected by the camera.
  • cranes such as tower cranes, which also accommodate loads such as construction site products, which are often significantly smaller than containers, since the large-area container top is not available here.
  • the US 6,351,720 B1 shows finally a container crane, in which the load position is determined by means of several cameras, one of which is attached to a trolley of the crane and another on the portal of the crane to account for twisting of the crane can.
  • this entails a very complicated data processing, moreover, there is a problem that the second camera has obstacles and the like has an impaired field of view.
  • the present invention is based on the object to provide an improved tower crane of the type mentioned, the disadvantages of the prior art avoids and the latter develops in an advantageous manner.
  • an improved position determination of the load hook is to be achieved, which manages with a limited amount of data processing and thus limited computer capacity, but it determines the position without excessive time delay exactly.
  • the image evaluation unit has contour recognition means for recognizing an outline contour corresponding to the load hook and / or attached attachment in the camera image, wherein the load hook position is determined on the basis of the outline contour of the load hook and / or the attached attachment.
  • the invention is based on the consideration that at a predetermined viewing direction of the camera attached to the trolley corresponds to the position of the load hook in the camera image of the load hook position relative to the trolley or a measure of the load hook position relative to the trolley and thus with complementary attraction of the trolley position the absolute position of the load hook in space can be determined. If the camera looks exactly vertically downwards from the trolley, the position of the load hook in the camera image or the position deviation of the load hook from the center of the camera balance is a measure for the transverse offset or horizontal offset of the load hook relative to the trolley, said horizontal offset of the load hook relative to the trolley, taking into account the respective depression depth of the load hook, ie the distance of the load hook from the trolley and an optionally adjusted zoom factor of the camera can be determined.
  • no multiple cameras or images from different visual axes are needed, since the position determination can be done with only one camera or out of just one camera image, thereby saving considerable computing power.
  • the distance of the load hook from the trolley can be determined in various ways.
  • the sink depth of the load hook can be determined from the unwound Hubseilin, even with not exactly straight Hubseilverlauf a sufficiently accurate measure of the distance of the load hook from the trolley or camera mounted therein, to the said distance of the load hook from the trolley and to determine the actual relative position or the actual horizontal offset of the load hook relative to the trolley, the image position of the load hook or the offset of the load hook from the image center determined in the camera image.
  • the distance of the load hook from the trolley or the camera attached thereto can also be determined from the camera image itself, in particular by means of an image evaluation unit, the number of pixels of the image representation of the load hook and / or an associated attachment such as a Seilumlenkflasche or a another crane structure part, which is located in the vicinity of the load hook as intended, or also an associated marking and / or the size of the load hook or said attachment of said mark in the camera image. Given a known size of the load hook or known size of the attachment or the marking, the distance of the crane hook or the attachment or the mark can be determined very accurately from the camera zoom factor and the number of pixels and / or the display size in the camera image.
  • the determination of the load hook distance from the trolley by means of pixel counting can be carried out in addition to the alternative lowering depth determination, for example from the hoist rope spool length, in order to achieve a redundant system for the lowering depth determination of the load hook and thus increase safety.
  • the optical determination by means of pixel evaluation can also be provided as an alternative.
  • the identification of the load hook in the camera image provided by the camera can basically be done in various ways, for example by pixel evaluation and / or contour evaluation and / or color evaluation. Especially for example, a pixel pattern that corresponds to the load hook and / or the attached attachment such as rope bottle or special mark, as well as the outline contour and color of the load hook and / or the associated attachment can be determined. In this case, known image processing algorithms such as binary imaging, edge detection or feature selection can be used to analyze the camera image. In order to increase the probability of detection or to simplify the identification of the crane hook or the marking applied thereto, the provided image can also be subjected to a spectral analysis, wherein, for example, reflection properties can be analyzed.
  • a spectral analysis wherein, for example, reflection properties can be analyzed.
  • the image evaluation unit may comprise cable course determination means for determining the cable course of the hoist cable running from the trolley.
  • the running of the trolley hoist has in the camera image provided usually a very characteristic contour in the form of a very narrow, long straight line or a very slightly curved, long, narrow line whose starting point by the deflection of the trolley in the camera image in a relatively narrow area and thus can be easily identified.
  • the hoisting rope running off the trolley in the case of the usually provided shearing on the load hook or the associated load bottle in the camera image produces two acute-angled or conically converging lines, in whose connection point at least approximately the position of the load hook can be assumed.
  • the position to be determined for the position of the load hook can in principle be provided in various ways, advantageously an absolute coordinate position indication can be done in an absolute coordinate system, which may for example have its origin in the foot of the crane, for example, the tower longitudinal axis Z axis, the boom can describe the X axis and a vertical axis can describe the Y axis.
  • the image evaluation unit can be the image position of the load hook in the camera image determine first in a relative coordinate system, for example, a trolley coordinate system, which has its origin in the camera and / or the trolley and is aligned parallel to the aforementioned absolute coordinate system, but the Z-axis corresponding to the optical axis of the camera inverse to Z Axis of the absolute system can run. Position information in this relative coordinate system, which can be displaced by trolley movements, are then converted by the position determination means, taking into account the trolley position in position information in the abovementioned absolute coordinate system.
  • a mark of predetermined size and / or predetermined contouring on an upper side attached to the load hook or the load bottle and / or visibly facing the trolley or camera attached thereto can in this case be formed as a separate component, for example in the form of a plate attached to the top of the bottle or a target, such a separate component can be mounted or attached to the load hook or the associated load bottle, for example, welded or screwed can.
  • the load hook and / or the load bottle itself may also be designed as a marking, for example by corresponding contouring of a load hook and / or load bottle section visible towards the trolley, in which case, for example, the load hook with its top-side head section is an example angular or circular contour, for example in the form of a mushroom-shaped or collar-shaped, in plan view triangular widening can be contoured.
  • the marker in this case, for example, a ring arrangement in the manner of a target or other geometric base contour or base such as triangle, quadrangle or polygon, circle, oval or ellipse, straight or curved lines or hybrids or combinations thereof, the marker may advantageously be composed of contrasting surface pieces, such as a white circle with a black dot in its center , and / or strong, from the usual ambient colors different colorations may have, for example, luminous color dots to facilitate the identification of the marker in the camera image.
  • a camera control unit can in particular adjust the zoom factor of the camera as a function of the lowering depth of the load hook, wherein the lowering depth determined from the hoist rope length can be used here for example for a presetting of the zoom factor and / or an adjustment or readjustment of the zoom factor after distance determination by pixel counting and / or determining the image representation size as explained above.
  • the zoom factor can be increased in order to achieve a certain size of the representation of the crane hook or the associated mark in the camera image. It considerably facilitates the identification of the marking or of the load hook in the camera image if the image evaluation unit knows, at least approximately, in advance how large the pixel pattern to be identified is in the overall image or what proportion of area the image representation of the marking or the load hook makes in the overall image.
  • the said zoom factor can also be varied by the camera control device as a function of other variables, in particular as a function of the result of an image evaluation attempt. If the load hook or the associated marking can not be identified in the image at a previously set zoom factor, the zoom factor can be reduced in order to be able to search a larger area of the image. If necessary, the zoom factor can be iteratively reduced several times in order to scan larger and larger areas in several stages.
  • the zoom factor can also be increased if the load hook or the associated mark could not be identified in a camera image, which may possibly also be due to the fact that the load hook is much too small in the picture when the zoom factor is very high so that the image sharpness or pixel count is not sufficient to identify the known contour pattern of the marking and / or the load hook and / or the load bottle.
  • the camera control device and / or the image evaluation unit can also vary an area to be evaluated within the camera image provided by the camera in order to minimize the amount of data to be evaluated.
  • the image section of interest can be enlarged, in particular, if the marking or the load hook has been lost in the previously evaluated image detail, for example, because the load hook has moved out of the image section due to stronger oscillations or stronger wind load. If the marking or the load hook is lost in the image detail examined by the image evaluation unit, said image detail can be inflated once or iteratively in several stages, if appropriate, until it covers the entire camera image.
  • the image evaluation unit can be designed in such a way that only the added image section area is re-evaluated when enlarging the image section of interest or to be evaluated, for example the frame-shaped image sectioning part which has been added by enlarging the image section around the previous image section.
  • the image evaluation unit evaluates the image section in the provided camera image.
  • the image section in the provided camera image is shifted and / or reduced, preferably in such a way that the new image section to be examined is centered with respect to the identified position of the load hook or the associated marking, ie the identified marking lies in the middle of the new image section.
  • the image section can be reduced once or iteratively, in particular in such a way that the pixel pattern reproducing the marking or the load hook is reduced or the corresponding image contour pattern represents a predetermined area proportion of the respective image detail, for example representing 20% of the area of the image detail used for the evaluation.
  • the position of the load hook can advantageously be determined not only relative to the trolley of the crane, but also absolutely and / or relative to the load hook environment, for example the construction site environment, from the camera image.
  • the position determination device can have environmental determination means for determining the load hook environment, in particular in the form of characteristic obstacle and / or environmental contours, from the recorded camera image, wherein the position determination means for determining the load hook position from the determined image position of the load hook in the camera image may be formed such that the load hook position is determined relative to the load hook environment.
  • the load hook position relative to the environment which can be determined from the camera image in the above-mentioned manner, can advantageously be determined to control the crane movements, in particular to approach a load hook target, for example a settling or pickup position, or to stop crane movements or a travel path of the car Automatically change load hook to avoid a collision of the load hook and / or a load taken with an identified in the camera image obstacle such as building edge.
  • the crane may have load hook control means for controlling crane movements depending on the particular load hook position relative to the load hook environment and / or collision avoidance control means for stopping or changing crane movements depending on the particular load hook position relative to the load hook environment.
  • Fig. 1 shows the crane can be designed as a tower tower crane rotating above 1, the tower 2 extending upright carries a boom 3 and a counter-jib. Said boom 3 can be rotated relative to the tower 2 about the upright longitudinal axis of the tower 4 and assume an at least approximately horizontal position.
  • a trolley 5 is movably suspended, so that the trolley 5 can be moved substantially over the entire length of the boom 3 to the discharge of the load hook 7 vary.
  • the said load hook 7 is fastened to a hoist rope 6, which runs over said trolley 5 in order to be able to lower and lift the load hook 7.
  • a load bottle 13 can be provided on the load hook 7, cf. Fig. 2 over which the hoist rope 6 is deflected or sheared on the load hook 7.
  • a load hook position determining device 8 comprises a camera 9 mounted on the trolley 5, which is movable together with the trolley 5 and looks downwards from the trolley 5 substantially vertically.
  • the viewing axis of the camera 9 can move together with the Z-axis of the local or relative Katzkoordinatensystems.
  • the image data provided by the camera 9 can advantageously be transmitted by a cordless transmission device 19, for example in the form of a radio transmission device, to an image processing and evaluation system 20, which can advantageously be arranged in the area of the driver's cab or crane control unit, and a corresponding receiver / transmitter unit 21a which can communicate with the reception / transmission unit 21b of the transmission device 18 on the trolley.
  • the image evaluation could be done directly on the camera 9 and the trolley 5, but it is preferred to collect there only the image data and then transfer it and evaluate elsewhere to make the system in the trolley small and easy to be able to train.
  • an energy storage 22, for example in the form of a battery can be provided on the trolley 5, which can be loaded by means of a charging station 23, which can be arranged on the boom 3, for example in the parking position of the trolley 5 to to load the energy storage 22 in out-of-service times of the crane.
  • the image processing and evaluation system 20 may comprise a central computer 24, for example in the form of an industrial PC with an image processing system, which can be connected via a video server 25 with the receiving / transmitting device 21, on the one hand to receive or retrieve the image signals of the camera 9 and on the other hand to be able to send control signals to the camera 9.
  • a central computer 24 for example in the form of an industrial PC with an image processing system, which can be connected via a video server 25 with the receiving / transmitting device 21, on the one hand to receive or retrieve the image signals of the camera 9 and on the other hand to be able to send control signals to the camera 9.
  • Fig. 2 may advantageously be provided in the area of the crane driver's station and a video display 26 in order to be able to display the image of the camera 9 to the crane operator in addition to determining the position.
  • features of the load hook 7 and / or the associated load bottle 13 are advantageously defined in advance, for example geometric surfaces, shapes, contours, Colors and the like, wherein in an advantageous embodiment of the invention, a marker 14 on the upper side of the load hook 7 and the load bottle 13 can be mounted so that the mark 14 for the camera 9 is visible.
  • the mark 14 may be in the manner of a target of contrasting rings, which are set in one another.
  • a uniquely oriented marking 14 As an alternative to such a rotationally symmetric marking, however, it is also advantageously possible to use a uniquely oriented marking 14, as it does Fig. 4 shows, for example in the form of a "T", which also here again advantageously a high-contrast representation is used.
  • the marker 14 may also have other orientation determination features, for example, two or more rotationally symmetric markers may be provided in geometric relation to each other, and / or other orientation oriented rectangular marker shapes may be used find and / or geometric shapes of the load itself or the load bearing such as the spreader container crane can be used as a marker.
  • the camera 9 is advantageously controlled via control signals from the image processing and evaluation system 20, the control signals here as well about the in Fig. 2 shown radio link can be transmitted.
  • the image evaluation unit 11 attempts to discover the load or the load hook 7 on the basis of the predefined marking 14 within the image provided by the camera 9.
  • An analysis of the provided camera image can be carried out by various algorithms such as a binary image, an edge detection and / or a feature selection.
  • the load hook 7 or the load located thereon can be determined not only statically in the image, but also during dynamic movements of the load.
  • a tracking of the load a so-called tracking done.
  • the lowering depth of the load hook 7 can preferably be permanently provided by the crane control, on the basis of which at least approximately it can be estimated at which distance the load hook 7 from the camera 9 is located. Thereupon, the image processing and evaluation system 20 adjusts the camera zoom of the camera 9 accordingly.
  • the analysis of the respectively provided camera image can be carried out continuously, preferably by means of edge detection, binary image generation and feature selection with respect to the known mark 14.
  • the processing is advantageously carried out within a predefinable image detail in a specific region of the camera image. Since the size, depending on the operating case can be kept very small, the computational effort is thereby considerably reduced.
  • the image section can be selected to be minimally so small that it essentially corresponds to the marker size.
  • the image detail to be analyzed can at most correspond substantially to the entire size of the complete camera image.
  • the position and / or size of said image detail may be determined based on the last known marker positions and an estimated prediction.
  • a so-called Kalman filter or other filter devices can be used, which can make a prediction on the basis of the past values.
  • the image section to be examined can be arbitrarily placed in the image. Should no mark be found in this image section, the image section can be continuously increased until the marker 14 is within the image section and can be detected.
  • the image evaluation unit 11 determines the image position of the load hook 7 or the mark 14 in the camera image, from which the position determining means 12 then determine the load hook position in the relative coordinate system of the trolley 5.
  • Said relative Katzkoordinatensystem can be chosen so that it has its origin in the optical axis of the camera 9 and the zero point of the sinking depth, which may be in the trolley 5.
  • the trolley 5 On the basis of the known size of the mark 14, the currently set zoom factor of the camera 9 as well as the number of pixels of the mark 14 in the camera image measured by the sensor, an exact distance determination of the mark 14 can be made by the trolley 5. From this, the Z-offset or the Z-difference of the load hook 7 can be determined to the sinking depth, which sinking depth can be determined for example by determining the unwound Hubseilbine. By separately measuring the actual sink depth over the pixel size of the marker 14 in the camera image, a redundancy to the conventional Senektiefesensor can be achieved.
  • the load Since in real use the load is never really at rest due to crane movements, wind influences or the dynamics of the crane, the load oscillates, the pendulum frequency being dependent on the rope length of the hoist rope 6.
  • the pendulum amplitude depends on the mass and other factors such as the dynamics of movement or the wind input.
  • the image evaluation device may lose the marking 14.
  • the following procedure can be adopted: First of all, for example, the image detail of the camera image to be analyzed can be inflated or enlarged and / or shifted onto an image section by expecting the reentry of the marking 14. Alternatively or additionally, the entire camera image can also be defined as an image detail, in particular if the available computing power is sufficiently large.
  • the camera 9 can also zoom back one or more stages in order to enlarge the image area. Due to the thus enlarged image area, there is a high probability that the marker will be within the image again. In order to compensate for the disadvantages of the resulting smaller marking size, the zoom factor of the camera 9 can be iteratively increased in several steps and also reduced again.
  • the image evaluation unit 11 may comprise cable course determination means 17 by means of which the course of the hoisting rope 6 is determined in the camera image, as this Fig. 5 shows. Based on the detected Hubseilverlaufs in the camera image, the position of the load hook 7 can be determined or at least the area are narrowed, in which the load hook 9 and the marker 14 must lie, so that said Hubseil-course determination as an alternative or in addition to the detection of said marker or of the load hook 7 can be provided directly from the camera image.
  • the determination of the hook position or narrowing of the area in which the load hook must be 7, using the Rope course determination is based on the assumption that the hoist rope 6 in a reeving on the load bottle 13 in the camera image has a conical shape, in particular conically to the load runs, cf. Fig. 5 so that the load hook 7 or the load and their position can be determined as the end of the cone defined by the hoist rope sections.
  • the measured image can also be subjected to a spectral analysis in a development of the invention.
  • the reflection properties of the features of the load, the load hook 7 or the marking 14 in certain spectral regions can expand the feature space and be used for the identification.
  • Such an approach can be part of a pre-filtering of the image, which significantly reduces the quantity of image data to be examined with the aid of the algorithms mentioned. This significantly reduces the effort of the algorithms for detecting the hook position. Even adverse weather conditions such as snow, ice, rain, fog, sunlight, shadows, etc. can be at least partially compensated.
  • Such a spectral analysis can be advantageously optimized by the use of special lacquers for the marking 14, for example by the Use of paints or other surface coatings that have low reflective properties in the near infrared range.
  • a known Landsat algorithm can be used.

Description

Die vorliegende Erfindung betrifft einen Kran, insbesondere Turmdrehkran, mit einem um eine aufrechte Achse drehbaren Kranausleger, an dem eine Laufkatze verfahrbar angeordnet ist, von der ein mit einem Lasthaken verbundenes Hubseil abläuft, sowie einer Lasthaken-Positionsbestimmungseinrichtung zur Bestimmung der Lasthakenposition.The present invention relates to a crane, in particular a tower crane, with a crane boom rotatable about an upright axis, on which a trolley is movably arranged, from which a lifting cable connected to a load hook runs, and a load hook position determining device for determining the load hook position.

Einen Kran mit einer Lasthaken-Positionsbestimmungseinrichtung zeigt beispielsweise die Schrift WO 91/14644 A1 .A crane with a load hook position determining device, for example, the font shows WO 91/14644 A1 ,

Turmdrehkrane können einen zumindest näherungsweise liegenden Kranausleger aufweisen, der von einem sich aufrecht erstreckenden Turm getragen wird und um die aufrechte Turmlängsachse verdreht werden kann. Bei einem sog. Obendreher dreht sich hierbei der Ausleger relativ zum Turm, während bei einem Untendreher der ganze Turm und damit der daran angelenkte Ausleger verdreht wird. Der Abstand des Lasthakens von der Turmachse kann mittels einer Laufkatze eingestellt werden, die entlang des Auslegers verfahrbar ist, wobei das mit dem Lasthaken verbundene Hubseil über die besagte Laufkatze abläuft.Tower cranes may have an at least approximately crane jib which is carried by a tower which extends upright and can be turned around the upright longitudinal axis of the tower. In the case of a so-called head turner, the boom rotates relative to the tower, while in the case of a bottom turner, the entire tower and thus the arm articulated thereon are rotated. The distance of the load hook from the tower axis can be adjusted by means of a trolley, which is movable along the boom, wherein the lifting cable connected to the load hook runs over the said trolley.

Aus verschiedenen Gründen ist es hierbei wünschenswert, die exakte Position des Lasthakens über eine entsprechende Lasthaken-Positionsbestimmungseinrichtung möglichst exakt zu bestimmen. Dies kann nicht nur vorteilhaft sein, wenn der Lasthaken beispielsweise hinter einer Mauer für den Kranführer nicht mehr sichtbar ist, sondern auch dann, wenn die Laufkatzenposition nicht mehr exakt mit der Lasthakenposition übereinstimmt, d.h. in senkrechter Richtung nicht mehr deckungsgleich ist (es versteht sich, dass durch die Senktiefe des Lasthakens die Höhenstellung von Lasthaken und Laufkatze abweicht). Eine solche Abweichung der Lasthakenposition von der Laufkatzenposition kann verschiedene Ursachen haben, beispielsweise einen ungeraden Verlauf des Hubseils oder dynamische Auslenkungen wie Pendelbewegungen der Last oder Windauslenkungen. Je nach zu bewerkstelligender Aufgabe kann es dabei ausreichend sein, die Lasthakenposition nur relativ zur Laufkatze bzw. zum Kran zu bestimmen, beispielsweise um Pendelbewegungen zu dämpfen, oder es kann auch eine absolute Lasthakenposition im Raum benötigt werden, beispielsweise um einen automatisierten Betrieb bei Umschlagvorgängen zu realisieren. Von solchen Verwendungen des Lasthakenpositionssignals zu Steuerungszwecken abgesehen kann durch Bestimmung der Lasthakenposition auch eine erhöhte Sicherheit erreicht werden, da die Last permanent überwacht werden kann, wobei ggf. auch eine Redundanz des Senktiefensensors erreicht werden kann.For various reasons, it is desirable in this case to determine the exact position of the load hook via a corresponding load hook position determination device as accurately as possible. This can not only be beneficial if the load hook For example, behind a wall for the crane operator is no longer visible, but also when the trolley position no longer coincides exactly with the hook position, that is no longer congruent in the vertical direction (it is understood that the vertical position of load hook by the lowering depth of the load hook and trolley deviates). Such a deviation of the load hook position from the trolley position can have different causes, for example, an odd course of the hoisting rope or dynamic deflections such as pendulum movements of the load or wind deflections. Depending on the task to be accomplished, it may be sufficient to determine the hook position only relative to the trolley or crane, for example, to dampen oscillations, or it may also be an absolute load hook position required in the room, for example, an automated operation at Umschlagvorgängen realize. Apart from such uses of the load hook position signal for control purposes, increased safety can also be achieved by determining the load hook position, since the load can be permanently monitored, whereby possibly a redundancy of the lowering depth sensor can also be achieved.

Aus dem Stand der Technik ist es dabei bekannt, die Lasthakenposition optisch zu erfassen. Beispielsweise zeigt die JP 9-142773 einen Kran, an dessen Auslegerspitze, von der das Hubseil abläuft, eine nach unten blickende Kamera montiert ist, deren Blickrichtung verstellt wird, um Pendelbewegungen des Lasthakens zu folgen, so dass der Kranführer über die Kamera stets den Lasthaken sehen kann. Die DE 197 25 315 C2 beschreibt einen Hüttenwerkskran mit einem relativ zu einem Tragrahmen verfahrbaren Katzfahrwerk, von dem das Hubseil abläuft. An dem Tragrahmen sind mehrere Kameras angeordnet, deren Blickfeld groß genug ist, um den Kranhaken bei verschiedenen Katzfahrwerkstellungen erfassen zu können. Bei einem solchen Hüttenwerkskran sind die anzufahrenden Positionen relativ starr vorgegeben, so dass die zu verarbeitende Bilddatenmenge handhabbar bleibt. Würde ein solches System indes bei einem Turmdrehkran verwendet, käme eine kaum mehr zu verarbeitende Datenflut zustande.It is known from the prior art to optically detect the load hook position. For example, the shows JP 9-142773 a crane, on whose jib tip from which the hoist rope runs, a down-facing camera is mounted, the viewing direction is adjusted to follow pendulum movements of the load hook, so that the crane operator can always see the load hook on the camera. The DE 197 25 315 C2 describes a metallurgical crane with a relative to a support frame movable trolley from which runs the hoist. On the support frame several cameras are arranged, the field of view is large enough to detect the crane hook at different Katzfahrwerkstellungen. In such a metallurgical crane, the positions to be approached are relatively rigid, so that the amount of image data to be processed remains manageable. If such a system were used in a tower crane, however, a flood of data that could hardly be processed would come about.

Aus der Schrift WO 2005/082770 A1 ist ferner ein Turmdrehkran bekannt, an dessen Laufkatze eine nach unten blickende Kamera angebracht ist, um dem Kranführer ein Videobild der Lasthaken-Umgebung anzuzeigen, so dass der Kranführer in Bewegungsrichtung liegende Hindernisse besser erkennen kann. Dieses Kamerasystem dient der Visualisierung von Hindernissen bzw. des Absetz- oder Aufnahmebereichs, den der Kranführer anzusteuern hat, es wird jedoch dabei nicht die Lasthakenposition relativ zum Kran oder absolut im Raum bestimmt.From the Scriptures WO 2005/082770 A1 Furthermore, a tower crane is known, on the trolley, a downward-facing camera is mounted to the crane operator to display a video image of the load hook environment, so that the crane operator can better detect obstacles lying in the direction of movement. This camera system is used to visualize obstacles or the settling or receiving area, which the crane operator has to control, but it is not the load hook position relative to the crane or determined absolutely in space.

Die DE 41 90 587 C2 beschreibt einen Schiffscontainer-Kran, bei dem eine Lasthakenposition mittels einer Kamera, die an der Aufhängungsvorrichtung für das Kranseil angebracht ist, bestimmt wird. Dabei werden an den aufgenommenen Containern mehrere nach oben strahlende Lichtquellen angebracht, die von der Kamera erfasst werden. Dies ist jedoch bei Kranen wie Turmdrehkranen, die auch Lasten wie Baustellenprodukte, die oft deutlich kleiner sind als Container, aufnehmen, nicht ohne weiteres möglich, da hier nicht die großflächige Containeroberseite zur Verfügung steht.The DE 41 90 587 C2 describes a shipping container crane in which a load hook position is determined by means of a camera which is attached to the suspension device for the crane rope. In this case, several upwardly radiating light sources are attached to the recorded containers, which are detected by the camera. However, this is not readily possible with cranes such as tower cranes, which also accommodate loads such as construction site products, which are often significantly smaller than containers, since the large-area container top is not available here.

In ähnlicher Weise mit Lichtquellen arbeitet die DE 102 45 970 A1 , bei der zusätzlich auch von oben her die Last mittels einer Lichtquelle bestrahlt wird. Die andere, an der aufzunehmenden Last angebrachte Lichtquelle sendet ein Lichtsignal nur dann nach oben an die Aufhängevorrichtung - sozusagen als optisches Echo -, wenn die Last von der oberen Lichtquelle bestrahlt wird.Similarly, with light sources works the DE 102 45 970 A1 , in which the load is additionally irradiated from above by means of a light source. The other light source mounted on the load to be picked up sends a light signal only up to the suspension device - as an optical echo, so to speak - when the load from the upper light source is irradiated.

Die US 6 351 720 B1 zeigt schließlich einen Containerkran, bei dem die Lastposition mittels mehrerer Kameras ermittelt wird, von denen eine an einer Laufkatze des Krans und eine andere am Portal des Krans angebracht ist, um Verwindungen des Krans berücksichtigen zu können. Dies bringt jedoch eine sehr aufwendige Datenverarbeitung mit sich, zudem besteht das Problem, dass die zweite Kamera ducrch Hindernisse und dgl. ein beeinträchtigtes Blickfeld hat.The US 6,351,720 B1 shows finally a container crane, in which the load position is determined by means of several cameras, one of which is attached to a trolley of the crane and another on the portal of the crane to account for twisting of the crane can. However, this entails a very complicated data processing, moreover, there is a problem that the second camera has obstacles and the like has an impaired field of view.

Der vorliegenden Erfindung liegt die Aufgabe zu Grunde, einen verbesserten Turmdrehkran der genannten Art zu schaffen, der Nachteile des Standes der Technik vermeidet und Letzteren in vorteilhafter Weise weiterbildet. Insbesondere soll eine verbesserte Positionsbestimmung des Lasthakens erreicht werden, die mit einer begrenzten Datenverarbeitungsmenge und damit begrenzter Rechnerkapazität auskommt, dabei jedoch ohne übermäßige Zeitverzögerung die Position exakt bestimmt.The present invention is based on the object to provide an improved tower crane of the type mentioned, the disadvantages of the prior art avoids and the latter develops in an advantageous manner. In particular, an improved position determination of the load hook is to be achieved, which manages with a limited amount of data processing and thus limited computer capacity, but it determines the position without excessive time delay exactly.

Erfindungsgemäß wird die genannte Aufgabe durch einen Turmdrehkran gemäß Anspruch 1 gelöst. Bevorzugte Ausgestaltungen der Erfindung sind Gegenstand der abhängigen Ansprüche.According to the invention, said object is achieved by a tower crane according to claim 1. Preferred embodiments of the invention are the subject of the dependent claims.

Es wird also vorgeschlagen, die Lasthakenposition optisch mittels einer Kamera zu bestimmen, die an der Laufkatze des Krans angebracht ist und von der Laufkatze in vorbestimmter und damit bekannter Blickrichtung nach unten auf den Lasthaken blickt. Dabei wird von einer Bildauswerteeinheit die Position des Lasthakens im Kamerabild bestimmt. Aus der Position des Lasthakens im Kamerabild und der Laufkatzenstellung bestimmen Auswertemittel sodann die tatsächliche Lasthakenposition. Erfindungsgemäß besitzt die Bildauswerteeinheit Konturerkennungsmittel zum Erkennen einer dem Lasthaken und/oder einem daran angebrachten Anbauteil entsprechenden Umrisskontur in dem Kamerabild, wobei die Lasthakenposition anhand der Umrisskontur des Lasthakens und/oder dem daran angebrachten Anbauteil bestimmt wird. Die Erfindung geht dabei von der Überlegung aus, dass bei vorbestimmter Blickrichtung der an der Laufkatze angebrachten Kamera die Position des Lasthakens im Kamerabild der Lasthakenposition relativ zur Laufkatze entspricht bzw. ein Maß für die Lasthakenposition relativ zur Laufkatze ist und somit unter ergänzender Heranziehung der Laufkatzenposition die absolute Position des Lasthakens im Raum bestimmt werden kann. Blickt die Kamera von der Laufkatze exakt senkrecht nach unten, ist die Position des Lasthakens im Kamerabild bzw. die Ortsabweichung des Lasthakens vom Zentrum des Kamerabi-Ids ein Maß für den Querversatz bzw. Horizontalversatz des Lasthakens gegenüber der Laufkatze, wobei der genannte Horizontalversatz des Lasthakens gegenüber der Laufkatze unter Heranziehung der jeweiligen Senktiefe des Lasthakens, d.h. des Abstands des Lasthakens von der Laufkatze und einem gegebenenfalls eingestellten Zoomfaktor der Kamera bestimmt werden kann. Vorteilhafterweise werden keine mehreren Kameras oder Bilder aus verschiedenen Blickachsen benötigt, da die Positionsbestimmung mit nur einer Kamera bzw. aus nur einem Kamerabild heraus erfolgen kann, wodurch beträchtlich Rechenleistung gespart wird.It is therefore proposed optically to determine the hook position by means of a camera which is mounted on the trolley of the crane and looks down from the trolley in a predetermined and thus known viewing direction down to the load hook. The position of the load hook in the camera image is determined by an image evaluation unit. From the position of the load hook in the camera image and the trolley position, evaluation means then determine the actual load hook position. According to the invention, the image evaluation unit has contour recognition means for recognizing an outline contour corresponding to the load hook and / or attached attachment in the camera image, wherein the load hook position is determined on the basis of the outline contour of the load hook and / or the attached attachment. The invention is based on the consideration that at a predetermined viewing direction of the camera attached to the trolley corresponds to the position of the load hook in the camera image of the load hook position relative to the trolley or a measure of the load hook position relative to the trolley and thus with complementary attraction of the trolley position the absolute position of the load hook in space can be determined. If the camera looks exactly vertically downwards from the trolley, the position of the load hook in the camera image or the position deviation of the load hook from the center of the camera balance is a measure for the transverse offset or horizontal offset of the load hook relative to the trolley, said horizontal offset of the load hook relative to the trolley, taking into account the respective depression depth of the load hook, ie the distance of the load hook from the trolley and an optionally adjusted zoom factor of the camera can be determined. Advantageously, no multiple cameras or images from different visual axes are needed, since the position determination can be done with only one camera or out of just one camera image, thereby saving considerable computing power.

Der Abstand des Lasthakens von der Laufkatze kann hierbei in verschiedener Weise bestimmt werden. Einerseits kann die Senktiefe des Lasthakens aus der abgespulten Hubseillänge bestimmt werden, die auch bei nicht exakt geradem Hubseilverlauf ein ausreichend genaues Maß für den Abstand des Lasthakens von der Laufkatze bzw. der darin montierten Kamera gibt, um aus dem besagten Abstand des Lasthakens von der Laufkatze und der im Kamerabild bestimmten Bildposition des Lasthakens bzw. des Versatzes des Lasthakens aus dem Bildzentrum heraus die tatsächliche Relativposition bzw. den tatsächlichen Horizontalversatz des Lasthakens gegenüber der Laufkatze zu bestimmen.The distance of the load hook from the trolley can be determined in various ways. On the one hand, the sink depth of the load hook can be determined from the unwound Hubseillänge, even with not exactly straight Hubseilverlauf a sufficiently accurate measure of the distance of the load hook from the trolley or camera mounted therein, to the said distance of the load hook from the trolley and to determine the actual relative position or the actual horizontal offset of the load hook relative to the trolley, the image position of the load hook or the offset of the load hook from the image center determined in the camera image.

Alternativ oder zusätzlich kann der Abstand des Lasthakens von der Laufkatze bzw. der daran angebrachten Kamera auch aus dem Kamerabild selbst bestimmt werden, insbesondere mittels einer Bildauswerteeinheit, die die Pixelanzahl der Bilddarstellung des Lasthakens und/oder eines damit verbundenen Anbauteils wie beispielsweise einer Seilumlenkflasche oder eines anderen Kranstrukturteils, das sich bestimmungsgemäß in der Nähe des Lasthakens befindet, oder auch einer damit verbundenen Markierung und/oder die Größe des Lasthakens oder des genannten Anbauteils der genannten Markierung im Kamerabild bestimmt. Bei bekannter Größe des Lasthakens bzw. bekannter Größe des Anbauteils oder der Markierung kann aus dem Kamera-Zoomfaktor und der Pixelanzahl und/oder der Darstellungsgröße im Kamerabild der Abstand des Kranhakens bzw. des Anbauteils oder der Markierung sehr exakt bestimmt werden. Die Bestimmung des Lasthakenabstands von der Laufkatze mittels Pixelzählung kann zusätzlich zur alternativen Senktiefenbestimmung beispielsweise aus der Hubseil-Spullänge erfolgen, um ein redundantes System für die Senktiefenbestimmung des Lasthakens zu erzielen und somit die Sicherheit zu erhöhen. Gegebenenfalls kann die optische Bestimmung mittels Pixelauswertung jedoch auch alternativ vorgesehen sein.Alternatively or additionally, the distance of the load hook from the trolley or the camera attached thereto can also be determined from the camera image itself, in particular by means of an image evaluation unit, the number of pixels of the image representation of the load hook and / or an associated attachment such as a Seilumlenkflasche or a another crane structure part, which is located in the vicinity of the load hook as intended, or also an associated marking and / or the size of the load hook or said attachment of said mark in the camera image. Given a known size of the load hook or known size of the attachment or the marking, the distance of the crane hook or the attachment or the mark can be determined very accurately from the camera zoom factor and the number of pixels and / or the display size in the camera image. The determination of the load hook distance from the trolley by means of pixel counting can be carried out in addition to the alternative lowering depth determination, for example from the hoist rope spool length, in order to achieve a redundant system for the lowering depth determination of the load hook and thus increase safety. Optionally, however, the optical determination by means of pixel evaluation can also be provided as an alternative.

Die Identifizierung des Lasthakens in dem von der Kamera bereitgestellten Kamerabild kann grundsätzlich in verschiedener Art und Weise erfolgen, beispielsweise durch Pixelauswertung und/oder Konturauswertung und/oder Farbauswertung. Insbesondere können ein Pixelmuster, das dem Lasthaken und/oder dem damit verbunden Anbauteil wie Seilflasche oder spezieller Markierung entspricht, sowie die Umrisskontur und Farbe des Lasthakens und/oder des damit verbundenen Anbauteils bestimmt werden. Hierbei können in der Bildverarbeitung an sich bekannte Algorithmen wie Binär-bilderstellung, Kantendetektion oder Merkmalsselektion eingesetzt werden, um das Kamerabild zu analysieren. Um die Entdeckungswahrscheinlichkeit zu erhöhen bzw. die Identifizierung des Kranhakens oder der daran angebrachten Markierung zu vereinfachen, kann das bereitgestellte Bild auch einer Spektralanalyse unterzogen werden, wobei beispielsweise Reflexionseigenschaften analysiert werden können.The identification of the load hook in the camera image provided by the camera can basically be done in various ways, for example by pixel evaluation and / or contour evaluation and / or color evaluation. Especially For example, a pixel pattern that corresponds to the load hook and / or the attached attachment such as rope bottle or special mark, as well as the outline contour and color of the load hook and / or the associated attachment can be determined. In this case, known image processing algorithms such as binary imaging, edge detection or feature selection can be used to analyze the camera image. In order to increase the probability of detection or to simplify the identification of the crane hook or the marking applied thereto, the provided image can also be subjected to a spectral analysis, wherein, for example, reflection properties can be analyzed.

Um das Finden des Lasthakens im Kamerabild zu vereinfachen, kann die Bildauswerteeinheit Seilverlaufs-Bestimmungsmittel zur Bestimmung des Seilverlaufs des von der Laufkatze ablaufenden Hubseils umfassen. Das von der Laufkatze ablaufende Hubseil besitzt in dem bereitgestellten Kamerabild in der Regel eine sehr charakteristische Kontur in Form einer sehr schmalen, langen Geraden bzw. einer nur sehr leicht gekrümmten, langen, schmalen Linie, deren Ausgangspunkt durch die Umlenkung an der Laufkatze im Kamerabild in einem relativ eng umgrenzten Bereich liegt und somit leicht identifiziert werden kann. Insbesondere erzeugt das von der Laufkatze ablaufende Hubseil bei der üblicherweise vorgesehenen Einscherung am Lasthaken bzw. der damit verbundenen Lastflasche im Kamerabild zwei spitzwinklig bzw. konisch zusammenlaufende Linien, in deren Verbindungspunkt zumindest näherungsweise die Position des Lasthakens angenommen werden kann.In order to simplify finding the load hook in the camera image, the image evaluation unit may comprise cable course determination means for determining the cable course of the hoist cable running from the trolley. The running of the trolley hoist has in the camera image provided usually a very characteristic contour in the form of a very narrow, long straight line or a very slightly curved, long, narrow line whose starting point by the deflection of the trolley in the camera image in a relatively narrow area and thus can be easily identified. In particular, the hoisting rope running off the trolley in the case of the usually provided shearing on the load hook or the associated load bottle in the camera image produces two acute-angled or conically converging lines, in whose connection point at least approximately the position of the load hook can be assumed.

Die zu bestimmende Positionsangabe für die Position des Lasthakens kann hierbei grundsätzlich in verschiedener Art und Weise bereitgestellt werden, wobei vorteilhafterweise eine absolute Koordinaten-Positionsangabe in einem absoluten Koordinatensystem erfolgen kann, welches beispielsweise seinen Ursprung im Fuß des Krans haben kann, wobei beispielsweise die Turmlängsachse die Z-Achse, der Ausleger die X-Achse und eine dazu senkrechte Achse die Y-Achse beschreiben kann. Die Bildauswerteeinheit kann dabei die Bildposition des Lasthakens im Kamerabild zunächst in einem relativen Koordinatensystem, beispielsweise einem Laufkatzen-Koordinatensystem bestimmen, welches seinen Ursprung in der Kamera und/oder der Laufkatze hat und parallel zum vorgenannten absoluten Koordinatensystem ausgerichtet ist, wobei jedoch die Z-Achse entsprechend der optischen Achse der Kamera invers zur Z-Achse des absoluten Systems verlaufen kann. Positionsangaben in diesem relativen Koordinatensystem, welches sich durch Laufkatzenbewegungen verschieben kann, werden dann von den Positionsbestimmungsmitteln unter Berücksichtigung der Laufkatzenstellung in Positionsangabe im vorgenannten absoluten Koordinatensystem umgerechnet.The position to be determined for the position of the load hook can in principle be provided in various ways, advantageously an absolute coordinate position indication can be done in an absolute coordinate system, which may for example have its origin in the foot of the crane, for example, the tower longitudinal axis Z axis, the boom can describe the X axis and a vertical axis can describe the Y axis. The image evaluation unit can be the image position of the load hook in the camera image determine first in a relative coordinate system, for example, a trolley coordinate system, which has its origin in the camera and / or the trolley and is aligned parallel to the aforementioned absolute coordinate system, but the Z-axis corresponding to the optical axis of the camera inverse to Z Axis of the absolute system can run. Position information in this relative coordinate system, which can be displaced by trolley movements, are then converted by the position determination means, taking into account the trolley position in position information in the abovementioned absolute coordinate system.

Um die Bildauswertung zu vereinfachen und die Datenmenge zu reduzieren, kann in Weiterbildung der Erfindung an dem Lasthaken oder der damit verbundenen Lastflasche, mittels derer das Hubseil am Lasthaken umgelenkt wird, eine Markierung vorbestimmter Größe und/oder vorbestimmter Konturierung angeordnet sein, die an einer Oberseite des Lasthakens bzw. der Lastflasche angebracht und/oder der Laufkatze bzw. der daran angebrachten Kamera sichtbar zugewandt ist. Die genannte Markierung kann hierbei als separates Bauteil ausgebildet sein, beispielsweise in Form eines oberseitig an der Flasche angebrachten Tellers oder einer Zielscheibe, wobei ein solches separates Bauteil an dem Lasthaken oder der damit verbundene Lastflasche montiert bzw. angebaut sein kann, beispielsweise angeschweißt oder festgeschraubt sein kann.In order to simplify the image analysis and reduce the amount of data can be arranged in a further development of the invention on the load hook or the associated load bottle, by means of which the hoist rope is deflected on the load hook, a mark of predetermined size and / or predetermined contouring on an upper side attached to the load hook or the load bottle and / or visibly facing the trolley or camera attached thereto. Said marking can in this case be formed as a separate component, for example in the form of a plate attached to the top of the bottle or a target, such a separate component can be mounted or attached to the load hook or the associated load bottle, for example, welded or screwed can.

Alternativ oder zusätzlich zu einem solchen separaten Markierungsteil kann auch der Lasthaken und/oder die Lastflasche selbst als Markierung ausgebildet sein, beispielsweise durch entsprechende Konturierung eines zur Laufkatze hin sichtbaren Lasthaken- und/oder Lastflaschenabschnitts, wobei hier beispielsweise der Lasthaken mit seinem oberseitigen Kopfabschnitt eine beispielsweise eckige oder runde Kontur, beispielsweise in Form einer pilz- oder kragenförmigen, in der Draufsicht dreieckförmigen Verbreiterung konturiert sein kann.As an alternative or in addition to such a separate marking part, the load hook and / or the load bottle itself may also be designed as a marking, for example by corresponding contouring of a load hook and / or load bottle section visible towards the trolley, in which case, for example, the load hook with its top-side head section is an example angular or circular contour, for example in the form of a mushroom-shaped or collar-shaped, in plan view triangular widening can be contoured.

Als Markierung kann hierbei beispielsweise eine Ringanordnung nach Art einer Zielscheibe oder auch eine andere geometrische Grundkontur oder Grundfläche wie beispielsweise Dreieck, Viereck oder Mehreck, Kreis, Oval oder Ellipse, gerade oder gebogene Linien oder Mischformen bzw. Kombinationen hieraus vorgesehen sein, wobei die Markierung vorteilhafterweise aus zueinander kontrastreichen Flächenstücken, beispielsweise ein weißer Kreis mit einem schwarzen Punkt in seiner Mitte zusammengesetzt sein kann, und/oder kräftige, von den üblichen Umgebungsfarben abweichende Farbgebungen aufweisen kann, beispielsweise Leuchtfarbenpunkte, um die Identifizierung der Markierung im Kamerabild zu vereinfachen.As a marker, in this case, for example, a ring arrangement in the manner of a target or other geometric base contour or base such as triangle, quadrangle or polygon, circle, oval or ellipse, straight or curved lines or hybrids or combinations thereof, the marker may advantageously be composed of contrasting surface pieces, such as a white circle with a black dot in its center , and / or strong, from the usual ambient colors different colorations may have, for example, luminous color dots to facilitate the identification of the marker in the camera image.

Um nicht nur die Position, sondern auch die Ausrichtung der Markierung im Kamerabild einfacher bestimmen zu können, kann in vorteilhafter Weise eine von rotationssymmetrischen Formen abweichende Markierung, insbesondere eindeutig orientierte Markierungskonturen verwendet werden, beispielsweise in Form eines "T" oder eines gleichschenkligen, nicht gleichseitigen Dreiecks oder dergleichen. Bei Verwendung derartiger Markierungen kann durch die Bildauswerteeinheit und entsprechende Auswertung des Kamerabilds nicht nur die exakte Lage des Lasthakens, sondern auch eine Verdrehung gegenüber der Auslegerausrichtung bestimmt werden, die beispielsweise durch Verdrehung der am Lasthaken hängenden Last eintreten kann.In order to be able to determine not only the position but also the orientation of the marking in the camera image, it is advantageously possible to use a marking deviating from rotationally symmetrical shapes, in particular clearly oriented marking contours, for example in the form of a "T" or an isosceles, not equilateral Triangles or the like. When using such markings not only the exact position of the load hook, but also a rotation relative to the boom alignment can be determined by the image evaluation unit and corresponding evaluation of the camera image, which can occur, for example, by rotation of the load hook hanging on the load hook.

Darüber hinaus kann insbesondere bei schwierigen Montagebedingungen für separat anzubringende Marker am Kranhaken der sichtbare Haken an sich als Marker verwendet werden, beispielsweise in der vorgenannten Weise durch spezielle Konturierung des der Laufkatze zugewandten Kopfabschnitts. Dies kann in Anlehnung an die Gesichtserkennung erfolgen, wie sie bei Überwachungssystemen eingesetzt wird. Dabei können geeignete geometrische Merkmale des Kranhakens als Marker bzw. Markierung verwendet werden. Dies bringt den Vorteil, dass separate Markeranbauten unnötig sind, welche im Betrieb beschädigt oder verschmutzt werden können. Vorteilhaft bei der Entwicklung ist, dass nur eine bestimmte Anzahl an vorbestimmten Merkmalen sichtbar sein müssen. Auch bei einer teilweisen Verdeckung einzelner Merkmale wird der Kranhaken noch zuverlässig in seiner Position und Orientierung erkannt.In addition, especially in difficult installation conditions for separately mounted marker on the crane hook of the visible hook can be used as a marker, for example in the aforementioned manner by special contouring of the trolley facing head section. This can be done on the basis of face recognition, as used in surveillance systems. In this case, suitable geometric features of the crane hook can be used as markers or markers. This has the advantage that separate marker attachments are unnecessary, which can be damaged or contaminated during operation. An advantage of the development is that only a certain number of predetermined features must be visible. Even with a partial covering of individual features of the crane hook is still reliably detected in its position and orientation.

Um die Datenverarbeitungsmenge bei der Bildauswertung möglichst klein zu halten, kann in vorteilhafter Weiterbildung der Erfindung der auszuwertende Bildbereich und/oder die Größe des auszuwertenden Bildes in Abhängigkeit verschiedener Betriebsparameter variabel gesteuert werden. Eine Kamerasteuereinheit kann insbesondere den Zoomfaktor der Kamera in Abhängigkeit der Senktiefe des Lasthakens einstellen, wobei hier beispielsweise für eine Voreinstellung des Zoomfaktors die aus der Hubseil-Spullänge bestimmte Senktiefe verwendet werden kann und/oder eine Justierung oder Nachjustierung des Zoomfaktors nach erfolgter Abstandsbestimmung durch Pixelzählung und/oder Bestimmung der Bilddarstellungsgröße wie zuvor erläutert erfolgen kann. Insbesondere kann mit zunehmender Senktiefe bzw. zunehmendem Abstand des Lasthakens von der Laufkatze der Zoomfaktor erhöht werden, um eine bestimmte Größe der Darstellung des Kranhakens oder der damit verbundenen Markierung im Kamerabild zu erreichen. Es erleichtert die Identifizierung der Markierung bzw. des Lasthakens im Kamerabild beträchtlich, wenn die Bildauswerteeinheit - zumindest näherungsweise - im Voraus weiß, wie groß das zu identifizierende Pixelmuster im Gesamtbild ist bzw. welchen Flächenanteil die Bilddarstellung der Markierung bzw. des Lasthakens im Gesamtbild ausmacht.In order to keep the data processing volume as small as possible in the image evaluation, the image area to be evaluated and / or the size of the image to be evaluated can be variably controlled in dependence on various operating parameters in an advantageous development of the invention. A camera control unit can in particular adjust the zoom factor of the camera as a function of the lowering depth of the load hook, wherein the lowering depth determined from the hoist rope length can be used here for example for a presetting of the zoom factor and / or an adjustment or readjustment of the zoom factor after distance determination by pixel counting and / or determining the image representation size as explained above. In particular, with increasing lowering depth or increasing distance of the load hook from the trolley, the zoom factor can be increased in order to achieve a certain size of the representation of the crane hook or the associated mark in the camera image. It considerably facilitates the identification of the marking or of the load hook in the camera image if the image evaluation unit knows, at least approximately, in advance how large the pixel pattern to be identified is in the overall image or what proportion of area the image representation of the marking or the load hook makes in the overall image.

Alternativ oder zusätzlich kann der genannte Zoomfaktor von der Kamerasteuervorrichtung auch in Abhängigkeit anderer Größen variiert werden, insbesondere in Abhängigkeit des Ergebnisses eines Bildauswerteversuchs. Kann bei einem zuvor eingestellten Zoomfaktor der Lasthaken oder die damit verbundene Markierung nicht im Bild identifiziert werden, kann der Zoomfaktor verkleinert werden, um einen größeren Bildausschnitt der Umgebung absuchen zu können. Gegebenfalls kann der Zoomfaktor iterativ mehrfach verkleinert werden, um in mehreren Stufen immer größere Bereiche abzusuchen. Alternativ oder zusätzlich kann der Zoomfaktor jedoch auch vergrößert werden, wenn der Lasthaken bzw. die damit verbundene Markierung in einem Kamerabild nicht identifiziert werden konnte, was gegebenenfalls auch daran liegen kann, dass der Lasthaken bei sehr stark zu kleinem Zoomfaktor im Bild viel zu klein dargestellt wird, sodass die Bildschärfe bzw. Pixelzahl nicht ausreicht, um das bekannte Konturmuster der Markierung und/oder des Lasthakens und/oder der Lastflasche zu identifizieren.Alternatively or additionally, the said zoom factor can also be varied by the camera control device as a function of other variables, in particular as a function of the result of an image evaluation attempt. If the load hook or the associated marking can not be identified in the image at a previously set zoom factor, the zoom factor can be reduced in order to be able to search a larger area of the image. If necessary, the zoom factor can be iteratively reduced several times in order to scan larger and larger areas in several stages. Alternatively or additionally, however, the zoom factor can also be increased if the load hook or the associated mark could not be identified in a camera image, which may possibly also be due to the fact that the load hook is much too small in the picture when the zoom factor is very high so that the image sharpness or pixel count is not sufficient to identify the known contour pattern of the marking and / or the load hook and / or the load bottle.

Alternativ oder zusätzlich zu einer solchen Verstellung des Zoomfaktors der Kamera kann die Kamerasteuervorrichtung und/oder die Bildauswerteeinheit auch einen auszuwertenden Bereich innerhalb des von der Kamera bereitgestellten Kamerabi-Ids variieren, um die auszuwertende Datenmenge möglichst klein zu halten. Der interessierende Bildausschnitt kann insbesondere dann vergrößert werden, wenn die Markierung bzw. der Lasthaken in dem zuvor ausgewerteten Bildausschnitt verloren gegangen ist, beispielsweise weil sich der Lasthaken durch stärkere Pendelbewegungen oder stärkere Windlast aus dem genannten Bildausschnitt herausbewegt hat. Geht die Markierung oder der Lasthaken im von der Bildauswerteeinheit untersuchten Bildausschnitt verloren, kann der genannte Bildausschnitt einmalig oder auch iterativ in mehreren Stufen aufgebläht werden, gegebenenfalls bis er das gesamte Kamerabild umfasst. Vorteilhafterweise kann die Bildauswerteeinheit derart ausgebildet sein, dass bei einer Vergrößerung des interessierenden bzw. auszuwertenden Bildausschnitts nur der hinzugenommene Bildausschnittsbereich erneut ausgewertet wird, beispielsweise der rahmenförmige Bildausschnittsteil, der durch Vergrößerung des Bildausschnitts um den vorherigen Bildausschnitt herum hinzugekommen ist.As an alternative or in addition to such an adjustment of the zoom factor of the camera, the camera control device and / or the image evaluation unit can also vary an area to be evaluated within the camera image provided by the camera in order to minimize the amount of data to be evaluated. The image section of interest can be enlarged, in particular, if the marking or the load hook has been lost in the previously evaluated image detail, for example, because the load hook has moved out of the image section due to stronger oscillations or stronger wind load. If the marking or the load hook is lost in the image detail examined by the image evaluation unit, said image detail can be inflated once or iteratively in several stages, if appropriate, until it covers the entire camera image. Advantageously, the image evaluation unit can be designed in such a way that only the added image section area is re-evaluated when enlarging the image section of interest or to be evaluated, for example the frame-shaped image sectioning part which has been added by enlarging the image section around the previous image section.

Alternativ oder zusätzlich zu einer solchen einmaligen oder iterativen Vergrößerung des Bildausschnitts, der von der Bildauswerteeinheit ausgewertet wird, um die Position des Lasthakens oder der daran angebrachten Markierung zu identifizieren, kann dann, wenn der Lasthaken oder die damit verbundene Markierung im Kamerabild identifiziert werden kann, der Bildausschnitt im bereitgestellten Kamerabild verschoben und/oder verkleinert werden, vorzugsweise derart, dass der neue, wiederum zu untersuchende Bildausschnitt bezüglich der identifizierten Position des Lasthakens bzw. der damit verbundenen Markierung zentriert wird, d.h. die identifizierte Markierung in der Mitte des neuen Bildausschnitts liegt. Alternativ oder zusätzlich kann der Bildausschnitt einmalig oder iterativ verkleinert werden, insbesondere derart, dass das die Markierung bzw. den Lasthaken wiedergebende Pixelmuster bzw. das entsprechende Bildkonturmuster einen vorbestimmten Flächenanteil des jeweiligen Bildausschnitts ausmacht, beispielsweise 20% der Fläche des für die Auswertung verwendeten Bildausschnitts wiedergibt.As an alternative or in addition to such a one-time or iterative enlargement of the image section which is evaluated by the image evaluation unit in order to identify the position of the load hook or the marking attached thereto, if the load hook or the associated marking can be identified in the camera image, the image section in the provided camera image is shifted and / or reduced, preferably in such a way that the new image section to be examined is centered with respect to the identified position of the load hook or the associated marking, ie the identified marking lies in the middle of the new image section. Alternatively or additionally, the image section can be reduced once or iteratively, in particular in such a way that the pixel pattern reproducing the marking or the load hook is reduced or the corresponding image contour pattern represents a predetermined area proportion of the respective image detail, for example representing 20% of the area of the image detail used for the evaluation.

Die Position des Lasthakens kann vorteilhafterweise nicht nur relativ zur Laufkatze des Krans, sondern auch absolut und/oder relativ zur Lasthakenumgebung, bspw. der Baustellenumgebung, aus dem Kamerabild bestimmt werden. In Weiterbildung der Erfindung kann die Positionsbestimmungseinrichtung Umgebungs-Bestimmungsmittel zum Bestimmen der Lasthaken-Umgebung, insbesondere in Form charakteristischer Hindernis- und/oder Umgebungskonturen, aus dem aufgenommenen Kamerabild aufweisen, wobei die Positionsbestimmungsmittel zur Bestimmung der Lasthakenposition aus der bestimmten Bildposition des Lasthakens im Kamerabild derart ausgebildet sein können, dass die Lasthakenposition relativ zur Lasthaken-Umgebung bestimmt wird.The position of the load hook can advantageously be determined not only relative to the trolley of the crane, but also absolutely and / or relative to the load hook environment, for example the construction site environment, from the camera image. In a further development of the invention, the position determination device can have environmental determination means for determining the load hook environment, in particular in the form of characteristic obstacle and / or environmental contours, from the recorded camera image, wherein the position determination means for determining the load hook position from the determined image position of the load hook in the camera image may be formed such that the load hook position is determined relative to the load hook environment.

Die Lasthakenposition relativ zur Umgebung, die in der genannten Weise aus dem Kamerabild bestimmbar ist, kann vorteilhafterweise dazu bestimmt werden, die Kranbewegungen zu steuern, insbesondere um ein Lasthakenziel, bspw. eine Absetz- oder Aufnahmeposition anzufahren, oder Kranbewegungen zu stoppen oder einen Verfahrweg des Lasthakens automatisch zu verändern, um eine Kollision des Lasthakens und/oder einer damit aufgenommen Last mit einem im Kamerabild identifizierten Hindernis wie bspw. Gebäudekante zu vermeiden. Dabei kann der Kran Lasthakenziel-Steuermittel zum Steuern von Kranbewegungen in Abhängigkeit der bestimmten Lasthakenposition relativ zur Lasthaken-Umgebung und/oder Kollisionsvermeidungs-Steuermittel zum Stoppen oder Ändern von Kranbewegungen in Abhängigkeit der bestimmten Lasthakenposition relativ zur Lasthaken-Umgebung aufweisen.The load hook position relative to the environment, which can be determined from the camera image in the above-mentioned manner, can advantageously be determined to control the crane movements, in particular to approach a load hook target, for example a settling or pickup position, or to stop crane movements or a travel path of the car Automatically change load hook to avoid a collision of the load hook and / or a load taken with an identified in the camera image obstacle such as building edge. The crane may have load hook control means for controlling crane movements depending on the particular load hook position relative to the load hook environment and / or collision avoidance control means for stopping or changing crane movements depending on the particular load hook position relative to the load hook environment.

Die Erfindung wird nachfolgend anhand eines bevorzugten Ausführungsbeispiels und zugehöriger Zeichnungen näher erläutert. In den Zeichnungen zeigen:

Fig. 1:
eine schematische Darstellung eines Turmdrehkrans, an dessen Ausleger eine verfahrbare Laufkatze vorgesehen ist, von der das mit einem Lasthaken verbundene Hubseil abläuft und an der eine Kamera zur Positionsbestimmung des Lasthakens angeordnet ist,
Fig. 2:
eine vergrößerte, ausschnittsweise Darstellung der am Ausleger vorgesehenen Laufkatze und der mit der Kamera verbundenen Systemkomponenten für die Bildübertragung und -auswertung sowie Positionsbestimmung,
Fig. 3:
eine Darstellung einer an der Oberseite der mit dem Lasthaken verbundenen Lastflasche angebrachten Markierung, die in dem von der Kamera bereitgestellten Kamerabild identifizierbar ist,
Fig. 4:
eine Darstellung einer Markierung ähnlich Fig. 3, wobei die Markierung im Gegensatz zur Fig. 3 eine eindeutige Orientierung aufweist, um zusätzlich zur Position auch die Orientierung bzw. Drehstellung des Lasthakens bestimmen zu können, und
Fig. 5:
ein von der Kamera bereitgestelltes Kamerabild des Lasthakens, wobei der im Kamerabild dargestellte Hubseilverlauf zu sehen ist, aus dem ebenfalls die Lasthakenposition bestimmt werden kann und/oder die Identifizierung des Lasthakens oder der damit verbundenen Markierung im Kamerabild vereinfacht werden kann.
The invention will be explained in more detail below with reference to a preferred embodiment and associated drawings. In the drawings show:
Fig. 1:
a schematic representation of a tower crane, on the boom of a movable trolley is provided, from which runs the associated with a load hook hoist and on which a camera for determining the position of the load hook is arranged
Fig. 2:
an enlarged, fragmentary representation of the trolley provided on the boom and connected to the camera system components for image transmission and evaluation and position determination,
3:
a representation of a mounted on the top of the load hook connected to the load hook mark that is identifiable in the camera image provided by the camera,
4:
a representation of a mark similar Fig. 3 , where the mark in contrast to Fig. 3 has a unique orientation, in addition to the position to be able to determine the orientation or rotational position of the load hook, and
Fig. 5:
a camera image of the load hook provided by the camera, wherein the Hubseilverlauf shown in the camera image can be seen, from which also the load hook position can be determined and / or the identification of the load hook or the associated mark in the camera image can be simplified.

Wie Fig. 1 zeigt, kann der Kran als oben drehender Turmdrehkran 1 ausgebildet sein, dessen sich aufrecht erstreckender Turm 2 einen Ausleger 3 sowie einen Gegenausleger trägt. Der genannte Ausleger 3 kann relativ zum Turm 2 um die aufrechte Turmlängsachse 4 verdreht werden und eine zumindest näherungsweise horizontale Lage einnehmen. An dem genannten Ausleger 3 ist eine Laufkatze 5 verfahrbar aufgehängt, so dass die Laufkatze 5 im Wesentlichen über die gesamte Länge des Auslegers 3 verfahren werden kann, um die Ausladung des Lasthakens 7 variieren zu können. Der genannte Lasthaken 7 ist dabei an einem Hubseil 6 befestigt, das über die genannte Laufkatze 5 abläuft, um den Lasthaken 7 absenken und anheben zu können. In an sich bekannter Weise kann an dem Lasthaken 7 hierbei eine Lastflasche 13 vorgesehen sein, vgl. Fig. 2, über die das Hubseil 6 am Lasthaken 7 umgelenkt bzw. eingeschert wird.As Fig. 1 shows the crane can be designed as a tower tower crane rotating above 1, the tower 2 extending upright carries a boom 3 and a counter-jib. Said boom 3 can be rotated relative to the tower 2 about the upright longitudinal axis of the tower 4 and assume an at least approximately horizontal position. At the said boom 3, a trolley 5 is movably suspended, so that the trolley 5 can be moved substantially over the entire length of the boom 3 to the discharge of the load hook 7 vary. The said load hook 7 is fastened to a hoist rope 6, which runs over said trolley 5 in order to be able to lower and lift the load hook 7. In a manner known per se, a load bottle 13 can be provided on the load hook 7, cf. Fig. 2 over which the hoist rope 6 is deflected or sheared on the load hook 7.

Wie Fig. 2 zeigt, umfasst eine Lasthaken-Positionsbestimmungseinrichtung 8 eine an der Laufkatze 5 angebrachte Kamera 9, die zusammen mit der Laufkatze 5 verfahrbar ist und von der Laufkatze 5 im Wesentlichen senkrecht nach unten blickt. Wie Fig. 2 zeigt, kann die Blickachse der Kamera 9 mit der Z-Achse des lokalen bzw. relativen Katzkoordinatensystems zusammenfahren.As Fig. 2 1, a load hook position determining device 8 comprises a camera 9 mounted on the trolley 5, which is movable together with the trolley 5 and looks downwards from the trolley 5 substantially vertically. As Fig. 2 shows, the viewing axis of the camera 9 can move together with the Z-axis of the local or relative Katzkoordinatensystems.

Die von der Kamera 9 bereitgestellten Bilddaten können vorteilhafterweise durch eine schnurlos arbeitende Übertragungsvorrichtung 19 beispielsweise in Form einer Funkübertragungsvorrichtung an ein Bildverarbeitungs- und Auswertesystem 20 übertragen werden, die vorteilhafterweise im Bereich der Führerkabine oder der Kransteuerungseinheit angeordnet sein kann und eine entsprechende Empfangs-/ Sendeeinheit 21a umfassen kann, die mit der Empfangs-/Sendeeinheit 21b der Übertragungsvorrichtung 18 an der Laufkatze kommunizieren kann. Grundsätzlich könnte auch die Bildauswertung unmittelbar an der Kamera 9 bzw. der Laufkatze 5 erfolgen, bevorzugt ist es jedoch, dort nur die Bilddaten zu sammeln und diese dann zu übertragen und an anderer Stelle auszuwerten, um das System im Bereich der Laufkatze klein und leicht bauend ausbilden zu können.The image data provided by the camera 9 can advantageously be transmitted by a cordless transmission device 19, for example in the form of a radio transmission device, to an image processing and evaluation system 20, which can advantageously be arranged in the area of the driver's cab or crane control unit, and a corresponding receiver / transmitter unit 21a which can communicate with the reception / transmission unit 21b of the transmission device 18 on the trolley. Basically, the image evaluation could be done directly on the camera 9 and the trolley 5, but it is preferred to collect there only the image data and then transfer it and evaluate elsewhere to make the system in the trolley small and easy to be able to train.

Um die Kamera 9 mit Energie zu versorgen, kann an der Laufkatze 5 ein Energiespeicher 22 beispielsweise in Form eines Akkus vorgesehen, der mittels einer Ladestation 23 geladen werden kann, die am Ausleger 3 beispielsweise im Bereich einer Parkposition der Laufkatze 5 angeordnet sein kann, um den Energiespeicher 22 in Außer-Betriebs-Zeiten des Krans laden zu können.To supply the camera 9 with energy, an energy storage 22, for example in the form of a battery can be provided on the trolley 5, which can be loaded by means of a charging station 23, which can be arranged on the boom 3, for example in the parking position of the trolley 5 to to load the energy storage 22 in out-of-service times of the crane.

Das Bildverarbeitungs- und Auswertesystem 20 kann einen zentralen Rechner 24 beispielsweise in Form eines Industrie-PCs mit Bildverarbeitungssystem umfassen, der über einen Videoserver 25 mit der Empfangs-/Sendeeinrichtung 21 verbunden sein kann, um einerseits die Bildsignale der Kamera 9 zu empfangen bzw. abzurufen und andererseits Steuersignale an die Kamera 9 senden zu können.The image processing and evaluation system 20 may comprise a central computer 24, for example in the form of an industrial PC with an image processing system, which can be connected via a video server 25 with the receiving / transmitting device 21, on the one hand to receive or retrieve the image signals of the camera 9 and on the other hand to be able to send control signals to the camera 9.

Wie Fig. 2 zeigt, kann vorteilhafterweise im Bereich des Kranführerstands auch ein Videodisplay 26 vorgesehen sein, um zusätzlich zur Positionsbestimmung auch das Bild der Kamera 9 dem Kranführer anzeigen zu können.As Fig. 2 shows, may advantageously be provided in the area of the crane driver's station and a video display 26 in order to be able to display the image of the camera 9 to the crane operator in addition to determining the position.

Damit die im Rechner 24 realisierte Bildauswerteeinheit 11 den Lasthaken 7 in dem von der Kamera 9 bereitgestellten Kamerabild detektieren und identifizieren kann, werden vorteilhafterweise im Vorfeld Merkmale des Lasthakens 7 und/oder der damit verbundenen Lastflasche 13 definiert, beispielsweise geometrische Flächen, Formen, Konturen, Farben und dergleichen, wobei in vorteilhafter Weiterbildung der Erfindung eine Markierung 14 oberseitig am Lasthaken 7 bzw. der Lastflasche 13 angebracht werden kann, so dass die Markierung 14 für die Kamera 9 sichtbar ist.In order that the image evaluation unit 11 implemented in the computer 24 can detect and identify the load hook 7 in the camera image provided by the camera 9, features of the load hook 7 and / or the associated load bottle 13 are advantageously defined in advance, for example geometric surfaces, shapes, contours, Colors and the like, wherein in an advantageous embodiment of the invention, a marker 14 on the upper side of the load hook 7 and the load bottle 13 can be mounted so that the mark 14 for the camera 9 is visible.

Wie Fig. 3 zeigt, kann die Markierung 14 nach Art einer Zielscheibe aus zueinander kontrastreichen Ringen bestehen, die ineinander gesetzt sind. Alternativ zu einer solchen rotationssymmetrischen Markierung kann vorteilhafterweise jedoch auch eine eindeutig orientierte Markierung 14 verwendet werden, wie sie Fig. 4 zeigt, beispielsweise in Form eines "T", wobei auch hier vorteilhafterweise wieder eine kontrastreiche Darstellung verwendet ist. Es versteht sich jedoch, dass anstelle eines solchen "T" auch die Markierung 14 auch andere Merkmale für eine Orientierungsbestimmung aufweisen kann, beispielsweise können zwei oder mehr rotationssymmetrische Marker in geometrischem Bezug zueinander vorgesehen werden, und/oder es können andere rechteckige Markerformen mit Orientierungsbezug Verwendung finden und/oder es können geometrische Formen der Last an sich oder der Lastaufnahme wie beispielsweise der Spreader beim Containerkran als Markierung verwendet werden.As Fig. 3 shows, the mark 14 may be in the manner of a target of contrasting rings, which are set in one another. As an alternative to such a rotationally symmetric marking, however, it is also advantageously possible to use a uniquely oriented marking 14, as it does Fig. 4 shows, for example in the form of a "T", which also here again advantageously a high-contrast representation is used. However, it should be understood that instead of such a "T", the marker 14 may also have other orientation determination features, for example, two or more rotationally symmetric markers may be provided in geometric relation to each other, and / or other orientation oriented rectangular marker shapes may be used find and / or geometric shapes of the load itself or the load bearing such as the spreader container crane can be used as a marker.

Die Kamera 9 wird vorteilhafterweise über Steuersignale von dem Bildverarbeitungs- und Auswertesystem 20 her gesteuert, wobei die Steuersignale hier auch über die in Fig. 2 gezeigte Funkverbindung übertragen werden können. Dabei versucht die Bildauswerteeinheit 11, die Last bzw. den Lasthaken 7 anhand der vordefinierten Markierung 14 innerhalb des von der Kamera 9 bereitgestellten Bildes zu entdecken. Eine Analyse des bereitgestellten Kamerabildes kann dabei durch verschiedene Algorithmen wie beispielsweise einer Binärbilderstellung, einer Kantendetektion und/oder einer Merkmalsselektion erfolgen.The camera 9 is advantageously controlled via control signals from the image processing and evaluation system 20, the control signals here as well about the in Fig. 2 shown radio link can be transmitted. In this case, the image evaluation unit 11 attempts to discover the load or the load hook 7 on the basis of the predefined marking 14 within the image provided by the camera 9. An analysis of the provided camera image can be carried out by various algorithms such as a binary image, an edge detection and / or a feature selection.

Mit Hilfe der Aktualisierungsrate der von der Kamera 9 bereitgestellten Kamerabilder und der damit verbundenen Auswertungsrate der Bildauswerteeinheit 11 kann der Lasthaken 7 bzw. die daran befindliche Last nicht nur statisch im Bild ermittelt werden, sondern auch bei dynamischen Bewegungen der Last. Hierbei kann eine Nachverfolgung der Last, ein sog. Tracking erfolgen.With the aid of the update rate of the camera images provided by the camera 9 and the associated evaluation rate of the image evaluation unit 11, the load hook 7 or the load located thereon can be determined not only statically in the image, but also during dynamic movements of the load. Here, a tracking of the load, a so-called tracking done.

Um die Identifizierung der Markierung 14 im Kamerabild zu unterstützen, kann von der Kransteuerung vorzugsweise permanent die Senktiefe des Lasthakens 7 bereitgestellt werden, auf Basis derer zumindest näherungsweise abgeschätzt werden kann, in welcher Entfernung sich der Lasthaken 7 von der Kamera 9 befindet. Daraufhin stellt das Bildverarbeitungs- und Auswertesystem 20 den Kamera-Zoom der Kamera 9 entsprechend ein.In order to support the identification of the marking 14 in the camera image, the lowering depth of the load hook 7 can preferably be permanently provided by the crane control, on the basis of which at least approximately it can be estimated at which distance the load hook 7 from the camera 9 is located. Thereupon, the image processing and evaluation system 20 adjusts the camera zoom of the camera 9 accordingly.

Die Analyse des jeweils bereitgestellten Kamerabildes kann kontinuierlich erfolgen, vorzugsweise mittels Kantendetektion, Binärbildgenerierung und Merkmalsselektion bezüglich der bekannten Markierung 14. Dabei wird vorteilhafterweise innerhalb eines vorgebbaren Bildausschnitts in einer bestimmten Region des Kamerabilds die Verarbeitung durchgeführt. Da die Größe, je nach Betriebsfall sehr klein gehalten werden kann, wird der Rechenaufwand hierdurch beträchtlich miniert. Der Bildausschnitt kann hierbei minimal so klein gewählt werden, dass er im Wesentlichen der Markergröße entspricht. Alternativ oder zusätzlich kann der zu analysierende Bildausschnitt maximal im Wesentlichen der gesamten Größe des kompletten Kamerabilds entsprechen.The analysis of the respectively provided camera image can be carried out continuously, preferably by means of edge detection, binary image generation and feature selection with respect to the known mark 14. In this case, the processing is advantageously carried out within a predefinable image detail in a specific region of the camera image. Since the size, depending on the operating case can be kept very small, the computational effort is thereby considerably reduced. In this case, the image section can be selected to be minimally so small that it essentially corresponds to the marker size. Alternatively or additionally, the image detail to be analyzed can at most correspond substantially to the entire size of the complete camera image.

Die Position und/oder die Größe des genannten Bildausschnitts kann aufgrund der letzten bekannten Markierungspositionen und einer geschätzten Vorhersage bestimmt werden. Hierzu kann beispielsweise ein sog. Kalman-Filter oder auch andere Filtereinrichtungen verwendet werden, welche aufgrund der vergangenen Werte eine Vorhersage treffen können.The position and / or size of said image detail may be determined based on the last known marker positions and an estimated prediction. For this purpose, for example, a so-called Kalman filter or other filter devices can be used, which can make a prediction on the basis of the past values.

Soweit bei der Initialisierung der Bildverarbeitung noch keine vergangenen Markierungspositionen für eine Vorhersage zur Verfügung stehen, kann der zu untersuchende Bildausschnitt willkürlich in das Bild gelegt werden. Sollte sich in diesem Bildausschnitt keine Markierung finden, kann der Bildausschnitt stetig vergrößert werden, bis die Markierung 14 innerhalb des Bildausschnitts liegt und detektiert werden kann.As far as no past marker positions are available for a prediction during the initialization of the image processing, the image section to be examined can be arbitrarily placed in the image. Should no mark be found in this image section, the image section can be continuously increased until the marker 14 is within the image section and can be detected.

Sobald die Markierung 14 im Kamerabild entdeckt werden kann, ermittelt die Bildauswerteeinheit 11 die Bildposition des Lasthakens 7 bzw. der Markierung 14 in dem Kamerabild, woraus dann die Positionsbestimmungsmittel 12 die Lasthakenposition in dem relativen Koordinatensystem der Laufkatze 5 bestimmen. Das genannte relative Katzkoordinatensystem kann so gewählt werden, dass es seinen Ursprung in der optischen Achse der Kamera 9 und dem Nullpunkt der Senktiefe besitzt, welcher in der Laufkatze 5 liegen kann.As soon as the marking 14 can be detected in the camera image, the image evaluation unit 11 determines the image position of the load hook 7 or the mark 14 in the camera image, from which the position determining means 12 then determine the load hook position in the relative coordinate system of the trolley 5. Said relative Katzkoordinatensystem can be chosen so that it has its origin in the optical axis of the camera 9 and the zero point of the sinking depth, which may be in the trolley 5.

Anhand der bekannten Größe der Markierung 14, des aktuell eingestellten Zoom-Faktors der Kamera 9 sowie der von der Sensorik gemessenen Pixelanzahl der Markierung 14 im Kamerabild kann eine exakte Entfernungsbestimmung der Markierung 14 von der Laufkatze 5 vorgenommen werden. Hieraus kann der Z-Versatz bzw. die Z-Differenz des Lasthakens 7 zur Senktiefe ermittelt werden, welche Senktiefe beispielsweise durch Bestimmung der abgespulten Hubseillänge bestimmt werden kann. Durch die gesonderte Messung der tatsächlichen Senktiefe über die Pixelgröße der Markierung 14 im Kamerabild kann eine Redundanz zum herkömmlichen Senktiefesensor erreicht werden.On the basis of the known size of the mark 14, the currently set zoom factor of the camera 9 as well as the number of pixels of the mark 14 in the camera image measured by the sensor, an exact distance determination of the mark 14 can be made by the trolley 5. From this, the Z-offset or the Z-difference of the load hook 7 can be determined to the sinking depth, which sinking depth can be determined for example by determining the unwound Hubseillänge. By separately measuring the actual sink depth over the pixel size of the marker 14 in the camera image, a redundancy to the conventional Senektiefesensor can be achieved.

Da im realen Einsatz die Last aufgrund von Kranbewegungen, Windeinflüssen oder der Dynamik des Krans nie wirklich in Ruhe ist, pendelt die Last, wobei die Pendelfrequenz in Abhängigkeit der Seillänge des Hubseils 6 steht. Die Pendelamplitude ist abhängig von der Masse und weiteren Faktoren wie der Bewegungsdynamik oder dem Windeintrag.Since in real use the load is never really at rest due to crane movements, wind influences or the dynamics of the crane, the load oscillates, the pendulum frequency being dependent on the rope length of the hoist rope 6. The pendulum amplitude depends on the mass and other factors such as the dynamics of movement or the wind input.

Um bei der Bildauswertung die Entdeckungswahrscheinlichkeit für die Entdeckung der Markierung 14 im Kamerabild zu verbessern, kann auch hier eine Abschätzung erfolgen, wo sich der Lasthaken 7 vermutlich bei folgenden Messungen befinden wird, wobei auch hier der vorgenannte Kalman-Filter zum Einsatz kommen kann.In order to improve the detection probability for the detection of the mark 14 in the camera image in the image analysis, an estimate can also be made here where the load hook 7 is likely to be in subsequent measurements, whereby the aforementioned Kalman filter can also be used here.

Wandert die Markierung 14 aufgrund einer zu großen Pendelamplitude aus dem Kamerabild heraus, kann die Bildauswerteeinrichtung die Markierung 14 verlieren. Um die Markierung 14 möglichst schnell wieder zu detektieren, kann folgendermaßen vorgegangen werden:
Zunächst kann beispielsweise der zu analysierende Bildausschnitt des Kamerabilds auf einen Bildausschnitt aufgebläht bzw. vergrößert und/oder verschoben werden, indem der Wiedereintritt der Markierung 14 erwartet wird. Alternativ oder zusätzlich kann auch das gesamte Kamerabild als Bildausschnitt definiert werden, insbesondere dann, wenn die zur Verfügung stehende Rechenleistung ausreichend groß ist.
If the marking 14 moves out of the camera image due to a too large pendulum amplitude, the image evaluation device may lose the marking 14. To detect the marking 14 as quickly as possible, the following procedure can be adopted:
First of all, for example, the image detail of the camera image to be analyzed can be inflated or enlarged and / or shifted onto an image section by expecting the reentry of the marking 14. Alternatively or additionally, the entire camera image can also be defined as an image detail, in particular if the available computing power is sufficiently large.

Alternativ oder zusätzlich zu einer solchen Veränderung des Bildausschnitts kann nach einem Verlust der Markierung 14 auch die Kamera 9 eine oder mehrere Stufen zurückzoomen, um den Bildbereich zu vergrößern. Aufgrund des solchermaßen vergrößerten Bildbereichs ist die Wahrscheinlichkeit groß, dass sich der Marker wieder innerhalb des Bildes befindet. Um die Nachteile der hierdurch kleiner werdenden Markierungsgröße zu kompensieren, kann der Zoomfaktor der Kamera 9 iterativ in mehreren Schritten vergrößert und auch wieder verkleinert werden.Alternatively or in addition to such a change in the image section, after a loss of the mark 14, the camera 9 can also zoom back one or more stages in order to enlarge the image area. Due to the thus enlarged image area, there is a high probability that the marker will be within the image again. In order to compensate for the disadvantages of the resulting smaller marking size, the zoom factor of the camera 9 can be iteratively increased in several steps and also reduced again.

Alternativ oder zusätzlich zu den vorgenannten Bildverarbeitungsstrategien kann die Bildauswerteeinheit 11 Seilverlauf-Bestimmungsmittel 17 umfassen, mittels derer der Verlauf des Hubseils 6 im Kamerabild bestimmt wird, wie dies Fig. 5 zeigt. Anhand des detektierten Hubseilverlaufs im Kamerabild kann die Position des Lasthakens 7 bestimmt werden oder zumindest der Bereich eingeengt werden, in dem der Lasthaken 9 bzw. die Markierung 14 liegen muss, so dass die genannte Hubseil-Verlaufsbestimmung alternativ oder zusätzlich zur Erfassung der genannten Markierung bzw. des Lasthakens 7 direkt aus dem Kamerabild vorgesehen sein kann.As an alternative or in addition to the aforementioned image processing strategies, the image evaluation unit 11 may comprise cable course determination means 17 by means of which the course of the hoisting rope 6 is determined in the camera image, as this Fig. 5 shows. Based on the detected Hubseilverlaufs in the camera image, the position of the load hook 7 can be determined or at least the area are narrowed, in which the load hook 9 and the marker 14 must lie, so that said Hubseil-course determination as an alternative or in addition to the detection of said marker or of the load hook 7 can be provided directly from the camera image.

Die Bestimmung der Lasthakenposition bzw. Einengung des Bereichs, in dem sich der Lasthaken 7 befinden muss, mit Hilfe der Seilverlaufsbestimmung beruht auf der Annahme, dass das Hubseil 6 bei einer Einscherung an der Lastflasche 13 im Kamerabild einen konischen Verlauf besitzt, insbesondere konisch zur Last zuläuft, vgl. Fig. 5, so dass der Lasthaken 7 bzw. die Last und deren Position als Ende des von den Hubseilabschnitten definierten Konus bestimmt werden kann.The determination of the hook position or narrowing of the area in which the load hook must be 7, using the Rope course determination is based on the assumption that the hoist rope 6 in a reeving on the load bottle 13 in the camera image has a conical shape, in particular conically to the load runs, cf. Fig. 5 so that the load hook 7 or the load and their position can be determined as the end of the cone defined by the hoist rope sections.

Um die Entdeckungswahrscheinlichkeit bezüglich der interessierenden Flächen und Konturen im Kamerabild zu erhöhen, kann das gemessene Bild in Weiterbildung der Erfindung auch einer spektralen Analyse unterzogen werden. Hierbei können beispielsweise die Reflexionseigenschaften der Merkmale der Last, des Lasthakens 7 oder der Markierung 14 in bestimmten spektralen Bereichen den Merkmalsraum erweitern und für die Identifizierung herangezogen werden.In order to increase the probability of detection with respect to the areas and contours of interest in the camera image, the measured image can also be subjected to a spectral analysis in a development of the invention. In this case, for example, the reflection properties of the features of the load, the load hook 7 or the marking 14 in certain spectral regions can expand the feature space and be used for the identification.

Eine solche Vorgehensweise kann Teil einer Vorfilterung des Bildes sein, die die dann mit Hilfe der genannten Algorithmen zu untersuchenden Bilddaten mengenmäßig deutlich reduziert. Damit verringert sich der Aufwand der Algorithmen zur Detektion der Lasthakenposition deutlich. Auch widrige Witterungseinflüsse wie Schnee, Eis, Regen, Nebel, Sonnenlicht, Schattenwurf usw. können zumindest teilweise kompensiert werden.Such an approach can be part of a pre-filtering of the image, which significantly reduces the quantity of image data to be examined with the aid of the algorithms mentioned. This significantly reduces the effort of the algorithms for detecting the hook position. Even adverse weather conditions such as snow, ice, rain, fog, sunlight, shadows, etc. can be at least partially compensated.

Eine solche spektrale Analyse kann vorteilhafterweise auch durch die Verwendung von Speziallacken für die Markierung 14 optimiert werden, beispielsweise durch die Verwendung von Lacken oder anderen Oberflächenbeschichtungen, die im nahen Infrarotbereich nur geringe Reflexionseigenschaften besitzen.Such a spectral analysis can be advantageously optimized by the use of special lacquers for the marking 14, for example by the Use of paints or other surface coatings that have low reflective properties in the near infrared range.

Für die genannte Vorfilterung kann z.B. ein an sich bekannter Landsat-Algorithmus verwendet werden.For said prefiltering, e.g. a known Landsat algorithm can be used.

Claims (14)

  1. Crane, in particular tower slewing crane, having a jib (3) rotatable about an upright axis (4), at which jib a trolley (5) is movably arranged, from which trolley a hoist rope (6) connected to a load hook (7) runs off, as well as a load hook position determining device (8) for determining the load hook position, wherein the load hook position determining device (8) comprises a camera (9) arranged at the trolley (5) and oriented downward towards the load hook (7) in a predetermined viewing direction (10), an image evaluator (11) for determining the image position of the load hook (7) in a camera image provided by the camera (9), as well as position determining means (12) for determining the load hook position based on the determined image position of the load hook (7) in the camera image while taking into account a position of the trolley, characterized in that the image evaluator (11) has contour recognition means for recognizing, in the camera image, an outer contour corresponding to the load hook and/or its attachment, and the load hook position is determined based on the outer contour of the load hook and/or the attachment mounted thereto
  2. Crane according to the preceding claim, wherein the image evaluator (11) includes rope run determining means (17) for determining the hoist rope run in the camera image, and the image evaluator (11) is adapted such that the position of the load hook (7) in the camera image is determined in dependency of the determined hoist rope run, wherein the load hook position is determined as being the point of intersection of two hoist rope lines identified in the camera image.
  3. Crane according to any one of the preceding claims, wherein the load hook position determining device (8) comprises distance determining means for determining the distance of the load hook (7) from the trolley (5), wherein said distance determining means has a pixel counter for determining the number of pixels of the load hooks and/or marker image area identified in the camera image.
  4. Crane according to any one of the preceding claims, wherein a lowering depth determining means is provided for determining the lowering depth of the load hook (7) based on an unwound length of the hoist rope (6).
  5. Crane according to one of claims 3 or 4, wherein a horizontal displacement of the load hook (7) in relation to the trolley (5) is determinable by the position determining means (12) based on the determined image position of the load hook (7) in the camera image taking into account the respective set zoom ratio of the camera and the determined lowering depth/distance of the load hook (7) from the trolley (5).
  6. Crane according to any one of the preceding claims, wherein a camera control device for controlling camera settings is provided and adapted such that the zoom ratio of the camera (9) is set variably in dependency of a load hook lowering depth.
  7. Crane according to the preceding claim, wherein the camera control device (15) is adapted such that the zoom ratio of the camera (9) is increased and/or decreased in dependence on recognition of the load hook (7) and/or the marker (14) provided thereon in the camera image provided by the camera (9), in particular such that when the load hook (7) and/or the marker (14) associated therewith is not recognized the zoom ratio is decreased once or iteratively.
  8. Crane according to any one of the preceding claims, wherein the image evaluator (11) includes image section control means (16) for enlarging an image section of the camera image to be evaluated by the image evaluator (11), which enlarging is effected in dependence on recognition of the load hook (7) and/or the marker (14) associated therewith, wherein said image section control means (16) are adapted such that in the case of non-recognition of the load hook (7) and/or the marker (14) associated therewith, starting with a small image section, such image section is enlarged once or iteratively.
  9. Crane according to any one of the preceding claims, wherein the image evaluator (11) includes pixel evaluation means for recognizing a pixel pattern corresponding to the load hook and/or an attachment connected thereto such as a pulley, as well as color recognition means for recognizing, in the camera image, a color and/or color combination corresponding to the color and/or color combination of the load hook and/or the attachment thereof.
  10. Crane according to any one of the preceding claims, wherein a marker (14) is attached to the load hook (7) and/or a pulley (13) connected thereto which marker is visibly oriented towards the trolley (5), and the image evaluator (11) is adapted such that in the camera image a contour and/or pixel pattern corresponding to the marker is identified.
  11. Crane according to the preceding claim, wherein the marker (14) and/or the load hook and/or the pulley includes a geometrical base such as circle, polygon, line and/or a base pattern combined of several geometrical bases.
  12. Crane according to any one of the two preceding claims, wherein the marker (14) and/or the load hook and/or the pulley are adapted in an unambiguously oriented manner and the image evaluator (11) has orientation determining means for determining the orientation of the load hook (7), in particular determining a rotation angle of the load hook (7) in relation to an upright axis.
  13. Crane according to any one of the preceding claims, wherein trolley position determining means (18) are provided which trolley position determining means include travel position determining means for determining the trolley position relative to the jib and slewing position determining means for determining the slewing position of the jib (3) relative to the rotational axis (4), wherein the load hook position determining means (12) are adapted such that the load hook position is determined based on the determined trolley position relative to the jib (3), the slewing position of the jib (3) and the image position of the load hook (7) in the camera image of camera (9).
  14. Crane according to any one of the preceding claims, wherein the position determining device (8) includes neighborhood determining means for determining the load hook neighborhood, in particular in terms of characteristic obstacle and/or neighborhood contours, based on the taken camera image, wherein the position determining means (12) for determining the load hook position based on the determined image position of the load hook (7) in the camera image are adapted such that the load hook position is determined relative to the load hook neighborhood, wherein load hook target control means are provided for controlling crane movements in dependency of the determined load hook position relative to the load hook neighborhood and/or collision prevention control means for stopping or altering crane movements in dependency of the determined load hook position relative to the load hook neighborhood.
EP13810895.6A 2012-12-17 2013-12-16 Rotating tower crane Active EP2931649B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP18163759.6A EP3354616B1 (en) 2012-12-17 2013-12-16 Rotating tower crane

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE202012012116.2U DE202012012116U1 (en) 2012-12-17 2012-12-17 Tower Crane
PCT/EP2013/003798 WO2014095028A1 (en) 2012-12-17 2013-12-16 Rotating tower crane

Related Child Applications (2)

Application Number Title Priority Date Filing Date
EP18163759.6A Division EP3354616B1 (en) 2012-12-17 2013-12-16 Rotating tower crane
EP18163759.6A Division-Into EP3354616B1 (en) 2012-12-17 2013-12-16 Rotating tower crane

Publications (2)

Publication Number Publication Date
EP2931649A1 EP2931649A1 (en) 2015-10-21
EP2931649B1 true EP2931649B1 (en) 2018-05-16

Family

ID=49816899

Family Applications (2)

Application Number Title Priority Date Filing Date
EP18163759.6A Active EP3354616B1 (en) 2012-12-17 2013-12-16 Rotating tower crane
EP13810895.6A Active EP2931649B1 (en) 2012-12-17 2013-12-16 Rotating tower crane

Family Applications Before (1)

Application Number Title Priority Date Filing Date
EP18163759.6A Active EP3354616B1 (en) 2012-12-17 2013-12-16 Rotating tower crane

Country Status (8)

Country Link
US (1) US9738493B2 (en)
EP (2) EP3354616B1 (en)
CN (1) CN104854017B (en)
DE (1) DE202012012116U1 (en)
ES (2) ES2683294T3 (en)
RU (1) RU2623287C2 (en)
TR (1) TR201908731T4 (en)
WO (1) WO2014095028A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE202019102393U1 (en) 2019-03-08 2020-06-09 Liebherr-Werk Biberach Gmbh Crane and device for its control
DE102021130785A1 (en) 2021-11-24 2023-05-25 Liebherr-Werk Biberach Gmbh crane
WO2023151967A1 (en) 2022-02-11 2023-08-17 Liebherr-Werk Biberach Gmbh Crane

Families Citing this family (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10822208B2 (en) * 2014-12-23 2020-11-03 Manitowoc Crane Companies, Llc Crane 3D workspace spatial techniques for crane operation in proximity of obstacles
CN104555737B (en) * 2014-12-29 2017-08-29 武汉港迪智能技术有限公司 The telecommunication of overhead and gantry cranes and position detecting device
FI127606B (en) 2015-04-01 2018-10-15 Konecranes Oyj Method, load handling device, computer program and computer program product for positioning gripping means
FI20155599A (en) * 2015-08-21 2017-02-22 Konecranes Global Oy Control of a lifting device
US10544012B2 (en) 2016-01-29 2020-01-28 Manitowoc Crane Companies, Llc Visual outrigger monitoring system
DE102016001684A1 (en) * 2016-02-12 2017-08-17 Liebherr-Werk Biberach Gmbh Method for monitoring at least one crane
DE102016004250A1 (en) 2016-04-08 2017-10-12 Liebherr-Components Biberach Gmbh Method and device for controlling a crane, an excavator, a caterpillar or similar construction machine
DE102016004350A1 (en) * 2016-04-11 2017-10-12 Liebherr-Components Biberach Gmbh Crane and method for controlling such a crane
US11130658B2 (en) * 2016-11-22 2021-09-28 Manitowoc Crane Companies, Llc Optical detection and analysis of a counterweight assembly on a crane
GB2562122B (en) * 2017-05-05 2022-10-19 Bamford Excavators Ltd Training machine
GB2562121B (en) * 2017-05-05 2022-10-12 Bamford Excavators Ltd Working machine
KR20200006555A (en) * 2017-05-05 2020-01-20 제이씨 뱀포드 엑스카베이터즈 리미티드 Training machine
DE102017116367A1 (en) 2017-07-20 2019-01-24 Liebherr-Components Deggendorf Gmbh Device for controlling an injector
JP2019104582A (en) * 2017-12-12 2019-06-27 株式会社北川鉄工所 Suspended load turning angle detection method
DE102017130792A1 (en) * 2017-12-20 2019-06-27 Liebherr-Werk Ehingen Gmbh Measuring device for load measurement in a hoist
US20210206605A1 (en) * 2018-05-30 2021-07-08 Syracuse Ltd. System and method for transporting a swaying hoisted load
CN110874544B (en) * 2018-08-29 2023-11-21 宝钢工程技术集团有限公司 Metallurgical driving safety monitoring and identifying method
CN108892042A (en) * 2018-09-13 2018-11-27 郑州大学 A kind of steel ladle trunnion lifting contraposition identification device and method
US20200140239A1 (en) * 2018-11-07 2020-05-07 Manitowoc Crane Companies, Llc System for determining crane status using optical and/or electromagnetic sensors
CN109095356B (en) * 2018-11-07 2024-03-01 江苏徐工国重实验室科技有限公司 Engineering machinery and operation space dynamic anti-collision method, device and system thereof
JP7192527B2 (en) * 2019-01-23 2022-12-20 株式会社タダノ crane
AT16885U1 (en) * 2019-03-28 2020-11-15 Palfinger Ag Crane with crane control
US11618655B2 (en) 2019-03-28 2023-04-04 International Business Machines Corporation Camera-assisted crane safety
CN110525420B (en) * 2019-09-02 2023-04-11 厦门迈凯科机电设备有限公司 STS cart gust-preventing control system
CN111115458A (en) * 2020-04-01 2020-05-08 湖南三一塔式起重机械有限公司 Load position calculation device and crane
CN112194011A (en) * 2020-08-31 2021-01-08 南京理工大学 Tower crane automatic loading method based on binocular vision
DE102020214021A1 (en) 2020-11-09 2022-05-12 Tadano Faun Gmbh Method for operating a crane system and crane system
CN112562018B (en) * 2020-12-09 2023-08-11 杭州鸿泉物联网技术股份有限公司 Lifting point following positioning method and system
CN112678696B (en) * 2020-12-18 2022-09-13 重庆市合川区昌友机械制造有限责任公司 Hoisting device for fan gear machining machine tool
WO2022221311A1 (en) 2021-04-12 2022-10-20 Structural Services, Inc. Systems and methods for assisting a crane operator
CN113247788B (en) * 2021-06-01 2021-09-24 新乡职业技术学院 Crane based on projection light self-alignment control
CN113044736B (en) * 2021-06-01 2021-08-13 新乡职业技术学院 Crane with sling stability control
CN113673344B (en) * 2021-07-19 2023-06-06 杭州大杰智能传动科技有限公司 Intelligent tower crane material mounting position identification method and device
DE102021121749A1 (en) 2021-08-23 2023-02-23 Abus Kransysteme Gmbh Method for detecting the outer contour of a load on a crane
CN113911917B (en) * 2021-09-13 2023-06-02 杭州大杰智能传动科技有限公司 Auxiliary remote control method for intelligent tower crane main control room
CN113896109B (en) * 2021-09-13 2023-06-02 杭州大杰智能传动科技有限公司 Camera shooting monitoring method and system for intelligent tower crane background remote control
JP2023049565A (en) * 2021-09-29 2023-04-10 住友重機械搬送システム株式会社 Position detection system, target, and position detection method
CN116152243B (en) * 2023-04-19 2023-07-25 深圳市平方科技股份有限公司 Method for detecting container loading and unloading operation state based on image analysis

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
SE502609C2 (en) 1990-03-28 1995-11-20 Asea Brown Boveri Moving of goods with container cranes
JPH08324963A (en) 1995-05-29 1996-12-10 Nippon Steel Corp Method and device of automatic operation for crane
CN2273306Y (en) * 1995-08-04 1998-01-28 上海海通港口工索具公司 Safety operation monitor for lifter
JPH09142773A (en) 1995-11-20 1997-06-03 Kajima Corp Automatic tracking system for crane hook
DE19725315C2 (en) 1997-06-09 2001-03-22 Mannesmann Ag Crane, especially steel mill crane
US6351720B1 (en) * 1997-10-24 2002-02-26 Mitsubishi Heavy Industries, Ltd. Trolley camera position detecting apparatus
JPH11349279A (en) * 1998-06-10 1999-12-21 Shinko Electric Co Ltd Suspending part position detecting device
DE19836103A1 (en) * 1998-08-10 2000-02-24 Siemens Ag Device and method for the two-dimensional determination of load oscillations and / or rotations on a crane
KR100390525B1 (en) 2001-02-16 2003-07-10 김종선 WIRELESS CCTV SYSTEM for tower crane
US7181312B2 (en) * 2002-04-09 2007-02-20 Paceco Corp. Method and apparatus for quay container crane-based automated optical container code recognition with positional identification
DE10245889B4 (en) * 2002-09-30 2008-07-31 Siemens Ag Method and / or device for determining a pendulum of a load of a hoist
DE10245970B4 (en) * 2002-09-30 2008-08-21 Siemens Ag Method and device for detecting a load of a hoist
ES1056945Y (en) 2004-02-26 2004-09-16 Promociones Y Construcciones O CRANE FOR HANDLING LOADS.
US7656459B2 (en) * 2006-04-20 2010-02-02 Pacific Systems Solution Llc Crane hook and trolley camera system
CN101428740A (en) * 2008-12-18 2009-05-13 何淑娟 Deflection drag-proof method for carriage hoisting operation
CN101428741B (en) 2008-12-18 2011-04-20 何淑娟 Method for estimating lift hook position
CN201605104U (en) 2009-11-06 2010-10-13 苏星 Intelligent tower crane operating device
US8618949B2 (en) * 2010-02-01 2013-12-31 Trimble Navigation Limited Lifting device efficient load delivery, load monitoring, collision avoidance, and load hazard avoidance
US8909467B2 (en) * 2010-06-07 2014-12-09 Industry-Academic Cooperation Foundation, Yonsei University Tower crane navigation system
CN101955130B (en) 2010-09-08 2012-03-07 西安理工大学 Tower crane video monitoring system with automatic tracking and zooming functions and monitoring method
CN102795547B (en) * 2012-08-31 2014-07-16 中国人民解放军国防科学技术大学 Real-time photographic measuring method of position and swing angle of lifting hook of crane

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE202019102393U1 (en) 2019-03-08 2020-06-09 Liebherr-Werk Biberach Gmbh Crane and device for its control
WO2020182592A1 (en) 2019-03-08 2020-09-17 Liebherr-Werk Biberach Gmbh Crane and device for controlling same
DE102021130785A1 (en) 2021-11-24 2023-05-25 Liebherr-Werk Biberach Gmbh crane
WO2023094516A1 (en) 2021-11-24 2023-06-01 Liebherr-Werk Biberach Gmbh Crane
WO2023151967A1 (en) 2022-02-11 2023-08-17 Liebherr-Werk Biberach Gmbh Crane
DE102022103283A1 (en) 2022-02-11 2023-08-17 Liebherr-Werk Biberach Gmbh crane

Also Published As

Publication number Publication date
RU2015129017A (en) 2017-01-23
TR201908731T4 (en) 2019-07-22
CN104854017B (en) 2018-01-23
RU2623287C2 (en) 2017-06-23
WO2014095028A1 (en) 2014-06-26
EP2931649A1 (en) 2015-10-21
ES2732760T3 (en) 2019-11-25
CN104854017A (en) 2015-08-19
US20150329333A1 (en) 2015-11-19
EP3354616B1 (en) 2019-04-03
DE202012012116U1 (en) 2014-03-19
US9738493B2 (en) 2017-08-22
EP3354616A1 (en) 2018-08-01
ES2683294T3 (en) 2018-09-26

Similar Documents

Publication Publication Date Title
EP2931649B1 (en) Rotating tower crane
DE10251910B4 (en) container crane
EP3000762B1 (en) Method for automatic, optical determination of a target position for a container lifting device
DE10164346B4 (en) Road surveillance method for a vehicle and system therefor
DE10245889B4 (en) Method and / or device for determining a pendulum of a load of a hoist
DE102016121864A1 (en) Distinguish lane markers to be followed by a vehicle
DE102016004250A1 (en) Method and device for controlling a crane, an excavator, a caterpillar or similar construction machine
EP2984022A1 (en) Remote-controlled crane
DE202019102393U1 (en) Crane and device for its control
EP3750842B1 (en) Loading a load with a crane system
EP3411321B1 (en) Procedure to monitor at least a crane
EP2193334A1 (en) Sensor unit and method for calibration thereof
DE4423797A1 (en) Precision container positioning and stacking device
DE4429016A1 (en) Navigating driver-less vehicles esp. of transport systems used in e.g. hangars or large hall
DE102013012019A1 (en) Crane, in particular mobile crane
DE102012003650B4 (en) Method and device for supervised vertical lifting of a standard container
DE19916999A1 (en) Positioning system for container stacking trucks uses laser scanner to avoid adjusting crane
WO2023151967A1 (en) Crane
EP0907604A1 (en) Method and arrangement for preventing load swings with a suspended-load-moving apparatus performing rotational movements
DE10202399A1 (en) Positioning of transport vehicles in depot handling containers uses laser scanning system
WO2020043461A1 (en) Method and arrangement for generating a representation of surroundings of a vehicle, and vehicle having such an arrangement
EP3929139B1 (en) Transport system for transporting a load device, method for controlling a transport system and aircraft with a transport system
EP3746739A1 (en) Device and method for identifying equipment in metallurgical industrial plants
EP3948470B1 (en) Optical position marker, robot with said marker and system for controlling said robot
DE102021130785A1 (en) crane

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20150424

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAX Request for extension of the european patent (deleted)
REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 502013010171

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: B66C0013460000

Ipc: B66C0013160000

RIC1 Information provided on ipc code assigned before grant

Ipc: B66C 13/18 20060101ALI20171026BHEP

Ipc: B66C 13/16 20060101AFI20171026BHEP

Ipc: B66C 13/46 20060101ALI20171026BHEP

Ipc: B66C 23/02 20060101ALI20171026BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20171206

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502013010171

Country of ref document: DE

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 999352

Country of ref document: AT

Kind code of ref document: T

Effective date: 20180615

REG Reference to a national code

Ref country code: NL

Ref legal event code: FP

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2683294

Country of ref document: ES

Kind code of ref document: T3

Effective date: 20180926

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180516

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180816

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180816

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180516

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180516

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180817

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180516

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180516

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180516

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180516

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180516

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180516

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180516

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180516

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180516

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502013010171

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180516

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20190219

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180516

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20181216

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180516

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20181216

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20181231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20181216

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20181231

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180516

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20181216

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180516

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180516

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20131216

Ref country code: MK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180516

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180516

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180916

REG Reference to a national code

Ref country code: CH

Ref legal event code: PFA

Owner name: LIEBHERR-COMPONENTS BIBERACH GMBH, DE

Free format text: FORMER OWNER: LIEBHERR-COMPONENTS BIBERACH GMBH, DE

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: TR

Payment date: 20211214

Year of fee payment: 9

REG Reference to a national code

Ref country code: NL

Ref legal event code: PD

Owner name: LIEBHERR-WERK BIBERACH GMBH; DE

Free format text: DETAILS ASSIGNMENT: CHANGE OF OWNER(S), ASSIGNMENT; FORMER OWNER NAME: LIEBHERR-COMPONENTS BIBERACH GMBH

Effective date: 20220718

REG Reference to a national code

Ref country code: ES

Ref legal event code: PC2A

Owner name: LIEBHERR-WERK BIBERACH GMBH

Effective date: 20220921

REG Reference to a national code

Ref country code: DE

Ref legal event code: R081

Ref document number: 502013010171

Country of ref document: DE

Owner name: LIEBHERR-WERK BIBERACH GMBH, DE

Free format text: FORMER OWNER: LIEBHERR-COMPONENTS BIBERACH GMBH, 88400 BIBERACH, DE

REG Reference to a national code

Ref country code: AT

Ref legal event code: PC

Ref document number: 999352

Country of ref document: AT

Kind code of ref document: T

Owner name: LIEBHERR-WERK BIBERACH GMBH, DE

Effective date: 20221018

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: ES

Payment date: 20230102

Year of fee payment: 10

Ref country code: CH

Payment date: 20221229

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20221229

Year of fee payment: 10

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230630

P02 Opt-out of the competence of the unified patent court (upc) changed

Effective date: 20230906

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20231220

Year of fee payment: 11

Ref country code: IT

Payment date: 20231227

Year of fee payment: 11

Ref country code: FR

Payment date: 20231220

Year of fee payment: 11

Ref country code: AT

Payment date: 20231219

Year of fee payment: 11