FI129322B - Determining position of a container handling equipment - Google Patents

Determining position of a container handling equipment Download PDF

Info

Publication number
FI129322B
FI129322B FI20205907A FI20205907A FI129322B FI 129322 B FI129322 B FI 129322B FI 20205907 A FI20205907 A FI 20205907A FI 20205907 A FI20205907 A FI 20205907A FI 129322 B FI129322 B FI 129322B
Authority
FI
Finland
Prior art keywords
reflector
container handling
location
reflector unit
handling equipment
Prior art date
Application number
FI20205907A
Other languages
Finnish (fi)
Swedish (sv)
Other versions
FI20205907A1 (en
Inventor
Jussi Lehtiö
Ville Mannari
Original Assignee
Konecranes Global Oy
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Konecranes Global Oy filed Critical Konecranes Global Oy
Priority to FI20205907A priority Critical patent/FI129322B/en
Priority to CN202180063562.9A priority patent/CN116391214A/en
Priority to PCT/FI2021/050611 priority patent/WO2022058654A1/en
Priority to US18/245,086 priority patent/US20230356985A1/en
Priority to EP21868794.5A priority patent/EP4214468A4/en
Application granted granted Critical
Publication of FI129322B publication Critical patent/FI129322B/en
Publication of FI20205907A1 publication Critical patent/FI20205907A1/en

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/04Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by terrestrial means
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88Lidar systems specially adapted for specific applications
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B66HOISTING; LIFTING; HAULING
    • B66CCRANES; LOAD-ENGAGING ELEMENTS OR DEVICES FOR CRANES, CAPSTANS, WINCHES, OR TACKLES
    • B66C13/00Other constructional features or details
    • B66C13/18Control systems or devices
    • B66C13/46Position indicators for suspended loads or for crane elements
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B66HOISTING; LIFTING; HAULING
    • B66CCRANES; LOAD-ENGAGING ELEMENTS OR DEVICES FOR CRANES, CAPSTANS, WINCHES, OR TACKLES
    • B66C13/00Other constructional features or details
    • B66C13/18Control systems or devices
    • B66C13/48Automatic control of crane drives for producing a single or repeated working cycle; Programme control
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B66HOISTING; LIFTING; HAULING
    • B66CCRANES; LOAD-ENGAGING ELEMENTS OR DEVICES FOR CRANES, CAPSTANS, WINCHES, OR TACKLES
    • B66C19/00Cranes comprising trolleys or crabs running on fixed or movable bridges or gantries
    • B66C19/007Cranes comprising trolleys or crabs running on fixed or movable bridges or gantries for containers
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S1/00Beacons or beacon systems transmitting signals having a characteristic or characteristics capable of being detected by non-directional receivers and defining directions, positions, or position lines fixed relatively to the beacon transmitters; Receivers co-operating therewith
    • G01S1/02Beacons or beacon systems transmitting signals having a characteristic or characteristics capable of being detected by non-directional receivers and defining directions, positions, or position lines fixed relatively to the beacon transmitters; Receivers co-operating therewith using radio waves
    • G01S1/08Systems for determining direction or position line
    • G01S1/42Conical-scan beacons transmitting signals which indicate at a mobile receiver any displacement of the receiver from the conical-scan axis, e.g. for "beam-riding" missile control
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06Systems determining position data of a target
    • G01S17/42Simultaneous measurement of distance and other co-ordinates
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B5/00Visible signalling systems, e.g. personal calling systems, remote indication of seats occupied

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Automation & Control Theory (AREA)
  • Mechanical Engineering (AREA)
  • Electromagnetism (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Traffic Control Systems (AREA)
  • Control And Safety Of Cranes (AREA)
  • Aerials With Secondary Devices (AREA)
  • Container, Conveyance, Adherence, Positioning, Of Wafer (AREA)

Abstract

A method comprising detecting a reflector unit (350, 520, 530) that comprises a plurality of reflector elements (351, 352) arranged in a pre-determined manner with respect to each other, identifying the reflector unit (350, 520, 530) based, at least partly, on its characteristics, and determining a location of a container handling equipment based, at least partly, on the identified reflector unit (350, 520, 530).

Description

DETERMINING POSITION OF A CONTAINER HANDLING EQUIPMENT
TECHNICAL FIELD The present application relates to determining position of an equipment that may be used for moving containers.
BACKGROUND Container handling equipment, such as straddle carriers, rail-mounted gantry cranes, automated guided vehicles, lift trucks, reach stackers, terminal trucks and/or rubber- tyred gantry cranes, are utilized for moving containers in areas such as port terminals and intermodal yards. Further, some container handling equipment, for example straddle carriers, may also be utilized in other areas such as manufacturing and construction, for handling oversized loads such as steel and pre-cast concrete. To improve safety and efficiency, automatization of container handling equipment may be beneficial and thus a container handling equipment, if it is an automated container handling equipment, may have at least partial autonomy in how it moves within the area in which it is used for lifting and/or transporting goods. For the automated container handling equipment to function properly, the location of the straddle carrier is to be known.
_ BRIEF DESCRIPTION
S = The scope of protection sought for various embodiments of the invention is set out by 2 the independent claims. The exemplary embodiments and features, if any, described in E 25 this specification that do not fall under the scope of the independent claims are to be N interpreted as examples useful for understanding various embodiments of the ? invention.
O
N According to an aspect there is provided a method comprising detecting a reflector unit that comprises a plurality of reflector elements arranged in a pre-determined manner with respect to each other, identifying the reflector unit based, at least partly, on its characteristics, and determining a location of a container handling equipment based, at least partly, on the identified reflector unit.
According to an aspect there is provided an apparatus comprising means for detecting a reflector unit that comprises a plurality of reflector elements arranged in a pre- determined manner with respect to each other, identifying the reflector unit based, at least partly, on its characteristics, and determining a location of a container handling equipment based, at least partly, on the identified reflector unit. According to another aspect there is provided an apparatus comprising at least one processor, and at least one memory including a computer program code, wherein the at least one memory and the computer program code are configured, with the at least one processor, to cause the apparatus to detect a reflector unit that comprises a plurality of reflector elements arranged in a pre-determined manner with respect to each other, identify the reflector unit based, at least partly, on its characteristics, and determine a location of a container handling equipment based, at least partly, on the identified reflector unit.
According to another aspect there is provided a computer program product which when executed by a computing apparatus causes the computing apparatus to perform - detect a reflector unit that comprises a plurality of reflector elements arranged in a O pre-determined manner with respect to each other, identify the reflector unit based, at = 25 least partly, on its characteristics, and determine a location of a container handling 2 eguipment based, at least partly, on the identified reflector unit. x a According to an aspect there is provided a computer program product comprising 3 computer program code stored in a non-transitory memory medium, the computer O 30 program code being configured to cause an apparatus, when executing the program code by a processor circuitry, to perform at least the following: detect a reflector unit that comprises a plurality of reflector elements arranged in a pre-determined manner with respect to each other, identify the reflector unit based, at least partly, on its characteristics, and determine a location of a container handling equipment based, at least partly, on the identified reflector unit.
BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 illustrates an exemplary embodiment of an area in which a container handling equipment is utilized.
Figure 2 illustrates an exemplary embodiment of a container handling equipment that comprises a multi-layer lidar. Figure 3 illustrates exemplary embodiments of a reflector element and a reflector unit comprising a plurality of reflector elements. Figure 4 illustrates a flow chart according to an exemplary embodiment. Figure 5 illustrates an exemplary embodiment of a container handling area in which reflector units are utilized. Figure 6 illustrates an exemplary embodiment of a computing apparatus.
N O
N - DETAILED DESCRIPTION 0 © 25 E The following embodiments are exemplifying. Although the specification may refer to 5 “an”, “one”, or “some” embodiment(s) in several locations of the text, this does not
O LQ necessarily mean that each reference is made to the same embodiment(s), or that a
N I particular feature only applies to a single embodiment. Single features of different embodiments may also be combined to provide other embodiments.
When large objects such as containers are to be moved around and stacked on top of one another, safety of personnel is of major importance. Having container handling equipment that may perform the moving and stacking in an automated manner, or with minimal guidance performed by a person, may therefore be desirable. Examples of such container handling equipment comprise rail-mounted gantry cranes, rubber- tyred gantry cranes, straddle carriers, automated guided vehicles, lift trucks, reach stackers and terminal trucks.
Container handling equipment may be operated by a driver or it may be automated, or it may be operated using a combination of both. For example, a container handling equipment such as a straddle carrier may be operated without a driver sitting in the straddle carrier and such a straddle carrier may also be called as an automated straddle carrier. Straddle carriers, that are one type of a container handling equipment, may be utilized in general in an outdoors environment, for example in port terminals and intermodal yards for stacking and moving containers. The containers may be ISO standard compliant. A straddle carrier operates by straddling its load, picking it up and carrying it by connecting to the container’s top lifting points using a container spreader. A straddle carrier may travel at relatively low speeds such as up to km/h or 20 mph.
Another type of container handling equipment is a gantry crane, in general, may be - understood as a crane that is built atop a gantry. Gantry cranes may vary from gantry O cranes, capable of lifting some of the heaviest loads in the world, to small cranes such = 25 —ascranescapable of lifting automobile engines out of vehicles. The structure of a gantry 2 crane may travel on wheels. The wheels may be rubber-tyred wheels that are intended E to travel on flat, or substantially flat, surface or the wheels running along rails. A = straddle carrier may be considered as one type of a rubber-tyred gantry crane.
O 5 O 30 = Figure 1 illustrates an exemplary embodiment of an area, such as a container handling area that is a geographically limited area, in which one or more container handling equipment may be utilized.
The environment in this exemplary embodiment is a port in which container ships may be loaded and unloaded of containers.
In this exemplary embodiment a container ship 110 is being unloaded by a ship-to-shore crane 120 after which the containers 135 may be stacked to a dedicated stacking area 130 in the port. 5 A container handling equipment 140, that in this exemplary embodiment is a straddle carrier, may be utilized to move a container 135 to a transfer area 125 after it has been unloaded by the ship-to-shore crane 120 to an unloading area.
From the transfer area another container handling equipment such as a stacking crane 132, may then move the container to a certain place in the stacking area 130. In some exemplary embodiments, another container handling equipment 145, which may also be a straddle carrier, may then be utilized when container is loaded on to a truck or train 150 for further transportation.
It is to be noted that the further transportation of a container may also be performed by other types of transportation vehicles such as trains 150. It is to be noted that the layout of a port area may vary and in this exemplary embodiment, the layout is simplified for the sake of ease of explanation.
In general, a stacking area may be understood as an area comprising multiple parallel bays, and at both ends of each bay, there may be a dedicated transfer area where a container handling equipment such as a straddle carrier may deliver containers to be handled within the stacking area by another container handling equipment and, respectively, — the said other container handling equipment may bring a container from a container stack in the stacking area to a transfer area, to be picked by the straddle carrier and transported to the ship-to shore crane.
O In a container handling area, such as a port, there may be a plurality of container stacks = 25 and a plurality of container handling equipment, which may be of various types, that 2 are operating and moving around at the same time.
In order to improve efficiency and E safety, automatization may be utilized for operating the container handling area that = comprises moving and storing containers as well as loading and unloading them to 3 vehicles.
Utilizing automatization may result in reduced need for personnel to control O 30 and operate the container handling area.
Yet there needs to be overall planning and guidance applying to the operation to avoid collisions and to make sure that correct equipment is in a correct place at the correct time and handling the correct container in a correct manner. Thus, for example in a container terminal an overall management is required. An operating management software may be used for such overall management. The overall management may comprise for example task planning, task scheduling, routing and onboarding aspects that are managed and controlled. The task planning may comprise plans regarding unloading a container ship. This planning may be performed by software program without user input or with some user input. A task may comprise identifying a container and its destination in the storage area. The tasks may then be scheduled using software. The software may independently schedule the — tasks or user input may be provided to complete scheduling of the tasks. Scheduling may comprise assigning a container handling eguipment to a task. The scheduling may take into account aspects such as timing, locations of the container handling eguipment and job gueues associated with the container handling eguipment. When planning routing, an optimized route for each of the container handling eguipment may be determined by the software with or without user input. When determining the routes, aspects such as currently assigned tasks to each container handling eguipment and their current locations may be taken into account. At an onboarding stage, a container handling eguipment may then execute a task and move a container from its current location to its target location. The container handling equipment may perform this part in automated manner. Automated manner of performing the task may however comprise a user supervising from a distance the container handling equipment. The supervising may be done on fleet level instead of, or in addition to, container handling - equipment level. The supervising may comprise interventions by a user if necessary. O For example, if container handling eguipment cannot detect its position, the user may = 25 resolve the problem by driving the equipment to another place from a remote location. 2 Yet, when performing the task in an automated manner, the container handling E eguipment operates without a user in it.
5 3 A container handling area such as a port or a container terminal with automated O 30 container handling equipment also needs to verify that the container handling equipment do not collide with another container handling equipment or other vehicle and/or structures.
An automated container handling equipment may also be understood as container handling equipment that may operate without a driver or may perform some operations in an automated manner and some operations with input from a driver.
Therefore, in order to operate the container handling area efficiently and to ensure collisions are avoided, it is important to know the location of a container handling equipment in real-time.
Thus, a container handling equipment, that may be automated container handling equipment, needs to be positioned.
Positioning container handling equipment may be understood as determining its location within a geographical area.
In general, when handling containers, coarse position information — may be sufficient for various purposes.
For example, collisions of container handling equipment may be avoided and the containers may be identified and located if the positioning accuracy is about +/- 1 meter.
Yet, for efficient handling of containers, the positioning accuracy of the container handling equipment, for example straddle carriers, may need to be significantly better, for example +/- 10 cm, which, for example, would allow a ship-to-shore gantry crane to pick up a container a straddle carrier has brought without having to move.
Various positioning techniques exist, and different positioning techniques may be utilized, alone or in a combination comprising two or more different techniques, to obtain a more robust positioning result when determining the position of a container handling equipment.
Some positioning techniques are based on radio frequency, RF.
An example of such positioning technique is a differential global positioning system, - DGPS, that is an enhanced version of global positioning system, GPS and may provide O positioning accuracy up to 1-3 cm.
Yet, in a container handling area there may be plenty = 25 of large objects and steel structures that will block and/or reflect RF signals 2 transmitted.
Further, RF based positioning may be prone to interference and thereby E causing errors that could lead to significant damage in a container handling area. = Transponders installed to the ground, which upon receiving a signal sent by the 3 container handling equipment, emit a specific unique signal in response, may also be O 30 utilized.
In a container handling area transponders may be located in fixed locations within the container handling area which means that as a location of a transponder does not change, the location of a moving container handling equipment may be determined based on the known location of the transponder. Yet, as a container handling area may be a large one, the number of transponders required may be overwhelming and therefore it may not always be feasible to utilize transponders in all areas of a container handling area.
Laser-based solutions may be utilized to scan the environments and make determinations based on the scanned results. Container handling equipment may comprise a multi-layer lidar that is a device that allows measuring distances by illuminating a target area with laser light and then measures the reflection with a sensor. A multi-layer lidar may scan the target area in multiple planes. Detected differences in return times and wavelengths are then utilized for creating a 3D point cloud that represents the target area. Software algorithms may then be utilized to determine from the 3D point cloud what the environment is like and are there landmark objects, obstacles to avoid and so on. The software algorithms may be executed by a computing device that may be comprised in the multi-layer lidar or the computing device may be connected to the multi-layer lidar. Figure 2 illustrates an exemplary embodiment of utilizing a multi-layer lidar. A multi- layer lidar 210 is comprised in a container handling equipment that in this exemplary embodiment is a straddle carrier 220 that is automated. The multi-layer lidar 210 is located on top of the straddle carrier 220 that may be used to move containers around - a container handling area. As the multi-layer lidar 210 is located on top of the straddle O carrier 220, it may obtain a 360 degree view around the straddle carrier 220 by turning = 25 around for example. In this exemplary embodiment, the multi-layer lidar 210 scans 16 2 layers and the distance between the layers is approximately 1.9 meters at 50 meters. E The field of view 230 of the multi-layer lidar 210 extends to the ground at = approximately 40 meters in this exemplary embodiment. The height at which the 3 multi-layer lidar 210 is located at in this exemplary embodiment is 12 meters. As the O 30 — multi-layer lidar scans the area around the straddle carrier 220, various objects may be detected. Yet, as the environment is a container handling area, multiple objects with the same size and shape exist thereby making it difficult to distinguish between the objects.
If the objects cannot be distinguished from one another, it may be challenging to perform positioning based on detected objects and/or landmarks that are detected using the multi-layer lidar 210. In other words, it may be challenging to determine a position based on the detected environment using the multi-layer lidar 210 when the environment comprises repetitive structures.
It is to be noted that the performance of the multi-layer lidar may in some other exemplary embodiments be different than that of the multi-layer lidar 210. It is to be noted though that in some other exemplary embodiments, other types of detection devices and technologies than a multi-layer lidar may be used in addition or alternatively to using the multi-layer lidar.
Such technologies comprise, for example, time of flight cameras, radar sensors and/or stereo cameras.
A multi-layer lidar, or other optical detection used, may easily detect a reflective — surface.
A reflective surface may be obtained using any suitable reflective material.
Yet, it is to be noted that even if material is not reflective, it may be considered to have reflective characteristics that may be categorized as being, at least substantially, non- reflective.
A reflector unit may be understood as a reflective object made of a single reflector element or comprising a plurality of reflector elements that are adjacent to one another in a pre-determined manner.
Adjacent reflector elements may be connected to each other or there may be a gap in between them.
Figure 3 illustrates exemplary embodiments of reflector units that comprise two or more reflector - elements 310. A reflector element 310 has characteristics such as shape, size, O orientation, reflectivity, and height, which may be the installation height of the = 25 reflector element.
It is to be noted that the reflectivity characteristics may also be, at 2 least substantially, non-reflective.
The shape of a reflective element may be for E example a cuboid, which may comprise one or more reflective sides, or a rectangle, or = any other suitable shape.
The characteristics of a reflector element may vary from one 3 reflector element to another.
As two or more reflector elements are combined into a O 30 reflector unit, the reflector unit also has characteristics such as size, shape, reflection pattern, height and width.
The reflection pattern may be formed by adjacent reflector elements having different reflectivity characteristic. For example, one element may have non-reflective characteristics and an adjacent reflector element may have high reflectivity. Further, depending on how the two or more reflective elements are placed respective to one another, the characteristics of the reflector unit may vary meaning that although the reflector elements comprised in reflector units may be identical, the reflector units may have characteristics that allow the reflector units to be distinguished from one another. The combinations 342, 344, 346 and 348 illustrate how the positioning of reflector elements respective to one another may change the shape of the reflector unit 330 comprising those reflector elements. A reflector orientation 345 may be understood as angular positions of reflector elements respective to each other. The reflector orientation 345 may be used to differentiate reflector units from one another even when they comprise identical reflector elements. In some exemplary embodiments, a reflector unit 350 may comprise a plurality of reflector elements in form of planar reflective surfaces that together may form a barcode -type of reflective pattern. The reflector unit may have a pre-determined size and the relative location of the outmost reflector elements 351 and 352 may also be pre-determined. Additionally, there may be pre-determined locations for reflector elements in between the reflector elements 351 and 352. Thus, the reflector unit 350 may be identified based on its reflective pattern that is formed depending on if there is a reflection in a location of a reflective element or not. For example, if there is no reflective surface at a location dedicated for a reflector element of the reflector unit — 350, the reflection may be substantially no reflection which is part of the reflection O pattern of thereflector unit 350. In some other exemplary embodiments, the shape and = 25 size of the reflector units in between the outmost reflector elements may vary.
2 E A reflector unit may then be attached to a stationary or non-stationary structure that = is located within a container handling area, and the location of said structure may be 3 known. In figure 3 an example of a light pole 320 with reflector elements 322 and 324 O 30 forming a reflector unit 330 is illustrated. The characteristics of the reflector unit 330 may be such that they allow identifying the light pole 320 as light pole in general or as a specific light pole within the container handling area.
In other words, all light poles may comprise a reflector unit with same characteristics making them distinguishable as light poles though not necessarily identifying which light pole.
Alternatively, the characteristics of the reflector unit 330 may be such that the light pole is identifiable as a certain light pole whose location within the container handling area is known.
Further, in some exemplary embodiments, the reflector unit 330 may be such that the light pole is identifiable as belonging to a certain group of light poles.
In addition to light poles, reflector units may be installed in other structures such as — ship-to-shore cranes and/or those may be used to identify certain areas, for example to distinguish between the transfer areas 125a, 125b, 125c, 125d etc. located at the ends of container stacking areas as illustrated in figure 5. In a limited area such as a container handling area, landmarks may be uniquely identifiable by using reflector units with characteristics unique within that limited area.
It is to be noted that a plurality of reflector elements may be used to form a reflector unit.
The size of a reflector unit is to be such that a multi-layer lidar may detect it from a distance such as 50 meters for example.
It is to be noted though that, in some exemplary embodiments, the size of a reflector unit may be related to the performance capability of a multi-layer lidar and therefore, the better the performance of a multi-layer lidar, the smaller the size of a reflector unit can be.
The reflective characteristics of reflective elements may be obtained for example by covering the elements, at least partly, with reflective tape or reflective paint and/or by using paints of different colour.
This may allow the multi- - layer lidar to be able to detect the reflector elements based on their reflectivity.
In some O exemplary embodiments, the reflector elements may further comprise non-reflective = 25 parts and/or there may be nonreflective areas in between reflector elements 2 comprised in a reflector unit.
Tr a K In general, one or more reflector units may be utilized for various purposes.
In an 2 exemplary embodiment, reflector units installed in fixed structures, such as lamp S 30 posts, may be utilized for positioning purposes within a certain area such as a port area.
In another exemplary embodiment, reflector units installed in non-fixed structures may provide positioning information for various purposes. For example, the reflector unit in non-fixed structures such as in ship to shore cranes may provide position information that may then be utilized to keep passing automated container handling equipment and/or other automated vehicles aligned with the driving lane. Additionally, or alternatively, the reflector units in the ship to shore cranes may enable precise relative positioning of the ship to shore crane and the automated container handling equipment, and thereby allow for efficient container transfer between the ship to shore crane and the automated container handling equipment.
Using a multi-layer lidar for detecting one or more reflector units may be utilized when positioning an equipment such as a container handling equipment that may be automated. Based on the detection of a reflector unit, that has a known position, using the multi-layer lidar, an XY-position of the equipment may be determined by running one or more software algorithms on a computing device that may be comprised in or connected to the multi-layer lidar. If multiple reflector units are detected and then identified based on their characteristics and the locations of the identified reflector units are known, then a relatively reliable and cost-efficient way of determining a location may be achieved. Yet, additionally also other methods of determining the location may be utilized. If no reflector units are detected at a given time by the multi- layer lidar that is comprised in a container handling equipment, then the travelled distance may be estimated based on laser data obtained from the multi-layer lidar for example.
O In some exemplary embodiments, there may be a plurality of ship-to-shore gantry = 25 —cranesinaportarea that have reflector units that have the same characteristics except 2 for the height at which the reflector unit is located at in the respective ship-to-shore E gantry crane. In such exemplary embodiment, a container handling eguipment = comprising a multi-layer lidar may identify each ship-to-shore gantry crane based on 3 the measured distance to their reflector units. This allows the container handling O 30 equipment to identify its relative position in view of a ship-to-shore gantry crane.
In some exemplary embodiments, for example when positioning is required in a large geographical area, in addition to utilizing reflector units to determine the location of an automated container handling equipment also other positioning methods may additionally be utilized. For example, it may be that it is not possible to create and install reflector units that would be unique with respect to each other within the whole geographical area. In such cases other positioning methods may be used to complement the reflector unit based positioning. For example, Wi-Fi access points may be utilized. If the reflector units that are located within the coverage area of a Wi-Fi access point are uniquely identifiable with respect to each other, then the reflector units may not need to be uniquely identifiable within the whole geographical area. In such exemplary embodiments, a Wi-Fi access point may be utilized to determine a coarse location of an automated container handling equipment and reflector units may then be utilized to determine a more precise location within the coverage area of the Wi-Fi access point.
Figure 4 illustrates a flow chart according to an exemplary embodiment. First, in S1, a reflector unit is detected. The reflector unit comprises a plurality of reflector elements. A reflector unit may be uniquely identifiable in a limited area such as a container handling area based on the characteristics of the reflector elements. It is to be noted that even if the reflector elements were identical as such, their positioning respective to one another may result in a reflector unit that has different characteristics compared to the other reflector units within the limited area. For example a reflector angle - and/or the number of reflector elements comprised in a reflector unit may vary O between the reflector units even if the reflector elements as such were identical. The = 25 position of a reflector unit may be stable, and it may be known. This is beneficial as it 2 allows detection to be performed as many times as needed, whenever it is needed and E by multiple detecting devices simultaneously. In this exemplary embodiment, the detection is performed using a multi-layer lidar and the multi-layer lidar is comprised 3 in automated container handling equipment. The multi-layer lidar may be located on O 30 top of the automated container handling equipment and it may rotate such that a 360 scanning of the environment may be enabled. Thus, the multi-layer lidar may detect not only one reflector unit but a plurality of reflector units when performing the scanning.
Next, in S2, the reflector unit is identified based on its characteristics.
The identifying may be done using one or more software algorithms based on data obtained from the multi-layer lidar.
The software algorithms may be run using a computing apparatus that is comprised in the multi-layer lidar or is connected to the multi-layer lidar.
For example, in case the running of the one or more algorithms requires more resources than is available in a computing device comprised in the multi-layer lidar, the data obtained by the multi-layer lidar may be for example pre-processed and then transmitted to another computing device for further processing based on which the identifying may then be performed.
Alternatively, the data obtained by the multi-layer lidar may be processed by running the one or more algorithms in a computing apparatus comprised in the multi-layer lidar and then identify the reflector unit, or in some exemplary embodiments, multiple reflector units.
In S3, once the reflector unit has been identified, a location of the automated container handling equipment is then determined based on the identified reflector unit.
As the location of the reflector unit is known and the multi-layer lidar provides information regarding the distance to the reflector unit, as well as the direction in which the reflector unit is respective to the automated container handling equipment, the location of the automated contained handling equipment may be determined.
It is to - be noted that also other methods for obtaining the location may be utilized and that O may be done additionally or alternatively.
If more than one reflector unit is identified, = 25 then the location of the automated container handling equipment may determine its 2 location based on the known locations, distances, and directions of the identified E reflector units.
The automated container handling eguipment may utilize the obtained = location information in verifying that it stays on the intended route and/or when it is 3 delivering a container to a destination location or picking up a container, to verify that O 30 the pick up or drop-off location is correct.
In S4 the determined location of the automated container handling equipment is provided to an operating management software that is used to operate the limited area within which the reflector units are located and within which the automated container handling equipment operates. This may be done by providing an indication of the location to the operating management software. The indication may be provided periodically or continuously. The indication may be provided even if the method for obtaining the location information changes, thus, providing the indication may be independent of the method used for obtaining the location. The operating management software may be for example such as described above, and it may plan tasks and routes and allocate those to various container handling equipment. It is desirable to be aware of the locations of the moving objects within the area and to be able to predict their movement and operations. For example, if the current position of a container handling equipment as well as its destination position are known, it may be estimated when another task may be assigned to the container handling equipment. Therefore, the location information is beneficial to ensure that operations are executed as planned and that the automated container handling equipment is on a correct route and/or correct place at any given time, and on the other hand, if the location is not what it is expected to be, and/or if a collision may be about to occur, it may be evaluated if corrective measures are to be taken. Such measures may be, for example, a command to the equipment to stop or change its route, or to provide an alert to a user who controls operations at the limited area. Additionally, or alternatively, the location may further be provided to other container handling equipment operating in the limited - area as well. In some exemplary embodiments, equipment to equipment O communication may also be possible.
= 25 2 Although in the exemplary embodiment described above there is one reflector unit E that is detected and identified, in some other exemplary embodiments there may be a = plurality of reflector units that are to be detected and their combination is to be 3 identified for determining a location. In such exemplary embodiments, for example a O 30 — ship-to-shore gantry crane may comprise in its left front leg, i.e. in one corner of the crane, a reflector unit that identifies it as a left front leg of the ship-to-shore gantry crane. Another reflector unit on the same ship-to-shore gantry crane may then be used to identify the said ship-to-shore gantry crane from other ship-to shore gantry cranes that also comprise a reflector unit for identifying their left front legs.
Figure 5 illustrates an exemplary embodiment in which reflector units are utilized in the port in area 500. A container ship 510 may be unloaded and loaded using ship-to- shore gantry cranes that are identifiable by reflector units 520 and/or 530 that are attached to their legs or to other structural parts. Each reflector unit may be uniquely identifiable or alternatively, there may be multiple reflector units in one ship-to-shore gantry crane. In an exemplary embodiment, a ship-to-shore gantry crane comprises at least two reflector units placed such that at least one of them is detectable to a multi- layer lidar comprised in an automated container handling equipment such as a straddle carrier. The ship-to-shore gantry crane may then be identified based on the detected reflector unit. It is to be noted that in some exemplary embodiments at least two reflector units are visible in every situation to the multi-layer lidar and the at least two reflector units then are utilized to identify the ship-to-shore crane. In a same manner there are reflector units 530 attached to light poles and reflector units 540 attached to traffic light platforms of a transfer area 125. In this exemplary embodiment, a reflector element comprised in a reflector unit 530 has a shape of a cuboid that has length of 0,5 meters, width of 0,5 meters and height of 2,5 meters. The light poles in this exemplary embodiment are 60 meters away from each other. The reflector elements comprised in a reflector unit 530 are stacked on top of each other and may - be distinguishable by the reflector angle at which they are rotated respective to each O other. In some exemplary embodiments, there may further be a reflector unit such as = 25 — the reflector unit 350 introduced in Figure 3 attached to a structure, that may be a 2 horizontal structure, and it may be located above a transfer area and comprise also E traffic lights. The reflector unit may then uniguely identify the structure and thus the = location may also be determined.
O 5 O 30 The apparatus 600 is an exemplary embodiment of a computing apparatus. The computing apparatus may be comprised in or connected to for example an automated container handling equipment or a multi-layer lidar.
The apparatus 600 comprises a processor 610. The processor 610 interprets computer program instructions and processes data.
The processor 610 may comprise one or more programmable processors.
The processor 610 may comprise programmable hardware with embedded firmware and may, alternatively or additionally, comprise one or more application specific integrated circuits, ASICs.
The processor 610 is coupled to a memory 620. The processor is configured to read and write data to and from the memory 620. The memory 620 may comprise one or more memory units.
The memory units may be volatile or non-volatile.
It is to be noted that in some exemplary embodiments there may be one or more units of non-volatile memory and one or more units of volatile memory or, alternatively, one or more units of non-volatile memory, or, alternatively, one or more units of volatile memory.
Volatile memory may be for example RAM, DRAM or SDRAM.
Non-volatile memory may be for example ROM, PROM, EEPROM, flash memory, optical storage or magnetic storage.
In general, memories may be referred to as non-transitory computer readable media.
The memory 620 further stores computer readable instructions that are executed by the processor 610. For example, non-volatile memory stores the computer readable instructions and the processor 610 executes the instructions using volatile memory for temporary storage of data and/or instructions.
The memory may also save data such as values. — The computer readable instructions may have been pre-stored to the memory 620 or, O alternatively or additionally, they may be received, by the apparatus, via = 25 electromagnetic carrier signal and/or may be copied from a physical entity such as 2 computer program product.
Execution of the computer readable instructions causes E the apparatus 600 to perform functionality described above. 5 3 In the context of this document, a memory or computer-readable media may be any O 30 — non-transitory media or means that can contain, store, communicate, propagate or transport the instructions for use by or in connection with an instruction execution system, apparatus, or device, such as a computer. The apparatus 600 further comprises, or is connected to, an input unit 630. The input unit 630 comprises one or more interfaces for receiving a user input. The one or more interfaces may comprise for example one or more motion and/or orientation sensors, one or more cameras, one or more accelerometers, one or more microphones, one or more buttons and one or more touch detection units. Further, the input unit 630 may comprise an interface to which external devices may connect to.
The apparatus 600 also comprises an output unit 640. The output unit may comprise for example one or more displays capable of rendering visual content such as a light emitting diode, LED, display or a liquid crystal display, LCD. The output unit 640 may further comprise one or more audio outputs such as loudspeakers or a set of headphones.
The apparatus 600 may further comprise a connectivity unit 650. The connectivity unit 650 enables wired and/or wireless connectivity to external networks such as Bluetooth or Wi-Fi. The connectivity unit 650 may comprise one or more antennas and one or more receivers that may be integrated to the apparatus 600 or the apparatus 600 may be connected to. The connectivity unit 650 may comprise an integrated circuit or a set of integrated circuits that provide the wireless communication capability for the apparatus 600. Alternatively, the wireless connectivity may be a hardwired - application specific integrated circuit, ASIC.
S = 25 Itistobenotedthatthe apparatus 600 may further comprise various components not 2 illustrated in the Figure 6. The various components may be hardware components E and/or software components.
5 3 Even though the invention has been described above with reference to exemplary O 30 embodiments according to the accompanying drawings, it is clear that the invention is not restricted thereto but can be modified in several ways within the scope of the appended claims. Therefore, all words and expressions should be interpreted broadly, and they are intended to illustrate, not to restrict, the embodiment. It will be obvious to a person skilled in the art that, as technology advances, the inventive concept can be implemented in various ways. Further, it is clear to a person skilled in the art that the described exemplary embodiments may, but are not required to, be combined with other exemplary embodiments in various ways. The scope of protection sought for various embodiments of the invention is set out by the independent claims. If any exemplary embodiments and features described in this specification should not fall under the scope of the independent claims, those are to be interpreted as examples useful for understanding various embodiments of the invention.
N O
N n
O
I a a
K O O LO O N O N

Claims (15)

1. A method comprising: detecting a reflector unit (350, 520, 530) that is attached to a stationary or non-stationary structure and that comprises a plurality of reflector elements arranged in a pre-determined manner with respect to each other, and wherein the reflector unit comprises a pre-determined shape, size and pre-determined relative locations of outmost reflector elements (351, 352); identifying the reflector unit (350, 520, 530) based, at least partly, on its characteristics; and determining a location of a container handling equipment based, at least partly, on the identified reflector unit (350, 520, 530).
2.A method according to claim 1, further comprising providing an indication of the determined location to an operating management software.
3. A method according to claim 1 or 2, wherein the location is used to operate the container handling equipment in an automated manner.
4. A method according to any previous claim wherein the characteristics of the reflector unit are unique within a coverage area of a Wi-Fi access point.
N
O
N L
5. A method according to any previous claim wherein the plurality of reflector elements n 25 are identical.
O
I =
6. A method according to any previous claim, wherein the location of the reflector unit
N 3 (350, 520, 530) is a known location.
O
N
O
N
7. A method according to any previous claim, wherein the reflector unit (350, 520, 530) is detected using optical detection.
8. A method according to any previous claim, wherein at least one other reflector unit (350,520,530) is detected for determining the location.
9. A method according to any previous claim, wherein the characteristics comprise at least one of the following: a reflector orientation, reflection pattern, shape, size, reflectivity, texture, amount of reflector elements, no reflection at a location dedicated for a reflector element of the reflector unit (350, 520, 530), and/or installation height of the reflector elements comprised in the reflector unit (350, 520, 530).
10. A method according to any previous claim, wherein the reflector unit (350, 520, 530) is comprised in at least one of the following: a light pole, a traffic light platform or — ship-to-shore gantry crane.
11. A method according to any previous claim wherein determining the location further comprises detecting location using RF-based positioning technique.
12. An apparatus comprising means for performing a method according to any of claims 1 to 11. -
13. An apparatus according to claim 12 wherein the apparatus is comprised in an
N S automated container handling eguipment. = 25 S
14. An apparatus according to claim 13 wherein the automated container handling E eguipment is a straddle carrier.
K
O 3
15. A computer program product comprising computer program code stored in a non- O 30 transitory memory medium, which, when executed by a computing apparatus, causes the apparatus to perform a method according to any of claims 1 to 11.
FI20205907A 2020-09-18 2020-09-18 Determining position of a container handling equipment FI129322B (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
FI20205907A FI129322B (en) 2020-09-18 2020-09-18 Determining position of a container handling equipment
CN202180063562.9A CN116391214A (en) 2020-09-18 2021-09-16 Determining the position of container handling equipment
PCT/FI2021/050611 WO2022058654A1 (en) 2020-09-18 2021-09-16 Determining position of a container handling equipment
US18/245,086 US20230356985A1 (en) 2020-09-18 2021-09-16 Determining position of a container handling equipment
EP21868794.5A EP4214468A4 (en) 2020-09-18 2021-09-16 Determining position of a container handling equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
FI20205907A FI129322B (en) 2020-09-18 2020-09-18 Determining position of a container handling equipment

Publications (2)

Publication Number Publication Date
FI129322B true FI129322B (en) 2021-11-30
FI20205907A1 FI20205907A1 (en) 2021-11-30

Family

ID=78716723

Family Applications (1)

Application Number Title Priority Date Filing Date
FI20205907A FI129322B (en) 2020-09-18 2020-09-18 Determining position of a container handling equipment

Country Status (5)

Country Link
US (1) US20230356985A1 (en)
EP (1) EP4214468A4 (en)
CN (1) CN116391214A (en)
FI (1) FI129322B (en)
WO (1) WO2022058654A1 (en)

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008057504A2 (en) * 2006-11-06 2008-05-15 Aman James A Load tracking system based on self- tracking forklift
FI121402B (en) * 2009-04-15 2010-10-29 Konecranes Oyj System for identification and / or position determination of container processing machine
US9410804B2 (en) * 2011-04-21 2016-08-09 Konecranes Global Corporation Techniques for positioning a vehicle
US20130054129A1 (en) * 2011-08-26 2013-02-28 INRO Technologies Limited Method and apparatus for using unique landmarks to locate industrial vehicles at start-up
US10949792B2 (en) * 2016-12-30 2021-03-16 United States Postal Service System and method for delivering items using autonomous vehicles and receptacle targets

Also Published As

Publication number Publication date
EP4214468A1 (en) 2023-07-26
US20230356985A1 (en) 2023-11-09
EP4214468A4 (en) 2024-10-16
WO2022058654A1 (en) 2022-03-24
FI20205907A1 (en) 2021-11-30
CN116391214A (en) 2023-07-04

Similar Documents

Publication Publication Date Title
US10408945B2 (en) Techniques for positioning a vehicle
CN109726969B (en) Port intelligent control system and related system and device
AU2019302313A1 (en) System for realizing automated transport of goods and related apparatus
CN109711787B (en) Port intelligent control system and related system and device
EP3828659B1 (en) System for vehicle
US12065310B2 (en) Systems, methods, computing platforms, and storage media for controlling an autonomous inventory management system
FI129322B (en) Determining position of a container handling equipment
CN112543505A (en) Port area positioning system and method
KR102491670B1 (en) Apparatus for Generating Map for Autonomous Driving
CN114265375B (en) System and method for storing and taking goods of flat truck by AGV
CN114360274B (en) Distribution vehicle navigation method, system, computer equipment and storage medium
US20220009759A1 (en) Industrial vehicle distance and range measurement device calibration
WO2017120079A1 (en) Autonomous box transport system
US11802948B2 (en) Industrial vehicle distance and range measurement device calibration
FI130312B (en) Tracking a truck in a container handling area
CN115840449A (en) Cargo handling method, cargo handling system, electronic device, and storage medium

Legal Events

Date Code Title Description
FG Patent granted

Ref document number: 129322

Country of ref document: FI

Kind code of ref document: B