EP4532398A1 - Verfahren und steuereinrichtung zum steuern eines flurförderzeugs - Google Patents
Verfahren und steuereinrichtung zum steuern eines flurförderzeugsInfo
- Publication number
- EP4532398A1 EP4532398A1 EP23727017.8A EP23727017A EP4532398A1 EP 4532398 A1 EP4532398 A1 EP 4532398A1 EP 23727017 A EP23727017 A EP 23727017A EP 4532398 A1 EP4532398 A1 EP 4532398A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- point information
- industrial truck
- point
- point cloud
- read
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B66—HOISTING; LIFTING; HAULING
- B66F—HOISTING, LIFTING, HAULING OR PUSHING, NOT OTHERWISE PROVIDED FOR, e.g. DEVICES WHICH APPLY A LIFTING OR PUSHING FORCE DIRECTLY TO THE SURFACE OF A LOAD
- B66F9/00—Devices for lifting or lowering bulky or heavy goods for loading or unloading purposes
- B66F9/06—Devices for lifting or lowering bulky or heavy goods for loading or unloading purposes movable, with their loads, on wheels or the like, e.g. fork-lift trucks
- B66F9/063—Automatically guided
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B66—HOISTING; LIFTING; HAULING
- B66F—HOISTING, LIFTING, HAULING OR PUSHING, NOT OTHERWISE PROVIDED FOR, e.g. DEVICES WHICH APPLY A LIFTING OR PUSHING FORCE DIRECTLY TO THE SURFACE OF A LOAD
- B66F9/00—Devices for lifting or lowering bulky or heavy goods for loading or unloading purposes
- B66F9/06—Devices for lifting or lowering bulky or heavy goods for loading or unloading purposes movable, with their loads, on wheels or the like, e.g. fork-lift trucks
- B66F9/075—Constructional features or details
- B66F9/0755—Position control; Position detectors
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B66—HOISTING; LIFTING; HAULING
- B66F—HOISTING, LIFTING, HAULING OR PUSHING, NOT OTHERWISE PROVIDED FOR, e.g. DEVICES WHICH APPLY A LIFTING OR PUSHING FORCE DIRECTLY TO THE SURFACE OF A LOAD
- B66F9/00—Devices for lifting or lowering bulky or heavy goods for loading or unloading purposes
- B66F9/06—Devices for lifting or lowering bulky or heavy goods for loading or unloading purposes movable, with their loads, on wheels or the like, e.g. fork-lift trucks
- B66F9/075—Constructional features or details
- B66F9/20—Means for actuating or controlling masts, platforms, or forks
- B66F9/24—Electrical devices or systems
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/50—Extraction of image or video features by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
Definitions
- the present invention relates to a method and a control device for controlling an industrial truck in a warehouse.
- the present invention also relates to an industrial truck with such a control device.
- the method includes reading in a point cloud of the warehouse in an environment of the industrial truck.
- the method can include recording the point cloud with an environment detection sensor system.
- the environment detection sensor system can be arranged on the industrial truck to detect the point cloud.
- the method can include outputting a control signal for detecting the point cloud with the environment detection sensor system.
- the environment detection sensor system can have a distance-measuring sensor. Alternatively or additionally, the environment detection sensor system can have an image-capturing sensor.
- the distance-measuring sensor can be designed as a scanning sensor.
- the distance-measuring sensor can be, for example, a laser scanner, a radar measuring device or an ultrasonic measuring device.
- the laser scanner, the radar measuring device or the ultrasonic measuring device can be designed as a two-dimensional or three-dimensional scanning sensor.
- the bearing can be detected or scanned at specific points in the area surrounding the industrial truck.
- the distance-measuring sensor can be used to record the point cloud of the warehouse in the area surrounding the industrial truck.
- the point cloud can be a two-dimensional or three-dimensional point cloud.
- the image-capturing sensor can be designed as a camera system.
- the camera system can have an RGB camera.
- the camera system can have a stereo camera system. If the environment detection sensor system has an image-capturing sensor as an alternative or in addition to a distance-measuring sensor, an image of the warehouse in the environment of the industrial truck can be captured or recorded.
- the image-capturing sensor can be used to capture a point cloud with image points of the warehouse.
- the point cloud read in has point information from at least one object located in the environment.
- the point information can include the measurement points recorded with the distance-measuring sensor. Alternatively or additionally, the point information can have the image points captured with the image-capturing sensor.
- the point information can have meta information about the measurement points. Alternatively or additionally, the point information can have meta information about the image points.
- the point information can have at least one point coordinate of the measuring points. Alternatively or additionally, the point information can have at least one color information in a visible or invisible spectral range of the image points.
- the method includes determining a statistical distribution parameter of the point information in the frequency distribution.
- the statistical distribution parameter may be a spread of the point information in the frequency distribution.
- the statistical distribution parameter can be a standard deviation or variance of the point information in the frequency distribution. The statistical distribution parameter can therefore be used to determine inhomogeneity of the point information.
- the method has a classification of the object into a human or into a storage object based on the statistical distribution parameter.
- the object can be an obstacle object for the industrial truck or a work object for the industrial truck.
- the industrial truck can be controlled using the method in such a way that a collision with the obstacle is avoided.
- the industrial truck can also be controlled using the method in such a way that the movement of the industrial truck towards the work object is improved.
- the classes for classifying the object consist of the human and the storage object.
- a classification into a person or into a warehouse object can be carried out based on a statistical distribution of point information in order to automatically control the industrial truck depending on a person or warehouse object recognized by the classification.
- the statistical distribution parameter can differ significantly depending on whether the point information relates to a person or a storage object. The steps of classifying and controlling the industrial truck can therefore be carried out reliably.
- the distribution parameter in the step of determining the statistical distribution parameter, can be determined based on a dispersion parameter in the frequency distribution.
- the dispersion parameter can be the standard deviation or the variance of the point information in the frequency distribution.
- the step of classifying the object can thus be carried out depending on the scattering parameter. If the scattering parameter exceeds a predetermined threshold value for the scattering parameter, the object can be classified as a human. If the scattering parameter falls below the predetermined threshold value, the object can be classified into the storage object. The classification can thus be carried out efficiently based on a spread of the point information.
- the point information in the step of transferring, can be converted into a histogram of the point information.
- the point information can be represented in the histogram as an image of the point information.
- the distribution parameter in the step of determining the statistical distribution parameter, can be determined in the histogram or in a subarea of the histogram.
- the distribution parameter may be determined based on a dispersion parameter in the histogram.
- the statistical distribution parameter can be determined functionally or image-based in the histogram. the.
- the distribution parameter can thus be determined in a particularly efficient manner using image processing methods in the representation of the point information in the histogram. The process can therefore advantageously also be carried out without a Cl approach.
- the point information of the point cloud read in can have spatial point coordinates of the at least one object located in the environment.
- the spatial point coordinates can be at least one-dimensional point coordinates of the at least one object located in the environment.
- the spatial point coordinates can be transferred into the frequency distribution.
- the specific statistical distribution parameter or the scattering parameter can thus define a scattering of the spatial point coordinates of the object.
- the classification described can therefore be carried out in at least one dimension depending on the spatial extent of the object.
- the point information of the read point cloud can have signal intensities of measurement signals reflected on the at least one object located in the environment for detecting the point cloud.
- the signal intensities can be transferred into the frequency distribution.
- the specific statistical distribution parameter or the scattering parameter can therefore define a scattering of the signal intensities of measurement signals reflected on the object.
- the classification can therefore be carried out depending on the material properties or geometry of the object, which can influence the signal intensities.
- a control signal for interrupting a work task carried out by the industrial truck can be output to a work device of the industrial truck.
- the working device can be a drive device for driving the industrial truck.
- the working device can also be a transport device or lifting device of the industrial truck for transporting or lifting goods.
- the control signal for interrupting the work task can be output if the classification step results in the object being classified into a human. A movement of the industrial truck when carrying out the work task can therefore be stopped based on the control signal in order to ensure the safety of the person at work.
- the step of classifying the object can be carried out based on a machine learning model.
- the machine learning model can use an AI approach or a neural network. point.
- at least one of the frequency distribution and the statistical distribution parameter can be read into the machine learning model.
- only the frequency distribution or the statistical distribution parameter can form an input variable for the machine learning model.
- the step of classifying the object can be carried out based on the machine learning model, with the histogram being read into the machine learning model.
- a histogram-based classification of the object can thus be carried out in a particularly efficient manner on the basis of the histogram.
- the image-based evaluation of the histogram is particularly advantageous.
- the present invention relates to a control device for controlling an industrial truck in a warehouse.
- the control device has an interface for reading in a point cloud of the warehouse in an environment of the industrial truck.
- the point cloud read in has point information from at least one object located in the environment.
- the control device is set up to convert the point information into a frequency distribution of the point information.
- the control device is also set up to determine a statistical distribution parameter of the point information in the frequency distribution.
- the control device is also set up to classify the object into a human or a storage object based on the statistical distribution parameter.
- the control device also has an interface for outputting a control signal for controlling the industrial truck in the warehouse based on the resulting classification.
- the control device can be set up to carry out the method according to the previous aspect.
- the control device can be arranged on the industrial truck.
- Features and embodiments of the method according to the preceding aspect may be corresponding features and embodiments of the control device, the control device being used to carry out each of the The steps described in the procedure can be set up.
- the control device can have corresponding units for carrying out the method steps.
- the present invention relates in a further aspect to an industrial truck.
- the industrial truck can be designed as described in the previous aspects.
- the industrial truck has a control device for controlling the industrial truck according to the previous aspect.
- Figure 1 shows an industrial truck and a control device for controlling the industrial truck according to respective embodiments of the invention.
- Figure 3 shows a flowchart with method steps for carrying out a method for controlling the industrial truck according to an embodiment of the invention.
- Figure 2 shows the industrial truck 100 in a warehouse 2.
- the warehouse 2 there are objects 10 in the environment 4 of the industrial truck 100.
- the point cloud recorded in the environment 4 has measurement data or points related to the objects 10.
- One object 10 of the objects 10 is a person 12 located in the warehouse 2 and another object 10 of the objects 10 is a storage technical item 14 located in the warehouse 2, according to one embodiment a shelf.
- the control device 110 determines a distribution parameter in the frequency distribution.
- the distribution parameter is a dispersion parameter of the frequencies of the histogram.
- the histogram forms an input variable for a machine learning model for classifying the object 10 into a human 12 or a storage object 14 based on a spread of the segmented point information.
- the scattering parameter forms a classification variable in the machine learning model.
Landscapes
- Engineering & Computer Science (AREA)
- Transportation (AREA)
- Structural Engineering (AREA)
- Mechanical Engineering (AREA)
- Civil Engineering (AREA)
- Life Sciences & Earth Sciences (AREA)
- Geology (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Evolutionary Computation (AREA)
- Artificial Intelligence (AREA)
- Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Computing Systems (AREA)
- Databases & Information Systems (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Software Systems (AREA)
- Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| DE102022205674.4A DE102022205674A1 (de) | 2022-06-02 | 2022-06-02 | Verfahren und Steuereinrichtung zum Steuern eines Flurförderzeugs |
| PCT/EP2023/063544 WO2023232500A1 (de) | 2022-06-02 | 2023-05-22 | Verfahren und steuereinrichtung zum steuern eines flurförderzeugs |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| EP4532398A1 true EP4532398A1 (de) | 2025-04-09 |
Family
ID=86605287
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP23727017.8A Withdrawn EP4532398A1 (de) | 2022-06-02 | 2023-05-22 | Verfahren und steuereinrichtung zum steuern eines flurförderzeugs |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US20250340414A1 (de) |
| EP (1) | EP4532398A1 (de) |
| CN (1) | CN119156340A (de) |
| DE (1) | DE102022205674A1 (de) |
| WO (1) | WO2023232500A1 (de) |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10788836B2 (en) * | 2016-02-29 | 2020-09-29 | AI Incorporated | Obstacle recognition method for autonomous robots |
| US10430673B2 (en) | 2017-07-19 | 2019-10-01 | GM Global Technology Operations LLC | Systems and methods for object classification in autonomous vehicles |
| US10768304B2 (en) * | 2017-12-13 | 2020-09-08 | Luminar Technologies, Inc. | Processing point clouds of vehicle sensors having variable scan line distributions using interpolation functions |
| DE102018205964A1 (de) | 2018-04-19 | 2019-10-24 | Zf Friedrichshafen Ag | Verfahren und Steuergerät zum Navigieren eines autonomen Flurförderfahrzeugs |
| DE102018205965B4 (de) * | 2018-04-19 | 2026-04-02 | Zf Friedrichshafen Ag | Verfahren und Steuergerät zum Kennzeichnen einer Person |
| EP3620978A1 (de) | 2018-09-07 | 2020-03-11 | Ibeo Automotive Systems GmbH | Verfahren und vorrichtung zur klassifizierung von objekten |
| US11532168B2 (en) * | 2019-11-15 | 2022-12-20 | Nvidia Corporation | Multi-view deep neural network for LiDAR perception |
| KR102757112B1 (ko) * | 2019-12-03 | 2025-01-21 | 가부시키가이샤 도요다 지도숏키 | 산업 차량 |
| US12233905B2 (en) * | 2020-11-02 | 2025-02-25 | Waymo Llc | Classification of objects based on motion patterns for autonomous vehicle applications |
-
2022
- 2022-06-02 DE DE102022205674.4A patent/DE102022205674A1/de active Pending
-
2023
- 2023-05-22 US US18/871,085 patent/US20250340414A1/en active Pending
- 2023-05-22 WO PCT/EP2023/063544 patent/WO2023232500A1/de not_active Ceased
- 2023-05-22 EP EP23727017.8A patent/EP4532398A1/de not_active Withdrawn
- 2023-05-22 CN CN202380041020.0A patent/CN119156340A/zh active Pending
Also Published As
| Publication number | Publication date |
|---|---|
| CN119156340A (zh) | 2024-12-17 |
| DE102022205674A1 (de) | 2023-12-07 |
| US20250340414A1 (en) | 2025-11-06 |
| WO2023232500A1 (de) | 2023-12-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| DE3587220T2 (de) | Identifizierungsverfahren von konturlinien. | |
| DE102014214448B4 (de) | Vorrichtung und Verfahren zur Erkennung eines Verkehrszeichens | |
| DE102015113434A1 (de) | Verfahren zur Objektlokalisierung und Posenschätzung für ein interessierendes Objekt | |
| DE102022129021A1 (de) | Algorithmus zum depalettieren bei unterschiedlichen grössen | |
| DE102008036219A1 (de) | Verfahren zur Erkennung von Objekten im Umfeld eines Fahrzeugs | |
| EP2385014A1 (de) | Flurförderzeug mit einer Einrichtung zur Identifizierung eines geladenen Transportgutes, und Verfahren zur Identifizierung eines geladenen Transportgutes eines Flurförderzeugs | |
| EP4377892A1 (de) | Verfahren zur ermittlung einer zielposition | |
| WO2022078799A1 (de) | Erkennungsverfahren zum erkennen von statischen objekten | |
| WO2023232500A1 (de) | Verfahren und steuereinrichtung zum steuern eines flurförderzeugs | |
| WO2023180202A1 (de) | Verfahren zum bestimmen einer lage eines objekts relativ zu einer erfassungseinrichtung, computerprogramm und datenträger | |
| DE102022211463A1 (de) | Computerimplementiertes Verfahren und Vorrichtung zur Bestimmung einer Klassifikation für ein Objekt | |
| EP2037407B1 (de) | Verfahren zur Objekterfassung | |
| WO2021180470A1 (de) | Verfahren zur qualitätssicherung eines beispielbasierten systems | |
| DE69606711T2 (de) | Verfahren zum erkennen von gegenständen | |
| DE102022124065A1 (de) | Verfahren zum Bestimmen eines Füllstands eines Ladungsträgers, Computerprogramm und Datenträger | |
| DE102023123114A1 (de) | Verfahren und Vorrichtung zur semantischen Segmentierung und Clutter-Erkennung | |
| WO2022096364A1 (de) | Erkennung von objekten in einer fahrzeugumgebung | |
| DE102019205039A1 (de) | Objekterkennungsvorrichtung und Objekterkennungsverfahren | |
| DE102020205535A1 (de) | Charakterisierung, Training und Anwendung von Bildklassifikatoren | |
| DE102024122058B3 (de) | Verfahren und Vorrichtung zum Erkennen zumindest einer Instanz eines Objektes während eines Arbeitsablaufs in einer Arbeitsumgebung und System zum Steuern eines Arbeitsablaufs in einer Arbeitsumgebung | |
| EP4312189B1 (de) | System zum ermitteln des abstands eines objekts | |
| DE112021007657T5 (de) | Bildverarbeitungsvorrichtung und computerlesbares speichermedium | |
| KR102837220B1 (ko) | 인공 신경망 적용 객체 감지 과정에서의 효과적인 하드웨어 사용을 위한 시스템 및 방법 | |
| DE112023005491T5 (de) | Bildverarbeitungsvorrichtung | |
| EP4672164A1 (de) | Vorrichtung, verfahren und system zum identifizieren von objekten |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20241118 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC ME MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| DAV | Request for validation of the european patent (deleted) | ||
| DAX | Request for extension of the european patent (deleted) | ||
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
| 18D | Application deemed to be withdrawn |
Effective date: 20250711 |