EP4348175A1 - Flurförderzeug mit einer optischen überwachungseinrichtung - Google Patents
Flurförderzeug mit einer optischen überwachungseinrichtungInfo
- Publication number
- EP4348175A1 EP4348175A1 EP22730781.6A EP22730781A EP4348175A1 EP 4348175 A1 EP4348175 A1 EP 4348175A1 EP 22730781 A EP22730781 A EP 22730781A EP 4348175 A1 EP4348175 A1 EP 4348175A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- pattern
- industrial truck
- camera
- projector
- cameras
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
- G01B11/25—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object
- G01B11/2545—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object with one projection direction and several detection directions, e.g. stereo
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
- G01B11/25—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object
- G01B11/2513—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object with several lines being projected in more than one direction, e.g. grids, patterns
Definitions
- the present invention relates to an industrial truck with an optical monitoring device.
- the optical monitoring device can fulfill a large number of different tasks, for example supporting the positioning of the vehicle relative to a load or a shelf or detecting an obstacle or the like. It is important for the optical surveillance device that three-dimensional data can be obtained in a reliable form.
- a known pattern can be projected onto the target object to obtain 3D data with just one camera.
- the pattern can consist of lines, circles, dots or other pattern elements.
- the light with such patterns is also referred to as coded light. Due to the height differences on the target object, the projected pattern is deformed, especially at edges. This distortion can be used to calculate differences in height if the pattern elements can be assigned to the original pattern.
- lines for example, a principle similar to a barcode is used to ensure that the projected line is unambiguous.
- lines allow good edge detection on the target object, since the lines change their orientation at the edges.
- points these can be identified in space, for example via correlations to neighboring points.
- Adding a second camera at a known location provides two additional benefits. On the one hand, the second camera can capture hidden lines from a different angle, which the first camera cannot evaluate. On the other hand, the stereoscopic view of the object can provide additional information about its three-dimensionality.
- the object of the invention is to provide an industrial truck with an optical monitoring device that reliably detects objects and objects in a warehouse environment using simple means.
- the industrial truck according to the invention is equipped with a monitoring device that has at least one projector and at least one camera.
- the projector emits a pattern consisting of a large number of pattern elements.
- the image of the pattern on an object is captured and evaluated by the at least one camera.
- the pattern with its pattern elements is preferably oriented in such a way that as many pattern elements as possible meet with horizontal and vertical edges.
- the meeting of one of the pattern elements with a horizontal or vertical edge results in a clear change in the projected pattern element, which can be well evaluated by the camera.
- the solution according to the invention for aligning the optical monitoring device is based on the knowledge that industrial trucks are generally confronted with vertical and horizontal edges in their environment. As such, it is possible to choose an orientation for the projected pattern where many pattern elements with horizontal and vertical edges meet.
- the invention it is provided that more pattern elements meet with horizontal and vertical edges than in a regular orientation, ie a horizontal or vertical orientation. It is therefore sought that an at least local maximum for the coincidence of the pattern elements with the edges can be achieved if there is no regular orientation.
- the invention is based on the finding that vertical and horizontal edges are predominantly provided in a storage environment. It is therefore possible to generally find an orientation that deviates from the regular orientation, in which as many pattern elements as possible encounter vertical or horizontal edges.
- the optical monitoring device has two cameras, which are aimed at a common image area into which the pattern is projected.
- the two cameras allow a stereoscopic view of the object and of the projected pattern on the object.
- the two cameras are inclined towards one another in such a way that epipolar lines run inclined to vertical and/or horizontal edges in the image.
- the epipolar line is the line that runs in an image plane between the epipolar pole and the corresponding pixel.
- the points on an epipolar line correspond to a series of object points that cannot be resolved on the corresponding other image plane, but lie on a ray pointing to the camera center of the other camera.
- pixel points are encoded among one another and the change in position of the pixel points relative to one another can be detected.
- Figure 1 is a top view of an industrial truck with two cameras and a projector on the back of the fork carriage
- Figure 2 shows an industrial truck viewed from above with two cameras and a projector arranged adjacent to one another on one side of the back of the fork
- FIG. 3 an industrial truck viewed from above with two cameras and a projector in the fork tips
- FIG. 4 shows a schematic view of the use of coded light with two cameras
- FIG. 5 shows a basic view for detecting a strip using a camera
- Figure 6 shows the projection onto a pallet carrier with strips
- FIG. 7 the reconstruction of the epipolar lines in a stereo view.
- FIG. 1 shows an industrial truck 10 in a schematic view from above.
- the truck has two wheel arms 12, 14, between which a fork carriage 16 is arranged.
- the fork carriage 16 has a load fork 18, 20 and a fork back 22.
- the fork carriage 16 is moved between the wheel arms in height.
- the force for raising and lowering the fork carriage 16 acts on the rear wall 22 of the fork.
- a camera 24, 26 is arranged on the outside.
- Each of the cameras 24, 26 has a field of view 28 or 30 which is directed towards an object 32 in the situation shown.
- a projector 36 with its projection field 38 is arranged centrally between the cameras 24 , 26 .
- FIG. 2 shows a slightly modified arrangement for the projector and camera.
- the cameras 26', 24' are arranged on one side of the back of the fork 22.
- the projector 36' is arranged between the cameras 24' and 26'.
- the projector 36' can also be arranged at any other point in the fork rear wall 22. Due to the adjacent arrangement of the cameras 24' and 26', the viewing angle of both cameras onto the object 32 is of a similar size. On the other hand, the lateral arrangement of both cameras allows a view of the object 32, which cannot be covered so quickly by a load that has been picked up. In particular in the case of a centrally arranged projector 36 there is a risk that a high load taken up centrally will cover it.
- Figure 3 shows an arrangement of the cameras 24" and 26" in the tip of the load arm. This will prevent a picked up load from blocking the view of the cameras with special needs. There is also the advantage that the cameras 24′′ and 26′′ come closer to the object 32 to be captured.
- the projector 36'' for the coded light is attached to a fork carriage together with the camera.
- the projector can also be installed at a different location if, for example, there is not enough space in the tip of a support arm for the camera and projector.
- FIG. 4 shows a schematic view of the measurement with coded light.
- the projector 36 projects a pattern 38 consisting of parallel lines 40 .
- the lines 40 from the pattern 38 also meet a cuboid object 42.
- the projected lines 40 change their course on the cuboid object 42.
- the two cameras 24 and 26 record an image of the projected pattern.
- the images differ in that the object 42 has sides facing away from the cameras and can also cover part of the background.
- FIG. 5 shows a single laser 44 which projects a strip 46 onto a background 48 .
- An image 50 is recorded by a camera. It can be clearly seen that the projected strip in the image has a paragraph that carries information about the nature of the subsurface 48 .
- the light from the laser 44 is used as a light source via a corresponding optical element to form a strip.
- the projecting laser 44 and the image from the camera 50 are shown in one housing. This is a possible refinement, but by no means required. In principle, the projector and camera can be mounted on the industrial truck independently of one another.
- FIG. 6 shows how an inclined pattern 38 is projected onto a pallet carrier 54.
- the pallet carrier 54 mainly consists of vertical and horizontal edges. With the sloping pattern 38, none of the lines 40 included in the pattern run along or parallel a vertical or horizontal edge. There is always an intersection between the projected line and the edge, which contains optically evaluated spatial information about the pallet carrier.
- FIG. 7 also shows a pallet carrier 54, but this time the epipolar lines resulting from a stereometric view of the pallet carrier. With an inclined arrangement of the cameras, relative to the pallet carrier 54, the epipolar lines 56 also run obliquely inclined.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| DE102021114067.6A DE102021114067A1 (de) | 2021-05-31 | 2021-05-31 | Flurförderzeug mit einer optischen Überwachungseinrichtung |
| PCT/EP2022/064124 WO2022253652A1 (de) | 2021-05-31 | 2022-05-24 | Flurförderzeug mit einer optischen überwachungseinrichtung |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| EP4348175A1 true EP4348175A1 (de) | 2024-04-10 |
Family
ID=82067808
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP22730781.6A Pending EP4348175A1 (de) | 2021-05-31 | 2022-05-24 | Flurförderzeug mit einer optischen überwachungseinrichtung |
Country Status (3)
| Country | Link |
|---|---|
| EP (1) | EP4348175A1 (de) |
| DE (1) | DE102021114067A1 (de) |
| WO (1) | WO2022253652A1 (de) |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE10336085A1 (de) * | 2003-08-06 | 2005-03-10 | Siemens Ag | Bestimmung der Postion eines Transportgutes durch Kombination lokaler, absoluter Positionsmessung und relativer Positionsmessung |
| DE10358544A1 (de) * | 2003-12-15 | 2005-07-14 | Daimlerchrysler Ag | Verfahren zur schnellen 3D-Objekterfassung |
| US7620209B2 (en) * | 2004-10-14 | 2009-11-17 | Stevick Glen R | Method and apparatus for dynamic space-time imaging system |
| DE102005009606A1 (de) | 2005-02-28 | 2006-08-31 | Isra Vision Systems Ag | Sensoranordnung |
| DE102008020326B3 (de) | 2008-04-23 | 2009-09-03 | Sick Ag | Stereoskopisches 3D-Kamerasystem zur Überwachung eines Raumbereichs |
| DE102008001629A1 (de) | 2008-05-07 | 2009-11-12 | Robert Bosch Gmbh | Projektionsmittel umfassende Vorrichtung |
| DE102013002554A1 (de) | 2013-02-15 | 2014-08-21 | Jungheinrich Aktiengesellschaft | Verfahren zur Erkennung von Objekten in einem Lager und/oder zur räumlichen Orientierung in einem Lager |
| US9694498B2 (en) * | 2015-03-30 | 2017-07-04 | X Development Llc | Imager for detecting visual light and projected patterns |
| EP3309505A4 (de) | 2015-06-11 | 2018-04-25 | Panasonic Intellectual Property Management Co., Ltd. | Dimensionsvermessungsvorrichtung und dimensionsvermessungsverfahren |
| DE102016120386A1 (de) | 2016-10-26 | 2018-04-26 | Jungheinrich Aktiengesellschaft | Verfahren zum Erkennen von Objekten in einem Lager und Flurförderzeug mit einer Einrichtung zum Erkennen von Objekten in einem Lager |
| DE102019123647A1 (de) * | 2019-09-04 | 2021-03-04 | Still Gesellschaft Mit Beschränkter Haftung | Verfahren zur Lokalisierung eines Fahrzeugs sowie Fahrzeug zur Durchführung des Verfahrens |
-
2021
- 2021-05-31 DE DE102021114067.6A patent/DE102021114067A1/de active Pending
-
2022
- 2022-05-24 EP EP22730781.6A patent/EP4348175A1/de active Pending
- 2022-05-24 WO PCT/EP2022/064124 patent/WO2022253652A1/de not_active Ceased
Also Published As
| Publication number | Publication date |
|---|---|
| DE102021114067A1 (de) | 2022-12-01 |
| WO2022253652A1 (de) | 2022-12-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| DE69826753T2 (de) | Optischer Profilsensor | |
| EP3316181B1 (de) | Verfahren zum erkennen von objekten in einem lager und flurförderzeug mit einer einrichtung zum erkennen von objekten in einem lager | |
| DE102014013677B4 (de) | Verfahren zum optischen Abtasten und Vermessen einer Umgebung mit einem Handscanner und unterteiltem Display | |
| EP2767925B1 (de) | Verfahren zur Erkennung von Objekten in einem Lager und/oder zur räumlichen Orientierung in einem Lager | |
| WO2004103882A1 (de) | Bewegliche sensoreinrichtung am lastmittel eines gabelstaplers | |
| DE112007001977T5 (de) | Verfahren zur Generierung dreidimensionaler Modelldaten und Vorrichtung zur Generierung dreidimensionaler Modelldaten | |
| DE10026201A1 (de) | Vorrichtung für die Bestimmung der Position eines Gegenstandes in einem OXZ-Bezugssystem | |
| DE102021201369A1 (de) | Verfahren und System zur Bestimmung einer Okklusion bzw. Verdeckung innerhalb eines Kamerasichtfelds | |
| EP2856755B1 (de) | Vorrichtung und verfahren zur aufnahme von bildern eines fahrzeugunterbodens | |
| EP3403404B1 (de) | Stereobilderfassungssystem | |
| DE102017116758B4 (de) | Verfahren und Vorrichtung zum Abtasten von Oberflächen mit einer Stereokamera | |
| EP3981731B1 (de) | Verfahren zur bestimmung von abstandswerten zu einem flurförderzeug sowie ein solches | |
| EP2715279A1 (de) | Vorrichtung und verfahren zur fahrwerksvermessung eines kraftfahrzeugs | |
| EP2865987A1 (de) | Verfahren und Scanner zum berührungslosen Ermitteln der Position und dreidimensionalen Form von Produkten auf einer laufenden Fläche | |
| EP4204762B1 (de) | Messtafel zur fahrzeugvermessung | |
| DE102012023623A1 (de) | Verfahren zum Zusammensetzen von Teilaufnahmen einer Oberfläche eines Objektes zu einer Gesamtaufnahme des Objektes und System zum Erstellen einer Gesamtaufnahme eines Objektes | |
| DE10040981A1 (de) | Verfahren und Vorrichtung zur Ermittlung der Lage eines Flächen und Kanten aufweisenden Gegenstandes sowie Positioniereinrichtung | |
| EP1022541A2 (de) | Verfahren und Vorrichtung zur Bestimmung der Geometrie von blattförmigem Gut oder Stapeln davon | |
| EP4348175A1 (de) | Flurförderzeug mit einer optischen überwachungseinrichtung | |
| DE102015106837B4 (de) | Verfahren zur Steuerung einer 3D-Messvorrichtung mittels Gesten und Vorrichtung hierzu | |
| DE10112732C2 (de) | Verfahren zur Bestimmung der Lage von Meßbildern eines Objektes relativ zum Objekt | |
| DE10332161B4 (de) | Kalibrationskörper und Kalibrationsverfahren für ein Kamerasystem | |
| WO2015043978A1 (de) | Fahrwerksvermessung bei umgebungslicht | |
| EP1586070B1 (de) | Verfahren und vorrichtung zur identifikation und kompensation einer perspektivischen verzerrung | |
| EP4095798B1 (de) | Verfahren zur erfassung der dreidimensionalen struktur eines gegenstands |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20231228 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| DAV | Request for validation of the european patent (deleted) | ||
| DAX | Request for extension of the european patent (deleted) | ||
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
| 17Q | First examination report despatched |
Effective date: 20250516 |