WO2021099149A1 - Kamerabasierte detektion von kippbewegungen - Google Patents
Kamerabasierte detektion von kippbewegungen Download PDFInfo
- Publication number
- WO2021099149A1 WO2021099149A1 PCT/EP2020/081404 EP2020081404W WO2021099149A1 WO 2021099149 A1 WO2021099149 A1 WO 2021099149A1 EP 2020081404 W EP2020081404 W EP 2020081404W WO 2021099149 A1 WO2021099149 A1 WO 2021099149A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- camera
- optical flow
- vehicle
- movement
- expected
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
- G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
- G06T7/269—Analysis of motion using gradient-based methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/765—Interface circuits between an apparatus for recording and another apparatus
- H04N5/77—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30244—Camera pose
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30248—Vehicle exterior or interior
- G06T2207/30252—Vehicle exterior; Vicinity of vehicle
Definitions
- the invention relates to a method according to claim 1 and a vehicle according to the independent device claim.
- the invention is based on the object of improving the stability of vehicles from tipping over at low speeds. This object is achieved by a method according to claim 1 and a vehicle according to the independent device claim.
- a tilting movement is a rolling movement, i.e. a turning movement around the longitudinal axis of the vehicle, or a pitching movement, i.e. a turning movement around the transverse axis of the vehicle, which causes the vehicle to become unbalanced and fall over.
- the vehicle is, for example, a wheel loader, a forklift or a dumper.
- the vehicle has a camera.
- a camera is a means of recording images of the environment on an imaging medium. It is preferably an optical camera in which visible light is imaging. The camera is fixed to the vehicle.
- the method provides that an image sequence is recorded with the camera.
- An image sequence is a sequence of at least two images.
- An optical flow is determined in the recorded image sequence. This is a vector field of the speed projected into the image plane of the camera of visible points of at least one object recorded by the camera.
- an optical flow to be expected is determined. The determination is based on a driving movement of the vehicle and a topography of the ground. A movement of the vehicle relative to the ground is referred to as driving movement.
- the topography of the subsurface is its surface texture.
- the movement of the vehicle and the topography of the ground clearly define a movement of the camera relative to objects that are stationary relative to the ground. This results in the expected optical flow of the object recorded by the camera.
- the step of determining the expected optical flow is subdivided into several sub-steps.
- the driving movement of the vehicle is determined.
- the driving movement is preferably performed while the image sequence is being recorded. averages. If necessary, the topography of the subsurface is also determined. This can be omitted if the surface is level.
- a movement of the camera relative to one or more objects recorded by the camera is clearly defined. This movement is determined in a further sub-step.
- the objects are objects that are stationary, i.e. immovable relative to the subsurface.
- the background itself can be such an object.
- the optical flow is determined which is to be expected on the basis of the determined movement of the camera.
- the sub-step of determining an optical flow to be expected due to the movement of the camera is further subdivided into sub-steps in a further preferred development.
- the object recorded by the camera is recognized in the image sequence.
- Corresponding automated or computer-implemented methods for image recognition are known to those skilled in the art from the prior art.
- neural networks or stochastic algorithms can be used for image recognition.
- an area in the image sequence is identified in which the object is imaged.
- the optical flow of this area is determined. This means that not the optical flow of the entire image area, but only the optical flow of the object in the image sequence is determined. This makes the determination more efficient and interference, for example caused by moving objects or people, is avoided.
- a corresponding optical flow of the object to be expected based on the movement of the camera is determined in the image sequence.
- the optical flow to be expected due to the movement of the camera is determined in the above-mentioned area in which the object is imaged.
- a vehicle according to the invention has at least one camera and at least one evaluation unit which implements the method according to the invention or a preferred development, ie which is designed to carry out such a method.
- FIG. 1 A preferred embodiment of the invention is shown in FIG. 1 in detail shows:
- the vehicle 101 shown in FIG. 1 has a camera 103 and an evaluation unit 105.
- the camera 103 is connected to the evaluation unit 105 in a signal-conducting manner.
- An object 107 is located in the image area of the camera 103, i.e. in an area recorded by the camera 103.
- the evaluation unit 105 determines an optical flow of the object 107 in an image sequence recorded by the camera 103.
- the evaluation unit 105 also detects a travel movement of the vehicle 101. This results in an expected optical flow of the object 107, which the evaluation unit 105 compares with the actual optical flow. If there are deviations, this suggests a tilting movement of the vehicle 101. In this case, the evaluation unit 105 initiates countermeasures to stabilize the vehicle 101.
Abstract
Description
Claims
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/778,186 US20220414893A1 (en) | 2019-11-21 | 2020-11-09 | Camera-based detection of tilting movements |
EP20803815.8A EP4062370A1 (de) | 2019-11-21 | 2020-11-09 | Kamerabasierte detektion von kippbewegungen |
JP2022529749A JP2023503915A (ja) | 2019-11-21 | 2020-11-09 | カメラに基づく傾斜運動の検知 |
CN202080078080.6A CN114651278A (zh) | 2019-11-21 | 2020-11-09 | 基于摄像机的倾翻运动探测 |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102019217988.6 | 2019-11-21 | ||
DE102019217988.6A DE102019217988A1 (de) | 2019-11-21 | 2019-11-21 | Kamerabasierte Detektion von Kippbewegungen |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2021099149A1 true WO2021099149A1 (de) | 2021-05-27 |
Family
ID=73198317
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/EP2020/081404 WO2021099149A1 (de) | 2019-11-21 | 2020-11-09 | Kamerabasierte detektion von kippbewegungen |
Country Status (6)
Country | Link |
---|---|
US (1) | US20220414893A1 (de) |
EP (1) | EP4062370A1 (de) |
JP (1) | JP2023503915A (de) |
CN (1) | CN114651278A (de) |
DE (1) | DE102019217988A1 (de) |
WO (1) | WO2021099149A1 (de) |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102011055795A1 (de) * | 2011-11-29 | 2013-05-29 | Continental Automotive Gmbh | Verfahren zur Ermittlung eines drohenden Überschlags eines Fahrzeugs |
DE102012110082A1 (de) * | 2012-10-23 | 2014-04-24 | Continental Automotive Gmbh | Verfahren zum Steuern von Sicherheitseinrichtungen eines Kraftfahrzeugs im Falle einer Böschungsfahrt |
DE102016209900A1 (de) * | 2016-06-06 | 2017-12-07 | Robert Bosch Gmbh | Verfahren und Vorrichtung zum Erkennen eines seitlichen Kippens eines Fahrzeugs und Fahrzeug |
US20190206060A1 (en) * | 2017-12-28 | 2019-07-04 | Denso Ten Limited | Abnormality detection device and abnormality detection method |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE19918597C2 (de) * | 1999-04-23 | 2001-03-08 | Deutsch Zentr Luft & Raumfahrt | Verfahren zur Reduktion der Kippgefahr von Straßenfahrzeugen |
DE10326190A1 (de) * | 2003-06-06 | 2004-12-30 | Daimlerchrysler Ag | Vorrichtung und Verfahren zur Ermittlung einer räumlichen Ausrichtung eines Auflegers oder Anhängers |
DE102014007900A1 (de) * | 2014-05-27 | 2015-12-03 | Man Truck & Bus Ag | Verfahren und Fahrerassistenzsystem zur Ermittlung fahrdynamischer Zustände eines Nutzfahrzeugs |
DE102018102287A1 (de) * | 2018-02-01 | 2019-08-01 | Sick Ag | Optoelektronische Sensorvorrichtung |
-
2019
- 2019-11-21 DE DE102019217988.6A patent/DE102019217988A1/de active Pending
-
2020
- 2020-11-09 CN CN202080078080.6A patent/CN114651278A/zh active Pending
- 2020-11-09 JP JP2022529749A patent/JP2023503915A/ja active Pending
- 2020-11-09 WO PCT/EP2020/081404 patent/WO2021099149A1/de unknown
- 2020-11-09 EP EP20803815.8A patent/EP4062370A1/de active Pending
- 2020-11-09 US US17/778,186 patent/US20220414893A1/en active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102011055795A1 (de) * | 2011-11-29 | 2013-05-29 | Continental Automotive Gmbh | Verfahren zur Ermittlung eines drohenden Überschlags eines Fahrzeugs |
DE102012110082A1 (de) * | 2012-10-23 | 2014-04-24 | Continental Automotive Gmbh | Verfahren zum Steuern von Sicherheitseinrichtungen eines Kraftfahrzeugs im Falle einer Böschungsfahrt |
DE102016209900A1 (de) * | 2016-06-06 | 2017-12-07 | Robert Bosch Gmbh | Verfahren und Vorrichtung zum Erkennen eines seitlichen Kippens eines Fahrzeugs und Fahrzeug |
US20190206060A1 (en) * | 2017-12-28 | 2019-07-04 | Denso Ten Limited | Abnormality detection device and abnormality detection method |
Non-Patent Citations (1)
Title |
---|
LU LOU ET AL: "Vision-Aided IMU Estimation of Attitude and Orientation for a Driverless Car", 20 August 2012, ADVANCES IN AUTONOMOUS ROBOTICS, SPRINGER BERLIN HEIDELBERG, BERLIN, HEIDELBERG, PAGE(S) 465 - 466, ISBN: 978-3-642-32526-7, XP047012014 * |
Also Published As
Publication number | Publication date |
---|---|
EP4062370A1 (de) | 2022-09-28 |
US20220414893A1 (en) | 2022-12-29 |
JP2023503915A (ja) | 2023-02-01 |
CN114651278A (zh) | 2022-06-21 |
DE102019217988A1 (de) | 2021-05-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1593552B1 (de) | Überwachung eines PKW-Anhängers mit einer Rückfahrkamera | |
DE102009015142B4 (de) | Fahrzeugumgebungs-Erkennungs-Vorrichtung und Steuerungssystem zum Verfolgen eines vorausfahrenden Fahrzeugs | |
DE60117348T2 (de) | Fahrspur-Erkennungsvorrichtung für Fahrzeuge | |
DE102014221144A1 (de) | Zielerfassungsvorrichtung | |
WO2002048648A1 (de) | Messeinrichtung zur berührungslosen messung von reifen | |
EP3727936B1 (de) | Verfahren zum erkennen von zumindest einem an einem kraftfahrzeug anliegenden objekt sowie steuervorrichtung und kraftfahrzeug | |
WO2014108561A1 (de) | Verfahren und vorrichtung zum überwachen eines umfelds eines fahrzeugs und verfahren zum durchführen einer notbremsung | |
DE102014007900A1 (de) | Verfahren und Fahrerassistenzsystem zur Ermittlung fahrdynamischer Zustände eines Nutzfahrzeugs | |
DE102008001363A1 (de) | Verfahren zum Erfassen einer Parkfläche unter Verwendung eines Entfernungssensors | |
DE102016100030A1 (de) | Gerät zum sicheren führen eines fahrzeugs | |
WO2002048670A2 (de) | Vorrichtung und verfahren zur qualitätsüberprüfung eines körpers | |
DE102019206875B3 (de) | Erkennen einer Bankettfahrt eines Kraftfahrzeugs | |
DE102010039949A1 (de) | Verfahren zur Erkennung fehlender Fahreraktivität am Lenkrad eines Kraftfahrzeugs | |
DE102021116703A1 (de) | Verfahren und System zur Vorhersage einer Trajektorie eines Zielfahrzeugs in einer Umgebung eines Fahrzeugs | |
WO2021151412A1 (de) | Vorrichtung und verfahren zur automatischen erkennung von beschädigungen an fahrzeugen | |
EP3193276B1 (de) | Erfassungsvorrichtung und verfahren zum erkennen von fahrzeugachsen | |
WO2020201217A1 (de) | Verfahren und vorrichtung zur bestimmung von verformungen an einem objekt | |
WO2021099149A1 (de) | Kamerabasierte detektion von kippbewegungen | |
DE102015111613A1 (de) | Verfahren zur Hinderniserfassung bei einem Flurförderzeug | |
DE102021203671B4 (de) | Verfahren zur Zustandsüberwachung eines Hubwagens eines Staplerfahrzeugs | |
DE102019209463A1 (de) | Verfahren zur Bestimmung eines Vertrauenswertes eines Objektes einer Klasse | |
EP3646237A1 (de) | Verfahren und vorrichtung zum bestimmen einer beschaffenheit einer oberfläche in der umgebung eines fahrzeugs | |
WO2021110486A1 (de) | Verfahren zur beurteilung der qualität lackierter holzoberflächen | |
DE102020006720A1 (de) | Verfahren zur Lokalisierung einer Silhouette eines Fahrzeuggespanns in von einer Fahrzeugaußenkamera erzeugten Kamerabildern und Fahrzeug | |
DE102018103060B3 (de) | Verfahren zur Lageschätzung einer Wand und zum Aktivieren einer aktiven Triangulation eines Matrixscheinwerfersystems eines Kraftfahrzeugs |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20803815 Country of ref document: EP Kind code of ref document: A1 |
|
REG | Reference to national code |
Ref country code: BR Ref legal event code: B01A Ref document number: 112022006499 Country of ref document: BR |
|
ENP | Entry into the national phase |
Ref document number: 2022529749 Country of ref document: JP Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 2020803815 Country of ref document: EP Effective date: 20220621 |
|
ENP | Entry into the national phase |
Ref document number: 112022006499 Country of ref document: BR Kind code of ref document: A2 Effective date: 20220404 |