WO2017178019A1

WO2017178019A1 - Method and device for supporting an operator after a fueling or charging process of a vehicle

Info

Publication number: WO2017178019A1
Application number: PCT/DE2017/200026
Authority: WO
Inventors: Wolfgang Fey
Original assignee: Conti Temic Microelectronic Gmbh
Priority date: 2016-04-15
Filing date: 2017-03-23
Publication date: 2017-10-19
Also published as: DE102016206411B4; DE102016206411A1

Abstract

The invention relates to a method and a corresponding device for supporting a vehicle operator after a fueling or charging process of a vehicle, wherein (S103, S203) an image of a fueling or charging device of the vehicle is captured using at least one camera system of the vehicle; (S204) a state of a closure of the fueling or charging device is ascertained using the at least one image or (S104) a determination is made as to whether a fueling or charging means is arranged in the fueling or charging device of the vehicle using the at least one image; and (S106, S206) based thereon, an indication is output or the continued travel of the vehicle is prevented.

Description

title

METHOD AND DEVICE FOR SUPPORTING AN OPERATOR AFTER A TANK CHARGING OR LOADING A VEHICLE

description

The invention relates to a method and korrespondie ^¬ Rende apparatus for assisting an operator to EVENT OF A tank or charging of a vehicle.

Both the refueling of fuel-powered vehicles, such as gasoline, diesel and natural gas vehicles, as well as recharging powered by electric power vehicles - also called electric vehicles - require manual operations by an operator, for example by the Fahrzeugfüh ^¬ rer, another vehicle ^occupant or a gas station attendant.

Systems are already known from the prior art, which should support the driver during a tank or charging his vehicle.

The DE 10 2012 215 354 Al discloses in this connection, a method for operating a vehicle in which a decision fernung is determined to a tank device, the inserted ^¬ directed to provide fuel for the vehicle. From ^¬ pending from a below a predetermined Entfer ^¬ nungsschwellwertes from the tank means a tank cap of the vehicle is automatically unlocked.

EP 2 949 620 A1 discloses a method for detecting ei ^¬ ner misfuelling of a vehicle, wherein by means of a Bil ^¬ capture device an image of a nozzle - handling ^¬ linguistically called fuel nozzle - near a Tankde- or tank filler neck detected and in the image at least one characteristic of the dispensing valve is determined, which indicates the type of fuel that is discharged from the dispensing valve. ben will. Then, it is determined whether the output from the fuel dispensing valve is compatible with the vehicle and generates a warning if the fuel with the driving ^¬ imaging is incompatible.

The present invention is based on the recognized problem that with each tank or landing process there is a risk that the respective operator forgets, in particular after completion of a tank or charging process, the nozzle from the filler neck or the charging plug from the Ladesteckdo ^¬ to remove the vehicle.

Also forget operator frequently to close the shutter of the tank ^¬ nozzle and / or the filler cap or the cover of the charging outlet.

In the former cases, when the vehicle is moved despite the still inserted dispensing valve or charging plug, it sometimes leads to significant damage to the vehicle and / or at the tank or charging station.

With an open closure of the fuel filler neck or with an open tank lid fuel can escape from the tank of the vehicle while driving. The Sun on the roadway corresponds standing fuel traces represent a considerable threat to the environment and other road users, insbesonde ^¬ re for cyclists.

The invention has for its object to provide a solution to the above problems.

The object is solved by the features of the independent claims. Advantageous embodiments are characterized in the sub ^¬ claims.

The invention includes a method for assisting an operator after a tank or a charging operation of a vehicle. When the operator is preferably around the driving ^¬ imaging guide of the vehicle. The operator may yet also be a different person per ^¬, for example, another passenger or a gas station attendant.

In particular, the method is used to assist a refueling operation of a fuel-powered vehicle and to assist a charging operation of an electric vehicle. Similarly, the process but also serves to support a load and / or refueling of a hybrid vehicle, defined as vehicles with more than one fuel and / or with egg ^¬ ner combination of at least one fuel and

electrical energy to be operated.

The term fuel any type of liquid, gaseous or solid fuels used for combustion in an internal combustion engine of a vehicle ^¬ falls.

According to a first aspect of the invention, a method is provided in which at least one image of a tank or charging device of the vehicle is detected by means of a camera system of the vehicle, and it is determined on the basis of the at least one image, whether a tank or loading means in the

Tank or charging device of the vehicle is arranged. ^{According to the} invention, an output of an indication and / or an inhibition of a continuation of travel of the vehicle take place when a tank or loading means in the tank or loading device has been determined.

According to a second aspect of the invention, a method is provided in which at least one image of a tank or charging device of the vehicle is detected by means of a camera system of the vehicle, and wherein a state of ^{closure of} the tank or charging device of the vehicle based on the at least one Image is determined. According to the invention carried out an output of a reference and / or a Unterbin ^¬ dung a further travel of the vehicle, when a state "Of ^¬ fen" was determined of the closure. By means of the first and the second aspect of the invention ^shown SEN method, as well as by means of the corresponding Vorrich ^¬ tung , it is ensured that the operator of the vehicle, in which the method or the device is used, at least receives an indication or even prevented from driving on with the vehicle, when a tank ^¬ or loading means in the tank or Charging device of the vehicle ^{¬ is} driving or if a closure of the tank device is open, in particular after completion of a refueling operation by the operator.

Hereinafter, preferred embodiments for both the first and the second aspect of the invention be ^{¬ written} . According to a first preferred embodiment of the method according ^¬ this invention includes the recognition of Fahrzeu ^¬ ginbetriebnahme. In particular take place at this Ausgestal ^¬ tung detecting the at least one image, determining on the basis of at least one image and the output of the reciprocating character and / or the prevention of the further drive when a vehicle start-up was only or not be recognized. In other words, according to this embodiment of the invention it is ^¬ checked at each startup of the vehicle by means of the method according to the invention, whether a tank or littel means in the tank or charging device of the vehicle is ordered to ^¬ or which state of the closure of Tank ^¬ or charging device of the vehicle has.

According to a further preferred embodiment of the method according to the invention, this comprises recognizing a

Tank and / or charging of the vehicle. In particular, he ^{/ she} follows the capture of the at least one image, which On the basis of the at least one image and the output of the hint and / or the inhibition of driving on only or only then when a refueling or charging was detected. Un ^¬ ter the detection of a tank or charging falls in particular the recognition that currently a charge or tank ^¬ process takes place, or the recognition that a tank or load operation has been made or has been completed, as example ^¬ since the last Commissioning the vehicle. According to a further preferred embodiment of the OF INVENTION ^¬ to the invention method, the detection of at least ei ^¬ nes image and / or the determination on the basis of at least ei ^¬ NEN image is performed cyclically, in particular to a condition for loading ^¬ end of the process, that is, a program end condition, a - occurs. According to this embodiment, therefore, are continuous

Images of the tank or charging means detects and determines in the ER framed images, whether in a tank or charging means is arranged or which state has a closure of the tank ^¬ or charging device.

The invention further relates to a device for a vehicle for implementing a method according to any one of the embodiments above-described ^¬. The device preferably comprises at least one or more cameras as a camera system for capturing at least one image of a

Tank or charging device of the vehicle and at least ei ^¬ ne evaluation. The evaluation unit is designed for determining from the at least one image according to the first ^¬ As pect of the present process, whether a tank or laser DEMITTEL in the tank or charging device of the vehicle is at ^¬ sorted, and / or for determining a condition of a closure of the tank or from the charging device Wenig ^¬ least one image according to the second aspect of the invention ^shown SEN method, and outputting at least one signal depending on the result of the determination. The means for detecting a vehicle start-up, to detect a tank or charging and / or for the output of a reference and for prohibiting further travel of the vehicle, need not necessarily be part of the device according to Inventive ^¬. Alternatively, the evaluation unit can receive corresponding information from other systems of the vehicle via corresponding signal inputs and / or provide other systems in the vehicle, which serve to output the indication and / or suppress the Wei ^¬ terfahrt the vehicle with appropriate signals ver ^¬ via appropriate signal outputs ,

Hereinafter, possible embodiments of the method according to the invention will be explained in greater detail with reference to the accompanying drawings.

Show it:

FIG. 1 is a flowchart for illustrating a

Embodiment relating to the first aspect of the method according to the invention

FIG. 2 is a flow chart for illustrating a

Embodiment concerning the second ace ^¬ pect of the inventive method

1 shows a flow chart of an exemplary embodiment according to the first aspect of the method according to the invention.

1, a program that runs according to the first aspect of the method according to the invention is started in a step S101, in which a start-up of the vehicle was detected. Under vehicle commissioning, for example, the detection of a door unlocking, a switch the ignition and or a start of the engine or electric drive are understood.

In a subsequent step S102 it is checked whether there is a tanking or charging of the vehicle. Under tank ^¬ or charging can be understood both a momentarily occurring tank or charging, ie when the Fahr ^¬ zeug fueled or loaded at the moment, as well as a completed tank or charging, in particular between a decommissioning, in particular the directly vorhergan ^¬ genes Decommissioning, and commissioning the Fahr ^¬ zeugs, in particular and the current recognized commissioning ^¬ me. If it is determined in step S102 that no tank or load ^¬ process exists ( "No), the program ends (" End ")

If it is determined in step S102 that a tank or charging ^¬ process is present ( "Yes"), an image of a tank or charger of the vehicle is detected with ^¬ means of a camera system of the vehicle in the subsequent step S103.

In the tank device may be any of the vehicle at ^¬ subordinate apparatus that is used to refuel the vehicle with fuel. Preferably, it is a filler neck, which is usually provided with a removable screw cap and / or a movable tank lid as Ver ^¬ circuit. In the charging device may be any of the vehicle at ^¬ subordinate apparatus that is used to load the vehicle with electrical energy. Preferably, it is a charging socket, which is usually provided with a removable or movable lid as a closure.

The camera system preferably comprises at least one camera arranged on the vehicle, which in such a way can be used in exterior or interior is arranged and aligned that the tank or charging device is located in the detection range of the camera. Preferably, in the camera system to Wenig ^¬ least one camera of a mirror replacement or SurroundView Kame ^¬ rasystems of the vehicle, so that an already for other Zwe ^¬ bridge, in particular for implementation of other so-called Fahreras ^¬ sistenzfunktionen, used camera of a camera-based driver assistance system in an advantageous , for the imple ^¬ wetting of the inventive method is used and no separate camera arranged in the vehicle on or ^¬ the must so ^¬ with. S104 whether a tank or charging means in the tank or La ^¬ signaling device is determined based on the captured image Then, in step, the vehicle is arranged.

Tank means is a device, in particular a nozzle, which can be arranged in the tank device and which is connected via a line, in particular a hose, to a power station, in particular a dispenser. Under charging means, an apparatus is understood insbeson ^¬ particular a charging plug, which can be placed in the charging device and which is connected via a line, in particular a Ka ^¬ bel with a charging station. The determination in the captured image, whether a tank or a

Charging means in the tank or in the charging device of Fahr ^¬ stuff is preferably carried out by means of known image processing methods for object detection, ^{beispielswei ¬} se means of pattern recognition or pattern matching method, and in particular by means of image processing methods already in other camera-based driver assistance systems are used, for example in the introductory ^¬ th methods and devices.

If in step S104 in the image of the camera system, no tank or loading means, which is arranged in the tank or charging device of the vehicle, determined ("No"), the program proceeds to step S105, in which it is checked whether a program end -Bedingung present. the detection and / or determination, in accordance with both the first and of the second aspect of the invention, for a certain period of time from the program start, he ^¬ follow at ^¬ play until a defined rate from Fahrzeuginbe ^¬ sioning is reached or until a defined distance has been covered from the vehicle start-up. If there is a pro ^¬ gram end condition or has a Programmende- condition reached ( "Yes"), the program ends ( "end"). If there is no program end condition, the program ^¬ goes Return to step S103 and continue there.

Is determined in step S104 in the image of the camera system, that a tank or charging means is disposed in the tank or Ladeeinrich ^¬ processing of the vehicle ( "Yes"), the program proceeds to step S106.

In step S106, an indication is issued

and / or an inhibition of continuing the journey of the vehicle. The output of the instruction can be carried out in particular acoustic, op ^¬ table or haptic, preferably via corresponding known output means inside the vehicle, eg According ^¬ speaker or the instrument display in the dashboard. The inhibition of onward travel can be done for example by preventing an engine start or by preventing ei ^¬ nes leaving a parking position of the transmission, especially in vehicles with an automatic transmission. According to the example shown in Fig. 1 embodiment, the program according to the output of a reference and / or after Un ^¬ terbinden continuing the trip terminated ( "end"). Thus, when a new attempt would commissioning of the vehicle, the program again with step S101 begin and accordingly checks whether a tank or loading means is further arranged in the tank or landing gear of the vehicle Al ^¬ ternative to the embodiment shown in Fig. 1, the program could also be continued until it was detected on the basis of the images of the camera system that no tank or charging means is disposed more in the tank or charger of the driving ^¬ zeugs and then a terminating the indication and / or terminating the ligation of the further drive SUC ^¬ gene. It could also connect an additional program to the step S106 ,

FIG. 2 shows a flow chart of an exemplary embodiment according to the second aspect of the method according to the invention.

The steps S201, S203 and S204 correspond to the We ^¬ sentlichen steps S101, S103 and S104 of the execution ^¬ example according to Fig. 1. In contrast to the embodiment of Fig. 1 is performed in which, in case of Fig. 2, no determination ( S102), whether there is a tanking or charging of the vehicle. Regardless because of ^¬ could also be provided between steps S201 and S203, this step.

In step S204 of the embodiment according to FIG. 2, a state of a closure of the tank or charging device of the vehicle is determined, ie on the basis of the image of the tank or charging device of the vehicle detected by the camera system in step S203. The closure of a loading or tank device is usually a screw cap and / or egg ^¬ nen movable or hinged lid. The state is preferably determined by means of known image processing methods for object recognition, for example by means of

Pattern recognition or pattern matching method, as in the known and initially described methods and Vorrich ^¬ lines. Has been determined in step S204 on the basis of the image, that the closure of the tank or loader in a ge ^¬ closed state ( "Close"), the Pro ^¬ program is terminated ( "end"). On the other hand, if it has been determined in step S204 from the image that the shutter of the vehicle's charging device is in an open state ("open"), the program proceeds to step S206, in which, analogously to FIG

Step S106 of the embodiment of FIG. 1, the output of an indication and / or the inhibition of onward travel takes place.

Among the detection of a state "open" while in particular ^¬ sondere falls detecting an opened lid of the tank or charging device of the vehicle. Furthermore, falls below the "open" state in particular, the case that a ^circuit-¬ Ver the tank or Charging device has not been detected, ie that the closure is not arranged in the tank or Ladeeinrich ^¬ tion.

The inventive method, especially the steps S104 and S204 are preferably performed on a vehicle in at ^¬ parent evaluation unit which can equally be part of the inventive device. In the evaluation unit can, for example, be a STEU ^¬ ergerät which is connected to the camera system, and includes image processing means for processing the images captured by the camera system. The control unit may further comprise at least one output for outputting a signal to other devices in the vehicle, ginsassen into ^¬ particular to issue appropriate signals to devices to issue instructions to the vehicle operator or to Fahrzeu ^¬ and / or appropriate signals to further control devices in the vehicle that can be used for prohibiting further travel of the driving ^¬ zeugs. Furthermore, the control unit may comprise one or more signal inputs for detecting signals, for example from the vehicle BUS, and in particular for detecting a startup of the vehicle and / or for detecting a tank or charging process, according to the preferred embodiments of the method according to the invention. The first and second aspects of the invention can also be implemented in a combined process. Furthermore, the method according to the invention, for example in the form of the programs described above, can be implemented on a control unit of a driver assistance system additionally used for other functions, for example on a central control unit - also called an electronic control unit (ECU) - of a surround view camera system for a driver assistance system Vehicle or a mirror replacement system for a vehicle - also called Miroror Replacement System -, which then also advantageously at least one camera of these systems for the detection of at least one image of the tank and / or charging device of the vehicle can be used.

Claims

claims

A method of assisting an operator after a vehicle refueling or charging, comprising the steps of:

(5103) acquiring at least one image of a tank or charging device of the vehicle by means of a camera system of the vehicle;

(5104) determine on the basis of the at least one image of whether a tank or loading means is arranged in the tank or La ^¬ deeinrichtung of the vehicle;

(S106) Issuing an indication and / or Unterbin tion of a continuation of travel of the vehicle when a tank o- loading means in the tank or charger was ermit ^¬ telt.

(5203) acquiring at least one image of a tank or charging device of the vehicle by means of a camera system of the vehicle;

(5204) determining a state of a Verschlus ^¬ ses the tank or charging device of the vehicle based on the at least one image;

(S206) Output of an indication and / or Unterbin ^¬ tion of a further travel of the vehicle when a state "open" of the closure has been determined.

Method according to one of the preceding claims, ^¬ further comprising the step:

(S101, S201) Detecting a Vehicle Startup. 4. The method according to any one of the preceding claims, ^¬ further comprising the step: (S102) Detecting a fueling and / or charging operation of the vehicle.

Method according to one of the preceding claims, characterized in that

the detection of at least one image (S103; S203) and the determination on the basis of the at least one image (S104; S204) take place cyclically until an end-of-program condition (S105) occurs.

Apparatus for a vehicle to implement a procedural ^¬ proceedings according to any one of the preceding claims, comprising

at least one camera for detecting at least one image of a tank or charging device of the vehicle, and

- At least one evaluation, trained

- For determining based on the at least one image, whether a tank or loading means in the tank or charging ^{¬ device of} the vehicle is arranged, as well as formed to output at least one signal in

Dependence of the determination, and / or

- For determining a state of a closure of the tank or charging device based on the at least one image, and designed to output at least one signal in dependence of the determination.

Vehicle comprising a device according to claim 6.