DE102015223613A1 - Method and device for automatically opening and closing at least one window pane of a motor vehicle - Google Patents

Abstract

A method and apparatus for automatically opening and closing at least one windowpane of a motor vehicle, the apparatus comprising at least one camera configured to image the surroundings of the vehicle, at least one sensor unit configured to receive data, and a controller that configures the data of the at least one camera and the at least one sensor unit is to be processed and a decision is made as to whether the at least one window pane is to be opened or closed, wherein the control unit is further configured on the basis of the decision to open or close the at least one window pane.

Description

The present invention relates generally to a method and apparatus for automatically opening and closing at least one window of a motor vehicle, and more particularly to automatically opening and closing at least one window of a motor vehicle using camera data in conjunction with sensor data.

From the document EP 1 526 242 B1 a method for controlling the movement of a window pane of a side door of a motor vehicle is known. In particular, the document describes a method in which a window pane is automatically moved to an intermediate position in response to a movement of the side door. The intermediate position is characterized by the fact that the side window is at least partially located with its upper edge in a lying on the parapet of the side door sealing gap. This should reduce rattling noise when closing the door.

The document DE 42 03 512 C1 relates to a device for lowering and raising a window of a motor vehicle door consisting of a window regulator with a drive motor and with a control device which can be actuated via at least one operating switch in the vehicle interior. The control device is also actuated from the outside of the vehicle with the aid of an external handle button of the door lock in such a way that after unlocking the vehicle door and pressing the handle button longer than a predetermined waiting time of about 1 sec, the window pane is lowered to its lower position. This should be able to be entered with lowered window in the vehicle, which is to be facilitated especially in tight parking conditions and frameless windows getting in.

The document DE 10 2014 017 748 A1 relates to a protective device for a motor vehicle with at least one opening, via which the interior of the motor vehicle is connected to the surrounding area, and with a closing device with an automatically adjustable by means of an adjusting closure element, for example a disc element which closes between a closed position and a closed opening Opening at least partially releasing open position is adjustable. The protective device is connected to the adjustment of the automatically adjustable closing element and has a sensor device for detecting a drive of the motor vehicle along a route with this at least partially covering structure, in particular a tunnel drive of the motor vehicle, in dependence of which the closing element is adjustable.

The document DE 10 2013 020 413 A1 relates to a driver assistance device for a vehicle with a position detection unit for detecting a vehicle position. The position detection unit is coupled to at least one control unit for controlling at least one vehicle function, for example an opening which can be opened by means of a movable vehicle window. In this case, the at least one control unit is coupled to at least one input unit with which it is possible to specify manually which vehicle function or which vehicle functions is or are to be automatically executed at a predefined vehicle position.

The document DE 196 19 643 C1 relates to a navigation device of a vehicle in which, inter alia, data on up-covered road network areas, ie in particular data on the exact location and length, are stored. In this way, the navigation device, in conjunction with the current vehicle position determination, can recognize when driving on such a road network area covered upwards is pending. As soon as this is the case during a journey, the navigation device emits a corresponding message to a control unit which then automatically activates certain vehicle components in a tunneling function to switch on the vehicle lights, close the vehicle openings, switch the air conditioning system to recirculation mode and / or Switch audio system to phonogram operation. The vehicle thereby automatically assumes the appropriate operating state for driving on the upwardly covered road network area, eg. As a tunnel, an underpass, a parking garage or underground parking, a, without the driver himself must pay attention to the activation of the tunneling function. In this way, a particularly high operating comfort when driving on such road network sections should be achieved for vehicles with navigation device and tunnel function.

The document DE 10 2015 000 541 A1 concerns an assistance device for a vehicle occupant of a vehicle, which has at least one identification device designed to identify at least one vehicle occupant and / or at least one object arranged within the vehicle. Furthermore, the identification device comprises at least one optical detection device for detecting the at least one vehicle occupant and / or the at least one object and is coupled to a control unit configured for controlling vehicle functions of the vehicle, depending on the at least one identified vehicle occupant and / or in dependence number of At least one vehicle function can be controlled by the vehicle occupant and / or depending on the identified object.

The object underlying the present invention is to provide a method and apparatus which eliminates the problems of the known systems, e.g. to increase the reliability of automatically opening and closing a windowpane in a motor vehicle and / or to increase the safety and efficiency of the system. This object is achieved with the features of the independent claims. The dependent claims relate to further aspects of the invention.

According to one aspect of the present invention, there is provided an apparatus for automatically opening and closing at least one window of a motor vehicle, the apparatus including at least one camera configured to provide camera data, in particular images of the surroundings of the vehicle, at least one sensor unit configured Receive data, in particular for determining a position of the vehicle, a distance to an object and / or for determining the vehicle state, in particular the vehicle speed, and having a control unit that is configured to the data of the at least one camera and the at least one sensor unit process and decide whether to open or close the at least one window pane, wherein the control unit is further configured, based on the decision to open or close the at least one window pane.

The at least one sensor unit has a receiver for in particular electromagnetic signals and / or optical and / or acoustic signals. For example, a receiver comprises an ultrasonic sensor, an infrared sensor, a distance sensor, a position sensor, a GPS sensor, a speed sensor, or a microphone. A microphone is preferably suitable to respond to the commands of the driver or outside noise, in particular announcements at parking garage barriers or the like, record. It is particularly advantageous if the at least one sensor unit has a speed sensor and / or a GPS sensor. In other words, it is particularly advantageous to evaluate the camera data together with data of a speed sensor and / or a GPS sensor. As a result, the result of the control unit can be improved and the event determined by means of the camera data and the data of the speed sensor and / or GPS sensor can be checked for correctness. In the context of the present invention, a speed sensor is understood as a unit which is able to determine the speed of the vehicle. Preferably, this will be done using a tachometer that determines the speed of the vehicle based on the wheel speed. In other words, a speed sensor preferably has a tachometer and a computing unit for determining the speed.

Preferably, the sensor unit is a unit which is already present in the motor vehicle, in particular a navigation unit, a speedometer, a tachometer, etc. In other words, it is preferable to use the existing sensor / electronics / map material and thus not to install any additional control devices . to use. However, the present invention is not limited thereto. The sensor unit may also receive data from an external (not part of the motor vehicle) unit.

The device described above may further comprise a memory unit for storing predetermined camera data, in particular images of vehicle surroundings, and / or data of the sensor unit. The storage unit is also preferably suitable for storing relations of the data to one another and conditions associated with the opening or closing of the at least one window pane. Preferably, the control unit is configured based on the assignment of data stored in the storage unit to decide whether the at least one window pane is to be opened or closed.

Images of vehicle environments are preferably images of objects, such as Signs, street signs, barriers, outlines of vehicles, lane markings, toll booths, parking garage exits, parking garage entrances, etc. Preferably, the device has a notification unit. The notification unit may be configured to inform a driver of the motor vehicle that the control unit has decided to open or close the at least one window pane. The control unit is preferably configured to open or close the window pane only after confirmation by the driver. As a result, the driver can be informed on the one hand when an opening or closing of the at least one window is imminent. Thus, the driver is informed that an action on his part, e.g. in the case of opening a window on a parking garage, imminent. On the other hand, for safety-related aspects, the driver can be prevented from uncontrolled opening or closing of the at least one window pane.

According to a further aspect of the present invention, a method for the automatic opening and closing of at least one window pane of a motor vehicle, the method comprising the steps of: receiving image data using at least one camera; Receiving sensor data using at least one sensor unit; Processing the image data and the sensor data using a control unit; Deciding whether to open or close the at least one windowpane using the processed image data and sensor data; and opening or closing the at least one window pane according to the decision made.

Receiving and processing the sensor data may include using at least one of the following sensor data: ultrasound data, infrared data, distance data, position data, GPS data, speed data, and audio data. Particularly preferred is the receiving and processing of the sensor data of speed data and / or position data, preferably GPS data.

The method may further comprise a step of assigning predetermined camera data and sensor data to each opening or closing of the at least one window pane using a memory unit, wherein preferably the decision is based on the associated data.

It is also advantageous that the method further comprises a step of notifying a driver of the motor vehicle that the control unit has decided to open or close the at least one window pane. The opening or closing of the at least one window pane preferably takes place only after an additional step for confirming the opening or closing by the driver.

In other words, according to the invention, the vehicle recognizes in advance, via existing in the vehicle sensors (including cameras, ultrasonic sensors, distance sensors, etc.) and / or highly accurate navigation data, which are also required for autonomous driving, if it is a parking garage / toll booth, etc. approaches. This is preferably done with existing sign recognition already a few miles in advance. To ensure the speed of the vehicle is preferably also considered. If this e.g. a threshold of e.g. 15 km / h below and the sensor or map data register a corresponding payment station, the window of the driver is automatically shut down without this one hand has to be removed from the steering wheel. When the vehicle is stationary, the parking ticket, the toll, etc. can be safely transferred. Only when starting, when the opening barrier is detected and when positive sensor data (for example, the hand is no longer in the window) is the disc automatically moved up again. Alternatively, this can also be done by a corresponding gesture control or specific voice commands.

By the present invention, a universal applicability to situations in which the driver must perform an action outside the vehicle without leaving the vehicle, such as. the removal of a ticket in a parking garage (entrance car park, parking with barrier), the insertion of a parking ticket in the machine (parking garage / parking), the payment or pulling a ticket at a toll booth, paying, ordering or receiving the food at a Drive-through restaurants, ordering or paying a program at a car wash, can be achieved. Through the combination of different sensor data, the present invention can make an efficient and safe decision on the opening or closing of the window panes. By the present invention it is achieved that a driver does not have to remove his hand if possible from the steering wheel in order to operate a power window and thus is not distracted, whereby the safety and comfort can be increased.

In other words, the present invention increases i.a. the safety and comfort, as the driver can leave both hands on the steering wheel until the car finally stops.

Hereinafter, the present invention will be explained in more detail with reference to embodiments and the figures.

Show it:

1 a schematic representation of a device according to an embodiment of the invention,

2 a schematic flow diagram according to an embodiment of the method according to the invention and

3 a schematic flow diagram according to another embodiment of the method according to the invention.

1 shows the schematic structure of an embodiment of the present invention with a camera 10 , a speed sensor 20 and a GPS sensor 21 , a control unit 30 and a window 40 ,

2 shows a corresponding schematic flow diagram of the exemplary embodiment according to 1 ,

The camera 10 is suitable to take pictures of the environment continuously or at predetermined intervals and analyze them by image processing software on possible objects such as signs. For the purposes of the present invention, relevant information signs may be, for example, street signs, signs for announced toll stations, parking garage signs or parking guidance system signs, etc. By capturing the camera data, a detection of an impending event (eg opening the windowpane) should be made possible as early as possible. The at least one window to be opened or closed is preferably the window on the driver's side, so that the driver can perform an action outside the vehicle through the opened window pane without leaving the car.

The evaluation of the data is done advantageously in the control unit 30 , For this, the data of the camera 10 transferred to the control unit (transfer). This step of receiving and transmitting the camera data is in 2 denoted by S1. The control unit 30 then takes over the evaluation of the transmitted camera data (step S2 in 2 ). Preferably using image processing such as image pattern analysis or pattern matching.

Preferably, the camera provides images of the environment, preferably the front field of view of the vehicle. From this significant sections are recognized and processed.

For signs, for example, a so-called OCR text recognition (optical character recognition) with database matching conceivable, the same applies to barriers. Preferably, the recognition is supported by a comparison with navigation data. The evaluation then takes place as a result of a comparison with a database in which signs are stored and can be compared with the recognized text.

Other vehicles, ticket booths etc. can be determined via various image classification methods known to the person skilled in the art, ie image preprocessing in advance, then segmentation and feature extraction (various methods) and then classification (for example via regression, neural networks, Gaussian methods, etc.). The methods are preferably used depending on the situation, i. a text recognition is used for signage with text and a classification procedure for signage without text. Preferably, the methods are executed in parallel in order to obtain fast results as a result of the situation. However, it is also possible to carry out a preferred method and to perform the other method (s) only after the first method has failed, in order to save computing power.

In the exemplary embodiment according to 1 is a speed sensor 20 and a GPS sensor 21 provided. The speed sensor 20 is suitable for measuring the speed of the motor vehicle and the GPS sensor 21 is suitable to receive or determine the position of the motor vehicle (step S3 in FIG 2 ). The data of the speed sensor 20 and the GPS sensor 21 are also sent to the control unit 30 transfer (transfer). The control unit 30 then takes over the evaluation of the transmitted sensor data (step S4 in FIG 2 ).

The transmission or evaluation of the various data to or by the control unit 30 is preferably carried out in parallel, but can also be done sequentially, for example, at predetermined times.

In a preferred embodiment of the present invention, the camera data is continuously evaluated. Once the control unit 30 detected an object, such as a relevant sign, the control unit evaluates the data of the speed sensor 20 and / or the GPS sensor 21 out. Represents the control unit 30 on the basis of the speed data and / or the GPS data that the motor vehicle is approaching eg a toll station or a parking garage, the control unit becomes 30 opening at least one window 40 , preferably the window 40 which is on the driver's side (step S5 in FIG 2 ).

By using multiple datasets (here camera data, speed data and GPS data) you can open the window 40 be safely controlled. The early detection of an object, such as a sign, due to the camera data allows the control unit 30 the data of the speed sensor 20 and the GPS sensor 21 do not have to evaluate continuously. This saves eg computing capacity and energy. It is preferred that the control unit 30 only after a recognition of an object, such as a sign, by the camera 10 evaluates the speed data and the GPS data.

The order of evaluation of the data sets is merely exemplary and not exhaustive. According to an exemplary embodiment, upon successful detection of an object, such as a sign, first the position of the vehicle could be determined from the GPS data and on the basis of existing maps on which, for example, parking garages and / or toll booths are registered determined. This will be the control unit 30 in a position to decide if the window 40 should be opened. Preferably, the control unit 30 an opening of the window 40 only arrange when the motor vehicle comes near the parking garage or the tollbooth.

Additionally or alternatively to the GPS data, the control unit 30 the data of the speed sensor 20 use to decide if the window 40 should be opened. The decision to open the window is preferably linked to the condition of the complete standstill (speed = 0 km / h) of the motor vehicle.

Whether and what data for determining the opening of the window 40 are used, is preferably determined by the situation. When the motor vehicle approaches a toll station, initially only the GPS data is advantageously used, since at the toll stations often backlogs occur and the speed sensor could indicate a stoppage, but the toll station would not have been reached yet. An evaluation of the speed sensor 20 takes place only when it is determined by evaluation of the camera data that the vehicle has reached the toll station.

On the other hand, in situations where GPS data can not or can only be determined very inaccurately, it may be advantageous to evaluate only the speed data. To increase the accuracy, preferably the speed data and the GPS data are combined. The control unit 30 can have both situational presets and a general presetting. The control unit 30 For example, you can use the camera data for early detection to recognize a parking garage and then evaluate the speed data and the GPS data to determine that the window 40 should be opened. This can be advantageous, since a motor vehicle often drives past parking garages directly without the driver actually controlling it. As a result, the determination, through the use of only a sensor used in addition to the camera data, may lead to a faulty opening of the window 40 to lead. It is different, for example, at a toll station. A different presetting could be possible here, since it is unlikely that a driver who comes in the immediate vicinity of a toll station, this does not want to happen. Thus, it may already be sufficient, in addition to the early detection by the camera data, for example, to evaluate the GPS data in order to decide whether the window should be opened. Also preferred is a uniform default setting of the control unit 30 ie the same conditions for opening or closing the window 40 for the different situations. Preferably, a combination of camera data and sensor data is used here, which leads to a satisfactory result in all situations, for example by evaluating the camera data, position data and speed data.

Preferably, after an automatic opening of the window 40 an automatic closing of the window 40 carried out. The control unit is preferred 30 after opening the window 40 Evaluate the received data to determine if the window should be closed. In order to save computing power, such an evaluation is only after previous opening of the window 40 performed by the control unit on the basis of an object recognized according to the invention. For this, the data from the speed sensor 20 , the GPS sensor 21 and / or the camera 10 received, evaluated and used (step S6 in 2 ).

Preferably, the speed data of the speed sensor becomes 20 through the control unit 30 after automatically opening the window 40 evaluated to register a start of the motor vehicle and then the window 40 to close automatically (step S7 in 2 ). It is also possible to use the camera data or the GPS data in the control unit 30 to evaluate the automatic closing of the window 40 through the control unit 30 to induce. For example, the camera data could be used to determine if a toll station has been passed.

Preferably, the control unit 30 after successful closing of the window 40 proceed to evaluate the camera data for detection of a further information label in order to execute steps S1 to S7 again if necessary.

3 shows another exemplary embodiment of the present invention. As in 3 is shown in a first step S10, an early detection of street signs, preferably achieved by the evaluation of camera data.

In a further step S11, the recognition of locations via the sensors used, e.g. Speed sensor and / or position sensor, preferably in accordance with each other, made to determine a situation previously recognized in S10.

If it is detected in S11 that the location has been reached, the window is opened and the driver has the option through the open window Perform action, such as solving a parking ticket (S12).

In a further step S13, it is determined whether the window should be closed again. For this purpose, the camera data and / or the sensor data are preferably evaluated. By the camera data, e.g. determine if a barrier has been opened. By the sensor data, e.g. determining whether a body part is still in the window area (e.g., by infrared sensor) or if the vehicle is moving (e.g., speed sensor and / or position sensor).

If it has been determined in S13 that one or more window-opening condition (s) is / are satisfied, the window is closed in a step S14. Preferably, the method of S14 begins from the front, i. it starts again at S10.

In the above-described exemplary embodiment of the present invention, the camera data was evaluated first. Alternatively or additionally, it is possible to use the data of a sensor, eg GPS sensor 21 to evaluate continuously and first. Represents the control unit 30 determines that the motor vehicle is approaching a parking garage or a toll station, other sensor data, eg from the speed sensor 20 and / or from the camera 10 be evaluated to open or close the window 40 to determine. The camera data could be used, for example, to determine whether the motor vehicle is behind another motor vehicle or whether it has reached the paying office of the parking garage or the toll station. Alternatively, as described above, the speed data may be used to determine the opening or closing of the window.

The present invention is not based on the use of certain sensors, here speed sensor 20 and GPS sensor 21 , limited. Rather, a variety of sensors can be used, which are suitable for determining the opening or closing of the window 40 to be used. Also, it may not be necessary to evaluate two sensors in addition to the camera data, it is possible to have only one additional sensor for unambiguous determination of the opening or closing of the window 40 to use. For example, it may be advantageous to evaluate another sensor, eg an infrared sensor, for closing the window pane, which is suitable for determining whether a body part, in particular an arm or a hand, is located in the region of the window to be closed. Thus, the security can be additionally increased.

While the present invention has been described and illustrated with respect to preferred embodiments thereof, it will be apparent to those skilled in the art that various modifications and changes may be made therein without departing from the scope of the invention. In this way, it is intended that the present invention cover the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents.

QUOTES INCLUDE IN THE DESCRIPTION

This list of the documents listed by the applicant has been generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Cited patent literature

• EP 1526242 B1 [0002]
• DE 4203512 C1 [0003]
• DE 102014017748 A1 [0004]
• DE 102013020413 A1 [0005]
• DE 19619643 C1 [0006]
• DE 102015000541 A1 [0007]

Claims (10)

Device for automatically opening and closing at least one window pane ( 40 ) of a motor vehicle, the device comprising: at least one camera ( 10 ) configured to provide camera data; at least one sensor unit ( 20 . 21 ) configured to receive data; and a control unit ( 30 ), which is configured the data of at least one camera ( 10 ) and the at least one sensor unit ( 20 . 21 ) and decide whether the at least one window pane ( 40 ) should be opened or closed, the control unit ( 30 ) is further configured on the basis of the decision the at least one window pane ( 40 ) to open or close. Apparatus according to claim 1, wherein the at least one sensor unit ( 20 . 21 ) has a receiver for electromagnetic signals and / or optical and / or acoustic signals. Apparatus according to claim 1 or 2, wherein the at least one sensor unit ( 20 . 21 ) a speed sensor ( 20 ) and / or a position sensor ( 21 ) having. Device according to one of claims 1 to 3, wherein the device further comprises a memory unit for storing predetermined camera data and data of the sensor unit and for storing relations of the data to each other and conditions, the opening or closing of the at least one window pane ( 40 ), the control unit ( 30 ) is configured on the basis of the assignment stored in the storage unit data to decide whether the at least one window pane ( 40 ) should be opened or closed. Device according to one of claims 1 to 4, wherein the device further comprises a notification unit, wherein the notification unit is configured to inform a driver of the motor vehicle that the control unit ( 30 ) has the at least one window pane ( 40 ) to open or close and / or the control unit ( 30 ) is configured only after confirmation by the driver, the window pane ( 40 ) to open or close. Method for automatically opening and closing at least one window pane ( 40 ) of a motor vehicle, the method comprising the steps of: receiving camera data using at least one camera ( 10 ); Receiving sensor data using at least one sensor unit ( 20 . 21 ); Processing the image data and the sensor data using a control unit ( 30 ); Decide if the at least one window pane ( 40 ) should be opened or closed using the processed camera data and sensor data; and opening or closing the at least one window pane ( 40 ) according to the decision taken.  The method of claim 6, wherein receiving and processing the sensor data comprises using at least one of the following sensor data: ultrasound data, infrared data, distance data, position data, GPS data, speed data, or audio data.  The method of claim 6 or 7, wherein receiving and processing the sensor data comprises speed data and / or position data. Method according to one of claims 6 to 8, wherein the method comprises a step for assigning predetermined camera data and sensor data to respectively the opening or the closing of the at least one window pane ( 40 ) using a memory unit, the decision being based on the associated data. Method according to one of claims 6 to 9, wherein the method further comprises a step of notifying a driver of the motor vehicle that the control unit ( 30 ) has the at least one window pane ( 40 ) to open or close and / or wherein the opening or closing of the at least one window pane ( 40 ) occurs after an additional step to confirm opening or closing by the driver.

Images