DE102013205361A1 - System and method for archiving touch events of a vehicle - Google Patents

Abstract

The invention relates to a system for archiving touch events of a vehicle (10), comprising a vehicle (10) as well as image capturing means (11, 12, 13, 14) and image archiving means (19) in the vehicle (10), the touch events being described by means of digital image data The image capture means (11, 12, 13, 14) capture images of at least a partial area of a vehicle environment (15, 16, 17, 18) and generate the image data from them, and the archiving means (19) digitally archive the image data. The system is characterized in that a vehicle sensor activates and / or deactivates generation and / or archiving of the image data. The invention further relates to a corresponding method.

Description

The invention relates to a system for archiving touch events of a vehicle according to the preamble of claim 1 and to a method for archiving touch events of a vehicle according to the preamble of claim 11.

Different types of driver assistance systems are known in the prior art, which are essentially common in that they serve to relieve the driver and increase vehicle safety in traffic. Such systems are often based on environmental information acquired by means of environmental sensors, environmental sensors being known, for example, as ultrasonic sensors, radar sensors, lidar sensors, laser sensors and camera sensors. The known camera sensors are embodied either as monocamera sensors with only a single-camera sensor or as stereo camera sensors with two single-camera sensors. The use of a stereo camera sensor, in contrast to the use of a monocamera sensor not only allows a presence or object recognition, but also a distance determination.

In this context, the DE 10 2008 038 731 A1 a method for detecting extended static objects in front of a moving vehicle. In this case, detects a front camera, which interacts with an image processing device, lane markings on the road, lateral detection devices detect objects in the so-called blind spot and further detection devices detect minimum distances to laterally passing or following vehicles. The lateral detection devices may be lidar or radar devices. By means of a linking unit the data of the image processing device of the front camera are linked to the data of the other detection devices in such a way that extensive static objects are detected in the front detection area of the vehicle and as such enter into the detection of the other detection devices. Thus, the object recognition of the lateral detection devices, in particular for extended and elongated objects, such as crash barriers, improved.

From the DE 10 2011 075 674 A1 a distance determination method by means of a camera sensor is known, wherein a distance of the camera sensor to the target object is determined on the basis of a spatial extent of the area covered by the target object on a light sensor in the camera sensor, by linking this information with information about the actual spatial extent of the target object.

In this case, the actual spatial extent is transmitted from the target object to the vehicle either by means of vehicle-to-X communication, or else the target object is classified by means of the camera sensor and the extensions which are typical for the recognized object class are used as the basis for determining the distance. Thus, a mono camera sensor can be used for distance determination.

The DE 10 2007 049 516 A1 discloses a system for determining objects in a field of vision in front of or behind a vehicle, wherein a first environment detection is carried out by means of a radar sensor and a second environment detection by means of a camera sensor. The sensor signals are then supplied to separate sensor signal analysis methods with object detection and verified taking into account further vehicle information and a lane prediction. When a dangerous situation is detected by a hazard computer, measures to increase passive safety are initiated.

However, the methods and systems known in the prior art do not yet exploit all the functionalities or advantages that result from the increasing equipment rate of motor vehicles with environmental sensor technology. Precisely because such environment sensor elements are usually associated with non-negligible cost overhead, as many functionalities as possible should be offered to a vehicle customer.

The object of the present invention is therefore to propose a further functionality for a camera-based environment sensor system.

This object is achieved by the system for archiving touch events of a vehicle according to claim 1.

The invention relates to a system for archiving touch events of a vehicle, comprising a vehicle and image capture means and image archiving means in the vehicle, wherein the touch events are described by means of digital image data, wherein the image capture means capture images of at least a portion of a vehicle environment and generate the image data from these and the Archiving means archiving the image data digitally. The system is characterized in that a vehicle sensor activates and / or deactivates generation and / or archiving of the image data.

This results in the advantage that all occurring in the detectable portion of the vehicle environment events, in particular touch events, by means of activation or deactivation can be detected and archived by the vehicle sensor. This is of particular interest for all types of touch events, as vehicle touch events are in most cases associated with vehicle damage. According to the invention, the term "touch event" is to be understood broadly and includes both all types of vehicle collisions and the collision of people, animals or objects with the vehicle. By archiving the image data, they can be evaluated following the touch event and used for clarification, in particular for criminal investigation, the touch event. The image data can be transmitted to a suitable storage means such as a USB stick via a multimedia unit in the vehicle and then evaluated on a computer or other suitable device. For the purposes of the invention, the term "archiving" therefore means the digital storage and provision of the image data, it being possible for the image data to be stored as individual image files or combined as a video file. Likewise, the image data in the archiving of a known data compression can be subjected to save digital storage space.

Advantageously, not all archived image data is archived in an archiving, but only the image data of a single image from a predetermined number of images, e.g. only every fifth image produced. This also helps to save digital storage space.

The vehicle sensor can activate and deactivate both the generation of the image data and the archiving of the image data. This means that it can be provided both that the image acquisition means are continuously activated and thus continuously generate image data, as well as that the image acquisition means are activated only by the vehicle sensor and only begin by their activation with the generation of the image data. In the latter case, the energy requirement of the system according to the invention is comparatively low.

It is preferably provided that the vehicle sensor is an ignition state sensor for detecting a state of a vehicle ignition, wherein the ignition state sensor activates the generation and / or archiving of the image data when a vehicle ignition is switched off and in particular also when the vehicle ignition is switched on. This results in the advantage that the system, especially in those situations in which the driver is usually not in the vehicle, namely in the vehicle standstill with the ignition off, the digital image data archived. Thus, cause of damage can be determined, which are added to the vehicle in the parked state and without witnesses. This in turn could lead to comparatively cheaper insurance premiums for vehicles that carry out the method according to the invention, since parking damage can often be explained with subsequent driver flight and thus the damage caused to the polluter can be charged instead of having to be paid by the insurance. In addition, a dissemination of the method according to the invention could lead to a more considerate traffic behavior of the different road users, as they would always have to be able to be determined in a simple manner in case of violations of the traffic rules and in particular for damage to other vehicles by means of the archived image data.

In addition, it is provided that the vehicle sensor is a distance sensor and makes a distance determination of a collision object to the vehicle. This results in the advantage that the occurrence of collision events can be detected comparatively easily and precisely, since a collision event is present when the distance disappears. In addition, distance sensors are comparatively economical in terms of their energy requirements, so that they can remain activated for a long time even when the vehicle is stationary without unduly burdening the electric vehicle energy storage.

In particular, it is provided that the distance sensor comprises the image acquisition means and / or ultrasound sensor system and / or laser sensor system and / or lidar sensor system and / or radar sensor system, the image acquisition means in particular performing an object recognition. Such types of sensors are particularly suitable for determining the distance, are already widespread and technically mature. By relying on the aforementioned types of sensors, reliable and comparatively cost-effective means for determining distances are thus available. In addition, a variety of current vehicles as standard at least a part of the aforementioned sensors. If the image capture means itself are used as a distance sensor, stereo camera sensors are particularly suitable for determining the distance. Object recognition, which is carried out by the image acquisition means, can also improve the distance determination by the image acquisition means, since different types of objects can thus be recognized as objects in the surroundings of the vehicle and can be distinguished from the background. It does not matter whether the objects are actually classified or even classifiable, eg as pedestrians, cyclists or motor vehicles. If the objects are nevertheless classified, it is conceivable using object recognition to activate archiving only when certain objects, eg vehicles, are detected.

In addition, it is provided in particular that the distance sensor activates the generation and / or archiving of the image data when the threshold distance of the collision object to the vehicle is undershot. The generation or the archiving therefore take place only when there is actually a risk of contact, because an object falls below the threshold distance to the vehicle. This results in the advantage that the digital storage space required for archiving can be further reduced, since archiving takes place only when the threshold distance is undershot and storage space is thus needed only when the threshold distance is undershot. In addition, this also results in a reduction of energy consumption. The energy consumption is further reduced, although the generation takes place only when falling below the threshold distance, since in these cases the image capture means can also be deactivated. Since, in particular, any type of unnecessary energy dissipation should be avoided, especially in the case of parked vehicles, so as not to complicate or make impossible a subsequent engine starting process, such situation-adapted activation of the image capturing means is particularly advantageous.

Particularly preferably, it is provided that the threshold distance is zero, so only an actual touch event for activation of the generation and / or archiving leads. Thus, only the image data of actual touch events are archived, which allows a further reduction of the required digital storage space and energy consumption and thus keeps the costs necessary for carrying out the method according to the invention cost.

It is expedient that the vehicle sensor is an accident sensor for detecting an accident event, wherein the accident sensor activates the generation and / or archiving of the image data upon detection of an accident event. This leads to a further reduction of the energy requirement of the system according to the invention. Accident sensors within the meaning of the invention are also known as so-called crash sensors, which detect the occurrence of an accident event. As accident sensors, e.g. Acceleration sensors or particularly preferably acoustic sensors are used, which detect the occurrence of a contact event or an accident by high-frequency vibrations in the vehicle body. Such accident sensors are particularly economical in terms of their energy needs.

Moreover, it is advantageous that the archiving comprises a determinable period of time, wherein the image archiving means successively overwrite already archived image data with newly acquired image data after the determinable time span has elapsed. The archiving thus takes place in the manner of an endless loop. This results in the advantage that the archiving can be continued even if the provided storage capacity of the image archiving means has already been fully used for archiving image data and is exhausted and thus therefore no free storage capacity is available. The determinable period of time is preferably a few hours to a few days. If a touch event has been identified as such, the archiving after detection of the touch event is particularly advantageously still for a further determinable period of time, e.g. 5 min, continued and then aborted to prevent overwriting of the image data describing the touch event in the further execution of the infinite loop.

It is preferably provided that the picture archiving means comprise a digital data memory. Digital data memories offer a number of advantages, e.g. they are equally compact and flexibly writable or erasable. The digital data storage may be a RAM, ROM or EEP. He can e.g. also be run as a conventional hard drive or SD card.

It is expedient that the image acquisition means comprise a multiplicity of camera sensors as well as associated image processing electronics, the camera sensors being arranged on the vehicle such that they generate digital image data of a complete vehicle environment. This has the advantage that image data describing a touch event can be detected independently of which direction the touch event hits the vehicle. Thus, essentially every touch event can be detected and archived via its associated image data.

Furthermore, it is provided that the plurality of camera sensors supplies image data to at least one further vehicle system, in particular a parking assistant and / or an emergency brake assistant and / or a distance assistant. Because a large number of current new vehicles are equipped in any case with camera sensors in series, the costs for equipping a vehicle with the system according to the invention thus remain comparatively low, as these camera sensors, which are present in any case, can be used. Examples of such already existing camera sensors are, for example, forward-looking cameras for traffic sign recognition, distance determination, lane recognition and for execution autonomous emergency braking. Also suitable are rear view cameras or cameras with so-called fisheye lenses as a parking aid. In particular, the cameras provided with fisheye lenses often capture comparatively large parts of the vehicle environment.

• – WLAN-Verbindung, insbesondere nach IEEE 802.11p ,
• – WiFi-Direct,
• – ISM-Verbindung (Industrial, Scientific, Medical Band), insbesondere über eine funkverbindungsfähige Schließvorrichtung,
• – Bluetooth-Verbindung,
• – ZigBee-Verbindung,
• – UWB-Verbindung (Ultra Wide Band),
• – WiMax (Worldwide Interoperability for Microwave Access),
• – Remote-Keyless-Entry-Verbindung,
• – funkverbindungsfähige Schließvorrichtung,
• – Mobilfunkverbindung, insbesondere GSM-, GPRS-, EDGE-, UMTS- und/oder LTE-Verbindungen und
• – Infrarotverbindung.

In addition, it is advantageous that the vehicle-to-X communication device sends or receives vehicle-to-X messages by means of at least one of the following types of connection:

• - Wi-Fi connection, especially after IEEE 802.11p .
• - WiFi Direct,
• ISM connection (Industrial, Scientific, Medical Band), in particular via a radio-compatible closing device,
• - Bluetooth connection,
• - ZigBee connection,
• - UWB connection (Ultra Wide Band),
• WiMax (Worldwide Interoperability for Microwave Access),
• - remote keyless entry connection,
• - radio-compatible locking device,
• Mobile radio connection, in particular GSM, GPRS, EDGE, UMTS and / or LTE connections and
• - Infrared connection.

These types of connections offer different advantages, depending on the type, wavelength and data protocol used. Thus, some of the mentioned types of connection, e.g. a comparatively high data transmission rate and a comparatively fast connection setup, while others are very well suited for data transmission around obstructions. The combination and simultaneous or parallel use of several of these types of connections provide further advantages, as well as disadvantages of individual types of connections can be compensated.

The invention further relates to a method for recording touch events of a vehicle, wherein the touch events are described by means of digital image data, wherein image acquisition means capture images of at least a portion of a vehicle environment and generate from these the image data and wherein archiving means digitally archive the image data. The method is characterized in that generation and / or archiving of the image data are activated and / or deactivated by means of a vehicle sensor. This results in the advantage that a touch event and a damage event associated with the touch event can be archived on the vehicle in the form of the image data and permit a retroactive elucidation of the contact event or the damage to the vehicle, if this becomes necessary. In particular, a possibly related to the damage criminal investigation is simplified.

Further preferred embodiments will become apparent from the subclaims and the following descriptions of exemplary embodiments with reference to figures.

Show it

1 schematically a vehicle that is equipped with the system according to the invention and

2 an exemplary sequence of the method according to the invention in the form of a flow chart.

In 1a is vehicle 10 to see, which is equipped with the system according to the invention. The system includes front camera sensor 11 , which is designed as a stereo camera sensor and is suitable both for object recognition and for determining the object distance. Front camera sensor 11 is arranged at the level of the rearview mirror on the inside of the windshield. Furthermore, the system includes reversing camera 12 , which is designed as a monocamera and the driver by means of a monitor device in the vehicle 10 assisted in reverse parking, as well as two lateral camera sensors, of which only camera sensor 13 in 1a is shown. camera sensor 13 has a so-called fisheye lens to capture the widest possible part of the vehicle environment and is integrated into the right-hand vehicle exterior mirror. An identical camera sensor is integrated in the left vehicle side mirror on the left side of the vehicle and in 1a not to be seen. The latter two camera sensors are associated with a blind spot warning assistant, which warns the driver, for example, when changing lanes on a multi-lane road from the presence of objects imperceptible to them in the so-called blind spot. When the ignition is switched off, the system according to the invention is automatically activated and begins to archive the acquired image data. The captured image data is from image storage means 19 , which, for example, are designed as hard disk recorders, digitally compressed and archived, ie stored digitally. The digital storage capacity of image storage media 19 is sufficient to archive the captured image data during a 4 hour period. Thereafter, the archived image data is successively overwritten with the newly acquired image data, so that in each case image data of the last 4 hours are kept.

1b shows a schematic plan view of the vehicle 10 with camera sensors 11 . 12 . 13 and 14 , Also shown in 1b subregions 15 . 16 . 17 and 18 of the vehicle environment, that of camera sensors 11 . 12 . 13 and 14 be captured and based on the generation of the respective image data. Front camera sensor 11 captures front section area 15 , Backup camera 12 covers the rear partial area 16 and camera sensors 13 and 14 capture lateral sections 17 and 18 , Thus, with the exclusively other vehicle systems associated camera sensors, the almost complete vehicle environment can be detected in order to carry out the inventive method. This results in an additional functionality for the already existing camera sensors 11 . 12 . 13 and 14 ,

2 shows an exemplary sequence of the method according to the invention in the form of a flow chart. In process step 20 It is first determined by means of ultrasonic sensors that an object falls below the threshold distance of 30 cm to the parked and parked vehicle. An object recognition does not take place, for example. In the following step 21 the detection of the vehicle environment is activated by means of camera sensors and in step 22 the archiving of the generated image data is activated. Thus, as from the fall below the threshold distance, all captured image data are first archived. These image data also describe the object which has fallen below the threshold distance to the vehicle. After a period of 5 min are in process step 23 the detection of the vehicle environment and the archiving of the generated image data deactivated again, since the threshold distance was only once short undercut. In step 24 Finally, the generated and archived image data can be output via the USB interface of a multimedia unit present in the vehicle to a USB stick to the driver.

According to another example, not shown, a vehicle equipped with the system according to the invention is parked in a public parking lot. During the absence of the driver, another vehicle causes a touch event in the form of a so-called parking bump. The on-board crash sensor detects, based on acoustic vibrations in the vehicle body, that a touch event has occurred and then activates the detection of the vehicle environment and the archival of the image data generated in this way. Image data of the 60 seconds following the touch event are generated and archived. By archiving the image data of such a short period of time, the image storage means can be made comparatively simple. Later, the driver will be provided via the multimedia unit, the generated image data as a video file.

According to another example, also not shown drives a plurality of vehicles with far too narrow distance in the left lane of a multi-lane road. A strong braking of a vehicle ahead causes a critical situation, which also causes the following vehicles to brake and partly to avoid a different lane. One of the evasive follower vehicles collides with a vehicle located in the other lane and thus causes a touch event. This other vehicle is equipped with the system according to the invention, wherein the system according to the invention, for example, permanently activated during operation of the vehicle and thereby archives image data of a period of 2 h and successively overwrites again. This image data later enables a reconstruction of the touch event and a clear blaming of the driver of the evasive vehicle.

QUOTES INCLUDE IN THE DESCRIPTION

This list of the documents listed by the applicant has been generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Cited patent literature

• DE 102008038731 A1 [0003]
• DE 102011075674 A1 [0004]
• DE 102007049516 A1 [0006]

Cited non-patent literature

• IEEE 802.11p [0024]

Claims (11)

System for archiving touch events of a vehicle ( 10 ) comprising a vehicle ( 10 ) and image capture means ( 11 . 12 . 13 . 14 ) and image archiving means ( 19 ) in the vehicle ( 10 ), wherein the touch events are described by means of digital image data, wherein the image capture means ( 11 . 12 . 13 . 14 ) Images of at least one subarea of a vehicle environment ( 15 . 16 . 17 . 18 ) and from these generate the image data and wherein the archiving means ( 19 ) digitally archive the image data, characterized in that a vehicle sensor activates and / or deactivates generation and / or archiving of the image data. System according to claim 1, characterized in that the vehicle sensor is an ignition state sensor for detecting a state of a vehicle ignition, wherein the ignition state sensor activates the generation and / or archiving of the image data when switching off a vehicle ignition and in particular also deactivated when switching on the vehicle ignition. System according to at least one of claims 1 and 2, characterized in that the vehicle sensor is a distance sensor and makes a distance determination of a collision object to the vehicle. System according to claim 3, characterized in that the distance sensor comprises the image capture means ( 11 . 12 . 13 . 14 ) and / or ultrasound sensor system and / or laser sensor system and / or lidar sensor system and / or radar sensor system, wherein the image capturing means ( 11 . 12 . 13 . 14 ) perform in particular an object recognition. System according to at least one of claims 3 and 4, characterized in that the distance sensor activates the generation and / or archiving of the image data falls below a threshold distance of the collision object to the vehicle. System according to at least one of claims 1 to 5, characterized in that the vehicle sensor is an accident sensor for detecting an accident event, wherein the accident sensor activates the generation and / or archiving of the image data upon detection of an accident event. System according to at least one of claims 1 to 6, characterized in that the archiving comprises a determinable period of time, wherein the image archiving means ( 19 ) successively overwrite already archived image data with newly acquired image data after the determinable time span has elapsed. System according to at least one of claims 1 to 7, characterized in that the image archiving means ( 19 ) a digital data storage ( 19 ). System according to at least one of claims 1 to 8, characterized in that the image capture means ( 11 . 12 . 13 . 14 ) a plurality of camera sensors ( 11 . 12 . 13 . 14 ) and associated image processing electronics, the camera sensors ( 11 . 12 . 13 . 14 ) on the vehicle ( 10 ) are arranged to receive digital image data of a complete vehicle environment ( 15 . 16 . 17 . 18 ) produce. System according to at least one of claims 1 to 9, characterized in that the plurality of camera sensors ( 11 . 12 . 13 . 14 ) supplies image data to at least one further vehicle system, in particular a parking assistant and / or an emergency brake assistant and / or a distance assistant. Method for recording touch events of a vehicle ( 10 ), in which the touch events are described by means of digital image data, image acquisition means ( 11 . 12 . 13 . 14 ) Images of at least one subarea of a vehicle environment ( 15 . 16 . 17 . 18 ) and from these generate the image data and wherein archiving means ( 19 ) digitally archive the image data, characterized in that a generation and / or archiving of the image data by means of a vehicle sensor is activated and / or deactivated.

Images