DE102021112520A1 - Monitoring system and monitoring method for a vehicle - Google Patents

Abstract

The present disclosure relates to a monitoring system (100) for a vehicle (10), comprising an environment sensor system (110) with two or more sensor types, the environment sensor system (110) being set up, in response to at least one trigger event (TE1, TE2 ) collect environmental data of the vehicle (10) relating to the vehicle 10 and/or a vehicle environment using the two or more sensor types; at least one storage unit (120) which is set up to store the environmental data recorded by the environmental sensors (110); and a communication unit (130) which is set up to transmit the environmental data stored in the at least one storage unit (120) to an external unit (20) upon request.

Description

The present disclosure relates to a monitoring system for a vehicle, a vehicle having such a monitoring system, a monitoring method for a vehicle, and a storage medium for executing the monitoring method. The present disclosure relates in particular to a vehicle-based recording of events by an environment sensor system of a vehicle, in particular a motor vehicle.

State of the art

Modern vehicles often have environmental sensors made up of various types of sensors, such as cameras, lidar sensors and radar sensors. These environmental sensors are required for environmental perception, for example in the context of automated driving, since the vehicle environment consists of many different objects/subjects such as different vehicle types, people and animals, static objects such as garbage cans, traffic control systems, natural objects and terrain that the vehicle encounters when driving automated driving must recognize and take into account.

If the vehicle is not in an automated driving mode, the environmental sensors are only operated to a limited extent or not at all in order to save energy. This is particularly necessary in vehicles with electric or hybrid drives so that the energy stores are not unnecessarily drained.

Disclosure of Invention

It is an object of the present disclosure to specify a monitoring system for a vehicle, a vehicle with such a monitoring system, a monitoring method for a vehicle and a storage medium for executing the monitoring method, which allow improved use of an environment sensor system of a vehicle. In addition, it is an object of the present disclosure to improve safety in a vehicle environment.

This object is solved by the subject matter of the independent claims. Advantageous configurations are specified in the dependent claims.

According to an independent aspect of the present disclosure, a monitoring system for a vehicle, in particular a motor vehicle, is specified. The monitoring system includes an environment sensor system with two or more sensor types, the environment sensor system being set up to capture environmental data of the vehicle in response to at least one trigger event in relation to the vehicle and/or a vehicle environment using the two or more sensor types, at least a storage unit that is set up to store the environmental data recorded by the environmental sensor system; and a communication unit that is set up to transmit the environmental data stored in the at least one storage unit to an external unit upon request.

According to the invention, after an event has occurred, the environmental sensors of a vehicle are used to record potentially relevant data relating to the event. For example, if a dangerous situation occurs, such as the triggering of an alarm system or an escape from an accident, an instruction can be sent to locally relevant vehicles via a cloud, so that the vehicles activate their environmental sensors to record the incident. Data can be recorded from different perspectives and by different sensors (e.g. cameras, lidar, ultrasound and/or acoustic sensors). As a result, security in a vehicle environment can be improved and/or a crime clear-up rate can be increased, in particular since situations that are otherwise not recorded by recording can be recorded by vehicles that are present.

The monitoring system preferably receives the request for transmission of the environmental data stored in the at least one storage unit from the external unit. However, the present disclosure is not so limited, and the request may be made by another external source (e.g., a government agency).

In another exemplary embodiment, the request may be made via a user interface, such as by the vehicle owner or another authorized person (e.g., workshop personnel).

The user interface can be a user interface integrated in the vehicle, such as a control panel, a touchscreen, a head-up display, etc. In response to the request received in the user interface, the monitoring system transmits the environmental data stored in the at least one memory unit to the external unit , possibly after an authorization check.

In another example, the user interface may be a mobile device, such as a mobile device of the vehicle owner. The mobile end device can be communicatively connected to the vehicle via a wired or wireless communication connection, for example, in order to make the request and optionally to receive the stored environmental data. The wireless communication link can be a near field link, a Bluetooth link, etc., for example.

In response to the request received on the mobile terminal, the monitoring system transmits the environmental data stored in the at least one storage unit to the external unit, possibly after an authorization check. In some embodiments, the external unit can be the mobile terminal, i.e. the environmental data stored in the at least one storage unit is transmitted to the mobile terminal. Alternatively, the mobile terminal and the external unit can be separate units. For example, the mobile terminal can be a smartphone and the external entity can be a central entity such as a server or a backend.

The term mobile end device includes smartphones in particular, but also other mobile telephones or cell phones, personal digital assistants (PDAs), tablet PCs and all current and future electronic devices that are equipped with communication technology.

The monitoring system is preferably set up to detect the at least one trigger event, in particular to detect it directly. For example, the environmental sensor system can be set up to detect the at least one trigger event, in particular to detect it directly. For example, an acoustic sensor of the environmental sensor system can be used to detect a trigger event, such as an alarm system being triggered. Similarly, an optical sensor of the environmental sensor system can detect an accident, for example.

In addition or as an alternative, the monitoring system can be set up to receive information relating to the at least one trigger event from a source external to the vehicle. In other words, the monitoring system can indirectly gain knowledge of at least one trigger event.

Preferably, the off-board source is selected from the group including or consisting of a server, another vehicle, and a person in the vehicle environment. However, the present disclosure is not limited to these examples, and the off-board source may be another object or subject that provides information related to the at least one trigger event.

The communication unit of the monitoring system is preferably set up to receive the information relating to the at least one trigger event from the source external to the vehicle, in particular the server and/or the other vehicle. For example, the server or the other vehicle can inform the monitoring system of an accident in the vicinity of the vehicle. Alternatively, the information relating to the at least one trigger event can only include an instruction to activate the environment sensors or to record the environment data.

The communication unit can be set up to communicate via local networks or local area networks (LANs), such as wireless LAN (WiFi/WLAN), or via long-distance networks or wide area networks (WANs), such as e.g. Global System for Mobile Communication (GSM ), General Package Radio Service (GPRS), Enhanced Data Rates for Global Evolution (EDGE), Universal Mobile Telecommunications System (UMTS), High Speed Downlink/Uplink Packet Access (HSDPA, HSUPA), Long-Term Evolution (LTE), 5G or World Wide Interoperability for Microwave Access (WIMAX) to communicate wirelessly. Communication via other common or future communication technologies is possible.

The environment sensor system is preferably set up to receive the information relating to the at least one trigger event from the source external to the vehicle. For example, an acoustic sensor of the environment sensor system can be used to receive an acoustic message from a person in the vehicle environment in relation to the occurrence of the at least one trigger event (e.g. "An accident happened here").

The monitoring system is preferably set up to switch the environmental sensor system from a sleep mode to an operating mode in response to the at least one trigger event. In particular, the environment sensors can be at least partially switched off, for example because the vehicle is parked and there are no occupants in the interior. The sleep mode of the environmental sensors ensures that the vehicle's energy consumption is reduced. In response to the at least one trigger event, the environment sensors can be at least partially woken up in order to capture the environment data.

The environment sensor system preferably comprises at least one first sensor and at least one second sensor. The at least one first sensor can be configured to detect the at least one trigger event while the at least one first sensor is in an operating mode. The monitoring system may be further configured to, in response to the at least one trigger event detected by the at least one first sensor, switch the at least one second sensor from a sleep mode to an operational mode to capture the environmental data.

The at least one first sensor may be an energy efficient sensor and may be maintained in operational mode even when the vehicle is parked and there is also no occupant in the cabin, for example. If the energy-efficient sensor detects the at least one trigger event, more energy-intensive parts of the environment sensors can be woken up. As a result, overall power consumption can be minimized.

The at least one first sensor is preferably an acoustic sensor, in particular a microphone.

Additionally or alternatively, the at least one second sensor is selected from the group that includes or consists of a camera, an ultrasonic sensor, a laser scanner, a radar sensor and a lidar sensor.

Preferably, the at least one trigger event related to the vehicle is damage to the vehicle. For example, the monitoring system can use a microphone and/or a camera to detect that the vehicle has been damaged, for example by another vehicle or a person in the vicinity of the vehicle. However, the present disclosure is not so limited, and the at least one trigger event related to the vehicle may indicate other situations where it is beneficial to capture environmental data to document the situation.

The at least one trigger event in relation to the vehicle environment is preferably the occurrence of a hazardous situation in the vehicle environment. The dangerous situation in the area surrounding the vehicle can be an acoustic alarm, a visual alarm, a traffic accident, etc., for example. However, the present disclosure is not limited to this and the hazardous situation in the vehicle environment can be any situation in which it is advantageous to collect environmental data in order to document the hazardous situation.

The monitoring system is preferably set up to encrypt the recorded environmental data before it is transmitted to the external unit. Encryption can be done using known methods that are suitable for converting data from a readable format into an encrypted format that can only be read or processed again after decryption.

In some embodiments, the surveillance system can be set up to store the encrypted environmental data in the at least one storage unit. In a further embodiment, the monitoring system can be set up to store the environmental data in unencrypted form in the at least one storage unit. In this case, the unencrypted environment data can only be encrypted before it is transmitted to the external unit.

The monitoring system is preferably set up to transmit the environmental data stored in the at least one storage unit to the external unit in anonymised form. The term “anonymized” as used in the context of the present disclosure means that it is no longer possible to draw conclusions about the identity of the vehicle and/or an identity of the vehicle owner from the environmental data transmitted to the external unit.

In some embodiments, the monitoring system can be set up to store the recorded environmental data in an anonymized form in the at least one storage unit. In a further embodiment, the monitoring system can be set up to store the environmental data in non-anonymized form in the at least one storage unit. In this case, the non-anonymized environmental data can only be anonymized before it is transmitted to the external entity.

The environment sensor system is preferably set up to detect the environment data of the vehicle while the vehicle is parked in response to the at least one trigger event.

According to a further aspect of the present disclosure, a vehicle, in particular a motor vehicle, is specified. The vehicle includes the monitoring system according to the embodiments of the present disclosure.

The term vehicle includes cars, trucks, buses, mobile homes, motorcycles, etc., which are used to transport people, goods, etc. esp Special includes the term motor vehicles for passenger transport.

Preferably, the vehicle is a hybrid or electric vehicle, such as a pure electric vehicle (BEV) or a plug-in hybrid vehicle (PHEV).

The vehicle preferably includes the environment sensor system, which is set up to record the environment data. Preferably, the environmental sensors include at least one lidar system and/or at least one radar system and/or at least one camera and/or at least one ultrasound system and/or at least one laser scanner. The environment sensor system can provide the environment data (also referred to as “environment data”), which depict an area surrounding the vehicle.

According to a further independent aspect of the present disclosure, a monitoring method for a vehicle, in particular a motor vehicle, is specified. The monitoring method includes acquiring environmental data of the vehicle by an environmental sensor system of the vehicle in response to at least one trigger event in relation to the vehicle and/or a vehicle environment, the environmental data being acquired using two or more sensor types of the environmental sensor system; storing the captured environmental data in at least one memory unit of the vehicle; receiving a request to transmit the stored environmental data to an external entity; and transmitting the stored environmental data to the external unit.

The monitoring method can implement the aspects of the monitoring system described in this document.

According to another independent aspect of the present disclosure, a software (SW) program is provided. The SW program can be set up to run on one or more processors and thereby carry out the monitoring method for a vehicle described in this document.

According to another independent aspect of the present disclosure, a storage medium is provided. The storage medium can comprise a SW program which is set up to be executed on one or more processors and thereby to carry out the monitoring method for a vehicle described in this document.

According to a further independent aspect of the present disclosure, software with program code for performing the monitoring method for a vehicle is to be executed when the software runs on one or more software-controlled devices.

character list

• 1 schematisch ein Fahrzeug mit einem Überwachungssystem gemäß Ausführungsformen der vorliegenden Offenbarung,
• 2 schematisch ein Fahrzeug und Trigger-Ereignisse gemäß Ausführungsformen der vorliegenden Offenbarung, und
• 3 ein Flussdiagram eines Überwachungsverfahren gemäß Ausführungsformen der vorliegenden Offenbarung.

Exemplary embodiments of the disclosure are shown in the figures and are described in more detail below. Show it:

• 1 schematically a vehicle with a monitoring system according to embodiments of the present disclosure,
• 2 schematically a vehicle and trigger events according to embodiments of the present disclosure, and
• 3 FIG. 12 is a flow chart of a monitoring method according to embodiments of the present disclosure.

Embodiments of the Disclosure

Unless otherwise noted, the same reference symbols are used below for the same elements and those with the same effect.

1 1 schematically shows a vehicle 10 having a monitoring system 100 according to embodiments of the present disclosure.

The monitoring system 100 comprises an environment sensor system 110 with two or more different sensor types (e.g. camera and ultrasound), the environment sensor system 110 being set up to react to at least one trigger event in relation to the vehicle 10 and/or a vehicle environment using the two or more sensor types to capture data surrounding the vehicle 10; at least one storage unit 120, which is set up to store the environmental data recorded by the environmental sensor system 110; and a communication unit 130, which is set up to transmit the environmental data stored in the at least one storage unit 120 to an external unit 20 upon request.

Surroundings sensor system 110 is preferably set up to detect the surrounding data of vehicle 10 when vehicle 10 is parked in response to the at least one trigger event.

The communication unit 130 can be connected to the external unit 20 via a communication link 1 . Communication link 1 between communication unit 130 and the external entity 20 may be over a mobile network, such as an LTE network or 5G network, in some embodiments. Typically, the communication unit 130 includes a SIM unit that enables communication over the mobile network.

In some embodiments, the monitoring system 100 can receive the request for transmission of the environmental data stored in the at least one storage unit 120 from the external unit 20 . In response to the request, the monitoring system 100 transmits the environmental data stored in the at least one storage unit 120 to the external unit 20, optionally after an authorization check.

In another exemplary embodiment, the request may be made using a user interface.

The user interface can be, for example, a user interface integrated in the vehicle, such as a control panel, a touchscreen, a head-up display, etc. In response to the request received in the user interface, the monitoring system 100 transmits the environmental data stored in the at least one memory unit 120 the external unit 20, possibly after an authorization check.

In a further example, the user interface can be a mobile device, in particular a mobile device belonging to the vehicle owner. In response to the request received on the mobile terminal, the monitoring system 100 transmits the environmental data stored in the at least one storage unit 120 to the external unit 20, optionally after an authorization check.

In some embodiments, the external unit 20 can be the mobile terminal, i.e. the environmental data stored in the at least one storage unit 120 is transmitted to the mobile terminal. Alternatively, the mobile terminal and the external unit 20 can be separate units. For example, the mobile terminal can be a smartphone and the external unit 20 can be a central unit such as a server or a backend.

In some embodiments, the monitoring system 100 may be configured to encrypt the captured environmental data prior to transmission to the external entity 20 . For example, the monitoring system 100 can be set up to store the encrypted environment data in the at least one storage unit 120 . In a further specific embodiment, the monitoring system 100 can be set up to store the environmental data in unencrypted form in the at least one storage unit 120 . In this case, the unencrypted environment data can only be encrypted before being transmitted to the external unit 20 .

Additionally or alternatively, the monitoring system 100 can be set up to transmit the environmental data stored in the at least one storage unit 120 to the external unit 20 in an anonymized form. For example, the monitoring system 100 can be set up to store the recorded environmental data anonymously in the at least one storage unit 120 . In a further specific embodiment, the monitoring system 100 can be set up to store the environmental data in non-anonymized form in the at least one storage unit 120 . In this case, the non-anonymized environmental data can only be anonymized before it is transmitted to the external unit 20 .

2 10 schematically shows a vehicle 10 and trigger events TE1, TE2 according to embodiments of the present disclosure.

The trigger event TE1, TE2 can be a trigger event related to the vehicle, such as damage to the vehicle. For example, the monitoring system can use a microphone and/or a camera to detect that the vehicle has been damaged, for example by another vehicle or a person in the vicinity of the vehicle.

In addition or as an alternative, the trigger event TE1, TE2 can be a trigger event in relation to the vehicle environment, such as the occurrence of a hazardous situation in the vehicle environment. The dangerous situation in the area surrounding the vehicle can be an acoustic alarm, a visual alarm, a traffic accident, etc., for example.

The environmental sensors of the vehicle 10 are set up to capture environmental data of the vehicle 10 in response to at least one trigger event TE1, TE2 in relation to the vehicle 10 and/or a vehicle environment using two or more sensor types.

In some embodiments, the sensory environment of the vehicle 10 may include one or more sensors selected from or consisting of an acoustic sensor, a camera, an ultrasonic sensor, a laser scanner, a radar sensor, and a lidar sensor.

The environmental sensors can have a detection range U, which can be different for different sensor types and/or sensor positions on the vehicle and/or situational conditions (day, night, fog, etc.).

The at least one trigger event can be inside or outside of the detection range U. In the 2 a first trigger event TE1 within the detection range U and a second trigger event TE2 outside the detection range U are shown as an example.

If the first trigger event TE1 is, for example, an alarm system of another vehicle, the environment sensors can, under suitable circumstances, immediately detect the first trigger event TE1. If the second trigger event TE2 is, for example, an alarm system of another vehicle, the environmental sensors cannot directly detect the first trigger event TE1, but under certain circumstances a perpetrator fleeing the crime scene if he moves through the detection area U.

In some embodiments, the monitoring system is configured to directly detect the at least one trigger event. For example, an acoustic sensor of the environmental sensor system can be used to detect a trigger event, such as an alarm system being triggered. Similarly, an optical sensor of the environmental sensor system can detect an accident, for example.

In addition or as an alternative, the monitoring system can be set up to receive information relating to the at least one trigger event indirectly from a source external to the vehicle. The off-vehicle source can be, for example, a server, another vehicle, or a person in the vicinity of the vehicle. For example, the information relating to the at least one trigger event can include or be an instruction from the vehicle-external source to activate the environment sensors or to record the environment data.

Typically, the monitoring system is set up to switch the environment sensors from a sleep mode to an operating mode in response to the at least one trigger event. In particular, the environment sensors can be at least partially switched off, for example because the vehicle is parked and there are no occupants in the interior. The sleep mode of the environmental sensors ensures that the vehicle's energy consumption is reduced. In response to the at least one trigger event, the environment sensors can be at least partially woken up in order to capture the environment data.

3 FIG. 3 schematically shows a flowchart of a monitoring method 300 according to embodiments of the present disclosure. The monitoring method 300 may be implemented by appropriate software executable by one or more processors (eg, a CPU).

In block 310, the monitoring method 300 includes acquiring environmental data of the vehicle by an environmental sensor system of the vehicle in response to at least one trigger event relating to the vehicle and/or a vehicle environment, the environmental data being acquired using two or more sensor types of the environmental sensor system will; in block 320, the recorded surroundings data are stored in at least one memory unit of the vehicle; in block 330, receiving a request to transmit the stored environmental data to an external entity; and in block 340, transmitting the stored environmental data to the external unit.

According to the invention, after an event has occurred, the environmental sensors of a vehicle are used to record potentially relevant data relating to the event. For example, if a dangerous situation occurs, such as the triggering of an alarm system or an escape from an accident, an instruction can be sent to locally relevant vehicles via a cloud, so that the vehicles activate their environmental sensors to record the incident. Data can be recorded from different perspectives and by different sensors (e.g. cameras, lidar, ultrasound and/or acoustic sensors). As a result, security in a vehicle environment can be improved and/or a crime clear-up rate can be increased, in particular since situations that are otherwise not recorded by recording can be recorded by vehicles that are present.

Although the invention has been illustrated and explained in more detail by means of preferred exemplary embodiments, the invention is not restricted by the disclosed examples and other variations can be derived therefrom by a person skilled in the art without departing from the protective scope of the invention. It is therefore clear that a large number of possible variations exist. It is also understood that exemplary embodiments are really examples only and should not be construed in any way as limiting such as the scope, uses or cons figuration of the invention are to be understood. Rather, the preceding description and the description of the figures enable the person skilled in the art to concretely implement the exemplary embodiments, whereby the person skilled in the art, knowing the disclosed inventive idea, can make a variety of changes, for example with regard to the function or the arrangement of individual elements mentioned in an exemplary embodiment, without having to Leaving the scope of protection defined by the claims and their legal equivalents, such as further explanations in the description.

Claims (10)

Monitoring system (100) for a vehicle (10), comprising: an environment sensor system (110) with two or more sensor types, wherein the environment sensor system (110) is set up, in response to at least one trigger event (TE1, TE2) in relation to the vehicle 10 and/or a vehicle environment using the two or to capture more sensor types environmental data of the vehicle (10); at least one storage unit (120) which is set up to store the environmental data recorded by the environmental sensors (110); and a communication unit (130) which is set up to transmit the environmental data stored in the at least one storage unit (120) to an external unit (20) upon request. The surveillance system (100) after claim 1 , wherein the monitoring system (100) is set up to detect the at least one trigger event (TE1, TE2), in particular wherein the environmental sensor system (110) is set up to detect the at least one trigger event (TE1, TE2); and / or wherein the monitoring system (100) is set up to receive information relating to the at least one trigger event (TE1, TE2) from a vehicle-external source, in particular wherein the vehicle-external source is selected from the group consisting of a server , another vehicle and a person in the vicinity of the vehicle. The surveillance system (100) after claim 1 or 2 , wherein the monitoring system (100) is set up to move the environmental sensors (110) in response to the at least one trigger event (TE1, TE2) from a sleep mode to an operating mode; and or The monitoring system (100) according to any one of the preceding claims, wherein the environmental sensor system (110) comprises at least one first sensor and at least one second sensor, wherein the at least one first sensor is set up to detect the at least one trigger event (TE1, TE2) while the at least one first sensor is in an operating mode is and wherein the monitoring system (100) is set up to switch the at least one second sensor from a sleep mode to an operating mode in response to the at least one trigger event (TE1, TE2) detected by the at least one first sensor in order to detect the environmental data : wherein the at least one first sensor can be a microphone, and/or wherein the at least one second sensor can be selected from the group consisting of a camera, an ultrasonic sensor, a laser scanner, a radar sensor and a lidar sensor. The monitoring system (100) according to any one of the preceding claims, wherein the at least one trigger event (TE1, TE2) in relation to the vehicle (10) is damage to the vehicle (10), and/or wherein the at least one trigger event (TE1, TE2) in relation to the vehicle environment is the occurrence of a hazardous situation in the vehicle environment. The monitoring system (100) according to any one of the preceding claims, wherein the monitoring system (100) is set up to encrypt the captured environmental data before transmission to the external unit (20), in particular wherein the monitoring system (100) is set up to encrypt the encrypted store environmental data in the at least one storage unit (120); and/or wherein the monitoring system (100) is set up to transmit the environmental data stored in the at least one storage unit (120) anonymously to the external unit (20), in particular wherein the monitoring system (100) is set up to anonymize the recorded environmental data to be stored in the at least one memory unit (120). The monitoring system (100) according to any one of the preceding claims, wherein the environment sensor system (110) is set up to record the environment data of the vehicle (10 ) capture. Vehicle (10), in particular a motor vehicle, comprising the monitoring system (100) according to one of Claims 1 until 7 . Monitoring method (300) for a vehicle, comprising: detecting (310) environmental data of the vehicle by an environmental sensor system of the vehicle in response to at least one trigger event in relation to the vehicle and/or a vehicle environment, the environmental data using two or more sensor types of the environmental sensors are detected; Saving (320) the captured environmental data in at least one memory unit of the vehicle; receiving (330) a request to transmit the stored environmental data to an external entity; and transmitting (340) the stored environmental data to the external unit. Storage medium comprising a software program arranged to be executed on one or more processors, and thereby the monitoring method (300) according to claim 9 to execute.

Images