DE102017223176A1 - Method for processing sensor data of a vehicle - Google Patents

Abstract

The invention relates to a method for processing sensor data of a vehicle, wherein sensor data which can be generated or generated by means of at least one sensor device is assigned a processing priority which is determined by a vehicle-external device, so that these are processed according to their processing priority by means of a processing device in the vehicle.

Description

Technical area

The invention relates to a method for processing sensor data of a vehicle.

The invention further relates to a processing system for sensor data.

The invention further relates to a device for processing sensor data for use in a vehicle, in particular a motor vehicle.

Although the present invention is generally applicable to any devices, the present invention will be described with respect to a device in a motor vehicle.

State of the art

Today's vehicles include a plurality of sensors, for example in the form of ABS sensors, temperature sensors or the like, whose data is collected by the vehicle and evaluated in this. Particularly with regard to partially autonomous or fully autonomous driving of vehicles, an ever increasing amount of data accumulates, which has to be stored and processed in the vehicle.

Disclosure of the invention

In one embodiment, the invention provides a method for processing sensor data of a vehicle, wherein sensor data that can be generated or generated by at least one sensor device is assigned a processing priority that is determined by a vehicle-external device, so that these are processed according to their processing priority by means of a processing device in the vehicle are processed.

In another embodiment, the invention provides a sensor data processing system comprising at least one vehicle including sensor means configured to generate sensor data and including processing means for processing sensor data by the aforementioned method and including a vehicle sensor system. external device connected to the processing device of the vehicle and configured to assign a processing priority to the generated or producible sensor data so that it is processed according to its processing priority by the processing device of the vehicle.

In a further embodiment, the invention provides a device for processing sensor data for use in a vehicle, in particular a motor vehicle, comprising a sensor device for generating sensor data, a processing device for processing sensor data, and a communication device which is connected on the one hand to the processing device, on the other hand connectable with a vehicle-external device, and is adapted to receive a processing priority for producible or generated sensor data of the vehicle and to transmit this to the processing means, so that the sensor data are processed according to their processing priority from the processing means.

One of the advantages achieved with this is that it optimizes the data yield, in particular data and its compression requirements for the effective use of storage in the vehicle can be determined independently of each other with processing priorities from an external device, for example a cloud service or the like. Another advantage is that efficient use of the vehicle's computing and storage resources is enabled.

Further features, advantages and further embodiments of the invention are described below or become apparent:

According to an advantageous development, the processing priority is dependent on processing capacities of the processing device in the vehicle, in particular available computing power and / or available storage space of the processing device in the vehicle and / or this is adapted to a bandwidth of an external communication link. In this way, the processing of sensor data can be flexibly adapted to changing processing capacities in the vehicle. If processed sensor data are to be transmitted to an external computing device for further processing, the processing and / or the generation of the sensor data can be prioritized accordingly.

According to a further advantageous development, the processing priority is adjusted as a function of a vehicle movement state. For example, if a vehicle is at a standstill, only a small amount of computing power is needed to autonomously drive the vehicle. During this time, sensor data from other sensors, for example, can be read in, compressed and, where appropriate, preprocessed and then later further processed or transferred to the vehicle-external device for further processing.

According to a further advantageous embodiment, the processing priority is at regular intervals and / or due to advance adjusted events and / or adjusted on request. This makes it possible in a particularly flexible way to adapt the processing priority in particular to changing external conditions in a timely manner.

According to a further advantageous development, the processing priority for at least a part of the generated sensor data is determined by a user of a vehicle. Thus, for example, an optimal use of the vehicle-non-critical data can be determined. Thus, for example, vehicle ancillary functions such as multimedia applications, comfort functions or the like can be provided at the request of the driver with a lower priority or individual vehicle functions can be weighed against each other by the driver according to his needs.

According to a further advantageous refinement, the vehicle-external device requests sensor data of at least one predetermined data type from a plurality of further vehicles and compares received data in accordance with its data type. This makes it possible, for example, vehicles that are close to each other or drive, using sensor data, such as GPS signals, to recognize and adjust their sensor data, for example, in relation to weather, road conditions or the like. This data can be forwarded to a traffic control center, which then according to the data, for example, a speed limit dynamically switches in a given stretch of road.

According to a further advantageous development, the processing priority for the data type of the adjusted data in at least one of the respective vehicles is lowered for a given match of the adjusted data. If, for example, the data are sufficiently accurate or agree in a predefinable measure, the generation of the sensor data and / or its processing in one or more vehicles can be correspondingly reduced, since sufficiently accurate data are already available to the vehicle-external device. In this way, the resources in each vehicle can be better utilized.

According to a further advantageous development, generated or producible sensor data and / or available data types of sensor data are displayed by the vehicle of the vehicle-external device and the latter requests the generated or producible sensor data and / or sensor data of available data types from the vehicle in accordance with predefinable parameters, in particular also evaluates these out. This makes it possible, for example, for vehicles to provide information to the vehicle-external device and then to request the data. This requested data can then be transmitted by the vehicle, for example, regularly to the vehicle-external device until the vehicle-external device indicates to the vehicle that no further data or data of a corresponding data type are needed.

According to a further advantageous refinement, generated or producible sensor data and / or sensor data of available data types are transmitted to the vehicle-external device at regular time intervals and / or on the basis of predetermined events and / or on request by the vehicle. Thus, for example, a vehicle-external device, if this weather data includes a vehicle that are not unique or contradictory, request corresponding data from other vehicles. This further increases the reliability of the processing of the sensor data and, if appropriate, its associated services.

According to a further advantageous development, rain, light, position, orientation, temperature, speed and / or acceleration are detected by means of the sensor device, in particular by means of an optical sensor, ultrasonic sensor, radar sensor or the like. Thus, a variety of interesting data can be generated in a flexible manner.

Further important features and advantages of the invention will become apparent from the subclaims, from the drawings, and from associated figure description with reference to the drawings.

It is understood that the features mentioned above and those yet to be explained below can be used not only in the particular combination given, but also in other combinations or in isolation, without departing from the scope of the present invention.

Preferred embodiments and embodiments of the invention are illustrated in the drawings and will be described in more detail in the following description, wherein like reference numerals refer to the same or similar or functionally identical components or elements.

list of figures

• 1 shows in schematic form a processing system according to an embodiment of the present invention.
• 2a shows a flowchart with steps of a method according to an embodiment of the present invention.
• 2 B in schematic form a main function for operating individual functions with steps of a method according to an embodiment of the present invention.
• 3a-c show steps of a method according to an embodiment of the present invention.
• 4 shows an on-vehicle device according to an embodiment of the present invention and
• 5 shows a device for processing sensor data for use in a vehicle according to an embodiment of the present invention.

Embodiments of the invention

1 shows in schematic form a processing system according to an embodiment of the present invention.

In 1 is a processing system 10 with a vehicle-external device 3 shown as well as two vehicles 1a and 1b , Every vehicle 1a . 1b has a sensor device 2a . 2 B , a processing device 5a . 5b with one or more processors and a communication device 6a . 6b who are in communication connection 4a . 4b with the vehicle-external device 3 stands. Furthermore, each vehicle includes 1a . 1b one or more memories 7a . 7b For example, a hard disk for multimedia data, RAM for navigation data, et cetera.

2a shows a flowchart with steps of a method according to an embodiment of the present invention and 2 B in schematic form a main function for operating individual functions with steps of a method according to an embodiment of the present invention.

In 2a are steps 100 for collecting data if memory resources are sufficient for this purpose. The collected data is then stored in memory 7a . 7b saved if there is enough space available in them. In detail, in a first step 101 Data collected. In a second step 102 Checks if there is enough space in memory 7a . 7b is available. If there is still enough storage space available, data that is generated by the sensor device will continue to be collected. In a third step 103 is checked if there is still enough computing capacity in the vehicle 1a . 1b to collect or provide data. If space or computing capacity is no longer sufficient, the data will be in a fourth step 104 summarized and then in a fifth step 105 In the storage room 7a . 7b saved.

With reference number 200 are shown steps for a particularly compute-intensive processing of data. This is done first in one step 202 checks if data is available for processing and if enough space is available (step 203 ) and enough computing power (step 204 ) are available to process the data (steps 201 and 205 ). When the data is fully processed, the data is in one step 206 in the store 7a . 7b saved.

With reference number 300 steps are shown for sending data as soon as preprocessed data is available, enough computing power is available for sending and the bandwidth is sufficient. It is checked in detail whether data is available (step 302 ), which should be sent, if enough bandwidth is available (step 303 ) and if enough computing power (step 304 ) is available for sending the data. If these conditions are fulfilled, the data will be sent (steps 301 and 305 ) by putting the data out of memory 7a . 7b be read out and sent.

For all steps 100 . 200 . 300 applies: Different data or data types, such as location data, temperature data, et cetera can be provided with different processing priorities of a vehicle-external device that can be adjusted depending on the available memory of the processing power of a processing device.

If, for example, due to a lack of availability or utilization of a resource, that is to say computing capacity, memory and bandwidth, there is a large time delay, then the function 100 . 200 . 300 and the stored data is deleted, in other words, a limited "durability" of data and functions 100 . 200 . 300 equals. This can be implemented, for example, by a negative processing priority for the data.

The "durability" is a parameter that is a function 100 . 200 . 300 can be assigned. There is no need for a function 100 . 200 . 300 so the service provider can 3 also send information to other vehicles that the function is no longer relevant and can be dropped.

A function can also be assigned a durability depending on a current state, situation or the like, in particular parameterizable. For example, a function can only be used for certain times, at certain locations or may be required, requested or performed and discarded after leaving the time period, location or the like.

The under the reference numerals 100 . 200 . 300 described respective steps can be carried out independently of each other or carried out. A parent function 400 can both the individual steps 100 . 200 . 300 and monitor and regulate their interaction.

In 2 B is now a superordinate main function 500 which is an administration of functions sent to a vehicle 400 . 401 . 402 , ... performs.

In a vehicle can have multiple functions 400 . 401 . 402 with different priority and different dependency of moment characteristics, ie current state, situation or the like such as location, time, temperature, ... are stored. The main main function 500 can then none, one or more functions 400 . 401 . 402 , ... with the highest priorities and the appropriate momentary property, such as location, time, temperature, ... be processed or canceled or discarded.

It is conceivable that, for example, camera images from interesting areas are recorded during the journey and stored in a currently available free memory of a multimedia unit of a vehicle, since this currently still has free memory available. If there is then computing power available, this data will be evaluated, processed and sent to free the memory again. If no computing power is available, but a renewed higher priority request to collect data, the previously collected data is discarded. Since the degree of compression and / or the data interest may be prioritized differently - in other words, may have different processing priorities - the vehicle may be optimized for both its available computational power and its available memory and the available data channel for sending the data. Since the available in the vehicle amount of interesting data on the evaluable and dispatchable amount of data can be optimal use of the vehicle as a sensor or in other words "data supplier" achieved in particular when its computing power, storage capacity and bandwidth of its data connection are maximized.

It is therefore conceivable that the collection of data is coupled with a business model and the value of the data depends on their interests. For example, if the vehicle is being moved in a low-traffic area, data related thereto may be temporarily of greater importance and thus provided with a higher processing priority. One example is capturing image information from the vehicle's perspective. If in the areas in which the vehicle is driving, no images collected or known but an interest in images available, the service would provide this data with higher priority, so with higher processing priority, and thus possibly rated higher monetary. This could, for example, be remunerated to the driver if his vehicle collects this data. If the vehicle leaves the area again, the processing priority is lowered again, that is to say the collection, the computation-intensive processing and / or the sinking are carried out with reduced priority and / or stopped altogether.

3a-3c show steps of a method according to an embodiment of the present invention.

In the 3a-3c are two vehicles 1a . 1b shown over communication links 4a . 4b with a vehicle-external device 3 in the form of a service provider 3 are connected. The two vehicles 1a . 1b serve as data providers for the service provider 3 and each comprise a service coordination unit 11a . 11b to coordinate the data and services with the service provider 3 who are in as well 5 are described. In a first step S1a, S1b offer the two vehicles 1a 1b over the communication connection 4a . 4b Services based on, for example, computing power, available memory space, customer shares or the like ( 3a) , In a second step S2a, S2b according to 3b now initiates the service provider 3 a desired service on the vehicle 1a . 1b in which he has a corresponding initiation code for the corresponding service to the respective vehicle 1a . 1b transmitted. This may contain appropriate processing priorities for the desired data. The vehicle 1a . 1b then provide the corresponding service or data to the service provider 3 ready. If the data or the service is no longer needed, the service provider sends 3 in a third step S3a . s3b the respective vehicle 1a . 1b a corresponding deactivation code. The vehicle 1a . 1b then stops providing the data or the service.

4 shows a vehicle-external device according to an embodiment of the present invention.

In 4 is in detail and in schematic form a vehicle-external device 3 in shape a server provider 3 shown. The service provider 3 includes components for managing services / services 31 and a roster 32 , The administrative component 31 again includes other components for billing 31111 , for the management of vehicles with corresponding services 3111 and a parent service action unit 311 , The roster component 32 again comprises subcomponents 321 - 324 , in the function of the position (reference numeral 321 ), the time / date (reference numeral 322 ), events (reference numerals 323 ) as well as external conditions (reference numerals 324 ) such as temperature or the like can provide different services.

In one embodiment of the invention, the service provider 3 provide services or services based on different data from different sources. This data can be data from vehicles 1a . 1b his. Which data comes from which source may depend on the type of service. There are services that require data depending on location, time, status, event, ... Depending on the location, time, status, event, ... as well as availability of resources results for different vehicles 1a . 1b the ability to perform services. vehicles 1a . 1b In particular, their available and shared resources can be regularly used by the service provider 3 which then uses the resources offered to generate the best possible service and possible vehicles 1a . 1b then "subtask" them with subtasks (collect and possibly pre-process data) and set the processing priorities. Is a service in the service provider 3 generated, the service manager controls 31 the service. He chooses the target vehicles 1a . 1b for subfunctions and sends Campaign Manager through the service 311 these sub-functions on one or more target vehicles 1a . 1b , The benefit of the vehicles 1a . 1b , more precisely their resources through the service provider 3 can also be settled in monetary terms and for example the owner of the vehicles 1a . 1b be credited.

• - Bei aufziehendem Schneesturm in einer Region sind Daten über Reibwerte, Regen/Schnee und die Temperatur interessant, wenn sich die Fahrzeuge in der entsprechenden Region aufhalten, in der es Schnee geben soll (Mögliche betroffene Sensoren in den Fahrzeugen: Regen/Licht Sensor, GPS, Temperatur).
• - Kommt es zu einem Verkehrsstau auf einer Autobahn, ist beispielsweise eine hochauflösende Verkehrsdichtemessung auf den umliegenden Ausweichstrecken relevant für einen Verkehrsservice/Navigation (Mögliche betroffene Sensoren in den Fahrzeugen: Kamera, Ultraschallsensor, Radarsensor, GPS, Geschwindigkeit, Fahrtrichtung).
• - Fallen in einer Straße die Straßenlaternen aus, so können Fahrzeuge, die dort parken, ihr Parklicht automatisch einschalten, wenn genug Rechenleistung/ Energiekapazität zur Verfügung steht. Ist genug Rechenleistung verfügbar könnte über das Kamerasystem zusätzlich eine Personenerfassung durchgeführt werden, so dass beim Erscheinen von Personen die Leuchtstärke erhöht wird. Letztere Personenerfassung könnte mit einer niedrigeren Verarbeitungspriorität versehen werden, sodass, wenn die Rechenleistung wieder sinkt, lediglich wieder das Einschalten des Parklichts, da dieses eine höhere Verarbeitungspriorität aufweist, vorgenommen wird.

Examples of services are shown below:

• - When a snowstorm occurs in a region data on friction, rain / snow and temperature are interesting, if the vehicles are in the appropriate region in which there is snow (possible affected sensors in the vehicles: rain / light sensor, GPS , Temperature).
• - If traffic congestion occurs on a motorway, for example, a high-resolution traffic density measurement on the surrounding alternative routes is relevant for traffic service / navigation (possible affected sensors in vehicles: camera, ultrasonic sensor, radar sensor, GPS, speed, direction of travel).
• - If street lights are lost in a street, vehicles parked there can automatically switch on their parking lights if there is enough computing power / energy capacity available. If enough computing power is available, an additional person detection could be carried out via the camera system, so that the luminosity is increased when people appear. The latter person detection could be provided with a lower processing priority, so that when the computing power drops again, only the switching on of the parking light, since this has a higher processing priority, is made.

5 shows a device for processing sensor data for use in a vehicle according to an embodiment of the present invention.

In detail is in 5 in schematic form to the vehicle 1 shown which is a service coordination unit 11 includes, with services or data 9 that a service provider 3 can be provided. In addition, the service coordination unit includes 11 a service management facility 5 ' and a resource management facility 5 ' , which in turn is a communication device 6 , a storage device 7 , a computing device 5 and a vehicle state determination device 8th includes. The communication device 6 includes a mobile radio module 6 ' and a WLAN module 6 " , The storage device 7 includes a multimedia data store 7 " and a vehicle data memory 7 ' , The vehicle condition determination device 8th includes several modules 8th' . 8th'' . 8th''' . 8th'''' , ..., being a module 8th' is designed to determine the state of motion, so whether the vehicle is driving, parking or stands and where another module 8th" is designed to determine the state of available energy, be it electrical energy or level of a tank or the like, and wherein another module 8th''' is designed for navigation, for example, to determine the position of the vehicle or a part / portion of a planned trip.

In detail is the service management facility 5 ' , trained functions, services and actions of a vehicle control unit, which collect data, preprocess and / or forward, manage the resource management device 5 ' Again, it is designed to manage appropriate resources according to their processing priorities as mentioned above.

• • Dynamische und effektive Nutzung von Speicher und Rechenleistung in einem Fahrzeug
• • Hohe Flexibilität
• • Einfache Implementierung
• • Hohe Effizienz

In summary, at least one of the embodiments has at least one of the following advantages:

• • Dynamic and effective use of memory and computing power in a vehicle
• • High flexibility
• • Simple implementation
• • High efficiency

Although the present invention has been described in terms of preferred embodiments, it is not limited thereto, but modifiable in a variety of ways.

Claims (12)

Method for processing sensor data of a vehicle (1a, 1b), wherein sensor data which can be generated or generated by means of at least one sensor device (2a, 2b) is assigned a processing priority which is determined by a vehicle-external device (3), so that these correspond to their processing priority by means of a processing device (5a, 5b) in the vehicle (1a, 1b) are processed. Method according to Claim 1 in which the processing priority is dynamically adapted to changing processing capacities in the vehicle (1a, 1b), in particular available computing power and / or available storage space of the processing device (2a, 2b) in the vehicle and / or to a bandwidth of an external communication link (4a, 4b) becomes. Method according to one of Claims 1 - 2 wherein the processing priority is adapted to a vehicle movement state. Method according to one of Claims 1 - 3 wherein the processing priority is adjusted dynamically, at regular intervals and / or on the basis of predetermined events and / or on request. Method according to one of Claims 1 - 4 wherein the processing priority for at least a portion of the generated or producible sensor data is determined by a user of a vehicle (1a, 1b). Method according to one of Claims 1 - 5 in which the vehicle-external device requests sensor data of at least one predetermined data type from a plurality of further vehicles (1a, 1b) and compares received data according to their data type. Method according to Claim 6 wherein, given a match of the adjusted data, the processing priority in at least one of the respective vehicles (1a, 1b) is lowered. Method according to one of Claims 6 - 7 in which generated or producible sensor data and / or available data types of sensor data are displayed by the vehicle (1a, 1b) of the vehicle-external device (3) and these corresponding predefinable parameters are the generated or producible sensor data and / or sensor data of available data types from the vehicle (1a , 1b) and in particular evaluates. Method according to Claim 8 in which generated or producible sensor data and / or sensor data of available data types are transmitted to the vehicle-external device (3) at regular intervals and / or on the basis of predefined events and / or on request from the vehicle (1a, 1b). Method according to one of Claims 1 - 9 , wherein by means of the sensor device (2a, 2b) rain, light, position, orientation, temperature, speed and / or acceleration is detected, in particular by means of an optical sensor, ultrasonic sensor, radar sensor or the like. Processing system (10) for sensor data, comprising at least one vehicle (1a, 1b) which comprises a sensor device (2a, 2b) which is designed to generate sensor data, and which comprises a processing device (5a, 5b) for processing sensor data, in particular according to one of the preceding claims , and a vehicle-external device (3), which is connected to the processing device (5a, 5b) of the vehicle (1a, 1b) and which is designed to assign a processing priority to the generated or producible sensor data, so that these are processed by the processing device according to their processing priority (FIG. 5a, 5b) of the vehicle (1a, 1b) are processed. Device for processing sensor data, in particular according to one of the methods of Claims 1 to 10 , for use in a vehicle (1a, 1b), in particular a motor vehicle, comprising sensor means (2a, 2b) for generating sensor data, processing means (5a, 5b) for processing sensor data, and communication means (6a, 6b), on the one hand connected to the processing device (5a, 5b), on the other hand connectable to a vehicle-external device (3), and is adapted to receive a processing priority for producible or generated sensor data of the vehicle and to transmit them to the processing means (5a, 5b) so that the sensor data are processed according to their processing priority by the processing means (5a, 5b).

Images