DE102019206718A1 - Process for the personalized use of means of communication - Google Patents

Abstract

A method is disclosed for the personalized provision of information to at least one person (11) in a vehicle (100) by a control device (40), with parameters of the at least one person (11) being determined and stored, a selection of at least one communication means ( 20, 21, 22, 23) is carried out, the communication means (20, 21, 22, 23) being optimally selected based on the parameters determined for the person (11) and the at least one selected communication means (20, 21, 22, 23 ) is used to output information to the person (11). A system (10) is also disclosed.

Description

The invention relates to a method for the personalized provision of information to at least one person in a vehicle and a control device.

State of the art

There are various functions or assistance systems in vehicles that communicate with the driver or other people. Communication means on the vehicle are used for this. Such communication means can, for example, be screens which display information or warnings to the driver.

The driver assistance systems can be, for example, lane departure warning systems, emergency braking assistants, collision warning systems or automated driving functions. In connection with the information system on the vehicle side, a large amount of information arises which has to be handled by the people in the vehicle. The driver's ability to react can decrease as the amount of information displayed and the possible means of communication increases.

Methods are already known with which the driver can define the preferred means of communication in advance. In particular, certain functions of the vehicle can use preferred means of communication. For example, haptic feedback can be generated on the steering wheel when the lane departure warning system issues a warning. When a call is made via a hands-free system, the relevant information can be shown on a screen or a head-up display. The large number of possible means of communication can confuse the driver when operating the vehicle. In particular, when paying attention to a communication medium, a warning or information from another communication medium can be ignored.

Disclosure of the invention

The invention is based on the object of creating a method which automatically selects a means of communication in such a way that the response time or other variables identified as being essential for traffic safety are increased or optimized.

This object is achieved by the features specified in claim 1 and claim 10. Further advantageous embodiments of the invention are described in the subclaims.

According to one aspect of the invention, a method for the personalized provision of information to at least one person in a vehicle is provided. The method can preferably be carried out by a control device which can be connected to at least one communication means. In particular, the control device can be set up to select at least one communication medium or to provide a function for selection.

In a step, parameters of the at least one person are determined and stored to enable personalized provision of communication means. In a further step, at least one communication means is selected on the basis of the determined parameters. The at least one selected means of communication is then used to output information to the person. The parameter or parameters are person-dependent or individual and can be determined as part of a learning phase. In particular, parameters that are optimized for a person are available. In particular, the parameters can be dependent on the means of communication used. The parameters can be used to describe a person-related or individual reaction behavior to the means of communication used. In particular, the determined parameters can be used to select communication means to which a person speaks or reacts particularly effectively. The at least one determined communication means can be transmitted to the functions or systems of the vehicle as part of a proposal or a recommendation. The respective functions or systems can then decide whether the determined means of communication is used for input or output.

According to a further aspect of the invention, a system with at least two communication means for outputting and / or receiving information is provided. The system has at least one control device for controlling the at least two communication means. The control device is set up to carry out the method according to the invention. The control unit can be used as a separate device or be designed as a module of an existing control unit. Alternatively, the control device can be implemented in the form of software that can be integrated into an existing module, system or function. The method can, for example, be carried out in parallel with other tasks of the function.

The method and the system can be used to create a knowledge model that is set up to learn and store the behavior of the at least one person. During a defined learning phase, parameters such as behavior and reactions of the person can be determined. After the learning phase, the knowledge generated can be used in the form of parameters to select at least one means of communication. The user-specifically selected means of communication is adapted to the person and is perceived most efficiently by the person. This allows optimized output of information or warnings via communication means without input from the driver or a passenger, in which, for example, the reaction times are minimal.

The knowledge model can take into account the fact that people react differently to stimuli. Some people can react more intensively or more efficiently to graphical outputs, audio outputs, haptic feedback or combined outputs. In particular, the reaction to the output or the output communication means can be dependent on the content or the type of information. These factors can be taken into account in the form of parameters by the knowledge model.

The knowledge model can be used to automatically learn how information and warnings are most efficiently transmitted to a person with regard to the reaction time.

By storing or storing the parameters collected about the person, this information can be used generically in order to present information to the person. In particular, the preferred or automatically selected communication means can be used by various functions of the vehicle for information output.

In the learning phase, depending on the function of the vehicle in particular, a communication medium that is optimally determined for the respective function during the development phase can be selected. Before determining the optimal means of communication during the learning phase, for example, a preset means of communication can be used by the respective functions or systems. The preset communication means can be used to carry out initial measurements to determine the parameters, such as the reaction time.

The knowledge model can be designed as a simulation model, an algorithm, an artificial intelligence and the like. The knowledge model can be implemented as a user model for one or more people.

Furthermore, additional boundary conditions, for example situation-dependent boundary conditions, such as time of day, brightness, weather conditions, distraction of the driver, drowsiness of the driver and the like, can be taken into account when selecting the means of communication using the parameters. Through the learning phase or the utilization of the parameters, one or more means of communication can be selected which are optimally adapted to the needs of the person and the respective function of the vehicle. The function, such as the assistance function, can access the means of communication and interact with the person via the at least one means of communication.

The parameters can preferably be personalized or individual parameters which are assigned to a person. Different sets of parameters can be assigned to different people. The parameters can be a result of a learning phase or of inputs from the respective person. The parameters can be used to determine preferences, inclinations, preferences and the like of a person by evaluating the actions of the respective person in connection with functions of the vehicle. All measured values and information related to external influences, such as time of day, season, temperatures, can be summarized by situation-dependent parameters or boundary conditions.

In particular, the selection of the means of communication can be made depending on the situation and optimized for the at least one person. The selection can be carried out in particular adapted to a driving situation and / or to an interaction scenario. An interaction scenario can be, for example, a request to correct a steering wheel angle based on a warning from the lane departure warning system or a request to brake an emergency braking system or the selection of an infotainment function.

The method allows the communication means of the different driver assistance functions of the vehicle to be combined with the communication means of the infotainment in the vehicle in order, for example, to enable the simplest / clearest possible notification with minimal interruption to the current activity of the person in the vehicle. Alternatively or additionally, the information can be provided via the communication means in such a way that distraction or confusion of the driver is reduced and traffic safety is increased.

In addition, the number of items of information output via the communication means can be proportioned as a function of the situation. For example, the amount of information can be reduced in critical situations, such as braking maneuvers or cornering, in order to avoid distraction or confusion. In unproblematic situations, such as, for example, unhindered straight-ahead travel, the number of activated communication means and the number of information displayed can be increased. Depending on the parameters determined from the situation, certain means of communication and / or information outputs can be temporarily stopped or blocked so as not to disturb the driver's attention.

The selection of the means of communication can preferably be made differently and separately from person to person. Thus, an individual, personalized adaptation of the means of communication can be realized.

The determined parameters can indicate the direction of attention of the driver. The direction of attention or the current direction of gaze can be used to carry out an optimal output of important information or warnings.

Such an optimized selection of the means of communication for the provision of information can be used by all systems of the vehicle. In particular, the selection for the respective system can be adapted in combination with the learned interactions of the at least one person. In particular, the original means of communication from different systems can be combined or used jointly. For example, a voice output from an infotainment system can be used as a means of communication for a warning from an automated driving system.

In order to determine the parameters, interactions between the person can be evaluated. For this purpose, the person's inputs can be related to previous outputs from systems of the vehicle. The interactions can be evaluated in terms of the situation and the reaction speed of the person. An input of the person can take place, for example, by operating the steering wheel or the pedal, by voice input, operating controls and the like. The evaluation can be carried out depending on the situation. The location or vehicle location of the interaction and the boundary conditions of the interaction are taken into account. Subsequently, by selecting the means of communication, it can be decided how information, a warning or an instruction is optimally transmitted to the person.

The at least one person can be a driver or any other person in the vehicle who has access to functions of the vehicle.

The communication means can be selected in a particularly simple manner if the parameters are determined by measuring reaction times to outputs and / or instructions from the communication means of the vehicle. The parameters are preferably determined as a function of the situation. Thus, the communication between the person and the functions or systems of the vehicle can be tailored. The focus here may be on increasing the speed of reaction or, for example, reducing distraction.

The relevant parameters for adapting or selecting the means of communication can be defined in advance. In interactions where the driver's reaction is necessary, the reaction time for following the instruction can be weighted more heavily. The reaction time can be, for example, the time that elapses from an issued brake warning to the actuation of the brake pedal by the driver. Furthermore, the reaction time between a warning from the lane departure warning system and a corrective movement of the steering wheel can be measured. The response times will vary depending on the means of communication and the situation. A means of communication in which the reaction time was the lowest during the learning phase can be used for future warnings after such a learning phase.

According to one exemplary embodiment, the parameters are determined by evaluating interactions carried out by the at least one person, the parameters being determined depending on the person and / or depending on situation-dependent boundary conditions, such as a route traveled or environmental conditions, the time of day and the like. This allows the learning phase to be carried out particularly precisely.

It is advantageous to take into account the particular situation in which the response time is determined. For this purpose, for example, the user or user ID, time of day, journey time, season, number of people in the vehicle, direction of travel, speed, outside temperature, temperature inside the vehicle, forces acting on the person, secondary tasks and the like can be taken into account when selecting the means of communication. These boundary conditions or situation-dependent parameters can be determined and evaluated by the vehicle sensors.

The interactions carried out in connection with driver assistance functions can be distinguished from interactions with infotainment systems. For example, an interaction with a hands-free device begins by accepting a telephone call and ends by hanging up the call.

According to one embodiment, a selection of the at least one communication means of the vehicle is carried out adapted to a reaction speed of the at least one person and / or to a specification of the at least one person for an output. In this way, the reaction speed can be determined depending on the means of communication which is used for an output.

So that the implementation of the learning phase and the selection of the means of communication are adapted to a person, the person is identified in advance. This can be done, for example, by entering a number, by measurement data from a fingerprint sensor, by facial recognition of the person, by biometric voice recognition and the like.

Separate learning phases can be carried out for different people and different parameters can be determined. Thus, a user-dependent, optimal selection of communication media can be stored in the control device.

According to a further exemplary embodiment, the selection of the at least one communication medium is carried out by an algorithm, a simulation model and / or by an artificial intelligence, the situation-dependent boundary conditions determined being used as input variables for the algorithm, the simulation model and / or the artificial intelligence. As a result, the method can take into account external influences and can thus be carried out particularly precisely by the control device.

The control device can preferably be connected in a data-conducting manner to communication means of the vehicle's infotainment system, such as a human-vehicle interface, a graphic interface, a voice interface and the like. Furthermore, the control device can be connected to other communication means, such as output units for time or position, screens and head-up displays, audio outputs, haptic outputs from the steering wheel or the seat.

The respective functions or systems of the vehicle can preferably communicate to the control unit which action is necessary and which parameters are to be determined.

According to a further embodiment, the selected communication means are sent to at least one application, the at least one application being designed as a driver assistance system. In this way, an optimal means of communication can be assigned to each system so that an output channel can be used individually adapted to the person for the transmission of instructions or information.

According to a further exemplary embodiment, the at least one selected communication medium is assigned a priority depending on the determined parameters, the at least one selected communication medium being used based on the assigned priority and an urgency of a reaction by the at least one person for outputting information or instructions. Depending on the efficiency of the respective means of communication with regard to the reaction time of the person, a means of communication with a high priority can be selected in the case of warnings or critical instructions, with which the person can react the fastest. Communication means that have a lower priority can be used for information.

The selection of the communication means can be checked or adapted in many ways if the selection of the communication means for an output is updated continuously, at defined time intervals or based on an insufficient confidence of the calculated selection of the communication means. For example, the control unit can carry out the learning phase in the background. As soon as new results are found with regard to optimized means of communication, the person can receive a notification. The individually optimized means of communication can be presented to the person visually. After confirmation by the person, the updated selection of the means of communication can be effectively set. An inadequate confidence is preferably present when a confidence value of the learning process for determining the personalized parameters does not exceed a predefined value. Thus, if the confidence is not sufficiently high, the confidence is insufficient. For example, a predefined value can have a confidence of 80%.

Furthermore, the decision to change the selection can be implemented based on a confidence in the previous selection of the means of communication. The confidence can, for example, indicate how precise the calculation or the selection of the previous communication medium is. The boundary conditions for the confidence can be user-defined. The control unit may need a longer learning phase for greater confidence. The learning phase can be reduced by setting a lower confidence level.

According to a further embodiment, the at least one selected communication medium is communicated to the at least one person, the at least one selected communication medium being enabled by the at least one person. In this way, the control device can ask the at least one person about an update of the preset communication means. For example, a recommendation can be sent to the person, which increases their reaction speed in an emergency. The person can allow or reject the change in the selection of the means of communication by making an entry.

• 1 eine schematische Darstellung eines Systems gemäß einer ersten Ausführungsform der Erfindung zum Veranschaulichen einer Lernphase,
• 2 eine schematische Darstellung des Systems gemäß der ersten Ausführungsform der Erfindung zum Veranschaulichen einer Zuordnung von ausgewählten Kommunikationsmitteln,
• 3 eine schematische Darstellung eines Systems gemäß einer ersten Ausführungsform der Erfindung zum Veranschaulichen von Zugriffen auf Kommunikationsmittel, und
• 4 eine schematische Darstellung eines Fahrzeugs mit einem System.

Several exemplary embodiments of the invention are explained in more detail below with reference to the drawings. Show it:

• 1 a schematic representation of a system according to a first embodiment of the invention to illustrate a learning phase,
• 2 a schematic representation of the system according to the first embodiment of the invention to illustrate an assignment of selected communication means,
• 3 a schematic representation of a system according to a first embodiment of the invention for illustrating access to communication means, and
• 4th a schematic representation of a vehicle with a system.

In the 1 is a schematic representation of a system 10 shown according to a first embodiment of the invention to illustrate a learning phase. In particular, the 1 to 3 the method according to the invention illustrates. The system 10 is for example in a vehicle 100 built-in.

The system 10 according to the embodiment has several communication means 20th , 21st , 22nd , 23 to output information, instructions or warnings to at least one person 11 on.

The means of communication 20th , 21st , 22nd , 23 can be, for example, voice output means, graphic output units or screens, haptic feedback units and the like.

Furthermore are means of communication 30th , 31 , 32 , 33 intended for recording or reading in information. The means of communication 30th , 31 , 32 , 33 can input the person 11 accept and forward or process. The means of communication 30th , 31 , 32 , 33 can for example be designed as microphones, video cameras, control elements or buttons, touch-sensitive screens and the like.

The means of communication 20th , 21st , 22nd , 23 to carry out expenses and the means of communication 30th , 31 , 32 , 33 for receiving inputs can be configured as separate communication means or as combined input-output communication means.

Furthermore, the system 10 a control unit 40 to select the means of communication 20th , 21st , 22nd , 23 for outputting information and reading out communication media 30th , 31 , 32 , 33 to receive user input. In particular, the control unit 40 be set up for the functions and systems of the vehicle 100 optimal or "best" means of communication 20th , 21st , 22nd , 23 , 30th , 31 , 32 , 33 to propose to output information and / or to read in user input. The respective functions can be, for example, driver assistance systems or functions or infotainment systems. Thus, the functions of the vehicle 100 still an independent decision of the means of communication 20th , 21st , 22nd , 23 , 30th , 31 , 32 , 33 meet and in particular independently the suggestion of the control unit 40 accept or reject.

Furthermore is the control unit 40 via an interface 50 with multiple sensors 60 , 61 , 62 connected. This allows the control unit 40 the sensor data of the sensors 60 , 61 , 62 receive and evaluate.

The sensors 60 , 61 , 62 are used to determine boundary conditions and / or situations, such as the time of day, the speed of the vehicle, and the person's state of fatigue 11 and the same. The sensors 60 , 61 , 62 can alternatively or additionally directly or without the interface 50 with the control unit 40 be connectable.

To evaluate interactions of the person 11 is the control unit 40 with assistance systems 70 , 71 , 72 , 73 coupled with data transmission. The assistance systems 70 , 71 , 72 , 73 can be designed, for example, as a lane departure warning, emergency braking assistant, blind spot assistant and an automated driving function.

The assistance systems 70 , 71 , 72 , 73 can use the means of communication 20th , 21st , 22nd , 23 to output information and instructions and access the person 11 call for action. Based on the person's inputs 11 and evaluating the means of communication 30th , 31 , 32 , 33 can the control unit 40 the person's interactions 11 analyze.

Using the sensor data from the sensors 60 , 61 , 62 situation-dependent boundary conditions of the interactions can be determined and taken into account in the analysis. This allows a learning phase to be implemented in the parameters of the person 11 generated and in the control unit 40 get saved.

Through the control unit 40 a model can be created which uses the stored parameters for an interaction of the person 11 optimized means of communication 20th , 21st , 22nd , 23 to select.

• Beispiel 1: Ausgabe einer Warnung durch einen Spurhalteassistenten
  • - Identifizieren der Person durch Daten von einem Identifikationssensor 26

Handlung: Keine

• - Ausgabe einer Warnung wegen Verlassen der Spur

Blickrichtung: unkonzentriert in Richtung Head-Up-Display Sichtzeit: 5 Sekunden Sprachausgabe: keine Ausgabe Sitz: haptisch, aktiviert Ausgabe Lenker: haptisch, deaktiviert

• - Randbedingungen, Situationsdaten

Ort: geografische Koordinaten Zeit: dd-mm-yy, HR:MIN Helligkeit: gering, dunkel Wetter: Nebel Scheibenwischer: Aktiv, Stufe zwei Zustand: Person ist erschöpft Reaktionszeit: 3 Sekunden The following are two examples with the control unit 40 determined parameters:

• Example 1: A warning is issued by a lane departure warning system
  • - Identifying the person using data from an identification sensor 26th

Plot: No

• - Issue a warning about leaving the lane

Direction of view: unfocused in the direction of the head-up display Viewing time: 5 seconds Speech output: no Issue seat: haptic, activated Edition handlebar: haptic, deactivated

• - boundary conditions, situation data

Place: geographic coordinates Time: dd-mm-yy, HR: MIN Brightness: low, dark Weather: fog Windshield wipers: Active, level two Status: Person is exhausted Reaction time: 3 seconds

• - Identifizieren der Person durch Daten von einem Identifikationssensor 26

Handlung: Keine Person leitet einen Anruf ein Eingabe: haptisch (touch-Screen) Blickrichtung: konzentriert in Richtung Head-Up-Display Sichtzeit: 20 Sekunden Ausgabe: Head-Up-Display Ausgabe: Sprach ausgabe Ausgabe Sitz: haptisch, deaktiviert Ausgabe Lenker: haptisch, deaktiviert

• - Randbedingungen, Situationsdaten

Ort: geografische Koordinaten Zeit: dd-mm-yy, HR:MIN Helligkeit: gering, dunkel Wetter: Nebel Scheibenwischer: Aktiv, Stufe zwei Zustand: Person ist erschöpft Example 2: person 11 make a call

• - Identifying the person using data from an identification sensor 26th

Plot: No one initiates a call Input: haptic (touch screen) Direction of view: concentrated in the direction of the head-up display Viewing time: 20 seconds Output: Head-Up Display Output: Voice output Issue seat: haptic, deactivated Edition handlebar: haptic, deactivated

• - boundary conditions, situation data

Place: geographic coordinates Time: dd-mm-yy, HR: MIN Brightness: low, dark Weather: fog Windshield wipers: Active, level two Status: Person is exhausted

The parameters described can be stored in an internal memory of the control unit 40 be deposited. In particular, the parameters can be stored in such a way that a subsequent link to the respective situation is possible. The situation can be classified as “foggy, dark, tired person”, for example.

In the event of a further warning from the lane departure warning system, the output of the warning can be based on a proposed selection of the control unit 40 take place in which the optimal means of communication 20th , 21st , 22nd , 23 is suggested. On the basis of the parameters described, the head-up display in combination with the haptic feedback of the seat can be selected as a means of communication as an optimal output.

The respective parameters can be divided into value ranges to enable the situations to be compared. For example, coordinates of the position can have an area that contains a road section. Similarly, the time of day between 6 a.m. and 12 p.m. can be declared as morning and between 12 and 5 p.m. as evening. Depending on the measurement data of a light sensor, the brightness can be assigned to “light”, “subdued” or “dark”.

Should suggest a selected means of communication to the person 11 do not correspond or do not like it, the selection of the means of communication can be prevented by entering.

Preferably, the model of the control device 40 be designed such that the data or the parameters and the selected communication means can be exported to different vehicles. As a result, the optimal selection of the means of communication can take place immediately and without a learning phase.

The 2 shows a schematic representation of the system 10 according to the first embodiment of the invention to illustrate an assignment 80 of selected means of communication 20th , 21st , 22nd , 23 . It is here in particular by the control unit 40 the assistance systems 70 , 71 , 72 , 73 transmitted via which means of communication 20th , 21st , 22nd , 23 ideally the person 11 is most efficiently approachable.

In the 3 is a schematic of the system 10 according to the embodiment of the invention to illustrate accesses to the communication means 20th , 21st , 22nd , 23 shown. The arrows show what happens through the control unit 40 recommended means of communication 20th , 21st , 22nd , 23 , which from the assistance systems 70 , 71 , 72 , 73 for issuing information and instructions to the person 11 can be used.

The 4th shows a schematic representation of a vehicle 100 with the system 10 . The person 11 can for example be a driver of the vehicle 100 his. The system 10 is according to the embodiment in a vehicle 100 installed, but is not limited to automotive use. Rather, the system can 10 For example, it can also be used in industrial areas in which warnings are generated and the attention of people is safety-relevant.

Claims (10)

Method for the personalized provision of information to at least one person (11) in a vehicle (100) by a control device (40), wherein - parameters of the at least one person (11) are determined and stored, - a selection of at least one communication means (20, 21, 22, 23) is carried out, the communication means (20, 21, 22, 23) being selected on the basis of the determined parameters, and - The at least one selected communication means (20, 21, 22, 23) is used to output information to the person (11). Procedure according to Claim 1 , the parameters being determined by measuring reaction times to outputs and / or instructions from the communication means (20, 21, 22, 23) of the vehicle (100), the parameters being determined as a function of the situation. Procedure according to Claim 1 or 2 , the parameters being determined by evaluating interactions carried out by the at least one person (11), the parameters being determined depending on the person (11) and / or depending on situation-dependent boundary conditions. Method according to one of the Claims 1 to 3 wherein a selection of the at least one communication means (20, 21, 22, 23) of the vehicle (100) is carried out adapted to a reaction speed of the at least one person (11) and / or to a specification of the at least one person (11) for an output becomes. Method according to one of the Claims 1 to 4th , the selection of the at least one means of communication (20, 21, 22, 23) being carried out by an algorithm, a simulation model and / or by artificial intelligence, the situation-dependent boundary conditions determined as input variables for the algorithm, the simulation model and / or the artificial intelligence can be used. Method according to one of the Claims 1 to 5 , wherein the selected communication means (20, 21, 22, 23) are sent to at least one application (70, 71, 72, 73), the at least one application (70, 71, 72, 73) as a driver assistance system (73) is designed. Method according to one of the Claims 1 to 6th , wherein the at least one selected communication means (20, 21, 22, 23) is assigned a priority depending on the determined parameters, the at least one selected communication means (20, 21, 22, 23) based on the assigned priority and an urgency of a Reaction by which at least one person (11) is used to issue information or instructions. Method according to one of the Claims 1 to 7th wherein the selection of the communication means (20, 21, 22, 23) for an output is updated continuously, at defined time intervals or based on an insufficient confidence of the calculated selection of the communication means (20, 21, 22, 23). Method according to one of the Claims 1 to 8th wherein the at least one selected communication means (20, 21, 22, 23) is communicated to the at least one person (11), the at least one selected communication means (20, 21, 22, 23) being enabled by the at least one person (11) becomes. System (10), comprising at least two communication means (20, 21, 22, 23, 30, 31, 32, 33) for outputting and / or receiving information, having a control device (40) for controlling the at least two communication means (20, 21, 22, 23, 30, 31, 32, 33), the control device (40) being set up to carry out the method according to one of the preceding claims.

Images