EP3962764A1

EP3962764A1 - Selection of an input mode for a driver information system of a vehicle

Info

Publication number: EP3962764A1
Application number: EP20720776.2A
Authority: EP
Inventors: Heino Wengelnik; Stefan Struhs
Original assignee: Volkswagen AG
Current assignee: Volkswagen AG
Priority date: 2019-05-02
Filing date: 2020-04-15
Publication date: 2022-03-09
Also published as: WO2020221588A1; DE102019206307A1

Abstract

The invention relates to a driver information system (10) for a vehicle, wherein the driver information system (10) comprises at least one function that is able to be controlled via a user input, wherein the driver information system (10) is configured to select at least one input mode from a plurality of available input modes as an active input mode for the user input; and wherein this selection is made on the basis of at least one of the following: a) a driver state; b) a route; c) a driving autonomy level; d) a driving speed, wherein a voice input mode is selected as active input mode starting from when a minimum driving speed is reached. The invention also relates to a method for selecting such an input mode.

Description

description

Selecting an input mode for a driver information system from a vehicle

The invention relates to a driver information system for a vehicle and a method for selecting an input mode for such a driver information system. The vehicle can be a motor vehicle and in particular a passenger car or a truck.

It is known that driver information systems can be operated via user inputs. The user input can be entered using various input modes.

For example, there are typically a voice input mode, a keyboard input mode, it also being possible for the keyboard to only be shown in a display device, i.e. a so-called soft keyboard, a rotary push button operation, a

Handwriting input, e.g. by moving your fingers on a touch-sensitive one

Surface or gesture recognition are available. According to the invention, all of these input modes can be provided alone or in any combination.

Depending on the input mode, an operator of the driver information system has a

different levels of attention and skill required. If the operator is the vehicle driver himself and, for example, not another vehicle occupant, who can also be an operator of the driver information system, this can adversely affect attention when driving the vehicle in an undesirable manner.

An object of the present invention is therefore to operate a

To improve driver information system, in particular so that the attention of a vehicle driver is not impaired in an undesirable manner.

This object is achieved by a driver information system with the features of claim 1 and a method with the features of claim 10. Advantageous further developments are given in the attached dependent claims. It goes without saying that the above features and explanations are also provided for the solution according to the invention or can apply to it, unless otherwise stated or evident. In general, the invention provides for a selection option from various available input modes to be provided, so that one of these input modes is the more active

Input mode can be selected, by means of which a user input for operating a driving information system takes place. This selection is preferably made automatically. Furthermore, this selection is preferably made as a function of an estimated or assumed complexity of the vehicle operation. For this purpose, for example, a driver's status is determined, the current or the driving route ahead is examined, a selected driving autonomy level and / or a current driving speed is considered. If it is determined that the driving conditions or vehicle operation are currently to be assessed as complex, then, for example, only those input modes can be selected that require little attention from the driver or do not increase the complexity any further. In particular, in driving situations assessed as complex, a voice input mode can preferably be selected as the active input mode. In general, the complexity of a driving situation increases when it occurs

The driver's condition has deteriorated (i.e. he has, for example, increased stress signals and / or increased fatigue and / or decreased alertness).

If an input mode is selected, this can e.g. when starting a function that is to be operated via user input, can be set as the input mode initially set automatically. According to the invention, this can then be the only available input mode or there can also be the possibility, e.g. manually switch to another input mode. Figuratively speaking, the

Driver information system, the correspondingly active input mode can be set automatically at least initially in order to encourage the driver to use this input mode that is most suitable from the point of view of the driver information system.

Overall, this solution increases the safety, but also the ease of use, since the operator or vehicle driver is automatically offered an input mode that is best suited to the current situation.

In detail, a driver information system for a vehicle is proposed, wherein the driver information system comprises at least one function (or, in other words, at least one service) that can be operated via a user input

Driver information system is set up to use at least one of a plurality of available input modes (for example automatically and / or without additional manual input) as the active input mode for user input; and wherein this selection is made as a function of at least one of the following: a) a driver state;

b) a route;

c) a driving autonomy level;

d) a driving speed, with a minimum driving speed being reached

Voice input mode is selected as the active input mode.

The driver information system can be a system according to any of the examples discussed in the introduction, and in particular an infotainment system. As explained below, the function can be a search function and in particular a global one

Search function that can simultaneously search for relevant search hits for a search entry made by the user in several services of the driver information system. The driver information system can comprise a graphical user interface, by means of which further services, e.g. a navigation service, a radio service, an air conditioning service, a media service or a digital manual can be called up. The search function and in particular the global search can also be a service that can be called up from the graphical user interface.

The driver information system can be of any of the sizes and discussed below

Access parameters to e.g. to determine a driver status, the route, a driver autonomy level or a driving speed. For this purpose, it can be connected to a CAN bus or a general data storage device of the vehicle. However, it is also possible to connect the driver information system with sensors that measure the corresponding variables and parameters.

According to one variant, the driver information system comprises a processor device with at least one microprocessor. Software components and / or

Program instructions can be stored in a memory device of the driver information system and executed by the processor device in order to implement the

Provide functions of the driver information system. For example, the sizes and / or parameters can be determined and the situations or

States can be determined (for example the driver's state or the route) and then definitions with regard to the active input mode can be calculated or determined. For each of the variables listed under a) to c), a current value or a current state can first be determined and this can be compared with a predetermined critical value or state. If the latter is reached, the active input mode can then be selected according to predefined rules. In general, the selection of the input modes can be rule-based or in accordance with previously defined rules of the

Driver information system are carried out.

The driver state can be a stress level, an awareness level and / or a

Specify the level of fatigue or be defined on this basis. The driver information system can determine this, as well as any other of the variables mentioned under a) to d), or it can be connected to corresponding determination devices and receive information or values of the variables mentioned from them.

The route can be determined using navigation data and / or location-based data that are stored in a memory device of the vehicle and / or that can be called up online (for example from a navigation service). In general, it can be a currently traveled route and / or a route that is at least partially ahead. For example, the driving route can be determined on the basis of an input driving route (e.g. driving route input into a navigation service) and / or a driving route calculated by a navigation service. However, it is also possible that the route is merely an estimated or expected route, which is estimated, for example, on the basis of routes that other road users usually choose. Furthermore, it can also be an expected probable route, for example if, starting from a current vehicle location, all or at least selected (e.g. randomly selected) possible routes in the vicinity of the vehicle location are considered. This can serve to at least roughly estimate the expected route properties

estimate, since in this way it can be determined, for example, whether the route is more characterized by properties that are typically present in urban areas, or by

Properties that are typically found outside of town.

The driving autonomy level can be determined according to conventional definitions and in particular the autonomy levels 0 to 5, as they are e.g. are defined in the industry standard SAE J3016. For example, depending on the activated assistance systems, a

present autonomy level can be determined and the driver information system can select a suitable active input mode based on this. Typically, at higher autonomy levels, more demanding and / or from the driver's point of view a higher one Input modes that require attention, such as keyboard input or handwriting recognition, are permitted.

By specifying a voice input mode after reaching a

On the other hand, the minimum travel speed can be achieved so that, from this speed onwards, the driver can no longer switch to more complex input modes or input modes requiring greater attention, or at least these are no longer preset as preferred input modes by the driver information system. This increases driving safety, since the driver is responsible for voice inputs e.g. no longer has to take his hands off the steering wheel and / or not or only to a lesser extent have to maintain eye contact with a display device of the driver information system.

As mentioned, the active input modes selected by the driver information system can be used as e.g. preset input modes can be selected to start the function. However, it cannot be ruled out that one operator can then also move on to another

Can change input mode. However, the latter can also be suppressed, in particular when the minimum travel speed is reached or when one of the other variables a) to c) reaches a critical state.

As mentioned, a development provides that the function is a search function and the user input is a search input. For example, a search string can be determined on the basis of the search input (e.g. through speech-to-text conversion or handwriting recognition) and this can then be used to determine relevant search hits. In this context, the invention is advantageous because corresponding search entries in driver information systems usually require interaction with the user and input modes suitable for this purpose according to the invention can be selected.

According to one variant, the selection is made as a function of the driver's status and the driver's status is determined using at least one of the following variables:

- a tiredness size;

- a pupil size;

- an eye movement quantity;

- a pitch;

- a pulse size. The level of drowsiness can be determined with known drowsiness detection systems of the vehicle. For example, a lane keeping ability of the driver can be evaluated and / or the pupil size or eye movement mentioned below can also be evaluated. The pupil size as well as the eye movement size can be determined on the basis of camera images, for which known evaluation algorithms can be used. For example, a pupil size that is inadequate for current environmental conditions can indicate an increased level of stress or increased fatigue. In contrast, an eye movement variable, which can relate in particular to a frequency of the eye movement (ie the changes in the viewing angle), can also indicate increased fatigue and / or a lack of attention if this is below a predetermined value.

The pulse can also be determined by camera measurement. Alternatively, it can be determined by means of biometric sensors that the driver wears (e.g. a bracelet) and whose measurement data is preferably transmitted to the vehicle via a wireless communication link (e.g. via Bluetooth). A voice pitch can be determined by a speech evaluation algorithm, e.g. a higher voice and / or generally a slower one

Speech speed, which can also be recognized by speech recognition, can indicate increased tiredness (i.e., correspondingly also decreased

Attention).

If these values reach a predetermined critical state or value, it can be determined that the driver's state is also critical and that e.g. there is increased tiredness and / or lack of alertness. Based on this, the active input mode can then be selected by the driver information system and, in particular, an input mode can be selected that does not require increased attention from the driver, e.g. a voice input mode.

More specifically, when the selection is made depending on the driver's condition and when the driver's condition reaches a predetermined critical reference condition (e.g., the above-mentioned critical value or critical condition), a voice input mode can be selected as the active input mode.

According to a further development, it can be provided that the selection is made as a function of the route, based on at least one of the following properties of the route: - a type of route, in particular whether it is a motorway, a country road or an urban road. Roads running in urban areas can generally be evaluated in such a way that they require greater attention from the driver than, for example, a country road or a motorway.

- A frequency of turns along the route, with a high frequency of turns (e.g.

above a predetermined critical value) or a high curve frequency

can be judged to the effect that a high level of attention is required from the driver.

- A frequency of intersections along the route, whereby again a frequency or

Frequency above a critical value can mean increased driver awareness.

- A complexity variable of the route, e.g. can be determined or calculated on the basis of any combination of the properties of the route described here, for example according to a predetermined rule and in particular a calculation rule. Alternatively or additionally, the complexity size can e.g. can be determined based on evaluations of routes that have already taken place, for example if frequently occurring routes e.g. have been assessed in advance by experts and these assessments are stored in a database. The higher the level of complexity, the greater the level of attention required by the driver for operating the vehicle and the less should the attention from

Input mode required attention or its distraction potential.

- A traffic volume along the route, e.g. can be accessed online from the navigation service. The higher the traffic volume (e.g. from a value above a defined threshold), the more likely it is that a

Voice input mode can be selected.

- Known accident black spots along the route, e.g. can be accessed online from the navigation service. The higher the number or extent of

Accident black spots (eg from a value above a defined threshold), the sooner a voice input mode can be selected as the active input mode. Correspondingly, a further development provides that the selection takes place as a function of the route and then, when the route meets a predetermined complexity criterion, a voice input mode is selected as the active input mode.

According to a further embodiment, the selection is made as a function of the

Driving autonomy level and from falling below a predetermined driving autonomy level (e.g.

Level 3), a voice input mode is selected as the active input mode for this and for higher driving autonomy levels. This is based on the idea that lower levels of driving autonomy require greater driver awareness for operating the vehicle, since the driver is only supported by less autonomous vehicle functions. Correspondingly, with low driving autonomy levels, additional

Distraction potentials are reduced. One finding of the invention also lies in the fact that the voice input mode offers a comparatively low potential for distraction.

According to a development, an active input mode can be selected by a user, which can generally be done in addition or as an alternative to the selection of the driving information system.

In particular, the user can in this way of one of the

The input mode selected by the driver information system can change to another input mode or can skip or overwrite a selection made automatically by the driver information system (in particular in the form of a preset input mode or input mode active at the start). In this way, the operator can also introduce personal preferences or correct selections of the driver information system that are inappropriate from his point of view.

Another exemplary embodiment provides that a preselection of available input modes can be established from the total of possible input modes, from which the driver information system can then select an active input mode. These

Pre-selection can be made in particular by a user or the driver. In this way, the driver can determine from the outset that certain input modes that are not preferred by him are not available for selection and thus also not by the driver information system e.g. can be preset automatically. This increases the ease of use.

According to the invention, it is also possible for the user to select a preset active input mode, in particular an input mode in which a search function is to be started. The solution according to the invention can do that However, the driver information system then automatically switches to an active input mode, for example automatically, which is more suitable as a function of the variables described.

In addition, it can also be provided that the function is linked to a last used one

Input mode starts as active input mode. But this can then be of the

Driver information system can be changed automatically if one of the cases described here occurs.

The invention also relates to a method for selecting an input mode for a

Driver information system of a vehicle, wherein the driver information system comprises at least one function that can be operated via a user input, and wherein the method comprises selecting at least one input mode from a plurality of available input modes as an active input mode for the user input; and wherein this selection is made as a function of at least one of the following:

a) a driver state;

b) a route;

c) a driving autonomy level;

d) a driving speed, with a minimum driving speed being reached

Voice input mode is selected as the active input mode.

The method can include any further feature and any further step in order to also provide all of the operating states, interactions and effects of the driver information system described herein. In particular, all

Developments and designs of the driver information system for the identical method features can also be provided or apply to them. The method can also be used by a driver information system in accordance with any of the methods described herein

Embodiment are carried out.

Furthermore, it is generally possible for a user to use any of the

Reference states, critical states, criteria (in particular a predetermined

Complexity criterion) or the like can flexibly select or set according to which the driver information system should select active input modes or switch to them. In addition, according to a development, it can also be provided that the driver information system, when a predetermined criterion and in particular a predetermined critical reference state of the driver state is reached, also all Input modes are deactivated or the function and in particular any search function is deactivated.

In addition, it can also be provided that the user deactivates automatic definitions of the active input mode by the driver information system at least temporarily or that these can be deactivated or not provided from the outset at least for some of the cases a) to d) considered. The latter can e.g. be provided depending on legal regulations or regions in which the vehicle is to be used.

In the following, exemplary embodiments according to the invention are explained with reference to the attached figures.

1 shows a schematic representation of a driver information system with a focus on the functions that can be provided by it; and

Fig. 2 shows a flow chart of a method according to the invention, which with the

Driver information system from Fig. 1 can be executed.

1 shows a driver information system 10 according to an exemplary embodiment of the invention. The driver information system 10 is installed in a vehicle not shown separately, e.g. in a center console of this. The driver information system 10 comprises a display device 12 which, in the case shown, is designed as a touch-sensitive screen (touchscreen). The driver information system 10 also includes a

Processor device 14 with at least one processor. It also includes a

Memory device 16, in which program instructions are stored which, when executed on processor device 14, enable the modes of operation, methods and in particular the selection of input modes described herein. It is also indicated that the driver information system 10 comprises a microphone device 18 in order to receive voice inputs from a driver. These can from the processor device 14 by means of known

Speech recognition algorithms are analyzed in order to capture their semantic content.

The driver information system 10 also includes a graphical user interface 19 that can be displayed on the display device 12. With the graphic user interface 19, various functions can be called up or executed in a known manner, in particular a search function. In the example shown, the search function is a global search function that can be found in several services of the driver information system or their searches related data for relevant hits. But it can also be the

Act only search function of a certain service, for example the search function of a navigation service, with which addresses or so-called points of interest can be searched.

In order to be able to search for an example of a general

Are user input in the driver information system 10, a user and in particular the driver in principle different input modes are available. In the case shown, this is a voice input via microphone device 18. Furthermore, a character string can be entered via handwriting via the touch-sensitive screen of display device 12, with handwriting recognition being able to be carried out by driver information system 10 in a manner known per se, in order to Recognize characters or translate them into a text string. As a further input mode, a soft keyboard 20, which can preferably be displayed selectively, is available in order to type in search entries.

It was recognized that the voice input compared to the others mentioned

Input options require less attention from the driver, since he can keep his hands on the steering wheel and, if at all, only slight eye contact with the driver information system 10 or the display device 12 is required. The

As will be explained in more detail below, driver information system 10 therefore preferably selects voice input as the active input mode in cases in which a high driver load or a complex driving situation is determined. This has a lower distraction potential compared to the other alternatives.

The driver information system is connected to a CAN bus 22. Various determination devices 24-28 are connected to this in a manner known per se. But it is also possible that the driver information system 10 directly with at least selected

Detection devices 24-28 is connected. It also includes

Driver information system 10 has a schematically indicated navigation service 30, which is set up in a manner known per se, data of a route and in particular location-based data e.g. read out from a locally stored data collection and / or retrieve online.

The driver information system 10 receives information via the aforementioned determination devices 24-28 and the navigation service 30 in order to define an input mode. These Information can be processed by the processor device 14, the selection of an input mode taking place on the basis of rules depending on a determined current state or a current situation.

The determination devices 24-28 are a driver status determination device 24, a driving autonomy level determination device 26 and a driving speed determination device 28. Properties of a route are determined by the navigation service 30.

In principle, these determination devices 28-28 as well as the navigation service 30 provide up-to-date descriptions of the status of the variables described here,

Status information or status values and these are from the

Driver information system 10 with references (in particular reference states) or with predetermined criteria (in particular selection criteria) or, in other words, with rules stored in advance (i.e. decision rules) compared to a suitable

Define the input mode.

In a manner known per se, the driver state determination device 24 determines, for example, a current level of awareness and / or level of drowsiness of the driver. For this purpose, it determines at least some of the parameters explained above using suitable sensor devices (e.g. a camera device, a microphone device and e.g. the microphone device 18 of the driver information system 10 or a biometric sensor). The driver state determining device 24 then gives a determined

Driver status to the driver information system 10. If this reaches a predetermined critical reference state, the driver information system 10 selects the voice input mode as the active input mode from the available input modes.

In general, the active input mode is that input mode which can be used directly for a user input (for example by means of which a user input can be converted directly into a search input). There can be several

Input modes can be selected at the same time as active input modes or only one. Input modes that are not active, on the other hand, cannot be used directly for user input or would first have to be activated automatically or by user input. If, within the scope of this disclosure, the selection of an input mode as the active input mode is spoken of, this can be synonymous with the fact that all other available input modes are not active. As mentioned, it is in principle possible that several input modes can also be selected and, for example, a further input mode can be activated in parallel to give the user several

To provide opportunities.

The driving autonomy level determining device 26 determines a current level of a

Driving autonomy level. For this purpose, an autonomy level selected by the user

can be accessed or the autonomy level can depending on the currently activated

Assistance systems are preferably determined in real time. Such information is usually available within the vehicle. In the case shown, if the driving autonomy level is below a certain level or, in other words, level, an input mode is selected as the active input mode, which requires only little attention. This is preferably the voice input mode.

The vehicle speed determining device 28, which is e.g. about one

Wheel speed sensor or an ESP control unit can act, determines a driving speed and outputs this to the driver information system 10. The latter then compares the

Driving speed with a predetermined minimum driving speed. If this is achieved, the voice input mode is preferably selected as the active input mode and all other input modes are preferably not activated. This is intended to prevent the driver from having to interact directly with the driver assistance system 10 by touching or using the keyboard at increased speed, which could reduce his or her attention.

Finally, properties of the route are determined by means of the navigation service 30, as explained above in the general part. If it turns out that the route meets a predetermined complexity criterion, which in turn depends on the

Driver information system 10 is checked and determined, is preferred

Voice input mode selected as (preferably the only) active input mode in order to keep the distraction potential for the driver as low as possible.

In the example shown, the automatic selection of an active input mode (and preferably a single active input mode) by the driver information system is used to define this selected input mode as the preset input mode, which is defined as the corresponding preset input mode when the search function is called up. According to certain embodiments, however, it can be provided that a user himself determines from which input modes an input mode can be automatically selected as the active input mode (ie input modes not generally preferred by the operator can be permanently deactivated or excluded from the automatic definition).

It is also possible that the user himself selects an input mode as the preferred input mode, which is then used by default as the active input mode when calling e.g. the search function is preset. In this case, however, the driver information system 10 can automatically switch to another input mode if one of the criteria described herein is met or one of the situations described herein is present.

Preferably, however, the operator always has the option of manually switching between the input modes and e.g. to interrupt an active input mode selected by the driver information system 10 and replace it with another.

FIG. 2 shows a flow chart for the procedure described above. This is a flow diagram of a method according to the invention that can be executed with the driver information system 10 from FIG. 1.

In a step S1, a search function of the driver information service is activated, so that by means of at least one of a plurality of in principle available

Input modes a search input could be made. In a step S2, information about a current state or a current situation is obtained. These are the states and / or information determined by the determination devices 24-28 as well as about the route properties determined by the navigation service 30. In one

In step S4, the driver information system 10 compares this received information and / or states with the criteria, references or otherwise stored decision rules described above. On this basis, decisions are then made as to which input mode or also which input modes are to be selected as the active input mode (or active input modes). These are then set as a correspondingly active input mode or active input modes in step S5. List of reference symbols

Driver information system

Display device

Processor facility

Storage facility

Microphone device

graphical user interface

Fade-in keyboard (soft keyboard)

CAN bus

Driver condition determining device

Driving autonomy level determining device Driving speed determining device Navigation service

Claims

1. Driver information system (10) for a vehicle,

wherein the driver information system (10) comprises at least one function that can be operated via a user input,

wherein the driver information system (10) is set up to use at least one of a plurality of available input modes as an active one

Select input mode for user input;

and wherein this selection is made as a function of at least one of the following:

a) a driver state;

b) a route;

c) a driving autonomy level;

d) a driving speed, with a voice input mode being selected as the active input mode once a minimum driving speed has been reached.

2. Driver information system (10) according to claim 1, wherein the function is a search function and the user input is a search input.

3. Driver information system (10) according to claim 1 or 2, wherein the selection in

Dependence on the driver's condition takes place and the driver's condition is determined using at least one of the following parameters:

- a tiredness size;

- a pupil size;

- an eye movement quantity;

- a pitch;

- a pulse.

4. Driver information system (10) according to one of the preceding claims, wherein the selection is made as a function of the driver state and then, when the driver state reaches a predetermined critical reference state, a voice input mode is selected as the active input mode.

5. Driver information system (10) according to claim 1, wherein the selection is made as a function of the route, based on at least one of the following properties of the route:

a type of route, in particular whether it is a motorway, a country road or an urban route;

- a number of turns along the route;

- an intersection frequency along the route;

- a complexity quantity of the route;

- a traffic volume along the route;

- known accident black spots along the route.

6. Driver information system (10) according to claim 1 or 5, wherein the selection in

Dependency of the route takes place and, when the route meets a predetermined complexity criterion, a voice input mode is selected as the active input mode.

7. Driver information system (10) according to claim 1, wherein the selection takes place as a function of the driving autonomy level and from falling below a predetermined one

Driving autonomy level a voice input mode is selected as the active input mode.

8. Driver information system (10) according to one of the preceding claims, wherein an active input mode can be selected by a user, in particular wherein a user can thereby switch from an input mode selected by the driver information system (10) to another input mode.

9. Driver information system (10) according to one of the preceding claims, wherein from the total possible input modes a preselection can be defined as available input modes, from which the driver information system (10) can then select an active input mode.

10. A method for selecting an input mode for a driver information system (10) of a vehicle, the driver information system (10) comprising at least one function that can be operated via a user input, and wherein the method comprises selecting at least one input mode from a plurality of available input modes as an active input mode for the user input;

a) a driver state;

b) a route;

c) a driving autonomy level;