DE102022113817A1 - METHOD AND DEVICE FOR OPERATING A VOICE CONTROL SYSTEM OF AN AUTOMATED MOTOR VEHICLE - Google Patents

Abstract

A method is provided for operating a voice control system of an automated motor vehicle having a driving assistance system. The method includes receiving an initial voice input from a user of the motor vehicle by the voice control system, analyzing the received initial voice input by the voice control system to determine whether it contains a desire to receive information about a current state of the driving assistance systems, and an auditory Outputting information about the current status of the driving assistance systems through the voice control system if the request is determined.

Description

The present disclosure relates to a method for operating a voice control system of an automated motor vehicle and/or a data processing device that is designed to at least partially carry out the method. Additionally or alternatively, a computer program is provided comprising commands which, when the program is executed by a computer, cause it to at least partially carry out the method. Additionally or alternatively, a computer-readable medium is provided comprising instructions which, when the instructions are executed by a computer, cause the computer to at least partially carry out the method.

In motor vehicles, a number of driver assistance functions or driving assistance systems increase as the degree of automation of the motor vehicles increases. However, the user of the motor vehicle may be increasingly unclear about how they work or even the existence of the individual driving assistance systems. To date, interaction with driver assistance functions has mostly used physical controls (e.g. steering column lever, buttons on the multifunction steering wheel, settings in so-called “settings menus”, etc.), but voice control or voice control is known from the prior art as a method for interacting with technical devices. Multimedia content (e.g. navigation, radio, telephone, etc.) can already be largely operated by voice in motor vehicles. However, voice control is known from other areas of everyday life (e.g. smartphone, smart TV, etc.).

The DE102015200522A1 describes a method for supporting a maneuvering process of a motor vehicle and a driving assistance system. In the method for supporting the maneuvering process of the motor vehicle, the maneuvering process is controlled by the driving assistance system at least partially autonomously, taking into account the surroundings of the motor vehicle and on the basis of predetermined control parameters. Here, an alternative operating mode of the motor vehicle is activated in response to a driver input, this alternative operating mode comprising a change at least one of the control parameters. This is based on the concept of activating a special operating mode of the driving assistance system based on driver inputs, in particular voice commands. The activation of the special operating mode does not directly control the movement of the motor vehicle, but rather gives the driver an additional opportunity to conveniently monitor and influence a maneuvering process, such as a parking maneuver.

Against the background of this prior art, the task of the present disclosure is to provide a device and a method which are each suitable for at least enriching the above-mentioned prior art.

The task is solved by the features of the independent claim. The subclaims contain preferred developments of the invention.

Accordingly, the task is solved by a method for operating a voice control system of an automated motor vehicle having a driving assistance system.

The method can be a computer-implemented method, i.e. one, several or all steps of the method can be carried out using a computer or a data processing device.

The method includes receiving an initial voice input from a user of the motor vehicle through the voice control system.

It is conceivable that the voice control system includes a microphone or can be connected to a microphone that can detect noises in a motor vehicle interior.

The method includes analyzing the received initial voice input by the voice control system to determine whether it contains a desire to receive information about a current state of the driving assistance systems.

It is conceivable that the voice control system has an algorithm, in particular based on artificial intelligence, which takes the noises recorded by the microphone as input data, analyzes them and determines whether it contains a request for information about the current state of the driving assistance systems to obtain.

The method includes an auditory output of the (desired) information about the current state of the driving assistance system by the voice control system if the request is or has been determined.

The information output can also be referred to as a response. It is conceivable that the algorithm selects an answer from a database based on or depending on the desired request and then outputs it audibly.

It is conceivable that the voice control system includes a loudspeaker or can be connected to a loudspeaker that outputs the information audibly into the motor vehicle interior.

This makes it possible for the user of the motor vehicle, who can be the driver of the motor vehicle depending on the level of automation of the motor vehicle, with the driving assistance system of the motor vehicle through speech, i.e. without the user having to make tactile input.

The method is to be distinguished from the prior art described above in that information about a current state of the driving assistance system is first output and the driving assistance system is not directly controlled by the user. This means that, in the sense of a guided user interaction with the motor vehicle, the user is initially enabled, in particular in a dialog-like manner, to find out the current state of the driving assistance system in order to, based on this, in an optional subsequent step, the driving assistance system, in particular by means of a further voice input, if necessary and/or desired, in particular through the voice control system. This enables natural interaction with driving assistance functions.

Possible further developments of the process are described in detail below.

The desired information can include information about which driving assistance system is present in the motor vehicle.

The desired information can include information about whether the driving assistance system of the motor vehicle is activated.

The desired information can include information about whether the driving assistance system of the motor vehicle can be activated.

The desired information can include information about the reason why the driving assistance system of the motor vehicle is and/or has carried out an intervention in a transverse and/or longitudinal guidance of the motor vehicle.

The desired information can include information about the scope of functions that the driving assistance system includes.

The method is not limited to a motor vehicle with a single driving assistance system, but the motor vehicle can have several driving assistance systems. The method for operating the voice control system of the automated motor vehicle having multiple driving assistance systems then includes receiving an initial voice input from a user of the motor vehicle by the voice control system, analyzing the received initial voice input by the voice control system in order to determine whether it contains a wish to provide information about to obtain the current state of the several driving assistance systems, and an auditory output of the information about the current state of the driving assistance systems by the voice control system if the request is determined.

The desired information can include information about which driving assistance systems are present in the motor vehicle, whether and/or which driving assistance systems of the motor vehicle are activated, whether and/or which driving assistance systems of the motor vehicle can be activated, and for what reason which driving assistance system of the motor vehicle intervenes in a Transverse and/or longitudinal guidance of the motor vehicle is carried out and/or has been carried out, and/or what functional scope the driving assistance systems, in particular each, include.

In other words and based on a specific embodiment, which is described as not limiting the present disclosure, what has been described above can be summarized as follows: The driver signals by voice a desire to receive information about existing and/or currently active driver assistance functions . This request is recognized and the status and configuration of the driver assistance systems are determined. Through a dialog-like interaction between the vehicle and driver, the driver is provided with additional information about the systems via voice. This information transmitted to the driver can include the presence of certain systems in the current vehicle, provide the possibility of subsequent sales via systems that can be purchased digitally, and/or contain details about active systems and possibilities for potentially activated or active subsystems. Some example scenarios in which the method is applicable are described below. For example, the driver drives without an active assistance system and says: “How can you help me drive?” The request is processed and the systems that are currently present in the vehicle and can be activated are identified. The driver receives information that no driver assistance system for “comfort” driving is currently active and which systems (e.g. speed limiter, cruise control system, assisted driving, ...) he could currently activate. In a wide scenario, the driver drives with adaptive cruise control activated and says “Which assistance system is currently active”. The vehicle responds by voice: “You currently have distance control active. This helps you to automatically adjust the speed and distance to vehicles in front.” In another scenario, the driver is driving with active distance control and active right-hand overtaking prevention and says “Why is my vehicle braking right now?”. The vehicle responds by voice: “This is a partial functionality of the distance control and prevents overtaking slower-moving vehicles in the left lane. Would you like to find out more about it? Should I turn this off?”

Furthermore, a data processing device or a system for data processing, comprising means for carrying out the method described above, is provided.

The system can be a distributed system, which can include a data processing device (i.e. the backend) external to the motor vehicle, which is operated, for example, by the motor vehicle manufacturer, and / or a data processing device (in particular wirelessly connected) which is in or on the motor vehicle is arranged.

The latter data processing device can therefore be part of a motor vehicle. This data processing device can be connected to a loudspeaker and a microphone, both of which are directed into the vehicle interior. The data processing device can also be referred to as a voice control system. The data processing device can include software components to at least partially carry out the method described above

The data processing device of the motor vehicle can, for example, include an electronic control unit (ECU). The data processing device of the motor vehicle can be an intelligent processor-controlled unit, which can communicate with other modules, for example via a central gateway (CGW) and, if necessary, via field buses, such as the CAN bus, LIN bus, MOST bus and FlexRay or via automotive -Ethernet, e.g. together with telematics control devices, can form the vehicle on-board network. The data processing device can be connected to a sensor system, for example via the above-mentioned on-board network.

It is conceivable that the data processing device of the motor vehicle, possibly together with another control device of the motor vehicle, controls and/or responds to functions relevant to the driving behavior of the motor vehicle, such as the engine control, the power transmission, the braking system and/or the tire pressure monitoring system for relevant data can be accessed. In addition, driver assistance systems, such as a parking assistant, an adapted cruise control (ACC), a lane keeping assistant, a lane change assistant, traffic sign recognition, light signal recognition, a starting assistant, a night vision assistant, an emergency braking assistant and / or an intersection assistant, can be used by the Data processing device of the motor vehicle, possibly together with another control unit of the motor vehicle, can be controlled and / or the relevant data can be accessed.

What has been described above with reference to the method also applies analogously to the data processing device and vice versa.

Furthermore, a motor vehicle having the data processing device can be provided, the data processing device being designed to at least partially carry out the method described above.

The motor vehicle can be a passenger car, in particular an automobile. The motor vehicle can be an automated motor vehicle, which can be designed to at least partially and/or at least temporarily take over longitudinal guidance and/or transverse guidance during automated driving of the motor vehicle. Automated driving can be carried out in such a way that the movement of the motor vehicle is (largely) autonomous.

The motor vehicle can be a motor vehicle with autonomy level 0, i.e. the driver takes over the dynamic driving task, even if supporting systems (e.g. ABS or ESP) are present.

The motor vehicle can be a motor vehicle with autonomy level 1, i.e. have certain driver assistance systems that support the driver in operating the vehicle, such as adaptive cruise control (ACC).

The motor vehicle can be a motor vehicle of autonomy level 2, i.e. be partially automated so that functions such as automatic parking, lane keeping or lateral guidance, general longitudinal guidance, acceleration and/or braking are taken over by driver assistance systems.

The motor vehicle can be a motor vehicle of autonomy level 3, ie conditionally automated so that the driver does not have to continuously monitor the vehicle system. The motor vehicle independently performs functions such as triggering using the turn signal, changing lanes and/or keeping in lane. The driver can turn his attention to other things, but if necessary the system will ask him to take over within a warning period.

The motor vehicle can be a motor vehicle with autonomy level 4, i.e. so highly automated that control of the vehicle is permanently taken over by the vehicle system. If the system can no longer handle the driving tasks, the driver can be asked to take over the lead.

The motor vehicle can be a motor vehicle with autonomy level 5, i.e. so fully automated that the driver is not required to complete the driving task. No human intervention is required other than setting the target and starting the system.

What has been described above with reference to the method and the data processing device also applies analogously to the motor vehicle and vice versa.

Furthermore, a computer program can be provided. The computer program is characterized in that it includes commands which, when the program is executed by a computer, cause it to at least partially carry out the method described above.

A program code of the computer program can be in any code, in particular in a code that is suitable for motor vehicle controls.

Furthermore, a computer-readable medium, in particular a computer-readable storage medium, is provided. The computer-readable medium is characterized in that it includes instructions which, when the program is executed by a computer, cause it to at least partially carry out the method described above.

That is, a computer-readable medium may be provided that includes a computer program as defined above. The computer-readable medium can be any digital data storage device, such as a USB flash drive, hard drive, CD-ROM, SD card, or SSD card.

The computer program does not necessarily have to be stored on such a computer-readable storage medium in order to be made available to the motor vehicle, but can also be obtained externally via the Internet or otherwise.

What has been described above with reference to the method, the data processing device and the motor vehicle also applies analogously to the computer program and the computer-readable medium and vice versa.

• 1 zeigt schematisch ein Kraftfahrzeug mit einer Datenverarbeitungsvorrichtung, die ausgestaltet ist, um ein Verfahren zum Betreiben eines Sprachsteuersystems eines automatisierten Kraftfahrzeugs, und
• 2 zeigt schematisch ein Ablaufdiagramm des Verfahrens.

An embodiment is described below with reference to 1 and 2 described.

• 1 shows schematically a motor vehicle with a data processing device that is designed to provide a method for operating a voice control system of an automated motor vehicle, and
• 2 shows a schematic flowchart of the process.

This in 1 Illustrated automated motor vehicle 1, for example an automobile, comprises a voice control system 2, a loudspeaker 3 connected thereto and a microphone 4 connected thereto, with both the loudspeaker 3 and the microphone 4 being directed into a passenger compartment of the motor vehicle 1. The motor vehicle 1 is designed to also refer to this below 2 to carry out the described method for operating the voice control system 2 of the motor vehicle 1, which has several driving assistance systems.

In a first step S1 of the method, an initial voice input from a user of the motor vehicle is received via the microphone 4 by the voice control system 2.

In a second step S2 of the method, the received initial voice input is analyzed by the voice control system 2 in order to determine whether it contains a desire to receive information about a current state of the driving assistance systems.

In a third step S3 of the method, the information about the current state of the driving assistance systems is output auditorily via the loudspeaker 3 by the voice control system 2 if the desire to receive information about a current state of the driving assistance systems is determined.

The information desired in the second step S2 can include information about which driving assistance systems are present in the motor vehicle 1, in which case a list of the existing driving assistance systems can then be output in the third step S3.

The information desired in the second step S2 can include information about which driving assistance systems of the motor vehicle 1 are activated, in which case in the third step S3 a list of activated driving assistance systems can be output.

The information desired in the second step S2 can include information about which of the driving assistance systems of the motor vehicle can be activated, in which case a list of the driving assistance systems that can be activated can then be output in the third step S3.

The information desired in the second step S2 can include information about the reason why the driving assistance systems of the motor vehicle 1 are making and/or have made an intervention in a transverse and/or longitudinal guidance of the motor vehicle 1, with the reason then being provided in the third step S3 for the intervention, if necessary naming the driving assistance system that intervened.

The information desired in the second step S2 can include information about the scope of functions that the driving assistance systems include, in which case the scope of functions, in particular for each driving assistance system, can then be output in the third step S3.

Reference symbol list

1

motor vehicle

2

Voice control system

3

speaker

4

microphone

S1 - S3

Steps of the procedure

QUOTES INCLUDED IN THE DESCRIPTION

This list of documents listed by the applicant was generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Cited patent literature

• DE 102015200522 A1 [0003]

Claims (10)

Method for operating a voice control system (2) of an automated motor vehicle (1) having a driving assistance system, the method comprising: - Receiving an initial voice input from a user of the motor vehicle through the voice control system (2), - Analyzing the initial voice input received by the voice control system (2) to determine whether it contains a desire to receive information about a current state of the driving assistance systems, and - If the request is determined, auditory output of the information about the current state of the driving assistance system by the voice control system (2). Procedure according to Claim 1 , wherein the desired information includes information about which driving assistance system is present in the motor vehicle (1). Procedure according to Claim 1 or 2 , wherein the desired information includes information about whether the driving assistance system of the motor vehicle (1) is activated. Procedure according to one of the Claims 1 until 3 , wherein the desired information includes information about whether the driving assistance system of the motor vehicle (1) can be activated. Procedure according to one of the Claims 1 until 4 , wherein the desired information includes information about the reason why the driving assistance system of the motor vehicle (1) is carrying out and/or has carried out an intervention in a transverse and/or longitudinal guidance of the motor vehicle (1). Procedure according to one of the Claims 1 until 5 , whereby the desired information includes information about the range of functions the driving assistance system includes. Data processing device, comprising means for carrying out the method according to one of Claims 1 until 6 . Motor vehicle (1), comprising the data processing device according to Claim 7 . Computer program, comprising commands which, when the program is executed by a computer, cause it to carry out the method according to one of the Claims 1 until 6 to carry out. Computer-readable medium comprising instructions which, when the instructions are executed by a computer, cause it to carry out the method according to one of the Claims 1 until 6 to carry out.

Images