JP2008531359A - Voice control method and apparatus for equipment or system in automobile - Google Patents

Abstract

  The present invention allows the device or system (1) to be operated by voice input (3) or non-voice input, for example, by operating switches (2) and / or buttons and / or touch screen (6). And the voice operation (3) of the device or system (1) depending on the presence or absence of a predetermined predefined condition to the user of the device or system (1), for example to the driver of the car It relates to a method for voice control of a device or system (1) in an automobile in which it is optically and / or acoustically and / or tactilely known to be possible. The invention further relates to an apparatus for supporting voice control of a device or system (1) in a motor vehicle in which this method can be implemented.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an audio control method for an apparatus or system in an automobile in which the apparatus or system can be operated by voice input and non-voice input, in particular by operation of switches and / or buttons and / or touch screens. . This type of device or system may be, for example, a radio, a car phone or a driver assist system, such as a navigation system.

  A voice control device and method for a device or system is known, for example, from the publication DE100008226C2. They are used in particular in the area of infotainment (car radio, playback equipment, hifi devices) and / or communication means (mobile phones, position measuring devices and navigation) in motor vehicles. The user's voice input is then picked up via at least one microphone, converted into an electrical signal and interpreted as an effective command.

  In general, a variety of sensory channels and a variety of encodings, such as tones, speech, graphics and / or text, are used in automobiles, and an increasingly popular interaction strategy is called multi-mode interaction strategy. ing. In addition to visual information display using buttons or touch screens and tactile input, in addition to the input from the user and the output to the user, there are more and more voice operations. To be used.

  In this case, the voice operation is not only a very simple and simple type of operation, especially in the motor vehicle, but also a very safe type of operation. This is because this type of operation does not interfere with other manually operated functions or imposed adjustment operations, such as lane keeping using the steering wheel. Therefore, lane keeping is usually better during voice operation than when the device is operated manually, and this has the essential merit of voice operation. Having the driver deviate very little from the original driving maneuver increases not only the traffic safety for the car occupants but also the safety for other traffic participants.

  However, in this type of system having an additional option for voice operation, functions capable of voice operation can be used in a conventional manner without using voice operation. Therefore, voice operation is always user-driven, and what it means is that the user himself decides and when he wants to be able to use the form of voice operation. In this case, for example, the conventional habits of the user or driver may play a major role. This does not always guarantee that the driver will use safer voice operations.

  The problem addressed by the present invention is generally that the merit of voice manipulation can be fully exploited and the method of the type described at the beginning provides the driver to perform voice interaction and / or allows the driver to continue voice manipulation. It is to develop into.

Advantages of the Invention The method of the present invention as claimed in claim 1, compared to the known voice operation methods, encourages a vehicle user or driver to use voice operations in a given situation, and thus provides traffic safety. It has the advantage that the property is enhanced. Using the method of the present invention, the driver is automatically instructed in a form of alternative voice operation, allowing the driver to choose to take advantage of the safer voice operation. .

  The idea on which the present invention is based is optically and / or reliant on the user of a device or system capable of voice operation, in particular on the driver of an automobile, depending on whether certain predetermined conditions are met or not met. Alternatively, it is a signal notification or notification that the voice operation of the device or system is possible acoustically and / or tactilely.

  This approach provides an easy-to-implement method that can contribute to increasing road safety with relatively little effort and relatively little cost. Furthermore, this method allows the driver to clearly and clearly show the form of voice operation even in a function that is not performed using voice because the driver has no custom or knowledge.

  Advantageous developments and improvements of the inventive method are evident from the dependent claims.

  Thus, it is particularly advantageous if the user is signaled of the possibility or form of voice operation when the user performs or performs a non-voice controlled operation of the device or system. In this case, the instruction output condition that can be inspected according to the present invention is the behavior of the user or the driver. As a result, the method of the present invention can assist the driver perfectly when learning various possibilities of voice operation.

  According to an alternative or supplementary variant of the method according to the invention, the user can perform voice operations each time the user switches on a voice-operable device or system and / or whenever the user starts the car. Get instructions for sex or form.

  According to a first particularly advantageous embodiment of the invention, one or more predetermined parameters of the user's instantaneous state and / or behavior are captured and detected and one or more predetermined parameter values; When the at least one captured and detected parameter value reaches or exceeds or falls below or belongs to the assigned comparison parameter value, the possibility or form of voice operation is signaled to the user Informed.

  This type of capture-detectable parameter for user or driver status or behavior may advantageously be eye and / or head movement. These movements can be captured and detected together via a separate system, for example via an eye tracking system for another function, and used together to implement the method of the present invention. In this case, frequent back and forth movements of the head or eyes may indicate a situation where the user is looking for a button or switch on the device or system, indicating the possibility or form of voice operation. Can help the driver.

  According to another particularly advantageous embodiment of the invention, one or more predetermined parameters of the instantaneous state of the vehicle are captured and detected and compared with one or more predetermined parameter values. When the at least one captured and detected parameter value reaches or exceeds or falls below a predetermined reference parameter value to which it belongs, the user is notified of the possibility or form of voice operation. Therefore, an instruction to the user is given depending on the instantaneous running state. In this case, the driving condition parameter can be transmitted from a module set for another function of the automobile.

  Advantageously, the instantaneous speed and / or average speed of the motor vehicle and / or the acceleration or deceleration of the motor vehicle and / or the number of instantaneous steering angles and / or the number of steering angle changes are captured and detected as parameters in a predetermined time space. can do. For example, if the number of frequent relatively small steering angle changes increases significantly, it can be seen as referring to a situation in which the driver is assisted by indicating the possibility or form of voice operation of the device or system.

  According to a third advantageous embodiment of the invention, one or more predetermined parameters in the immediate vicinity of the vehicle are captured and detected and compared with one or more predetermined parameter values. When the at least one captured and detected parameter value reaches or exceeds or falls below a predetermined reference parameter value to which it belongs, the user is notified of the possibility or form of voice operation. In this case, the instruction to the user is given depending on the instantaneous traffic situation.

  In this case, the type and / or nature of the road, such as whether it is straight or curved, the state and / or the passage of a predetermined traffic sign and / or the current Can be captured and detected as a parameter. In other words, there are situations where instructions on the possibility or form of voice operation of the equipment or system to assist the driver appear to be meaningful, for example in an autobahn or when detecting a speed limit or at a particularly high traffic density. It is that.

  Of course, not only the three above listed conditions for the driver, the vehicle or the surrounding conditions of the vehicle are individually captured and detected, but these are simultaneously captured and detected and the instructions of the present invention are based on this to the driver. You can also check if it should be output.

  Another alternative is to inform the user of the possibility or form of voice operation of the device or system, depending on time, in particular at regular time intervals.

  Furthermore, it is particularly advantageous if the possibility of voice operation is reported acoustically to the user or driver by means of the output of speech segments prestored in a plurality of languages in some cases in the communication interface (HMI). For this purpose, for example, the following instructions should be output: “Continue with voice input”. This allows the driver to enter immediately in an advantageous way for the voice dialog. Basically, however, the instructions of the present invention may be output by changing the graphical input mask. In addition, the driver may be instructed by using optical indicating means that can be formed by an indicating device incorporated in a combination panel of an automobile. In particular, in the conventional operation of the device or system, in addition to the visibility output, the corresponding voice output of the voice operation is also output in parallel so that the driver can easily enter by voice operation. Become.

  The invention further relates to an apparatus suitable for carrying out the method of the invention. It is particularly advantageous if the device has memory means in which software implementing the method of the invention can be stored. In the memory medium, it is also advantageous to store reference parameter values that are required when carrying out the method for determining the conditions under which an indication that voice operation can be performed.

  An apparatus for supporting voice control of a device or system in a vehicle, corresponding to the method described so far, advantageously comprises at least one device or system located in or in the vehicle, said device Alternatively, the system can be operated by voice input or non-linguistic input, in particular by operating switches and / or buttons and / or touch screens, and the driver and / or the vehicle and / or at least one state around the vehicle. A means for capturing and detecting, a memory device for storing a predetermined reference value, a comparison unit for comparing the captured and detected state value with a reference value, and connected to the comparison unit Preferably comprising optically and / or acoustically acting signal means, said signal hand Depending on the event that is supplied by the comparison unit on the user's equipment or system allows report that the device or system is operational by the voice operation.

  This type of device allows the driver to voice operation or form when a predetermined predetermined condition or situation exists or when the captured and detected state value reaches or exceeds or falls below the reference value You can be directed about sex. Advantageously, a corresponding instruction in the device or device of the present invention can also be made during a conventional operation in spite of the fact that a voice operation of the device or system on which the driver is operated is possible. As in the case of the method described above, the driver is also encouraged to use the voice operation in an advantageous manner by means of the device according to the invention so that traffic safety is enhanced. The device of the present invention can be advantageously realized in cost with relatively little effort.

The drawing shows an embodiment of the invention, which will be described in detail in the following description. The drawing shows the device of the present invention for supporting voice control of a system in a motor vehicle, which can be operated by voice input and non-voice input.

DESCRIPTION OF THE EMBODIMENTS FIG. 1 shows a driver assistant system 1 which may be a navigation system for assisting a driver when finding the best possible driving section, for example. The system 1 can be operated by a driver on the one hand in a conventional manner, via keys, buttons and / or switches 2 and on the other hand additionally via the voice identification module 3. In order to output the information, the driver assistant system 1 is connected to a pointing device 4 and a voice output module 5 in the combination instrument of the automobile. In addition, as another user interface (HMI = Human Machine Interface), there is a touch screen 6 that can output information from the system 1 to the driver and can also input from the driver.

  Furthermore, the system 1 for carrying out the method of the invention is connected to means for capturing and detecting at least one state 7 of the driver, at least one state 8 of the vehicle and at least one state 9 around the vehicle. Yes. The state parameters 7, 8 and 9 thus captured and detected are compared with a predetermined predetermined reference value stored in the memory unit 11 in the comparison unit 10 connected to the assistant system 1. The driver is connected to the comparison unit 10 via the system 1 when a predetermined reference value is reached and / or below a predetermined reference value that is predetermined or adjustable. With the voice output module 5, the driver is instructed to operate or operate the assistant system 1 by voice input in the most advantageous manner.

  The present invention then takes into account the driver's and / or the car's specific situation so that the driver is supported exactly when the use of voice operation is significantly advantageous considering traffic safety. . This is especially true in situations where the driver is heavily burdened or when greater attention is needed to the original driving task, for example when traffic density is high, or when the driver is inadvertent or tired, for example. This is true when you are.

  Although the present invention has been described based on an advantageous embodiment, the present invention is not limited thereto and can be modified in various ways. In particular, the conditions or states 7, 8 and 9 to be examined are not limited to the examples given above, and they may have any state, situation and / or outcome. The user of the device or system 1 capable of voice operation may be different from the driver of the automobile.

Schematic of one embodiment of the present invention

Claims (13)

The device or system (1) can be operated either by voice input (3) or non-voice input, for example by operation of the switch (2) and / or buttons and / or touch screen (6), In the voice control method of a device or system (1) in an automobile,
Depending on the presence or absence of certain predefined conditions, the user of the device or system (1), for example the driver of the car, can perform a voice operation (3) of the device or system (1). Wherein the information is optically and / or acoustically and / or tactilely known. The method according to claim 1, wherein the user is informed of the possibility of a voice operation when he / she performs or is performing an uncontrolled operation of the device or system. The method according to claim 1 or 2, wherein the user is informed of the possibility of voice operation when the device or system (1) is switched on or at the start of the car. At least one predetermined parameter of user state (7) or behavior is captured and compared with at least one predefined parameter value, and at least one captured detected parameter value is at least 1 4. A method according to any one of claims 1 to 3, wherein the user is informed of the possibility of voice manipulation when reaching or exceeding or falling below two predefined parameter values. The method according to claim 4, wherein the user's eye movement and / or head movement are captured and detected as parameters. At least one predetermined parameter of the vehicle condition (8) is captured and compared with at least one predefined parameter value, and at least one captured detected parameter value is at least one predetermined parameter value. 6. A method as claimed in any one of the preceding claims, wherein the user is informed of the possibility of voice manipulation when reaching or exceeding or below a defined parameter value. 7. The method according to claim 6, wherein the instantaneous speed and / or average speed and / or acceleration or deceleration of the motor vehicle and / or the instantaneous steering angle and / or the number of steering angle changes are captured and detected as parameters in a predetermined time space. At least one predetermined parameter of the vehicle's surroundings or ambient condition (9) is captured and compared with at least one predefined parameter value, and at least one captured detected parameter value is 8. A method according to any one of claims 1 to 7, wherein the user is informed of the possibility of a voice operation when at least one predefined parameter value is reached or above or below it. 9. The method according to claim 8, wherein the type and / or extension and / or nature of the traffic route that is traveling instantaneously and / or the traffic sign and / or the density of traffic in which a vehicle is present are captured and detected as parameters. The method according to any one of claims 1 to 9, wherein the user is informed of the possibility of voice operation at regular time intervals. 10. A method according to any one of claims 1 to 9, wherein the user is informed of the possibility of voice operation acoustically by means of an output (5) of the voice segment. A device for supporting voice control of a device or system (1) in a motor vehicle is suitable and advantageously suitable for carrying out the method according to any one of claims 1-11. An apparatus comprising memory means capable of storing a computer program for executing the method. -Comprising at least one device or system (1) located in or in the vehicle, which device or system can be activated by voice input (3) or non-linguistic input, in particular by switch (2) and / or Can be operated by operating buttons and / or touch screen (6),
-Means for capturing and detecting at least one condition (7, 8, 9) around the driver and / or the car and / or the car;
A memory device (11) for storing a predetermined comparison value;
A comparison unit (10) for comparing said captured and detected state value (7, 8, 8, 9) with a reference value;
-Comprising signal means (4, 5, 6) connected to the comparison unit (10), depending on the event supplied by the comparison unit (10) to the user of the device or system (1) by means of the signal means Thus, in particular in a motor vehicle, which can inform that the device or system (1) can be operated by voice operation (3) when the reference value reaches or exceeds or falls below the detected and detected state value. A device for supporting voice control of the system (1).

Images