DE102011013755A1 - Method for verbal input of data sequence in form of data blocks in input-and-detection unit of motor vehicle, involves correcting the recognized data block using one format and displaying corrected data using another format - Google Patents

Abstract

The method involves summarizing the blocks of data by which the current sequence data are identified, and illustrating the current data sequence in a display (2) of the input-and-detection unit. The lastly entered data block which is recognized for verification is displayed in the input-and-detection unit. The recognized data block is optionally corrected using the first format, and the corrected data are finally displayed using a second format. An independent claim is included for device for verbal input of data sequence in form of data blocks in input-and-detection unit of motor vehicle.

Description

The invention relates to a method and a device for alphanumeric speech input in motor vehicles according to the preamble of claims 1 and 8.

Due to the increasing number of comfort components in motor vehicles which can be operated and adjusted via multifunction operating devices, it becomes increasingly difficult for the driver to have all the operating options and their setting modalities ready. Furthermore, the access to required commands or the input of necessary information, for example, in infotainment systems with navigation and / or telephone facilities, be relatively cumbersome and therefore time consuming. In particular, when entering information such as phone numbers while driving this can lead to a distraction of the driver.

To minimize these problems, speech input devices are increasingly being developed and used, so that for command and data entry, the driver does not have to take his hands off the steering wheel. This type of command and data entry often leads to other problems in practice. For example, many conventional voice control components have a fixed instruction set that the user must, in principle, memorize. As a result, the problem often arises while driving that the driver has forgotten the necessary command and is also unable to look up the manual.

From the DE 100 28 869 A1 For example, a method for supporting command and data input is known in which a display unit displays to a user at least one input menu in which possible command and menu fields of the currently permissible voice command and voice inputs are optically highlighted. The visual highlighting can be achieved by color design, the use of different brightness and contrast levels or other measures. However, the method is fixed to a fixed instruction set.

From the DE 199 42 871 A1 A method is known for operating a voice-operated command input unit in a motor vehicle in which operability is acoustically menu-driven by first voice-controlling the command level to be activated prior to device or function-related command input, whereby so-called shortcut commands are used with which you can switch between device-specific menus.

The publication DE 10 2007 052 345 A1 describes a method and a device for operating a device of a vehicle with a voice control, in which an operating step is selected and a function assigned to the operating step is carried out. In this case, the selection of the operating step automatically activates a voice control for an input following the operating step, whereby the input can be made linguistically or haptically.

The publication EP 0 389 514 B1 discloses an input method for data sequences by means of speech input into a speech recognition, wherein here a data sequence is understood to be a number block consisting of a number of digits. In this case, a pause signal is generated by the speech recognition after a spoken data sequence and the recognized data sequence is repeated. Furthermore, the recognized data sequence is visually displayed on a display. Then the user can enter the next data sequence. If the user recognizes a recognition error on the part of speech recognition either visually or on the basis of the linguistic confirmation, the linguistic input of a corresponding keyword, such as "delete", deletes the last data sequence entered. A mixture of linguistic and haptic input is not provided.

The invention is therefore based on the object to provide an input method for haptic and linguistic input of data sequences with improved verification of the input data sequences.

The object is achieved by a method for inputting data sequences into an input and identification device of a motor vehicle having the features of claim 1 and by a corresponding device having the features of claim 8. Preferred embodiments of the invention are the subject of the dependent claims.

In the method according to the invention for the linguistic input of a data sequence as a result of data blocks in an input and recognition device of a motor vehicle, wherein recognized data blocks are displayed as a current data sequence in a display of the input and recognition device, the last entered and recognized data block for verification and optionally Correction in a first formatting and after verification in a second formatting. The representation of the last linguistically entered data block in different formats depending on the verification status clearly perceptible to the user and is shown faster, what was recognized and should be confirmed by him. This leads to a relief and thus increased security

Preferably, a data block has at least one alphanumeric character, whereby alphanumeric characters are understood to be letters and numbers. In other words, a data block comprises one or more characters, wherein the number of characters per data block may be different. In particular, therefore, a data block of a data sequence can consist of a sequence of digits, as is the case, for example, with a voice input of a telephone number. The sequence of data blocks of different lengths then gives the overall sequence the data sequence, where current data sequence is the summary of the input data blocks including the current data block.

Preferably, a linguistic verification of the current data block takes place by the input of a further data block or by a linguistic input of a verification command. Thus, if the user has recognized that the last data block entered was recognized correctly, the entry of a next data block automatically verifies the still current data block. It is also possible to accomplish the verification by a separate voice command.

Further preferably, a linguistic correction of the current data sequence causes a deletion of the last recognized data block, d. H. the current data block. Thus, if the user has recognized that the recognition of the current data block represented in the first formatting was erroneous, then a linguistic correction, for example by input of a correction command, causes a deletion of the current data block.

In addition, it is possible that after deleting the last detected current data block, the previous data block is transferred again to the first formatting for renewed verification. In this way, even a linguistic correction of the past data blocks is possible.

Preferably, a haptic correction of the current data sequence including the current data block represented in the first formatting causes the deletion of the last character and the entire data sequence is transferred to the second formatting. The correction of the last character is thus understood as a transition from the linguistic input to the haptic operation, with a further haptic correction of the new last character in the usual way is possible. But it is also possible to continue the linguistic input by speaking another data block.

The second formatting is preferably carried out by a bold representation, italic representation, underlining, selection of a different font with respect to the last recognized data sequence and / or insertion of special characters before the last recognized data sequence. This striking initial formatting makes it easy to identify and verify the current data block.

The device according to the invention for carrying out the above-described method for linguistically inputting a data sequence in the form of data blocks into an input and recognition device of a motor vehicle comprises:

• A means for inputting and recognizing blocks of data,
• A device for verifying and correcting the input data blocks,
• A display device for displaying the current data sequence, and
• - Formatting means for formatting the linguistically entered and recognized data blocks in at least two different formats.

Preferably, the device further comprises an input device for haptic input of the data sequence and a device for correcting the haptic input.

In particular, the haptic correction device may have a greater priority than the linguistic correction device. In other words, haptic correction takes precedence over linguistic correction, and the device enters haptic mode of operation.

A preferred embodiment of the invention will be described below with reference to the drawings

1 a free-text speller for telephone numbers in a schematic representation,

2 the free text speller after entering a first number pad,

3 the free text speller after entering a second numeric keypad, and

4 the free text speller after correcting the second entry.

The 1 to 4 explain the method according to the invention and the corresponding device on the basis of a so-called free-text Spellers, whose characteristic is the fact that the user always has all possible input modes, ie haptic and linguistic input possibilities, Tobe offered. In the following, numerals are considered as alphanumeric characters, such as when entering a telephone number.

1 shows a representation of a menu for a free text speller on a touch-sensitive screen 1 in other words, a touch screen. Shown is a display block 2 for displaying a current data sequence, here the numbers "1234", a numeric keypad 3 with the numbers 0 to 9 for haptic input, a correction key 4 and a verification key 5 , There is also a button 6 intended to close the current menu, ie an operation of the button 6 usually returns the menu to the next higher menu level.

Due to the different modalities, namely haptic on the one hand and linguistic on the other hand, various correction mechanisms are used. For example, while a haptic "correction" usually refers to the deletion of the last character, which here by the "DEL" key 4 is effected, a verbal "correction" can lead to the deletion of several previously entered characters, for example the current data block.

Since the haptic-visual representations, formatting and verification mechanisms for a purely haptic operation in themselves coherent and sufficiently well-known, only the linguistic representation and verification will be discussed, and - taking into account a fully multimodal system - the transition from the linguistic operation towards a haptic operation and looking back.

A linguistic input of numbers usually takes place in the form of n data blocks, in which each of the individual data blocks can in turn contain 1 to k digits. This makes it possible to enter a number sequence in the form of integers or as a sequence of individual digits. The default case will generally be mid-range, consisting of a sequence of several smaller blocks.

Assuming that the user haptically or linguistically has not yet entered a number sequence and now linguistically begins to enter the number block "1234", this results in 2 illustrated example of the visualization.

The user says "1234". The system responds with the recognized digit sequence, for example "1234", and places the recognized result in the display block 2 represents.

However, since the result was "written" by the voice control in the Speller, a different type of presentation is selected in the linguistic input. The formatting of the recognized data block "1234" shown here is in bold type with underscore. This result can now be corrected by means of a suitable dialog, for example the commands "Correct", "Delete", etc., by the user.

However, if the user confirms the input implicitly, for example by naming a data block with further individual digits or explicitly, ie by a corresponding command, then the form of presentation will now be converted to the standard formatting of the haptic-visual input, which is represented here by the normal font without an underscore , Ultimately, the user has thus verified and confirmed the previous input.

In our example, the user implicitly continues the dialogue by naming further single digits, as in 3 is shown. The number sequence is "56", but the system recognizes "567" this time. Also, this recognized data block is now displayed first in the language-specific representation, namely in the formatting "bold" and "underlined". The first data block "1234" implicitly verified by the continuation of the dialog is attested in the haptic-visual formatting, ie the second formatting.

The user now has several possibilities to correct this recognition result displayed as the current data sequence. By a verbal "correction", for example, the last recognized numeric keypad "567" would be deleted and it could - the user is yes again in the voice control - the previously entered digit string "1234" again be marked voice-specific, namely "bold" and "underlined ". For a haptic correction by pressing the button 4 with the label "DEL" the last digit of "567" would be deleted.

Decisive here is that when detecting a haptic correction, for example by a proximity sensor or detection of the pressure of the correction key 4 that language-specific formatting is transferred into the haptic visual formatting, as the user no longer continues the dialogue speech-controlled. In addition, the speech dialogue is even paused or terminated in the case of a haptic operation.

4 shows that in the example of the user the last digit by pressing the correction key 4 deleted. Since now also this digit sequence was verified, what by the representation of the sequence "123456" is shown in the second formatting, the formatting can also be at a restart of the speech dialogue, for example by resuming the speech dialogue after previous pause, start by pressing a PTT button (push-to-talk, not shown), Name a corresponding command "Continued", etc., to be retained.

Optionally, the voice-specific formatting (bold) of the last input - this would then only be the digit sequence "56" - but also resumed when the voice dialogue was restarted or no further haptic operation, for example, by a proximity sensor, was detected.

This interplay of the different formatting, which may possibly be supported by animations, is continued with differently used input modality as long as the user also enters a numeric entry.

• – kursiv: ”1234567”
• – unterstrichen: ”1234567”
• – Einfügen von Sonderzeichen (zum Beispiel Leerzeichen): ”1234 567”
• – andere Schriftart

und verschiedene Kombinationen aus den jeweiligen Formatierungen:

• – Kursiv und fett: ”1234567”
• – mit Leerzeichen und fett: ”1234 567”
• – mit Leerzeichen, kursiv und fett: ”1234 567”

Alternative formatting of the recognized number sequence, compared to the already shown "bold", would be for example:

• - italic: "1234567"
• - underlined: "1234567"
• - Inserting special characters (for example, spaces): "1234 567"
• - other font

and different combinations of the respective formatting:

• - Italic and bold: "1234567"
• - with spaces and bold: "1234 567"
• - with spaces, italics and bold: "1234 567"

LIST OF REFERENCE NUMBERS

1

screen

2

display

3

number keys

4

Clear key

5

confirmation key

6

Button "Close menu"

QUOTES INCLUDE IN THE DESCRIPTION

This list of the documents listed by the applicant has been generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Cited patent literature

• DE 10028869 A1 [0004]
• DE 19942871 A1 [0005]
• DE 102007052345 A1 [0006]
• EP 0389514 B1 [0007]

Claims (10)

Method for linguistically inputting a data sequence in the form of data blocks into an input and identification device of a motor vehicle, wherein recognized data blocks are combined to form a current data sequence and the current data sequence is displayed in a display of the input and recognition device, characterized in that the last input and recognized data block is displayed for verification and, where appropriate, correction in a first formatting and after verification in a second formatting. A method according to claim 1, characterized in that a data block has at least one alphanumeric character. Method according to one of claims 1 or 2, characterized in that a linguistic verification of the current data block is carried out by the input of a further data block or by a linguistic input of a verification command. Method according to one of the preceding claims, characterized in that a linguistic correction of the current data sequence causes a deletion of the last detected data block. A method according to claim 4, characterized in that after deleting the last recognized data block, the previous data block is transferred again for re-verification in the first formatting. Method according to one of the preceding claims, characterized in that a haptic correction of the recognition result causes the deletion of the last character of the current data sequence and transfers the current data sequence in the second formatting. Method according to one of the preceding claims, characterized in that the first formatting by a bold, italic, underlining, choosing a different font with respect to the last detected data block and / or insertion of special characters before the last recognized data block is done. Device for carrying out the method for linguistically inputting a data sequence in the form of data blocks into an input and identification device of a motor vehicle according to one of the preceding claims, having a device for inputting and recognizing data blocks, a device for verifying and correcting the input data blocks, a display device ( 2 ) for displaying the current data sequence, and a formatting device for formatting the linguistically entered and recognized data blocks in at least two different formats. Device according to Claim 8, characterized in that the device has an input device ( 3 ) for haptic input of the data sequence, and a device ( 4 ) for correcting the haptic input. Device according to claim 9, characterized in that the haptic correction device ( 4 ) has a greater priority than the linguistic correction device.

Images