EP1342358A1

EP1342358A1 - Method for configuring a user interface

Info

Publication number: EP1342358A1
Application number: EP01270188A
Authority: EP
Inventors: Meinrad Niemöller; Tobias Schneider
Original assignee: Siemens AG
Current assignee: Siemens AG
Priority date: 2000-12-11
Filing date: 2001-11-22
Publication date: 2003-09-10
Also published as: WO2002049325A1; US20040064318A1; JP2004516563A; EP1213897A1

Abstract

The invention relates to a method for configuring a user interface for an electronic device for connecting it at least temporarily to a telecommunication or data network, comprising a voice-oriented user interface and/or a voice data entry device. The user interface or voice data entry device is configured via the telecommunication or data network by transferring at least parts of a vocabulary from a main unit in the telecommunication or data network to a terminal component of the user interface, which receives said parts of the vocabulary and saves them in an internal vocabulary memory.

Description

description

Procedure for configuring a user interface

The invention relates to a method for configuring a user interface for an electronic device according to the preamble of claim 1. It also relates to an electronic device equipped with such a user interface or interface parts.

Portable and especially hand-held electronic devices have become an integral part of modern society and have long been a subject of dynamic technical and economic development. This development had its breakthrough with the early portable transistor radios and pocket transistor radios and later with the Walkman and the portable CD player (Discman) in the field of consumer electronics experienced further highlights. A similar development is already emerging in this area for the MP3 player for storing music pieces downloaded from the Internet.

In addition to hand-held audio devices, the devices mentioned also include the remote control devices that have long been used to operate stationary television, video and hi-fi devices and, more recently, have been used to control other devices in the home (lighting, door and gate controls, etc.) ,

The handheld computing and data processing devices of the various application specifications and performance classes, which are also very widespread - from simple pocket calculators to programmable pocket calculators and simpler address and appointment databases to high-performance handheld PCs or PDAs (Personal Digital Assistant) - has become one rapid development towards higher performance and complexity. In recent years, cell phones and cordless phones have gained outstanding economic importance in handheld electronic devices. Here, too, there has been a highly dynamic development in performance, which has led to modern mobile phones with a wealth of convenience features and Internet access via WAP (Wireless Application Protocol).

The considerable increase in the complexity of the functions of the devices mentioned has led some time ago to a departure from traditional operation via simple function keys and to the increased use of language-oriented and / or graphic user interfaces or interface parts. A prime example of this is the operation of modern mobile phones via a dialog system based on the visual display of control words, names etc. and a corresponding selection with variable function keys (so-called softkeys).

Inspired by the dynamic development and application success of voice control and voice input systems in PCs and in line with the increasing complexity of the hand-held devices mentioned, these are now also increasingly being offered voice control and input options. Correspondingly equipped remote control devices - which, however, only have a small vocabulary of control words - are already common on the market, as are mobile phones, in which control functions in particular can be triggered by voice input and phone numbers can be dialed.

The components of such devices that relate to the actual voice control or input, as well as the conventional voice-oriented user interfaces, in which the user is visually shown a certain menu and is verbally prompted for input, are briefly referred to below as “dialog System "is referred to; in this sense, the term user interface or user interface is used more generally.

Such user interfaces, without which modern hand-held devices with a high level of complexity are no longer conceivable, must of course be carried out with the national language vocabulary of these markets for the sale of the devices in international markets. With increasing complexity of the user interfaces or user interface mentioned, their nationalization is becoming increasingly important on the one hand and becoming increasingly complex on the other. It brings with it considerable organizational and logistical problems and high costs. While for user interfaces with low complexity (e.g. for televisions, simple remote control devices and graphical user interfaces) all relevant national language configurations are usually kept on the same device, this becomes less and less meaningful with increasing complexity of the user interfaces or dialog systems and especially for complex voice control systems.

The invention is therefore based on the object of specifying a method for configuring a user interface which substantially reduces the organizational and logistical outlay and brings significant cost savings.

This object is achieved by a method with the features of claim 1.

The invention includes the basic idea of merely implementing a rudimentary end device component of the user interface in the respective electronic device during its production and delivery to the end customer and having the configuration (“nationalization”) initiated by the respective user himself the idea of nationalizing this via a communication network (e.g. the Internet, a fixed telephone network or a mobile phone). bilfunknetz) to which the device must be connected anyway or at least can be connected easily. Furthermore, the invention includes the idea of transferring at least parts of corresponding sources of knowledge, in particular at least parts of one of several stored (national or dialect-related) vocabularies to a central device in this communication network, to the terminal component. This configuration of the user interface basically represents a last step in the manufacture of the respective device.

The terminal component must be designed to receive and store this vocabulary and to integrate it into the user interface or the user interface. In the case of complex user interfaces with speaker-independent speech recognition, speech synthesis or voice prompts as well as complex graphical user interfaces with nationalized touch screens, all the necessary operating algorithms are pre-defined in the user interfaces, but the language-dependent parts of the user interface are only taken over from the communication network by the end customer.

In a preferred embodiment of the invention, the vocabulary or other sources of knowledge are transmitted to the terminal component in response to a request signal sent by the latter. This is generated in particular on the basis of a selection process of a national language (or also a dialect) by the user when starting up his terminal. The transmission and storage of the vocabulary then takes place independently and “invisibly” for the user. The request signal can alternatively also be generated automatically on the basis of information about the user's place of residence contained on the SIM card.

In the case of mobile radio terminals, menu navigation, which starts when the user logs on to the network, is preferred On the basis of the location information contained in his SIM card or available from the HLR of the mobile radio network, a national language is proposed for nationalization, but he is given the option of another language selection. So it can be z. For example, the user of a mobile phone in Germany may decide to load an English speech recognition on his device, or a resident of Switzerland chooses his mother tongue from the official languages.

In the context of the present invention, the term “national language” is also intended to include dialects. There is also the possibility of configuring a dialect- or dialect-specific user interface for parts of a specific country, for example for Bavaria and Saxony in Germany.

The telephone companies or providers generally have the corresponding information about the user and can offer certain nationalization or regionalization variants on their own, the final determination should expediently be left to the user. The initialization dialogs can therefore be very short and simple and can in no way be compared to the cumbersome enrollment procedures for speaker-dependent speech recognition.

As an alternative, nationalization vocabulary can be transferred to the terminal device, particularly in the case of terminal devices, such as mobile radio terminal devices, which are permanently connected to a communication network, in response to a control signal originating from the communication network itself. This is useful, for example, in the sense of updating.

In preferred variants of the embodiment of the invention, differently specified vocabularies or vocabulary parts are loaded in user interfaces (user interfaces or user interfaces) of special end devices. So The transmitted vocabulary can include, in particular, national language control words for operating the device, in particular for optical menu navigation and / or voice control, or also for a speech synthesis system. This will apply in particular to remote controls for controlling stationary devices or device combinations in the home area, where essentially only such vocabularies are required. A control vocabulary for operating a television set can be downloaded, for example, from a special teletext page that is created and maintained by the device manufacturer and / or a television broadcaster or an independent service provider.

Control words also form at least part of the relevant nationalization vocabulary for telecommunication devices and hand-held computers. For these devices there is also a national language set of personal and / or place names for voice control of address or telephone book functions and / or a national language basic vocabulary of everyday language or also certain technical languages - especially for handheld PCs or PDAs for certain professional groups - to implement with advantage.

Advantages and expediencies of the invention also emerge from the subclaims and the following description of preferred exemplary embodiments with reference to the figures. Of these show:

1 shows a schematic representation of a first embodiment of the invention (mobile telephone) in the form of a function block diagram,

Fig. 2 is a schematic representation of a second embodiment of the invention (handheld PC) in the form of a functional block diagram and Fig. 3 is a schematic representation of a third embodiment of the invention (mobile remote control device) in the manner of a functional block diagram.

1 shows how a mobile telephone MS is connected in the usual way via a base station BTS / BSC and a mobile switching center MSC to a service and maintenance center SMC of a mobile radio network GSM. The other components of a mobile radio network according to the GSM standard are of little importance here and, since the structure of such a network is generally known, are not described further. The service and maintenance center SMC is assigned a nationalization server NS for carrying out the configuration method according to the invention for the mobile phone MS, to which a plurality of vocabulary databases DB1, DB2 and DB3 with national language vocabularies for the mobile phone MS are connected in different languages. The vocabulary databases contain in particular a selection of common personal names in the respective national language as well as an extensive control vocabulary that is sufficient to operate a comfortable mobile phone by voice control.

The mobile phone MS is with the usual software, i.e. H. Control and processing algorithms for device operation, but without national vocabulary. When starting up for the first time, a connection to the service and maintenance center SMC of the provider is automatically established and, based on the information about the registration location of the telephone stored in the SIM card (not shown), a connection is established to the vocabulary database that corresponds to the registration location of the device keeps the correct vocabulary.

As part of a minimal version of a menu guidance, the user is given the opportunity to confirm this vocabulary for implementation in his device or to select a different national vocabulary. After the corresponding The relevant input is loaded into the internal vocabulary memory WM of the mobile phone MS via the network connection. The mobile phone is now fully functional.

The production of a fully functional handheld PC PC according to FIG. 2 works in a very similar manner. Here - which is only symbolically shown in the figure due to the general familiarity of corresponding arrangements - via an exchange SC in a fixed telephone network TN and a gateway server GS established a connection to a firmware server FS from the manufacturer of the handheld PC in the Internet IP. A nationalization sequence control NC is implemented in the firmware server FS, which has access to a plurality of vocabulary databases DB1 ^x to DB3 '.

On delivery, the handheld PC is essentially equipped with the usual software by the manufacturer, but only a minimal vocabulary or a symbol-oriented operator guidance is implemented, which allows a connection to be made with the firmware server FS. After the connection has been established by the user, the country code of his dial-in node is used to determine which national language is most likely to be implemented in the device, and a connection to the corresponding vocabulary database is established.

The user is informed on the display which national vocabulary the user interface is to be configured with and is asked to confirm or select another national language. After confirmation or other selection, the vocabulary is loaded from the corresponding vocabulary database via the nationalization sequence control NC and the Internet connection into the internal vocabulary memory WM. The user interface or the user interface of the handheld PC is hereby fully configured and it is fully functional. The scope of the implemented 1 1 Cn

⁽ 0 1 • H, 1 ß 0, o rd Φ 1 φ ß

N 4 ß ß Cn 4-) r- ß φ 1 o Cn -H rH -H -d »W 1 ß ra 4-J Ό • H Φ 1 ß ß -H rH XI -rl x φ • H 4-> 4-J> ft ri Φ ß ß> 4H • H

KO φ r ß Φ CQ φ Cn D fd o • rl rH Φ (X! 1

N ε 4-1 Φ • rl o ß -H Φ Φ cn

4-1 Xi 3 rl rd φ Cn H ß φ TJ u ri fd o Φ ß X! rl -H ß X! > ^• H u Q ft -H -H

= O Φ X) N ß Φ 0-1 -. V4 φ φ ri h} • rl> M = ß ß Φ 0 4J cn ON 1H ri CQ 1 PQ ß 4-1 ß ß = rd 1 XI 4-J ^Q , T) τ. M ß M Φ MH ß _' CQ CQ CQ o. 4H Φ ß ß α. Φ 4-J ß φ ß -H

Φ Φ 4-> ε 4-J φ = rd CQ ß 4J ß Φ Ό CQ - Φ -rl ß ß ß rl Φ: rd ω ß ^■ 9 Φ Φ O 2 rl 4-J -rl 0 CQ φ O ß ß ß r ^• s ß ß -H φ rH

O

H ß • H rd Φ cn Φ ß CQ 4H 4-J ß Φ 1 O φ PQ 4-J Φ Cn Φ τJ Φ

CO U ^• ϊ 0 Ό P PQ o Cn fd rl Ü Φ M 4J -rl 1 -rl φ CQ i D ε M ε • Λ; o 4H 0 α. φ CQ CQ 1 S ß u rl φ φ ^• H φ Φ! Φ o -rl Φ rd Φ ß 14H>

^• d • HH 0 N ß «MH ß ß ß ß ß rl fd - CQ • rl CQ ri! -3 ^• H Φ X! ß -H

CQ Φ CQ 4 Φ rH ß ^• rl Φ Φ ß ß i ß fd Ό> 4-J Φ rH • rl X! Φ Ό) o Φ Q rl

Φ fO Λ ß rd Ό ß rH 4-J H Φ Λ ß rl φ υ fd 5 rl ε Φ • rl 4-J Λ ü Φ rl ß CQ φ

CQ PQ Φ Xi Φ Φ -H o • H φ ß CQ ε -H ^ ß Ό ß -rl ^• d XI φ rd td Φ -rl

CO ß X! O Cn T3 4-) Φ Hl cn CQ Φ 4-1 o rl 0-1 ^ s -H Φ _' rH ß ü = ß 5 X) -HX! rtJ ß 0 Φ Q ß CQ Xi ß ß -H φ -H Φ ß -H Cn Φ Λ CQ * ε ß CQ 4H 4J ß 3 rH φ> 4 ß ß DI ß rd ß ß 4-> -H 4-JN rH Cn φ 4-J ü Φ H -rd ^• H 4-J CQ Φ X! ; ß M ri -H ^• H ^• H ß 0 Cn ri J 4 • ß rl ε ß -H s PQ ß 1 4H ß cn -H 4-1 X! ü

CQ -H r-i Φ O Φ 4-> Φ φ Φ -rl CQ ß ß U Φ φ H CQ Q 0 fd Φ • rl rd o ß cn φ X! XI S -rt ß M CQ -rl 4 4 ß ß ß CQ ß 4-J N ε ß Φ 4-J 4-> CQ Q -H rd ß (0 rd Φ Φ Φ -H X). = 0 <«. MH Φ s -H N CQ 4-J -rl ß Φ T-J cn ß = 0 Φ 1 rH

3 N? ß ß Xl Cn ß Φ φ Φ ß rl PQ Φ 4-J cn fd Φ Φ 4-J -rl o Φ ß N XI Cn ß

4-J 4-> CQ 4-1 φ Cn ü Φ & PQ rH Φ -H φ 1 Φ ß) T) J CQ r-> Φ ß φ 4-1 ß -H ß

01 rö ß CQ τ ( ^• H -fd Φ 4 Φ Λ Φ ß ri ß ß h-1 ß -H rd rd no XI rd co. Rd

-H X! -H 4H rH -H CQ n rl PQ φ rd φ td t) J Φ • XX X! - P, X! Φ ^

Φ O ß ß Ό ß φ ß • T) 4-> ε ^• d • ß ß X! cn ß 4-1 1 ^• d ε 4 u ß rH

►-1 CQ φ CQ • H o 4J N 5 ß • Cfl -rl 4-J CM -H ß υ -rl Φ ß 0 ß 0 X! CQ φ r-

4-) ß «« Φ XI Φ ß N ß N ß 4-1 φ Λ CQ Cn 4-J Φ -H ß ^ u 4-1 ß ß xi σ »MM -rl ß Λ υ Cn ß CQ Q 4- J ß -rl xi ß. n N rl rd ^• d ^• H rl Φ rl fd

Φ O Φ • Φ φ O ß rd -rl ß rd Φ s u rl Cn φ 4-J φ xi Q Φ a 1 Φ ß O -d Φ 5

T3 ^• ϊ ß ^• H -HH fd ß M CQ ß Φ Xi X -H φ -rl> Φ 4-J υ 1 CQ ß X3 S Φ) CQ

M rl φ cn Ό Φ Φ Φ rd Φ τt υ Φ φ rH 4-J Cn ß ß rd N Φ φ o cn 4-1 -rl ß ß ß Φ Φ CQ O N 4-J rH Λ PQ! CQ rH ß cn φ φ 4-J ß ß 4-J -rl M ß -ri ß ε XI 0 <

0 ß Ό CQ r-i φ 4-1 m -H 1 ü Φ 4J Ω, • rl = 0 H 0-1 • rl CQ rd Q «ß 0 l-i ß rd o CQ

> Φ o O -H ß ß Λ Λ XI CQ> H ε Φ ε = fd) Φ -. ß Xi IM CQ xi 4-1 CQ CQ Φ

4-> s MH ß 5 ß: fd 0 U 4-J • rl 0 o rl fd ε Cn) Φ υ. o X! φ rl - ^• rl

4-> co Ό B -H Φ rH B • H 0 4-> 5 X Φ φ • rl Φ q rl n CQ φ Φ φ rd ü Φ ri Q σi ß ß BX! PQ CQ 0 4 N in ^• H> Cn fd CQ -H ^• H 4-JNN P4 -H> rH ß B ß o Φ ß 4J Λi 4 Φ -s φ ß XI fd s ß rl 4-J 4-J ft ß 0.

-fd φ ß Φ -H •> Φ ß φ Φ ß ß φ 0 CQ ß ß φ Ό Φ O -rd -fd fd ω ß φ ß> ß x: 1-5 φ Φ 4-1 iH ^■ 5 rl rd ß ri ß Φ Ό CQ Φ Φ 0 X. - 4Y ^• ri £ X! xi ^• d xi -H Cn Φ ß φ

-H X! ε XI ß N CN rd rH Φ Φ 4-J -rl CQ • rl φ T) rl rH U u o Φ ß X! ß X!

CQ Φ o rβ O Xl Λ XI ß PQ Cn C0 Cn ß Q Φ 4-J -H ß Φ rH Φ ß CQ CQ -. rd ß -rl O ^• rl U

Φ rd & rd «rd JN • H ß ß Φ ^• H rd rd Λ Φ Ό Φ 4-J 4-J • <H Φ CQ CQ rd

N ß Cn ß ß 4-1 rl Φ 4-J ß ß ε • TJ xi 4 = ß 4-J ^• d rl o ^• H Φ -H

4-1 Φ Ά ß Xl φ ß Φ ß Φ r-i Φ n xi 4-J ß u CQ CQ ß O o 4-J> H -d Cn 5 ß ft

(D -Q CQ Φ ß ü rH CQ ß τ (: fd rd rH φ 4-J rl H Cn CQ ε 4J Φ O ß S s Φ φ Φ N Φ CQ

Xl Φ CQ x: 0 -H rH H ß fd o ß i rd -H -rl φ Φ -H φ! cn> -H in τ) XI> X! CQ o ß cn o> rH Φ -H M 0 CQ ß CQ rl -rl Λ MH Λ Φ ß Φ Φ 0 ß -H Di ü Φ

CQ ß CQ N 4-) • Φ 1 -rl ß 0 ^• H 0 4 = ß ß ε rl Φ ε Φ Φ ß 4 4-1 ß -rl τJ

4-1 ß rd -H cn • 4-1 CQ cn φ r ^ 4-1 rd • rl rH cn ß 0 CQ Φ • rl Xi -rl 4-J Φ = rd 1 Φ rd ß Φ ß rl ß cn MH ß A: fd 4-1 -rH rH CQ rl rd K 4-> rd rH Φ Ό M rH τJ TJ o TJ 4-) rl CQ Cn rH rl rd

0 rβ B rö ß o CQ 4-> Cn rH φ rd 4 rd φ ε ß rd Q, MH Φ CO Φ cn Φ φ Φ h-l

S = ^ £> ri -rl ^• d -H Φ -rl! CQ ε ß tf Φ ß Φ ε ß 4-J o CQ X! -H n ß -rl XI n rH iH ß ß Xi CQ Q ü Φ ß ri> Xi Φ X! 4-J Cn ü 4-1 ß ε rd Φ N rl XI o ß Ό 0 Φ cn ß Xl ü CQ ß ß ß n φ 0, »υ Λ ü Ω, ß ß Φ ^• H Cn ß CQ ß φ υ O Φ ß Φ Φ 4 = 0 n ü fd Φ. fd 0 -rl Φ ß! ε U φ 0 Φ - l fd ß ß Φ XI Φ ε -H Φ Φ XI

4-1 3 Ό cn CQ BO CQ ß>>φ> N u -rl o. Co ß 5-5 ß h-1 Ό ε u K ß Φ τt υ ß

on the basis of the dial-in node used by the laptop PC ^Λ , but an evaluation of the user's Internet address or a selection made at the beginning by the user is preferred.

The embodiment of the invention is not limited to the examples outlined above, but is also possible within the scope of the claims in a large number of modifications which are within the scope of professional action. In particular, combinations of individual components of the arrangements described by way of example are within the scope of the invention.

Claims

claims

1. Method for configuring a user interface for an electronic device (MS; PC; RC) for at least temporary connection to a telecommunications or data network (GSM; TN, IP), in particular for a telecommunications terminal, a handheld PC Remote control device or an audio or video device with a voice-oriented user interface and / or a voice input device, characterized in that the user interface or voice input device is configured via the telecommunications or data network, with at least parts of a language knowledge source, in particular at least parts of a vocabulary of several stored vocabularies, transmitted from a center (SMC, FS) in the telecommunications or data network to a terminal component and received therein and in an internal knowledge source database, in particular an internal vocabulary memory (WM; WM '; WM ^{, Λ} ), get saved.

2. The method of claim 1, d a d u r c h g e k e n n z e i c h n e t that the transmission of the knowledge source to the terminal component takes place in response to a request signal emanating from it.

3. The method of claim 2, d a d u r c h g e k e n n z e i c h n e t that the request signal is generated by the user based on a terminal identifier or the choice of input of a national language and the transfer and storage of the vocabulary take place automatically upon selection.

4. The method according to any one of the preceding claims, characterized in that the vocabulary transmitted national control words for operating the device, in particular for an optical menu leadership and / or voice control and / or speech synthesis.

5. The method according to any one of the preceding claims, d a d u r c h g e k e n n z e i c h n e t that the vocabulary transmitted comprises a national set of personal and / or place names.

6. The method according to any one of the preceding claims, d a d u r c h g e k e n n z e i c h n e t that the vocabulary transmitted includes a national language basic vocabulary of the vernacular and / or a technical language.

7. The method according to any one of the preceding claims, that the transmitted knowledge source comprises a neuronal network or hidden Markov model prepared in the national language.

8. The method as claimed in one of the preceding claims, that the transmission of the language knowledge source or language knowledge sources is organized as an independent service in the telecommunications or data network (GSM; TN, IP).

9. Electronic device, in particular telecommunications terminal (MS), handheld PC (PC), remote control device (RC), audio device or video device, with a user interface that is configured with a method according to one of the preceding claims.

10. Electronic device according to claim 9, d a d u r c h g e k e n n z e i c h n e t that the user interface has a voice control and / or means for voice input of text.

11. Electronic device according to claim 8 or 9, characterized in that the user interface has an optical display device for displaying words or nationally or nationally accented acronyms and / or graphic symbols.

12. System for performing the method according to one of claims 1 to 8, characterized by a server (NS; FS) in the telecommunications or data network (GSM; TN, IP) with storage means (DB1 to DB3; DB1 ^x to DB3 ^N ; DBl ^{, λ} to DB3 ^λ ) for the central storage of the language knowledge source or language knowledge sources and transmission means for their transmission to the electronic device (MS; PC; RC).