EP1472906A2 - Virtueller assistent, der einem benutzer einer datenendeinrichtung hörbare informationen mittels mindestens zwei elektroakustischen wandlern ausgibt, und verfahren zur darbietung von hörbaren informationen eines virtuellen assistenten - Google Patents
Virtueller assistent, der einem benutzer einer datenendeinrichtung hörbare informationen mittels mindestens zwei elektroakustischen wandlern ausgibt, und verfahren zur darbietung von hörbaren informationen eines virtuellen assistentenInfo
- Publication number
- EP1472906A2 EP1472906A2 EP03706218A EP03706218A EP1472906A2 EP 1472906 A2 EP1472906 A2 EP 1472906A2 EP 03706218 A EP03706218 A EP 03706218A EP 03706218 A EP03706218 A EP 03706218A EP 1472906 A2 EP1472906 A2 EP 1472906A2
- Authority
- EP
- European Patent Office
- Prior art keywords
- virtual assistant
- user
- information
- data terminal
- terminal device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/60—Substation equipment, e.g. for use by subscribers including speech amplifiers
- H04M1/6033—Substation equipment, e.g. for use by subscribers including speech amplifiers for providing handsfree use or a loudspeaker mode in telephone sets
- H04M1/6041—Portable telephones adapted for handsfree use
- H04M1/6058—Portable telephones adapted for handsfree use involving the use of a headset accessory device connected to the portable telephone
- H04M1/6066—Portable telephones adapted for handsfree use involving the use of a headset accessory device connected to the portable telephone including a wireless connection
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/26—Devices for calling a subscriber
- H04M1/27—Devices whereby a plurality of signals may be stored simultaneously
- H04M1/271—Devices whereby a plurality of signals may be stored simultaneously controlled by voice recognition
Definitions
- Virtual assistant which outputs audible information to a user of a data terminal device by means of at least two electroacoustic transducers, and method for the presentation of audible information by a virtual assistant
- the invention relates to a virtual assistant which outputs audible information to a user of a data terminal device by means of at least two electroacoustic transducers, and to a method for the presentation of audible information by a virtual assistant to a user of a data terminal device.
- a virtual assistant i.e. a computer-based help (program) can be used, which supports the user in carrying out the steps necessary to carry out a task, or if the user wishes further explanations about the possibilities of the PC application program.
- the user is made aware of incorrect entries and the virtual assistant makes input suggestions to the user.
- the information provided by the virtual assistant is visually presented to the user, i.e. presented by means of a display unit.
- This function of a virtual assistant which is helpful for the user, can in principle also be applied to mobile data terminal devices such as, for example, mobile telephones or those which are known under the name Personal Digital Assistants PDAs.
- mobile data terminal devices such as, for example, mobile telephones or those which are known under the name Personal Digital Assistants PDAs.
- PDAs Personal Digital Assistants
- extensive information optically presented by a virtual assistant is difficult to process for the user of a data terminal device if the user must simultaneously concentrate on further visually presented information in the environment or acoustic information of a conversation partner. It makes sense here to carry out the information presented by the virtual assistant of a data terminal device to the user of the data terminal device by means of an acoustic presentation. In this way, the user of the data terminal device can better process the acoustically presented information and further information presented optically at the same time.
- data terminal devices or methods are known in which additional information is acoustically presented to the user of the data terminal devices or the method.
- an assistant in the ticket office uses acoustic information to guide the user of the ticket office through appropriate operating programs of the ticket office.
- the listener can be given the subjective impression that the sound-generating source is rotating around him or is approaching him or is moving away from him by processing the audio information accordingly.
- the sound-generating source can therefore be positioned anywhere in the room by means of signal processing of the hearing information.
- a virtual assistant which outputs audible information to a user of a data terminal device by means of at least two electroacoustic transducers, can be positioned in the room by the user in order to improve the spatial acoustic separation between the information output by the electroacoustic transducers and further information obtained from at least one other sound source.
- One advantage of the invention is the use of the spatial positioning of sound sources by means of signal processing of the hearing information of the virtual assistant of the data terminal or its localization by the user of the data terminal. This hearing information from the virtual assistant can be perceived better separated from ambient noise for the user of the data terminal device.
- the user of the data terminal device can be given the hearing information of the virtual assistant specifically from one direction, while the user is talking to another conversation partner in the room at the same time.
- a good spatial acoustic separation can be achieved between the hearing information which the virtual assistant and the conversation partner have on the user.
- the user can thus record and process both the information from the virtual assistant and the information from the interlocutor. At the very least, it is easier for the user to record and process the information coming from both the virtual assistant and the conversation partner at the same time.
- a further advantage arises if, in addition to the hearing information originating from the virtual assistant and that available from other information in the environment of the user
- a pedestrian is on the road.
- the pedestrian is loaded with heavy shopping bags.
- the pedestrian would like to make a telephone call using his data terminal designed as a mobile phone.
- the mobile phone is switched on, but stowed in one of its shopping bags and therefore not easy to find.
- the pedestrian wears lightweight headphones with headsets.
- Two electroacoustic transducers for outputting hearing information are integrated in the headphones with headsets.
- the headphone with headset is equipped with a radio module, for example a Bluetooth radio module, for short-range data exchange between headphones with headset and mobile phone.
- the pedestrian, user of the headphones with headset or the mobile phone activates the headphone with headset and thus enables data exchange between headphones with headset and mobile phone.
- the user speaks the word "SELECT" in the headphones with headset, whereupon the virtual assistant of the mobile phone answers with "PLEASE NAME NAME".
- the user gives the name of the person to be called. Since the user is in an environment with high noise levels, the mobile phone does not recognize the name of the person to be called with sufficient accuracy.
- the mobile phone processes the name entered by the user and compares it with the names stored in the internal phone book of the mobile phone. The mobile phone recognizes the spoken name as "SCHMITZER" or "SCHNITZLER".
- the user recognizes the two options offered by the virtual assistant despite the loud ambient noise, because the binaural technique is used when the audio information of the virtual assistant of the mobile phone is output by means of the electroacoustic transducer.
- the binaural technique enables the targeted signal processing of the hearing information in the mobile phone.
- the listening information is reproduced by the virtual assistant using the headset with a headset
- the user of the mobile telephone can perceive a clear local assignment of the hearing information output by the virtual assistant.
- the hearing information is processed in the mobile telephone in such a way that the user of the mobile telephone locates the hearing information presented by the virtual assistant as coming from the vicinity of the head.
- the hearing information is "whispered" from behind the user's shoulder into his ear.
- the position of the virtual assistant or the position from which the hearing information output by the virtual assistant is perceived can be changed as desired by the user of the mobile telephone, for example by means of an electro-mechanical input device known per se.
- the electromechanical input device is, for example, a ball in a socket.
- the ball rotations caused by the user are detected by sensors.
- the virtual assistant is positioned in a manner known per se by means of voice commands or by means of inputs on a touch-sensitive display unit of the mobile telephone.
- the mobile phone has a head position sensor that detects head movements of the user of the mobile phone, for example by means of a rotation rate sensor or a magnetic field sensor
- the selected position of the virtual assistant can also be maintained if the head movements during the signal processing of the Listening information are taken into account.
- the user can both operate the mobile phone in a simple manner using voice commands to set up an outgoing connection and also be able to perceive ambient noises such as loud calls or honking etc. ,
- a teleconferencing situation is described.
- a large number of people who largely speak or understand different languages take part in the teleconference.
- the people are at individual tables are spread across the teleconference room, with each person having their own screen. If a participant answers, the data terminal designed as a teleconferencing system displays this participant on a large screen on a side wall of the teleconference room, so that the other participants can also observe the facial expressions and gestures of this participant.
- his speech is broadcast on loudspeakers connected to the teleconference system and designed as electroacoustic transducers.
- the contributions of the speaking participant are simultaneously translated into the languages of the other participants and the translation in the form of hearing information is made accessible to the participants via headphones with a headset, in which two electroacoustic transducers for outputting hearing information are integrated.
- the simultaneous translation is audibly output by the teleconferencing system through a virtual assistant for the other participants.
- the virtual assistant can be positioned anywhere in the room by any participant in the teleconference by entering appropriate key combinations in the teleconferencing system.
- the positioning of the virtual assistant or the spatial acoustic perception of the hearing information output by the virtual assistant is achieved by the individual subscriber by means of signal processing of the hearing information in the teleconferencing system.
- the participants position the virtual assistant so that the participants perceive the output of the hearing information by the virtual assistant as being from behind over the shoulder and coming from the vicinity of the head.
- This positioning of the virtual assistant achieves a good spatial acoustic separation between the speech broadcast over the loudspeaker and the simultaneous translation of the speech, so that the participants can follow the speech broadcast over the loudspeaker as well as the simultaneous translation and the facial expressions and gestures of the speaking participant are still attentive can watch. This means that the participants can follow several information strands simultaneously with great attention.
- this participant can cause the teleconferencing system to send him additional information acoustically via the virtual assistant, for example about the daily schedule, background information about the other participants or information about the participant's hotel allow.
- Tour guides are mentioned here by way of example, the tour guide explaining certain exhibits of a museum to the visitors in the national language, with the visitors hearing a simultaneous translation of the explanations of the travel guide in good spatial acoustic separation by a virtual assistant via their UMTS mobile phone and, if necessary, further optical information with regard to them the exhibits on the display unit of their UMTS mobile phone can be followed closely at the same time.
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Human Computer Interaction (AREA)
- Telephone Function (AREA)
- Circuit For Audible Band Transducer (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
Description
Claims
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE10201072 | 2002-01-14 | ||
DE10201072 | 2002-01-14 | ||
PCT/DE2003/000078 WO2003058419A2 (de) | 2002-01-14 | 2003-01-13 | Virtueller assistent, der einem benutzer einer datenendeinrichtung hörbare informationen mittels mindestens zwei elektroakustischen wandlern ausgibt, und verfahren zur darbietung von hörbaren informationen eines virtuellen assistenten |
Publications (1)
Publication Number | Publication Date |
---|---|
EP1472906A2 true EP1472906A2 (de) | 2004-11-03 |
Family
ID=7712057
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP03706218A Withdrawn EP1472906A2 (de) | 2002-01-14 | 2003-01-13 | Virtueller assistent, der einem benutzer einer datenendeinrichtung hörbare informationen mittels mindestens zwei elektroakustischen wandlern ausgibt, und verfahren zur darbietung von hörbaren informationen eines virtuellen assistenten |
Country Status (5)
Country | Link |
---|---|
US (1) | US20050129250A1 (de) |
EP (1) | EP1472906A2 (de) |
CN (1) | CN1615671A (de) |
AU (1) | AU2003208256A1 (de) |
WO (1) | WO2003058419A2 (de) |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7177413B2 (en) * | 2003-04-30 | 2007-02-13 | Cisco Technology, Inc. | Head position based telephone conference system and associated method |
US10079892B2 (en) * | 2010-04-16 | 2018-09-18 | Avaya Inc. | System and method for suggesting automated assistants based on a similarity vector in a graphical user interface for managing communication sessions |
US10721594B2 (en) | 2014-06-26 | 2020-07-21 | Microsoft Technology Licensing, Llc | Location-based audio messaging |
US11200026B2 (en) * | 2016-08-26 | 2021-12-14 | Bragi GmbH | Wireless earpiece with a passive virtual assistant |
US10051107B1 (en) | 2017-03-16 | 2018-08-14 | Microsoft Technology Licensing, Llc | Opportunistic timing of device notifications |
US11188721B2 (en) * | 2018-10-22 | 2021-11-30 | Andi D'oleo | Headphones for a real time natural language machine interpretation |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4088849A (en) * | 1975-09-30 | 1978-05-09 | Victor Company Of Japan, Limited | Headphone unit incorporating microphones for binaural recording |
DE69522971T2 (de) * | 1994-02-25 | 2002-04-04 | Dorte Hammershoi | Binaurale Synthese, kopfbezogene Übertragungsfunktion, und ihre Verwendung |
US7012630B2 (en) * | 1996-02-08 | 2006-03-14 | Verizon Services Corp. | Spatial sound conference system and apparatus |
US5751817A (en) * | 1996-12-30 | 1998-05-12 | Brungart; Douglas S. | Simplified analog virtual externalization for stereophonic audio |
US6038330A (en) * | 1998-02-20 | 2000-03-14 | Meucci, Jr.; Robert James | Virtual sound headset and method for simulating spatial sound |
EP1143766A4 (de) * | 1999-10-28 | 2004-11-10 | Mitsubishi Electric Corp | System zur wiedergabe von dreidimensionalem schallfeld |
JP4509450B2 (ja) * | 1999-12-24 | 2010-07-21 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | 一体化されたマイクロホンを有するヘッドホン |
GB2360165A (en) * | 2000-03-07 | 2001-09-12 | Central Research Lab Ltd | A method of improving the audibility of sound from a loudspeaker located close to an ear |
AUPQ938000A0 (en) * | 2000-08-14 | 2000-09-07 | Moorthy, Surya | Method and system for recording and reproduction of binaural sound |
US6961439B2 (en) * | 2001-09-26 | 2005-11-01 | The United States Of America As Represented By The Secretary Of The Navy | Method and apparatus for producing spatialized audio signals |
-
2003
- 2003-01-13 EP EP03706218A patent/EP1472906A2/de not_active Withdrawn
- 2003-01-13 AU AU2003208256A patent/AU2003208256A1/en not_active Abandoned
- 2003-01-13 CN CN03802220.6A patent/CN1615671A/zh active Pending
- 2003-01-13 WO PCT/DE2003/000078 patent/WO2003058419A2/de not_active Application Discontinuation
- 2003-07-17 US US10/501,361 patent/US20050129250A1/en not_active Abandoned
Non-Patent Citations (1)
Title |
---|
See references of WO03058419A3 * |
Also Published As
Publication number | Publication date |
---|---|
WO2003058419A3 (de) | 2004-09-02 |
AU2003208256A8 (en) | 2003-07-24 |
WO2003058419A2 (de) | 2003-07-17 |
CN1615671A (zh) | 2005-05-11 |
AU2003208256A1 (en) | 2003-07-24 |
US20050129250A1 (en) | 2005-06-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1912474B1 (de) | Verfahren zum Betreiben einer Hörhilfe, sowie Hörhilfe | |
DE60209637T2 (de) | Steuerung eines Konferenzgespräches | |
EP2084937B1 (de) | Verfahren und vorrichtung zur aufnahme, übertragung und wiedergabe von schallereignissen für kommunikationsanwendungen | |
EP3430819B1 (de) | Ohrhörer mit getrennten mikrofonen für binauralaufnahmen und zum telefonieren | |
DE102016103331A1 (de) | Vorrichtung und Verfahren zur Wiedergabe von Audiosignalen in einem Kraftfahrzeug | |
EP1912472A1 (de) | Verfahren zum Betreiben einer Hörhilfe, sowie Hörhilfe | |
EP2047668A1 (de) | Verfahren, sprachdialogsystem und telekommunikationsendgerät zur multilingualen sprachausgabe | |
DE2510731A1 (de) | Elektrische schaltung fuer eine hoerhilfe | |
EP1472906A2 (de) | Virtueller assistent, der einem benutzer einer datenendeinrichtung hörbare informationen mittels mindestens zwei elektroakustischen wandlern ausgibt, und verfahren zur darbietung von hörbaren informationen eines virtuellen assistenten | |
DE102020207482B4 (de) | Verfahren zum Ausgaben von nutzerindividuellen akustischen Signalen mit einer Ausgabeeinheit, Computerprogrammprodukt und elektronisches Signalverarbeitungssystem | |
DE102014210760B4 (de) | Betrieb einer Kommunikationsanlage | |
EP2156654B1 (de) | Mobile telekommunikationseinrichtung zum übertragen und übersetzen von informationen | |
DE102016114720B4 (de) | Kommunikationsgerät zur sprachbasierten Kommunikation | |
DE2523864A1 (de) | Mikrofon-lautsprecherkombination fuer kommunikationssysteme | |
DE3737873C2 (de) | Verwendung von Hörsprechgarnituren zur Verbesserung der Sprachverständlichkeit in störschallerfüllter Umgebung | |
DE102019135799A1 (de) | Verfahren zum Verbessern von Sprachverständlichkeit einer elektronischen Sprechverbindung und Headset zur Durchführung des Verfahrens | |
DE112019005697T5 (de) | Verfahren zur Bereitstellung von Dienstleistungen unter Verwendung eines Ohrbügels | |
DE102005036867A1 (de) | Sicherstellung der Privatsphäre bei Lautsprecherausgaben | |
JP2005123959A (ja) | 高臨場感通信会議装置 | |
DE102005004974A1 (de) | Verfahren und System zum Durchführen von Telefonkonferenzen | |
DE10052992C2 (de) | Verfahren für die raumgerechte Wiedergabe von Toninformationen bei Videokonferenzen | |
Gimm et al. | 10 A Multichannel Spatial Hands-Free Application for In-Car Communication Systems | |
WO2001018990A1 (de) | Personeninformationsanlage, insbesondere personenführungsanlage, zum drahtlosen übertragen von sprachinformationen | |
DE102018211129A1 (de) | Audioeinrichtung für ein Fahrzeug und Verfahren zum Betrieb einer Audioeinrichtung für ein Fahrzeug | |
DE102007058586A1 (de) | Vorrichtung und Verfahren zur Durchführung von Fernbesprechungen |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20040621 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR IE IT LI LU MC NL PT SE SI SK TR |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: 7H 04S 1/00 A Ipc: 7G 06F 3/16 B |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: LORENZ, FRANK Inventor name: POERSCHMANN, CHRISTOPH Inventor name: EUSCHER, CHRISTOPH Inventor name: HUELSKEMPER, MICHAEL Inventor name: KLINKE, STEFANO, AMBROSIUS Inventor name: AUBAUER, ROLAND |
|
17Q | First examination report despatched |
Effective date: 20070831 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20080111 |