EP1077013B1 - Method and device for operating voice-controlled systems in motor vehicles - Google Patents
Method and device for operating voice-controlled systems in motor vehicles Download PDFInfo
- Publication number
- EP1077013B1 EP1077013B1 EP99924872A EP99924872A EP1077013B1 EP 1077013 B1 EP1077013 B1 EP 1077013B1 EP 99924872 A EP99924872 A EP 99924872A EP 99924872 A EP99924872 A EP 99924872A EP 1077013 B1 EP1077013 B1 EP 1077013B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- voice
- signal
- microphone
- loudspeaker
- signals
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
- H04R3/02—Circuits for transducers, loudspeakers or microphones for preventing acoustic reaction, i.e. acoustic oscillatory feedback
Definitions
- the invention relates to a method and a device for operating voice-assisted Systems such as communication and / or speech / intercom systems in motor vehicles, in which or via which Mehdachmlkrofonan extract recorded voice signals and at least one Speakers are passed on, according to the preamble of claims 1 and 5.
- EP 0078014 B1 is a speech recognition device for a motor vehicle is known, in which in the amplifier system of the speech recognition device Sensors are reported or fed in whether the engine is in operation and / or that Vehicle moves. Then a level control is then attempted will filter out the voice command from the background noise.
- a filtering is known from WO 97/34290 in which periodic interference signals are filtered out, in which their period is determined and by means of a generator is interfered so that the speech signal remains.
- DE 39 25 589 A1 discloses the use of a multiple microphone arrangement, being one of the microphones in the engine compartment and a when used in a motor vehicle is further arranged in the passenger compartment. The two signals are then subtracted. The result is that only the engine noise or the actual one Operating noise of the vehicle itself subtracted from the overall signal in the passenger compartment becomes. Specific background noises are not taken into account here. As well there is no feedback suppression, which is a particular problem. All over where microphones and loudspeakers are arranged in acoustically connectable proximity, it happens that the acoustic signal coupled out at the loudspeaker in turn the microphone feeds back. There is a so-called feedback and one subsequent override.
- the invention is therefore based on the object of a method and a device of generic type to the extent that feedback and Instabilities that occur when several microphones and loudspeakers are arranged, be suppressed.
- the object is in a method of the generic type according to the invention solved by the characterizing features of claim 1.
- the invention is based on both the method and the device Communication and / or intercom / intercom in motor vehicles. It it is also known to arrange a multiple microphone arrangement, in addition Record voice and noise signals and the total signal Subtract noise signals again so that the speech signal remains filtered.
- the essence of the invention is that the respective Microphone signal is first frequency shifted by a small amount ⁇ F, and only then on the speaker or on the input of a voice-controlled Facility is given.
- the frequency shift according to the invention is carried out at a defined point and is not arbitrary, supports the on the one hand the filtering and on the other hand there are feedbacks, also the echo signal decoupled by one of the not yet frequency shifted overall signal first microphone the overall signal of another or second shifted by ⁇ F Microphones is subtracted, and vice versa.
- the illustration shows the basic structure as well as the mode of operation, so that the image itself, both the procedural measures and the interconnection of the individual furnishing elements to each other in their logical entirety is or are recognizable.
- the vehicle interior is in divided into two sub-rooms, namely front and rear.
- the microphone M1 picks up the speech signal there and possibly noise signals.
- the noise signal consists of the noise level in the passenger compartment that results from the operation of the vehicle. This can be engine noises, wind noises and rolling noises, but also acoustic echo signals from the other tell room and the like.
- the sum signal from speech and noise backdrop (total signal) contained at M1 is fed to a first summation point S1.
- a correspondingly prepared signal is then also generated from this summation point an acoustic model AM1 in front, fed in the acoustic model AM1 generated subtraction signal in this embodiment comes from the im received rear part of the vehicle, and already frequency-shifted signal. Because this signal coming from M2 and frequency shifted in F2, which originates in the rear compartment of the passenger cell, via AM1 signaling is also taken into account at the front, that generated in the rear compartment of the vehicle and after vome, acoustically transported into the front compartment of the passenger cell Signal, which is also registered by M1, in turn at the summation point S1 subtracted. That is, the device AM1 becomes the rear compartment of the passenger compartment acoustically separated from the front compartment of the passenger compartment.
- the total perceptible acoustic signal is fed in, and at the summation point S1 first subtracts the echo from the rear compartment of the passenger compartment.
- the so obtained original signal from M1 from the front compartment of the passenger cell then becomes one Frequency shifting device F.1 supplied and by an amount ⁇ F, for example 5 Hz, shifted.
- the output signal of F1 thus obtained is then the Loudspeaker L1 of the rear compartment of the passenger compartment supplied and to the other at the same time again fed into the device AM2 in the same way.
- AM2 again represents the acoustic model for the rear part of the Passenger compartment.
- the transmission of a voice message from the back of the tell room Passenger cell via M2 to the front compartment of the passenger cell via L2 takes place in analogous way. That is, the microphone M2 registers the voice message together Noise in the rear compartment of the passenger compartment and transmits it to the Summation point S2, at which the acoustic recorded via M1 Overall signal, i.e. the echo and background noise is subtracted. So again the echo-free signal created by the microphone M2 then also becomes one Frequency shifter F2 supplied, which in turn a frequency shift by an amount ⁇ F. At the output of this frequency shifter F2 becomes the result or the signal thus processed in turn the front subspace the passenger compartment, namely the loudspeaker L2 positioned there.
- the Frequency shift for transmission from front to back can also be from that frequency shift from the back to the front be different.
Landscapes
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Otolaryngology (AREA)
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
- Circuit For Audible Band Transducer (AREA)
- Soundproofing, Sound Blocking, And Sound Damping (AREA)
- Interconnected Communication Systems, Intercoms, And Interphones (AREA)
Description
Die Erfindung betrifft ein Verfahren sowie eine Einrichtung zum Betrieb von sprachunterstützten
Systemen, wie Kommunikations- und/oder Sprech- /Gegensprecheinrichtungen
in Kraftfahrzeugen, bei welchem bzw. bei welcher über eine
Mehdachmlkrofonanordnung Sprachsignale aufgenommen und an mindestens einen
Lautsprecher weitergegeben werden, gemäß Oberbegriff der Patentansprüche 1 und 5.The invention relates to a method and a device for operating voice-assisted
Systems such as communication and / or speech / intercom systems
in motor vehicles, in which or via which
Mehdachmlkrofonanordnung recorded voice signals and at least one
Speakers are passed on, according to the preamble of
Verfahren dieser Art werden in Kraftfahrzeugen zum einen zum sprachunterstützten Gegensprechbetrieb eingesetzt, oder aber auch zur Unterstützung von spracheingabegesteuerten elektronischen oder elektrischen Baugruppen. Die grundsätzliche Problematik hierbei ist, daß im Kraftfahrzeug je nach Betriebszustand eine entsprechende Geräuschkulisse vorhanden ist. Diese überdeckt die Sprachbefehle. Sprech- und Gegensprechanlagen in Kraftfahrzeugen sind überwiegend bei großen Fahrzeugen, Minibussen und dergleichen vorteilhaft. Sie können jedoch auch bei normalen Personenkraftwagen eingesetzt werden. Bei der Verwendung von sprachgesteuerten Eingabeeinheiten für elektrische Komponenten im Fahrzeug ist die Unterdrückung der Geräuschkulisse bzw. das Herausfiltem des Sprachbefehles noch von besonderer Bedeutung.Methods of this type become voice-assisted in motor vehicles Intercom mode used, or also to support voice input controlled electronic or electrical assemblies. The basic The problem here is that, depending on the operating state, a corresponding one in the motor vehicle Noise is present. This covers the voice commands. Speaking and Intercom systems in motor vehicles are predominantly in large vehicles, Minibuses and the like advantageous. However, you can also use normal Cars are used. When using voice controlled Input units for electrical components in the vehicle is the suppression of Noise or the filtering out of the voice command is even more special Importance.
So Ist aus der EP 0078014 B 1 eine Spracherkennungseinrichtung für ein Kraftfahrzeug bekannt, bei welchem in das Verstärkersystem der Spracherkennungseinrichtung über Sensoren gemeldet bzw. eingespeist wird, ob der Motor in Betrieb ist und/oder sich das Fahrzeug bewegt. Danach richtet sich sodann eine Pegelbeeinflussung mit der versucht wird, den Sprachbefehl aus der Geräuschkulisse herauszufiltern.EP 0078014 B1 is a speech recognition device for a motor vehicle is known, in which in the amplifier system of the speech recognition device Sensors are reported or fed in whether the engine is in operation and / or that Vehicle moves. Then a level control is then attempted will filter out the voice command from the background noise.
Aus der DE 3742929 C1 ist eine Anordnung mit zwei Mikrofonen bekannt, wobei eines der Mikrofone am Mund der Bedienperson angeordnet ist und ein anderes In der Nähe, jedoch zur Aufnahme des Körperschalles. Beide Mikrofonsignale werden getriggert derart, daß Körperschall vom Gesamtschall subtrahierbar ist. An arrangement with two microphones is known from DE 3742929 C1, one of which Microphones are placed on the operator's mouth and another nearby, however to absorb structure-borne noise. Both microphone signals are triggered in such a way that Structure-borne noise is subtractable from the total sound.
Aus der DE 197 05 471 A1 ist bekannt, eine Spracherkennung mit Hilfe einer Transversalfilterung zu unterstützen. Hierbei wird eine Frequenzanalyse vorgenommen, die jedoch lediglich zu dem Zweck der Sprachbefehlserkennung dient Es findet hierbei keine Nebengeräuschkompensation statt.DE 197 05 471 A1 discloses speech recognition with the aid of transversal filtering to support. A frequency analysis is carried out here however, it is only used for the purpose of voice command recognition Noise compensation instead.
Aus der WO 97/34290 ist eine Filterung bekannt, bei der periodische Störsignale ausgefiltert werden, in dem deren Periode ermittelt und mittels Generator herausinterferiert wird, so daß das Sprachsignal übrig bleibt.A filtering is known from WO 97/34290 in which periodic interference signals are filtered out, in which their period is determined and by means of a generator is interfered so that the speech signal remains.
Aus der DE 41 06 405 C2 ist ein Verfahren bekannt, bei dem eine Geräuschsubtraktion vom Sprachsignal erfolgt, wobei eine Mehrzahl von Mikrofonen verwendet wird.From DE 41 06 405 C2 a method is known in which a noise subtraction from the speech signal, using a plurality of microphones.
Aus der DE 39 25 589 A1 ist die Verwendung einer Mehrfachmlkrofonanordnung bekannt, wobei bei Anwendung im Kraftfahrzeug eines der Mikrofone im Motorraum und ein weiteres im Fahrgastraum angeordnet ist. Sodann erfolgt eine Subtraktion beider Signale. Nachbilig ist hierbei, daß lediglich das Motorgeräusch bzw. das eigentliche Betriebsgeräusch des Fahrzeuges selbst vom Gesamtsignal Im Fahrgastraum abgezogen wird. Spezifische Nebengeräusche werden hierbei unberücksichtigt gelassen. Ebenso fehlt eine Rückkopplungsunterdrückung, die eine besondere Problematik darstellt. Überall dort, wo Mikrofone und Lautsprecher in akustisch ankoppelbarer Nähe angeordnet sind, kommt es vor, daß das am Lautsprecher ausgekoppelte akustische Signal wiederum in das Mikrofon rückeinspeist. Es kommt zu einer sogenannten Rückkopplung und einer darauf folgenden Übersteuerung.DE 39 25 589 A1 discloses the use of a multiple microphone arrangement, being one of the microphones in the engine compartment and a when used in a motor vehicle is further arranged in the passenger compartment. The two signals are then subtracted. The result is that only the engine noise or the actual one Operating noise of the vehicle itself subtracted from the overall signal in the passenger compartment becomes. Specific background noises are not taken into account here. As well there is no feedback suppression, which is a particular problem. All over where microphones and loudspeakers are arranged in acoustically connectable proximity, it happens that the acoustic signal coupled out at the loudspeaker in turn the microphone feeds back. There is a so-called feedback and one subsequent override.
Aus der EP-A-0 304 257 ist ein ähnliches Verfahren und eine ähnliche Einrichtung bekannt, welche die Merkmale der Oberbegriffe der Ansprüche 1 und 5 offenbaren und bei welchem ein aus
Sprachsignal und Fremdsignal bestehendes Summensignal gebildet wird. Die zusätzliche
Fremdschallaufnahme erfolgt gesondert zusätzlich. Das Fremdschall- und das
Sprachsignal wird über einen Filter geleitet und vom Summensignal subtrahiert Das
Vergleichsergebnis steuert dann den Filter. Ein Verfahren dieser Art kann das Auftreten
von Echos und Rückkopplungen nicht wirksam bekämpfen.From EP-A-0 304 257 a similar method and a similar device are known which disclose the features of the preambles of
Der Erfindung liegt somit die Aufgabe zugrunde, ein Verfahren sowie eine Einrichtung der gattungsgemäßen Art dahingehend weiterzubilden, daß Rückkopplungen und Instabilitäten, die bei Anordnung mehrerer Mikrofone und Lautsprecher auftreten, unterdrückt werden. The invention is therefore based on the object of a method and a device of generic type to the extent that feedback and Instabilities that occur when several microphones and loudspeakers are arranged, be suppressed.
Die gestellte Aufgabe ist bei einem Verfahren der gattungsgemäßen Art erfindungsgemäß
durch die kennzeichnenden Merkmale des Patentanspruches 1 gelöst.The object is in a method of the generic type according to the invention
solved by the characterizing features of
Weitere vorteilhafte Ausgestaltungen des Verfahrens sind in den Ansprüchen 2 bis 4
angegeben.Further advantageous embodiments of the method are in
Hinsichtlich einer Einrichtung der gattungsgemäßen Art ist die gestellte Aufgabe erfindungsgemäß durch die kennzeichnenden Merkmale des Patentanspruches 5 gelöst. Weitere vorteilhafte Ausgestaltungen der einrichtungsgemäßen Erfindung sind in den übrigen Ansprüchen angegeben.With regard to a device of the generic type, the task is solved according to the invention by the characterizing features of claim 5. Further advantageous refinements of the inventive device are in the other claims specified.
Die Erfindung geht sowohl hinsichtlich des Verfahrens als auch der Einrichtung von einer Kommunikations- und/oder Sprech- /Gegensprecheinrichtung in Kraftfahrzeugen aus. Es ist auch bekannt, hierbei eine Mehrfachmikrofonanordnung anzuordnen, darüber hinaus Sprach- als auch Geräuschsignale aufzunehmen und vom Gesamtsignal die Geräuschsignale wiederum zu subtrahieren, so daß das Sprachsignal gefiltert übrig bleibt.The invention is based on both the method and the device Communication and / or intercom / intercom in motor vehicles. It it is also known to arrange a multiple microphone arrangement, in addition Record voice and noise signals and the total signal Subtract noise signals again so that the speech signal remains filtered.
Gemäß der gestellten Aufgabe besteht der Kern der Erfindung darin, daß das jeweilige Mikrofonsignal zunächst um einen kleinen Betrag ΔF frequenzverschoben wird, und nachfolgend erst auf den oder die Lautsprecher oder auf die Eingabe einer sprachgesteuerten Einrichtung gegeben wird. Die erfindungsgemäße Frequenzverschiebung, die hierbei an definierter Stelle vorgenommen wird und nicht willkürlich ist, unterstützt zum einen die Filterung und zum anderen werden Rückkopplungen, also auch das Echosignal ausgekoppelt, indem von dem noch nicht frequenzverschobenen Gesamtsignal eines ersten Mikrofones das um ΔF verschobene Gesamtsignal eines anderen bzw. zweiten Mikrofones subtrahiert wird, und umgekehrt.According to the object, the essence of the invention is that the respective Microphone signal is first frequency shifted by a small amount ΔF, and only then on the speaker or on the input of a voice-controlled Facility is given. The frequency shift according to the invention, the is carried out at a defined point and is not arbitrary, supports the on the one hand the filtering and on the other hand there are feedbacks, also the echo signal decoupled by one of the not yet frequency shifted overall signal first microphone the overall signal of another or second shifted by ΔF Microphones is subtracted, and vice versa.
Da Rückkopplungen ohne die besagte erfindungsgemäße Frequenzverschiebung nichts weiter sind als das rückgekoppelt verstärkte Sprachsignal, können mit Mitteln und Vorgehensweisen aus dem zitierten Stand der Technik solche Rückkopplungen nicht eliminiert werden. Dies ist deshalb der Fall, weil Einrichtungen der bekannten Art lediglich das Sprachsignal vom Geräuschsignal separieren und das rückgekoppelte Signal als Sprachsignal und nicht als Geräuschsignal identifizieren. Dadurch sind die besagten Rückkopplungen mit Hilfe der im Stand der Technik bekannten Mittel nicht, oder nicht gleichzeitig beherrschbar. Since feedback without the frequency shift according to the invention nothing are further than the feedback amplified speech signal, can be by means and Approaches from the cited prior art do not provide such feedback be eliminated. This is the case because devices of the known type only separate the speech signal from the noise signal and the feedback signal as Identify voice signal and not as noise signal. As a result, the said Feedback using the means known in the prior art is not, or is not controllable at the same time.
Demgegenüber werden jedoch durch das erfindungsgemäße Verfahren sowie durch die erfindungsgemäße Einrichtung, die sich auf die Verechaltung der einzelnen Elemente miteinander bezieht, auf elegante Weise Rückkopplungseffekte eliminiert.In contrast, however, by the inventive method and by the device according to the invention, which relates to the interconnection of the individual elements related, elegantly eliminates feedback effects.
Da die Rückkopplung als solche ursächlich immer dann auftritt, wenn Mikrofonort und Lautsprecherort dicht beieinander liegen, was in Kraftfahrzeugen zwanghaft der Fall ist, kommt der Eliminierung dieser Rückkopplung im genannten Anwendungsfall ganz erhebliche Bedeutung zu. Dies gilt nicht nur im Falle des Gegensprechbetriebes, bei dem elektroakustische Rückkopplungen für die Insassen unangenehm sind, sondern hat auch besondere Bedeutung beim Einsatz sprachgesteuerter Eingabeschnittstellen von elektrischen bzw. elektronischen Bauteilen am Kraftfahrzeug. Dies gilt nur dann, wenn die gesamte Anordnung Im Fahrzeug sowohl Mikrofone als auch Lautsprecher umfaßt, und hierüber auch die sprachgesteuerte Eingabe an elektrische Geräte erfolgt. Rückkopplungen und daraus resultierende Übersteuerungen können selbst bei intelligenten Eingabeschnittstellen erhebliche Fehlfunktionen und Mißdeutungen des Sprachbefehles hervorrufen. Je nach Einsatzfall stellt dies auch ein Sicherheitsrisiko dar. Wahlweise kann die gleichzeltige Geräuscheliminierung zusätzlich, d.h. gleichzeitig vorgenommen werden.Since the feedback as such always occurs when the microphone location and Speaker location are close together, which is compulsorily the case in motor vehicles, the elimination of this feedback comes completely in the use case mentioned significant importance too. This does not only apply in the case of intercom, where electroacoustic feedback is uncomfortable for the occupants, but also has of particular importance when using voice-controlled input interfaces from electrical or electronic components on the motor vehicle. This only applies if the entire arrangement in the vehicle includes both microphones and speakers, and This also enables voice-controlled input to electrical devices. Feedback and the resulting overload can even occur intelligent input interfaces considerable malfunctions and misinterpretations of the Cause voice commands. Depending on the application, this also poses a security risk. Optionally, simultaneous noise cancellation can also be carried out, i.e. simultaneously be made.
Die Erfindung ist in der Zeichnung dargestellt und nachfolgend näher beschrieben.The invention is illustrated in the drawing and described in more detail below.
Die Abbildung zeigt den prinzipiellen Aufbau sowie auch die Funktionsweise, so daß aus der Abbildung selbst sowohl die Verfahrensmaßnahmen, als auch die Verschaltung der einzelnen einrichtungsgemäßen Elemente zueinander In ihrer logischen Gesamtheit erkennbar ist, bzw. sind.The illustration shows the basic structure as well as the mode of operation, so that the image itself, both the procedural measures and the interconnection of the individual furnishing elements to each other in their logical entirety is or are recognizable.
In diesem dargestellten Ausführungsbeispiel der Erfindung ist der Fahrzeuginnenraum in zwei Teilräume unterteilt, nämlich vorne und hinten.In this illustrated embodiment of the invention, the vehicle interior is in divided into two sub-rooms, namely front and rear.
Im vorderen Teil befindet sich ein Mikrofon M1 und ein Lautsprecher L 2.
Das Mikrofon M1 nimmt das dortige Sprachsignal und ggf. Geräuschsignale auf. Das
Geräuschsignal besteht dabei aus der sich im Betrieb des Fahrzeuges ergebenden
Geräuschkullsse im Fahrgastraum. Dies können Motorengeräusche, Windgeräusche
sowie Abrollgeräusche aber auch akustische Echosignale aus dem anderen Tellraum und
dergleichen mehr sein. Das an M1 enthaltene Summensignal aus Sprach- und
Geräuschkulisse (Gesamtsignal), wird einem ersten Summationspunkt S1 zugeführt. In the front part there is a microphone M1 and a
The microphone M1 picks up the speech signal there and possibly noise signals. The noise signal consists of the noise level in the passenger compartment that results from the operation of the vehicle. This can be engine noises, wind noises and rolling noises, but also acoustic echo signals from the other tell room and the like. The sum signal from speech and noise backdrop (total signal) contained at M1 is fed to a first summation point S1.
Diesem Summationspunkt wird dann ebenfalls ein entsprechend aufbereitetes Signal aus einem akustischen Model AM1 vorne, zugeführt Das im akustischen Modell AM1 generierte Subtraktionssignal entstammt in diesem Ausführungsbeispiel aus dem im hinteren Teil des Fahrzeuges erhaltenen, und bereits frequenzverschobenen Signal. Dadurch, daß dieses von M2 kommende und in F2 frequenzverschobene Signal, welches dem hinteren Teilraum der Fahrgastzelle entstammt, über AM1 signaltechnisch auch vorne berücksichtigt wird, wird das im hinteren Teilraum des Fahrzeuges generierte und nach vome, in den vorderen Teilraum der Fahrgastzelle akustisch transportierte Signal, welches auch von M1 registriert wird, am Summationspunkt S1 wiederum subtrahiert. D.h., durch die Einrichtung AM1 wird der hintere Teilraum der Fahrgastzelle vom vorderen Teilraum der Fahrgastzelle akustisch getrennt. D.h., zunächst wird in M1 das gesamt wahrnehmbare akustische Signal eingespeist, und am Summationspunkt S1 zunächst das Echo vom hinteren Teilraum der Fahrgastzelle subtrahiert. Das so erhaltene originäre Signal von M1 aus dem vorderen Teilraum der Fahrgastzelle wird sodann einer Frequenzverschiebeeinrichtung F.1 zugeführt und um einen Betrag ΔF, beispielsweise 5 Hz, verschoben. Das so erhaltene Ausgangssignal von F1 wird sodann dem Lautsprecher L1 des hinteren Teilraumes der Fahrgastzelie zugeführt und zum anderen gleichzeitig auch wiederum auf die gleiche Weise in die Einrichtung AM2 eingespeist. AM2 repräsentiert dabei wieder das akustische Modell für den hinteren Teilraum der Fahrgastzelle. Die Übermittlung einer Sprachnachricht vom hinteren Tellraum der Fahrgastzelle über M2 zum vorderen Teilraum der Fahrgastzelle über L2 erfolgt in analoger Weise. D.h., das Mikrofon M2 registriert die Sprachnachricht samt Geräuschkulisse im hinteren Teilraum der Fahrgastzelle und übermittelt sie an den Summationspunkt S2 , an welchem das über M1 aufgenommene akustische Gesamtsignal, d.h., das Echo sowie Nebengeräusche, subtrahiert wird. Das so wiederum erstellte echofreie Signal von dem Mikrofon M2 wird sodann ebenfalls einer Frequenzverschiebeeinrichtung F2 zugeführt, die wiederum eine Frequenzverschiebung um einen Betrag ΔF vornimmt. Am Ausgang dieser Frequenzverschiebungseinrichtung F2 wird das Ergebnis bzw. das so aufbereitete Signal wiederum dem vorderen Teilraum der Fahrgastzelle, nämlich dem dort positionierten Lautsprecher L2 zugeführt. Die Frequenzverschiebung für die Übermittlung von vorne nach hinten kann auch von derjenigen Frequenzverschiebung von hinten nach vorne verschieden sein.A correspondingly prepared signal is then also generated from this summation point an acoustic model AM1 in front, fed in the acoustic model AM1 generated subtraction signal in this embodiment comes from the im received rear part of the vehicle, and already frequency-shifted signal. Because this signal coming from M2 and frequency shifted in F2, which originates in the rear compartment of the passenger cell, via AM1 signaling is also taken into account at the front, that generated in the rear compartment of the vehicle and after vome, acoustically transported into the front compartment of the passenger cell Signal, which is also registered by M1, in turn at the summation point S1 subtracted. That is, the device AM1 becomes the rear compartment of the passenger compartment acoustically separated from the front compartment of the passenger compartment. That is, first in M1 the total perceptible acoustic signal is fed in, and at the summation point S1 first subtracts the echo from the rear compartment of the passenger compartment. The so obtained original signal from M1 from the front compartment of the passenger cell then becomes one Frequency shifting device F.1 supplied and by an amount ΔF, for example 5 Hz, shifted. The output signal of F1 thus obtained is then the Loudspeaker L1 of the rear compartment of the passenger compartment supplied and to the other at the same time again fed into the device AM2 in the same way. AM2 again represents the acoustic model for the rear part of the Passenger compartment. The transmission of a voice message from the back of the tell room Passenger cell via M2 to the front compartment of the passenger cell via L2 takes place in analogous way. That is, the microphone M2 registers the voice message together Noise in the rear compartment of the passenger compartment and transmits it to the Summation point S2, at which the acoustic recorded via M1 Overall signal, i.e. the echo and background noise is subtracted. So again The echo-free signal created by the microphone M2 then also becomes one Frequency shifter F2 supplied, which in turn a frequency shift by an amount ΔF. At the output of this frequency shifter F2 becomes the result or the signal thus processed in turn the front subspace the passenger compartment, namely the loudspeaker L2 positioned there. The Frequency shift for transmission from front to back can also be from that frequency shift from the back to the front be different.
Insgesamt ergibt sich ein geschlossenes rückkopplungsfreies System. Dabei ist die Verschiebung der Frequenz ein wesentliches Merkmal, und durch das Zusammenwirken mit der Verschaltung über die akustischen Modelle AM1 und AM2 ist eine Echoeliminierung vom vorderen zum hinteren Teilraum und umgekehrt gegeben.Overall, there is a closed feedback-free system. Here is the Frequency shift an essential feature, and by interacting with the connection via the acoustic models AM1 and AM2 is one Echo elimination from the front to the rear subspace and vice versa.
Es ist jedoch auch möglich, daß zusätzlich zur Echounterdrückung und Rückkopplungseliminierung auch eine Geräuschsignalsubtraktion hinzukommt. Dies kann in geeigneter Weise im jeweiligen akustischen Modell AM1 und AM2 mitberücksichtigt werden. Die weltergehenden, hierzu notwendigen Komponenten, wie Geräuschsignalmikrofone, sind dabei nicht weiter dargestellt.However, it is also possible that in addition to echo cancellation and Feedback elimination also adds a noise signal subtraction. This can appropriately taken into account in the respective acoustic models AM1 and AM2 become. The world-leading components necessary for this, such as Noise signal microphones are not shown here.
Somit läßt sich also sagen, daß jedem akustischen Eingabesignal von M1 sowie auch von M2, bevor es weitergehend aufbereitet und den Lautsprechern L2 bzw. L1 zugeführt wird, das aus Echo und übrigen Geräuschen zusammengesetzte Gesamtgeräuschkulissensignal subtrahiert wird. Es findet somit nicht nur eine akustische Abkopplung zwischen vorderem und hinterem Teilraum der Fahrgastzelle statt, sondern auch die übrigen Geräuschsignale werden quasl In ein und demselben Aktionsschritt mitkompensiert bzw. subtrahiert.Thus it can be said that every acoustic input signal from M1 as well as from M2 before it is further processed and fed to the loudspeakers L2 and L1 that is composed of echo and other noises Overall noise signal is subtracted. It is therefore not just an acoustic one Decoupling between the front and rear compartment of the passenger compartment instead the other noise signals are quasl in one and the same action step also compensated or subtracted.
Claims (7)
- Method for operating voice-controlled systems such as communication and/or intercommunication devices in motor vehicles, wherein voice signals and background sound signals are received as overall signals by a multiple microphone system (M1, M2) and transmitted to at least one loudspeaker (L1, L2), wherein the overall signal received by the respective microphone (M1, M2) is first frequency shifted by a value ΔF and only subsequently transmitted to the loudspeaker(s) (L1, L2) or to the input of a voice-controlled device,
characterised in that
in order to eliminate feedback and echo signals from the overall signal, which has not yet been frequency shifted, of a first microphone (M1, M2) the overall signal, which has been shifted by ΔF, of another or second microphone (M2, M1) is subtracted, and vice versa. - Method for operating voice-controlled systems according to claim 1, characterised in that, for the purpose of acoustic coupling or subtraction of the background sound signals, any acoustic model (AM1, AM2) is formed from the received overall signals and is passed, for subtraction in signal technology terms, to a respective summation point (S1, S2) between the respective microphone (M1, M2) and the respective frequency shift (F1, F2).
- Method for operating voice-controlled systems according to claim 2, characterised in that the passenger compartment of the vehicle is divided into at least two acoustic partial chambers in such a way that in each partial chamber at least one microphone location and at least one loudspeaker location is provided, and also in that between the microphone location of one partial chamber and the loudspeaker location of the other partial chamber the said frequency shift ΔF takes place and between the loudspeaker locations and the microphone locations of one partial chamber and between the loudspeaker locations and the microphone locations of the other partial chamber the said acoustic models (AM1, AM2) are used so that, in signal technology terms, a closed electroacoustic control circuit is produced.
- Method for operating voice-controlled systems according to claim 3, characterised in that the said acoustic models (AM1, AM2) take account not only of the voice and/or background sound signals of the different partial chambers in the passenger compartment but detected sounds occurring in the whole vicinity are also considered and subtracted from the overall signal so that substantially only the voice signal remains.
- Device for operating voice-controlled systems such as communication and/or intercommunication devices in motor vehicles, having a plurality of microphones (M1, M2) and loudspeakers (L1, L2), and having means for transmitting voice messages or voice commands, wherein the passenger compartment in the motor vehicle is divided into at least two, possibly open, partial regions each with at least one microphone (M1, M2) and at least one loudspeaker (L1, L2), and the said means also include frequency shifting devices (F1, F2) which are connected in each case between one of the microphones (M1, M2) and the loudspeaker (L1, L2) located in the respective other partial region,
characterised in that
the loudspeaker signal which results in each case is picked up in a parallel manner and is superimposed in a subtractive manner on the respective microphone overall signal, provided in the same partial region, by means of a respective summation point (S1, S2), and the elements of the whole device are connected together to form a closed electroacoustic control circuit. - Device for operating voice-controlled systems according to claim 5, characterised in that between the parallel pick-up point of the respective loudspeaker signal and the respective summation point (S1, S2), means (AM1, AM2) are provided by which so-called acoustic models are generated which influence and/or post-process the respective loudspeaker signal, and that the resulting signal from these means (AM1, AM2) is switched to the respective summation point (S1, S2).
- Device for operating voice-controlled systems according to claim 6, characterised in that the acoustic models (AM1, AM2) contain means for sound pattern recognition which serve to separate engine and/or travel sounds from voice-generated acoustic signals and to separate primarily voice-generated signals from feedback echo signals.
Applications Claiming Priority (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| DE19820000 | 1998-05-06 | ||
| DE19820000 | 1998-05-06 | ||
| DE19827134A DE19827134A1 (en) | 1998-05-06 | 1998-06-18 | Method and device for operating voice-assisted systems in motor vehicles |
| DE19827134 | 1998-06-18 | ||
| PCT/EP1999/003031 WO1999057938A1 (en) | 1998-05-06 | 1999-05-04 | Method and device for operating voice-controlled systems in motor vehicles |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| EP1077013A1 EP1077013A1 (en) | 2001-02-21 |
| EP1077013B1 true EP1077013B1 (en) | 2002-03-06 |
Family
ID=26045962
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP99924872A Expired - Lifetime EP1077013B1 (en) | 1998-05-06 | 1999-05-04 | Method and device for operating voice-controlled systems in motor vehicles |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US7010129B1 (en) |
| EP (1) | EP1077013B1 (en) |
| JP (1) | JP2002514775A (en) |
| ES (1) | ES2174611T3 (en) |
| WO (1) | WO1999057938A1 (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1445761A1 (en) | 2003-02-07 | 2004-08-11 | Volkswagen Aktiengesellschaft | Apparatus and method for operating voice controlled systems in vehicles |
| WO2005018277A1 (en) | 2003-07-18 | 2005-02-24 | Volkswagen Aktiengesellschaft | Device and method for operating voice-assisted systems in motor vehicles |
| EP1625973A1 (en) | 2004-08-10 | 2006-02-15 | Volkswagen Aktiengesellschaft | Speech support system for motor vehicle |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3886391B2 (en) * | 2002-02-15 | 2007-02-28 | シャープ株式会社 | CARD-TYPE DEVICE AND ELECTRONIC DEVICE HAVING THE SAME |
| US8537030B2 (en) * | 2010-02-15 | 2013-09-17 | Ford Global Technologies, Llc | Pedestrian alert system and method |
| US9628930B2 (en) | 2010-04-08 | 2017-04-18 | City University Of Hong Kong | Audio spatial effect enhancement |
| JP6111955B2 (en) * | 2013-09-27 | 2017-04-12 | アンデン株式会社 | Vehicle approach notification device |
| US9595253B2 (en) | 2015-03-24 | 2017-03-14 | Honda Motor Co., Ltd. | Active noise reduction system, and vehicular active noise reduction system |
| JP6231042B2 (en) * | 2015-03-24 | 2017-11-15 | 本田技研工業株式会社 | Active noise suppression system and vehicle active noise suppression system |
Family Cites Families (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPS5870292A (en) | 1981-10-22 | 1983-04-26 | 日産自動車株式会社 | Voice recognition equipment for vehicle |
| JPH0746791B2 (en) * | 1985-07-17 | 1995-05-17 | 日本電信電話株式会社 | Howling suppression circuit |
| GB2208990B (en) * | 1987-08-19 | 1991-04-03 | Thomas Mcgregor | Voice enhancer system |
| DE3925589C2 (en) | 1989-08-02 | 1994-03-17 | Blaupunkt Werke Gmbh | Method and arrangement for the elimination of interference from speech signals |
| DE4106405C2 (en) | 1990-03-23 | 1996-02-29 | Ricoh Kk | Noise suppression device for a speech recognition system |
| GB9026906D0 (en) * | 1990-12-11 | 1991-01-30 | B & W Loudspeakers | Compensating filters |
| DE4203436A1 (en) | 1991-02-06 | 1992-08-13 | Koenig Florian | Data reduced speech communication based on non-harmonic constituents - involves analogue=digital converter receiving band limited input signal with digital signal divided into twenty one band passes at specific time |
| DE4227826C2 (en) | 1991-08-23 | 1999-07-22 | Hitachi Ltd | Digital processing device for acoustic signals |
| JP2760373B2 (en) * | 1995-03-03 | 1998-05-28 | 日本電気株式会社 | Noise canceller |
| DE19524847C1 (en) | 1995-07-07 | 1997-02-13 | Siemens Ag | Device for improving disturbed speech signals |
| US5903819A (en) | 1996-03-13 | 1999-05-11 | Ericsson Inc. | Noise suppressor circuit and associated method for suppressing periodic interference component portions of a communication signal |
| US5920834A (en) * | 1997-01-31 | 1999-07-06 | Qualcomm Incorporated | Echo canceller with talk state determination to control speech processor functional elements in a digital telephone system |
| DE19705471C2 (en) | 1997-02-13 | 1998-04-09 | Sican F & E Gmbh Sibet | Method and circuit arrangement for speech recognition and for voice control of devices |
| US5893056A (en) * | 1997-04-17 | 1999-04-06 | Northern Telecom Limited | Methods and apparatus for generating noise signals from speech signals |
| US6098040A (en) * | 1997-11-07 | 2000-08-01 | Nortel Networks Corporation | Method and apparatus for providing an improved feature set in speech recognition by performing noise cancellation and background masking |
-
1999
- 1999-05-04 US US09/674,839 patent/US7010129B1/en not_active Expired - Lifetime
- 1999-05-04 WO PCT/EP1999/003031 patent/WO1999057938A1/en active IP Right Grant
- 1999-05-04 EP EP99924872A patent/EP1077013B1/en not_active Expired - Lifetime
- 1999-05-04 JP JP2000547814A patent/JP2002514775A/en active Pending
- 1999-05-04 ES ES99924872T patent/ES2174611T3/en not_active Expired - Lifetime
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1445761A1 (en) | 2003-02-07 | 2004-08-11 | Volkswagen Aktiengesellschaft | Apparatus and method for operating voice controlled systems in vehicles |
| WO2005018277A1 (en) | 2003-07-18 | 2005-02-24 | Volkswagen Aktiengesellschaft | Device and method for operating voice-assisted systems in motor vehicles |
| EP1625973A1 (en) | 2004-08-10 | 2006-02-15 | Volkswagen Aktiengesellschaft | Speech support system for motor vehicle |
Also Published As
| Publication number | Publication date |
|---|---|
| US7010129B1 (en) | 2006-03-07 |
| EP1077013A1 (en) | 2001-02-21 |
| WO1999057938A1 (en) | 1999-11-11 |
| ES2174611T3 (en) | 2002-11-01 |
| JP2002514775A (en) | 2002-05-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| DE3925589C2 (en) | Method and arrangement for the elimination of interference from speech signals | |
| EP2296356B1 (en) | Method and device for analysing and calibrating acoustic characteristics of a motor vehicle hands-free kit | |
| DE19938158C1 (en) | Acoustic signal loss compensation method for automobile intercom device determines signal transmission path for providing transmission function parameter used for controlling acoustic signal level | |
| DE19938171C2 (en) | Process for processing acoustic signals and communication system for occupants in a vehicle | |
| DE60031583T2 (en) | Language distribution system | |
| EP3375204B1 (en) | Audio signal processing in a vehicle | |
| DE102006047983A1 (en) | Processing an input signal in a hearing aid | |
| EP1077013B1 (en) | Method and device for operating voice-controlled systems in motor vehicles | |
| DE10357800B3 (en) | Hearing aid with noise suppression has signal processing device for simulating transmission function of acoustic path that applies function to noise signal to form noise output signal that is combined with useful output signal | |
| DE112016004394B4 (en) | howl suppression device | |
| EP1367856A2 (en) | Method and apparatus for feedback reduction in hearing systems | |
| EP2200341B1 (en) | Method for operating a hearing aid and hearing aid with a source separation device | |
| EP1406469B1 (en) | Feedback compensator in acoustic amplifying systems, hearing-aid, method for feedback compensation and use of said method in hearing-aids | |
| DE10025496C2 (en) | Audio system, in particular for motor vehicles | |
| DE19827134A1 (en) | Method and device for operating voice-assisted systems in motor vehicles | |
| EP1445761B1 (en) | Apparatus and method for operating voice controlled systems in vehicles | |
| EP1649719B1 (en) | Device and method for operating voice-assisted systems in motor vehicles | |
| DE102017212980B4 (en) | Method for compensating for noise in a hands-free device in a motor vehicle and hands-free device | |
| DE4430931A1 (en) | Device for controlling the volume of a car radio based on driving noise | |
| EP1929465A1 (en) | Method for the active reduction of noise, and device for carrying out said method | |
| DE10140523B4 (en) | Device for feedback canceling the output of microphone signals through loudspeakers | |
| DE3411494A1 (en) | Method for suppressing sound and a circuit arrangement and sound-protection device to carry out the method | |
| DE19743192A1 (en) | Echo cancellation method, echo cancellation device and telecommunication device | |
| DE102020114429A1 (en) | METHOD, DEVICE, HEADPHONES AND COMPUTER PROGRAM FOR ACTIVE SUPPRESSION OF THE OCCLUSION EFFECT DURING THE REPLAY OF AUDIO SIGNALS | |
| DE102004039066B4 (en) | Audio system for a motor vehicle |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| 17P | Request for examination filed |
Effective date: 20001206 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): DE ES FR GB IT SE |
|
| GRAG | Despatch of communication of intention to grant |
Free format text: ORIGINAL CODE: EPIDOS AGRA |
|
| GRAG | Despatch of communication of intention to grant |
Free format text: ORIGINAL CODE: EPIDOS AGRA |
|
| GRAH | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOS IGRA |
|
| 17Q | First examination report despatched |
Effective date: 20010725 |
|
| GRAH | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOS IGRA |
|
| REG | Reference to a national code |
Ref country code: GB Ref legal event code: IF02 |
|
| GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
| AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): DE ES FR GB IT SE |
|
| REF | Corresponds to: |
Ref document number: 59900941 Country of ref document: DE Date of ref document: 20020411 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20020606 |
|
| ET | Fr: translation filed | ||
| REG | Reference to a national code |
Ref country code: ES Ref legal event code: FG2A Ref document number: 2174611 Country of ref document: ES Kind code of ref document: T3 |
|
| PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
| 26N | No opposition filed |
Effective date: 20021209 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R084 Ref document number: 59900941 Country of ref document: DE Effective date: 20120121 |
|
| REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 17 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20150529 Year of fee payment: 17 Ref country code: ES Payment date: 20150622 Year of fee payment: 17 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20150529 Year of fee payment: 17 Ref country code: IT Payment date: 20150529 Year of fee payment: 17 |
|
| GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20160504 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160504 |
|
| REG | Reference to a national code |
Ref country code: FR Ref legal event code: ST Effective date: 20170131 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160531 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160504 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160505 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20180531 Year of fee payment: 20 |
|
| REG | Reference to a national code |
Ref country code: ES Ref legal event code: FD2A Effective date: 20181128 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R071 Ref document number: 59900941 Country of ref document: DE |
|
| P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230523 |