EP2394271A1

EP2394271A1 - Method for separating signal paths and use for improving speech using electric larynx

Info

Publication number: EP2394271A1
Application number: EP10708882A
Authority: EP
Inventors: Martin HAGMÜLLER; Gernot Kubin
Original assignee: Heimomed Heinze & Co KG GmbH
Current assignee: Heimomed Heinze & Co KG GmbH
Priority date: 2009-02-04
Filing date: 2010-02-01
Publication date: 2011-12-14
Anticipated expiration: 2030-02-01
Also published as: ES2628521T3; CN102341853B; CN102341853A; JP5249431B2; DK2394271T3; US20120004906A1; AT507844B1; WO2010088709A1; EP2394271B1; CA2749617C; AT507844A1; PT2394271T; JP2012517031A; CA2749617A1

Abstract

In order to improve the speech quality of an electric larynx (EL) speaker, the speech signal of which is digitized by suitable means, the following steps are carried out: a) dividing a single-channel speech signal into a series of frequency channels by transferring it from a time domain into a discrete frequency domain; b) filtering out the modulation frequency of the EL by way of a high-pass or notch filter, in each frequency channel; and c) back-transforming the filtered speech signal from the frequency domain into the time domain and combining it into a single-channel output signal.

Description

METHOD FOR SEPARATING SIGNAL PATH AND APPLICATION TO IMPROVEMENT

OF LANGUAGE WITH ELECTRO-LARYNX

The invention is a method for improving the speech quality of an electro-laryngeal (EL) speaker, wherein the speech signal of the speaker is digitized by suitable means. By suitable means is meant, for example, a microphone with associated analog / digital converter, a telephone or other methods using electronic equipment.

An EL is an artificial spare voice device, for example, for patients who have had their larynx surgically removed. The EL is attached to the underside of the jaw; a tone generator with a certain frequency makes the air in the oral cavity vibrate over the soft tissues on the underside of the jaw. These vibrations are then modulated by the articulation organs so that speaking becomes possible. However, since the tone generator usually only works with one frequency, the voice sounds monotonous and unnatural, or "robotic".

Furthermore, it is disadvantageous that the vibration of the EL disturbs the perception of the speech or even drowned out, because only a part of the sound is articulated in the oral cavity. The parts emerging directly from the device or at the transition point on the neck overlay the articulated parts and reduce the intelligibility. This is particularly the case with speakers who have received radiation therapy in the neck area, which stiffens the tissue structure. Various methods have therefore been developed which are intended to amplify the useful signal - ie the articulated vibrations - in relation to the interference signal - ie the direct sound or the unmodulated vibration of the EL.

These methods are predominantly used in situations in which the listener is not directly exposed to the radiated sound, but electronic mediators are used, for example, when making a call, with sound recordings or generally when speaking through microphone and amplifier.

In US 6,359,988 Bl, an EL front signal is subjected to cepstrum analysis and superimposed with the speech of a normal speaker, whereby the pitch change of the person speaking with EL can be made more natural; At the same time, this also suppresses the proportion of direct sound emitted by the signal. The disadvantage of this solution is, above all, that for every statement of an EL spokesman at the same time the same statement of a healthy (ie without EL speaking) speaker is needed, which is practically impossible to achieve.

Another solution is shown in US 6,975,984 B2, which describes a solution for improving an EL speech signal in telephony. In this case, in a digital signal processor, the speech signal is processed in such a way that the buzzing background noise of the EL is recognized and removed from the speech signal. The speech signal is divided into a voiced and an unvoiced component and processed separately. The voiced part is Fourier-transformed in blocks, frequency-filtered (fundamental frequency and harmonics are reused), inverse transformed and subsequently subtracted from the entire original signal. What remains is the unvoiced portion of the original signal. Alternatively, it is also proposed to filter the voiced portion over lowpass, completely filter out in case of recognition of a speech break and to superimpose the unvoiced portion afterwards.

The document "Enhancement of Electrolaryngeal Speech by Adaptive Filtering" by Carol Y. Espy-Wilson et al. (JSLHR, 41: 1253-1264, 1998) describes a method for improving the speech quality of an EL speaker adaptive filtering to the speech signal disturbed by the EL background noise (or the EL fundamental noise articulated to speech), and in a further step the signals are subtracted from each other, leaving an error signal for controlling and adjusting the filter parameters with the objective of The error signal in the present method is the speech signal freed from the EL fundamental noise, assuming that although the noise signal in the speech signal is correlated with the EL fundamental noise, the speech signal of interest is independent of the other signals that is, so to speak the disturbing background noise and the speech signal of different Qu originate from

The document "Enhancement of Electrolaryng Speech Based on Auditory Masking" by Hanjun Liu et al. (IEEE Transactions on Biomedical Engineering, 53 (5): 865-874, 2006) describes a subtraction algorithm for signal enhancement of an EL speaker, particularly with respect to environmental noise.

Unlike other methods that provide fixed subtraction parameters, this algorithm adapts the subtraction parameters in the frequency domain based on auditory masking. It is assumed that speech and background noise are uncorrelated and therefore the background noise can be estimated and subtracted from the signal in the frequency domain. These solutions have in common that methods are used based on a model, according to which speech and noise (ie ambient noise, but also the background noise of the EL) are statistically independent, or uncorrelated.

Based on this assumption, the implementation of the methods mentioned is carried out in a very complex manner. Attempting to suppress direct sound with an (adaptive) notch filter also reduces the quality of the speech signal, which then sounds like a whisper; Speech signal and noise are on the same harmonics.

US 2005/0004604 A1 describes a laryngeal solution in which a sounder and a microphone are placed directly in front of the mouth of a user, wherein the sounder emits a sound at low volume and the signal for further processing via the microphone is recorded. In further processing, the signal is essentially filtered with a comb filter to reduce or remove the harmonics of the signal. However, the quality of the speech signal is badly affected.

WO 2006/099670 A1 describes a device for monitoring the respiratory tract, wherein sound in the audible frequency range is introduced into the respiratory tract of an object and the condition of the respiratory tract is determined from the reflected or processed sound. For example, it is possible to detect airway obstruction. In a variant of the invention, the exceeding of specific threshold values is checked by means of the FFT (fast Fourier transformation), from which conclusions are drawn regarding the treatment of the measured signal.

It is an object of the invention to overcome the above-mentioned disadvantages of the prior art and to improve the speech quality of EL users using electronic mediators such as microphones.

This object is achieved by a method of the type mentioned according to the invention by the following steps: a) dividing a single-channel speech signal into a series of frequency channels by transferring the time domain into a discrete frequency range, b) filtering out the modulation frequency of the EL by means of a high-pass or Notch filter in each frequency channel, and c) retransforming the filtered speech signal from the frequency domain to the time domain and merging into a single channel output signal. The invention makes use of an improved model of the use of an EL, according to which the EL fundamental sound articulated to a speech signal as well as the unaltered portions of the EL interfering with the perception of the speech signal come from a common source, namely the EL. Since the disturbing inarticulate fundamental noise of the EL in the modulation range is recognizable as a time-invariant signal, it can be easily filtered out by a suitable procedure. Thus, there is a separation not of signal sources, but of propagation paths (a propagation path through the articulation organs of a speaker, another propagation path from the application site on the neck of the speaker directly to the ear of the listener, or to the microphone or recording means).

The person skilled in the art knows a large number of possibilities for converting a digitized, single-channel signal into the frequency domain and thus dividing it into a series of frequency channels. In each frequency channel the modulation frequency of the EL is filtered by suitable filters - e.g. Notch or high pass filter applied to the amount - suppresses and thus improves the quality of the articulated signal components.

Similar prior art methods regard the articulated portions as well as the unmodified portions as coming from different sources, and choose appropriate approaches to this model, for example filtering by bandpass filters which, however, attenuate the speech signal as well.

The method according to the invention thus aims to increase the intelligibility of the language of EL users or to make the signal more pleasant and "more human." The aim is to reduce the direct sound from the EL during communication via electronic means (eg telephone) or to eliminate.

The implementation of the method according to the invention can be done for example by a software plug-in, as a hard-wired solution or as an analog circuit.

From the large number of known methods for transferring a signal into the frequency range or back, the conversion in step a) of the method according to the invention is advantageously carried out by Fourier transformation and the inverse transformation in step c) by means of inverse Fourier transformation. The transfer takes place in blocks (eg blocks of 20 ms) at short intervals (refresh every 10 ms, for example). The division of the signal into a series of frequency channels takes place when transferring the signal into the frequency domain. In a variant of the invention, the transfer of the speech signal in step a) and the inverse transformation in step c) with a corresponding filter bank.

The results of the method according to the invention can be further improved if signal compression takes place before the filtering in step b) and decompression takes place after step b). The compression can be prevented that at high amplitudes whose changes are so dominant that the changes of small amplitudes are not taken into account. Compression makes relative changes more visible to the filter.

In a further embodiment of the method according to the invention, before the inverse transformation in step c), a rectification of the negative signal components takes place.

In the following the invention will be explained in more detail with reference to a non-limiting embodiment, which is illustrated in the drawing. In this shows schematically:

1 is a simplified representation of the use of an EL and the signal paths occurring,

Fig. 2 is a simplified representation of the situation in which the method according to the invention finds application and

Fig. 3 is a block diagram of the method according to the invention.

In Fig. 1, the different transmission paths of the signal of an EL 1 are outlined. In this case, an EL 1 is arranged on the neck of a speaker 2. The sound produced by the EL 1 spreads on the one hand through the normal speech channels (mouth and nose) 5 of the first speaker 2 and is there articulated to language; this first signal 3 is clearly variable, or time-variant. At the ear of a listener 4 comes next to this time-variant signal 3 and a second signal 6 (shown in phantom in Fig. 1) in the form of direct sound of EL 1, this signal 4 is largely stationary and is therefore assumed to be invariant in time. The second part 6 of the overall signal, that is the background noise of the EL 1, is perceived by the listener 4 as an interference signal and reduces the intelligibility of the speech of the speaker 2. The original excitation by means of the EL 1 is thus transmitted via two different paths.

Although the invention relates to the improvement of the speech quality of an EL speaker when using electronic mediators - so instead of a listener, the signals would be recorded, for example, with a microphone. To illustrate the However, for the sake of clarity, this general model has been chosen.

FIG. 2 shows a simplified model representation of the situation to which the inventive method for suppressing a disturbing second signal 6 (see FIG. 1) is applied. It is readily apparent that in the method according to the invention there is no separation of signal sources, but of propagation paths.

A source signal x (w) from a signal source 7 propagates over two different signal paths. In the first signal path, the output signal is modulated by a time-variant filter H (w, t) to a time-variant signal x (w) H (w, t). In the second signal path, the output signal is changed only by a time-invariant filter F (w) to a signal x (w) F (w).

The signals of the two paths are then received in a receiver 8 - e.g. the ear of a listener, a microphone o.a. - Summed to a signal available for measurement S (w, t). The signal then consists of the sum of the components, S (w, t) = x (w) H (w, t) + x (w) F (w).

It is now possible to separate the signal components from the time-invariant and time-variant signal paths, by attenuating either all signal components which change over time or are constant over time. For example, as a result, only the time-variant component S i (w, t) ~ x (w) H (w, t) is obtained.

In the application for speech with EL, the inarticulate signal component x (w) F (w) (ie the background noise of the EL) superimposes the time-variant speech signal x (w) H (w, t) and thereby causes a loss of intelligibility for the speech signal. Speech intelligibility is improved by separating the time-variant signal component from the time-invariant signal component.

Fig. 3 shows a possible implementation of the method according to the invention. In this case, an arbitrary digital speech signal 9 from a speaker with EL can be present at the input. In a first step 10, using the short-time Fourier transformation, the speech signal 9 is transformed in blocks into the frequency domain and thus divided into a series of frequency channels. The person skilled in the art can choose here from various established methods for the transformation of a signal from the time domain into the frequency domain; In addition to the Fourier transformation, for example, the discrete cosine transformation is also used - however, the prerequisite for an application according to the invention is that the transformation is reversible. The signal is divided at a certain refresh rate (eg 10 ms) into blocks of, for example, 20 ms in length, which are each fanned out into a series of frequency channels 11. The originally single-channel speech signal 9 is thus split into a plurality of frequency ranges, which change as a result of time. The frequency signal is complex, but subsequently only the absolute value is modified, phase 15 remains unchanged.

In step 10, a filter bank may also be used, reducing the sample rate of the signal after the filter bank. The reduction of the sampling rate corresponds to the block formation when using the Fourier transform.

In another functional block 12, each frequency channel 11 is filtered, for example with a high-pass filter or notch filter. This filtering allows certain frequencies to be filtered out - in audio engineering, narrow-band interferences are eliminated with notch filters. Since the EL oscillates at a certain frequency - for example 100 Hz - the interference signal, which is not changed by the articulation organs of a speaker, results in the frequency range amplitudes in the 100 Hz channel with the modulation frequency 0 Hz - ie the amplitude of the EL Signal does not change. The interference signal is characterized in that it is perfectly time-invariant. To filter the background noise of the EL, a notch or a high pass filter are used. The limiting frequency for the high-pass filter is the modulation frequency of the EL; the notch filter is chosen so that it locks exactly at the modulation frequency of the EL.

In the real implementation of course a perfect temporal invariance due to reflections, refractions, ambient noise and structural needs of the EL will not be achievable. However, since the filter is not restricted to just one frequency but covers a specific frequency range-in this case a modulation frequency range-the function of the method according to the invention is ensured.

In a final function block 13, the feedback of the signals into the time domain, for example by means of inverse Fourier transformation and the merger of the frequency channels 11 back into a channel by means of overlap-add. The overlap-add method is a method of digital signal processing known to the person skilled in the art. The result is a single-channel output signal 14, in which the interference signal of the EL is filtered out or at least attenuated. The output signal can then be processed further. When using a filter bank in step 10, the sampling rate of the signal is increased again after the filtering in step 12 and then treated further as described.

Basically, these statements represent only the most important components of the method according to the invention; before the filtering in block 12, the signal can be compressed, after the decompression can be provided. A rectification before the inverse transformation into the time domain can also be favorable, since unauthorized negative values can arise during processing.

The invention can be used, for example, as an additional device for telephoning. In a conventional analogue telephone, the device is simply integrated into the handset. In a telephone with integrated digital signal processor, the integration of the invention by a software plug-in is possible. Also, the realization in the context of a hardwired solution, e.g. also in an analog circuit, is possible.

The method according to the invention can also be used when using an EL in which two or more frequencies can be switched back and forth in order to give the speech a more realistic sound. This applies both to discrete frequency jumps and to continuous changes in the fundamental frequency assuming that the frequencies being switched are within a frequency band into which the fundamental signal is split.

The width of the modulation frequency filter determines how fast the frequency may change. With very slow, continuous changes, the frequency can change over the entire band of the frequency band if the suppression function works - the decisive factor is not the size but the speed of the change. When switching the EL on and off, which corresponds to rapid changes, the suppression only takes a few milliseconds - depending on how wide the notch filter is selected or where the fundamental frequency of the high-pass filter is.

However, the changes in the fundamental frequency must not be too large. In order to ensure the function according to the invention, for example, the frequency channels into which the signal is split would have to be expanded, or the filtering by means of a high-pass filter would have to start at a somewhat higher frequency.

Claims

A method for improving the speech quality of an electro laryngeal (EL) speaker whose speech signal is digitized by suitable means characterized by the steps of: a) splitting a single-channel speech signal into a series of frequency channels by transitioning from the time domain to a discrete frequency domain; b) filtering out the modulation frequency of the EL by means of a high pass filter in each frequency channel; and c) re-transforming the filtered speech signal from the frequency domain to the time domain and merging into a single channel output signal.

2. The method according to claim 1, characterized in that the transfer of the speech signal in step a) by means of Fourier transformation and the inverse transformation in step c) by means of inverse Fourier transformation.

3. The method according to claim 1, characterized in that the transfer of the speech signal in step a) and the synthesis of the frequency channels in step c) takes place with a filter bank.

4. The method according to any one of claims 1 to 3, characterized in that prior to the filtering in step b) a signal compression takes place and after step b) a decompression takes place.

5. The method according to any one of claims 1 to 4, characterized in that prior to the inverse transformation in step c), a rectification of the negative signal components.