Connect public, paid and private patent data with Google Patents Public Datasets

Apparatus and method for performing speech rate modification and improved fidelity

Download PDF

Info

Publication number
US5341432A
US5341432A US07993526 US99352692A US5341432A US 5341432 A US5341432 A US 5341432A US 07993526 US07993526 US 07993526 US 99352692 A US99352692 A US 99352692A US 5341432 A US5341432 A US 5341432A
Authority
US
Grant status
Grant
Patent type
Prior art keywords
time
signal
function
fig
modification
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
US07993526
Inventor
Ryoji Suzuki
Masayuki Misaki
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Corp
Original Assignee
Panasonic Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Grant date

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/04Time compression or expansion

Abstract

In a speech rate modification system and method, correlation functions between different segments of input speech signal are computed by a correlator (17), the amplitude of the input signal is controlled by two multipliers (19, 20) which multiply the input speech signal by an increasing window function and by a decreasing window function, or vice versa, respectively, produced by a window function generator (18), and then output signals of the multipliers (19, 20) are added to each other by an adder (21) at such a relative delay within one unitary segment (T) as to maximize the value of the correlation function, and the input voice signal and the output of the adder (21) are selected by a multiplier (22), to be issued as a rate-modified speech signal.

Description

This is a continuation of application Ser. No. 07/593,209, filed on Oct. 4, 1990, which was abandoned upon the filling hereof.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an apparatus for and a method of performing a speech rate modification in which only the time duration of speech is changed without altering the fundamental frequency components of the speech signal.

2. Description of the Prior Art

Heretofore, in order to perform a speeded-up listening or a slowed-down listening of speech signals recorded on audio tapes or the like, speech rate modification systems have been utilized.

Speech rate modification apparatus of prior art have included U.S. Pat. No. 3,786,195, to Schiffman et al., "Variable Delay Line Signal Processor for Sound Reproduction". This speech rate modification apparatus is comprised of a variable delay line, a ramp level and amplitude changer, a blanking circuit, a blanking pulse generator, and a ramp pulse-train generator.

The operation of the speech rate modification apparatus described above is elucidated below.

The input signal is first written into the variable delay line. Next, the ramp pulse-train generator controls the ramp level and amplitude changer and the blanking pulse generator corresponding to a time-scale modification ratio. Then the level and amplitude changer performs a read-out operation of signals from the variable delay line with a speed which is different from the speed used at the time of write-in operation and depends on the time-axis modification ratio. That is, when the reproduction rate of a tape is increased, the read-out operation of the data from a memory is made slower than the write-in operation to the memory in order to restore raised tone (frequencies) to normal levels; whereas when the reproduction rate of a tape is decreased, the read-out operation of the data from the memory is made faster than the write-in operation of the data to the memory in order to restore lowered tones to normal tones. Then, on discontinuous parts between respective speech blocks, the blanking circuit applies a muting action on the output of the variable delay line.

In the conventional constitution as has been described above, however, when increasing the rate, degradations in the recognizability of consonants necessarily occur owing to the practice of thinning data which is necessary for increasing the rate. And because of the above-mentioned muting, signal amplitude becomes discontinuous, causing the problem that only a speech voice having a poor naturalness can be obtained.

Although there is other means using detection of pitch period, apart from the above-mentioned conventional speech rate modification apparatus, such pitch detection methods can not be applied for the case that background music or noise superimposes on speech to be processed because the extraction of pitch is difficult in such case. Hence the above-mentioned method cannot be considered very suitable.

OBJECT AND SUMMARY OF THE INVENTION

The purpose of the present invention is to offer a speech rate modification apparatus which is capable of issuing a speech voice having an ample naturalness with less data drop-offs.

In order to achieve the above-mentioned purpose, a speech rate modification apparatus of the present invention comprises a correlator for computing a correlation function between different segments of input signal, a multiplier for controlling the amplitude of the signal, an adder for carrying out the addition calculation of signals at a time point at which the correlation function takes a largest value within a time-length of unitary segment based on the output from the above-mentioned correlator, and a selection circuit for switching over between the input signal and the output of the above-mentioned adder.

According to the constitution described above, in consequence of controlling the signal amplitude by the multiplier, the discontinuities of signal amplitude or the drop-offs of data become less, and also in consequence of the addition calculation of signals by the correlator and the adder at a time point at which the correlation function takes a largest value, discontinuities in phase also become less. And furthermore, in consequence of the control of segments by which the input signal is directly issued through selection circuits, a wide range of desired time-scale modification ratios are obtainable.

BRIEF DESCRIPTION OF THE DRAWINGS

These and other objects of this invention will become apparent and more readily appreciated from the following description of the presently preferred exemplary embodiments, taken in conjunction with the accompanying drawings.

FIG. 1 is a block diagram of a speech rate modification apparatus in a first embodiment of the present invention.

FIG. 2 is a flow chart representing a speech rate modification method in a first embodiment of the present invention.

FIGS. 3(a)-3(e) show schematic diagram of processing voice waveforms in accordance with the speech rate modification method in the first embodiment of the present invention.

FIGS. 4(a)-4(e) show schematic diagram of processing voice waveforms in accordance with the speech rate modification method in the first embodiment of the present invention.

FIG. 5 is a flow chart representing a speech rate modification method in a second embodiment of the present invention.

FIGS. 6(a)-6(e) show schematic diagram of processing voice waveforms in accordance with the speech rate modification method in the second embodiment of the present invention.

FIGS. 7(a)-7(e) show schematic diagram of processing voice waveforms in accordance with the speech rate modification method in the second embodiment of the present invention.

FIG. 8 is a flow chart representing a speech rate modification method in a third embodiment of the present invention.

FIGS. 9(a)-9(e) show schematic diagram of processing voice waveforms in accordance with the speech rate modification method in the third embodiment of the present invention.

FIGS. 10(a)-10(e) show schematic diagram of processing voice waveforms in accordance with the speech rate modification method in the third embodiment of the present invention.

FIG. 11 is a flow chart representing a speech rate modification method in a fourth embodiment of the present invention.

FIGS. 12(a)-12(c) show schematic diagram of processing voice waveforms in accordance with the speech rate modification method in the fourth embodiment of the present invention.

FIG. 13 is a block diagram of an improved embodiment of speech rate modification apparatus of the present invention.

FIGS. 14(a)-14(c) are schematic diagram representing weighting functions to be applied to the correlation values in accordance with the speech rate modification apparatus in the second embodiment of the present invention.

FIGS. 15(a)-15(c) are schematic diagram representing weighting functions for the correlation values in accordance with the speech rate modification apparatus in the second embodiment of the present invention.

FIG. 16 is a flow chart representing a speech rate modification method in a fifth embodiment of the present invention.

FIGS. 17(a)-17(e) show schematic diagram of processing voice waveforms in accordance with the speech rate modification method in the fifth embodiment of the present invention.

FIGS. 18(a)-18(e) show a schematic diagram of processing voice waveforms in accordance with the speech rate modification method in the fifth embodiment of the present invention.

FIG. 19 is a flow chart representing a speech rate modification method in a sixth embodiment of the present invention.

FIGS. 20(a)-20(e) show a schematic diagram of processing voice waveforms in accordance with the speech rate modification method in the sixth embodiment of the present invention.

FIGS. 21(a)-21(e) show schematic diagram of processing voice waveforms in accordance with the speech rate modification method in the sixth embodiment of the present invention.

FIG. 22 is a flow chart representing a speech rate modification method in a seventh embodiment of the present invention.

FIGS. 23(a)-23(e) show schematic diagram of processing voice waveforms in accordance with the speech rate modification method in the seventh embodiment of the present invention.

FIGS. 24(a)-24(e) shows schematic diagram of processing voice waveforms in accordance with the speech rate modification method in the seventh embodiment of the present invention.

It will be recognized that some or all of the Figures are schematic representations for purposes of illustration and do not necessarily depict the actual relative sizes or locations of the elements shown.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

The purpose of the present invention is to offer a speech rate modification apparatus which is capable of giving a speech voice having an ample naturalness with less discontinuities in signal amplitude and phase and also with less data drop-offs and also which can be realized with simple hardware.

FIRST EMBODIMENT

In the following, elucidation is given on the first embodiment of a speech rate modification of the present invention referring to FIG. 1.

FIG. 1 is a block diagram of a speech rate modification apparatus in the present embodiment. In FIG. 1, numeral 11 is an A/D converter for converting an input voice signal to a digitized voice signal. A buffer 12 is for temporarily storing the digitized voice signal. A demultiplexer 14 switches to deliver the digitized voice signal to a first memory 15, to a second memory 16, and to a multiplexer 22, being controlled by a rate control circuit 13. A correlator 17 is for computing a correlation function between outputs of the first memory 15 and the second memory 16. Output terminals of the correlator 17 are connected to the rate control circuit 13, to an adder 21 and to a window function generator 18. A first multiplier 19 and a second multiplier 20 are for multiplying an output of the window function generator 18 by outputs of the first memory 15 and of the second memory 16, respectively. The output terminals of the multipliers 19 and 20 are connected to the adder 21 which adds outputs to each other and is controlled by the output of the correlator 17. The multiplexer 22 is for combining outputs from the adder 21 and the demultiplexer 14 under control of the rate control circuit 13. Then a D/A converter 23 is for converting the combined digital signal to an analog output signal.

On the speech rate modification apparatus constituted as has been described above, its operation is elucidated below.

First, the input signal is converted into a digital signal by the A/D converter 11 and written into the buffer 12. Next, the rate control circuit 13 controls the demultiplexer 14 in accordance with a given time-scale modification ratio to supply the data in the buffer 12 to the first memory 15 and the second memory 16, and also to the multiplexer 22. Then, correlation functions between the contents of the first memory 15 and that of the second memory 16 are computed by the correlator 17, and the information of these correlation computations is supplied to the rate control circuit 13, the window function generator 18, and the adder 21. The window function generator 18 generates a first window function which gradually increases or gradually decreases, based on the information from the correlator 17 and on a given time-scale modification ratio, and supplies it to the first multiplier 19. And window function generator 18 also issues a second window function which is complementary to the above-mentioned first window function, and supplies it to the second multiplier 20. Then the first multiplier 19 performs a multiplication calculation between the contents of the first memory 15 and the first window function issued from the window function generator 18; whereas the second multiplier 20 performs a multiplication calculation between the contents of the second memory 16 and the second window function issued also from the window function generator 18. The adder 21 performs an addition calculation between these windowed outputs from the first multiplier 19 and from the second multiplier 20 after displacing their mutual position making a relative delay so that the computed correlation function takes a largest value within a time-length of unitary segment, based on the information from the correlator 17. Also, the adder 21 supplies the sum output to the multiplexer 22. Then, the multiplexer 22 selects the output of the adder 21 and the output of the demultiplexer 14 and supplies the selected result to the D/A converter 23, which converts the resultant digital signal to an analog signal.

As has been described above, according to the present embodiment, by using the first multiplier 19 and the second multiplier 20, the contents of the first memory 15 and the contents of the second memory 16 are multiplied respectively by paired window functions. These paired window functions are complementary to each other, one being a gradually increasing window function and the other being a gradually decreasing window function, both generated from the window function generator 18. Then, those windowed outputs from respective multipliers are added to each other by the adder 21, thus making a digitized speech voice having an ample naturalness with less discontinuities in the signal amplitude and also with relatively small data drop-offs. The correlator 17 computes a correlation function between the contents of the first memory 15 and the contents of the second memory 16. The adder 21 performs an addition calculation between the outputs from the first multiplier 19 and from the second multiplier 20 after displacing their mutual position to make delay so that the computed correlation function takes a largest value within a time-length of unitary segment. Thus, a high quality speech voice signal with less discontinuities in the signal phase can be obtained. Moreover, the length of segments in which the input signal is directly issued is controlled by the action of the rate control circuit 13, the demultiplexer 14 and the multiplexer 22. Thereby, the time-scale modification ratio can easily be changed. At the same time, according to the above-mentioned controlling, it becomes possible to rapidly absorb such deviations in the time-scale modification ratio that might be caused by the addition calculation performed by displacing the mutual position of those windowed signals to make the correlation function take a largest value within a time-length of unitary segment.

In the following, elucidation is given on the first embodiment of the speech rate modification method of the present invention referring to the accompanying drawings, FIG. 2 through FIG. 4.

The purpose of this invention is to offer a method of speech rate modification which is capable of giving a speech voice having an ample naturalness with less discontinuities in signal amplitude and phase and also with less data drop-offs for a time-scale modification ratio of α≧1.0.

Hereupon, the time-scale modification ratio α is defined as ##EQU1##

FIG. 2 is a flow chart representing a speech rate modification method in the present embodiment. Its operation is elucidated below.

First, an input pointer is reset (step 202). Then, a signal XA having a time-length as long as T time-units starting from a time point designated by this input pointer is inputted from the demultiplexer 14 to the first memory 15 (step 203). Then, T is added to the input pointer to update it (step 204). Next, a signal XB having thus the same time-length as long as T time-units starting from a time point designated by this updated input pointer is inputted from the demultiplexer 14 to the second memory 16 (step 205). Then a correlation function between XA and XB is computed (step 206). Based on this correlation function thus obtained, XA is multiplied by a window of a gradually increasing function (step 207). Also based on this correlation function obtained, XB is multiplied by a window of a gradually decreasing function (step 208). Then based also on the correlation function obtained, these windowed signals XA and XB are displaced relative to each other by a number of time units Tc (as shown also in FIG. 3) so that the correlation function between XA and XB takes a largest value within a time-length of unitary segment and they are added, issuing the added result (step 209). Next, a signal XC, which has a time-length of T/(α-1) time-units from a time point designated by the updated input pointer, is inputted from the demultiplexer 14 and directly issued to the multiplexer 22 (step 210). Then T/(α-1) is added to the input pointer to update it (operation 211). Then, step returns to the step 203 so long as further data exists that needs to be processed.

FIG. 3 schematically illustrates actual exemplary cases, wherein the horizontal direction corresponds to the time lapse and the vertical heights corresponds to the amplitude level of voice signal. FIG. 3(a) schematically shows a succession of segments, designated by 1, 2, 3, . . . each having a time-length of T time-units of an original voice signal on which a speech rate modification process is to be carried out. FIGS. 3(b) and 3(c) respectively schematically represent embodiments that the time-scale modification ratios α are 2.0 and 3.0, respectively. In FIG. 3(c), f stands for the fore part of a segment, while h stands for the hind part thereof. FIGS. 3(d) and 3(e) schematically illustrate examples of individual detailed process of the addition calculation. FIG. 3(d) illustrates a case of an addition calculation designated by D in FIG. 3(b) and FIG. 3(c), wherein the addition calculation is done under a condition that the correlation function takes a largest value when XB is displaced to the positive side by Tc time-units with respect to X.sub. A, resulting in extension of arise time sections outside the leading and rear edges of their overlapping time interval. FIG. 3(e) illustrates another case of an addition calculation designated by E in FIG. 3(b) and in FIG. 3(c), wherein the addition calculation for the same condition is done when XB is displaced to the negative side by Tc time-units with respect to XA. In the exemplary cases shown in FIGS. 3(b) and 3(c), there are time intervals designated by D which correspond to the time interval D of FIG. 3(d). In these time intervals, time sections extending outside the overlapping time interval may overlap also to adjacent time intervals and hence it is necessary to perform the amplitude adjustments also in those adjacent time intervals.

Hereinafter, also in FIGS. 4, 6, 7, 9, 10, 12, 17, 18, 20, 21, 23, and 24, the same convention as has been employed in FIG. 3 is applied.

As has been described above, according to the present embodiment, signals XA and XB are multiplied respectively by window functions which are complementary to each other, one being a gradually increasing window function and the other being a gradually decreasing window function. A signal obtained by adding these windowed signals is inserted at a time point corresponding to the beginning of the input signal part XB, and this process is repeated. Thus, a speech voice having an ample naturalness with less discontinuities in signal amplitude and also with less data drop-offs can be issued for a time-scale modification ratio of α≧1.0. By computing a correlation function between XA and XB, and adding windowed signals XA and XB by displacing their mutual position so that the computed correlation function takes a largest value within a time-length of unitary segment, a high quality speech voice with less discontinuities in the signal phase is obtainable. Moreover, by changing the length of XC, it becomes possible to easily change the time-scale modification ratio.

FIG. 4 schematically illustrates modified exemplary cases obtained by modifying the above-mentioned embodiment. FIG. 4(a) schematically shows a succession of segments 1, 2, 3, . . . each having a time-length of T time-units of an original voice signal on which the speech rate modification process is to be carried out. FIG. 4(b) and FIG. 4(c) schematically represent embodiments where the time-scale modification ratios α are 2.0 and 3.0, respectively, and FIG. 4(d) and FIG. 4(e) schematically illustrate examples of detailed individual process of the addition calculation. FIG. 4(d) illustrates a case of addition calculation designated by D in FIG. 4(b) and FIG. 4(c), wherein the addition calculation is done under a condition that the correlation function takes a largest value when XB is displaced to the positive side by Tc time-units with respect to XA and time sections extending outside the leading and rear edges of the overlapping time interval are discarded. FIG. 4(e) illustrates another case of addition calculation, designated by E in FIG. 4(b) and FIG. 4(c), wherein the addition calculation for the same condition is done when XB is displaced to the negative side by Tc time-units with respect to XA. In these exemplary cases shown in FIGS. 4(b) and (c), too, there are time intervals designated by D which correspond to the time interval D of FIG. 4(d). In these time intervals, time sections extending outside the overlapping time interval are discarded as shown in FIG. 4(d). This modified method can be realized by changing the window function. This modified method enables realizing a simplification of process as described above without suffering a degradation in the recognizability of the speech voice.

In the following, elucidation is given on the second embodiment of the speech rate modification method of the present invention referring to FIGS. 5 through 7.

The purpose of this embodiment is to offer a method of speech rate modification which is capable of giving a speech voice having an ample naturalness with less discontinuities in signal amplitude and phase and also with less data drop-offs for a time-scale modification ratio of 0.5≦α≦1.0.

FIG. 5 shows a flow chart representing a speech rate modification method in the present embodiment, and the same hardware as shown in FIG. 1 is used. Its operation is elucidated below.

First, an input pointer is reset (step 502). Then, a signal XA having a time-length as long as T time-units starting from a time point designated by this input pointer is inputted (step 503). Then, T is added to the input pointer to update it (step 504). Next, a signal XB having thus the same time-length as long as T time-units starting from a time point designated by this updated input pointer is inputted (step 505). T is added to the input pointer to update it (step 506). Then a correlation function between XA and XB is computed (step 507). Based on this correlation function thus obtained, XA is multiplied by a window of a gradually decreasing function (step 508). Also based on this correlation function obtained, XB is multiplied by a window of a gradually increasing function (step 509). Then based also on the correlation obtained, these windowed signals XA and XB are added to each other after they are mutually displaced at a time point at which the correlation function takes a largest value within a time-length of unitary segment and the added result is issued (step 510). Next, a signal XC having a time-length of (2α-1)T/(α-1) time-units starting from a time point designated by the updated input pointer is inputted and directly issued (step 511). Then (2α-1)T/(α-1) is added to the input pointer to update it (operation 512). Then, step returns to the step 503.

FIG. 6 schematically represents actual exemplary cases, wherein FIG. 6(a) schematically shows a succession of segments each having a time-length of T time-units of original voice signals on which the speech rate modification process is to be carried out, and FIG. 6(b) and FIG. 6(c) schematically represent embodiments where the time-scale modification ratios α are 2/3 and 0.5, respectively. And FIG. 6(d) and FIG. 6(e) schematically illustrate examples of individual detailed process of the addition calculation; FIG. 6(d) illustrates a case of an addition calculation designated by D in FIG. 6(b) and FIG. 6(c), wherein the addition calculation is performed under the condition that the correlation function takes a largest value when XB is displaced to the positive side by Tc time-units with respect to XA. FIG. 6(e) illustrates another case of addition calculation, designated by E in FIG. 6(b) and FIG. 6(c), wherein the addition calculation is done for the same condition is done when XB is displaced to the negative side by Tc time-units with respect to XA. In the exemplary cases shown in FIG. 6(b) and FIG. 6(c), there are time intervals designated by E which correspond to the time interval E of FIG. 6(e). In these time intervals, time sections extending outside the overlapping time interval may overlap also to adjacent time intervals and hence it is necessary to perform the amplitude adjustments also in those adjacent time intervals.

As has been described above, according to the present embodiment, signals XA and XB are multiplied respectively by window functions which are complementary to each other, one being a gradually decreasing window function and the other being a gradually increasing window function. A signal obtained by adding these windowed signals is issued and then the signal XC is issued, and this process is repeated. Thus, a speech voice having an ample naturalness with less discontinuities in signal amplitude and also with less data drop-offs can be issued for a time-scale modification ratio of 0.5≦α≦1.0. By computing a correlation function between XA and XB, and adding windowed signals XA and XB by displacing their mutual position so that the computed correlation function takes a largest value within a time-length of unitary segment, a high quality speech voice with less discontinuities in its signal phase can be obtained. Moreover, by changing the length of XC, it becomes possible to easily change the time-scale modification ratio.

FIG. 7 schematically illustrates modified exemplary cases obtained by modifying the above-mentioned embodiment, wherein FIG. 7(a) schematically shows a succession of segments each having a time-length of T time-units of an original voice signal on which the speech rate modification process is to be carried out, FIG. 7(b) and FIG. 7(c) schematically represent embodiments where the time-scale modification ratios α are 2/3 and 0.5, respectively. FIG. 7(d) and FIG. 7(e) schematically illustrate examples of detailed individual processes of the addition calculation. FIG. 7(d) illustrates a case of the addition calculation designated by D in FIG. 7(b) and FIG. 7(c), wherein the addition calculation is done under a condition that the correlation function takes a largest value when XB is displaced to the positive side by Tc time-units with respect to XA. FIG. 7(e) illustrates another case of the addition calculation designated by E in FIG. 7(b) and FIG. 7(c), wherein the addition calculation for the same condition is done when XB is displaced to the negative side by Tc time-units with respect to XA and time sections extending outside the leading and rear edges of the overlapping time interval are discarded. In these exemplary cases shown in FIG. 7(b) and FIG. 7(c), too, there are time intervals designated by E which correspond to the time interval E of FIG. 7(e). In these time intervals, time sections extending outside the overlapping time interval are discarded as shown in FIG. 7(e). This modified method can be realized by changing the window function. This modified method enables realizing a simplification of the process described above without suffering a degradation in the recognizability of the speech voice.

In the following, elucidation is given on the third embodiment of the speech rate modification method of the present invention referring to FIG. 8 through FIG. 10.

The purpose of this embodiment is to offer a method of speech rate modification which is capable of giving a speech voice having an ample naturalness with less discontinuities in signal amplitude and phase for a range of the time-scale modification ratio of α≦0.5.

FIG. 8 shows a flow chart representing a speech rate modification method in the present embodiment, and the same hardware as shown in FIG. 1 is used. Its operation is elucidated below.

First, an input pointer is reset (step 802). Then, a signal XA having a time-length as long as T time-units starting from a time point designated by this input pointer is inputted (step 803). Then, (1-α)T/α is added to the input pointer to update it (step 804). Next, a signal XB having the same time-length as long as T time-units starting from a time point designated by this updated input pointer is inputted (step 805). T is added to the input pointer to update (step 806). Then a correlation function between XA and XB is computed (step 807). Based on this correlation function thus obtained, XA is multiplied by a window of a gradually decreasing function (step 808). Also based on this correlation function obtained, XB is multiplied by a window of a gradually increasing function (step 809). Then based also on the correlation function obtained, these windowed signals XA and XB are added to each other after they are displaced at a point at which the correlation function between XA and XB takes a largest value within a time-length of unitary segment and the added result is issued (step 810). Then operation returns to step 803.

FIG. 9 schematically represents actual exemplary cases, wherein FIG. 9(a) schematically shows a succession of segments each having a time-length of T time-units of original voice signals on which speech rate modification process is to be carried out, FIGS. 9(b) and (c) schematically represent embodiments where the time-scale modification ratios α are 1/3 and 1/4, respectively, and FIGS. 9(d) and (e) schematically illustrate examples of individual detailed processes of the addition calculation; FIG. 9(d) illustrates a case of the addition calculation designated by D in FIG. 9(b) and FIG. 9(c), wherein the addition calculation is performed under the condition that the correlation function takes a largest value when XB is displaced to the positive side by Tc time-units with respect to XA. FIG. 9(e) illustrates another case of the addition calculation designated by E in FIG. 9(b) and FIG. 9(c), wherein the addition calculation is done for the same condition when XB is displaced to the negative side by Tc time-units with respect to XA. In the exemplary cases shown in FIGS. 9(b) and (c), there are time intervals designated by E which correspond to the time interval E of FIG. 9(e). In these time intervals, time sections extending outside the overlapping time interval may overlap also to adjacent time intervals and hence it is necessary to perform the amplitude adjustments also in those adjacent time intervals.

As has been described above, according to the present embodiment, signals XA and XB are multiplied respectively by window functions which are complementary to each other, one being a gradually increasing window function and the other being a gradually decreasing window function. A signal obtained by adding these windowed signals is issued, and this process is repeated. Thus, a speech voice having an ample naturalness with less discontinuities in signal amplitude can be issued for a range of the time-scale modification ratio of α≦0.5. By computing a correlation function between XA and XB, and adding windowed signals XA and XB by displacing their mutual position so that the computed correlation function takes a largest value within a time-length of unitary segment, a high quality speech voice with less discontinuities in the signal phase can be issued. Moreover, by changing the time interval between XA and XB, it becomes possible to easily change the time-scale modification ratio.

FIG. 10 schematically illustrates modified exemplary cases obtained by modifying the above-mentioned embodiment, wherein FIG. 10(a) schematically shows a succession of segments each having a time-length of T time-units of an original voice signal on which the speech rate modification process is to be carried out, FIGS. 10(b) and (c) schematically represent embodiments where the time-scale modification ratios α are 1/3 and 1/4, respectively, and FIGS. 10(d) and 10(e) schematically illustrate examples of detailed individual processes of the addition calculation. FIG. 10(d) illustrates a case of the addition calculation designated by D in FIG. 10(b) and FIG. 10(c), wherein the addition calculation is done under a condition that the correlation function takes a largest value when XB is displaced to the positive side by Tc time-units with respect to XA. FIG. 10(e) illustrates another case of the addition calculation designated by E in FIG. 10(b) and FIG. 10(c), wherein the addition calculation for the same condition is done when XB is displaced to the negative side by Tc time-units with respect to XA, and time sections extending outside the leading and rear edges of the overlapping time interval are discarded. In these exemplary cases shown in FIGS. 10(b) and (c), too, there are time intervals designated by E which correspond to the time interval E of FIG. 10(e). In these time intervals, time sections extending outside the overlapping time interval are discarded as shown in FIG. 10(e). This modified method can be realized by changing the window function. This modified method enables realizing a simplification of the process described above without suffering a degradation in the recognizability of the speech voice.

In the following, elucidation is given on the fourth embodiment of the speech rate modification method of the present invention referring to FIGS. 11 and 12.

The purpose of this embodiment is to offer a method of speech rate modification which is capable of giving a speech voice having an ample naturalness with less discontinuities in signal amplitude and phase and also with less data drop-offs also for a range of the time-scale modification ratio of α≦0.5.

FIG. 11 shows a flow chart representing a speech rate modification method in the present embodiment, and the same hardware as shown in FIG. 1 is used. Its operation is elucidated below.

First, an input pointer is reset (step 1102). Next, an output pointer is reset (step 1103). Then, a signal X having a time-length as long as T/(1-α) time-units starting from a time point designated by this input pointer is inputted (step 1104). The, T/(1-α) is added to the input pointer to update it (step 1105). Next, a correlation function between X and the output of the preceding segment is computed by having a time point of the output pointer as its reference (step 1106). Based on this correlation function thus obtained, X is multiplied by a window of a gradually increasing function at its leading-half part and a gradually decreasing function at its rear-half part (step 1107). Then based also on the correlation function obtained, this windowed X is added to the output signal so that the correlation function takes a largest value within a time-length of unitary segment and the added result is issued (step 1108). Then αT/(1-α) is added to the output pointer to update it (step 1109). Next, operation returns to step 1104.

FIG. 12 schematically represents actual exemplary cases, wherein the time-scale modification ratios α are 1/3 and 1/4. As has been described above, according to the present embodiment, X is multiplied by a window function which increases gradually at its leading-half part and decreases gradually at its rear-half part on X. Then this windowed signal X is added to the output signal and issued, and this process is repeated. Thus, a speech voice having an ample naturalness with less discontinuities in signal amplitude and also with less data drop-offs can be issued for a time-scale modification ratio of α≦0.5. By computing a correlation function between X and a preceding segment, and adding them by displacing their mutual position so that their correlation function takes a largest value within a time-length of unitary segment, a high quality speech voice with less discontinuities in the signal phase can be issued. Moreover, by changing the amount of shifting between the input pointer and the output pointer, it becomes possible to easily change the time-scale modification ratio.

The purpose of the present invention is to offer a speech rate modification apparatus which is capable of giving a speech voice having an ample naturalness with less discontinuities in signal amplitude and phase and also with less data drop-offs and also which can be realized with a simple hardware.

In the following, elucidation is given on the second or improved apparatus-embodiment of a speech rate modification of the present invention referring to FIGS. 13 through 15. The apparatus is improved to achieve an intended accurate time scale of the rate-modified speech, and is applicable to the foregoing 1st through 4th method embodiments.

FIG. 13 is a block diagram of the improved speech rate modification apparatus in the present embodiment. In FIG. 13, numeral 11 is an A/D converter for converting an input voice signal to a digitized voice signal. A buffer 12 is for temporarily storing the digitized voice signal. A demultiplexer 14 switches to deliver the digitized voice signal to a first memory 15, to a second memory 16, and to a multiplexer 22, and is controlled by a rate control circuit 13. A correlator 17 is for computing a correlation function between outputs of the first memory 15 and the second memory 16. Output terminals of the correlator 17 are connected to a third multiplier 26, which multiplies the output of a weighting function generator 25 on the output of the correlator 17. The weighting function generator 25 generates weighting functions depending upon the output of a time-scale modification ratio detector 24, which detects the difference between the number of data supplied to the demultiplexer 14 and the number of data issued from the multiplexer 22 under the control of the rate control circuit 13. The output of the third multiplier 26 is supplied to the rate control circuit 13, the window function generator 18, and an adder 21. A first multiplier 19 and a second multiplier 20 are for multiplying the output of the window function generator 18 by outputs of the first memory 15 and of the second memory 16, respectively. The output terminals of the multipliers 19 and 20 are connected to the adder 21 which adds outputs to each other and is controlled by the output of the third multiplier 26. The multiplexer 22 is for combining outputs from the adder 21 and the demultiplexer 14 under control of the rate control circuit 13. Then a D/A converter 23 is for converting the combined digital signal to an analog output signal.

While the speech rate modification apparatus constituted has been described above, its operation is elucidated below.

First, the input signal is converted into a digital signal by the A/D converter 11 and written into the buffer 12. Next, the rate control circuit 13 controls the demultiplexer 14 in accordance with a given time-scale modification ratio to supply the data in the buffer 12 to the first memory 15 and the second memory 16, and also to the multiplexer 22. The time-scale modification ratio detector 24 detects a time-scale modification ratio presently being processed by judging from the number of data supplied to the demultiplexer 14 and the number of data issued from the multiplexer 22. Monitoring the deviation from the target time-scale modification ratio which is set in the rate control circuit 13, information thus obtained is issued to the weighting function generator 25. Next, the weighting function generator 25 corrects the weighting function to be issued in a manner such that the time-scale modification ratio of speech voice data presently being processed does not deviate largely corresponding to an amount of the deviation with respect to the target time-scale modification ratio obtained from the time-scale modification ratio detector 24. Then, a correlation function between the contents of the first memory 15 and that of the second memory 16 is computed by the correlator 17. The third multiplier 26 performs a multiplication calculation between the output of the correlator 17 and the output of the weighting function generator 25. Then the information thus obtained is supplied to the rate control circuit 13, the window function generator 18, and the adder 21. The window function generator 18 supplies a window function to the first multiplier 19 and the second multiplier 20 based on the information from the third multiplier 26. Then the first multiplier 19 performs a multiplication calculation between the contents of the first memory 15 and the first window function issued from the window function generator 18, whereas the second multiplier 20 performs a multiplication calculation between the contents of the second memory 16 and the second window function issued also from the window function generator 18. The adder 21 performs an addition calculation between the output of the first multiplier 19 and the output of the second multiplier 20 after displacing their mutual position so that the weighted correlation function takes a largest value within a time-length of unitary segment based on the information from the third multiplier 26 and supplies its output to the multiplexer 22. Then the multiplexer 22 selects the output of the adder 21 and the output of the multiplexer 14 and supplies the selected result to the D/A converter 23, which converts the resultant digital signal to an analog signal.

FIG. 14 and FIG. 15 show examples of weighting functions issued from the weighting function generator 25.

In these figures, each abscissa represents a mutual delay between two segments whereon the correlation function is computed.

FIG. 14 shows a weighting function by which the largest value of the correlation function is searched only at a side wherein the deviation is made less. FIG. 14(a) shows a case where the deviation from the target time-scale modification ratio increases when the largest value of the correlation function is present on the negative side. FIG. 14(b) shows a case where the presently processed time-scale modification ratio does not deviate from the target time-scale modification ratio. Finally, FIG. 14(c) shows a case where the deviation from the target time-scale modification ratio increases when the largest value of the correlation function is present at the positive side.

FIG. 15 shows a weighting function which searches, in case that the presently processed time-scale modification ratio deviates from the target time-scale modification ratio, the largest value of the correlation function by putting weight on the side on which the deviation is made less. FIG. 15(a) shows a case where the deviation from the target time-scale modification ratio increases when the largest value of the correlation function is present on the negative side. FIG. 15(b) shows a case where the presently processed time-scale modification ratio does not deviate from the target time-scale modification ratio. And, FIG. 15(c) shows a case where the deviation from the target time-scale modification ratio increases when the largest value of the correlation function is present on the positive side.

As has been described above, according to the present embodiment, similarly to the first apparatus embodiment of FIG. 1, by using the first multiplier 19 and the second multiplier 20, the contents of the first memory 15 and the contents of the second memory 16 are multiplied respectively by a window function generated from the window function generator 18. Then those windowed outputs from respective multipliers are added to each other by the adder 21. Thus, a speech voice having an ample naturalness with less discontinuities in the signal amplitude and also with less data drop-offs can be obtained. In this embodiment, the correlator 17 computes a correlation function between the contents of the first memory 15 and the contents of the second memory 16. The adder 21 performs an addition calculation between the outputs from the first multiplier 19 and from the second multiplier 20 after displacing their mutual positions so that the correlation function between the output of the first multiplier 19 and the output of the second multiplier 20 takes a largest value within a time-length of unitary segment. Thus, the discontinuities in the phase of the signal thereby are reduced.

When the addition calculations are performed successively at those parts at which the correlation function takes a largest value within a time-length of unitary segment, the time-scale modification ratio actually obtained may deviate from the target time-scale modification ratio. Then, according to the configuration of FIG. 13, the time-scale modification ratio actually being processed is detected by the time-scale modification ratio detector 24, and thereby the deviation from the target value is monitored. Responding to the deviation, the weighting function generator 25 changes the weighting function and issues it. Thus, the deviation from the target time-scale modification ratio can easily be reduced and and also a time position at which the correlation function takes a largest value within a time-length of unitary segment can be found. Thereby a high quality processed speech voice with fewer time scale fluctuations can be obtained with a desired time-scale modification ratio.

In the following, elucidation is given on the fifth embodiment of the speech rate modification method of the present invention referring to FIGS. 16 through 18.

The present embodiment is to offer a method of speech rate modification which is capable of giving a speech voice having an ample naturalness with less discontinuities in signal amplitude and phase and also with less data drop-offs for a time-scale modification ratio of α≧1.0.

FIG. 16 shows a flow chart representing a speech rate modification method in the present embodiment. Its operation is elucidated below.

First, an A-pointer is set to be 0 (step 1602), while a B-pointer is set to be T (step 1603). Then, a signal XA having a time-length as long as T time-units starting from a time point designated by the A-pointer is inputted (step 1604), and a signal XB having a time interval as long as T time-units starting from a time point designated by the B-pointer is inputted (step 1605). Then, the B-pointer is updated by inputting a number obtained by adding T on the contents of the A-pointer (step 1606). Then a correlation function between XA and XB is computed (step 1607). A time point Tc (which corresponds to a time point displaced by Tc from the time point when two segments completely overlap) at which the correlation function takes its largest value within a time-length of one unitary segment is searched (step 1608). Based on this correlation function thus obtained, XA is multiplied by a window of a gradually increasing function (step 1609). Also based on this correlation function obtained, XB is multiplied by a window of a gradually decreasing function (step 1610). Then based also on the correlation function obtained, these windowed signals XA and XB are added to each other after they are mutually displaced at a time point at which the correlation function takes a largest value within one unitary segment (step 1611). Next, in case that T-Tc is less than αT/(α-1), an added signal is all issued (step 1613), further a signal XC of a time-length as long as T/(α-1)+Tc time-units starting from a time point designated by the B-pointer is directly issued (step 1615). On the other hand, in case that αT/(α-1) is less than T-Tc, the added signal is issued only for a time-length of α T/(α-1) time-units (step 1614). Next, T/(α-1)+Tc is added to the B-pointer to update it (step 1616), and T/(α-1) is added to the A-pointer to update it (step 1617). Then, operation returns to step 1604.

FIG. 17 schematically represents actual exemplary cases, wherein FIG. 17(a) schematically shows a succession of segments having a time-length of T time-units of original voice signals on which the speech rate modification process is to be carried out, FIG. 17(b) and FIG. 17(c) schematically represent embodiments where the time-scale modification ratios α are 2.0 and 3.0, respectively, and FIG. 17(d) and FIG. 17(e) schematically illustrate examples of individual detailed process of the mutual addition calculation. FIG. 17(d) illustrates a case of the addition calculation designated by D in FIG. 17(b) and FIG. 17(c). wherein the addition calculation is performed under the condition that the correlation function takes a largest value when XB is displaced to the positive side by Tc time-units with respect to XA, whereas FIG. 17(e) illustrates another case of the addition calculation designated by E in FIG. 17(b) and FIG. 17(c), wherein the addition calculation is done for the same condition when XB is displaced to the negative side by Tc time-units with respect to XA. In the exemplary cases shown in FIG. 17(b) and FIG. 17(c), there are time intervals designated by D which correspond to the time interval D of FIG. 17(d). In these time intervals, time sections extending outside the overlapping time interval may overlap also to adjacent time intervals and hence it is necessary to perform the amplitude adjustments also in those adjacent time intervals.

As has been described above, according to the present embodiment, signals XA and XB are multiplied respectively by window functions which are complementary to each other, one being a gradually increasing window function and the other being a gradually decreasing window function. A signal obtained by adding these windowed signals is issued, and a signal XC subsequent to XA is issued, and these processes are repeated. Thus, a speech voice having an ample naturalness with less discontinuities in signal amplitude and also with less data drop-offs can be issued for a range of the time-scale modification ratio of α≧1.0. By computing a correlation function between XA and XB and adding windowed signals XA and XB by displacing their mutual position so that the correlation function obtained takes a largest value within a time-length of one unitary segment, a high quality speech voice with less discontinuities in the signal phase can be issued. Moreover, by adjusting the segment length of XC in which the input signal is directly issued, it becomes possible to easily change the time-scale modification ratio. Also, according to the above-mentioned method, it becomes possible to rapidly absorb such deviations in the time-scale modification ratio that might be caused by the addition calculation performed by displacing the mutual position of those windowed signals to make the correlation function take a largest value within a time-length of one unitary segment.

FIG. 18 schematically illustrates modified exemplary cases obtained by modifying the above-mentioned embodiment, wherein FIG. 18(a) schematically shows a succession of segments each having a time-length of T time-units of an original voice signal on which the speech rate modification process is to be carried out, FIG. 18(b) and FIG. 18(c) schematically represent embodiments where the the time-scale modification ratios α are 2.0 and 3.0, respectively, and FIGS. 18(d) and (e) schematically illustrate examples of detailed individual process of the addition calculation. FIG. 18(d) illustrates a case of the addition calculation designated by D in FIG. 18(b) and FIG. 18(c), wherein the addition calculation is done under a condition that the correlation function takes a largest value when XB is displaced to the positive side by Tc time-units with respect to XA and time sections extending outside the leading and rear edges of the overlapping time interval are discarded. FIG. 18(e) illustrates another case of the addition calculation designated by E in FIG. 18(b) and FIG. 18(c), wherein the addition calculation for the same condition is done when XB is displaced to the negative side by Tc time-units with respect to XA. In these exemplary cases shown in FIG. 18(b) and FIG. 18(c), too, there are time intervals designated by D which correspond to the time interval D of FIG. 18(d). In these time intervals, time sections extending outside the overlapping time interval are discarded as shown in FIG. 18(d). This modified method can be realized by changing the window function. This modified method enables realizing a simplification of the process described above without suffering a degradation in the recognizability of the speech voice.

In the following, elucidation is given on the sixth embodiment of the speech rate modification method of the present invention referring to FIGS. 19 through 21.

The purpose of the present embodiment is to offer a method of speech rate modification which is capable of giving a speech voice having an ample naturalness with less discontinuities in signal amplitude and phase and also with less data drop-offs also for a range of the time-scale modification ratio of 0.5≦α≦1.0.

FIG. 19 shows a flow chart representing a speech rate modification method in the present embodiment, and the same hardware as shown in FIG. 1 is used. Its operation is elucidated below.

First, an A-pointer is set to be 0 (step 1902), while a B-pointer is set to be T (step 1903). Then, a signal XA having a time-length as long as T time-units starting from a time point designated by the A-pointer is inputted (step 1904). A signal XB having a time interval as long as T time-units starting from a time point designated by the B-pointer is inputted (step 1905). Then, the A-pointer is updated to be a number obtained by adding T on the contents of the B-pointer (step 1906). Then a correlation function between XA and XB is computed (step 1907). A time point Tc at which the correlation function takes its largest value in a time-length of one unitary segment is searched (step 1908). Based on this correlation function thus obtained, XA is multiplied by a window of a gradually decreasing function (step 1909). Also based on this correlation function obtained, XB is a window of a gradually increasing function (step 1910). Then based also on the correlation function obtained, these windowed signals XA and XB are added to each other after they are mutually displaced at a time point at which the correlation function takes a largest value within a time-length of one unitary segment (step 1911). Next, in case that T+Tc is less than αT/(1-α), an added signal is all issued (step 1913). Further a signal XC of a time interval as long as (2α-1)T/(1-α)-Tc time-units starting from a time point designated by the A-pointer is directly issued (step 1915). On the other hand, in case that αT/(1-α) is less than T+Tc, the added signal is issued only for a time-length of αT/(1-α) time-units (step 1914). Next, (2α-1)T/(1-α)-Tc is added to the A-pointer to update it (step 1916), and T/(1-α) is added to the B-pointer to update it (step 1917). Then, operation returns to the step 1904.

FIG. 20 schematically represents actual exemplary cases, wherein FIG. 20(a) schematically shows a succession of segments each having a time-length of T time-units of original voice signals on which speech rate modification process is to be carried out, FIG. 20(b) and FIG. 20(c) schematically represent embodiments where the time-scale modification ratios α are 2/3 and 0.5, respectively, and FIG. 20(d) and FIG. 20(e) schematically illustrate examples of individual detailed process of the mutual addition calculation. FIG. 20(d) illustrates a case of the addition calculation, designated by D in FIG. 20(b) and FIG. 20(c), wherein the addition calculation is performed under the condition that the correlation function takes a largest value when XB is displaced to the positive side by Tc time-units with respect to XA. FIG. 20(e) illustrates another case of the addition calculation designated by E in FIG. 20(b) and FIG. 20(c), wherein the addition calculation is done for the same condition when XB is displaced to the negative side by Tc time-units with respect to XA. In the exemplary cases shown in FIG. 20(b ) and FIG. 20(c), there are time intervals designated by E which correspond to the time interval E of FIG. 20(e). In these time intervals, time sections extending outside the overlapping time interval may overlap also to adjacent time intervals and hence it is necessary to perform the amplitude adjustments also in those adjacent time intervals.

As has been described above, according to the present embodiment, signals XA and XB are multiplied respectively by window functions which are complementary to each other, one being a gradually increasing window function and the other being a gradually decreasing window function. A signal obtained by adding these windowed signals is issued, and a signal XC subsequent to XB is issued, and these process is repeated. Thus, a speech voice having an ample naturalness with less discontinuities in signal amplitude and also with less data drop-offs can be issued for a range of the time-scale modification ratio of 0.5≦α≦1.0. By computing a correlation function between XA and XB, and adding windowed signals XA and XB by displacing their mutual position so that the correlation function obtained takes a largest value within a time-length of one unitary segment, a high quality speech voice with less discontinuities in the signal phase can be issued. Moreover, by adjusting the segment length of XC in which the input signal is directly issued, it becomes possible to easily change the time-scale modification ratio. Also, according to the above-mentioned method, it becomes possible to rapidly absorb such deviations in the time-scale modification ratio that might be caused by the addition calculation performed by displacing the mutual position of those windowed signals to make the correlation function take a largest value within a time-length of one unitary segment.

FIG. 21 schematically illustrates modified exemplary cases obtained by modifying the above-mentioned embodiment, wherein FIG. 21(a) schematically shows a succession of segments each having a time-length of T time-units of an original voice signal on which the speech rate modification process is to be carried out, FIG. 21(b) and FIG. 21(c) schematically represent embodiments where the time-scale modification ratios α are 2/3 and 0.5, respectively, and FIG. 21(d) and FIG. 21(e) schematically illustrate examples of detailed individual processes of the addition calculation. FIG. 21(d) illustrates a case of the addition calculation designated by D in FIG. 21(b) and FIG. 21(c), wherein the addition calculation is done under a condition that the correlation function takes a largest value when XB is displaced to the positive side by Tc time-units with respect to XA. FIG. 21(e) illustrates another case of the addition calculation, designated by E in FIG. 21(b) and FIG. 21(c), wherein the addition calculation for the same condition is done when XB is displaced to the negative side by T.sub. c time-units with respect to XA and time sections extending outside the leading and rear edges of the overlapping time interval are discarded. In these exemplary cases shown in FIG. 21(b) and FIG. 21(c), too, there are time intervals designated by E which correspond to the time interval E of FIG. 21(e). In these time intervals, time sections extending outside the overlapping time interval are discarded as shown in FIG. 21(e). This modified method can be realized by changing the window function. This modified method enables realizing a simplification of process described above without suffering a degradation in the recognizability of the speech voice.

In the following, elucidation is given on the seventh embodiment of the speech rate modification method of the present invention referring to FIGS. 22 through 24.

The purpose of this embodiment is to offer a method of speech rate modification which is capable of giving a speech voice having an ample naturalness with less discontinuities in signal amplitude and phase for a time-scale modification ratio of α≦0.5.

FIG. 22 shows a flow chart representing a speech rate modification method in the present embodiment, and the same hardware as shown in FIG. 1 is used. Its operation is elucidated below.

First, an A-pointer is set to be 0 (step 2202), while a B-pointer is set to be (1-α)T/α (step 2203). Then, a signal XA having a time interval as long as T segments starting from a time point designated by the A-pointer is inputted (step 2204). A signal XB having a time interval as long as T segments starting from a time point designated by the B-pointer is inputted (step 2205). Then, the A-pointer is updated to be a number obtained by adding T on the contents of the B-pointer (step 2206). Then a correlation function between XA and XB is computed (step 2207). A time point Tc at which the correlation function takes its largest value is searched (step 2208). Based on this correlation function thus obtained, XA is multiplied by a window of a gradually decreasing function (step 2209). Also based on this correlation function obtained, XB is multiplied by a window of a gradually increasing function. (step 2210). Then, based also on the correlation function obtained, these windowed XA and XB are added to each other after they are mutually displaced at a time point at which the correlation function takes a largest value within a time-length of one unitary segment (step 2211). Next, in case that Tc is negative, an added signal is all issued (step 2213). Further a signal XC of a time interval as long as -Tc time-units starting from a time point designated by the A-pointer is issued (step 2215). On the other hand, in case that Tc is not negative, the added signal is issued only for a time interval of T time-units (step 2214). Next, -Tc is added to the A-pointer to update it (step 2216). And T/α is added to the B-pointer (step 2217). Then operation returns to the step 2204.

FIG. 23 schematically represents actual exemplary cases, wherein FIG. 23(a) schematically shows a succession of segments each having a time-length of T time-units of original voice signals on which speech rate modification process is to be carried out, FIG. 23(b) and FIG. 23(c) schematically represent embodiments where the time-scale modification ratios α are 1/3 and 1/4, respectively. FIG. 23(d) and FIG. 23(e) schematically illustrate examples of individual detailed process of the mutual addition calculation. FIG. 23(d) illustrates a case of the addition calculation designated by D in FIG. 23(b) and FIG. 23(c), wherein the addition calculation is performed under the condition that the correlation function takes a largest value when XB is displaced to the positive side by Tc time-units with respect to XA. FIG. 23(e) illustrates another case of the addition calculation, designated by E in FIG. 23(b) and FIG. 23(c), wherein the addition calculation is done for the same condition when XB is displaced to the negative side by Tc time-units with respect to XA. In the exemplary cases shown in FIGS. 23(b) and (c), there are time intervals designated by E which correspond to the time interval E of FIG. 23(e). In these time intervals, time sections extending outside the overlapping time interval may overlap also to adjacent time intervals and hence it is necessary to perform the amplitude adjustments also in those adjacent time intervals.

As has been described above, in accordance with the present embodiment, signals XA and XB are multiplied respectively by window functions which are complementary to each other, one being a gradually increasing window function and the other being a gradually decreasing window function. A signal obtained by adding these windowed signals is issued, a signal XC subsequent to XB is issued, and this process is repeated. Thus, a speech voice having an ample naturalness with less discontinuities in signal amplitude can be issued for a range of the time-scale modification ratio of α≦0.5. By computing a correlation function between these windowed XA and XB, and adding windowed XA and XB by displacing their mutual position so that the computed correlation function takes a largest value within a time-length of one unitary segment, a high quality speech voice with less discontinuities in the signal phase can be obtained. Moreover, by adjusting the position of the B-pointer with respect to the A-pointer, it becomes possible to easily change the time-scale modification ratio. Also, according to the above-mentioned method, it becomes possible to rapidly absorb such deviations in the time-scale modification ratio that might be caused by the addition calculation performed by displacing the mutual position of those windowed signals to make the correlation function take a largest value within a time-length of one unitary segment.

FIG. 24 schematically illustrates modified exemplary cases obtained by modifying the above-mentioned embodiment, wherein FIG. 24(a) schematically shows a succession of segments each having a time-length of T time-units of an original voice signal on which the speech rate modification process is to be carried out, FIG. 24(b) and FIG. 24(c) schematically represent embodiments where the the time-scale modification ratios α are 1/3 and 1/4, respectively, and FIG. 24(d) and FIG. 24(e) schematically illustrate examples of detailed individual processes of the addition calculation. FIG. 24(d) illustrates a case of the addition calculation designated by D in FIG. 24(b) and FIG. 24(c), wherein the addition calculation is done under a condition that the correlation function takes a largest value when XB is displaced to the positive side by Tc time-units with respect to XA. FIG. 24(e) illustrates another case of the addition calculation, designated by E in FIG. 24(b) and FIG. 24(c), wherein the addition calculation for the same condition is done when XB is displaced to the negative side by Tc time-units with respect to X.sub. A and time sections extending outside the leading and rear edges of the overlapping time interval are discarded. In these exemplary cases shown in FIG. 24(b) and FIG. 24(c), too, there are time intervals designated by E which correspond to the time interval E of FIG. 24(e). In these time intervals, time sections extending outside the overlapping time interval are discarded as shown in FIG. 24(e). This modified method can be realized by changing the window function. This modified method enables realizing a simplification of the process described above without suffering a degradation in the recognizability of the speech voice.

Although the invention has been described in its preferred form with a certain degree of particularity, it is understood that the present disclosure of the preferred form has been changed in the details of construction and the combination and arrangement of parts may be resorted to without departing from the spirit and the scope of the invention as hereinafter claimed.

Claims (25)

What is claimed is:
1. Method for modifying speech rate and changing a speech reproduction time interval by 1.0 times or more comprising the following steps:
deriving a correlation function in a range being shorter than a time length T with respect to a positive direction in which said second signal is moved to a direction with respect to said first signal and a negative direction in which said second signal is moved to an inverse direction of said direction with respect to said first signal from a reference time point at which a starting point of said first signal is in coincidence with a starting point of said second signal, in said first signal of the time length T and said second signal of the time length T, and deriving a time point Tc at which a value of said correlation function becomes a maximum value,
displacing said first signal with respect to said second signal at a time point at which the correlation function takes a largest value within a time-length of one unitary segment of speech to be analyzed,
multiplying said first signal by a first window function whose amplitude determined on the basis of a time point at which a value of the correlation function is maximum increases gradually to obtain a windowed first signal,
multiplying said second signal by a second window function whose amplitude determined on the basis of a time point at which a value of the correlation function is maximum decreases gradually to obtain a windowed second signal,
adding said first signal multiplied by said first window function and said second signal multiplied by said second window function to each other and outputting them,
issuing a third signal of a time-length of {T/(α-1)} time-units subsequent to the first signal wherein α is a time-scale modification ratio defined as output time duration/input time duration,
setting a starting point for said first signal at a next process to be a point at which the starting point of said first signal is delayed by a time interval of {T/(α-1)} time-units, and
repeating all the above-mentioned steps.
2. Method for modifying speech rate for changing speech reproduction time interval of a range of from 0.5 times to 1.0 times comprising the following steps:
computing a correlation function between a first signal and a second signal subsequent to the first signal and deriving a time point at which a value of the correlation function is maximum,
displacing said second signal with respect to said first signal at a time point at which the correlation function takes a largest value,
multiplying said first signal by a first window function whose amplitude determined on the basis of a time point at which a value of the correlation function is maximum decreases gradually to obtain a windowed first signal,
multiplying said second signal by a second window function whose amplitude decided on the basis of a time point at which a value of the correlation function is maximum increases gradually to obtain a windowed second signal,
adding said first signal multiplied by said first window function and said second signal multiplied by said second window function to each other to issue an added result,
issuing a third signal subsequent to said second signal, said third signal being an original input signal for a time interval decided on the basis of a time-scale modification ratio,
setting a starting point of a first signal in a next process to be a subsequent time point of a terminal time point of said third signal, and
repeating all the above-mentioned steps.
3. Method for modifying speech rate for changing speech reproduction time interval of a range of from 0.5 times to 1.0 times comprising the following steps:
deriving a correlation function in a range shorter than a time length T with respect to a positive direction in which said second signal is moved to a direction with respect to said first signal and a negative direction in which said second signal is moved to an inverse direction of said direction with respect to said first signal from a reference time point at which a starting point of said first signal is in coincidence with a starting point of said second signal, in said first signal of the time length T and said second signal of the time length T, and deriving a time point Tc at which a value of said correlation function becomes a maximum value,
displacing said second signal with respect to said first signal at a time point at which the correlation function takes a largest value,
multiplying said first signal by a first window function whose amplitude decided on the basis of a time point at which a value of the correlation function is maximum decreases gradually to obtain a windowed first signal,
multiplying said second signal by a second window function whose amplitude decided on the basis of a time point at which a value of the correlation function is maximum increases gradually to obtain a windowed second signal,
adding said first signal multiplied by said first window function and said second signal multiplied by said second window function to issue an added result,
issuing a third signal of a time-length of {(2α-1)T/(1-α)} time-units subsequent to the second signal decided on the basis of a time-scale modification ratio, setting a starting point of said first signal at a next process to be a next point to a terminal point of said third signal, and
repeating all the above-mentioned steps.
4. Method for modifying speech rate for changing speech reproduction time interval by 0.5 or less comprising the following steps:
setting a starting point of a second signal to a time point at which a first signal is delayed by such a time interval as to make a desired time-scale modification ratio α defined at a ratio of output time duration/input time duration,
computing a correlation function between said first signal and said second signal and deriving a time point at which the value of the correlation function is maximum,
displacing said second signal with respect to said first signal to a time point at which said correlation function takes a largest value,
multiplying said first signal by a first window function whose amplitude determined on the basis of a time point at which a value of the correlation function is maximum decreases gradually to obtain a windowed first signal,
multiplying said second signal by a second window function whose amplitude decided on the basis of a time point at which a value of the correlation function is maximum increases gradually to obtain a windowed second signal,
adding first signal multiplied by said window function and said second signal multiplied by said second window function to each other to issue an added result, setting a starting point of a first signal at a next process to be a point next to a terminal point of said second signal, and
repeating all the above-mentioned steps.
5. Method for modifying speech rate for changing speech reproduction time interval by 0.5 or less comprising the following steps: setting a starting point of a second signal to a time point at which a starting point of a first signal is delayed by a time interval of {(1-α)T/α} time-units wherein T is a time-length of one unitary segment and α is a time-scale modification ratio,
deriving a correlation function in a range shorter than a time length T with respect to a positive direction in which said second signal is moved to a direction with respect to said first signal and a negative direction in which said second signal is moved to an inverse direction of said direction with respect to said first signal from a reference time point at which a starting point of said first signal is in coincidence with a starting point of said second signal, in said first signal of the time length T and said second signal of the time length T, and deriving a time point Tc at which a value of said correlation function becomes a maximum value,
displacing said second signal with respect to said first signal to said time point Tc at which the correlation function takes a largest value within a time-length of one unitary segment,
multiplying said first signal by a first window function whose amplitude determined on the basis of a time point at which a value of the correlation function is maximum decreases gradually to obtain a windowed first signal,
multiplying said second signal by a second window function whose amplitude determined on the basis of a time point at which a value of the correlation function is maximum increases gradually to obtain a windowed second signal,
adding said first signal multiplied by said first window function and said second signal multiplied by said second window function to each other to issue an added result,
setting a starting point of a first signal at a next process to be a point at which a second signal is delayed by a time interval of T time-units; and
repeating all the above-mentioned steps.
6. Method for modifying speech rate for changing speech reproduction time interval by 0.5 times or less comprising the following steps:
displacing an input signal with respect to a preceding output signal on the basis of time-scale modification ratio α defined as a ratio of output time duration/input time duration,
computing a correlation function between said preceding output signal and said input signal and deriving a time point at which a value of the correlation function is maximum,
displacing said input signal further to a time point at which the correlation function takes a largest value,
multiplying said input signal by a window function whose amplitude decided on the basis of a time point at which a value of the correlation function is maximum increases gradually at its front-half part and a gradually decreases at its rear-half part,
adding said input signal multiplied by said window function to said output signal to issue an added result,
setting a starting point of an input signal in a next process to be a subsequent time point of a terminal time point of said input signal, and
repeating all the above-mentioned steps as necessary.
7. Method for modifying speech rate for changing speech reproduction time interval by 0.5 times or less comprising the following steps:
displacing an input signal of a time length of {T/(1-α} time-units to a point at which a starting point of a preceding output signal is displaced by a time interval of {αT/(1-α)} time-units,
computing a correlation function between said preceding signal and said input signal and deriving a time point at which a value of the correlation function is maximum,
displacing said input signal to a time point at which said correlation function takes a largest value,
multiplying said input signal by a window function whose amplitude decided on the basis of a value of a time-scale modification ratio α and a time point at which a value of the correlation function is maximum increases gradually at its front-half part and a gradually decreases at its rear-half part,
adding said input signal multiplied by said window function to said output signal,
setting a starting point of said input signal at a next process to be a point at which the starting point of said input signal is delayed by a time interval of {T/(1-α)} time-units, and
repeating all the above-mentioned steps.
8. A speech rate modification apparatus comprising:
a correlator for computing a correlation function between signals,
a time-scale modification ratio deviation detector for detecting a deviation of an actual time-scale modification ratio from a target time-scale modification ratio,
a weighting function generator for generating a weighting function based upon an output of said time-scale modification ratio detector,
a multiplier for multiplying an output of said correlator by an output of said weighting function generator,
a maximum value detector for deriving a time point at which an output of said multiplier is maximum, and
an adder for performing an addition calculation of said signals at a time point at which a weighted correlation function takes a largest value on the basis of an output of said maximum value detector.
9. A speech rate modification apparatus comprising:
a first memory for memorizing an input signal at a first time,
a second memory for memorizing said input signal at a second time subsequent to said first time,
a correlator for computing a correlation function between contents of said first memory and contents of said second memory,
a time-scale modification ratio detector for detecting a deviation of an output of an actual time-scale modification ratio from a target time-scale modification ratio α defined as a ratio of output time duration/input time duration,
a weighting function generator for generating weighting functions based upon an output of said time-scale modification ratio detector,
a third multiplier for multiplying an output of said correlator by an output of said weighting function generator,
a maximum value detector for deriving a time point at which an output of said third multiplier is maximum,
a window function generator for generating two complementary window functions based on an output of said maximum value detector,
a first multiplier for multiplying said contents of said first memory by a first output of said window function generator,
a second multiplier for multiplying said contents of said second memory by a second output of said window function generator,
an adder for performing a windowed addition calculation of an output of said first multiplier and an output of said second multiplier at a time point at which said correlation function takes a largest value based on an output of said maximum value detector, and
a multiplexer responsive to a signal representative of the time-scale modification ratio, said multiplexer having as a first input the input signal, as a second input an output of said adder, and as its output a modified speech signal.
10. A speech rate modification apparatus in accordance with claim 9, wherein:
said weighting function generator issues said weighting function on the basis of said deviation between a target time-scale modification ratio α defined as a ratio of output time duration/input time duration and an actually resulting time-scale modification ratio issued from said time-scale modification ratio detector, and includes
means for determining if an actually resulting time-scale modification ratio is longer than the target time-scale modification ratio α, and
means for selecting a largest value of the correlation function at a time point at which a time-length of a time-part of the output of the adder where the windowed addition calculation is performed is made shorter, and for selecting the largest value of the correlation function at a time point at which a time-length of a time-part of the output of the adder where the windowed addition calculation is performed is made longer.
11. A speech rate modification apparatus comprising:
a first memory for memorizing an input signal,
a second memory for memorizing said input signal,
a correlator for computing a correlation function between contents of said first memory and contents of said second memory and outputting a time point Tc at which the correlation function is maximum,
a window function generator for generating two complementary window functions based on an output of said correlator,
a first multiplier for multiplying said contents of said first memory by a first output of said window function generator,
a second multiplier for multiplying said contents of said second memory by a second output of said window function generator,
an adder for performing an addition calculation between an output of said first multiplier and an output of said second multiplier at the time point Tc at which said correlator function takes a largest value within a time-length of one unitary segment based on the output of said first multiplier, and
a multiplexer responsive to a signal representative of a time point Tc at which the correlation function is maximum and a value of a time-scale modification ratio α defined as a ratio of output time duration/input time duration, said multiplexer having as a first input said input signal, as a second input the output of said adder, and as its output a modified speech signal.
12. Method for modifying speech rate comprising the following steps:
computing a correlation function between a first signal and a second signal and deriving a time point Tc at which a value of the correlation function is maximum,
displacing said second signal with respect to said first signal to a time point at which the correlation function takes a largest value,
multiplying said first signal and second signal respectively by first and second complementary window functions decided on the basis of the time-point Tc at which a value of said correlation function is maximum,
adding said first signal multiplied by said first complementary window function and said second signal multiplied by said second complementary window function to each other to issue an added result,
issuing a third signal subsequent to said added result for a time interval decided on the basis of a time-scale modification ratio α and the time point Tc at which a value of the correlation function is maximum to produce a desired time-scale modification ratio, and
repeating all the above-mentioned steps.
13. Method for modifying speech rate and changing speech reproduction time interval by 1.0 times or more comprising the following steps:
computing a correlation function between a first signal and a second signal and deriving a time point Tc at which a value of the correlation function is maximum,
displacing said first signal with respect to said second signal at a time point Tc at which said correlation function takes a largest value within a time-length of one unitary segment,
multiplying said first signal by a first window function whose amplitude decided on the basis of the time point Tc at which a value of said correlation function is maximum increases gradually to produce a windowed first signal,
multiplying said second signal by a second window function whose amplitude decided on the basis of the time point Tc at which a value of said correlation function is maximum decreases gradually to produce a windowed second signal,
adding these windowed first and second signals to each other to issue an added result,
issuing a third signal subsequent to said first signal for a time-length which is determined on the basis of a desired time-scale modification ratio and a time point Tc at which said correlation function takes a largest value within a time-length of one unitary segment in a manner that a desired time duration/input time duration is realized,
repeating the above steps as a next process,
setting a starting time point of the first signal in the next process to be a time point at which a starting time point of said first signal is delayed by a time interval such that a desired time-scale modification ratio is produced, and
setting a starting time point of the second signal in the next process to be a subsequent time point of a terminal time point of said third signal.
14. Method for modifying speech rate for changing speech reproduction time interval by 1.0 times or more comprising the following steps:
deriving a correlation function in a range shorter than a time length T with respect to a positive direction in which said second signal is moved to a direction with respect to said first signal and a negative direction in which said second signal is moved to an inverse direction of said direction with respect to said first signal from a reference time point at which a starting point of said first signal is in coincidence with a staring point of said second signal, in said first signal of the time length T and said second signal of the time length T, and deriving a time point Tc at which a value of said correlation function becomes a maximum value,
displacing said first signal to a time position Tc with respect to said second signal at which said correlation function takes a largest value,
multiplying said first signal by a first window function whose amplitude decided on the basis of the time point Tc at which a value of said correlation function is maximum increases gradually to obtain a windowed first signal,
multiplying said second signal by a second window function whose amplitude decided on the basis of the time point Tc at which a value of said correlation function is maximum decreases gradually to obtain a windowed second signal,
adding said first signal multiplied by said first window function and said second signal multiplied by said second window function to each other to issue an added result,
issuing a third signal of a time interval of {T/(α-1)+T} time-units subsequent to said first signal,
setting a starting time of said first signal in a next process to such a time point that a starting point of said first signal is delayed by a time interval of {T/(α-1)} time-units,
setting said start time of said second signal in the next process to such a time point that a starting point of said first signal is delayed by a time interval of {αT/(α-1)+T} time-units; and
repeating all the above-mentioned steps.
15. Method for modifying speech rate as in claim 14, wherein:
said adding step includes, when the time interval of the added result exceeds a time interval of {αT/(α-1)} time-units, time-units from the start of said added result, and inhibiting issuance of said third signal.
16. Method for modifying speech rate for changing a speech reproduction time interval of from 0.5 to 1.0 times comprising the following steps:
computing a correlation function between a first signal and a second signal and deriving a time point Tc at which a value of the correlation function is maximum,
displacing said second signal with respect to said first signal to a time point Tc at which the correlation function takes a largest value,
multiplying said first signal by a first window function whose amplitude decided on the basis of the time point Tc at which a value of said correlation function is maximum decreases gradually to obtain a windowed first signal,
multiplying said second signal by a second window function whose amplitude decided on the basis of the time point Tc at which a value of said correlation function is maximum increases gradually to obtain a windowed second signal,
adding said first signal multiplied by said first window function and said second signal multiplied by said second window function to each other to issue an added result,
issuing a third signal subsequent to said second signal for a time-length which is determined on the basis of a time-scale modification ratio α and a time point Tc at which said correlation function takes a largest value in a manner that a desired time-scale modification ratio α defined as a ratio of output time duration/input time duration is realized,
setting a starting time point of said first signal in a next process to be a subsequent time point of a terminal time point of said third signal, and
setting a starting time point of said second signal in the next process to be a time point at which a starting time point of said second signal is delayed by a time interval such that a desired time-scale modification ratio is produced.
17. Method for modifying speech rate for changing speech reproduction time interval of from 0.5 to 1.0 times or more comprising the following steps:
deriving a correlation function in a range shorter than a time length T with respect to a positive direction in which said second signal is moved to a direction with respect to said first signal and a negative direction in which said second signal is moved to an inverse direction of said direction with respect to said first signal from a reference time point at which a starting point of said first signal is in coincidence with a starting point of said second signal, in said first signal of the time length T and said second signal of the time length T, and deriving a time point Tc at which a value of said correlation function becomes a maximum value,
displacing said second signal to a time position Tc with respect to said first signal at which said correlation function takes a largest value within a time-length of one unitary segment,
multiplying said first signal by a first window function whose amplitude decided on the basis of the time point Tc at which a value of said correlation function decreases gradually to obtain a windowed first signal,
multiplying said second signal by a second window function whose amplitude decided on the basis of the time point Tc at which a value of said correlation function increases gradually to obtain a windowed second signal,
adding said first signal multiplied by said first window function and said second signal multiplied by said second window function to each other to issue an added result,
issuing a third signal of a time interval of {(2α-1)T/(1-α)-Tc } time-units subsequent to said second signal, wherein α is time-scale modification ratio defined as output time duration/input time duration,
setting a starting time of said first signal in a next process to a time point that a starting point of said second signal is delayed by a time interval of {αT/(1-α)-Tc } time-units, and
setting said starting time of said second signal in the next process to be a time point that said starting point of said second signal is delayed by a time interval of {T/(1-α)} time-units, and
repeating all the above-mentioned steps.
18. A speech rate modification method in accordance with claim 17, wherein said adding step includes, in case that a time-length of said added result exceeds a time interval of {αT/(1-α)} time-units, the added result is issued only for a time interval of {αT/(α-1)} time-units from the start of the added result, and issuance of the third signal is inhibited.
19. Method for modifying speech rate for changing a speech reproduction time interval of 0.5 times or less comprising the following steps:
setting initially a starting point of a second signal to a time point that the starting point of a first signal is delayed by such a time interval as to produce a desired time-scale modification ratio α defined as a ratio of output time duration/input time duration,
computing a correlation function of said second signal with respect to said first signal and deriving a time point Tc at which a value of the correlation function is maximum,
displacing said second signal with respect to said first signal at a time point Tc at which said correlation function takes a largest value within a time-length of one unitary segment,
multiplying said first signal by a first window function whose amplitude decided on the basis of the time point Tc at which a value of said correlation function decreases gradually to obtain a windowed first signal,
multiplying said second signal by a second window function whose amplitude decided on the basis of the time point Tc at which a value of said correlation function increases gradually to obtain a windowed second signal,
adding said first signal multiplied by said first window function and said second signal multiplied by said second window function to each other to obtain an added signal,
issuing said added signal as well as a third signal which is subsequent to said second signal, for a time-length such that a desired time-scale modification ratio is made,
repeating said computing, displacing, multiplying adding and issuing steps as a next process,
setting a starting time of the first signal in a next process to be a next time point of a terminal time point of issued signal, and
setting a starting time of the second signal in the next process to be a time point that said starting point of said second signal is delayed by such a time interval as to produce a desired time-scale modification ratio.
20. Method for modifying speech rate for changing speech reproduction time interval of 0.5 times or less comprising the following steps:
setting initially a starting point of a second signal to a time point that starting point of a first signal is delayed by a time interval of {(1-α)T/α} time-units,
deriving a correlation function in a range shorter than a time length T with respect to a positive direction in which said second signal is moved to a direction with respect to said first signal and a negative direction in which said second signal is moved to an inverse direction of said direction with respect to said first signal from a reference time point at which a starting point of said first signal is in coincidence with a starting point of said second signal, in said first signal of the time length T and said second signal of the time length T, and deriving a time point Tc at which a value of said correlation function becomes a maximum value,
displacing said second signal to a time point Tc at which the correlation function takes a largest value within a time-length of one unitary segment,
multiplying said first signal by a first window function whose amplitude decided on the basis of the time point Tc at which the value of said correlation function is maximum decreases gradually to obtain a windowed first signal,
multiplying said second signal by a second window function whose amplitude decided on the basis of the time point Tc at which the value of said correlation function is maximum increases gradually to obtain a windowed second signal,
adding said first signal multiplied by said first window signal and second signal multiplied by said second window signal to each other to issue an added result,
issuing, when Tc is negative, a third signal of a time length of -Tc subsequent to said second signal after issuing said added result,
issuing, when Tc is zero or positive, said added result for a time length of T time-units from said starting point of the added result,
setting a starting time of said first signal in a next process at such a time point that the starting point of the second signal is delayed by a time interval of {T-Tc } time-units,
setting a starting point of said second signal in the next process at such a time point that the starting point of said second signal is delayed by a time interval of {T/α} time-units, and
repeating all the above-mentioned steps except for said initial setting.
21. A speech rate modification apparatus comprising:
a demultiplexer having as an input signal a speech signal, as a first output a first segment signal indicative of a first predetermined time length of said input signal, as a second output a second segment signal indicative of a second predetermined time length of said input signal, and as a third output a third segment signal indicative of a time length of said input signal which is determined according to a predetermined time-scale modification ratio (α) which represents a ratio of an output time length of an output signal to an input time length of said input signal after said input signal is time-scale-modified;
a correlator comprising means for deriving a correlation function comprising a sum total of products of amplitudes in an overlapped signal formed by overlapping said first segment signal and said second segment signal by shifting said first segment signal and said second segment signal relative to each other by a short time length, and for outputting a time-shift-signal representing a time shift between said first segment signal and said second segment signal when a value of the correlation function represented by said sum total becomes a maximum value;
a window function generator having means for generating a pair of window functions;
a pair of multipliers, respectively receiving said pair of window functions for weighting respective amplitudes of said first segment signal and said second segment signal based on characteristics of said window function;
an adder for adding outputs of said pair of multipliers with a time shift at which the value of said correlation function becomes the maximum value; and
a multiplexer responsive to a signal representative of said time-scale modification ratio (α), said multiplexer having as a first input an output of said adder, as a second input said third segment signal output from said demultiplexer, and as its output a modified speech signal.
22. A speech rate modification apparatus according to claim 21, further comprising a first memory for storing said first segment signal; and
a second memory for storing said second segment signal.
23. A method for modifying speech rate, comprising the steps of:
dividing an input signal into a first segment signal of a first predetermined time length, a second segment signal of a predetermined time length and a third segment signal of a time length which is determined according to a time-scale modification ratio (α) which is defined by a ratio of an output time length of an output signal to an input time length of said input signal after said input signal is time-scale-modified, and selectively outputting said first segment signal, said second segment signal and said third segment signal;
deriving a correlation function comprising a sum total of products of amplitudes in an overlapped signal formed by overlapping said first segment signal and said second segment signal by shifting said first segment signal and said second segment signal relative to each other by a short time length, and outputting a time-shift-signal representing a time shift between said first segment signal and said second segment signal when a value of the correlation function represented by said sum total becomes a maximum value,
generating a pair of window functions;
weighting respective amplitudes of said first segment signal and said second segment signal, on the basis of characteristics of said window functions to produce weighted first and second segment signals;
adding said weighted first segment signal and said weighted second segment signal with a time shift at which the value of said correlation function becomes the maximum value; and
selecting one of said added first segment signal and second segment signal or said third segment signal on the basis of said time-scale modification ratio (α).
24. A method for modifying a speech rate according to claim 23, wherein:
said pair of window functions have complimentary characteristics, one of which gradually increases an amplitude of said first segment signal and the other of which gradually decreases the amplitude of said second segment signal, and comprising the further step of repeating said dividing, defining, generating, weighting, adding and selecting steps to vary said output time length of said output signal by said time scale modification ratio (α).
25. A method for modifying a speech rate and for changing a speech reproduction time interval by 1.0 times or more, said method comprising the following steps:
computing a correlation function between a first signal and a second signal subsequent to said first signal and deriving a time point which a value of the correlation function is maximum,
displacing said first signal with respect to said second signal at a time point at which the correlation function takes a largest value,
multiplying said first signal by a window function whose amplitude decided on the basis of the time point at which the value of the correlation function is maximum increases gradually,
multiplying said second signal by a window function whose amplitude decided on the basis of the time point at which the value of the correlation function is maximum decreases gradually,
adding said first signal multiplied by said window function and said second signal multiplied by said window function to each other and outputting the added signal,
issuing a third signal subsequent to said first signal of an original input signal for a time interval decided on the basis of a time-scale modification ratio,
setting a starting point of a second signal in a next process to be a subsequent time point of a terminal time point of said third signal, and
repeating all the above-mentioned steps.
US07993526 1989-10-06 1992-12-16 Apparatus and method for performing speech rate modification and improved fidelity Expired - Lifetime US5341432A (en)

Priority Applications (8)

Application Number Priority Date Filing Date Title
JP26239189A JP2890530B2 (en) 1989-10-06 1989-10-06 Voice speed converting apparatus
JP1-262391 1989-10-06
JP2-13857 1990-01-24
JP1385790A JP2669088B2 (en) 1990-01-24 1990-01-24 Voice speed converting apparatus
JP22316790A JP2532731B2 (en) 1990-08-23 1990-08-23 Speech velocity converting apparatus and the speech speed converting method
JP2-223167 1990-08-23
US59320990 true 1990-10-04 1990-10-04
US07993526 US5341432A (en) 1989-10-06 1992-12-16 Apparatus and method for performing speech rate modification and improved fidelity

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US07993526 US5341432A (en) 1989-10-06 1992-12-16 Apparatus and method for performing speech rate modification and improved fidelity

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US59320990 Continuation 1990-10-04 1990-10-04

Publications (1)

Publication Number Publication Date
US5341432A true US5341432A (en) 1994-08-23

Family

ID=27280430

Family Applications (1)

Application Number Title Priority Date Filing Date
US07993526 Expired - Lifetime US5341432A (en) 1989-10-06 1992-12-16 Apparatus and method for performing speech rate modification and improved fidelity

Country Status (3)

Country Link
US (1) US5341432A (en)
DE (2) DE69024919T2 (en)
EP (1) EP0427953B1 (en)

Cited By (58)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1996018184A1 (en) * 1994-12-08 1996-06-13 The Regents Of The University Of California Method and device for enhancing the recognition of speech among speech-impaired individuals
EP0763905A2 (en) * 1995-09-13 1997-03-19 Matsushita Electric Industrial Co., Ltd. Subband decoding allowing for high-speed reproducing
US5630013A (en) * 1993-01-25 1997-05-13 Matsushita Electric Industrial Co., Ltd. Method of and apparatus for performing time-scale modification of speech signals
US5651089A (en) * 1993-02-19 1997-07-22 Matsushita Electric Industrial Co., Ltd. Block size determination according to differences between the peaks of adjacent and non-adjacent blocks in a transform coder
US5694521A (en) * 1995-01-11 1997-12-02 Rockwell International Corporation Variable speed playback system
US5717818A (en) * 1992-08-18 1998-02-10 Hitachi, Ltd. Audio signal storing apparatus having a function for converting speech speed
US5717823A (en) * 1994-04-14 1998-02-10 Lucent Technologies Inc. Speech-rate modification for linear-prediction based analysis-by-synthesis speech coders
US5752223A (en) * 1994-11-22 1998-05-12 Oki Electric Industry Co., Ltd. Code-excited linear predictive coder and decoder with conversion filter for converting stochastic and impulsive excitation signals
US5794201A (en) * 1991-08-23 1998-08-11 Hitachi, Ltd. Digital acoustic signal processing apparatus
US5828994A (en) * 1996-06-05 1998-10-27 Interval Research Corporation Non-uniform time scale modification of recorded audio
US5864792A (en) * 1995-09-30 1999-01-26 Samsung Electronics Co., Ltd. Speed-variable speech signal reproduction apparatus and method
US5927988A (en) * 1997-12-17 1999-07-27 Jenkins; William M. Method and apparatus for training of sensory and perceptual systems in LLI subjects
US5960387A (en) * 1997-06-12 1999-09-28 Motorola, Inc. Method and apparatus for compressing and decompressing a voice message in a voice messaging system
US6019607A (en) * 1997-12-17 2000-02-01 Jenkins; William M. Method and apparatus for training of sensory and perceptual systems in LLI systems
WO2000021091A1 (en) * 1998-10-08 2000-04-13 Sony Electronics Inc. Apparatus and method for variable-speed audio data playback
US6109107A (en) * 1997-05-07 2000-08-29 Scientific Learning Corporation Method and apparatus for diagnosing and remediating language-based learning impairments
US6159014A (en) * 1997-12-17 2000-12-12 Scientific Learning Corp. Method and apparatus for training of cognitive and memory systems in humans
US6249766B1 (en) * 1998-03-10 2001-06-19 Siemens Corporate Research, Inc. Real-time down-sampling system for digital audio waveform data
US6496794B1 (en) * 1999-11-22 2002-12-17 Motorola, Inc. Method and apparatus for seamless multi-rate speech coding
US6718309B1 (en) 2000-07-26 2004-04-06 Ssi Corporation Continuously variable time scale modification of digital audio signals
US20040068412A1 (en) * 2002-10-03 2004-04-08 Docomo Communications Laboratories Usa, Inc. Energy-based nonuniform time-scale modification of audio signals
US20040105660A1 (en) * 2001-10-18 2004-06-03 Ryoji Suzuki Audio video reproduction apparatus, audio video reproduction method, program, and medium
US20050039219A1 (en) * 1994-10-12 2005-02-17 Pixel Instruments Program viewing apparatus and method
US20050075860A1 (en) * 2003-10-03 2005-04-07 Hiroyuki Takeishi Apparatus for processing speech signal and method thereof as well as method for communicating speech and apparatus thereof
US20050149329A1 (en) * 2002-12-04 2005-07-07 Moustafa Elshafei Apparatus and method for changing the playback rate of recorded speech
US20050153267A1 (en) * 2004-01-13 2005-07-14 Neuroscience Solutions Corporation Rewards method and apparatus for improved neurological training
US20050175972A1 (en) * 2004-01-13 2005-08-11 Neuroscience Solutions Corporation Method for enhancing memory and cognition in aging adults
US20060074648A1 (en) * 1997-06-23 2006-04-06 Liechti Ag Method for the compression of recordings of ambient noise, method for the detection of program elements therein, and device therefor
US20060153163A1 (en) * 2005-01-07 2006-07-13 At&T Corp. System and method for modifying speech playout to compensate for transmission delay jitter in a Voice over Internet protocol (VoIP) network
US20060274843A1 (en) * 2005-06-01 2006-12-07 Samsung Electronics Co., Ltd. Apparatus and method for transmitting/receiving preamble signal in a wireless communication system
US20070154031A1 (en) * 2006-01-05 2007-07-05 Audience, Inc. System and method for utilizing inter-microphone level differences for speech enhancement
US20070276656A1 (en) * 2006-05-25 2007-11-29 Audience, Inc. System and method for processing an audio signal
US20080019548A1 (en) * 2006-01-30 2008-01-24 Audience, Inc. System and method for utilizing omni-directional microphones for speech enhancement
US20080140391A1 (en) * 2006-12-08 2008-06-12 Micro-Star Int'l Co., Ltd Method for Varying Speech Speed
US20090012783A1 (en) * 2007-07-06 2009-01-08 Audience, Inc. System and method for adaptive intelligent noise suppression
US20090132243A1 (en) * 2006-01-24 2009-05-21 Ryoji Suzuki Conversion device
US20090323982A1 (en) * 2006-01-30 2009-12-31 Ludger Solbach System and method for providing noise suppression utilizing null processing noise subtraction
EP2141696A1 (en) * 2008-07-03 2010-01-06 Deutsche Thomson OHG Method for time scaling of a sequence of input signal values
US20100302857A1 (en) * 2006-06-01 2010-12-02 Microchip Technology Incorporated Method of programming an array of nmos eeprom cells that minimizes bit disturbances and voltage withstand requirements for the memory array and supporting circuits
US8143620B1 (en) 2007-12-21 2012-03-27 Audience, Inc. System and method for adaptive classification of audio sources
US8180064B1 (en) 2007-12-21 2012-05-15 Audience, Inc. System and method for providing voice equalization
US8189766B1 (en) 2007-07-26 2012-05-29 Audience, Inc. System and method for blind subband acoustic echo cancellation postfiltering
US8194882B2 (en) 2008-02-29 2012-06-05 Audience, Inc. System and method for providing single microphone noise suppression fallback
US8204252B1 (en) 2006-10-10 2012-06-19 Audience, Inc. System and method for providing close microphone adaptive array processing
US8204253B1 (en) 2008-06-30 2012-06-19 Audience, Inc. Self calibration of audio device
US8259926B1 (en) 2007-02-23 2012-09-04 Audience, Inc. System and method for 2-channel and 3-channel acoustic echo cancellation
US8355511B2 (en) 2008-03-18 2013-01-15 Audience, Inc. System and method for envelope-based acoustic echo cancellation
US8521530B1 (en) 2008-06-30 2013-08-27 Audience, Inc. System and method for enhancing a monaural audio signal
US8570328B2 (en) 2000-12-12 2013-10-29 Epl Holdings, Llc Modifying temporal sequence presentation data based on a calculated cumulative rendition period
US8774423B1 (en) 2008-06-30 2014-07-08 Audience, Inc. System and method for controlling adaptivity of signal modification using a phantom coefficient
US8849231B1 (en) 2007-08-08 2014-09-30 Audience, Inc. System and method for adaptive power control
US8934641B2 (en) 2006-05-25 2015-01-13 Audience, Inc. Systems and methods for reconstructing decomposed audio signals
US8949120B1 (en) 2006-05-25 2015-02-03 Audience, Inc. Adaptive noise cancelation
US9008329B1 (en) 2010-01-26 2015-04-14 Audience, Inc. Noise reduction using multi-feature cluster tracker
US20160154029A1 (en) * 2013-06-01 2016-06-02 Analog Devices Global Electrical signal measurement
US9536540B2 (en) 2013-07-19 2017-01-03 Knowles Electronics, Llc Speech signal separation and synthesis based on auditory scene analysis and speech modeling
US9640194B1 (en) 2012-10-04 2017-05-02 Knowles Electronics, Llc Noise suppression for speech processing based on machine-learning mask estimation
US9799330B2 (en) 2014-08-28 2017-10-24 Knowles Electronics, Llc Multi-sourced noise suppression

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE69228211T2 (en) * 1991-08-09 1999-07-08 Koninkl Philips Electronics Nv Method and apparatus for handling the level and duration of a physical audio signal
JP2955247B2 (en) * 1997-03-14 1999-10-04 日本放送協会 Speech speed conversion method and apparatus
DE19710545C1 (en) * 1997-03-14 1997-12-04 Grundig Ag Time scale modification method for speech signals

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3786195A (en) * 1971-08-13 1974-01-15 Dc Dt Liquidating Partnership Variable delay line signal processor for sound reproduction
US4246617A (en) * 1979-07-30 1981-01-20 Massachusetts Institute Of Technology Digital system for changing the rate of recorded speech
US4464784A (en) * 1981-04-30 1984-08-07 Eventide Clockworks, Inc. Pitch changer with glitch minimizer
US4597318A (en) * 1983-01-18 1986-07-01 Matsushita Electric Industrial Co., Ltd. Wave generating method and apparatus using same
EP0197758A2 (en) * 1985-04-02 1986-10-15 Matsushita Electric Industrial Co., Ltd. Tone restoring apparatus
US4815135A (en) * 1984-07-10 1989-03-21 Nec Corporation Speech signal processor
US4864620A (en) * 1987-12-21 1989-09-05 The Dsp Group, Inc. Method for performing time-scale modification of speech information or speech signals
US4984253A (en) * 1988-06-03 1991-01-08 Hughes Aircraft Company Apparatus and method for processing simultaneous radio frequency signals

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3786195A (en) * 1971-08-13 1974-01-15 Dc Dt Liquidating Partnership Variable delay line signal processor for sound reproduction
US4246617A (en) * 1979-07-30 1981-01-20 Massachusetts Institute Of Technology Digital system for changing the rate of recorded speech
US4464784A (en) * 1981-04-30 1984-08-07 Eventide Clockworks, Inc. Pitch changer with glitch minimizer
US4597318A (en) * 1983-01-18 1986-07-01 Matsushita Electric Industrial Co., Ltd. Wave generating method and apparatus using same
US4815135A (en) * 1984-07-10 1989-03-21 Nec Corporation Speech signal processor
EP0197758A2 (en) * 1985-04-02 1986-10-15 Matsushita Electric Industrial Co., Ltd. Tone restoring apparatus
US4864620A (en) * 1987-12-21 1989-09-05 The Dsp Group, Inc. Method for performing time-scale modification of speech information or speech signals
US4984253A (en) * 1988-06-03 1991-01-08 Hughes Aircraft Company Apparatus and method for processing simultaneous radio frequency signals

Non-Patent Citations (10)

* Cited by examiner, † Cited by third party
Title
D. Malah; "Time-Domain Algorithms For Harmonic Bandwidth Reduction and Time Scaling Of Speech Signals" IEEE Transactions on Acoustics, Speech, and Signal Processing, Tampa, Fla.; vol. ASSP 27, No. 2; Apr. 1979; pp. 311--323.
D. Malah; Time Domain Algorithms For Harmonic Bandwidth Reduction and Time Scaling Of Speech Signals IEEE Transactions on Acoustics, Speech, and Signal Processing, Tampa, Fla.; vol. ASSP 27, No. 2; Apr. 1979; pp. 311 323. *
John Makhoul, et al., "Time-Scale Modification to Low Rate Speech Coding" IEEE International Conference on Acoustics, Speech and Signal Processing, vol. 3, 1986; pp. 1705-1706.
John Makhoul, et al., Time Scale Modification to Low Rate Speech Coding IEEE International Conference on Acoustics, Speech and Signal Processing, vol. 3, 1986; pp. 1705 1706. *
P. Jianping, "Effective Time-Domain Method for Speech Rate-Change", IEEE Transactions on Consumer Electronics, vol. 34, No. 2, May 1988 pp. 339-346.
P. Jianping, Effective Time Domain Method for Speech Rate Change , IEEE Transactions on Consumer Electronics, vol. 34, No. 2, May 1988 pp. 339 346. *
Richard V. Cox, et al., "Real-Time Implementation of Time Domain Harmonic Scaling of Speech for Rate Modification and Coding" IEEE Transactions on Acoustics Speech and Signal Processing, vol. 31, Feb. 1983 pp. 258-259, 261-265.
Richard V. Cox, et al., Real Time Implementation of Time Domain Harmonic Scaling of Speech for Rate Modification and Coding IEEE Transactions on Acoustics Speech and Signal Processing, vol. 31, Feb. 1983 pp. 258 259, 261 265. *
S. Roucos and A. M. Wilgus; "High Qualty Time-Scale Modification For Speech"; IEEE International Conference Acoustics, Signal Processing, Tampa Fla., Mar. 1985, pp. 493-496.
S. Roucos and A. M. Wilgus; High Qualty Time Scale Modification For Speech ; IEEE International Conference Acoustics, Signal Processing, Tampa Fla., Mar. 1985, pp. 493 496. *

Cited By (103)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5794201A (en) * 1991-08-23 1998-08-11 Hitachi, Ltd. Digital acoustic signal processing apparatus
US6226605B1 (en) 1991-08-23 2001-05-01 Hitachi, Ltd. Digital voice processing apparatus providing frequency characteristic processing and/or time scale expansion
US5717818A (en) * 1992-08-18 1998-02-10 Hitachi, Ltd. Audio signal storing apparatus having a function for converting speech speed
US5630013A (en) * 1993-01-25 1997-05-13 Matsushita Electric Industrial Co., Ltd. Method of and apparatus for performing time-scale modification of speech signals
US5651089A (en) * 1993-02-19 1997-07-22 Matsushita Electric Industrial Co., Ltd. Block size determination according to differences between the peaks of adjacent and non-adjacent blocks in a transform coder
US5717823A (en) * 1994-04-14 1998-02-10 Lucent Technologies Inc. Speech-rate modification for linear-prediction based analysis-by-synthesis speech coders
US8769601B2 (en) 1994-10-12 2014-07-01 J. Carl Cooper Program viewing apparatus and method
US8428427B2 (en) 1994-10-12 2013-04-23 J. Carl Cooper Television program transmission, storage and recovery with audio and video synchronization
US9723357B2 (en) 1994-10-12 2017-08-01 J. Carl Cooper Program viewing apparatus and method
US20050039219A1 (en) * 1994-10-12 2005-02-17 Pixel Instruments Program viewing apparatus and method
US8185929B2 (en) 1994-10-12 2012-05-22 Cooper J Carl Program viewing apparatus and method
US20100247065A1 (en) * 1994-10-12 2010-09-30 Pixel Instruments Corporation Program viewing apparatus and method
US20060015348A1 (en) * 1994-10-12 2006-01-19 Pixel Instruments Corp. Television program transmission, storage and recovery with audio and video synchronization
US20050240962A1 (en) * 1994-10-12 2005-10-27 Pixel Instruments Corp. Program viewing apparatus and method
US5752223A (en) * 1994-11-22 1998-05-12 Oki Electric Industry Co., Ltd. Code-excited linear predictive coder and decoder with conversion filter for converting stochastic and impulsive excitation signals
WO1996018184A1 (en) * 1994-12-08 1996-06-13 The Regents Of The University Of California Method and device for enhancing the recognition of speech among speech-impaired individuals
US6302697B1 (en) 1994-12-08 2001-10-16 Paula Anne Tallal Method and device for enhancing the recognition of speech among speech-impaired individuals
US6123548A (en) * 1994-12-08 2000-09-26 The Regents Of The University Of California Method and device for enhancing the recognition of speech among speech-impaired individuals
US5813862A (en) * 1994-12-08 1998-09-29 The Regents Of The University Of California Method and device for enhancing the recognition of speech among speech-impaired individuals
US5694521A (en) * 1995-01-11 1997-12-02 Rockwell International Corporation Variable speed playback system
US5845247A (en) * 1995-09-13 1998-12-01 Matsushita Electric Industrial Co., Ltd. Reproducing apparatus
EP0763905A3 (en) * 1995-09-13 2001-01-03 Matsushita Electric Industrial Co., Ltd. Subband decoding allowing for high-speed reproducing
EP0763905A2 (en) * 1995-09-13 1997-03-19 Matsushita Electric Industrial Co., Ltd. Subband decoding allowing for high-speed reproducing
US5864792A (en) * 1995-09-30 1999-01-26 Samsung Electronics Co., Ltd. Speed-variable speech signal reproduction apparatus and method
US5828994A (en) * 1996-06-05 1998-10-27 Interval Research Corporation Non-uniform time scale modification of recorded audio
US6109107A (en) * 1997-05-07 2000-08-29 Scientific Learning Corporation Method and apparatus for diagnosing and remediating language-based learning impairments
US6457362B1 (en) 1997-05-07 2002-10-01 Scientific Learning Corporation Method and apparatus for diagnosing and remediating language-based learning impairments
US6349598B1 (en) 1997-05-07 2002-02-26 Scientific Learning Corporation Method and apparatus for diagnosing and remediating language-based learning impairments
US5960387A (en) * 1997-06-12 1999-09-28 Motorola, Inc. Method and apparatus for compressing and decompressing a voice message in a voice messaging system
US7630888B2 (en) * 1997-06-23 2009-12-08 Liechti Ag Program or method and device for detecting an audio component in ambient noise samples
US20060074648A1 (en) * 1997-06-23 2006-04-06 Liechti Ag Method for the compression of recordings of ambient noise, method for the detection of program elements therein, and device therefor
US6159014A (en) * 1997-12-17 2000-12-12 Scientific Learning Corp. Method and apparatus for training of cognitive and memory systems in humans
US5927988A (en) * 1997-12-17 1999-07-27 Jenkins; William M. Method and apparatus for training of sensory and perceptual systems in LLI subjects
US6019607A (en) * 1997-12-17 2000-02-01 Jenkins; William M. Method and apparatus for training of sensory and perceptual systems in LLI systems
US6249766B1 (en) * 1998-03-10 2001-06-19 Siemens Corporate Research, Inc. Real-time down-sampling system for digital audio waveform data
WO2000021091A1 (en) * 1998-10-08 2000-04-13 Sony Electronics Inc. Apparatus and method for variable-speed audio data playback
US6292454B1 (en) * 1998-10-08 2001-09-18 Sony Corporation Apparatus and method for implementing a variable-speed audio data playback system
US6496794B1 (en) * 1999-11-22 2002-12-17 Motorola, Inc. Method and apparatus for seamless multi-rate speech coding
US6718309B1 (en) 2000-07-26 2004-04-06 Ssi Corporation Continuously variable time scale modification of digital audio signals
US8797329B2 (en) 2000-12-12 2014-08-05 Epl Holdings, Llc Associating buffers with temporal sequence presentation data
US9035954B2 (en) 2000-12-12 2015-05-19 Virentem Ventures, Llc Enhancing a rendering system to distinguish presentation time from data time
US8570328B2 (en) 2000-12-12 2013-10-29 Epl Holdings, Llc Modifying temporal sequence presentation data based on a calculated cumulative rendition period
US7158187B2 (en) 2001-10-18 2007-01-02 Matsushita Electric Industrial Co., Ltd. Audio video reproduction apparatus, audio video reproduction method, program, and medium
US20040105660A1 (en) * 2001-10-18 2004-06-03 Ryoji Suzuki Audio video reproduction apparatus, audio video reproduction method, program, and medium
US7426470B2 (en) * 2002-10-03 2008-09-16 Ntt Docomo, Inc. Energy-based nonuniform time-scale modification of audio signals
US20080133251A1 (en) * 2002-10-03 2008-06-05 Chu Wai C Energy-based nonuniform time-scale modification of audio signals
US20040068412A1 (en) * 2002-10-03 2004-04-08 Docomo Communications Laboratories Usa, Inc. Energy-based nonuniform time-scale modification of audio signals
US20080133252A1 (en) * 2002-10-03 2008-06-05 Chu Wai C Energy-based nonuniform time-scale modification of audio signals
US20050149329A1 (en) * 2002-12-04 2005-07-07 Moustafa Elshafei Apparatus and method for changing the playback rate of recorded speech
US7143029B2 (en) 2002-12-04 2006-11-28 Mitel Networks Corporation Apparatus and method for changing the playback rate of recorded speech
US20050075860A1 (en) * 2003-10-03 2005-04-07 Hiroyuki Takeishi Apparatus for processing speech signal and method thereof as well as method for communicating speech and apparatus thereof
US7509255B2 (en) * 2003-10-03 2009-03-24 Victor Company Of Japan, Limited Apparatuses for adaptively controlling processing of speech signal and adaptively communicating speech in accordance with conditions of transmitting apparatus side and radio wave and methods thereof
US20050153267A1 (en) * 2004-01-13 2005-07-14 Neuroscience Solutions Corporation Rewards method and apparatus for improved neurological training
US20050175972A1 (en) * 2004-01-13 2005-08-11 Neuroscience Solutions Corporation Method for enhancing memory and cognition in aging adults
US7830862B2 (en) * 2005-01-07 2010-11-09 At&T Intellectual Property Ii, L.P. System and method for modifying speech playout to compensate for transmission delay jitter in a voice over internet protocol (VoIP) network
US20060153163A1 (en) * 2005-01-07 2006-07-13 At&T Corp. System and method for modifying speech playout to compensate for transmission delay jitter in a Voice over Internet protocol (VoIP) network
US20060274843A1 (en) * 2005-06-01 2006-12-07 Samsung Electronics Co., Ltd. Apparatus and method for transmitting/receiving preamble signal in a wireless communication system
US8867759B2 (en) 2006-01-05 2014-10-21 Audience, Inc. System and method for utilizing inter-microphone level differences for speech enhancement
US20070154031A1 (en) * 2006-01-05 2007-07-05 Audience, Inc. System and method for utilizing inter-microphone level differences for speech enhancement
US8345890B2 (en) 2006-01-05 2013-01-01 Audience, Inc. System and method for utilizing inter-microphone level differences for speech enhancement
US20090132243A1 (en) * 2006-01-24 2009-05-21 Ryoji Suzuki Conversion device
US8073704B2 (en) 2006-01-24 2011-12-06 Panasonic Corporation Conversion device
US9185487B2 (en) 2006-01-30 2015-11-10 Audience, Inc. System and method for providing noise suppression utilizing null processing noise subtraction
US20090323982A1 (en) * 2006-01-30 2009-12-31 Ludger Solbach System and method for providing noise suppression utilizing null processing noise subtraction
US20080019548A1 (en) * 2006-01-30 2008-01-24 Audience, Inc. System and method for utilizing omni-directional microphones for speech enhancement
US8194880B2 (en) 2006-01-30 2012-06-05 Audience, Inc. System and method for utilizing omni-directional microphones for speech enhancement
US8934641B2 (en) 2006-05-25 2015-01-13 Audience, Inc. Systems and methods for reconstructing decomposed audio signals
US20070276656A1 (en) * 2006-05-25 2007-11-29 Audience, Inc. System and method for processing an audio signal
US8949120B1 (en) 2006-05-25 2015-02-03 Audience, Inc. Adaptive noise cancelation
US8150065B2 (en) 2006-05-25 2012-04-03 Audience, Inc. System and method for processing an audio signal
US9830899B1 (en) 2006-05-25 2017-11-28 Knowles Electronics, Llc Adaptive noise cancellation
US8094503B2 (en) * 2006-06-01 2012-01-10 Microchip Technology Incorporated Method of programming an array of NMOS EEPROM cells that minimizes bit disturbances and voltage withstand requirements for the memory array and supporting circuits
US20100302857A1 (en) * 2006-06-01 2010-12-02 Microchip Technology Incorporated Method of programming an array of nmos eeprom cells that minimizes bit disturbances and voltage withstand requirements for the memory array and supporting circuits
US8204252B1 (en) 2006-10-10 2012-06-19 Audience, Inc. System and method for providing close microphone adaptive array processing
US20080140391A1 (en) * 2006-12-08 2008-06-12 Micro-Star Int'l Co., Ltd Method for Varying Speech Speed
US7853447B2 (en) * 2006-12-08 2010-12-14 Micro-Star Int'l Co., Ltd. Method for varying speech speed
US8259926B1 (en) 2007-02-23 2012-09-04 Audience, Inc. System and method for 2-channel and 3-channel acoustic echo cancellation
US8744844B2 (en) 2007-07-06 2014-06-03 Audience, Inc. System and method for adaptive intelligent noise suppression
US20090012783A1 (en) * 2007-07-06 2009-01-08 Audience, Inc. System and method for adaptive intelligent noise suppression
US8886525B2 (en) 2007-07-06 2014-11-11 Audience, Inc. System and method for adaptive intelligent noise suppression
US8189766B1 (en) 2007-07-26 2012-05-29 Audience, Inc. System and method for blind subband acoustic echo cancellation postfiltering
US8849231B1 (en) 2007-08-08 2014-09-30 Audience, Inc. System and method for adaptive power control
US9076456B1 (en) 2007-12-21 2015-07-07 Audience, Inc. System and method for providing voice equalization
US8180064B1 (en) 2007-12-21 2012-05-15 Audience, Inc. System and method for providing voice equalization
US8143620B1 (en) 2007-12-21 2012-03-27 Audience, Inc. System and method for adaptive classification of audio sources
US8194882B2 (en) 2008-02-29 2012-06-05 Audience, Inc. System and method for providing single microphone noise suppression fallback
US8355511B2 (en) 2008-03-18 2013-01-15 Audience, Inc. System and method for envelope-based acoustic echo cancellation
US8774423B1 (en) 2008-06-30 2014-07-08 Audience, Inc. System and method for controlling adaptivity of signal modification using a phantom coefficient
US8204253B1 (en) 2008-06-30 2012-06-19 Audience, Inc. Self calibration of audio device
US8521530B1 (en) 2008-06-30 2013-08-27 Audience, Inc. System and method for enhancing a monaural audio signal
US8676584B2 (en) 2008-07-03 2014-03-18 Thomson Licensing Method for time scaling of a sequence of input signal values
US20100004937A1 (en) * 2008-07-03 2010-01-07 Thomson Licensing Method for time scaling of a sequence of input signal values
KR20100004876A (en) * 2008-07-03 2010-01-13 톰슨 라이센싱 Method for time scaling of a sequence of input signal values
CN101620856B (en) 2008-07-03 2013-07-17 汤姆森许可贸易公司 Method for time scaling of a sequence of input signal values
EP2141696A1 (en) * 2008-07-03 2010-01-06 Deutsche Thomson OHG Method for time scaling of a sequence of input signal values
KR101582358B1 (en) 2008-07-03 2016-01-04 톰슨 라이센싱 Method for time scaling a sequence of input signal values
EP2141697A1 (en) 2008-07-03 2010-01-06 Thomson Licensing Method for time scaling of a sequence of input signal values
US9008329B1 (en) 2010-01-26 2015-04-14 Audience, Inc. Noise reduction using multi-feature cluster tracker
US9640194B1 (en) 2012-10-04 2017-05-02 Knowles Electronics, Llc Noise suppression for speech processing based on machine-learning mask estimation
US9823275B2 (en) * 2013-06-01 2017-11-21 Analog Devices Global Electrical signal measurement
US20160154029A1 (en) * 2013-06-01 2016-06-02 Analog Devices Global Electrical signal measurement
US9536540B2 (en) 2013-07-19 2017-01-03 Knowles Electronics, Llc Speech signal separation and synthesis based on auditory scene analysis and speech modeling
US9799330B2 (en) 2014-08-28 2017-10-24 Knowles Electronics, Llc Multi-sourced noise suppression

Also Published As

Publication number Publication date Type
DE69024919D1 (en) 1996-02-29 grant
DE69024919T2 (en) 1996-10-17 grant
EP0427953A3 (en) 1991-05-29 application
EP0427953A2 (en) 1991-05-22 application
EP0427953B1 (en) 1996-01-17 grant

Similar Documents

Publication Publication Date Title
US3369077A (en) Pitch modification of audio waveforms
US3624302A (en) Speech analysis and synthesis by the use of the linear prediction of a speech wave
US6411927B1 (en) Robust preprocessing signal equalization system and method for normalizing to a target environment
US6169241B1 (en) Sound source with free compression and expansion of voice independently of pitch
US4066842A (en) Method and apparatus for cancelling room reverberation and noise pickup
US5323459A (en) Multi-channel echo canceler
US4712243A (en) Speech recognition apparatus
US5572443A (en) Acoustic characteristic correction device
US3997773A (en) Interpolating digital filter with input buffer
US4052559A (en) Noise filtering device
US6360202B1 (en) Variable rate video playback with synchronized audio
US5408581A (en) Apparatus and method for speech signal processing
US4720802A (en) Noise compensation arrangement
US6801898B1 (en) Time-scale modification method and apparatus for digital signals
US5249578A (en) Ultrasound imaging system using finite impulse response digital clutter filter with forward and reverse coefficients
US4734795A (en) Apparatus for reproducing audio signal
US5641927A (en) Autokeying for musical accompaniment playing apparatus
US5267322A (en) Digital automatic gain control with lookahead, adaptive noise floor sensing, and decay boost initialization
US5179531A (en) Accelerated digital signal processor
US4365338A (en) Technique for high rate digital transmission over a dynamic dispersive channel
US4715257A (en) Waveform generating device for electronic musical instruments
US5434949A (en) Score evaluation display device for an electronic song accompaniment apparatus
US5715179A (en) Performance evaluation method for use in a karaoke apparatus
US4435832A (en) Speech synthesizer having speech time stretch and compression functions
US5952596A (en) Method of changing tempo and pitch of audio by digital signal processing

Legal Events

Date Code Title Description
FPAY Fee payment

Year of fee payment: 4

FPAY Fee payment

Year of fee payment: 8

FPAY Fee payment

Year of fee payment: 12