EP0527529A2 - Method and apparatus for manipulating duration of a physical audio signal, and a storage medium containing a representation of such physical audio signal - Google Patents
Method and apparatus for manipulating duration of a physical audio signal, and a storage medium containing a representation of such physical audio signal Download PDFInfo
- Publication number
- EP0527529A2 EP0527529A2 EP92202374A EP92202374A EP0527529A2 EP 0527529 A2 EP0527529 A2 EP 0527529A2 EP 92202374 A EP92202374 A EP 92202374A EP 92202374 A EP92202374 A EP 92202374A EP 0527529 A2 EP0527529 A2 EP 0527529A2
- Authority
- EP
- European Patent Office
- Prior art keywords
- signal
- duration
- audio
- audio equivalent
- manipulating
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/04—Time compression or expansion
Definitions
- the invention relates to a method for manipulating an audio equivalent signal, comprising positioning of a chain of mutually overlapping time windows with respect to the audio equivalent signal, as based on periodicity measurements on said audio equivalent signal, and wherein a positional displacement between adjacent windows substantially corresponds to a principal period of said periodicity, and synthesizing an audio output signal by chained superposition of segment signals, each deriving from the audio equivalent signal through weighting with the associated window function.
- the inventors of the present invention have realized that the manipulation of the duration can be used in various situations where there are external constraints to the total length of a self-contained unit of speech, which constraints may specify both the maximum and the minimum duration of such unit.
- the object is realized in that the invention is characterized by manipulating a duration of said output signal through systematically repeating, maintaining, and/or suppressing said segment signals, to a resulting predetermined overall length that differs from a corresponding duration of said audio equivalent signal.
- An advantage of the method of positioning windows according to the junior reference is that it can be machine-executed without any window-to-window human control being necessary. Furthermore, it has been found that the duration can be changed by a factor between 2 and 1 ⁇ 2 without seriously impairing understandability of speech. For lesser degrees of manipulating the duration, such as by + or - 30%, not only remains the understandability very good, but also the natural quality of speech is maintained, and a listener would hardly feel the change of duration as unnatural. A prerequisite to applying the method is that the pitch can indeed be measured, which for human speech is a problem knowing various solutions.
- the invention relates also to an apparatus for executing the method and to a storage medium containing a representation of audio signal equivalent.
- the invention allows to fill the available space for a unit of speech (sentence, partial sentence, exclamation, or other) well nigh completely.
- CD-I Compact Disc Interactive
- a particular application is Compact Disc Interactive, especially so in a multi-language environment. Editing CD-I is by itself a complicated task. Sizing the duration of speech utterances may now be performed by the machine for relieving the program editor from this tedium.
- CD-I is a well-published storage medium with associated development platform, the storage itself being an extension from Compact Disc Audio.
- the audio or speech equivalent signal may be direct analog speech, or it may be speech that is stored as a sequence of codes for on the basis thereon generating synthetic speech.
- the length of the various windows may be non-uniform, and in a particular embodiment, the length of each window may be substantially equal to a local actual pitch period length.
- the window function is uniform, which means that the window function scales linearly with the width of the window, which means that generally, there may be an appreciable variation between the widths of successive windows.
- the systematical character of the repeating, maintaining, or suppression implies that there is a certain prescription for the sequence of window positions that, first, restricts to either repeating or suppressing, either possibly in combination with maintaining, and furthermore, that the repeating or maintaining is done under control of an actual or emulated recurrent cycle. Examples are: each third window is repeated once, the others are maintained; of each five successive windows, #2 and #4 are suppressed; at each next window, a count is incremented by a particular amount and overflow controls actual suppression or repetition.
- the different representations in parallel may be different languages; it has been found that the same sentence, translated to another language, would have different length, counted for example, as a number of syllables: in particular, the German language caused a longer duration as compared with English and French.
- the pictorial material 200 is shown with accompanying speech representations in French (202), German (204) and English (206) before editing. It is intended to lend each language representation (among which a user may choose) exactly the same duration as the pictorial material (movie, animation, etcetera).
- a single window is suppressed
- five windows are suppressed.
- six windows are repeated one (crosses). The result after editing is not shown. It has been found that analysis of the results can prove infringement. Especially the occurrence of the repeated windows is well traceable.
- the substantially equal lengths of the various representations is, together with the high subjective quality of the rendering is a clear indication for the use of the present technology.
- the slowing down or speeding may lend the speech a character, such as nervous (fast) or lively (slow). Also such use is sometimes advantageous.
- Changing the duration of the audio equivalent signal may be combined with changing the pitch.
- the two types of manipulation may be both in the same direction, for example in that both effectively shorten the duration. In other circumstances, they could to some degree compensate the effects, so that the change in duration would be less or even be zero.
- the change of duration may be according to a time-varying pattern, whereby the overall change of duration is the integral or sum of the elementary changes-of-duration.
- Figures 2a, 2b and 2c show speech signals with marks 52 placed apart by distances determined with a pitch meter (that may be conventional), that is, without a fixed phase reference.
- a pitch meter that may be conventional
- two successive periods where marked as voiceless by placing their pitch period length indication outside the scale.
- the pitch marks (lower scale) where obtained by interpolating the period length.
- the incremental placement of windows also solves another problem.
- unvoiced stretches that contain fricatives like the sound “ssss", in which the vocal cords are not excited
- the windows are placed incrementally just like for voiced stretches.
- the pitch period length is interpolated between the lengths measured for unvoiced stretches adjacent to the voiced stretch. This provides regularly spaced windows without audible artefacts.
- the placement of windows is easy if the input audio equivalent signal is monotonous.
- the windows may be placed simply at fixed distances from each other. This may be effected by preprocessing the signal, so as to change its pitch to a single monotonous value. The final manipulation to obtain a desired pitch and/or duration starting can then be performed with windows at uniform spacing.
- Figure 3 shows an exemplary embodiment of an apparatus for changing the pitch and/or duration of an audible signal.
- the input audio equivalent signal arrives at an input 60, and the output signal leaves at an output 63.
- the input signal is multiplied by the window function in multiplication means 61, and stored segment signal by segment signal in segment slots in storage means 62.
- speech samples from various segment signals are summed in summing means 64.
- the manipulation of speech signals in terms of pitch change and/or duration manipulation, is effected by addressing the storage means 62 and selecting window function values. Accordingly, selection of storage addresses for storing the segments is controlled by window position selection means 65, which also control window function value selection means 69; selection of readout addresses is controlled by combination means 66.
- Figure 4 shows the multiplication means 61 and the window function value selection means 69.
- the respective t values t a , t b described above are multiplied by the inverse of the period length L i (determined from the period length in an invertor 74) in scaling multipliers 70a, 70b to determine the corresponding arguments of the window function W.
- These arguments are supplied to window function evaluators 71a, 71b (implemented for example in case of discrete arguments as a lookup table) which outputs the corresponding values of the window function, which are multiplied with the input signal in two multipliers 72a, 72b. This produces the segment signal values Si, Si+1 at two inputs 73a, 73b to the storage means 62.
- segment signal values are stored in the storage means 62 in segment slots at addresses in the slots corresponding to their respective time point values t a , t b and to respective slot numbers. These addresses are controlled by window position selection means 65. Window position selection means suitable for implementing the invention are shown in Figure 5.
- the time point values t a , t b are addressed by counters 81, 82, the segment slots numbers are addressed by indexing means 84, (which output the segment indices i, i+1).
- the counters 81, 82 and the indexing means 84 output addresses with a width as appropriate to distinguish the various positions within the slots and the various slot respectively, but are shown symbolically only as single lines in Figure 5.
- the two counters 81, 82 are clocked at a fixed clock rate and count from an initial value loaded from a load input (L), upon a trigger signal at trigger input (T).
- the indexing means 84 increment the index values upon reception of this trigger signal.
- pitch measuring means 86 determine a pitch value from input 60, and control the scale factor for the scaling multipliers 70a, 70b, and provide the initial value of the first counter 81 (the initial count being minus the pitch value), whereas the trigger signal is generated internally in the window position selection means, once the counter reaches zero, as detected by a comparator 88. This means that successive windows are placed by incrementing the location of a previous window by the time needed by the first counter 81 to reach zero.
- a monotonized signal is applied to the input 60 (this monotonized signal being obtained by prior processing in which the pitch is adjusted to a time independent value).
- a constant value, corresponding to the monotonized pitch is fed as initial value to the first counter 81.
- the scaling multipliers 70a, 70b can be omitted since the windows have a fixed size.
- the combination means 66 of Figure 3 are shown in Figure 10.
- the sum being limited to index values i for which -L i ⁇ t-T i ⁇ L i+1 ; in principle, any number of index values may contribute to the sum at one time point t. But when the pitch is not changed by more than a factor of 3/2, at most 3 index values will contribute at a time.
- Figures 3 and 7 show an apparatus which provides for only three active indices at a time; extension to more than three segments is straightforward.
- the combination means 66 are quite similar to the input side: they comprise three counters 101, 102, 103 (clocked at a fixed rate), outputting the time point values t-T i for the three segment signals.
- the three counters receive the same trigger signal, which triggers loading of minus the desired output pitch interval in the first of the three counters 101.
- the trigger signal is generated by a comparator 104, which detects zero crossing of the first counter 101.
- the trigger signal also updates indexing means 106.
- the indexing means address the segment slot numbers which must be read out and the counters address the position within the slots.
- the counters and indexing means address three segments, which are output from the storage means 62 to the summing means 64 in order to produce the output signal.
- the duration of the speech signal is controlled by a duration control input 68b to the indexing means. Without duration manipulation, the indexing means simply produce three successive segment slot numbers.
- the values of the first and second output are copied to the second an third output respectively, and the first output is increased by one.
- the duration is increased, the first output is kept constant once every so many cycles, as determined by the duration control input 68b.
- the first output is increased by two every so many cycles. The change in duration is determined by the net number of skipped or repeated indices.
- Figure 3 only provides one embodiment by way of example.
- the principal point is the incremental placement of windows at the input side with a phase determined from the phase of a previous window.
- the addresses may be generated using a computer program, and the starting addresses need not have the values given in the example.
- Figure 3 can be implemented in various ways, for example using digital samples at input 60, where the sampling rate has at any convenient value, for example 10000 samples per second; conversely, it may use continuous signal techniques, where the clocks 81, 82, 101, 102, 103 provide continuous ramp signals, and the storage means provide for continuously controlled access like a magnetic disk. Furthermore, in Figure 3 in practice segment slots may be reused after some time, as they are not needed permanently. Not all components of Figure 4 need to be implemented by discrete function blocks: often it may be implemented in whole or part by a computer.
Abstract
Description
- The invention relates to a method for manipulating an audio equivalent signal, comprising positioning of a chain of mutually overlapping time windows with respect to the audio equivalent signal, as based on periodicity measurements on said audio equivalent signal, and wherein a positional displacement between adjacent windows substantially corresponds to a principal period of said periodicity, and synthesizing an audio output signal by chained superposition of segment signals, each deriving from the audio equivalent signal through weighting with the associated window function.
Such method has been described in earlier non pre-published European Application 91202044.3 (PHN 13.801) co-authored by the present inventors and assigned to the same assignee, herein incorporated by reference, inasfar as not actually included. As an alternative of the art recited, a still earlier, prepublished technology can be used, as per European Patent Application EP-A-363 233. The object of the references is to change prosody for synthesized speech, the pitch of the output signal, and the duration of stretches of speech. In combination with the junior reference, the method should be performed automatically, be robust against noise, and retain a high audio quality for the output signal. - The inventors of the present invention have realized that the manipulation of the duration can be used in various situations where there are external constraints to the total length of a self-contained unit of speech, which constraints may specify both the maximum and the minimum duration of such unit.
- Accordingly, amongst other things, it is an object of the present invention to position the manipulated audio equivalent signal in a predetermined time length that differs from the original length, while on the one hand filling the interval more or less completely, and on the other hand keeping the impression of the eventual representation as natural as possible.
- Now, according to one of its aspects, the object is realized in that the invention is characterized by manipulating a duration of said output signal through systematically repeating, maintaining, and/or suppressing said segment signals, to a resulting predetermined overall length that differs from a corresponding duration of said audio equivalent signal.
- An advantage of the method of positioning windows according to the junior reference is that it can be machine-executed without any window-to-window human control being necessary. Furthermore, it has been found that the duration can be changed by a factor between 2 and ½ without seriously impairing understandability of speech. For lesser degrees of manipulating the duration, such as by + or - 30%, not only remains the understandability very good, but also the natural quality of speech is maintained, and a listener would hardly feel the change of duration as unnatural. A prerequisite to applying the method is that the pitch can indeed be measured, which for human speech is a problem knowing various solutions. Situations where the duration of speech should be manipulated are various, such as in post-synchronizing of movies or other video representative material, adapting a speech explanation or other matter to physical motion of objects, such as the closing instant of a door, and many other instances. In movies, actor utterances should preferably coincide with their facial motions, or at least with their moving around in general. Typical time scales of the total duration of the utterance are 0.3 to several seconds. In this short time frame, prior art had not succeeded in duration manipulation with also preserving naturalness. On a much longer time scale, the length of a pause can be manipulated, such as is often done by human interpreters. If the available time is known beforehand, sometimes a different verbalization can be used, but all these methods require specialized human skills. The present method is easily applicable and just requires the setting of a speed-up or slow-down percentage. Of course, the use of the present invention is also for amending longer durations than in the seconds range.
- The invention relates also to an apparatus for executing the method and to a storage medium containing a representation of audio signal equivalent. The invention allows to fill the available space for a unit of speech (sentence, partial sentence, exclamation, or other) well nigh completely.
- A particular application is Compact Disc Interactive, especially so in a multi-language environment. Editing CD-I is by itself a complicated task. Sizing the duration of speech utterances may now be performed by the machine for relieving the program editor from this tedium. By itself, CD-I is a well-published storage medium with associated development platform, the storage itself being an extension from Compact Disc Audio.
- Various advantageous aspects of the invention are recited in dependent Claims.
- These and other advantages will be described with reference to a preferred embodiment which is shown in a number of Figures, of which
- Figure 1 shows editing of CDI-program for storage on a CD-I-disc;
The following Figures especially show the technology of the junior reference: - Figures 2a,b,c show speech signals with windows placed according to the invention;
- Figure 3 shows an apparatus for changing the pitch and/or duration of a signal;
- Figure 4 shows multiplication means and window function value selection means for use in an apparatus for changing the pitch and/or duration of a signal;
- Figure 5 shows window position selection means for implementing the invention;
- Figure 6 shows a subsystem for combining several segment signals.
- As is commonly understood, the audio or speech equivalent signal may be direct analog speech, or it may be speech that is stored as a sequence of codes for on the basis thereon generating synthetic speech. The length of the various windows may be non-uniform, and in a particular embodiment, the length of each window may be substantially equal to a local actual pitch period length. Within the window, the window function is uniform, which means that the window function scales linearly with the width of the window, which means that generally, there may be an appreciable variation between the widths of successive windows. The systematical character of the repeating, maintaining, or suppression implies that there is a certain prescription for the sequence of window positions that, first, restricts to either repeating or suppressing, either possibly in combination with maintaining, and furthermore, that the repeating or maintaining is done under control of an actual or emulated recurrent cycle. Examples are:
each third window is repeated once, the others are maintained;
of each five successive windows, #2 and #4 are suppressed;
at each next window, a count is incremented by a particular amount and overflow controls actual suppression or repetition. - It is commented that the systematical character would not need to be completely uniform. For example, in post-synchronization of a movie, it could be advantageous to amend the time durations of various parts of a sentence somewhat differently from each other, as long as the natural character of the resulting speech would remain. In particular the movement of a face while speaking speech could to a certain extent be followed by the dynamics of the audio speech. Also, different sentences in various places of the post-synchronizing now may have uniform pitch among each other.
- The different representations in parallel may be different languages; it has been found that the same sentence, translated to another language, would have different length, counted for example, as a number of syllables: in particular, the German language caused a longer duration as compared with English and French.
- Other, in particular exotic, languages may lead to even more extreme situations. Similar situations may distinguish child voices from adult voices.
- In the Figure for a three language CD-I track the
pictorial material 200 is shown with accompanying speech representations in French (202), German (204) and English (206) before editing. It is intended to lend each language representation (among which a user may choose) exactly the same duration as the pictorial material (movie, animation, etcetera). As shown, online 202, a single window is suppressed, online 204, five windows are suppressed. Online 206, six windows are repeated one (crosses). The result after editing is not shown. It has been found that analysis of the results can prove infringement. Especially the occurrence of the repeated windows is well traceable. Moreover, the substantially equal lengths of the various representations is, together with the high subjective quality of the rendering is a clear indication for the use of the present technology. - In certain situations, apart from changing the duration per se, the slowing down or speeding may lend the speech a character, such as nervous (fast) or majestic (slow). Also such use is sometimes advantageous. Changing the duration of the audio equivalent signal may be combined with changing the pitch. The two types of manipulation may be both in the same direction, for example in that both effectively shorten the duration. In other circumstances, they could to some degree compensate the effects, so that the change in duration would be less or even be zero. The change of duration may be according to a time-varying pattern, whereby the overall change of duration is the integral or sum of the elementary changes-of-duration.
- Hereinafter, a description of the preferred technology according to the junior reference is given.
- Figures 2a, 2b and 2c show speech signals with marks 52 placed apart by distances determined with a pitch meter (that may be conventional), that is, without a fixed phase reference. In Figure 2a, two successive periods where marked as voiceless by placing their pitch period length indication outside the scale. The pitch marks (lower scale) where obtained by interpolating the period length. Although the pitch period lengths were determined without smoothing other than that inherent in determining spectra of the speech signal extending over several pitch periods, a very regular curve was obtained automatically.
- The incremental placement of windows also solves another problem. For unvoiced stretches, that contain fricatives like the sound "ssss", in which the vocal cords are not excited, the windows are placed incrementally just like for voiced stretches. The pitch period length is interpolated between the lengths measured for unvoiced stretches adjacent to the voiced stretch. This provides regularly spaced windows without audible artefacts.
- The placement of windows is easy if the input audio equivalent signal is monotonous. In this case, the windows may be placed simply at fixed distances from each other. This may be effected by preprocessing the signal, so as to change its pitch to a single monotonous value. The final manipulation to obtain a desired pitch and/or duration starting can then be performed with windows at uniform spacing.
- Figure 3 shows an exemplary embodiment of an apparatus for changing the pitch and/or duration of an audible signal. The input audio equivalent signal arrives at an
input 60, and the output signal leaves at anoutput 63. The input signal is multiplied by the window function in multiplication means 61, and stored segment signal by segment signal in segment slots in storage means 62. To synthesize the output signal onoutput 63, speech samples from various segment signals are summed in summingmeans 64. The manipulation of speech signals, in terms of pitch change and/or duration manipulation, is effected by addressing the storage means 62 and selecting window function values. Accordingly, selection of storage addresses for storing the segments is controlled by window position selection means 65, which also control window function value selection means 69; selection of readout addresses is controlled by combination means 66. - In order to explain the operation of the components of the apparatus shown in Figure 3 it will be briefly recalled that signal segments S are to be derived from the input signal X (at 60), the segments being defined by
and these segments are to be superposed to produce the output signal Y (at 63):
(The sum being limited to indices i for which
At any point in time t' a signal X(t') is supplied at theinput 60, which contributes to two segments i, i+1 at respective t values ta=t'-ti and tb=t'-ti+1 (these being the only possibilities that - Figure 4 shows the multiplication means 61 and the window function value selection means 69. The respective t values ta, tb described above are multiplied by the inverse of the period length Li (determined from the period length in an invertor 74) in scaling
multipliers window function evaluators 71a, 71b (implemented for example in case of discrete arguments as a lookup table) which outputs the corresponding values of the window function, which are multiplied with the input signal in twomultipliers inputs - These segment signal values are stored in the storage means 62 in segment slots at addresses in the slots corresponding to their respective time point values ta, tb and to respective slot numbers. These addresses are controlled by window position selection means 65. Window position selection means suitable for implementing the invention are shown in Figure 5. The time point values ta, tb are addressed by
counters counters - The two counters 81, 82 are clocked at a fixed clock rate and count from an initial value loaded from a load input (L), upon a trigger signal at trigger input (T). The indexing means 84 increment the index values upon reception of this trigger signal. According to one embodiment, pitch measuring means 86 determine a pitch value from
input 60, and control the scale factor for the scalingmultipliers comparator 88. This means that successive windows are placed by incrementing the location of a previous window by the time needed by thefirst counter 81 to reach zero. - In another embodiment, a monotonized signal is applied to the input 60 (this monotonized signal being obtained by prior processing in which the pitch is adjusted to a time independent value). In this monotonized case, a constant value, corresponding to the monotonized pitch is fed as initial value to the
first counter 81. In this case the scalingmultipliers - The combination means 66 of Figure 3 are shown in Figure 10. The purpose of the output side is to superpose segments from the storage means 62 according to
The sum being limited to index values i for which -Li<t-Ti<Li+1;
in principle, any number of index values may contribute to the sum at one time point t. But when the pitch is not changed by more than a factor of 3/2, at most 3 index values will contribute at a time. By way of example, therefore, Figures 3 and 7 show an apparatus which provides for only three active indices at a time; extension to more than three segments is straightforward. - For addressing the segments, the combination means 66 are quite similar to the input side: they comprise three
counters first counter 101 is loaded into thesecond counter 102, and in thethird counter 103 the last position of thesecond counter 102 is loaded. The trigger signal is generated by acomparator 104, which detects zero crossing of thefirst counter 101. The trigger signal also updates indexing means 106. - The indexing means address the segment slot numbers which must be read out and the counters address the position within the slots. The counters and indexing means address three segments, which are output from the storage means 62 to the summing means 64 in order to produce the output signal.
- By applying desired pitch interval values at the
pitch control input 68a, one can thus control the pitch value. The duration of the speech signal is controlled by aduration control input 68b to the indexing means. Without duration manipulation, the indexing means simply produce three successive segment slot numbers. At the trigger signal, the values of the first and second output are copied to the second an third output respectively, and the first output is increased by one. When the duration is increased, the first output is kept constant once every so many cycles, as determined by theduration control input 68b. To decrease the duration, the first output is increased by two every so many cycles. The change in duration is determined by the net number of skipped or repeated indices. When the apparatus is used to change the pitch and duration of a signal independently (for example changing the pitch and keeping the duration constant), theduration input 68b should be controlled to give a net frequency F at which indices should be skipped or repeated according to
(D being the factor by which the duration is changed, t being the pitch period length of the input signal and T being the period length of the output signal; a negative value of F corresponds to skipping of indices, a positive value corresponds to repetition). - Figure 3 only provides one embodiment by way of example. The principal point is the incremental placement of windows at the input side with a phase determined from the phase of a previous window. There are many ways of generating the addresses for the storage means 62, of which Figure 5 is but one. For example, the addresses may be generated using a computer program, and the starting addresses need not have the values given in the example.
- Figure 3 can be implemented in various ways, for example using digital samples at
input 60, where the sampling rate has at any convenient value, for example 10000 samples per second; conversely, it may use continuous signal techniques, where theclocks
Claims (8)
- A method for manipulating an audio equivalent signal, comprising positioning of a chain of mutually overlapping time windows with respect to the audio equivalent signal, as based on periodicity measurements on said audio equivalent signal, and wherein a positional displacement between adjacent windows substantially corresponds to a principal period of said periodicity, and synthesizing an audio output signal by chained superposition of segment signals, each deriving from the audio equivalent signal through weighting with the associated window function, characterized by manipulating a duration of said output signal through systematically repeating, maintaining, and/or suppressing said segment signals, to a resulting predetermined overall length that differs from a corresponding duration of said audio equivalent signal.
- A method as claimed in Claim 1, wherein said predetermined length applies to a plurality of speech equivalent signals in parallel that correspond in content but have differences in representation.
- A method as claimed in Claim 2 wherein said differences originate from said plurality of audio equivalent signals being in as many different languages.
- A method as claimed in Claim 1, 2 or 3, wherein said predetermined length pertains to an intermission between non-manipulated audio equivalent signals.
- A method as claimed in any of Claims 1 to 4 for post-synchronizing human speech as featured by a video representable item.
- A method as claimed in any of Claims 1 to 5, wherein said windows are shifted with respect to a previous window in said sequence over an actual pitch period length of said audio equivalent signal.
- A unitary storage medium comprising audio equivalent signals generated according to the method as claimed in any of Claims 1 to 6.
- An apparatus for manipulating an audio equivalent signal according to a method as claimed in any of Claims 1 to 6.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP19920202374 EP0527529B1 (en) | 1991-08-09 | 1992-07-31 | Method and apparatus for manipulating duration of a physical audio signal, and a storage medium containing a representation of such physical audio signal |
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP91202044 | 1991-08-09 | ||
EP91202044 | 1991-08-09 | ||
EP92200521 | 1992-02-24 | ||
EP92200521 | 1992-02-24 | ||
EP19920202374 EP0527529B1 (en) | 1991-08-09 | 1992-07-31 | Method and apparatus for manipulating duration of a physical audio signal, and a storage medium containing a representation of such physical audio signal |
Publications (3)
Publication Number | Publication Date |
---|---|
EP0527529A2 true EP0527529A2 (en) | 1993-02-17 |
EP0527529A3 EP0527529A3 (en) | 1993-05-05 |
EP0527529B1 EP0527529B1 (en) | 2000-07-19 |
Family
ID=27234119
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP19920202374 Expired - Lifetime EP0527529B1 (en) | 1991-08-09 | 1992-07-31 | Method and apparatus for manipulating duration of a physical audio signal, and a storage medium containing a representation of such physical audio signal |
Country Status (1)
Country | Link |
---|---|
EP (1) | EP0527529B1 (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1999033050A2 (en) * | 1997-12-19 | 1999-07-01 | Koninklijke Philips Electronics N.V. | Removing periodicity from a lengthened audio signal |
US6453283B1 (en) | 1998-05-11 | 2002-09-17 | Koninklijke Philips Electronics N.V. | Speech coding based on determining a noise contribution from a phase change |
US6885986B1 (en) | 1998-05-11 | 2005-04-26 | Koninklijke Philips Electronics N.V. | Refinement of pitch detection |
EP1628288A1 (en) * | 2004-08-19 | 2006-02-22 | Vrije Universiteit Brussel | Method and system for sound synthesis |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1983003483A1 (en) * | 1982-03-23 | 1983-10-13 | Phillip Jeffrey Bloom | Method and apparatus for use in processing signals |
US4596032A (en) * | 1981-12-14 | 1986-06-17 | Canon Kabushiki Kaisha | Electronic equipment with time-based correction means that maintains the frequency of the corrected signal substantially unchanged |
WO1990003027A1 (en) * | 1988-09-02 | 1990-03-22 | ETAT FRANÇAIS, représenté par LE MINISTRE DES POSTES, TELECOMMUNICATIONS ET DE L'ESPACE, CENTRE NATIONAL D'ETUDES DES TELECOMMUNICATIONS | Process and device for speech synthesis by addition/overlapping of waveforms |
EP0372155A2 (en) * | 1988-12-09 | 1990-06-13 | John J. Karamon | Method and system for synchronization of an auxiliary sound source which may contain multiple language channels to motion picture film, video tape, or other picture source containing a sound track |
-
1992
- 1992-07-31 EP EP19920202374 patent/EP0527529B1/en not_active Expired - Lifetime
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4596032A (en) * | 1981-12-14 | 1986-06-17 | Canon Kabushiki Kaisha | Electronic equipment with time-based correction means that maintains the frequency of the corrected signal substantially unchanged |
WO1983003483A1 (en) * | 1982-03-23 | 1983-10-13 | Phillip Jeffrey Bloom | Method and apparatus for use in processing signals |
WO1990003027A1 (en) * | 1988-09-02 | 1990-03-22 | ETAT FRANÇAIS, représenté par LE MINISTRE DES POSTES, TELECOMMUNICATIONS ET DE L'ESPACE, CENTRE NATIONAL D'ETUDES DES TELECOMMUNICATIONS | Process and device for speech synthesis by addition/overlapping of waveforms |
EP0372155A2 (en) * | 1988-12-09 | 1990-06-13 | John J. Karamon | Method and system for synchronization of an auxiliary sound source which may contain multiple language channels to motion picture film, video tape, or other picture source containing a sound track |
Non-Patent Citations (1)
Title |
---|
JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA vol. 63, no. 2, February 1978, NEW YORK US pages 624 - 625 NEUBURG 'Simple pitch dependent algorithm for high quality speech rate changing' * |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1999033050A2 (en) * | 1997-12-19 | 1999-07-01 | Koninklijke Philips Electronics N.V. | Removing periodicity from a lengthened audio signal |
WO1999033050A3 (en) * | 1997-12-19 | 1999-09-10 | Koninkl Philips Electronics Nv | Removing periodicity from a lengthened audio signal |
US6208960B1 (en) | 1997-12-19 | 2001-03-27 | U.S. Philips Corporation | Removing periodicity from a lengthened audio signal |
US6453283B1 (en) | 1998-05-11 | 2002-09-17 | Koninklijke Philips Electronics N.V. | Speech coding based on determining a noise contribution from a phase change |
US6885986B1 (en) | 1998-05-11 | 2005-04-26 | Koninklijke Philips Electronics N.V. | Refinement of pitch detection |
EP1628288A1 (en) * | 2004-08-19 | 2006-02-22 | Vrije Universiteit Brussel | Method and system for sound synthesis |
WO2006017916A1 (en) * | 2004-08-19 | 2006-02-23 | Vrije Universiteit Brussel | Method and system for sound synthesis |
Also Published As
Publication number | Publication date |
---|---|
EP0527529B1 (en) | 2000-07-19 |
EP0527529A3 (en) | 1993-05-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US5611002A (en) | Method and apparatus for manipulating an input signal to form an output signal having a different length | |
US5479564A (en) | Method and apparatus for manipulating pitch and/or duration of a signal | |
EP1308928B1 (en) | System and method for speech synthesis using a smoothing filter | |
US4384169A (en) | Method and apparatus for speech synthesizing | |
EP0030390B1 (en) | Sound synthesizer | |
EP0164677B1 (en) | Speech synthesis system | |
EP0527529A2 (en) | Method and apparatus for manipulating duration of a physical audio signal, and a storage medium containing a representation of such physical audio signal | |
US7457752B2 (en) | Method and apparatus for controlling the operation of an emotion synthesizing device | |
JP3728173B2 (en) | Speech synthesis method, apparatus and storage medium | |
US4092495A (en) | Speech synthesizing apparatus | |
US4354056A (en) | Method and apparatus for speech synthesis filter excitation | |
Lukaszewicz et al. | Microphonemic method of speech synthesis | |
JP2785628B2 (en) | Pitch pattern generator | |
Rodet | Sound analysis, processing and synthesis tools for music research and production | |
EP1256933B1 (en) | Method and apparatus for controlling the operation of an emotion synthesising device | |
Nebbia et al. | Eight-channel digital speech synthesizer based on LPC techniques | |
JP2001100777A (en) | Method and device for voice synthesis | |
Wiggins | An integrated circuit for speech synthesis | |
JP2573587B2 (en) | Pitch pattern generator | |
Tychtl | Phase-mismatch-free and data efficient approach to natural sounding harmonic concatenative speech synthesis | |
JPH056191A (en) | Voice synthesizing device | |
Lukaszewicz et al. | Microphonemics–High Quality Speech Synthesis by Waveform Concatenation | |
Weenink | STEVIN Can Praat. | |
Yaohua et al. | The study of prosodic adjustment in Chinese speech synthesis | |
Hill | Gnuspeech Monet Manual 0.9 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): DE FR GB IT |
|
PUAL | Search report despatched |
Free format text: ORIGINAL CODE: 0009013 |
|
AK | Designated contracting states |
Kind code of ref document: A3 Designated state(s): DE FR GB IT |
|
17P | Request for examination filed |
Effective date: 19931026 |
|
17Q | First examination report despatched |
Effective date: 19970221 |
|
RAP3 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: KONINKLIJKE PHILIPS ELECTRONICS N.V. |
|
GRAG | Despatch of communication of intention to grant |
Free format text: ORIGINAL CODE: EPIDOS AGRA |
|
GRAG | Despatch of communication of intention to grant |
Free format text: ORIGINAL CODE: EPIDOS AGRA |
|
GRAH | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOS IGRA |
|
RIC1 | Information provided on ipc code assigned before grant |
Free format text: 7G 10L 21/04 A |
|
GRAH | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOS IGRA |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): DE FR GB IT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT;WARNING: LAPSES OF ITALIAN PATENTS WITH EFFECTIVE DATE BEFORE 2007 MAY HAVE OCCURRED AT ANY TIME BEFORE 2007. THE CORRECT EFFECTIVE DATE MAY BE DIFFERENT FROM THE ONE RECORDED. Effective date: 20000719 |
|
REF | Corresponds to: |
Ref document number: 69231266 Country of ref document: DE Date of ref document: 20000824 |
|
ET | Fr: translation filed | ||
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed | ||
REG | Reference to a national code |
Ref country code: GB Ref legal event code: IF02 |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: 732E |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20031224 Year of fee payment: 12 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20031231 Year of fee payment: 12 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20040115 Year of fee payment: 12 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: TP |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20040731 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20050201 |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20040731 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20050331 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: ST |