FR2818479A1 - METHOD AND SYSTEM FOR VOICE PROCESSING OF A SUCCESS OF PHONEMAS - Google Patents

Abstract

The invention concerns a method and a system for voice processing comprising means for detecting pauses in a series of phonemes, means for selecting interesting pauses, and means for increasing duration of interesting pauses.

Description

<Desc / Clms Page number 1>

Method and system for vocal processing of a sequence of phonemes.

 The present invention relates to the field of vocal processing of sounds, in particular of phonemes, in order to facilitate comprehension by a listener.

 The invention applies in telephone networks, and in local or remote communications networks.

 The frequency spectrum useful in a voice conversation between two people, necessary for good perception, ranges from 250 to 4000 Hz. People with hearing loss causing hearing loss greater than or equal to 92 dB are considered deaf . A loss between 70 and 90 dB leads to a deficiency considered to be significant. Hearing losses between 50 and 60 dB are considered moderate, even if they can cause discomfort and discomfort during direct or telephone conversations. Hearing loss is sometimes identified only by a general drop in level across the spectrum. In many cases, the level of loss is greater on certain frequencies or frequency zones.

 Hearing impaired people wishing to speak by telephone must currently make their disability known and succeed in making their interlocutors understand that they must speak slowly and with a loud voice.

 The invention provides inexpensive voice processing, which is simple to implement for users and which facilitates telephone conversations with at least one hearing impaired person.

 The invention proposes to make accessible by the network

<Desc / Clms Page number 2>

 telephone correction service that does not distort the voice frequency of the callers.

 The invention also applies to correct a telephone conversation when it is necessary to converse with an interlocutor practicing a foreign language which one does not master perfectly.

 The voice processing method, according to one aspect of the invention, is carried out by slowing down. We detect pauses in a sequence of phonemes, we select interesting pauses, and we extend the durations of interesting pauses.

 Preferably, the interesting breaks are selected according to a duration criterion.

 In one embodiment of the invention, the duration of the interesting breaks is greater than a threshold. The threshold can be between 50 and 200 ms, preferably between 80 and 150 ms, better still on the order of 100 ms. Preferably, the threshold is adjustable.

 In one embodiment of the invention, the threshold is adjusted as a function of the number of words recognized in a series of phonemes.

 In one embodiment of the invention, if the number of recognized words is considered to be too low, said threshold is reduced.

 In one embodiment of the invention, word recognition is carried out by comparing a consecutive set of phonemes between two interesting pauses with a list of words stored in a database.

 In one embodiment of the invention, the durations of the interesting breaks are extended by a value determined by a user, or by a constant value.

 In one embodiment of the invention, the durations of the interesting pauses are widened by a value depending on the bit rate of the sequence of phonemes.

 Preferably, said voice processing is applied, in a telephone conversation, at the request of one of the interlocutors to any series of phonemes to be received by said interlocutor.

 Said request is made with each call given or received by said interlocutor.

<Desc / Clms Page number 3>

 Said request is made on each call given or received from a determined telephone set, while retaining the possibility of deactivating said voice processing.

 The processing applies, in particular, to telephone conversations and messages recorded on answering machine or voicemail.

 The voice processing system, according to one aspect of the invention, comprises a means of detecting pauses in a sequence of phonemes, a means of selecting interesting pauses, and a means of enlarging the durations of interesting pauses.

 In one embodiment of the invention, the means for detecting breaks, selecting interesting breaks and widening are part of a device connected to a telephone network.

 In one embodiment of the invention, the system comprises a plurality of self-routing centers each connected to a plurality of telephone sets, each self-routing center being able to divert a series of phonemes to the detection means breaks, selection of interesting breaks and enlargement.

 The invention also relates to a computer program comprising program code means for implementing the steps of the method, when said program is running on a computer.

 The invention also relates to a medium capable of being read by a device for reading program code means which are stored therein and which are suitable for carrying out the steps of the method, when said program is running on a computer.

 Thanks to the invention, the speed of speech of a first interlocutor is slowed down so that at least one other interlocutor can more easily understand the first interlocutor. It significantly improves hearing comfort. Hearing impaired people can have a conversation over a telecommunications network or can use voice services without difficulty.

<Desc / Clms Page number 4>

 The method can be implemented by a network device accessible by the hearing impaired. They can access the service implementing the process by dialing before or during communication on their telephone handset or terminal a code, for example composed of the R key often present followed by a number. The speech of their interlocutor is then filtered, to be rid of parasitic noises, then analyzed in order to be able to be slowed down. The subscriber of the service can then adapt the speech to his listening ability by pressing a key on the handset keyboard to more or less significantly slow down the speech.

The conversation is slowed down and an insertion of a waiting message makes it possible to warn the interlocutor not suffering from hearing impairment and having a normal speech rate.

 The rate of speech varies greatly from one speaker to another. We can consider that a normal flow is of the order of 9 syllables / second, but can go from 6 to 12 syllables / second. The duration of syntactic or style breaks and punctuation breaks, breathing breaks or those associated with punctuation marks, is also variable. Overall, the number of pauses decreases as the speaking speed increases. However, this variation is not regular but depends on the type of breaks. The number of pauses linked, for example to a clear interruption, is relatively constant regardless of the speed of speech. A decrease in the number of pauses linked to commas appears going from the slow rhythm to the fast rhythm.

This decrease is even more pronounced for syntactic pauses not linked to punctuation marks.

 For example, a pause linked to a clear interruption, such as the point marking the end of a sentence, is generally of the order of 100 ms. The duration of a comma-related pause generally varies between 100 and 200 ms, while the duration of a syntactic pause can vary between 30 and 300 ms.

 It is therefore planned to set a duration threshold making it possible to distinguish between the types of breaks and to determine at least approximately the breaks that have the greatest probability of being related to punctuation or breathing pauses. The breaks

<Desc / Clms Page number 5>

 syntactics essential for the understanding of the sentence will thus be more rarely affected by the slowdown.

 In general, a series of phonemes intended for a person who has chosen to slow down the reception rate, whether it comes from a speaker during a conversation, or from a recording made beforehand, begins with a filtering phase parasites. A phase of increasing the emission level is then implemented, followed by a phase of widening the breaks, in particular breathing or punctuation breaks.

 We could also consider slowing down the speaking phases. However, there is a risk of modifying the vocal frequency of the sequence of phonemes in a significant and annoying manner. We could then consider correcting the frequency of the phoneme sequence phases in order to be as close as possible to the operating frequency.

This correction automatically introduces new syntactic breaks or weakenings.

- le client A prend la communication et indique à son correspondant qu'il souhaite utiliser le service de ralentissement ; - il appuie sur la touche R du clavier du combiné téléphonique et compose le numéro de téléphone permettant d'activer le ralentissement (en variante, il peut attendre la tonalité après l'appui sur la touche R) ; - le correspondant B est alors averti de la mise en oeuvre du ralentissement ;

- la communication du correspondant B vers le client A est alors traitée de telle façon que le procédé de ralentissement adapte les caractéristiques des suites de phonèmes du correspondant B aux capacités auditives du client A ; - lorsque le client A souhaite élargir les intervalles entre les mots, il peut appuyer sur une touche du clavier, par exemple la touche In the case of a telephone network, the method can be implemented by a system linked to the network and operating as follows: - client A receives a call and wishes to use the slowdown service;

- customer A takes the call and indicates to his correspondent that he wishes to use the slowdown service; - he presses the R key on the telephone handset keypad and dials the telephone number to activate the deceleration (alternatively, he can wait for the dial tone after pressing the R key); - correspondent B is then informed of the implementation of the slowdown;

the communication from correspondent B to client A is then processed in such a way that the deceleration process adapts the characteristics of the sequences of phonemes of correspondent B to the hearing abilities of client A; - when client A wishes to widen the intervals between words, he can press a key on the keyboard, for example the key

<Desc / Clms Page number 6>

 +, and when he wishes to decrease them, he can press another key, for example the - key.

In the case of a telephone network, if customer A is a subscriber to the service, the method can be implemented by a system linked to the network and operating as follows:
If subscriber A is not at home, he can easily use the service if he is the caller: - Client A dials the number of the slowdown network service and is identified as a subscriber.

- The service's vocal server asks him to dial the number of his correspondent B.

- Communication is established, conversation B to A is processed and slowed down.

If subscriber A is not at home and is called: - Client A receives a call from client B.

- Client A uses the inquiry call function and calls the slowdown service by pressing the R key and dialing a number.

 - He is put in contact with the service.

 - He orders the transfer of the call from client B to the slowdown service.

 - He hangs up.

 - The slowdown service calls him back and puts him in communication with customer B.

- la figure 2 est un organigramme des étapes du procédé de ralentissement ; - la figure 3 est un organigramme détaillé de l'étape de ralentissement proprement dite ; et - la figure 4 est une variante de la figure 3. The present invention will be better understood and other advantages will appear on reading the detailed description of an embodiment taken by way of nonlimiting example and illustrated by the appended drawings, in which: - Figure 1 is a view schematic of a telephone network equipped with a slowdown system;

- Figure 2 is a flow diagram of the steps of the deceleration process; - Figure 3 is a detailed flowchart of the actual deceleration step; and - Figure 4 is a variant of Figure 3.

<Desc / Clms Page number 7>

 As can be seen in FIG. 1, an interlocutor 1 is equipped with a telephone set 2 which can be of private or public type, for example with a means of payment such as a coin mechanism or a credit card reader. The telephone set 2 is connected to a self-routing center 3, for example a PABX.

 Similarly, the user 4 has at his disposal a telephone set 5 connected to another self-routing center 6.

A deceleration system 7 is able to establish communications with the centers with routing autonomy 3 and 6. Each center with routing autonomy 3.6 is provided, for this purpose, with an interface 8, 9. Of course, the centers with autonomous routing 3.6 are capable of passing communications through the conventional telephone network 10, digital or analog. Optionally, provision can be made for the autonomous routing centers 3 and 6 to be able to establish communications via another network 11, for example the Internet network, or even an Intranet or other network.

 As can be seen in FIG. 2, the slowdown treatment method comprises a step 12 of filtering out noise, followed by an amplification step 13, followed by a slowdown step 14 which will be explained in more detail with reference to FIG. 3 and, followed by a step 15 of restitution of the audio signal. The filtering and amplification characteristics can be adjusted automatically and / or by the user.

 More precisely and as can be seen in FIG. 3, step 14 is broken down into a step 16 called "dated phonetic analysis", which consists in separating the input audio signal into a list of dated phonemes. A phoneme can be identified by a serial number, a start date and an end date which can be expressed to the nearest millisecond. Each phoneme is a sound unit relevant to communication and capable of producing a difference in communication.

 The list of dated phonemes is then treated during sub-step 17 of separation into phonetic chains. A detection is carried out aimed at identifying the pauses characterized by a duration between two consecutive phonemes greater than a threshold T. We separate the

<Desc / Clms Page number 8>

 list of phonemes in chains of phonemes which can be assimilated to words which are then processed during the recognition step 18 during which the supposed words are compared with known words which can be stored in a database.

For reasons of economy, provision may be made to store only a limited number of words, for example the words most commonly used in a conversation. The objective is not to recognize all the words, but a sufficient number which can be defined by experimentation to confirm or vary the interval
Ts between two words.

 If two words are recognized in a chain of phonemes, the threshold Ts is too high because it means that the pause between these two words is of duration less than Ts and has not been taken into account.

We can then decrease Ts by a fixed duration or by a percentage. We can also measure an update time Tc from dated phonemes. The duration is determined according to the duration of a pause between two words or according to an average of duration of inter-word pauses. The value Tc which is used to update the threshold Ts used in step 17 of separation into phonetic chains is transmitted. If no word is recognized, we try to work on the sum of the previous phoneme chain added to the current phoneme chain to check if we are not cutting the signal too much. In this case, the value of the threshold Ts can be increased during an update.

 If the rate of recognized words is considered to be insufficient after comparison with a number of words per minute arbitrarily fixed after experimentation, the threshold Ts can be gradually reduced to a default value. If the threshold Ts being placed at the default value, the rate of recognized words remains insufficient, the threshold Ts is gradually increased until an acceptable number of recognized words is reached. To improve the quality of service, provision may be made during the implementation of the service by the users that the number of stored words forming a sort of dictionary is optimized with the type of conversation practiced by the user.

 Finally, during step 19, from the input audio signal and the threshold Tu, the pauses above the threshold Ts are detected and they are

<Desc / Clms Page number 9>

allonge en fonction d'une grandeur AI déterminée par l'utilisateur, par exemple au moyen de touches de son combiné téléphonique. A l'issue de l'étape 19, on envoie le signal audio ralenti à l'étape de restitution 15 illustrée sur la figure 2.

extension as a function of a quantity AI determined by the user, for example by means of keys on his telephone handset. At the end of step 19, the slowed down audio signal is sent to the restitution step 15 illustrated in FIG. 2.

 Optionally, in order to increase the quality and the listening comfort, one can provide a step 20 which, from step 16 of dated phonetic analysis, measures the number of syllables per second. When the rate of syllables of a chain of phonemes becomes greater than a predetermined value, for example 9 syllables / second, a correction quantity A2 is transmitted for taking into account during step 19 for voice adaptation. When the syllable flow is slow or normal, A2 is zero. When the syllable rate becomes high, the pauses greater than Ts can be lengthened during step 19, by the sum AI + A2. Step 20 of syllable detection can be implemented either from the sequence of phonemes from step 16, or from words recognized during step 18.

 Such a method makes it possible to offer several modes of implementation, for example a static mode where it is planned to keep a fixed threshold Ts or a controlled mode where the threshold Ts changes from an initial value Ti, as a function of the speaking speed of user 2 addressed to user 1. All pauses above the threshold Ts are extended by a value A, or by a value AI + A2, or even by the only value A2.

 It is understood that if the threshold Ts is at an adapted value, a chain will generally correspond to a word, while if it takes a value too high, a chain will include several words, and if it takes a value too low, a chain will only be made up of part of a word.

 More particularly, in the case of a communication between a user 1 who is hard of hearing and a user 4 of normal hearing, it can be provided that the transmission between user 1 and user 4 takes place in a normal manner, for example by the network 10. Communication between user 4 and user 1 takes place via the self-service center 6, interface 9, system 7, interface 8, center at autonomy

<Desc / Clms Page number 10>

 routing 3, the communication being slowed down by increasing certain breaks by means of the system 7.

 In the case of communication between two hearing-impaired users 1 and 4, provision can be made for communication in both directions to be carried out by means of the system 7, more precisely by means of the self-routing center 6 , of interface 9, of system 7, of interface 8, of the self-routing center 3, from user 4 to user 1, and of the self-routing center 3, of interface 8, of the system 7, of the interface 9, of the self-routing center 6, from user 1 to user 4, the two-way communication being slowed down by increasing some breaks using the system 7.

 As a variant, it can be provided that the system 7 receiving a communication to be slowed down coming from the interface 8 of the self-routing center 3, performs the slowdown processing and returns the slowed down communication to the interface 8, the center at routing autonomy 3 establishing a normal connection to the routing autonomy center 6. However, the transmission time may be slightly increased.

Claims (13)

 1. Method of vocal processing by slowing down, in which we detect pauses in a sequence of phonemes, we select interesting pauses, we extend the durations of interesting pauses.  2. Method according to claim 1, in which the interesting breaks are selected according to a duration criterion.  3. The method of claim 2, wherein the duration of interesting breaks is greater than a threshold.  4. The method of claim 3, wherein the threshold is adjustable.  5. Method according to claim 4, in which the threshold is adjusted as a function of the number of words recognized in a sequence of phonemes.  6. The method of claim 5, wherein if the number of recognized words is considered to be too low, said threshold is reduced.  7. Method according to claim 5 or 6, in which the word recognition is carried out by comparison of a consecutive set of phonemes between two interesting pauses with a list of words stored in a database.  8. Method according to any one of the preceding claims, in which the durations of the interesting breaks are extended by a value determined by a user, or by a constant value.  9. Method according to any one of the preceding claims, in which the durations of the interesting pauses are widened by a value depending on the bit rate of the sequence of phonemes.  10. Method according to any one of the preceding claims, in which said voice processing is applied, in a telephone conversation, at the request of one of the interlocutors to any series of phonemes to be received by said interlocutor.  11. Voice processing system (7), characterized in that it comprises a means for detecting pauses in a series of phonemes, a means for selecting interesting pauses, and a <Desc / Clms Page number 12>  means of extending the durations of interesting breaks.  12. System according to claim 11, characterized in that the means for detecting breaks, selecting interesting breaks and widening are part of a device connected to a telephone network.  13. The system as claimed in claim 11, characterized in that it comprises a plurality of self-routing centers each connected to a plurality of telephone sets, each self-routing center being capable of routing a series of phonemes to the means of detecting breaks, selecting interesting breaks and widening.