Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04B—TRANSMISSION
  • H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
  • H04B1/06—Receivers
  • H04B1/08—Constructional details, e.g. cabinet
  • H04B1/082—Constructional details, e.g. cabinet to be used in vehicles
• • G—PHYSICS
  • G10—MUSICAL INSTRUMENTS; ACOUSTICS
  • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
  • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
  • G10L25/27—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the analysis technique
  • G10L25/30—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the analysis technique using neural networks
• • G—PHYSICS
  • G10—MUSICAL INSTRUMENTS; ACOUSTICS
  • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
  • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
  • G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
  • G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
• • G—PHYSICS
  • G10—MUSICAL INSTRUMENTS; ACOUSTICS
  • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
  • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
  • G10L25/03—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters
  • G10L25/21—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters the extracted parameters being power information

Definitions

• the invention relates to a method and a device for processing an audio signal, in particular an audio signal from a radio receiver of a vehicle.
• the invention also relates to a method and a device for classifying the noise level of an audio signal.
• Contemporary vehicles are generally equipped with radio reception systems, for the entertainment or information of the driver and / or his passengers, for the reception of service information (for example information relating to road traffic) and / or for communication of the vehicle with fixed equipment (eg antennas or roadside units) or mobile (eg other vehicles).
• service information for example information relating to road traffic
• fixed equipment eg antennas or roadside units
• mobile eg other vehicles
• radiofrequency signals emitted by surrounding sources these signals carrying information intended to be received and decoded by the vehicle.
• These signals correspond, for example, to radio signals of the FM type (standing for “Frequency Modulation” in English or in French for “Frequency Modulation”) which are then converted into audio signals to be transmitted to one or more loudspeakers fitted to the vehicle. , which make an audio signal perceptible by the driver and / or passengers of the vehicle.
• the performance of these systems depends on many factors, such as the intrinsic quality of the components of these systems, the arrangement of the components in the vehicle, the cog speed of the vehicle, the environment of use (e.g. example urban or peri-urban environment, mountain area), etc.
• the environment of use e.g. example urban or peri-urban environment, mountain area
• EP 1093245 discloses a method for testing the quality of the components of a vehicle radio reception system. This process is based on the use of two vehicles, each comprising a system to be tested and its own recording device. Both vehicles travel on the same road and acquire signals as they travel. The signals are compared to determine the performance level of the system under test.
• Such an approach like the known test approaches to test the performance of a radio reception system in a prototype vehicle, involves multiple operators or testers. These people sit in several vehicles, listen to, analyze and compare the quality of the audio signals received in a vehicle under test with the quality of a signal received in a reference vehicle which is traveling at the same time on the same stretch of road. The performance of the system is then established on the basis of the subjective perceptions of the testers in the test vehicle, these performances being evaluated and compared in real time with the subjective perceptions of the testers in the reference vehicle.
• tests are only carried out in real time. No recording of the tested signals is made. Therefore, the tests are not reproducible. They are not performed only once. If they are repeated, for example after having modified the implantation of a particular component of the reception chain in the vehicle, there is no guarantee that the same test conditions can be reproduced to assess the improvement of the situation. with relevance and objectivity.
• An object of the present invention is to improve the evaluation of the quality of an audio signal.
• the invention relates to a method for processing an audio signal, the method being implemented in a device for processing an audio signal implementing a neural network, the method comprising the following steps:
• an operation of random deactivation of a part of the neurons of the network is associated with the first operation of “pooling” with a probability of 0.3
• an operation of random deactivation of a part of the neurons of the network is associated with the second “pooling” operation with a probability of 0.1
• a random deactivation operation of part of the neurons of said network is associated with the third “pooling” operation with a probability of 0.2.
• the determined number of values of said input vector is equal to 16000.
• the audio signal is obtained by converting a radiofrequency signal by a tuner of a vehicle.
• the size of the input vector is equal to 1x16000
• the size of the first matrix is equal to 1x15994x100
• the size of the second matrix is equal to 1x15988x100
• the size of the third matrix is equal to 1x5329x100
• the size of the fourth matrix is 1x5323x1208
• the size of the fifth matrix is 1x1774x1208
• the size of the sixth matrix is 1x1768x1208
• the size of the output vector is 1x1x128.
• the number of output neurons is equal to 6.
• the method further comprises a step of processing the audio signal as a function of the class representative of a noise level associated with the signal in order to at least partially correct the noise.
• the method further comprises a step of learning the values included in the convolution filters.
• the invention relates to a device for processing an audio signal, the device comprising a memory associated with a processor configured for implementing the steps of the method according to the first aspect of the invention.
• the invention relates to a computer program which comprises instructions adapted for the execution of the steps of the method according to the first aspect of the invention, this in particular when the computer program is executed by at least one. processor.
• Such a computer program can use any programming language, and be in the form of a source code, an object code, or an intermediate code between a source code and an object code, such as in a partially compiled form, or in any other desirable form.
• the invention relates to a recording medium readable by a computer on which is recorded a computer program comprising instructions for carrying out the steps of the method according to the first aspect of the invention.
• the recording medium can be any entity or device capable of storing the program.
• the medium may comprise a storage means, such as a ROM memory, a CD-ROM or a ROM memory of the microelectronic circuit type, or else a magnetic recording means or a hard disk.
• this recording medium can also be a transmissible medium such as an electrical or optical signal, such a signal being able to be conveyed via an electrical or optical cable, by conventional or hertzian radio or by self-directed laser beam. or by other means.
• the computer program according to the invention can in particular be downloaded from an Internet type network.
• the recording medium can be an integrated circuit in which the computer program is incorporated, the integrated circuit being adapted to execute or to be used in the execution of the method in question.
• FIG. 1 schematically illustrates a system for evaluating the quality of an audio signal received by a vehicle, according to a particular embodiment of the present invention
• FIG. 2 schematically illustrates the audio signal of FIG. 1, according to a particular embodiment of the present invention
• FIG. 3 illustrates a flowchart of the different steps of a method for processing the audio signal of FIG. 2, according to a particular embodiment of the present invention.
• FIG. 4 schematically illustrates a device for processing the audio signal of FIG. 2, according to a particular embodiment of the present invention.
• a method for processing an audio signal implemented in a neural network comprises receiving a vector at the input of the processing device, the vector comprising a number determined of values each representing the amplitude of a sample of the processed or evaluated audio signal.
• the audio signal is for example sampled so as to obtain 16,000 samples with for each of these samples a value representative of the amplitude of the signal.
• a first matrix is obtained by applying 100 first convolution filters of size 1x7 with a step (from the English “stride”) of 1 to the input vector.
• the size of the first matrix is for example 1x15994x100.
• a second matrix is obtained by applying 100 second convolution filters of size 1x7 with a step of 1 to the first matrix.
• the size of the second matrix is for example 1x15988x100.
• a third matrix is obtained by applying a first so-called “pooling” operation without overlap with a filter of size 1x3 to the second matrix.
• the first “pooling” operation advantageously corresponds to a so-called “maximum pooling” operation for which the maximum value of each sub-matrix obtained by applying the filter to the second matrix is retained.
• the size of the third matrix is for example 1x5329x100.
• a fourth matrix is obtained by applying 128 third convolutional filters of size 1x7 with a step of 1 to the third matrix.
• the size of the fourth matrix is for example 1x5323x128.
• a fifth matrix is obtained by applying a second operation called “maximum pooling” without overlap with a filter of size 1x3 to the fourth matrix.
• the size of the fifth matrix is equal for example 1x1774x128.
• a sixth matrix is obtained by applying 128 third convolutional filters of size 1x7 with a step of 1 to the fifth matrix.
• the size of the sixth matrix is 1xNx128, for example equal to 1x1768x128.
• an output vector is obtained by applying a third operation called “average pooling” without overlap with a filter of size 1xN to the sixth matrix.
• the size of the output vector is for example 1x1x128.
• the input audio signal is classified, that is, a class (also called a label) is associated with the audio signal by applying the output vector to a layer of densely connected neurons, this layer having at output a number of neurons less than 10 (for example equal to 6), each output neuron corresponding to a class representative of a different noise level.
• a class also called a label
• Such a method makes it possible to test the quality of an audio signal by determining to which noise level class the audio signal belongs, without human intervention. Furthermore, the use of such a method allows the system to learn as the audio signals to be classified are processed, which allows the classification results to be refined. Furthermore, the evaluation of the quality of the audio signal is all the more relevant as the analysis is carried out on the sampled audio signal as a whole, and not on certain fragmented and / or random characteristics of the signal.
• the data from the various operations implemented in the invention are represented in the form of a vector, matrix or tensor.
• the sizes (or dimensions) of each of the vectors or matrices will be provided in the format corresponding to the size or dimension of a tensor, i.e. with three dimensions AxBxC, where A , B and C correspond to the numbers of rows, columns and channels.
• a vector is a tensor for which 2 of the 3 dimensions are equal to 1 and a matrix is a tensor for which 1 of the 3 dimensions is equal to 1.
• FIG. 1 schematically illustrates a system for evaluating the quality of an audio signal, according to a particular and non-limiting exemplary embodiment of the present invention.
• the system 1 comprises a vehicle 103, for example a motor vehicle, receiving a radiofrequency signal 102 via one or more onboard antennas in or on the vehicle 103.
• the radiofrequency signal corresponds for example to an FM-type radio signal carrying the data of the signal. audio to analyze, evaluate or test.
• the signal 102 is for example transmitted via one or more transmitting antennas 101.
• a tuner 104 on board the vehicle 103 receives the radiofrequency signal 102 via the receiving antenna on board the vehicle and converts it into an audio signal. .
• VS audio signal is then transmitted to one or more speakers of the vehicle 103 for a reproduction or a rendering of this audio signal perceptible by the driver and / or the passengers of the vehicle 103 in the form of sound waves.
• the audio signal obtained from the tuner 104, or part of this signal (for example 1 second or a few seconds of this signal), is for example transmitted directly to a device or a processing unit 106 configured to implement the processing method of the audio signal of the invention with a view to evaluating this audio signal, that is to say with a view to obtaining one or more pieces of information representative of the quality of the audio signal.
• the audio signal obtained from the tuner 104 (or part of this signal) is recorded, that is to say stored in a data storage device (for example a memory) 105 before being transmitted to the. processing device 106.
• the storage of the audio signal makes it possible for example to repeat the evaluation of the signal, for example to compare the latter with a processed or corrected version of this recorded signal.
• the recording of the signal also allows a subsequent processing of this signal, for example in a test laboratory, which avoids the need to embark the processing unit 106 in the vehicle 103 to carry out the tests and which makes it possible to carry out the test. all the tests in a controlled environment, away from the noise of the road environment in which the vehicle 103 operates, for example.
• the recording of the signal (or of several signals) also makes it possible to carry out one or more processing operations of this signal before implementing the evaluation of the audio signal.
• FIG. 2 illustrates a diagram 2 representing the audio signal 20 to be evaluated, according to a particular and non-limiting embodiment of the present invention.
• Diagram 2 represents an evolution of the amplitude of an audio signal 20 received from the tuner 104 as a function of time.
• the time is represented on the abscissa and the amplitude of signal 20 is represented on the ordinate.
• the amplitude of signal 20 is normalized between a minimum value and a maximum value, for example between -5 and 5, -2 and 2, -1 and 1.
• the audio signal 20 evaluated by example a duration of 1 second.
• the duration of signal 20 is a few seconds, for example between 2 and 8 seconds, for example equal to 5 seconds.
• the audio signal 20 is advantageously sampled before being processed or classified according to the method described with reference to FIG. 3.
• the audio signal 20 is for example sampled at a frequency of 16 kHz, which makes it possible to obtain 16,000 samples of the signal. 20 when the latter has a duration of 1 second, as in the example of FIG. 2.
• Such a sampling frequency makes it possible to obtain a large number of samples and to have a faithful representation of the audio signal 20, even sampled for evaluation or classification.
• FIG. 3 illustrates a flowchart of the various steps of a process for processing an audio signal, for example the audio signal 20 of FIG. 2, according to a particular and non-limiting example of the present invention.
• the method is advantageously implemented in the device 106.
• a determined number of values each representing a value of an amplitude of a sample of the audio signal 20 are received. These data are for example received from a memory, for example a buffer memory or a flash type memory, in which the signal samples obtained after sampling the audio signal 20 are stored. Example given with reference to figure 2, 16000 values are received in the form of an input vector of size 1x16000x1.
• a first matrix is determined or obtained by applying 100 first convolution filters of size 1x7, with a step (from the English “stride”) of 1, to the input vector obtained in step 31
• the input vector passes through a first convolutional layer and convolution operations are applied to this input vector on the basis of 100 first filters of size 1x7, with a step of 1.
• the size of the first matrix is equal to 1x15994x100.
• the product of the first convolutional layer is a first matrix (also called the characteristic map (of the output feature map or activation map, the OxOxC dimensions of which are obtained by:
• the step corresponds to the number of pixels by which the window corresponding to the filter moves in the input tensor (input vector in this case).
• a second matrix is determined or obtained by applying 100 second convolution filters of size 1 x7, with a step of 1, to the first matrix obtained in step 32.
• the first matrix passes through a second convolution layer and convolution operations are applied to this first matrix on the basis of 100 second filters of size 1x7, with a step of 1.
• a third matrix is determined or obtained by applying to the second matrix obtained in step 33 a first so-called “pooling” operation, and more specifically a first “pooling by maximum” operation. (from the English “max pooling”).
• This first operation is based on the use of a 1x3 filter, without overlap, i.e. the filter (a window of 1 pixel by 3 pixels if we consider that the matrices correspond to arrays of pixels) moves in the second matrix without overlap (ie there is no common pixel between the sub-matrices obtained from the second matrix by application of the filter moving in this second matrix).
• the first one The “maximum pooling” operation corresponds to a spatial reduction in the size of the second matrix by selecting only one value, the maximum value, in each sub-matrix obtained from the second matrix via the 1x3 filter.
• the size of the third matrix is equal to 1x5329x100, with 5329 3 ⁇ 4 (15988/3).
• the first "pooling" operation is matched or associated with a random deactivation operation of some of the neurons of the network, with a probability of 0.3 (30%). This technique is known as “dropout”.
• a fourth matrix is determined or obtained by applying 128 third convolutional filters of size 1x7, with a step of 1, to the third matrix obtained in step 34.
• the third matrix passes into a third layer of convolution and operations of convolutions are applied to this third matrix on the basis of 128 second filters of size 1x7, with a step of 1.
• a fifth matrix is determined or obtained by applying to the fourth matrix obtained in step 35 a second so-called “pooling” operation, and more specifically a second “maximum pooling” operation. (from the English “max pooling"). This second operation is based on the use of a 1x3 filter, without overlap. Following the example provided with the input vector of dimension 1 x16000x1, the size of the fifth matrix is equal to 1 x1774x100, with 1774 " (5323/3).
• the second "pooling" operation is matched or associated with a random deactivation operation ("dropout") of part of the neurons of the network, with a probability of 0.1 (10%).
• a sixth matrix is determined or obtained by applying 128 fourth convolution filters of size 1x7, with a step of 1, to the fifth matrix obtained in step 36.
• the fifth matrix passes into a fourth convolution layer and convolution operations are applied to this fifth matrix on the basis of 128 second filters of size 1x7, with a step of 1.
• a seventh matrix is determined or obtained by applying to the sixth matrix obtained in step 37 a third operation called “pooling”, and more specifically a third “pooling by average” operation. (from the English "average pooling").
• This third operation is based on the use of a 1xN filter (N corresponding to the 1xNx128 dimension of the sixth matrix, or 1768 according to the particular example).
• the third operation of "pooling by average” corresponds to a spatial reduction in the size of the sixth matrix by selecting only one value, the average of the N values, for each of the 128 channels.
• a single value (the average of the N values) is taken into account.
• the size of the seventh matrix is equal to 1x1x128.
• This seventh matrix is also called the output vector since 2 of the 3 dimensions of the 1x1x128 tensor are equal to 1.
• the third "pooling" operation is matched or associated with a random deactivation operation ("dropout") of part of the neurons of the network, with a probability of 0.2 (20%).
• the output vector passes through a layer of densely connected neurons, with 128 neurons each connected to each of the neurons of a layer comprising for example 6 neurons, a class representative of a different noise level being associated to each of these 6 neurons.
• the input audio signal is thus classified, that is to say that a class (also called label) is associated with the audio signal by applying the output vector to a layer of densely connected neurons, this layer having at output for example 6 neurons each corresponding to a class representative of a different noise level.
• a class also called label
• the number of output neurons is not limited to 6 and is for example equal to 4, 8 or 10 and advantageously less than 10.
• the values of the first filters are advantageously determined in a learning phase, according to a method known to those skilled in the art.
• a learning phase a large number of input audio signals of which the associated class (ie the noise level) is known are used to learn the different values or coefficients of the convolution filters.
• a method known as the backpropagation of the error gradient is, for example, implemented.
• the values included in one of the first, second, third or fourth convolution filters are equal to: - 0.07848639; 0.04320003; 0.0651957; 0.054399617; 0.033398744; - 0.006850287; and 0.07814157.
• the number of input samples may be different from 16000, for example equal to 10,000 or 20,000 or 32,000.
• the number of samples of the input vector is for example taken into account as a learning parameter, having an impact on the values included in the convolution filters used in the different convolution layers.
• a particular processing is applied to the audio signal as a function of the class to which the signal has been associated in step 39, the processing being for example implemented to improve the quality of the signal by reducing the noise.
• So-called spectral subtraction methods for example based on Wiener filtering or Lim filtering, are for example implemented.
• Such a classification via a neural network has the advantage that the system implementing the method (the neural network) finds or learns the properties of interest to make the classification (for example the values included in the convolution filters) , which makes it possible to be freed from arbitrary and biased choices that a human being would make for example.
• FIG. 4 schematically illustrates a device 106 configured to process an audio signal such as the audio signal 20, for example to classify the noise level of such a signal, according to a particular and non-limiting embodiment of the present invention.
• the device 106 is for example configured for the implementation of the operations described with reference to FIGS. 1 and 2 and / or the steps of the method described with regard to FIG. 3. Examples of such a device 106 include, without being there limited, a computer, a server, a smart phone, a tablet, a calculator.
• the elements of the device 106 individually or in combination, can be integrated in a single integrated circuit, in several integrated circuits, and / or in discrete components.
• the device 106 can be produced in the form of electronic circuits or software (or computer) modules or else a combination of electronic circuits and software modules.
• the device 106 comprises one (or more) processor (s) 40 configured to execute instructions for carrying out the steps of the method and / or for executing the instructions of the software (s) embedded in the device 106.
• the processor 40 can include integrated memory, an input / output interface, and various circuits known to those skilled in the art.
• the device 106 further comprises at least one memory 41 corresponding, for example, to a volatile and / or non-volatile memory and / or comprises a memory storage device which may comprise memory. volatile and / or non-volatile, such as EEPROM, ROM, PROM, RAM, DRAM, SRAM, flash, magnetic or optical disk.
• the computer code of the on-board software (s) comprising the instructions to be loaded and executed by the processor is for example stored in the first memory 41.
• the device 106 comprises a block 42 of interface elements for communicating with external devices, for example a remote server or the “cloud” or else the tuner 104.
• the elements of interface of block 42 include one or more of the following interfaces:
• radiofrequency interface for example of the Bluetooth® or Wi-Fi® type, LTE (from English “Long-Term Evolution” or in French “Long-term Evolution”), LTE-Advanced (or in French LTE-advanced );
• USB interface from English “Universal Serial Bus” or “Bus Universel en Série” in French);
• the device 106 comprises a communication interface 43 which makes it possible to establish communication with other devices via a communication channel 430.
• the communication interface 43 corresponds for example to a transmitter configured for transmitting and receiving information and / or data via the communication channel 430.
• the device 106 can provide and / or receive output signals to one or more external devices, such as a keyboard 440, a mouse 450 and / or a screen 460 respectively via interfaces of input / output 44, 45 and 46.
• one or the other of the external devices is integrated into the device 106.
• the display screen 460 corresponds for example to a touch screen.
• the invention is not limited to the embodiments described above but extends to a method of classifying the noise level of an audio signal, and to the device configured for the implementation of such process.
• the invention also relates to a method for evaluating an audio signal and more particularly to a method for evaluating the quality of an audio signal, and to the device configured for implementing such a method.
• the invention also relates to a vehicle comprising the device 106.

Landscapes

• Engineering & Computer Science (AREA)
• Signal Processing (AREA)
• Physics & Mathematics (AREA)
• Computational Linguistics (AREA)
• Health & Medical Sciences (AREA)
• Audiology, Speech & Language Pathology (AREA)
• Human Computer Interaction (AREA)
• Acoustics & Sound (AREA)
• Multimedia (AREA)
• Artificial Intelligence (AREA)
• Evolutionary Computation (AREA)
• Computer Networks & Wireless Communication (AREA)
• Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)

Applications Claiming Priority (2)

Publications (1)

Family

ID=70228115

Family Applications (1)

Country Status (3)

Family Cites Families (4)

• 2019
  • 2019-11-26 FR FR1913207A patent/FR3103660B1/fr active Active
• 2020
  • 2020-10-21 EP EP20807468.2A patent/EP4066389A1/de active Pending
  • 2020-10-21 WO PCT/FR2020/051901 patent/WO2021105574A1/fr unknown

Also Published As

Similar Documents

Legal Events