CN115223582B - Audio noise processing method, system, electronic device and medium - Google Patents
Audio noise processing method, system, electronic device and medium Download PDFInfo
- Publication number
- CN115223582B CN115223582B CN202111540141.9A CN202111540141A CN115223582B CN 115223582 B CN115223582 B CN 115223582B CN 202111540141 A CN202111540141 A CN 202111540141A CN 115223582 B CN115223582 B CN 115223582B
- Authority
- CN
- China
- Prior art keywords
- audio signal
- noise reduction
- audio
- voice
- processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title claims description 15
- 230000005236 sound signal Effects 0.000 claims abstract description 346
- 230000009467 reduction Effects 0.000 claims abstract description 275
- 238000012545 processing Methods 0.000 claims abstract description 130
- 238000000034 method Methods 0.000 claims abstract description 35
- 238000004891 communication Methods 0.000 claims description 31
- 238000005070 sampling Methods 0.000 claims description 22
- 238000012952 Resampling Methods 0.000 claims description 21
- 238000003860 storage Methods 0.000 claims description 13
- 230000003993 interaction Effects 0.000 claims description 12
- 230000004044 response Effects 0.000 claims description 11
- 238000004590 computer program Methods 0.000 claims description 10
- 238000001914 filtration Methods 0.000 claims description 9
- 238000000926 separation method Methods 0.000 claims description 7
- 238000011161 development Methods 0.000 abstract description 6
- 230000006870 function Effects 0.000 description 16
- 238000004519 manufacturing process Methods 0.000 description 16
- 238000011946 reduction process Methods 0.000 description 12
- 238000012986 modification Methods 0.000 description 11
- 230000004048 modification Effects 0.000 description 11
- 230000008859 change Effects 0.000 description 10
- 230000000694 effects Effects 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 4
- 238000005034 decoration Methods 0.000 description 4
- 230000001360 synchronised effect Effects 0.000 description 4
- 230000002457 bidirectional effect Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000003321 amplification Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 2
- 238000013475 authorization Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000010168 coupling process Methods 0.000 description 2
- 238000005859 coupling reaction Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000003199 nucleic acid amplification method Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 238000000802 evaporation-induced self-assembly Methods 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000000630 rising effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Quality & Reliability (AREA)
- Soundproofing, Sound Blocking, And Sound Damping (AREA)
- Telephone Function (AREA)
Abstract
The invention provides a method and a system for processing noise of audio, wherein the method comprises the following steps: acquiring an audio signal of a microphone end, and determining a sound source of the audio signal; if the sound source of the audio signal is a call audio signal, the call audio signal is subjected to noise reduction processing through the DSP noise reduction chip, and the obtained first noise reduction signal is input to the call module through the audio hardware abstraction layer; if the audio source of the audio signal is a local voice audio signal, the local voice audio signal is input into voice assistant application software through an audio hardware abstraction layer, and noise reduction processing and echo cancellation processing are carried out on the local voice audio signal through a voice noise reduction algorithm integrated in the voice assistant application software; if the sound source of the audio signal is the mobile phone interconnection voice audio signal, the noise reduction unit of the hardware abstraction layer is used for carrying out noise reduction processing on the mobile phone interconnection voice audio signal. The invention reduces the hardware cost and development cost of noise processing and avoids the quality risk caused by greatly modifying the audio hardware abstraction layer.
Description
Technical Field
The present invention relates to the field of noise processing technologies, and in particular, to a method, a system, an electronic device, and a medium for processing audio noise.
Background
Along with the development of the internet of vehicles, voice, bluetooth communication and the like have become mainstream and important interaction modes in vehicles, and under the vehicle-mounted environment, noise such as environmental noise, wind noise, tire noise, played audio and the like is contained in the vehicles, so that signals recorded by the voice of the vehicle, bluetooth and the like are poor, and the quality of communication, recognition and the like is low. In-car noise reduction application scenes are divided into three categories: the method is used for front-end audio processing of voice recognition, front-end audio processing of call functions such as Bluetooth call, carPlay (an in-vehicle system published by apple Inc. of America, an iOS device of a user is combined with an instrument panel system), an in-vehicle networking terminal (Telecommatics BOX, TBOX) and the like, and mobile phone interconnection voice audio processing of CarPlay, carlife (a mobile phone and automobile intelligent interconnection product proposed by Baidu company) and the like. Currently, the technology mainly adopts one of hard noise reduction treatment and soft noise reduction treatment schemes.
The existing vehicle-mounted noise reduction method mainly adopts one of hard noise reduction treatment and soft noise reduction treatment schemes for treatment. Hard noise reduction refers to noise reduction and echo cancellation by an independent hardware noise reduction module, but the disadvantage of this approach is: 1) The hardware cost is high, and the hardware design difficulty for recording channels and the like is high; 2) The printed circuit board (Printed Circuit Board, PCB) occupies a large space; 3) The refreshing needs to be combined with firmware updating, the noise reduction parameters/algorithms cannot be flexibly adjusted, the updating cannot be carried out through Over-the-Air Technology (OTA), and the refreshing difficulty in after-sales updating is high. Soft noise reduction refers to noise reduction by a software algorithm, but this approach has the disadvantage: 1) The cost is high, and because all algorithms are integrated in a System On Chip (SOC), the CPU has extremely high performance consumption, so that a high-performance SOC Chip is required to be adopted, and the cost is increased; if the CPU performance is insufficient, a time delay condition exists, and the noise reduction effect is poor; 2) Since all soft noise reduction algorithms are deployed at an Audio hardware abstraction layer (Audio Hardware Abstraction Layer, audio-HAL) of the android system, modifying the HAL layer causes an increase in quality risk; 3) Because the soft noise reduction algorithm has a complex verification process, the production complexity is increased, and the production efficiency is reduced.
Disclosure of Invention
In order to solve the above prior art problems, the invention provides an audio noise processing method, an audio noise processing system, an electronic device and a medium.
The first aspect of the present invention provides a method for processing noise of audio, including:
acquiring an audio signal of a microphone end and determining a sound source of the audio signal;
if the sound source of the audio signal is a call audio signal, the call audio signal is subjected to noise reduction through a DSP noise reduction chip, and a first noise reduction signal obtained through the noise reduction is input to a call module through an audio hardware abstraction layer so as to complete two-way call interaction and response;
if the audio source of the audio signal is a local voice audio signal, the local voice audio signal is input into voice assistant application software through an audio hardware abstraction layer, and noise reduction processing and echo cancellation processing are carried out on the local voice audio signal through a voice noise reduction algorithm integrated in the voice assistant application software;
if the sound source of the audio signal is a mobile phone interconnection voice audio signal, the mobile phone interconnection voice audio signal is subjected to noise reduction processing through a noise reduction unit of an audio hardware abstraction layer.
Further, the noise reduction processing of the call audio signal by the DSP noise reduction chip includes:
the communication audio signal is gained through the DSP noise reduction chip, and a first gain signal is obtained;
noise separation and filtering are carried out on the first gain signal, and a mono audio signal is obtained;
resampling the mono audio signal to enable the sampling rate of the mono audio signal to meet the sampling rate of the input signal of the call module, and taking the resampled mono audio signal as a first noise reduction signal.
Further, the resampling of the mono audio signal, in particular:
and carrying out hardware resampling on the mono audio signal through an ADSP chip built in the SOC chip.
Further, before the voice audio signal is input to the voice assistant application software through the audio hardware abstraction layer and noise reduction processing and echo cancellation processing are performed by a voice noise reduction algorithm integrated in the voice assistant application software, the method further comprises:
acquiring an audio signal of a loudspeaker end as a reference signal;
mixing the reference signal with the voice audio signal to obtain a mixed audio signal;
And inputting the mixed audio signal into a CPU, and calling the voice noise reduction algorithm integrated in the voice assistant application software.
Further, before the noise reduction processing is performed on the call audio signal by the DSP noise reduction chip, the method further includes:
and setting the audio source program as a call mode, and switching the DSP noise reduction chip into a call channel mode through an SPI serial communication protocol.
Further, before the noise reduction processing and the echo cancellation processing are performed on the local voice audio signal by using a voice noise reduction algorithm integrated in the voice assistant application software, the method further includes:
and setting the audio source program to an intelligent voice mode, and switching the DSP noise reduction chip to an intelligent voice channel mode.
Further, the determining the audio source of the audio signal, in particular:
and judging the sound source of the audio signal through the sound source circulation channel of the audio signal.
A second aspect of the present invention provides an audio noise processing system comprising:
the audio signal acquisition and sound source judgment module is used for acquiring an audio signal of a microphone end by a sound source and determining the sound source of the audio signal;
the communication audio signal processing module is used for carrying out noise reduction processing on the communication audio signal through the DSP noise reduction chip when the audio source of the audio signal is the communication audio signal, and inputting a first noise reduction signal obtained by the noise reduction processing to the communication module through the audio hardware abstraction layer so as to complete two-way communication interaction and response;
The local voice audio signal processing module is used for inputting the local voice audio signal into voice assistant application software through an audio hardware abstraction layer when the audio source of the audio signal is the local voice audio signal, and carrying out noise reduction processing and echo cancellation processing on the local voice audio signal through a voice noise reduction algorithm integrated in the voice assistant application software;
and the mobile phone interconnection voice audio signal processing module is used for carrying out noise reduction processing on the mobile phone interconnection voice audio signal through a noise reduction unit of the audio hardware abstraction layer when the sound source of the audio signal is the mobile phone interconnection voice audio signal.
A third aspect of the present invention provides an electronic device comprising a processor, a memory and a computer program stored in the memory and configured to be executed by the processor, the processor implementing the method of noise processing of audio as described in any one of the first aspects above when the computer program is executed.
A fourth aspect of the present invention provides a computer readable storage medium comprising a stored computer program, wherein the computer program, when run, controls a device in which the computer readable storage medium is located to perform the method of noise processing of audio as described in any of the first aspects above.
Compared with the prior art, the embodiment of the invention has the beneficial effects that:
the invention provides a method and a system for processing noise of audio, wherein the method comprises the following steps: acquiring an audio signal of a microphone end and determining a sound source of the audio signal; if the sound source of the audio signal is a call audio signal, the call audio signal is subjected to noise reduction through a DSP noise reduction chip, and a first noise reduction signal obtained through the noise reduction is input to a call module passing through an audio hardware abstraction layer so as to complete two-way call interaction and response; if the audio source of the audio signal is a local voice audio signal, the local voice audio signal is input into voice assistant application software through an audio hardware abstraction layer, and noise reduction processing and echo cancellation processing are carried out on the local voice audio signal through a voice noise reduction algorithm integrated in the voice assistant application software; if the sound source of the audio signal is a mobile phone interconnection voice audio signal, the mobile phone interconnection voice audio signal is subjected to noise reduction processing through a noise reduction unit of an audio hardware abstraction layer. According to the invention, the audio signals are separated according to the sound sources of the audio signals, different noise reduction methods are adopted for the audio signals of different sound sources, the hardware cost and development cost of noise processing are reduced, and the quality risk caused by the large-scale modification of the audio hardware abstraction layer is avoided.
Drawings
In order to more clearly illustrate the technical solutions of the present invention, the drawings that are needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a flowchart of a method for processing noise of audio provided in embodiment 1 of the present invention;
fig. 2 is a flowchart of a method for processing noise of audio according to embodiment 2 of the present invention;
fig. 3 is a flowchart of a method for processing noise of audio according to embodiment 3 of the present invention;
FIG. 4 is a block diagram of an audio noise processing system according to embodiment 5 of the present invention;
fig. 5 is a block diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
It should be understood that the step numbers used herein are for convenience of description only and are not limiting as to the order in which the steps are performed.
It is to be understood that the terminology used in the description of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in this specification and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
The terms "comprises" and "comprising" indicate the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
The term "and/or" refers to any and all possible combinations of one or more of the associated listed items, and includes such combinations.
Currently, the technology mainly adopts one of two processing schemes of hard noise reduction processing and soft noise reduction: the hardware noise reduction module is required to be higher due to the fact that call voice and the like are adopted hard noise reduction, an independent noise reduction module is required to be adopted specially, noise reduction echo is carried out by the noise reduction module, however, the scheme is serious in rising of hardware cost, occupied space for a printed circuit board (Printed Circuit Board, PCB) is large, noise reduction parameters/algorithms can not be flexibly adjusted due to the fact that firmware is required to be updated every time, particularly after-sale updating is carried out, refreshing difficulty is high, and updating can not be carried out through OTA.
The soft noise reduction is adopted singly, and because the algorithm required by the soft noise reduction is integrated in the SOC, if the call voice adopts the soft noise reduction, compared with the hard noise reduction, the performance consumption of the CPU is extremely large, if the performance is insufficient, the problem of time delay exists, and the call effect is reduced; and the call soft noise reduction algorithm needs to be deployed on an Audio-HAL of the android system, so that the quality risk is increased due to the modification of the HAL layer, and the complexity of a production line is easily affected by the verification steps of the multipath soft noise reduction algorithm, so that the production beat is slowed down.
Compared with the method of hard noise reduction or soft noise reduction in the industry, the invention provides a noise processing method of audio combining hard noise reduction and soft noise reduction, which separates audio signals according to the sound sources of the audio signals, adopts different noise reduction methods for the audio signals of different sound sources, reduces the noise interference of vehicle-mounted audio, improves the quality of the vehicle-mounted audio, and reduces the hardware cost and development cost of noise processing.
In a first aspect.
Referring to fig. 1, embodiment 1 of the present invention provides a method for processing audio noise, including steps S100, S200, S300, and S400; after the execution of step S100 is finished, one step of S200, S300 or S400 is selected to be executed according to the result of step S100; and the steps S200, S300 and S400 are parallel, but not sequential. Specifically:
S100, acquiring an audio signal of a microphone end, and determining a sound source of the audio signal.
The audio signal of the microphone end is an input signal of a user to the microphone end, and after the DSP chip collects the audio signal of the microphone end, the vehicle-mounted system judges the sound source of the audio signal.
It will be appreciated that, since the audio channels of different audio signals are different, determining the audio source of the audio signal may be: and judging the sound source of the audio signal through the sound source circulation channel of the audio signal. Since the frequency domains of different audio signals are different, determining the audio source of the audio signal may also be determining the audio source of the audio signal according to the frequency domain of the audio signal.
Preferably, the determining the audio source of the audio signal, in particular:
and judging the sound source of the audio signal through the sound source circulation channel of the audio signal.
And S200, if the sound source of the audio signal is a call audio signal, performing noise reduction processing on the call audio signal through a DSP noise reduction chip, and inputting a first noise reduction signal obtained by the noise reduction processing to a call module through an audio hardware abstraction layer to complete two-way call interaction and response.
Note that, the call audio signal includes: a bluetooth call, a CarPlay phone, ECALL (car emergency call system), BCAll (push-to-talk rescue, mainly road rescue), and the like. And the noise reduction processing of the communication audio signal through the DSP noise reduction chip is to perform hard noise reduction processing on the communication audio signal.
It can be understood that after the DSP chip collects the audio signal of the microphone end and the vehicle-mounted system determines that the audio signal is a call audio signal, the noise reduction processing is directly performed inside the DSP chip to obtain a first noise reduction signal, and the first noise reduction signal is transmitted to the call module through the audio hardware abstraction layer, so as to complete two-way call interaction and response.
S300, if the sound source of the audio signal is a local voice audio signal, the local voice audio signal is input into voice assistant application software through an audio hardware abstraction layer, and noise reduction processing and echo cancellation processing are carried out on the local voice audio signal through a voice noise reduction algorithm integrated in the voice assistant application software.
Note that the local voice audio signal includes: local voice audio signals such as vehicle artificial intelligence voice, vehicle voice recognition assistant and the like. The noise reduction processing and the echo cancellation processing are performed on the local voice audio signal through a voice noise reduction algorithm integrated in voice assistant application software, namely, soft noise reduction is performed on the local voice audio signal.
It can be understood that after the DSP chip collects the audio signal of the microphone end and the vehicle-mounted system determines that the local voice audio signal is a local voice audio signal, the local voice audio signal is transmitted to the CPU, and is input to the voice assistant application software through the audio hardware abstraction layer, and the noise reduction processing and the echo cancellation processing are performed on the local voice audio signal through the voice noise reduction algorithm integrated in the voice assistant application software.
S400, if the sound source of the audio signal is a mobile phone interconnection voice audio signal, the mobile phone interconnection voice audio signal is subjected to noise reduction processing through a noise reduction unit of an audio hardware abstraction layer.
It should be noted that, the mobile phone interconnection voice audio is a voice and music mixing, and the mobile phone interconnection voice audio signal includes: carplay, carlife, etc., and the third party application does not provide the noise reduction function. And the noise reduction unit through the audio hardware abstraction layer performs noise reduction processing on the mobile phone interconnection voice audio signal, namely soft noise reduction is performed on the mobile phone interconnection voice audio signal.
It can be understood that after the DSP chip collects the audio signal of the microphone end and the vehicle-mounted system determines that the mobile phone is connected with the voice audio signal, the voice monitoring needs to be performed when music is played, the local voice audio signal is transmitted to the CPU, and the noise reduction processing is performed on the mobile phone connected with the voice audio signal through the vehicle-mounted SOC system at the audio hardware abstraction layer.
According to the audio noise processing method provided by the embodiment 1 of the invention, the audio signals are separated according to the sound sources of the audio signals, the DSP noise reduction chip is adopted for noise reduction of the call audio signals, the voice noise reduction algorithm is adopted for noise reduction of the local voice audio signals, the noise reduction unit of the hardware abstraction layer is adopted for noise reduction of the mobile phone interconnection voice audio signals, namely, different noise reduction methods are adopted for the audio signals of different sound sources, the noise interference of the vehicle-mounted audio is reduced, the quality of the vehicle-mounted audio is improved, and the hardware cost and the development cost of noise processing are reduced.
In addition, the noise reduction process of the call audio signal does not occupy the CPU performance, does not need to change HAL layer codes, does not need to authorize or activate to influence the production line, decouples the voice resource package and the Bluetooth telephone and the like, and reduces the call fault probability; after-sales updating of noise reduction of call audio signals is carried out only by updating and refreshing software without replacing a DSP chip, so that a voice noise reduction algorithm can be updated at any time through OTA, and the hardware refreshing cost is reduced.
For the noise reduction process of the local voice audio signal, because each vehicle model is different in microphone arrangement position, angle, interval, interior decoration and other differences and noise environments such as an engine, an air conditioner, tire noise, road noise and the like in the vehicle, in order to ensure good voice recognition effect, the voice parameters such as a voice wake-up threshold value, an in-vehicle reverberation signal model and the like are required to be calibrated and adjusted along with the change of the vehicle model, the voice noise reduction algorithm provided by the scheme is integrated in an APP layer, only parameters of the APP layer are modified, the HAL layer is not required to be modified, quick modification and application of each vehicle model can be realized, voice tuning parameters can be flexibly adjusted according to different vehicle models and different application scenes, the occupation of a separate hardware noise reduction module is reduced, the PCB is reduced, the dependence on hardware is reduced, the cost is greatly reduced, after-sales update and flexible adjustment of tuning parameters for noise reduction of the local voice audio signal are not required to be updated, and the cost is reduced.
For the noise reduction process of the mobile phone interconnection voice audio signal, the DSP cannot support noise reduction under the condition of mixing voice and music at the same time, so that the noise reduction of the mobile phone interconnection voice audio signal of a third party application program which does not provide a noise reduction function, such as Carplay, carlife, cannot be supported, therefore, the noise reduction process of the mobile phone interconnection voice audio signal is processed by the vehicle-mounted SOC system of the HAL layer, occupation of a PCB is reduced, dependence on hardware is reduced, and cost is greatly reduced.
Referring to fig. 2, steps S100 to S400 of the audio noise processing method provided in embodiment 2 of the present invention are the same as steps S100 to S400 in embodiment 1, except that: in the step S200, the noise reduction processing is performed on the call audio signal by using a DSP noise reduction chip, including:
s210, gain is carried out on the call audio signal through the DSP noise reduction chip, and a first gain signal is obtained.
It should be noted that the gain is the amplification factor of the signal.
S220, noise separation and filtering are carried out on the first gain signal, and a mono audio signal is obtained.
The filtering of the separator is to perform denoising processing on the signal.
It can be understood that the DSP noise reduction chip gains the call audio signal, separates and filters out external environment noise, and eliminates the noise, thereby improving the call quality.
S230, resampling the mono audio signal to enable the sampling rate of the mono audio signal to meet the sampling rate of the input signal of the call module, and taking the resampled mono audio signal as a first noise reduction signal.
It should be noted that resampling is to resample a signal to obtain a signal that meets the sampling rate of the input signal of the call module. Because the sampling rate of the signal output by the DSP noise reduction chip is different from the sampling rate of the input signal of the call module, the signal needs to be resampled. For example, the sampling rate of the signal output by the DSP noise reduction chip is 48K, and the sampling rate of the signal is changed into one of the sampling rate 8K, 24K or 16K of the input signal of the call module through resampling.
Preferably, the mono audio signal is resampled in the step S230, in particular:
and carrying out hardware resampling on the mono audio signal through an ADSP chip built in the SOC chip.
It should be noted that, after hardware resampling is performed by adopting an ADSP chip built in the SOC chip, the hardware resampling is sent to the core algorithm processing engine, and software resampling of an android frame work layer is not adopted for implementation, so that the overhead of the system is greatly reduced, and the system efficiency is increased.
According to the audio noise processing method provided by the embodiment 2 of the invention, the DSP noise reduction chip is used for carrying out gain, separation, filtering and resampling on the call audio signals, so that the signals of the call audio signals output by the DSP can be completely input into the call module, and the bidirectional call interaction and response are completed. The noise reduction process of the call audio signal does not occupy the CPU performance, does not need to change HAL layer codes, does not need to authorize or activate to influence the production line, decouples the voice resource package and the Bluetooth telephone and the like, and reduces the call fault probability; after-sales updating of noise reduction of call audio signals is carried out only by updating and refreshing software without replacing a DSP chip, so that a voice noise reduction algorithm can be updated at any time through OTA, and the hardware refreshing cost is reduced.
Referring to fig. 3, steps S100 to S400 of the audio noise processing method provided in embodiment 3 of the present invention are the same as steps S100 to S400 in embodiment 1, except that: the step S300 is input to a voice assistant application software through an audio hardware abstraction layer, and before the noise reduction processing and the echo cancellation processing are performed on the voice audio signal by a voice noise reduction algorithm integrated in the voice assistant application software, the method further includes:
S310, acquiring an audio signal of a loudspeaker end as a reference signal.
It should be noted that, the DSP collects the audio signal of the speaker end in real time as the reference signal.
S320, mixing the reference signal with the voice audio signal to obtain a mixed audio signal.
It should be noted that, after the reference signal and the multiple signals such as the voice audio signal are collected and converted by the ADC (analog-digital converter), and mixed by the time-division multiplexing (time-division multiplexing, TDM) mode, the DSP obtains a signal and transmits the signal to the CPU, so as to realize simultaneous transmission of the multiple signals.
S330, inputting the mixed audio signal into a CPU, and calling the voice noise reduction algorithm integrated in the voice assistant application software.
It should be noted that, invoking a voice noise reduction algorithm integrated in the voice assistant application software in the SOC realizes noise reduction and echo cancellation of the voice audio signal, and ensures good recognition efficiency. The interface function of the voice noise reduction algorithm is shown in table 1:
TABLE 1
It can be appreciated that the noise reduction and echo cancellation algorithm for voice audio signals is integrated in the voice assistant application software, which can eliminate the need for modification of the HAL layer, reduce the occupation of separate hardware noise reduction modules, reduce the occupation of the PCB, reduce the dependence on hardware, greatly reduce the cost, flexibly adjust tuning parameters, eliminate the need for updating firmware, and reduce the refreshing cost.
According to the audio noise processing method provided by the embodiment 3 of the invention, for the noise reduction process of local voice audio signals, because each vehicle type is different in microphone arrangement position, angle, interval, interior decoration and other differences and noise environments such as in-vehicle engines, air conditioners, tire noise, road noise and the like, in order to ensure good voice recognition effect, voice parameters such as voice wake-up threshold and in-vehicle reverberation signal model are required to be calibrated and adjusted along with the change of the vehicle types, after multi-path audio is mixed, voice noise is reduced by a voice noise reduction algorithm integrated in voice assistant application software, because the voice noise reduction algorithm is integrated in an APP layer, only the parameters of the APP layer are modified, quick modification and application of each vehicle type can be realized without modifying the HAL layer, voice tuning parameters can be flexibly adjusted according to different vehicle types and different application scenes, occupation of independent hardware noise reduction modules can be reduced, dependence on hardware is reduced, cost is greatly reduced, after-sales parameters of local voice signals are updated, tuning parameters can be flexibly adjusted, firmware is not required to be updated, and refreshing cost is reduced.
The steps S100 to S400 of the noise processing method for audio provided in embodiment 4 of the present invention are the same as the steps S100 to S400 in embodiment 1, and the difference is that:
Before the noise reduction processing is performed on the call audio signal by the DSP noise reduction chip in step S200, the method further includes:
and setting the audio source program as a call mode, and switching the DSP noise reduction chip into a call channel mode through an SPI serial communication protocol.
It should be noted that, the SPI serial communication protocol is a synchronous serial interface technology, is a high-speed, full duplex, synchronous communication bus, and has the advantages of supporting full duplex communication, being simple in communication, having a fast data transmission rate, and the like.
It can be understood that after the DSP chip collects the audio signal of the microphone end and the vehicle-mounted system determines that the audio signal is a call audio signal, the audio source program is set to a call mode, and the DSP is notified to switch to a call channel mode through the SPI serial message.
Before the noise reduction processing and the echo cancellation processing are performed on the local voice audio signal by the voice noise reduction algorithm integrated in the voice assistant application software in the step S300, the method further includes:
and setting the audio source program to an intelligent voice mode, and switching the DSP noise reduction chip to an intelligent voice channel mode.
It can be understood that after the DSP chip collects the audio signal of the microphone end and the vehicle-mounted system determines that the audio signal is a local voice audio signal, the audio source program is set to an intelligent voice mode, and the DSP is notified to switch to the intelligent voice channel mode through the SPI serial message.
If the call audio signal is noise reduced in the same soft noise reduction mode as the local voice audio signal, there are many difficulties and problems. The first problem is that the complexity and occupied space of the soft noise reduction algorithm are increased, the running performance of the CPU is consumed, and time delay can exist. The second problem is that the noise reduction of the call audio signal is different from the noise reduction of the voice audio signal, because the noise reduction algorithm of the voice audio signal can be integrated in the application layer voice assistant APP, the Bluetooth call algorithm BTNR in the soft noise reduction scheme of the call audio signal has deeper bottom layer, needs to integrate the soft noise reduction library in the HAL layer, calls the interface library and modifies the function to configure and create the recording thread, and finally the recording is reduced and sent into the voice assistant to realize the soft noise reduction. The scheme can lead to the need of deeply changing the android HAL layer interface, has large modification risk and is easy to cause problems. The third problem is that the general soft noise reduction algorithm needs to be activated in an authorization way, if the call audio signal also adopts the soft noise reduction algorithm, the call audio signal can be the same as the local voice audio signal in soft noise reduction, the production line needs to be checked by the algorithm of at least two times of calls and voices, the complexity of the production line is increased, the production beat is slowed down, and the unauthorized problem in certain scenes is very easy to occur. The fourth problem is that the call audio signal soft noise reduction algorithm and the local voice audio signal soft noise reduction algorithm need to be stored in a voice resource packet together, when the voice resource packet is missing, the telephone recording function is directly affected, the coupling is larger, the telephone function itself requires a higher level than voice, the voice resource packet is larger, and the missing easily occurs due to copy upgrade and the like, so that the telephone unavailability probability is increased.
Therefore, embodiment 4 of the present invention proposes an audio noise processing method, in which the noise reduction of the call audio signal is based on the DSP chip for hard noise reduction: the user inputs the audio to the microphone, the DSP samples the conversation audio such as Bluetooth/CarPlay telephone/ECALL/BCall and the like, then the noise reduction processing is directly carried out in the bottom DSP chip, the sound recording after noise reduction is finally transmitted to the Bluetooth APP application, and the conversation identification function is completed. By adopting the scheme, the call audio signal noise reduction does not need to occupy CPU performance, change HAL layer codes, authorize or activate to influence the production line, decouple the voice resource package from the Bluetooth telephone and the like, and reduce the call failure probability.
The second aspect.
Referring to fig. 4, embodiment 5 of the present invention provides an audio noise processing system, which includes:
the audio signal acquiring and sound source judging module 100 acquires an audio signal at a microphone end and determines a sound source of the audio signal.
The audio signal of the microphone end is an input signal of a user to the microphone end, and after the DSP chip collects the audio signal of the microphone end, the vehicle-mounted system judges the sound source of the audio signal.
It will be appreciated that, since the audio channels of different audio signals are different, determining the audio source of the audio signal may be: and judging the sound source of the audio signal through the sound source circulation channel of the audio signal. Since the frequency domains of different audio signals are different, determining the audio source of the audio signal may also be determining the audio source of the audio signal according to the frequency domain of the audio signal.
Preferably, the determining the audio source of the audio signal, in particular:
and judging the sound source of the audio signal through the sound source circulation channel of the audio signal.
And the call audio signal processing module 200 is configured to, when the audio source of the audio signal is a call audio signal, perform noise reduction processing on the call audio signal through the DSP noise reduction chip, and input a first noise reduction signal obtained by the noise reduction processing to the call module through the audio hardware abstraction layer, so as to complete bidirectional call interaction and response.
Note that, the call audio signal includes: bluetooth call, carPlay phone, ECALL, BCALL, etc. And the noise reduction processing of the communication audio signal through the DSP noise reduction chip is to perform hard noise reduction processing on the communication audio signal.
It can be understood that after the DSP chip collects the audio signal of the microphone end and the vehicle-mounted system determines that the audio signal is a call audio signal, the noise reduction processing is directly performed inside the DSP chip to obtain a first noise reduction signal, and the first noise reduction signal is transmitted to the call module through the audio hardware abstraction layer, so as to complete two-way call interaction and response.
The local voice audio signal processing module 300 is configured to input the local voice audio signal to a voice assistant application software through an audio hardware abstraction layer when the audio source of the audio signal is a local voice audio signal, and perform noise reduction processing and echo cancellation processing on the local voice audio signal through a voice noise reduction algorithm integrated in the voice assistant application software.
Note that the local voice audio signal includes: local voice audio signals such as vehicle artificial intelligence voice, vehicle voice recognition assistant and the like. The noise reduction processing and the echo cancellation processing are performed on the local voice audio signal through a voice noise reduction algorithm integrated in voice assistant application software, namely, soft noise reduction is performed on the local voice audio signal.
It can be understood that after the DSP chip collects the audio signal of the microphone end and the vehicle-mounted system determines that the local voice audio signal is a local voice audio signal, the local voice audio signal is transmitted to the CPU, and is input to the voice assistant application software through the audio hardware abstraction layer, and the noise reduction processing and the echo cancellation processing are performed on the local voice audio signal through the voice noise reduction algorithm integrated in the voice assistant application software.
And the mobile phone interconnection voice audio signal processing module 400 is used for carrying out noise reduction processing on the mobile phone interconnection voice audio signal through a noise reduction unit of the audio hardware abstraction layer when the sound source of the audio signal is the mobile phone interconnection voice audio signal.
It should be noted that, the mobile phone interconnection voice audio is a voice and music mixing, and the mobile phone interconnection voice audio signal includes: carplay, carlife, etc., and the third party application does not provide the noise reduction function. And the noise reduction unit through the audio hardware abstraction layer performs noise reduction processing on the mobile phone interconnection voice audio signal, namely soft noise reduction is performed on the mobile phone interconnection voice audio signal.
It can be understood that after the DSP chip collects the audio signal of the microphone end and the vehicle-mounted system determines that the mobile phone is connected with the audio signal of voice, voice monitoring is needed when music is played, the local voice audio signal is transmitted to the CPU, and noise reduction processing is performed on the mobile phone connected with the audio signal of voice through the vehicle-mounted SOC system at the HAL layer.
According to the audio noise processing system provided by the embodiment 5 of the invention, the audio signals are separated according to the sound sources of the audio signals, the DSP noise reduction chip is adopted for noise reduction of the call audio signals, the voice noise reduction algorithm is adopted for noise reduction of the local voice audio signals, the noise reduction unit of the hardware abstraction layer is adopted for noise reduction of the mobile phone interconnection voice audio signals, namely, different noise reduction methods are adopted for the audio signals of different sound sources, the noise interference of the vehicle-mounted audio is reduced, the quality of the vehicle-mounted audio is improved, and the hardware cost and the development cost of noise processing are reduced.
In addition, the noise reduction process of the call audio signal does not occupy the CPU performance, does not need to change HAL layer codes, does not need to authorize or activate to influence the production line, decouples the voice resource package and the Bluetooth telephone and the like, and reduces the call fault probability; after-sales updating of noise reduction of call audio signals is carried out only by updating and refreshing software without replacing a DSP chip, so that a voice noise reduction algorithm can be updated at any time through OTA, and the hardware refreshing cost is reduced.
For the noise reduction process of the local voice audio signal, because each vehicle model is different in microphone arrangement position, angle, interval, interior decoration and other differences and noise environments such as an engine, an air conditioner, tire noise, road noise and the like in the vehicle, in order to ensure good voice recognition effect, the voice parameters such as a voice wake-up threshold value, an in-vehicle reverberation signal model and the like are required to be calibrated and adjusted along with the change of the vehicle model, the voice noise reduction algorithm provided by the scheme is integrated in an APP layer, only parameters of the APP layer are modified, the modification of the HAL layer is not required, the quick modification and application of each vehicle model can be realized, voice tuning parameters can be flexibly adjusted according to different vehicle models and different application scenes, the occupation of a separate hardware noise reduction module is reduced, the occupation of a PCB is reduced, the dependence on hardware is reduced, the cost is greatly reduced, the tuning parameters are updated after sales for noise reduction of the local voice audio signal can be flexibly adjusted, firmware is not required to be updated, and the refreshing cost is reduced.
For the noise reduction process of the mobile phone interconnection voice audio signal, the DSP cannot support noise reduction under the condition of mixing voice and music at the same time, so that the noise reduction of the mobile phone interconnection voice audio signal of a third party application program which does not provide a noise reduction function, such as Carplay, carlife, cannot be supported, therefore, the noise reduction process of the mobile phone interconnection voice audio signal is processed by the vehicle-mounted SOC system of the HAL layer, occupation of a PCB is reduced, dependence on hardware is reduced, and cost is greatly reduced.
The modules 100-400 of the audio noise processing system provided in embodiment 6 of the present invention are the same as the modules 100-400 in embodiment 5, except that: the call audio signal processing module 200 is further configured to execute steps S210 to S230:
s210, gain is carried out on the call audio signal through the DSP noise reduction chip, and a first gain signal is obtained.
It should be noted that the gain is the amplification factor of the signal.
S220, noise separation and filtering are carried out on the first gain signal, and a mono audio signal is obtained.
The filtering of the separator is to perform denoising processing on the signal.
It can be understood that the DSP noise reduction chip gains the call audio signal, separates and filters out external environment noise, and eliminates the noise, thereby improving the call quality.
S230, resampling the mono audio signal to enable the sampling rate of the mono audio signal to meet the sampling rate of the input signal of the call module, and taking the resampled mono audio signal as a first noise reduction signal.
It should be noted that resampling is to resample a signal to obtain a signal that meets the sampling rate of the input signal of the call module. Because the sampling rate of the signal output by the DSP noise reduction chip is different from the sampling rate of the input signal of the call module, the signal needs to be resampled. For example, the sampling rate of the signal output by the DSP noise reduction chip is 48K, and the sampling rate of the signal is changed into one of the sampling rate 8K, 24K or 16K of the input signal of the call module through resampling.
Preferably, the mono audio signal is resampled in the step S230, in particular:
and carrying out hardware resampling on the mono audio signal through an ADSP chip built in the SOC chip.
It should be noted that, after hardware resampling is performed by adopting an ADSP chip built in the SOC chip, the hardware resampling is sent to the core algorithm processing engine, and software resampling of an android frame work layer is not adopted for implementation, so that the overhead of the system is greatly reduced, and the system efficiency is increased.
According to the audio noise processing system provided by the embodiment 6 of the invention, the DSP noise reduction chip is used for carrying out gain, separation, filtering and resampling on the call audio signals, so that the signals of the call audio signals output by the DSP can be completely input into the call module, and the bidirectional call interaction and response are completed. The noise reduction process of the call audio signal does not occupy the CPU performance, does not need to change HAL layer codes, does not need to authorize or activate to influence the production line, decouples the voice resource package and the Bluetooth telephone and the like, and reduces the call fault probability; after-sales updating of noise reduction of call audio signals is carried out only by updating and refreshing software without replacing a DSP chip, so that a voice noise reduction algorithm can be updated at any time through OTA, and the hardware refreshing cost is reduced.
The modules 100-400 of the audio noise processing system provided in embodiment 7 of the present invention are the same as the modules 100-400 in embodiment 5, except that: the local voice audio signal processing module 300 is further configured to execute steps S310 to S3330:
s310, acquiring an audio signal of a loudspeaker end as a reference signal.
It should be noted that, the DSP collects the audio signal of the speaker end in real time as the reference signal.
S320, mixing the reference signal with the voice audio signal to obtain a mixed audio signal.
The DSP collects and converts the reference signal, the voice audio signal and other multipath signals through the ADC, mixes the signals through the TDM mode, and transmits the signals to the CPU to realize the simultaneous transmission of the multipath signals.
S330, inputting the mixed audio signal into a CPU, and calling the voice noise reduction algorithm integrated in the voice assistant application software.
It should be noted that, invoking a voice noise reduction algorithm integrated in the voice assistant application software in the SOC realizes noise reduction and echo cancellation of the voice audio signal, and ensures good recognition efficiency. The interface function of the voice noise reduction algorithm is shown in table 1:
TABLE 1
It can be appreciated that the noise reduction and echo cancellation algorithm for voice audio signals is integrated in the voice assistant application software, which can eliminate the need for modification of the HAL layer, reduce the occupation of separate hardware noise reduction modules, reduce the occupation of the PCB, reduce the dependence on hardware, greatly reduce the cost, flexibly adjust tuning parameters, eliminate the need for updating firmware, and reduce the refreshing cost.
In the audio noise processing system provided in embodiment 7 of the present invention, for the noise reduction process of the local audio signal, because each vehicle type has different microphone arrangement positions, angles, intervals, interior decoration and other differences, and different noise environments such as in-vehicle engine, air conditioner, tire noise, road noise and the like, in order to ensure good speech recognition effect, the speech parameters such as the speech wake-up threshold, in-vehicle reverberation signal model and the like need to be calibrated and adjusted along with the vehicle type change, after multi-path audio is mixed, the speech audio signal is subjected to noise reduction by the speech noise reduction algorithm integrated in the speech assistant application software, since the speech noise reduction algorithm is integrated in the APP layer, only the parameters of the APP layer are modified, the rapid modification and application of each vehicle type can be realized without modifying the HAL layer, the speech tuning parameters can be more flexibly adjusted according to different vehicle types and different application scenarios, and the occupation of separate hardware noise reduction modules can be reduced, the dependence on hardware is reduced, the cost is greatly reduced, the after-sales tuning parameters of the local audio signal are updated, the updating firmware is not required, and the updating cost is reduced.
The modules 100-400 of the audio noise processing system provided in embodiment 8 of the present invention are the same as the modules 100-400 in embodiment 5, except that: the call audio signal processing module 200 is further configured to:
and setting the audio source program as a call mode, and switching the DSP noise reduction chip into a call channel mode through an SPI serial communication protocol.
It should be noted that, the SPI serial communication protocol is a synchronous serial interface technology, is a high-speed, full duplex, synchronous communication bus, and has the advantages of supporting full duplex communication, being simple in communication, having a fast data transmission rate, and the like.
It can be understood that after the DSP chip collects the audio signal of the microphone end and the vehicle-mounted system determines that the audio signal is a call audio signal, the audio source program is set to a call mode, and the DSP is notified to switch to a call channel mode through the SPI serial message.
The local voice audio signal processing module 300 is further configured to:
and setting the audio source program to an intelligent voice mode, and switching the DSP noise reduction chip to an intelligent voice channel mode.
It can be understood that after the DSP chip collects the audio signal of the microphone end and the vehicle-mounted system determines that the audio signal is a local voice audio signal, the audio source program is set to an intelligent voice mode, and the DSP is notified to switch to the intelligent voice channel mode through the SPI serial message.
If the call audio signal is noise reduced in the same soft noise reduction mode as the local voice audio signal, there are many difficulties and problems. The first problem is that the complexity and occupied space of the soft noise reduction algorithm are increased, the running performance of the CPU is consumed, and time delay can exist. The second problem is that the noise reduction of the call audio signal is different from the noise reduction of the voice audio signal, because the noise reduction algorithm of the voice audio signal can be integrated in the application layer voice assistant APP, the Bluetooth call algorithm BTNR in the soft noise reduction scheme of the call audio signal has deeper bottom layer, needs to integrate the soft noise reduction library in the HAL layer, calls the interface library and modifies the function to configure and create the recording thread, and finally the recording is reduced and sent into the voice assistant to realize the soft noise reduction. The scheme can lead to the need of deeply changing the android HAL layer interface, has large modification risk and is easy to cause problems. The third problem is that the general soft noise reduction algorithm needs to be activated in an authorization way, if the call audio signal also adopts the soft noise reduction algorithm, the call audio signal can be the same as the local voice audio signal in soft noise reduction, the production line needs to be checked by the algorithm of at least two times of calls and voices, the complexity of the production line is increased, the production beat is slowed down, and the unauthorized problem in certain scenes is very easy to occur. The fourth problem is that the call audio signal soft noise reduction algorithm and the local voice audio signal soft noise reduction algorithm need to be stored in a voice resource packet together, when the voice resource packet is missing, the telephone recording function is directly affected, the coupling is larger, the telephone function itself requires a higher level than voice, the voice resource packet is larger, and the missing easily occurs due to copy upgrade and the like, so that the telephone unavailability probability is increased.
Therefore, embodiment 8 of the present invention proposes an audio noise processing system, in which the noise reduction of the call audio signal is based on the DSP chip for hard noise reduction: the user inputs the audio to the microphone, the DSP samples the conversation audio such as Bluetooth/CarPlay telephone/ECALL/BCall and the like, then the noise reduction processing is directly carried out in the bottom DSP chip, the sound recording after noise reduction is finally transmitted to the Bluetooth APP application, and the conversation identification function is completed. By adopting the scheme, the call audio signal noise reduction does not need to occupy CPU performance, change HAL layer codes, authorize or activate to influence the production line, decouple the voice resource package from the Bluetooth telephone and the like, and reduce the call failure probability.
In a third aspect.
The present invention provides an electronic device including:
a processor, a memory, and a bus;
the bus is used for connecting the processor and the memory;
the memory is used for storing operation instructions;
the processor is configured to, by invoking the operation instruction, cause the processor to execute an operation corresponding to a noise processing method of audio as shown in the first aspect of the present application.
In an alternative embodiment, an electronic device is provided, as shown in fig. 5, the electronic device 5000 shown in fig. 5 includes: a processor 5001 and a memory 5003. The processor 5001 is coupled to the memory 5003, e.g., via bus 5002. Optionally, the electronic device 5000 may also include a transceiver 5004. Note that, in practical applications, the transceiver 5004 is not limited to one, and the structure of the electronic device 5000 is not limited to the embodiment of the present application.
The processor 5001 may be a CPU, general purpose processor, DSP, ASIC, FPGA or other programmable logic device, transistor logic device, hardware component, or any combination thereof. Which may implement or perform the various exemplary logic blocks, modules, and circuits described in connection with this disclosure. The processor 5001 may also be a combination of computing functions, e.g., including one or more microprocessor combinations, a combination of a DSP and a microprocessor, etc.
Bus 5002 may include a path to transfer information between the aforementioned components. Bus 5002 may be a PCI bus or an EISA bus, among others. The bus 5002 may be divided into an address bus, a data bus, a control bus, and the like. For ease of illustration, only one thick line is shown in fig. 5, but not only one bus or one type of bus.
The memory 5003 may be, but is not limited to, ROM or other type of static storage device, RAM or other type of dynamic storage device, which can store static information and instructions, EEPROM, CD-ROM or other optical disk storage, optical disk storage (including compact disk, laser disk, optical disk, digital versatile disk, blu-ray disc, etc.), magnetic disk storage or other magnetic storage devices, or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and capable of being accessed by a computer.
The memory 5003 is used for storing application program codes for executing the aspects of the present application and is controlled by the processor 5001 for execution. The processor 5001 is operative to execute application code stored in the memory 5003 to implement what has been shown in any of the method embodiments described previously.
Among them, electronic devices include, but are not limited to: mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and the like, and stationary terminals such as digital TVs, desktop computers, and the like.
A fourth aspect.
The present invention provides a computer readable storage medium having stored thereon a computer program which when executed by a processor implements a method of noise processing of audio as shown in the first aspect of the present application.
Yet another embodiment of the present application provides a computer readable storage medium having stored thereon a computer program which, when run on a computer, causes the computer to perform the corresponding content of the foregoing method embodiments.
Claims (9)
1. The audio noise processing method is characterized by being applied to a vehicle-mounted terminal and comprising the following steps of:
Acquiring an audio signal of a microphone end and determining a sound source of the audio signal;
if the sound source of the audio signal is a call audio signal, the call audio signal is subjected to noise reduction through a DSP noise reduction chip, and a first noise reduction signal obtained through the noise reduction is input to a call module through an audio hardware abstraction layer so as to complete two-way call interaction and response;
if the audio source of the audio signal is a local voice audio signal, the local voice audio signal is input into voice assistant application software through an audio hardware abstraction layer, and noise reduction processing and echo cancellation processing are carried out on the local voice audio signal through a voice noise reduction algorithm integrated in the voice assistant application software;
if the sound source of the audio signal is a mobile phone interconnection voice audio signal, the mobile phone interconnection voice audio signal is subjected to noise reduction processing through a noise reduction unit of an audio hardware abstraction layer, and the mobile phone interconnection voice audio signal is subjected to noise reduction processing through a vehicle-mounted SOC system of a HAL layer;
the noise reduction processing of the call audio signal by the DSP noise reduction chip comprises the following steps:
the communication audio signal is gained through the DSP noise reduction chip, and a first gain signal is obtained;
Noise separation and filtering are carried out on the first gain signal, and a mono audio signal is obtained;
resampling the mono audio signal to enable the sampling rate of the mono audio signal to meet the sampling rate of the input signal of the call module, and taking the resampled mono audio signal as a first noise reduction signal.
2. The noise processing method of audio according to claim 1, wherein the resampling of the mono audio signal is performed, in particular:
and carrying out hardware resampling on the mono audio signal through an ADSP chip built in the SOC chip.
3. The method for processing audio noise according to claim 1, wherein the audio signal is input to a voice assistant application software via an audio hardware abstraction layer and subjected to noise reduction processing and echo cancellation processing by a voice noise reduction algorithm integrated in the voice assistant application software, further comprising:
acquiring an audio signal of a loudspeaker end as a reference signal;
mixing the reference signal with the voice audio signal to obtain a mixed audio signal;
and inputting the mixed audio signal into a CPU, and calling the voice noise reduction algorithm integrated in the voice assistant application software.
4. The method for processing audio noise according to claim 1, wherein before the noise reduction processing is performed on the call audio signal by the DSP noise reduction chip, the method further comprises:
and setting the audio source program as a call mode, and switching the DSP noise reduction chip into a call channel mode through an SPI serial communication protocol.
5. The method for noise processing of audio according to claim 1, wherein said noise reduction processing and echo cancellation processing of said local speech audio signal by a speech noise reduction algorithm integrated in a speech assistant application software is preceded by:
and setting the audio source program to an intelligent voice mode, and switching the DSP noise reduction chip to an intelligent voice channel mode.
6. The method for noise processing of audio according to claim 1, wherein said determining the audio source of said audio signal, in particular:
and judging the sound source of the audio signal through the sound source circulation channel of the audio signal.
7. An audio noise processing system, which is applied to a vehicle-mounted terminal, comprising:
the audio signal acquisition and sound source judgment module is used for acquiring an audio signal of a microphone end by a sound source and determining the sound source of the audio signal;
The communication audio signal processing module is used for carrying out noise reduction processing on the communication audio signal through the DSP noise reduction chip when the audio source of the audio signal is the communication audio signal, and inputting a first noise reduction signal obtained by the noise reduction processing to the communication module through the audio hardware abstraction layer so as to complete two-way communication interaction and response;
the local voice audio signal processing module is used for inputting the local voice audio signal into voice assistant application software through an audio hardware abstraction layer when the audio source of the audio signal is the local voice audio signal, and carrying out noise reduction processing and echo cancellation processing on the local voice audio signal through a voice noise reduction algorithm integrated in the voice assistant application software;
the mobile phone interconnection voice audio signal processing module is used for carrying out noise reduction processing on the mobile phone interconnection voice audio signal through a noise reduction unit of an audio hardware abstraction layer when the sound source of the audio signal is the mobile phone interconnection voice audio signal;
carrying out noise reduction processing on the mobile phone interconnection voice audio signals by a vehicle-mounted SOC system of the HAL layer;
the noise reduction processing of the call audio signal by the DSP noise reduction chip comprises the following steps:
the communication audio signal is gained through the DSP noise reduction chip, and a first gain signal is obtained;
Noise separation and filtering are carried out on the first gain signal, and a mono audio signal is obtained;
resampling the mono audio signal to enable the sampling rate of the mono audio signal to meet the sampling rate of the input signal of the call module, and taking the resampled mono audio signal as a first noise reduction signal.
8. An electronic device comprising a processor, a memory and a computer program stored in the memory and configured to be executed by the processor, the processor implementing the method of noise processing of audio according to any one of claims 1 to 6 when the computer program is executed.
9. A computer readable storage medium, characterized in that the computer readable storage medium comprises a stored computer program, wherein the computer program, when run, controls a device in which the computer readable storage medium is located to perform the noise processing method of audio according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111540141.9A CN115223582B (en) | 2021-12-16 | 2021-12-16 | Audio noise processing method, system, electronic device and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111540141.9A CN115223582B (en) | 2021-12-16 | 2021-12-16 | Audio noise processing method, system, electronic device and medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115223582A CN115223582A (en) | 2022-10-21 |
| CN115223582B true CN115223582B (en) | 2024-01-30 |
Family
ID=83606003
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111540141.9A Active CN115223582B (en) | 2021-12-16 | 2021-12-16 | Audio noise processing method, system, electronic device and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115223582B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104575510A (en) * | 2015-02-04 | 2015-04-29 | 深圳酷派技术有限公司 | Noise reduction method, noise reduction device and terminal |
| CN110097891A (en) * | 2019-04-22 | 2019-08-06 | 广州视源电子科技股份有限公司 | A kind of microphone signal processing method, device, equipment and storage medium |
| CN110769111A (en) * | 2019-10-28 | 2020-02-07 | 珠海格力电器股份有限公司 | Noise reduction method, system, storage medium and terminal |
| CN111683319A (en) * | 2020-06-08 | 2020-09-18 | 北京爱德发科技有限公司 | Call pickup noise reduction method, earphone and storage medium |
| CN112235674A (en) * | 2020-09-24 | 2021-01-15 | 海菲曼（天津）科技有限公司 | Active noise reduction processing method, system and chip based on noise analysis |
| CN113096677A (en) * | 2021-03-31 | 2021-07-09 | 深圳市睿耳电子有限公司 | Intelligent noise reduction method and related equipment |
| CN113163152A (en) * | 2021-03-30 | 2021-07-23 | 九音(南京)集成电路技术有限公司 | Multi-dimensional sound pickup and noise reduction method, video teleconference system and computer storage medium |
| GB202112256D0 (en) * | 2020-08-31 | 2021-10-13 | Parker Tom Richard | Systems and methods for moderating noise levels in a communication session |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6937980B2 (en) * | 2001-10-02 | 2005-08-30 | Telefonaktiebolaget Lm Ericsson (Publ) | Speech recognition using microphone antenna array |
| JP2009539306A (en) * | 2006-05-31 | 2009-11-12 | アギア システムズ インコーポレーテッド | Noise reduction with mobile communication devices in non-call situations |
| FR2992459B1 (en) * | 2012-06-26 | 2014-08-15 | Parrot | METHOD FOR DEBRUCTING AN ACOUSTIC SIGNAL FOR A MULTI-MICROPHONE AUDIO DEVICE OPERATING IN A NOISE MEDIUM |
| KR102502601B1 (en) * | 2015-11-27 | 2023-02-23 | 삼성전자주식회사 | Electronic device and controlling voice signal method |
| KR101842777B1 (en) * | 2016-07-26 | 2018-03-27 | 라인 가부시키가이샤 | Method and system for audio quality enhancement |
| US10354673B2 (en) * | 2018-01-24 | 2019-07-16 | Hisense Mobile Communications Technology Co., Ltd. | Noise reduction method and electronic device |
-
2021
- 2021-12-16 CN CN202111540141.9A patent/CN115223582B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104575510A (en) * | 2015-02-04 | 2015-04-29 | 深圳酷派技术有限公司 | Noise reduction method, noise reduction device and terminal |
| CN110097891A (en) * | 2019-04-22 | 2019-08-06 | 广州视源电子科技股份有限公司 | A kind of microphone signal processing method, device, equipment and storage medium |
| CN110769111A (en) * | 2019-10-28 | 2020-02-07 | 珠海格力电器股份有限公司 | Noise reduction method, system, storage medium and terminal |
| CN111683319A (en) * | 2020-06-08 | 2020-09-18 | 北京爱德发科技有限公司 | Call pickup noise reduction method, earphone and storage medium |
| GB202112256D0 (en) * | 2020-08-31 | 2021-10-13 | Parker Tom Richard | Systems and methods for moderating noise levels in a communication session |
| CN112235674A (en) * | 2020-09-24 | 2021-01-15 | 海菲曼（天津）科技有限公司 | Active noise reduction processing method, system and chip based on noise analysis |
| CN113163152A (en) * | 2021-03-30 | 2021-07-23 | 九音(南京)集成电路技术有限公司 | Multi-dimensional sound pickup and noise reduction method, video teleconference system and computer storage medium |
| CN113096677A (en) * | 2021-03-31 | 2021-07-09 | 深圳市睿耳电子有限公司 | Intelligent noise reduction method and related equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115223582A (en) | 2022-10-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9978389B2 (en) | Combined voice recognition, hands-free telephony and in-car communication | |
| US8019454B2 (en) | Audio processing system | |
| EP1044119B1 (en) | Vehicle computer system with audio entertainment system | |
| US20040078104A1 (en) | Method and apparatus for an in-vehicle audio system | |
| CN107004423A (en) | Feedback for sharing the communication of the enhanced conversation type in acoustic space is eliminated | |
| CN102774321B (en) | Vehicle-mounted system and sound control method thereof | |
| CN112437383B (en) | Multi-sound-source adjusting method and device, vehicle and storage medium | |
| CN105790802A (en) | Sound sources management method in dual-terminal interconnection mode | |
| CN109273006A (en) | Sound control method, onboard system, vehicle and the storage medium of onboard system | |
| WO2023056764A1 (en) | In-vehicle call method and apparatus, system, and vehicle | |
| CN113225716A (en) | Vehicle-mounted karaoke realization method, system, equipment and storage medium | |
| CN114299976A (en) | Audio data processing method and electronic equipment | |
| CN115223582B (en) | Audio noise processing method, system, electronic device and medium | |
| CN106888147B (en) | Vehicle-mounted instant messaging hands-free system | |
| WO2014141574A1 (en) | Voice control system, voice control method, program for voice control, and program for voice output with noise canceling | |
| CN111666062A (en) | Audio processing device and method and vehicle-mounted information entertainment system | |
| CN106445456A (en) | Transmission method and transmission device for navigating TTS (text to speech) audio data | |
| CN212569744U (en) | Audio processing device | |
| CN114882721B (en) | Vehicle navigation information playing method and device, electronic equipment and storage medium | |
| CN116841950A (en) | Audio data transmission method, device, chip and computer readable storage medium | |
| Every et al. | A Software-Centric Solution to Automotive Audio for General Purpose CPUs | |
| CN114827835A (en) | In-vehicle multi-audio playing method and device based on earphone and storage medium | |
| JP7084899B2 (en) | In-vehicle device | |
| CN114827834A (en) | In-vehicle multi-audio playing method and device based on earphone and storage medium | |
| CN114827797A (en) | In-vehicle multi-audio playing method and device based on earphone and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |