CN109104670B - Audio device and spatial noise reduction method and system thereof - Google Patents
Audio device and spatial noise reduction method and system thereof Download PDFInfo
- Publication number
- CN109104670B CN109104670B CN201810955454.2A CN201810955454A CN109104670B CN 109104670 B CN109104670 B CN 109104670B CN 201810955454 A CN201810955454 A CN 201810955454A CN 109104670 B CN109104670 B CN 109104670B
- Authority
- CN
- China
- Prior art keywords
- sound
- sound signal
- loudspeaker
- audio
- array
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2410/00—Microphones
- H04R2410/01—Noise reduction using microphones having different directional characteristics
Abstract
The invention discloses audio equipment and a spatial noise reduction method and a spatial noise reduction system thereof, wherein the audio equipment comprises a microphone array and a loudspeaker array, the microphone array comprises a plurality of first microphones arranged in different spatial directions, and the loudspeaker array comprises a plurality of first loudspeakers arranged in one-to-one correspondence with the first microphones; the method comprises the steps of acquiring first sound signals received by first microphones respectively; the first sound signal comprises a user sound signal and a noise sound signal; controlling a corresponding first loudspeaker to play a suppressed sound signal aiming at the noise sound signal according to preset sound information and each first sound signal; the suppression sound signal includes an inverted sound wave for suppressing a corresponding noise sound signal, and the preset sound information includes user sound information collected in advance. The invention enlarges the suppression range of the space noise, enhances the noise reduction effect, ensures that the sound signal of the user is not suppressed and is convenient for the user to use.
Description
Technical Field
The embodiment of the invention relates to the technical field of noise reduction, in particular to audio equipment and a spatial noise reduction method and system thereof.
Background
The noise exists everywhere in people's life, for example, the sound of vehicle driving, whistling, construction sound etc. and the noise brings very big puzzlement to people's life, can influence human health in the time of seriously. With the development of science and technology, active noise reduction technology comes along, and active noise reduction is to generate reverse sound waves equal to external noise through a noise reduction system to offset the external noise. At present, an active noise reduction system in the prior art is generally composed of a single microphone and a single loudspeaker, and after a microphone picks up noise, only one loudspeaker can emit a reverse sound wave with a phase opposite to that of the noise to offset the noise.
Disclosure of Invention
The embodiment of the invention aims to provide audio equipment and a spatial noise reduction method and system thereof, which expand the suppression range of spatial noise in the use process, enhance the noise reduction effect, ensure that the sound signal of a user is not suppressed, bring convenience to the user and be beneficial to meeting the user requirement.
In order to solve the foregoing technical problem, an embodiment of the present invention provides a spatial noise reduction method for an audio device, where the audio device includes a microphone array and a loudspeaker array, the microphone array includes a plurality of first microphones arranged in different spatial directions, and the loudspeaker array includes a plurality of first loudspeakers arranged in one-to-one correspondence with the first microphones; the method comprises the following steps:
acquiring first sound signals received by the first microphones respectively; the first sound signal comprises a user sound signal and a noise sound signal;
controlling a corresponding first loudspeaker to play a suppressed sound signal aiming at the noise sound signal according to preset sound information and each first sound signal; the suppression sound signal includes an inverted sound wave for suppressing a corresponding noise sound signal, and the preset sound information includes user sound information collected in advance.
Optionally, the audio device further includes a second speaker, where the second speaker is located at a preset position of a spatial structure formed by the speaker array and the microphone array, so that external sound waves preferentially pass through the microphone array and the speaker array and then are transmitted to the second speaker in a transmission process;
the method further comprises the following steps:
acquiring audio parameter information of an audio file;
and controlling the second loudspeaker to play the audio sound signal corresponding to the audio file according to the audio parameter information.
This application sets up second loudspeaker in the preset position department of the spatial structure that loudspeaker array and microphone array constitute to make external sound wave pass through microphone array and loudspeaker array in the transmission course again preferentially behind the second loudspeaker can ensure that the audio sound signal that the second loudspeaker broadcast is not disturbed by noise signal, is favorable to ensureing the sound effect of the audio sound that the second loudspeaker broadcast and the tone quality of whole audio equipment.
Optionally, the first sound signal further comprises an audio sound signal;
according to the preset sound information and each first sound signal, the process of controlling the corresponding first loudspeaker to play the sound suppression signal aiming at the noise sound signal is as follows:
and controlling the corresponding first loudspeaker to play the suppression sound signal aiming at the noise sound signal according to the preset sound information, the audio parameter information and each first sound signal.
The application can realize the recognition of the user sound signal and the audio sound signal, and only suppresses the noise signal when the spatial noise is suppressed, thereby avoiding weakening the useful sound signal in the noise suppression process, providing a quiet living environment for the user, ensuring the living demand of the user, and being beneficial to improving the life quality of the user.
Optionally, the audio device further includes a second microphone, the second microphone being spaced from the second speaker by a preset distance;
the method further comprises the following steps:
acquiring a second sound signal received by a second microphone, wherein the second sound signal comprises a user sound signal, an audio sound signal and an interference sound signal;
and controlling a second loudspeaker to play an interference suppression signal aiming at the interference sound signal according to the preset sound information, the audio parameter information and the second sound information, wherein the interference suppression signal comprises an inverse sound wave for suppressing the interference sound signal.
This application feeds back the second sound signal that it received to the audio playback return circuit in through the second microphone to restrain the noise signal of second microphone position department, with the whole tone quality of the audio sound signal's that further improves the second loudspeaker broadcast audio effect and audio equipment.
Optionally, the method further comprises:
acquiring a voice sound signal in the noise sound signal, and extracting character information in the voice sound signal;
and matching the text information with preset text information, and controlling the first loudspeaker and/or the second loudspeaker to send out a sound signal corresponding to the preset text information according to a matching result.
According to the method and the device, the space noise is inhibited, and meanwhile, some sensitive words can be recognized, so that a user can find emergency situations in time, and the user can take corresponding measures in time to further meet the user requirements.
The embodiment of the invention also provides audio equipment which comprises a processing device and a spatial noise reduction structure, wherein the spatial noise reduction structure comprises a microphone array of which the output end is connected with the input end of the processing device and a loudspeaker array of which the input end is connected with the output end of the processing device, so that external sound waves preferentially pass through the microphone array and then pass through the loudspeaker array in the transmission process; the microphone array comprises a plurality of first microphones arranged in different spatial directions, the loudspeaker array comprises a plurality of first loudspeakers, and the first microphones and the first loudspeakers are arranged in a one-to-one correspondence manner;
each first microphone is used for picking up a first sound signal at each position and sending the first sound signal to the processing device;
the processing device is used for analyzing and processing each received first sound signal to obtain a sound wave suppression signal corresponding to each first sound signal respectively, and sending each sound wave suppression signal to a corresponding first loudspeaker;
and each first loudspeaker plays corresponding reverse sound waves according to the received sound wave suppression signals respectively so as to suppress the corresponding first sound signals.
Optionally, the microphone array and the horn array are both annular arrays.
Optionally, the audio device further comprises a second speaker for playing audio sound signals; the second loudspeaker is located at the preset position of the space structure formed by the first microphones and the first loudspeakers, so that external sound waves preferentially pass through the microphone array and the loudspeaker array and then are transmitted to the second loudspeaker in the transmission process.
Optionally, the audio device further comprises a second microphone, the second microphone being spaced from the second speaker by a preset distance.
The embodiment of the invention correspondingly provides a spatial noise reduction system of audio equipment, which comprises:
a memory for storing a computer program;
a processor for implementing the steps of the spatial noise reduction method of the audio device as described above when executing the computer program.
The embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps of the spatial noise reduction method of the audio device.
The invention provides audio equipment and a spatial noise reduction method and a spatial noise reduction system thereof, wherein the audio equipment comprises a microphone array and a loudspeaker array, the microphone array comprises a plurality of first microphones arranged in different spatial directions, and the loudspeaker array comprises a plurality of first loudspeakers arranged in one-to-one correspondence with the first microphones; the method comprises the following steps: acquiring first sound signals received by the first microphones respectively; the first sound signal comprises a user sound signal and a noise sound signal; controlling a corresponding first loudspeaker to play a suppressed sound signal aiming at the noise sound signal according to preset sound information and each first sound signal; the suppression sound signal includes an inverted sound wave for suppressing a corresponding noise sound signal, and the preset sound information includes user sound information collected in advance.
It can be seen that, the spatial directions of the first microphones in the present application are different, so that the microphone array can pick up sound signals in multiple directions, thereby expanding the spatial range of sound pick-up, and the first sound signals received by the first microphones are processed and controlled to play the inverse sound waves used for suppressing the corresponding noise sound signals with the first loudspeakers arranged in one-to-one correspondence with the first microphones, so as to suppress the noise in multiple directions in space, thereby expanding the suppression range of spatial noise and enhancing the noise reduction effect. In addition, when each first sound signal is processed, the user sound signal in each first sound signal can be identified according to preset sound information, and the corresponding first loudspeaker is controlled to only play the reversed-phase sound wave aiming at the noise sound signal, so that the sound signal of the user is not inhibited, convenience is brought to the user, and the user requirements are favorably met.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed in the prior art and the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
Fig. 1 is a schematic flowchart of a spatial noise reduction method for an audio device according to an embodiment of the present invention;
fig. 2 is a schematic flowchart of a spatial noise reduction method for an audio device according to another embodiment of the present invention;
fig. 3 is a schematic structural diagram of an audio device according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a spatial noise reduction structure of FIG. 3;
FIG. 5 is a schematic diagram of a specific structure of the spatial noise reduction structure in FIG. 3;
FIG. 6 is a schematic structural diagram of another spatial noise reduction structure provided in an embodiment of the present invention;
FIG. 7 is a schematic structural diagram of another spatial noise reduction structure provided in an embodiment of the present invention;
FIG. 8 is a schematic structural diagram of another spatial noise reduction structure provided in an embodiment of the present invention;
FIG. 9 is a schematic structural diagram of another spatial noise reduction structure provided in an embodiment of the present invention;
FIG. 10 is a side view of the structure of FIG. 4;
fig. 11 is a schematic structural diagram of a spatial noise reduction system of an audio device according to an embodiment of the present invention.
Detailed Description
The embodiment of the invention provides audio equipment and a spatial noise reduction method and system thereof, which expand the suppression range of spatial noise in the use process, enhance the noise reduction effect, ensure that the sound signal of a user is not suppressed, bring convenience to the user and be beneficial to meeting the user requirement.
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, fig. 1 is a flowchart illustrating a spatial noise reduction method of an audio device according to an embodiment of the present invention.
The audio equipment comprises a microphone array and a loudspeaker array, wherein the microphone array comprises a plurality of first microphones arranged in different spatial directions, and the loudspeaker array comprises a plurality of first loudspeakers arranged in one-to-one correspondence with the first microphones;
the different spatial directions of the first microphones in the microphone array mean that the spatial position distribution of the first microphones can enable the microphone array to achieve sound pickup in multiple directions, the sound pickup range is large, the first loudspeakers in the loudspeaker array correspond to the first microphones in the microphone array one to one, and not only do the first loudspeakers correspond to the first microphones in the spatial directions one to one, but also the opposite-phase sound waves emitted by the first loudspeakers are used for suppressing noise sound signals in the first sound signals received by the corresponding first microphones.
The spatial noise reduction method comprises the following steps:
s110: acquiring first sound signals received by the first microphones respectively; the first sound signal comprises a user sound signal and a noise sound signal;
it is understood that the space where the audio device is located includes not only the noise sound signal but also the sound signal of the user, and when the external noise sound signal and the user sound signal are transmitted to the first microphones, each of the first microphones picks up the first sound signal at the respective location, and the first sound signal includes the user sound signal and the noise sound signal.
S120: controlling a corresponding first loudspeaker to play a suppressed sound signal aiming at the noise sound signal according to preset sound information and each first sound signal; the suppression sound signal includes an inverted sound wave for suppressing a corresponding noise sound signal, and the preset sound information includes user sound information collected in advance.
It should be noted that, when the user voice signal matches the user voice information collected in advance, it is stated that the user voice signal is a "familiar" voice, and the "familiar" voice is not suppressed at this time, so as to ensure that the user can make a call or communicate smoothly.
In the embodiment of the present invention, one of the first audio signals is taken as an example for detailed description, and the processing processes of the other first audio signals are the same, specifically as follows:
after receiving the first sound signal, identifying the first sound signal according to the user sound information collected in advance, when the first sound signal is identified to include the user sound signal corresponding to the user sound information collected in advance, filtering the user sound signal from the first sound signal to obtain a corresponding noise sound signal, processing the noise sound signal (specifically, analyzing parameters such as frequency, phase, amplitude and the like of the noise sound signal) to obtain a sound wave suppression signal corresponding to the noise sound signal, sending the sound wave suppression signal to a first loudspeaker corresponding to a first microphone, and playing the corresponding suppression sound signal by the first loudspeaker according to the received sound wave suppression signal, wherein the suppression sound signal includes an inverse sound wave for suppressing the noise sound signal, and the inverse sound wave is preferably an amplitude such as an amplitude and the like of the noise sound signal, Equal frequency and opposite phase sound wave, so that the corresponding noise sound signal can be better suppressed.
The pre-collected user sound information is pre-stored voiceprint information, when the first sound signal is identified according to the pre-collected user sound information, sound wave digital discrete point comparison can be carried out on the first sound signal and the pre-stored voiceprint information, when the contrast is not lower than a preset threshold value (for example, 85%), it is judged that the first sound signal comprises the user sound information corresponding to the pre-stored voiceprint information, the pre-stored voiceprint information is subtracted from a voiceprint corresponding to the first sound signal, the obtained voiceprint information is the voiceprint information corresponding to the noise sound signal, and therefore the user sound information is filtered from the first sound signal, and the noise sound signal is obtained.
The pre-collected user voice information can be used for collecting the voice of the user in a relatively quiet space and storing the voiceprint information of the user.
In the present application, since the spatial directions of the first microphones are different, the acoustic characteristics of the first sound signals received by the first microphones are also different, and therefore, the first speaker is required to suppress the noise signals in the first sound signals received by the corresponding first microphone. That is, when the first sound signals are identified, a sound wave suppression signal is obtained according to a noise sound signal in the first sound signals sent by the nth first microphone, and the sound wave suppression signal is sent to the nth first speaker, so that the nth first speaker plays the suppression sound signal according to the sound suppression signal.
In addition, in the present application, when each first sound signal is analyzed, the processing may be performed in a parallel processing manner, so as to increase the processing speed.
It can be seen that, the spatial directions of the first microphones in the present application are different, so that the microphone array can pick up sound signals in multiple directions, thereby expanding the spatial range of sound pick-up, and the first sound signals received by the first microphones are processed and controlled to play the inverse sound waves used for suppressing the corresponding noise sound signals with the first loudspeakers arranged in one-to-one correspondence with the first microphones, so as to suppress the noise in multiple directions in space, thereby expanding the suppression range of spatial noise and enhancing the noise reduction effect. In addition, when each first sound signal is processed, the user sound signal in each first sound signal can be identified according to preset sound information, and the corresponding first loudspeaker is controlled to only play the reversed-phase sound wave aiming at the noise sound signal, so that the sound signal of the user is not inhibited, convenience is brought to the user, and the user requirements are favorably met. That is, the application not only can enlarge the suppression range of the space noise and enhance the noise reduction effect, but also can avoid suppressing familiar sound, brings great convenience for the use of users, and is favorable for improving the life quality of the users.
Referring to fig. 2, fig. 2 is a flowchart illustrating a spatial noise reduction method of an audio device according to an embodiment of the present invention.
The audio equipment also comprises a second loudspeaker, wherein the second loudspeaker is positioned at a preset position of a space structure formed by the loudspeaker array and the microphone array, so that external sound waves preferentially pass through the microphone arrays and the loudspeaker array and then are transmitted to the second loudspeaker in the transmission process;
it should be noted that the second speaker is used for playing audio sound signals. Since the first microphone in the microphone array picks up the noise in the noise transmission process and the opposite-phase sound wave is played through the corresponding first horn to suppress the noise, the noise is weakened in the transmission process, so that the noise at the position far away from the noise source in the noise transmission direction is weak, and in order to ensure that the audio sound signal played by the second horn is not interfered by the noise signal, the position of the second horn in the spatial noise reduction structure formed by the microphone array and the horn array in the embodiment should make the external sound wave preferentially pass through the microphone array and the horn array in the transmission process and then be transmitted to the second horn, so as to ensure the sound effect of the audio sound played by the second horn and the sound quality of the whole audio equipment.
The preset position of the application can be determined according to the specific structures of the microphone array and the loudspeaker array, for example, when the microphone array and the loudspeaker array are both circular ring-shaped arrays and the loudspeaker array is located inside the microphone array, the preset position can be the center position of the loudspeaker array.
The spatial noise reduction method may further include:
s210: acquiring audio parameter information of an audio file;
specifically, when an audio file needs to be played, audio parameter information of the played audio file is obtained, where the audio parameter information is specifically sound decoding information corresponding to the audio file, and includes characteristic parameter information such as frequency, amplitude, phase, and the like, and each audio file has audio parameter information uniquely corresponding thereto. The audio files are, for example, music files, etc.
S220: controlling a second loudspeaker to play audio sound signals corresponding to the audio files according to the audio parameter information;
for example, when the audio file is a music file, the second speaker may be controlled to play corresponding music according to the audio parameter information corresponding to the music file.
S230: acquiring first sound signals received by the first microphones respectively; the first sound signal includes a user sound signal, a noise sound signal, and an audio sound signal;
specifically, when the second speaker plays the audio file, the first sound signals received by the respective first microphones include audio sound signals (e.g., music sound signals) played by the audio device itself, in addition to the user sound signals and the noise sound signals. Wherein steps S210 and S220 may be performed before step S210.
S240: and controlling the corresponding first loudspeaker to play a suppression sound signal aiming at the noise sound signal according to preset sound information, audio parameter information and each first sound signal, wherein the suppression sound signal comprises an inverse sound wave for suppressing the corresponding noise sound signal, and the preset sound information comprises user sound information collected in advance.
It should be noted that, the present application not only can identify "familiar" sound signals when suppressing spatial noise, but also can identify audio sound signals from each first sound signal when playing an audio file, and filter the user sound signals and the audio sound signals from the first sound signals to obtain noise sound signals, and then control the corresponding first speakers to play the suppressed sound signals for the noise sound signals. In the embodiment, the useful sound signals (namely, the user sound signals and the audio sound signals) can be identified, and only the noise signals are suppressed when the spatial noise suppression is performed, so that the useful sound signals are prevented from being weakened in the noise suppression process, that is, the life requirements of the user can be ensured while a quiet living environment is provided for the user, and the improvement of the life quality of the user is facilitated.
Specifically, according to the preset sound information and the audio parameter information, the user sound signal matched with the preset sound information can be identified from each first sound signal, and the audio sound signal corresponding to the audio parameter information can be identified. For the specific process of recognizing the user' S voice, reference may be made to the above description in S120, and the embodiment of the present invention is not described in detail again, and for the recognition of the audio sound signal, since the audio sound signal is played by the second speaker in the audio device, the audio sound signal can be recognized from the first noise signal according to the audio parameter information corresponding to the audio file.
It can be understood that, during specific identification, one of the user sound signal and the audio sound signal may be identified first, and then the other one may be identified, or the other one may be identified at the same time, and the specific manner is not limited in this application.
Further, the audio device further comprises a second microphone, and the second microphone and the second loudspeaker are separated by a preset distance;
the preset distance can be between 5mm and 3cm, so as to ensure that the second microphone is no longer in the vibration stroke range of the tympanic membrane of the second loudspeaker, and music sound signals in the sound signals acquired by the second microphone are not distorted.
Correspondingly, the spatial noise reduction method further comprises the following steps:
acquiring a second sound signal received by a second microphone, wherein the second sound signal comprises a user sound signal, an audio sound signal and an interference sound signal;
and controlling a second loudspeaker to play an interference suppression signal aiming at the interference sound signal according to the preset sound information, the audio parameter information and the second sound information, wherein the interference suppression signal comprises an inverse sound wave for suppressing the interference sound signal.
It can be understood that the second microphone is arranged at the preset distance of the second loudspeaker and picks up the second sound signal at the position of the second microphone, the second sound signal comprises the music sound signal played by the second loudspeaker, the user sound signal transmitted from the outside and the interference sound signal at the preset position, and the sound effect enhancement and the noise suppression of the played audio sound signal are realized by feeding back the second sound signal in the audio playing loop, which is favorable for further improving the audio playing effect and the integral sound quality of the audio equipment.
Specifically, the second sound signal picked up by the second microphone is identified according to the preset sound information and the audio parameter information, so that the user sound information (the user sound information is matched with the preset sound information) and the audio parameter information in the second sound information can be identified, then the user sound information and the audio parameter information in the second sound information are filtered, the remaining interference sound signal can be obtained, and the second loudspeaker is controlled to play the interference suppression signal according to the interference sound signal, so that the interference sound signal is suppressed through the corresponding reverse-phase sound wave. The interference sound signal in the embodiment of the invention comprises a noise sound signal remained after being suppressed by the first loudspeaker.
It should be further noted that the second speaker may be controlled to play the audio sound signal and the interference suppression signal in a time-division multiplexing manner, that is, the inverse sound wave corresponding to the interference suppression signal is inserted into the waveform of the audio sound signal according to a preset frequency, where the preset frequency is not lower than 20KHz, so as to ensure that the human ear cannot perceive the "break and continue" of the audio sound signal, thereby ensuring the sound effect.
Further, the spatial noise reduction method further includes:
acquiring a voice sound signal in the noise sound signal, and extracting character information in the voice sound signal;
and matching the text information with preset text information, and controlling the first loudspeaker and/or the second loudspeaker to send out a sound signal corresponding to the preset text information according to a matching result.
It is understood that an emergency may be encountered in real life, and there may be a voice message including some urgent words, such as "fire", "rescue" and the like, in order to enable the user to hear the sound information with the emergency words from the outside indoors, the embodiment of the invention can also acquire the voice sound information in the noise sound signal, extracting corresponding text information from the voice and sound information, matching the extracted text information with pre-stored preset text information (such as 'fire', 'life saving', etc.), when the matching is successful, the first loudspeaker and/or the second loudspeaker can be controlled to play the sound signal corresponding to the successfully matched text information, so that the user can listen to the related text information in time and take corresponding action measures. The embodiment can identify some sensitive words while inhibiting the spatial noise, thereby ensuring that a user can find emergency in time, so that the user can take corresponding measures in time to further meet the user requirements.
Referring to fig. 3, fig. 3 is a schematic structural diagram of an audio device according to an embodiment of the present invention. On the basis of the above embodiment of the spatial noise reduction method of the audio device, an embodiment of the present invention further provides an audio device, which is used for implementing the method in the above embodiment of the method. The equipment comprises a processing device 1 and a spatial noise reduction structure 2, wherein the spatial noise reduction structure 2 comprises a microphone array 21 of which the output end is connected with the input end of the processing device 1 and a loudspeaker array 22 of which the input end is connected with the output end of the processing device 1, so that external sound waves preferentially pass through the microphone array 2 and then pass through the loudspeaker array 22 in the transmission process; the microphone array 21 comprises a plurality of first microphones 211 arranged in different spatial directions, the horn array 22 comprises a plurality of first horns 221, and the first microphones 211 and the first horns 221 are arranged in a one-to-one correspondence manner;
each first microphone 211 is configured to pick up a first sound signal at its respective location and send the first sound signal to the processing apparatus 1;
the processing device 1 is configured to analyze and process each received first sound signal to obtain a sound wave suppression signal corresponding to each first sound signal, and send each sound wave suppression signal to a corresponding first loudspeaker 221;
each first speaker 221 plays a corresponding inverse sound wave according to the received sound wave suppression signal, so as to suppress the corresponding first sound signal.
It should be noted that, when suppressing noise, it is necessary to receive noise first and then send out a sound wave for suppressing the noise according to the received noise, so the structural relationship between the microphone array 21 and the horn array 22 in the present application needs to satisfy that an external sound wave preferentially passes through the microphone array 2 and then passes through the horn array 22 in a transmission process. That is, the first microphone 211 in the microphone array 21 should be located in front of the corresponding first loudspeaker 221, and the first loudspeaker 221 is further away from the noise source relative to the corresponding first microphone 211, so that after the first microphone 211 receives the first sound signal, the processing device 1 can control the first loudspeaker 221 to emit the corresponding inverse sound wave according to the first sound signal, so as to perform inverse suppression on the first sound signal.
Specifically, in the present application, the spatial directions of the first microphones 211 in the microphone array 21 are different, that is, the spatial position distributions of the first microphones 211 are different, so that the microphone array 21 can pick up sound in multiple directions, and the sound pickup range is large. The first horns 221 in the horn array 22 are arranged in one-to-one correspondence with the first microphones 211 in the microphone array 21, so that the first sound signals received by the corresponding first microphones 211 can be suppressed by the anti-phase sound waves emitted by each first horn 221, and the suppression range of the spatial noise is large.
For example, each first microphone 211 in the microphone array 21 forms a spherical array, each first horn 221 in the corresponding horn array 22 also forms a spherical array, and the horn array 22 is located inside the microphone array 21, so that external sound waves can preferentially pass through the microphone array 2 and then pass through the horn array 22 in the transmission process.
It should be further noted that, in the embodiment of the present invention, in a process of analyzing each received first sound signal (specifically, analyzing parameters such as frequency, phase, amplitude, and the like of the first sound signal), obtaining sound wave suppression signals corresponding to each first sound signal, and controlling the corresponding first speaker 221 to emit the corresponding inverse sound wave according to each sound wave suppression signal, reference may be made to the above spatial noise reduction method embodiment of the audio device, which is not described herein again.
In addition, the audio equipment in the application can be placed on a path where noise is transmitted in the use process, for example, when the noise is transmitted to the indoor after the noise is outside the window, the audio equipment can be placed at the window, so that the noise is reduced for the noise transmitted outside the window, and the influence of the noise on the indoor environment is reduced.
Specifically, the processing device 1 in the present application may include an FPGA board card, so as to implement parallel processing on each first sound signal, and improve the processing speed.
Please refer to fig. 4-10. Further, the microphone array 21 and the horn array 22 in the present application are both annular arrays.
It should be noted that, in order to be able to realize picking up spatial noise in multiple directions (360 ° omnidirectional), the microphone array 21 and the loudspeaker array 22 in the present application are both preferably annular arrays, so that noise reduction processing can be performed on spatial noise in 360 ° omnidirectional, the noise reduction range is greatly improved, and the noise reduction effect is further improved. For example, the array may be a circular array (see fig. 4), a polygonal circular array, or a triangular circular array.
Referring to fig. 5, the spatial noise reduction structure 2 is shown, wherein the microphone array 21 and the speaker array 22 are circular ring arrays. As shown in fig. 5, the microphone array 21 includes 8 first microphones 211, MIC1, MIC2, and MIC3 … MIC8, and the horn array 22 correspondingly includes 8 first horns 221, SPK1, SPK2, and SPK3 … SPK8, and assuming that noise is transmitted from one direction, for example, noise is transmitted from the direction of the first microphone MIC2 in fig. 5, since the sound wave is a longitudinal wave and the sound wave is spread, MIC2 will first pick up a noise main lobe, and the processing apparatus 1 controls the first horn SPK1 to emit a reverse sound wave for the noise main lobe according to the noise main lobe to cancel the noise main lobe; after the MIC2 picks up the noise main lobe, MIC1 and MIC3 simultaneously pick up the main lobe and the side lobe where the noise is dispersed, and then send the received first noise signals to the processing device 1, the processing device 1 analyzes parameters such as frequency, phase and amplitude according to the received waveforms to obtain corresponding sound wave suppression signals, and respectively controls SPK1 and SPK3 to send out corresponding opposite-phase sound waves to cancel the first sound signals received by MIC1 and MIC 3. It can be seen that after the noise is picked up by MIC1, MIC2 and MIC3 and the sound waves sent by SPK1, SPK2 and SPK3 in the transmission process, the noise pressure level can be rapidly reduced, the residual noise is also picked up by MIC4 and MIC8 in the propagation direction and the sound waves sent by SPK4 and SPK8 again, compared with a single-horn and single-microphone noise reduction system, the spatial noise can be picked up and cancelled in 360 degrees in space, the spatial noise can be suppressed to a great extent, and the noise reduction effect is greatly improved. Of course, when suppressing noise transmitted from a plurality of directions, the principle of suppressing noise transmitted from a certain direction is the same as that described above, and the details of the present application are not described.
In addition, the microphone array 21 and the horn array 22 in the present application may be on the same plane or different planes, and the microphone array 21 and the horn array 22 may also be coaxially disposed.
Furthermore, the audio device comprises a second speaker 3 for playing audio sound signals; the second speaker 3 is located at a preset position of a spatial structure formed by the first microphones 211 and the first speakers 221, so that external sound waves preferentially pass through the microphone array 2 and the speaker array 22 and then are transmitted to the second speaker 3 in the transmission process.
Specifically, the audio device in the present application may also be configured to play an audio sound signal, specifically, the audio sound signal may be played through the second speaker 3. In addition, since the sound waves are picked up by the first microphones 211 in the microphone array 21 during the noise transmission process and the inverted sound waves are played through the corresponding first horns 221 to suppress the noise, the noise is attenuated during the transmission process, so the noise at the position far away from the noise source in the noise transmission direction is weak, and in order to ensure that the audio sound signals played by the second horns 3 are not interfered by the noise signals, the second horns 3 are positioned in the spatial noise reduction structure 2 formed by the microphone array 21 and the horn array 22 so that the external sound waves preferentially pass through the microphone array 2 and the horn array 22 during the transmission process and then are transmitted to the second horns 3.
For example, when the microphone array 21 and the horn array 22 are both annular arrays and are on the same plane, the second horn 3 may be located at the center position of the horn array 22.
For the process of processing each first sound signal and controlling each corresponding first loudspeaker 221 to play the corresponding inverse sound wave when the second loudspeaker 3 plays the audio sound signal, please refer to relevant parts in the above method embodiments, which is not described herein again.
Further, the audio device further includes a second microphone 4, and the second microphone 4 is spaced apart from the second speaker 3 by a predetermined distance.
The relative position relationship between the second microphone 4 and the second horn 3 can be referred to fig. 10, the relative position between the second microphone 4 and the second horn 3 preferably enables the second microphone 4 to be located within the orthographic projection range of the second horn 3, and the preset distance (DL in fig. 10) in this application is a straight-line distance between the second microphone 4 and the second horn 3, and the preset distance can be between 5mm and 3cm, so as to ensure that the second microphone 4 is no longer within the tympanic membrane vibration stroke range of the second horn 3, and enable the music sound signals in the sound signals acquired by the second microphone 4 not to be distorted.
Specifically, the second microphone 4 and the second horn 3 may be both located on a common axis of the microphone array 21 and the horn array 22, and the second microphone 4 is spaced from the second horn 3 by a preset distance.
Fig. 6 to 10 are schematic partial structural diagrams in the audio device of the present application, fig. 6 to 10 show distribution relationships of several types of second speakers 3, second microphones 4, microphone arrays 21 and speaker arrays 22, where the microphone arrays 21 and the speaker arrays 22 shown in fig. 6, 7 and 10 are located on the same plane, the schematic structural diagram shown in fig. 10 is a side view of the schematic structural diagram shown in fig. 4, and the microphone arrays 21 and the speaker arrays 22 shown in fig. 8 and 9 are located on different planes.
Of course, the acoustic device and the spatial noise reduction structure 2 thereof provided in the embodiment of the present invention are not limited to the several structures shown in the drawings, and may be other specific structures.
It can be seen that, in the present application, the spatial directions of the first microphones 211 are different, so that the microphone array 21 can pick up sound signals in multiple directions, thereby expanding the spatial range of sound pick-up, and the first sound signals received by the first microphones 211 are processed and controlled to play the inverse sound waves used for suppressing the corresponding noise sound signals with the first loudspeakers 221 arranged in one-to-one correspondence with the first microphones 211, so as to suppress the noise in multiple directions in space, thereby expanding the suppression range of spatial noise, enhancing the noise reduction effect, having strong practicability, and the manufacturing cost is low.
On the basis of the above method embodiment, please refer to fig. 11. The embodiment of the invention correspondingly provides a spatial noise reduction system of audio equipment, which comprises:
a memory 5 for storing a computer program;
a processor 6 for implementing the steps of the spatial noise reduction method of the audio device as described above when executing the computer program.
It should be noted that the spatial noise reduction system of the audio device provided in the embodiment of the present invention has the same beneficial effects as the spatial noise reduction method of the audio device provided in the above method embodiment. In addition, for a specific description of the spatial noise reduction method for audio equipment according to the embodiment of the present invention, please refer to the above method embodiment, which is not described herein again.
On the basis of the foregoing embodiments, the present invention further provides a computer-readable storage medium, on which a computer program is stored, and the computer program, when executed by a processor, implements the steps of the spatial noise reduction method of the audio device as described above.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
It is further noted that, in the present specification, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (8)
1. A spatial noise reduction method of audio equipment is characterized in that the audio equipment comprises a microphone array and a loudspeaker array, the microphone array comprises a plurality of first microphones arranged in different spatial directions, the loudspeaker array comprises a plurality of first loudspeakers arranged in one-to-one correspondence with the first microphones, and the position relation between the microphone array and the loudspeaker array meets the requirement that external sound waves preferentially pass through the microphone array and then pass through the loudspeaker array in the transmission process; the method comprises the following steps:
acquiring a first sound signal received by each first microphone; the first sound signal comprises a user sound signal and a noise sound signal;
controlling a corresponding first loudspeaker to play a suppression sound signal aiming at the noise sound signal according to preset sound information and each first sound signal; the suppression sound signal comprises an inverse sound wave for suppressing a corresponding noise sound signal, and the preset sound information comprises pre-collected user sound information;
the audio equipment further comprises a second loudspeaker, wherein the second loudspeaker is located at a preset position of a space structure formed by the loudspeaker array and the microphone array, so that external sound waves preferentially pass through the microphone array and the loudspeaker array and then are transmitted to the second loudspeaker in the transmission process;
the method further comprises the following steps:
acquiring audio parameter information of an audio file;
and controlling the second loudspeaker to play the audio sound signal corresponding to the audio file according to the audio parameter information.
2. The spatial noise reduction method of an audio device according to claim 1, wherein the first sound signal further includes the audio sound signal;
the process of controlling the corresponding first loudspeaker to play the sound suppression signal aiming at the noise sound signal according to the preset sound information and each first sound signal is as follows:
and controlling the corresponding first loudspeaker to play a sound suppression signal aiming at the noise sound signal according to preset sound information, the audio parameter information and each first sound signal.
3. The spatial noise reduction method of an audio device according to claim 2, wherein the audio device further comprises a second microphone spaced from the second horn by a preset distance;
the method further comprises the following steps:
acquiring a second sound signal received by the second microphone, wherein the second sound signal comprises the user sound signal, the audio sound signal and an interference sound signal;
and controlling the second loudspeaker to play an interference suppression signal aiming at the interference sound signal according to the preset sound information, the audio parameter information and the second sound information, wherein the interference suppression signal comprises an inverse sound wave for suppressing the interference sound signal.
4. The method of spatial noise reduction for an audio device of any of claims 1-3, further comprising:
acquiring a voice sound signal in the noise sound signal, and extracting text information in the voice sound signal;
and matching the text information with preset text information, and controlling the first loudspeaker and/or the second loudspeaker to send out a sound signal corresponding to the preset text information according to a matching result.
5. The audio equipment is characterized by comprising a processing device and a spatial noise reduction structure, wherein the spatial noise reduction structure comprises a microphone array with an output end connected with an input end of the processing device and a loudspeaker array with an input end connected with an output end of the processing device, so that external sound waves preferentially pass through the microphone array and then pass through the loudspeaker array in a transmission process; the microphone array comprises a plurality of first microphones arranged in different spatial directions, the loudspeaker array comprises a plurality of first loudspeakers, and the first microphones and the first loudspeakers are arranged in a one-to-one correspondence manner;
each first microphone is used for picking up a first sound signal at each position and sending the first sound signal to the processing device;
the processing device is used for analyzing and processing each received first sound signal to obtain a sound wave suppression signal corresponding to each first sound signal respectively, and sending each sound wave suppression signal to a corresponding first loudspeaker;
each first loudspeaker plays a corresponding sound suppression signal according to the received sound wave suppression signal; the suppression sound signal includes an inverted sound wave for suppressing a noise sound signal in the first sound signal;
wherein the audio device further comprises a second speaker for playing audio sound signals; the second loudspeaker is located each first microphone and each the preset position department of the spatial structure that first loudspeaker constitute to make external sound wave pass through in the transmission preferentially the microphone array with pass to again behind the loudspeaker array the second loudspeaker.
6. The audio device of claim 5, wherein the microphone array and the horn array are both annular arrays.
7. The audio device of claim 6, further comprising a second microphone spaced a predetermined distance from the second horn.
8. A spatial noise reduction system for an audio device, comprising:
a memory for storing a computer program;
a processor for implementing the steps of the spatial noise reduction method of the audio device according to any of claims 1 to 4 when executing the computer program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810955454.2A CN109104670B (en) | 2018-08-21 | 2018-08-21 | Audio device and spatial noise reduction method and system thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810955454.2A CN109104670B (en) | 2018-08-21 | 2018-08-21 | Audio device and spatial noise reduction method and system thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109104670A CN109104670A (en) | 2018-12-28 |
| CN109104670B true CN109104670B (en) | 2021-06-25 |
Family
ID=64850565
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810955454.2A Active CN109104670B (en) | 2018-08-21 | 2018-08-21 | Audio device and spatial noise reduction method and system thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109104670B (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109473089A (en) * | 2018-12-29 | 2019-03-15 | 联想(北京)有限公司 | A kind of electronic equipment and processing method |
| CN109874081A (en) * | 2019-01-04 | 2019-06-11 | 惠州迪芬尼声学科技股份有限公司 | A kind of loudspeaker |
| CN110517660A (en) * | 2019-08-22 | 2019-11-29 | 珠海格力电器股份有限公司 | Noise-reduction method and device based on built-in Linux real-time kernel |
| CN111391771B (en) * | 2020-03-25 | 2021-11-09 | 斑马网络技术有限公司 | Method, device and system for processing noise |
| CN112073857A (en) * | 2020-09-08 | 2020-12-11 | 麦格雷博电子(深圳)有限公司 | Space omnibearing 4 pi sphericity sound radiation system and sound pickup system |
| CN112788480B (en) * | 2021-01-27 | 2023-01-24 | 歌尔科技有限公司 | Sound production structure and wearable equipment |
| CN113539249B (en) * | 2021-06-08 | 2023-12-26 | 安徽沐峰数据科技有限公司 | Speech processing equipment and method based on artificial intelligence |
| CN113724721A (en) * | 2021-07-28 | 2021-11-30 | 深圳市星范儿文化科技有限公司 | Noise reduction method and system for intelligent reading kiosk |
| CN115150712A (en) * | 2022-06-07 | 2022-10-04 | 中国第一汽车股份有限公司 | Vehicle-mounted microphone system and automobile |
| CN115116232B (en) * | 2022-08-29 | 2022-12-09 | 深圳市微纳感知计算技术有限公司 | Voiceprint comparison method, device and equipment for automobile whistling and storage medium |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104217712A (en) * | 2014-09-19 | 2014-12-17 | 阿特拉斯科普柯(南京)建筑矿山设备有限公司 | Active noise reduction device of engineering machinery operation room and rock drilling machine |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000106700A (en) * | 1998-09-29 | 2000-04-11 | Hitachi Ltd | Method for generating stereophonic sound and system for realizing virtual reality |
| CN100514445C (en) * | 2005-09-13 | 2009-07-15 | 南京大学 | Virtual sound screen |
| CN100495533C (en) * | 2006-05-22 | 2009-06-03 | 南京大学 | Sound intensity active acoustic shielding |
| CN102723076A (en) * | 2012-05-31 | 2012-10-10 | 四川正升环保科技有限公司 | Multi-channel active noise control system |
| JP6038312B2 (en) * | 2012-07-27 | 2016-12-07 | フラウンホーファー−ゲゼルシャフト・ツール・フェルデルング・デル・アンゲヴァンテン・フォルシュング・アインゲトラーゲネル・フェライン | Apparatus and method for providing loudspeaker-enclosure-microphone system description |
| US9949017B2 (en) * | 2015-11-24 | 2018-04-17 | Bose Corporation | Controlling ambient sound volume |
-
2018
- 2018-08-21 CN CN201810955454.2A patent/CN109104670B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104217712A (en) * | 2014-09-19 | 2014-12-17 | 阿特拉斯科普柯(南京)建筑矿山设备有限公司 | Active noise reduction device of engineering machinery operation room and rock drilling machine |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109104670A (en) | 2018-12-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109104670B (en) | Audio device and spatial noise reduction method and system thereof | |
| US11569789B2 (en) | Compensation for ambient sound signals to facilitate adjustment of an audio volume | |
| US11626125B2 (en) | System and apparatus for real-time speech enhancement in noisy environments | |
| KR101171494B1 (en) | Robust two microphone noise suppression system | |
| CN108962272A (en) | Sound pick-up method and system | |
| EP2605239A2 (en) | Method and arrangement for noise reduction | |
| EP2352312A1 (en) | A method for dynamic suppression of surrounding acoustic noise when listening to electrical inputs | |
| CN107396223B (en) | Earphone uplink noise-reduction method | |
| JP6964608B2 (en) | Media compensated pass-through and mode switching | |
| US10510361B2 (en) | Audio processing apparatus that outputs, among sounds surrounding user, sound to be provided to user | |
| US10616676B2 (en) | Dynamically adjustable sidetone generation | |
| CN110277103A (en) | Noise-reduction method and terminal based on speech recognition | |
| WO2018158558A1 (en) | Device for capturing and outputting audio | |
| JP5295115B2 (en) | Hearing aid driving method and hearing aid | |
| EP3902285A1 (en) | A portable device comprising a directional system | |
| CN112435682A (en) | Vehicle noise reduction system, method and device, vehicle and storage medium | |
| KR20200100665A (en) | Acoustic noise cancellation system in passenger compartment for remote communication | |
| EP2482566B1 (en) | Method for generating an audio signal | |
| CN114640938A (en) | Hearing aid function implementation method based on Bluetooth headset chip and Bluetooth headset | |
| RU2756385C1 (en) | Voice-activated sound conversion for headsets using the representation of signals of the microphone in the frequency domain | |
| JP2008228198A (en) | Apparatus and method for adjusting playback sound | |
| TW202242856A (en) | Open-back headphones | |
| JP2011199697A (en) | Headphone | |
| CN113611277B (en) | Noise reduction method, noise reduction device and noise reduction system | |
| US10880642B2 (en) | Sound pick-up apparatus, medium, and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |