CN107360318B - Voice noise reduction method and device, mobile terminal and computer readable storage medium - Google Patents
Voice noise reduction method and device, mobile terminal and computer readable storage medium Download PDFInfo
- Publication number
- CN107360318B CN107360318B CN201710523438.1A CN201710523438A CN107360318B CN 107360318 B CN107360318 B CN 107360318B CN 201710523438 A CN201710523438 A CN 201710523438A CN 107360318 B CN107360318 B CN 107360318B
- Authority
- CN
- China
- Prior art keywords
- audio signal
- signal
- mobile terminal
- audio
- noise
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
- H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
- G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K2210/00—Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
- G10K2210/10—Applications
- G10K2210/108—Communication systems, e.g. where useful sound is kept and noise is cancelled
- G10K2210/1081—Earphones, e.g. for telephones, ear protectors or headsets
Abstract
The embodiment of the invention provides a voice noise reduction method, a voice noise reduction device, a mobile terminal and a computer readable storage medium, wherein the method is applied to the mobile terminal, the mobile terminal is connected with an earphone, and the method comprises the following steps: collecting a first audio signal; receiving a second audio signal sent by the earphone; detecting whether the mobile terminal is shielded; extracting a target noise signal from the first audio signal and/or the second audio signal based on a result of the detecting; performing noise reduction processing on a third audio signal acquired by the mobile terminal by using the target noise signal, and outputting a fourth audio signal; the third audio signal is an audio signal collected by the earphone or an audio signal to be sent to the earphone; by the embodiment of the invention, the adaptive noise reduction scheme is dynamically selected according to the environment, the precision of noise pickup is improved, and the noise reduction effect is improved.
Description
Technical Field
The present invention relates to the field of communications technologies, and in particular, to a method and an apparatus for reducing noise in voice, a mobile terminal, and a computer-readable storage medium.
Background
With the development of science and technology, mobile terminals have become essential communication tools and entertainment tools in people's lives, and usually, earphones can be connected with the mobile terminals to carry out operations such as communication and music playing, but in some public places with more people and traffic streams, such as public transport stations like buses, subways and airports, the use of earphones can be influenced by large noise in the surrounding environment.
In the prior art, by adding the customized sound processing chip, the sound processing chip can generate noise reduction sound waves after collecting noise in the surrounding environment, and when the earphone is used for communication, music playing and other operations, the noise reduction sound waves are added to offset the noise, so that the purpose of noise elimination is achieved.
However, the noise collected in the surrounding environment in the prior art is not accurate, and when the environment where the mobile terminal and the earphone are located changes suddenly, the noise collected in the surrounding environment in the prior art is more affected, so that the generated noise reduction sound wave cannot be effectively reduced, and the noise reduction effect is reduced.
Disclosure of Invention
In view of the foregoing problems, embodiments of the present invention provide a method, an apparatus, a mobile terminal, and a computer-readable storage medium for reducing noise in a voice, so as to solve the problem that a noise reduction scheme adapted to an environment cannot be dynamically selected in the prior art.
In order to solve the above problem, an embodiment of the present invention provides an audio noise reduction method, which is applied to a mobile terminal, where the mobile terminal is connected to an earphone, and the method includes:
collecting a first audio signal;
receiving a second audio signal sent by the earphone;
detecting whether the mobile terminal is shielded;
extracting a target noise signal from the first audio signal and/or the second audio signal based on a result of the detecting;
performing noise reduction processing on a third audio signal acquired by the mobile terminal by using the target noise signal, and outputting a fourth audio signal; the third audio signal is an audio signal collected by the earphone or an audio signal to be sent to the earphone.
The embodiment of the invention also provides an audio noise reduction device, which is applied to a mobile terminal, wherein the mobile terminal is connected with an earphone, and the device comprises:
the first audio signal acquisition module is used for acquiring a first audio signal;
the second audio signal acquisition module is used for receiving a second audio signal sent by the earphone;
the shielding detection module is used for detecting whether the mobile terminal is shielded or not;
a target noise signal extraction module for extracting a target noise signal from the first audio signal and/or the second audio signal based on a result of the detection;
the fourth audio signal output module is used for performing noise reduction processing on the third audio signal acquired by the mobile terminal by adopting the target noise signal and outputting a fourth audio signal; the third audio signal is an audio signal collected by the earphone or an audio signal to be sent to the earphone.
The embodiment of the present invention further provides a mobile terminal, which includes a processor, a memory, and a computer program stored on the memory and capable of running on the processor, and when the computer program is executed by the processor, the steps of the audio noise reduction method described above are implemented.
An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps of the audio noise reduction method as described above.
The embodiment of the invention has the following advantages:
in the embodiment of the invention, the mobile terminal receives the second audio signal sent by the connected earphone by acquiring the first audio signal, then detects whether the mobile terminal is blocked, extracts the target noise signal from the first audio signal and/or the second audio signal based on the detection result, performs noise reduction processing on the third audio signal acquired by the mobile terminal by adopting the target noise signal, and outputs the fourth audio signal, so that the adaptive noise reduction scheme is dynamically selected according to the environment where the mobile terminal is located, the accuracy of noise pickup is improved, and the noise reduction effect is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments of the present invention will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive labor.
Fig. 1 is a schematic hardware configuration diagram of a mobile terminal implementing various embodiments of the present invention;
FIG. 2 is a flow chart of the steps of a method for speech noise reduction according to an embodiment of the present invention;
fig. 3 is a schematic diagram of an earphone structure according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a voltage step-down circuit according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of a superimposing circuit according to an embodiment of the invention;
fig. 6 is a block diagram of a voice noise reduction apparatus according to an embodiment of the present invention;
fig. 7 is a block diagram of a target noise signal extraction module according to an embodiment of the present invention;
fig. 8 is a block diagram of another structure of a target noise signal extraction module according to an embodiment of the present invention;
FIG. 9 is a block diagram of an unoccluded fetch submodule according to an embodiment of the present invention;
fig. 10 is a block diagram of a fourth audio signal output module according to an embodiment of the present invention.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below. It is to be understood that the embodiments described are only a few embodiments of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In the embodiment of the present invention, the mobile terminal includes, but is not limited to, a mobile terminal such as a mobile phone, a tablet computer, a notebook computer, a palm computer, a navigation device, a wearable device, a smart band, a pedometer, and the like.
Fig. 1 is a schematic diagram of a hardware structure of a mobile terminal for implementing various embodiments of the present invention, where the mobile terminal 100 includes but is not limited to: radio frequency unit 101, network module 102, audio output unit 103, (audio/video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111. Those skilled in the art will appreciate that the mobile terminal architecture shown in fig. 1 is not intended to be limiting of mobile terminals, which may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
The following describes each component of the mobile terminal in detail with reference to fig. 1:
the radio frequency unit 101 may be configured to receive and transmit signals during information transmission and reception or during a call, and specifically, receive downlink information of a base station and then process the downlink information to the processor 110; in addition, the uplink data is transmitted to the base station. Typically, radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 can also communicate with a network and other devices through wireless communication. The wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System for mobile communications), GPRS (General packet radio Service), CDMA2000(Code Division multiple Access 2000), WCDMA (Wideband Code Division multiple Access), TD-SCDMA (Time Division-Synchronous Code Division multiple Access), FDD-LTE (Frequency Division duplex Long Term Evolution), TDD-LTE (Time Division duplex Long Term Evolution), Wi-Fi module, NFC module, bluetooth module, and the like.
The mobile terminal may assist the user in sending and receiving e-mail, browsing web pages, accessing streaming media, etc. through the network module 102, which provides the user with wireless broadband internet access, and the network module 102 includes, but is not limited to, RJ45 port module, etc.
The audio output unit 103 may convert audio data received by the radio frequency unit 101 or the network module 102 or stored in the memory 109 into an audio signal and output as sound when the mobile terminal 100 is in a call signal reception mode, a call mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output unit 103 may also provide audio output related to a specific function performed by the mobile terminal 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 103 includes a speaker, a buzzer, a receiver, and the like.
The input unit 104 is used to receive an audio or video signal. The input Unit 104 may include a Graphics Processing Unit (GPU) 1041 and a microphone 1042, and the Graphics processor 1041 processes image data of a still picture or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the graphic processor 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the network module 102. The microphone 1042 may receive sounds (audio data) via the microphone 1042 in a phone call mode, a recording mode, a voice recognition mode, or the like, and may be capable of processing such sounds into audio data. The processed audio (voice) data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 101 in case of a phone call mode.
The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 1061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 1061 and/or a backlight when the mobile terminal 100 is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally, three axes), detect the magnitude and direction of gravity when stationary, and can be used for applications (such as horizontal and vertical screen switching, related games, magnetometer attitude calibration) for recognizing the attitude of the mobile terminal, and related functions (such as pedometer and tapping) for vibration recognition; as for other sensors such as a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured on the mobile terminal, further description is omitted here.
The display unit 106 is used to display information input by a user or information provided to the user. The Display unit 106 may include a Display panel 1061, and the Display panel 1061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.
The user input unit 107 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the mobile terminal. Specifically, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also referred to as a touch screen, may collect a touch operation performed by a user on or near the touch panel 1071 (e.g., an operation performed by the user on or near the touch panel 1071 using a finger, a stylus, or any other suitable object or accessory), and drive a corresponding connection device according to a predetermined program. The touch panel 1071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 110, and can receive and execute commands sent by the processor 110. In addition, the touch panel 1071 may be implemented in various types, such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may include other input devices 1072. In particular, other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like, and are not limited to these specific examples.
Further, the touch panel 1071 may cover the display panel 1061, and when the touch panel 1071 detects a touch operation thereon or nearby, the touch panel 1071 transmits the touch operation to the processor 110 to determine the type of the touch event, and then the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of the touch event. Although the touch panel 1071 and the display panel 1061 are shown in fig. 1 as two separate components to implement the input and output functions of the mobile terminal, in some embodiments, the touch panel 1071 and the display panel 1061 may be integrated to implement the input and output functions of the mobile terminal, and is not limited herein.
The interface unit 108 serves as an interface through which at least one external device is connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from external devices and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal 100 and external devices.
The memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 109 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
The processor 110 is a control center of the mobile terminal, connects various parts of the entire mobile terminal using various interfaces and lines, and performs various functions of the mobile terminal and processes data by operating or executing software programs and/or modules stored in the memory 109 and calling data stored in the memory 109, thereby performing overall monitoring of the mobile terminal. Processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.
The mobile terminal 100 may further include a power supply 111 (e.g., a battery) for supplying power to various components, and preferably, the power supply 111 may be logically connected to the processor 110 via a power management system, so as to manage charging, discharging, and power consumption management functions via the power management system.
In addition, the mobile terminal 100 includes some functional modules that are not shown, and thus, the detailed description thereof is omitted.
Based on the hardware structure of the mobile terminal, the following detailed description will be made of embodiments of the present invention.
Referring to fig. 2, a flowchart illustrating steps of a speech noise reduction method according to an embodiment of the present invention is shown.
The embodiment of the invention can be applied to the mobile terminal, and the mobile terminal can be connected with the earphone.
As an example, the mobile terminal and the headset may communicate by wireless transmission, which may include one or more of the following:
ethernet, Bluetooth, 2.4G wireless network, infrared ray and wireless network protocol ZigBee.
Among them, Ethernet (Ethernet) is a computer local area networking technology, and uses a passive medium to propagate information in a broadcast manner. It specifies the physical layer and data link layer protocols, the interfaces of the physical layer and data link layer and the interfaces of the data link layer with higher layers. The standard topological structure is bus type topology, but the current fast Ethernet (100BASE-T, 1000BASE-T standards) uses the switch (Switchhub) to connect and organize the network in order to reduce the conflict to the maximum extent and improve the network speed and the use efficiency to the maximum extent, so the topological structure of the Ethernet is star-shaped, but logically, the Ethernet still uses the bus type topology and CSMA/CD (Carrier Sense multiple Access/Collision Detect, i.e. Carrier Sense multiple Access with conflict detection) bus contention technology, and the Ethernet is applied, and can adopt WiFi (a wireless local area network device created in IEEE 802.11 standard) to communicate.
Bluetooth, a radio technology that supports short-range communication (typically within 10 m) of devices. The wireless information exchange can be carried out among a plurality of devices such as mobile phones, PDAs, wireless earphones, notebook computers and related peripherals. By using the bluetooth technology, the communication between mobile communication terminal devices can be effectively simplified, and the communication between the devices and the Internet can also be successfully simplified, so that the data transmission becomes faster and more efficient, and the way is widened for wireless communication. Bluetooth adopts a distributed network structure and a fast frequency hopping and short packet technology, supports point-to-point and point-to-multipoint communication, and works in a global universal 2.4GHz ISM (industrial, scientific and medical) frequency band. The data rate is 1 Mbps. And the full duplex transmission is realized by adopting a time division duplex transmission scheme.
The 2.4G wireless network frequency band belongs to the ISM frequency band, which is an ultra-low radiation green environment-friendly frequency band widely used in the global range; 125 communication channels are provided, because the 2.4G wireless network communication is smoother, a plurality of communication commands can not interfere with each other; the highest bandwidth transmission rate of the 2.4G wireless grid can reach 108Mbps, so that the transmission speed of the wireless grid is high; its transmission distance is relatively long (open area: 200m effective transmission distance), and it is not affected by transmission party, and supports two-way communication.
Infrared is a wireless communication method, and can transmit wireless data. The infrared communication has the characteristics of low cost, convenient connection, simplicity, easy use and compact structure, so the infrared communication is widely applied to small-sized mobile equipment. Through the infrared interface, various mobile devices can freely exchange data.
The wireless network protocol ZigBee is a wireless network protocol of low-speed short-distance transmission based on the IEEE802.15.4 standard. The protocols are, from bottom to top, a physical layer (PHY), a medium access control layer (MAC), a Transport Layer (TL), a network layer (NWK), an application layer (APL), etc. Wherein the physical layer and the medium access control layer comply with the provisions of the IEEE802.15.4 standard. The ZigBee network has the main characteristics of low power consumption, low cost, low speed, support of a large number of nodes, support of various network topologies, low complexity, rapidness, reliability and safety. The devices in the ZigBee network can be divided into three roles, namely, a Coordinator (Coordinator), a sink node (Router), a sensor node (end device), and the like.
Of course, the above transmission manner is only an example, and when implementing the embodiment of the present invention, other transmission manners may be set according to actual situations, which is not limited in the embodiment of the present invention.
Specifically, the embodiment of the present invention may include the following steps:
when a user uses the earphone to collect voice, such as making a call and sending voice information, or uses the earphone to play audio, such as playing music, a preset chip in the mobile terminal can collect noise in the environment through the sound collecting hole to obtain a first audio signal.
The preset chip may be an existing chip in the mobile terminal, or an added Active Noise reduction chip, which may implement the function of ANC (Active Noise Control, Active Noise Control system), the first audio signal may include an audio signal collected by a first sound receiving hole located in the mobile terminal, and the first sound receiving hole may be located at the top of the mobile terminal, and is used to collect Noise in the environment.
as shown in fig. 3, the earphone may have a second sound-receiving hole 301, a third sound-receiving hole 302, the second sound-receiving hole 301 may be located at the top of the earphone for collecting noise in the environment, and the third sound-receiving hole 302 may be located at a position in the earphone convenient for collecting voice of the user, such as near the mouth.
The earphone can acquire the noise in the environment through the second sound pickup hole 301 to obtain a second audio signal, and then send the second audio signal to the mobile terminal, so that the mobile terminal can acquire the second audio signal.
in the embodiment of the invention, the mobile terminal can detect whether the mobile terminal and the earphone are shielded or not through the infrared sensor so as to determine whether the mobile terminal and the earphone are in the same sound receiving environment or not, thereby dynamically selecting a suitable noise reduction scheme according to the environment, improving the accuracy of noise pickup and improving the noise reduction effect.
after detecting whether the mobile terminal is occluded, the mobile terminal may select to extract the target noise signal from the first audio signal, or the second audio signal, or both the first audio signal and the second audio signal based on a result of the detection.
In one embodiment, step 204 may include the following sub-steps:
and a substep S11, extracting a target noise signal from the second audio signal when the mobile terminal is detected to be blocked.
In the embodiment of the invention, when the mobile terminal is detected to be shielded, the mobile terminal and the earphone are not in the same sound receiving environment, and the first audio signal collected by the mobile terminal cannot accurately reflect the noise in the environment, the target noise signal can be directly extracted from the second audio signal collected by the earphone.
Of course, if both the mobile terminal and the headset are blocked, the noise reduction process may not be performed.
In another embodiment, step 204 may include the following sub-steps:
a substep S21, determining a first variation value of the intensity of the noise signal contained in the first audio signal within a preset time and a second variation value of the intensity of the noise signal contained in the second audio signal within a preset time when it is detected that the mobile terminal is not blocked;
in the embodiment of the present invention, when it is not detected that the mobile terminal is not shielded, and the mobile terminal and the earphone are in the same sound receiving environment, it can be further determined whether the sound receiving environment of the mobile terminal and the earphone has sudden changes, such as a sound receiving hole is touched, sudden explosion sound, and the like.
In a specific implementation, the mobile terminal may obtain intensities of noise signals included in the first audio signal and the second audio signal at a certain time point, and obtain intensities of the noise signals included in the first audio signal and the second audio signal after a preset time, so as to obtain a first change value of the intensity of the noise signal included in the first audio signal within the preset time, and a second change value of the intensity of the noise signal included in the second audio signal within the preset time.
In practice, the audio signal may be an electrical signal, the intensity of the noise signal included therein may be a voltage value of the noise signal, and the first variation value and the second variation value may be variation values of the voltage.
As an example, the terminal may detect the voltage of the noise signal included in the first audio signal and the second audio signal by using a power coupler in a preset radio frequency circuit, detect the voltage of the noise signal included in the first audio signal and the second audio signal after a preset time, for example, after 10ms, and then calculate the first variation value and the second variation value.
A sub-step S22 of extracting a target noise signal from the first audio signal and/or the second audio signal based on the first variation value and the second variation value.
After obtaining the first variation value and the second variation value, the mobile terminal may extract a target noise signal from the first audio signal and/or the second audio signal.
Specifically, the method may include the following sub-steps:
substep S221, when both the first variation value and the second variation value are smaller than or larger than a preset variation value, obtaining an average signal after superimposing the first audio signal and the second audio signal, and extracting a target noise signal from the average signal;
after the first change value and the second change value are determined, the terminal may compare the first change value and the second change value with a preset change value, and when both of the first change value and the second change value are smaller than or larger than the preset change value, that is, the sound receiving environments of the terminal and the earphone are normal or both have sudden changes, such as sudden explosion sound, the first audio signal and the second audio signal may be superimposed, an average signal of the superimposed audio signals may be obtained, and then the target noise signal may be extracted from the average signal.
In a specific implementation, the sub-step S221 may include the following sub-steps:
substep S2211, superimposing the first audio signal and the second audio signal to obtain a superimposed noise signal;
when the target noise signal needs to be extracted from the first audio signal and the second audio signal, the mobile terminal may superimpose the first audio signal and the second audio signal to obtain a superimposed noise signal.
Substep S2212, averaging the superimposed noise signal;
after obtaining the superimposed noise signal, the mobile terminal may average the superimposed noise signal.
In practical applications, the superimposed noise signal may be an electrical signal, the terminal may be preset with a voltage reduction circuit, as shown in fig. 4, the resistances of the resistor R1 and the resistor R2 are set to be the same, such as 100 ohms, after the superimposed noise signal is obtained, the mobile terminal may input the superimposed noise signal into the voltage reduction circuit, and output an average signal having a voltage of half of the superimposed noise signal.
And a substep S2213 of extracting a target noise signal from the averaged signal.
After obtaining the average signal, the mobile terminal may train the average signal, and extract a signal with a specific frequency from the average signal as the target noise signal.
A substep S222, extracting a target noise signal from the second audio signal when the first variation value is greater than the preset variation value and the second variation value is less than the preset variation value;
in the embodiment of the present invention, the terminal is provided with a preset variation value, if the preset variation value is 5mV in voltage, when it is detected that the first variation value is greater than the preset variation value and the second variation value is smaller than the preset variation value, that is, the sound receiving environment of the terminal changes suddenly, and if the first sound receiving hole is touched and the sound receiving environment of the earphone is normal, the target noise signal is extracted from the second audio signal acquired by the earphone.
And a substep S223 of extracting a target noise signal from the first audio signal when the first variation value is smaller than the preset variation value and the second variation value is larger than the preset variation value.
When the first change value is smaller than the preset change value and the second change value is larger than the preset change value, namely, the sound receiving environment of the earphone is suddenly changed, if the second sound receiving hole is touched and the sound receiving environment of the terminal is normal, the target noise signal is extracted from the first audio signal collected by the terminal.
In the embodiment of the invention, whether the mobile terminal and the earphone are in the same sound receiving environment is determined by detecting whether the mobile terminal is shielded, and when the mobile terminal is shielded, the second audio signal acquired by the earphone is directly adopted as the target noise signal, so that the interference of the first audio signal acquired when the mobile terminal is shielded is eliminated.
When the mobile terminal is not shielded and the mobile terminal and the earphone are in the same sound receiving environment, the championship is needed to determine whether the sound receiving environments of the mobile terminal and the earphone are suddenly changed, by determining the transformation value of the intensity of the noise signal contained in the first audio signal and the second audio signal within the preset time, when the intensity of the noise signal is smaller than or larger than the preset transformation value, that is, the mobile terminal and the earphone are in the same sound receiving environment, the average value of the intensity of the first audio signal and the noise signal contained in the first audio signal is taken to obtain the target noise signal, when only one is larger than the preset variation value, namely, the sound receiving environment of the mobile terminal or the earphone changes suddenly, the noise signal contained by the party which is not greater than the preset change value is taken as the target noise signal, so that the sound receiving strategy of dynamic adjustment according to different sound receiving environments is realized, and the accuracy of receiving the environmental noise is improved.
In an implementation manner, the third audio signal acquired by the mobile terminal may be an audio signal acquired by an earphone, and may include an audio signal acquired by a third sound receiving hole located in the earphone, for example, the earphone acquires voice of a user when a call is made, the terminal may perform noise reduction processing on the third audio signal by using a target noise signal to obtain a fourth audio signal, and then send the fourth audio signal through an antenna of the mobile terminal, for example, send the fourth audio signal to a telephone of an opposite terminal.
In another embodiment, the third audio signal acquired by the mobile terminal may be an audio signal to be sent to an earphone, for example, music to be played in the earphone when listening to music, and the mobile terminal may perform noise reduction processing on the third audio signal by using a target noise signal to obtain a fourth audio signal, and send the fourth audio signal to the earphone, so as to cancel noise in the environment, and enable the user to hear the clearer third audio signal.
Specifically, step 205 may include the following sub-steps:
a substep S31 of determining the phase and intensity of the target noise signal;
since the target noise signal may be an electrical signal having a phase and a strength, the terminal may determine the phase and the strength of the target noise signal.
A substep S32 of generating a noise reduction signal having the same intensity and an opposite phase to the target noise signal;
after the phase and the intensity of the target noise signal are determined, the terminal performs phase inversion processing on the target noise signal to generate a noise reduction signal which is opposite to the phase of the target noise signal and has the same intensity.
The inversion processing may be a process of changing a to-a, the terminal may have a large number of processing chips, the chips may include a large number of logic circuits, and may complete operations such as addition, subtraction, multiplication, division, and the like, and the terminal may complete the inversion processing through the logic circuits.
And a substep S33, superimposing the noise reduction signal with the third audio signal obtained by the terminal, and outputting a fourth audio signal.
After the noise reduction signal is generated, the noise reduction signal is an electrical signal, and the terminal may input the noise reduction signal and a third audio signal acquired by the terminal into a superimposing circuit through a preset superimposing circuit, as shown in fig. 5, and output a fourth audio signal.
In fig. 5, V1 is the input third audio signal, V2 is the input noise reduction signal, V0 is the output fourth audio signal, R, RfFor resistance, LM741 is a general-purpose operational amplifier integrated circuit.
In the embodiment of the invention, the mobile terminal receives the second audio signal sent by the connected earphone by acquiring the first audio signal, then detects whether the mobile terminal is blocked, extracts the target noise signal from the first audio signal and/or the second audio signal based on the detection result, performs noise reduction processing on the third audio signal acquired by the mobile terminal by adopting the target noise signal, and outputs the fourth audio signal, so that the adaptive noise reduction scheme is dynamically selected according to the environment where the mobile terminal is located, the accuracy of noise pickup is improved, and the noise reduction effect is improved.
Referring to fig. 6, a block diagram of a structure of an audio noise reduction apparatus according to an embodiment of the present invention is shown, and is applied to a terminal, where a mobile terminal is connected to an earphone, and the audio noise reduction apparatus may specifically include the following modules:
a first audio signal acquisition module 601, configured to acquire a first audio signal;
a second audio signal obtaining module 602, configured to receive a second audio signal sent by the earphone;
an occlusion detection module 603, configured to detect whether the mobile terminal is occluded;
a target noise signal extraction module 604, configured to extract a target noise signal from the first audio signal and/or the second audio signal based on a result of the detection;
a fourth audio signal output module 605, configured to perform noise reduction processing on the third audio signal acquired by the mobile terminal by using the target noise signal, and output a fourth audio signal; the third audio signal is an audio signal collected by the earphone or an audio signal to be sent to the earphone.
In a preferred embodiment of the present invention, as shown in fig. 7, the target noise signal extraction module 604 includes:
an occlusion extraction sub-module 6041 configured to, when it is detected that the mobile terminal is occluded, extract a target noise signal from the second audio signal.
In a preferred embodiment of the present invention, as shown in fig. 8, the target noise signal extraction module 604 includes:
a variation value determining submodule 6042, configured to determine, when it is detected that the mobile terminal is not shielded, a first variation value of the intensity of the noise signal included in the first audio signal within a preset time, and a second variation value of the intensity of the noise signal included in the second audio signal within the preset time;
an unobstructed extraction sub-module 6043 for extracting a target noise signal from the first audio signal and/or the second audio signal based on the first transform value and the second transform value.
In a preferred embodiment of the present invention, as shown in fig. 9, the unoccluded extraction sub-module 6043 includes:
a first target noise signal extraction unit 60431, configured to, when both the first variation value and the second variation value are smaller than or greater than a preset variation value, sum the first audio signal and the second audio signal, and then obtain an average signal, and extract a target noise signal from the average signal;
a second target noise signal extraction unit 60432 configured to extract a target noise signal from the second audio signal when the first variation value is larger than the preset variation value and the second variation value is smaller than the preset variation value;
a third target noise signal extraction unit 60433, configured to extract a target noise signal from the first audio signal when the first variation value is smaller than the preset variation value and the second variation value is larger than the preset variation value.
In a preferred embodiment of the present invention, as shown in fig. 10, the fourth audio signal output module 605 includes:
a phase strength determination sub-module 6051 for determining the phase and strength of the target noise signal;
a noise reduction signal generation sub-module 6052 configured to generate a noise reduction signal having an opposite phase and the same intensity as the target noise signal;
and a superposition output sub-module 6053, configured to superimpose the noise reduction signal and the third audio signal, and output a fourth audio signal.
The mobile terminal provided in the embodiment of the present invention can implement each process implemented by the mobile terminal in the method embodiment of fig. 2, and is not described here again in order to avoid repetition.
In the embodiment of the invention, the mobile terminal receives the second audio signal sent by the connected earphone by acquiring the first audio signal, then detects whether the mobile terminal is blocked, extracts the target noise signal from the first audio signal and/or the second audio signal based on the detection result, performs noise reduction processing on the third audio signal acquired by the mobile terminal by adopting the target noise signal, and outputs the fourth audio signal, so that the adaptive noise reduction scheme is dynamically selected according to the environment where the mobile terminal is located, the accuracy of noise pickup is improved, and the noise reduction effect is improved.
Preferably, an embodiment of the present invention further provides a mobile terminal, which includes a processor 110, a memory 109, and a computer program stored in the memory 109 and capable of running on the processor 110, where the computer program, when executed by the processor 110, implements each process of the foregoing voice noise reduction method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not described here again.
An embodiment of the present invention further provides a computer-readable storage medium, where an information processing program is stored on the computer-readable storage medium, and when the information processing program is executed by a processor, the information processing program implements each process of the foregoing speech noise reduction method embodiment, and can achieve the same technical effect, and in order to avoid repetition, the details are not repeated here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (12)
1. An audio noise reduction method is applied to a mobile terminal, and the mobile terminal is connected with an earphone, and is characterized in that the method comprises the following steps:
collecting a first audio signal; the first audio information is an audio signal acquired through a first sound receiving hole of the mobile terminal, and the first sound receiving hole is used for acquiring noise in the environment;
receiving a second audio signal sent by the earphone; the second audio information is an audio signal collected through a second sound collecting hole of the earphone, and the second sound collecting hole is used for collecting noise in the environment;
detecting whether the mobile terminal is shielded;
extracting a target noise signal from the first audio signal and/or the second audio signal based on a result of the detecting;
performing noise reduction processing on a third audio signal acquired by the mobile terminal by using the target noise signal, and outputting a fourth audio signal; the third audio signal is an audio signal collected through a third sound receiving hole of the earphone or an audio signal to be sent to the earphone.
2. The method according to claim 1, wherein the step of extracting a target noise signal from the first audio signal and/or the second audio signal based on the result of the detection comprises:
and when the mobile terminal is detected to be shielded, extracting a target noise signal from the second audio signal.
3. The method according to claim 1, wherein the step of extracting a target noise signal from the first audio signal and/or the second audio signal based on the result of the detection comprises:
when the mobile terminal is detected not to be shielded, determining a first change value of the intensity of the noise signal contained in the first audio signal in a preset time and a second change value of the intensity of the noise signal contained in the second audio signal in the preset time;
extracting a target noise signal from the first audio signal and/or the second audio signal based on the first variation value and the second variation value.
4. The method according to claim 3, wherein the step of extracting a target noise signal from the first audio signal and/or the second audio signal based on the first variation value and the second variation value comprises:
when the first change value and the second change value are both smaller than or larger than a preset change value, superposing the first audio signal and the second audio signal, then taking an average signal, and extracting a target noise signal from the average signal;
when the first change value is larger than the preset change value and the second change value is smaller than the preset change value, extracting a target noise signal from the second audio signal;
and when the first change value is smaller than the preset change value and the second change value is larger than the preset change value, extracting a target noise signal from the first audio signal.
5. The method according to claim 1, wherein the step of performing noise reduction processing on the third audio signal acquired by the mobile terminal by using the target noise signal and outputting a fourth audio signal comprises:
determining a phase and a strength of the target noise signal;
generating a noise reduction signal having an opposite phase and the same intensity as the target noise signal;
and superposing the noise reduction signal and the third audio signal to output a fourth audio signal.
6. An audio noise reduction device applied to a mobile terminal connected with an earphone, the device comprising:
the first audio signal acquisition module is used for acquiring a first audio signal; the first audio information is an audio signal acquired through a first sound receiving hole of the mobile terminal, and the first sound receiving hole is used for acquiring noise in the environment;
the second audio signal acquisition module is used for receiving a second audio signal sent by the earphone; the second audio information is an audio signal collected through a second sound collecting hole of the earphone, and the second sound collecting hole is used for collecting noise in the environment;
the shielding detection module is used for detecting whether the mobile terminal is shielded or not;
a target noise signal extraction module for extracting a target noise signal from the first audio signal and/or the second audio signal based on a result of the detection;
the fourth audio signal output module is used for performing noise reduction processing on the third audio signal acquired by the mobile terminal by adopting the target noise signal and outputting a fourth audio signal; the third audio signal is an audio signal collected through a third sound receiving hole of the earphone or an audio signal to be sent to the earphone.
7. The apparatus of claim 6, wherein the target noise signal extraction module comprises:
and the occlusion extraction submodule is used for extracting a target noise signal from the second audio signal when the mobile terminal is detected to be occluded.
8. The apparatus of claim 6, wherein the target noise signal extraction module comprises:
the change value determining submodule is used for determining a first change value of the intensity of the noise signal contained in the first audio signal in a preset time and a second change value of the intensity of the noise signal contained in the second audio signal in the preset time when the mobile terminal is detected not to be shielded;
an unobstructed extraction sub-module for extracting a target noise signal from the first audio signal and/or the second audio signal based on the first variance value and the second variance value.
9. The apparatus of claim 8, wherein the unoccluded extraction sub-module comprises:
the first target noise signal extraction unit is used for superposing the first audio signal and the second audio signal and then obtaining an average signal when the first change value and the second change value are both smaller than or larger than a preset change value, and extracting a target noise signal from the average signal;
a second target noise signal extracting unit, configured to extract a target noise signal from the second audio signal when the first variation value is greater than the preset variation value and the second variation value is less than the preset variation value;
a third target noise signal extracting unit, configured to extract a target noise signal from the first audio signal when the first variation value is smaller than the preset variation value and the second variation value is larger than the preset variation value.
10. The apparatus of claim 6, wherein the fourth audio signal output module comprises:
a phase strength determination submodule for determining a phase and strength of the target noise signal;
the noise reduction signal generation submodule is used for generating a noise reduction signal which is opposite to the phase of the target noise signal and has the same intensity;
and the superposition output submodule is used for superposing the noise reduction signal and the third audio signal and outputting a fourth audio signal.
11. A mobile terminal, characterized in that it comprises a processor, a memory and a computer program stored on the memory and executable on the processor, which computer program, when executed by the processor, implements the steps of the audio noise reduction method according to any of claims 1 to 5.
12. A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, which computer program, when being executed by a processor, carries out the steps of the audio noise reduction method according to any of the claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710523438.1A CN107360318B (en) | 2017-06-30 | 2017-06-30 | Voice noise reduction method and device, mobile terminal and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710523438.1A CN107360318B (en) | 2017-06-30 | 2017-06-30 | Voice noise reduction method and device, mobile terminal and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107360318A CN107360318A (en) | 2017-11-17 |
| CN107360318B true CN107360318B (en) | 2020-01-14 |
Family
ID=60273499
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710523438.1A Active CN107360318B (en) | 2017-06-30 | 2017-06-30 | Voice noise reduction method and device, mobile terminal and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107360318B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107995060B (en) * | 2017-11-29 | 2021-11-16 | 努比亚技术有限公司 | Mobile terminal audio test method and device and computer readable storage medium |
| US10354641B1 (en) * | 2018-02-13 | 2019-07-16 | Bose Corporation | Acoustic noise reduction audio system having tap control |
| CN109166567A (en) * | 2018-10-09 | 2019-01-08 | 安徽信息工程学院 | A kind of noise-reduction method and equipment |
| CN109391870B (en) * | 2018-11-10 | 2021-01-15 | 上海麦克风文化传媒有限公司 | Method for automatically adjusting earphone audio signal playing based on human motion state |
| CN113542960B (en) * | 2021-07-13 | 2023-07-14 | RealMe重庆移动通信有限公司 | Audio signal processing method, system, device, electronic equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20100021199A (en) * | 2008-08-14 | 2010-02-24 | 최영순 | Mobile phone headset with sound insulation |
| CN103888876A (en) * | 2014-03-31 | 2014-06-25 | 深圳市冠旭电子有限公司 | Earphone noise processing circuit and earphones |
| CN105489212A (en) * | 2014-09-17 | 2016-04-13 | 中兴通讯股份有限公司 | Downlink active noise reduction device and method, and mobile terminal |
| CN105551479A (en) * | 2015-12-22 | 2016-05-04 | 努比亚技术有限公司 | Mobile terminal noise reduction method and apparatus thereof |
| CN105744429A (en) * | 2016-05-17 | 2016-07-06 | 乐视控股（北京）有限公司 | Headset noise reduction method based on mobile terminal, mobile terminal and noise reduction headset |
| CN106101909A (en) * | 2016-08-26 | 2016-11-09 | 维沃移动通信有限公司 | A kind of method of earphone noise reduction and mobile terminal |
-
2017
- 2017-06-30 CN CN201710523438.1A patent/CN107360318B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20100021199A (en) * | 2008-08-14 | 2010-02-24 | 최영순 | Mobile phone headset with sound insulation |
| CN103888876A (en) * | 2014-03-31 | 2014-06-25 | 深圳市冠旭电子有限公司 | Earphone noise processing circuit and earphones |
| CN105489212A (en) * | 2014-09-17 | 2016-04-13 | 中兴通讯股份有限公司 | Downlink active noise reduction device and method, and mobile terminal |
| CN105551479A (en) * | 2015-12-22 | 2016-05-04 | 努比亚技术有限公司 | Mobile terminal noise reduction method and apparatus thereof |
| CN105744429A (en) * | 2016-05-17 | 2016-07-06 | 乐视控股（北京）有限公司 | Headset noise reduction method based on mobile terminal, mobile terminal and noise reduction headset |
| CN106101909A (en) * | 2016-08-26 | 2016-11-09 | 维沃移动通信有限公司 | A kind of method of earphone noise reduction and mobile terminal |
Non-Patent Citations (1)
| Title |
|---|
| 浅谈主动降噪耳机技术;韩国民,李世杰;《数字技术与应用》;20140130;第215页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107360318A (en) | 2017-11-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107360318B (en) | Voice noise reduction method and device, mobile terminal and computer readable storage medium | |
| US11848773B2 (en) | Transmit antenna switching method and terminal device | |
| US11582791B2 (en) | PUCCH collision processing method and terminal | |
| CN108347759B (en) | Anti-interference method of flexible screen and mobile terminal | |
| CN108513347B (en) | Data transmission method and electronic equipment | |
| CN110299936B (en) | Transmitting antenna switching method, terminal equipment and computer readable storage medium | |
| WO2021179966A1 (en) | Signal transmission method, information indication method, and communication device | |
| US11452081B2 (en) | Spatial relationship determination method, terminal and base station | |
| US20230006711A1 (en) | Audio transmission method and electronic device | |
| CN111093137B (en) | Volume control method, volume control equipment and computer readable storage medium | |
| US11375497B2 (en) | Power configuration method and terminal | |
| CN109889214B (en) | Method for reducing SAR value and mobile terminal | |
| CN108540659B (en) | Method, terminal and computer readable storage medium for reducing TDD noise influence | |
| CN111465119A (en) | Data sending method, information configuration method, terminal and network equipment | |
| WO2020169003A1 (en) | Method for sending control signaling, and transmission node | |
| WO2021000778A1 (en) | Uplink transmission discarding method, uplink transmission discarding configuration method and related device | |
| CN110210197B (en) | Screen sensitivity adjusting method and mobile terminal | |
| CN111510075A (en) | Voltage adjusting method and device of power amplifier and electronic equipment | |
| CN110366273B (en) | Communication method and related equipment | |
| WO2021000777A1 (en) | Uplink transmission processing method, information configuration method, and related device | |
| CN111107225B (en) | Interactive communication method and electronic equipment | |
| CN111464962B (en) | Device connection method, first electronic device and operator device | |
| CN112398704B (en) | Virtual network delay calculation method and terminal equipment | |
| US11800545B2 (en) | Control method and terminal | |
| WO2021185117A1 (en) | Audio transmission method and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |