CN115190212A - Call noise reduction method and device based on earphone equipment, earphone equipment and medium - Google Patents
Call noise reduction method and device based on earphone equipment, earphone equipment and medium Download PDFInfo
- Publication number
- CN115190212A CN115190212A CN202210760779.1A CN202210760779A CN115190212A CN 115190212 A CN115190212 A CN 115190212A CN 202210760779 A CN202210760779 A CN 202210760779A CN 115190212 A CN115190212 A CN 115190212A
- Authority
- CN
- China
- Prior art keywords
- wearer
- voice
- mask
- earphone
- call
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M9/00—Arrangements for interconnection not involving centralised switching
- H04M9/08—Two-way loud-speaking telephone systems with means for conditioning the signal, e.g. for suppressing echoes for one or both directions of traffic
- H04M9/082—Two-way loud-speaking telephone systems with means for conditioning the signal, e.g. for suppressing echoes for one or both directions of traffic using echo cancellers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
- H04R1/1091—Details not provided for in groups H04R1/1008 - H04R1/1083
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2420/00—Details of connection covered by H04R, not provided for in its groups
- H04R2420/07—Applications of wireless loudspeakers or wireless microphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2460/00—Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
- H04R2460/13—Hearing devices using bone conduction transducers
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Soundproofing, Sound Blocking, And Sound Damping (AREA)
Abstract
The invention discloses a conversation noise reduction method and device based on earphone equipment, the earphone equipment and a computer readable storage medium, wherein whether a wearer of the earphone equipment outputs voice information is determined by the earphone equipment which is provided with an analog microphone and a bone conduction sensor according to a digital sound signal detected by the bone conduction sensor; if yes, determining whether the wearer correctly wears the mask according to an analog signal obtained by acquiring the voice information by the analog microphone; when the fact that the wearer correctly wears the mask is determined, and the fact that the wearer carries out voice call based on the earphone device is determined, call noise reduction is carried out according to a first voice signal collected by the bone conduction sensor and a second voice signal collected by the analog microphone. By adopting the technical scheme of the invention, whether the user correctly wears the mask can be accurately detected, and noise reduction is carried out on the voice call process of the user using the earphone equipment under the condition that the user wears the mask.
Description
Technical Field
The invention belongs to the technical field of earphone equipment, and particularly relates to a communication noise reduction method and device based on earphone equipment, the earphone equipment and a computer readable storage medium.
Background
Nowadays, wearing a mask is an effective means for daily prevention of rapid virus propagation. On the one hand, however, there are still many social residents in public places who forget to wear the mask and who wear the mask irregularly, which undoubtedly increases the risk of viral infection. On the other hand, when people wear the mask, due to the certain shielding effect of the mask on the normal breathing airflow of people, the sound made by people is quite stuffy, and due to the friction between the speaking mask and the skin of the face and/or beard of people, extra noise can be generated, so that the embodiment is more obvious when people wear the mask to carry out voice call, and especially when users wear TWS (True Wireless Stereo) earphone equipment to carry out call, the sound caused by wearing the mask becomes stuffy and the interference noise generated from time to time can cause the serious reduction of the whole call quality.
Disclosure of Invention
The invention mainly aims to provide a method and a device for reducing the noise of a call based on earphone equipment, the earphone equipment and a computer readable storage medium. Whether the user correctly wears the mask is accurately detected based on the earphone device, and therefore noise reduction is carried out on the process that the user uses the earphone device to carry out voice call under the condition that the user wears the mask, and the call quality is improved.
In order to achieve the above object, the present invention provides a method for reducing noise of a call based on a headset device, where the method for reducing noise of a call based on a headset device is applied to a headset device configured with an analog microphone and a bone conduction sensor, and the method for reducing noise of a call based on a headset device includes:
determining whether a wearer of the earphone device is outputting voice information from the digital sound signal detected by the bone conduction sensor;
if yes, determining whether the wearer correctly wears the mask according to an analog signal obtained by acquiring the voice information by the analog microphone;
when the fact that the mask is worn correctly by the wearer and the fact that the wearer carries out voice call based on the earphone device is determined, call noise reduction is carried out according to a first voice signal collected by the bone conduction sensor and a second voice signal collected by the analog microphone.
Optionally, the step of performing call noise reduction according to the first voice signal collected by the bone conduction sensor and the second voice signal collected by the analog microphone includes:
extracting a low-frequency voice signal from a first voice signal acquired by the bone conduction sensor when the wearer carries out voice call;
extracting a high-frequency voice signal from a second voice signal acquired by the analog microphone when the wearer carries out voice communication;
and mixing the low-frequency voice signal and the high-frequency voice signal into 1-path voice data to be output so as to reduce the noise of the call.
Optionally, the step of determining whether the wearer of the earphone device is outputting voice information from the digital sound signal detected by the bone conduction sensor comprises:
acquiring a digital sound signal detected by the bone conduction sensor, and performing voice recognition on the digital sound signal;
determining that a wearer of the headset device is outputting voice information upon voice recognition of the digital sound signal to detect voice information from the digital sound signal.
Optionally, the step of determining whether the mask is worn correctly by the wearer according to the analog signal obtained by collecting the voice information by the analog microphone includes:
acquiring an analog signal acquired by the analog microphone aiming at the voice information continuously output by the wearer;
and determining whether the wearer correctly wears the mask according to the ratio relation between the high-frequency energy and the low-frequency energy in the analog signal.
Optionally, the step of determining whether the mask is worn correctly by the wearer according to a ratio between high-frequency energy and low-frequency energy in the analog signal includes:
after carrying out fast Fourier transform on the analog signal, respectively calculating high-frequency energy and low-frequency energy in the analog signal, and determining the ratio relationship between the high-frequency energy and the low-frequency energy;
if the proportion relationship is that the low-frequency energy proportion exceeds a preset threshold value, determining that the wearer correctly wears the mask;
if the proportion relationship is that the low-frequency energy proportion exceeds a preset threshold value, determining that the wearer does not wear the mask or does not wear the mask correctly.
Optionally, after the step of determining whether the wearer is wearing the mask correctly according to the analog signal obtained by collecting the voice information by the analog microphone, the method further comprises:
and when the wearer is determined not to wear the mask or not to wear the mask correctly, outputting a prompt voice for reminding the wearer of wearing the mask according to the standard through a loudspeaker of the earphone device.
Optionally, the headset device establishes a bluetooth connection with the mobile terminal in advance, and the method further includes:
and when receiving a voice Bluetooth signal transmitted by the mobile terminal through the Bluetooth connection, determining that the wearer is currently carrying out voice call based on the earphone equipment.
In addition, in order to achieve the above object, the present invention further provides a conversation noise reduction apparatus based on an earphone device, where the conversation noise reduction apparatus based on the earphone device is applied to an earphone device configured with an analog microphone and a bone conduction sensor, and the conversation noise reduction apparatus based on the earphone device includes:
the mask detection module is used for determining whether a wearer of the earphone device outputs voice information according to the digital sound signals detected by the bone conduction sensor; if yes, determining whether the wearer correctly wears the mask according to a simulation signal obtained by collecting the voice information by the simulation microphone;
and the conversation noise reduction module is used for determining that the wearer correctly wears the mask and determining that the wearer can make a conversation noise reduction according to the first voice signal acquired by the bone conduction sensor and the second voice signal acquired by the analog microphone when making a voice conversation based on the earphone equipment.
The steps of the control method for monitoring the movement of the wireless earphone are realized when each functional module of the conversation noise reduction device based on the earphone equipment runs.
Further, to achieve the above object, the present invention also provides an earphone device including: the control program of the motion monitoring of the wireless headset realizes the steps of the control method of the motion monitoring motion of the wireless headset as described above when the control program of the motion monitoring of the wireless headset is executed by the processor.
In addition, to achieve the above object, the present invention also provides a computer readable storage medium, on which a call noise reduction program based on an earphone device is stored, and when being executed by a processor, the call noise reduction program based on an earphone device realizes the steps of the call noise reduction method based on an earphone device as described above.
The embodiment of the invention provides a communication noise reduction method and device based on earphone equipment, the earphone equipment and a computer readable storage medium, wherein whether a wearer of the earphone equipment outputs voice information or not is determined by the earphone equipment provided with an analog microphone and a bone conduction sensor according to a digital sound signal detected by the bone conduction sensor; if yes, determining whether the wearer correctly wears the mask according to an analog signal obtained by acquiring the voice information by the analog microphone; when the fact that the wearer correctly wears the mask is determined, and the fact that the wearer carries out voice call based on the earphone device is determined, call noise reduction is carried out according to a first voice signal collected by the bone conduction sensor and a second voice signal collected by the analog microphone.
Therefore, the embodiment of the invention realizes that whether the user correctly wears the mask is accurately detected through the bone conduction sensor and the analog microphone, and further, under the condition that the user wears the mask, the noise of the voice signal in the voice call process of the user using the earphone equipment is reduced through the bone conduction sensor and the analog microphone respectively, so that the voice quality of the user for calling based on the earphone equipment is improved through the little brother.
Drawings
Fig. 1 is a schematic diagram of a device structure of a hardware operating environment of an earphone device according to an embodiment of the present invention;
fig. 2 is a schematic flowchart of a first embodiment of a call noise reduction method based on an earphone device according to the present invention;
fig. 3 is a schematic flow diagram illustrating mask wearing detection according to an embodiment of a method for reducing noise in a call based on an earphone device according to the present invention;
fig. 4 is a schematic flow chart illustrating call noise reduction according to an embodiment of the call noise reduction method based on an earphone device of the present invention;
fig. 5 is a schematic functional block diagram of a communication noise reduction apparatus based on an earphone device according to an embodiment of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and do not limit the invention.
Referring to fig. 1, fig. 1 is a schematic device structure diagram of a hardware operating environment of a headset device according to an embodiment of the present invention.
The earphone device according to the embodiment of the present invention may specifically be an earphone device such as a bluetooth earphone, a TWS (True Wireless Stereo) earphone, and the earphone device is internally equipped with an analog MIC — an analog microphone and a VPU (Voice Pick Unit) bone conduction sensor.
As shown in fig. 1, the earphone device may include: a processor 1001, such as a CPU, a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. The communication bus 1002 is used to implement connection communication among these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., a Wi-Fi interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory such as a disk memory. The memory 1005 may alternatively be a storage device separate from the processor 1001.
It will be appreciated by those skilled in the art that the earphone device configuration shown in fig. 1 does not constitute a limitation of the earphone device, and may include more or fewer components than those shown, or some components in combination, or a different arrangement of components.
As shown in fig. 1, a memory 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and a call noise reduction program based on a headphone device.
In the terminal shown in fig. 1, the network interface 1004 is mainly used for connecting a background server and communicating data with the background server; the user interface 1003 is mainly used for connecting a client and performing data communication with the client; and the processor 1001 may be configured to call the earphone device-based call noise reduction program stored in the memory 1005, and perform the following operations:
determining whether a wearer of the earphone device is outputting voice information from the digital sound signal detected by the bone conduction sensor;
if yes, determining whether the wearer correctly wears the mask according to a simulation signal obtained by collecting the voice information by the simulation microphone;
when the fact that the wearer correctly wears the mask is determined, and the fact that the wearer carries out voice call based on the earphone device is determined, call noise reduction is carried out according to a first voice signal collected by the bone conduction sensor and a second voice signal collected by the analog microphone.
Optionally, the processor 1001 may be further configured to call a call noise reduction program based on the headset device stored in the memory 1005, and perform the following operations:
extracting a low-frequency voice signal from a first voice signal acquired by the bone conduction sensor when the wearer carries out voice communication;
extracting a high-frequency voice signal from a second voice signal acquired by the analog microphone when the wearer carries out voice communication;
and mixing the low-frequency voice signal and the high-frequency voice signal into 1-path voice data to be output so as to reduce the noise of the call.
Optionally, the processor 1001 may be further configured to call a call noise reduction program based on the earphone device stored in the memory 1005, and perform the following operations:
acquiring a digital sound signal detected by the bone conduction sensor, and performing voice recognition on the digital sound signal;
determining that a wearer of the headset device is outputting voice information upon voice recognition of the digital sound signal to detect voice information from the digital sound signal.
Optionally, the processor 1001 may be further configured to call a call noise reduction program based on the headset device stored in the memory 1005, and perform the following operations:
acquiring an analog signal acquired by the analog microphone aiming at the voice information continuously output by the wearer;
and determining whether the wearer correctly wears the mask according to the ratio relation between the high-frequency energy and the low-frequency energy in the analog signal.
Optionally, the processor 1001 may be further configured to call a call noise reduction program based on the headset device stored in the memory 1005, and perform the following operations:
after carrying out fast Fourier transform on the analog signal, respectively calculating high-frequency energy and low-frequency energy in the analog signal, and determining the ratio relation between the high-frequency energy and the low-frequency energy;
if the proportion relation is that the low-frequency energy proportion exceeds a preset threshold value, determining that the wearer correctly wears the mask;
and if the proportion relation is that the low-frequency energy proportion exceeds a preset threshold value, determining that the wearer does not wear the mask or does not wear the mask correctly.
Optionally, the processor 1001 may be further configured to call a call noise reduction program based on an earphone device stored in the memory 1005, and after the step of determining whether the wearer correctly wears the mask according to the analog signal obtained by collecting the voice information by the analog microphone is performed, further perform the following operations:
and when the wearer is determined not to wear the mask or not to wear the mask correctly, outputting a prompt voice for reminding the wearer of wearing the mask according to the standard through a loudspeaker of the earphone device.
Optionally, the headset device establishes a bluetooth connection with the mobile terminal in advance, and the processor 1001 may be further configured to call a call noise reduction program based on the headset device stored in the memory 1005, and perform the following operations:
and when receiving a voice Bluetooth signal transmitted by the mobile terminal through the Bluetooth connection, determining that the wearer is currently carrying out voice call based on the earphone equipment.
Based on the earphone device, the invention provides various embodiments of the call noise reduction method based on the earphone device. In each embodiment of the motion monitoring method of the wireless headset, the communication noise reduction method based on the headset device is applied to the headset device provided with the analog microphone and the bone conduction sensor.
Referring to fig. 2, fig. 2 is a flowchart illustrating a first embodiment of a method for reducing noise in a call based on an earphone device according to the present invention. In a first embodiment of the conversation noise reduction method based on the earphone device, the conversation noise reduction method based on the earphone device comprises the following steps:
step S10: determining whether a wearer of the earphone device is outputting voice information according to the digital sound signal detected by the bone conduction sensor;
in the embodiment, the earphone device continuously collects the data sound signal generated by the wearer through the bone conduction sensor configured in the earphone device during the whole process of detecting and determining to be worn, and then determines whether the wearer is outputting the voice information at the current time or not based on the collected digital sound signal.
It should be noted that, in this embodiment, since the digital sound signal collected by the VPU bone conduction sensor is from the skull, that is, the transmission channel of the VPU bone conduction sensor and the transmission channel of the ordinary microphone for collecting the air medium sound wave are different, and the sound wave collected by the VPU bone conduction sensor is hardly affected by wearing a mask and is more suitable for the detection operation of voice recognition than the ordinary microphone. Based on the method, the earphone device performs signal processing through the VPU bone conduction sensor to assist the MIC analog microphone to identify the wearing state of the mask by the wearer and reduce noise of mask friction interference sound in the subsequent conversation process of the wearer.
Further, in some possible embodiments, step S10 may include:
step S101, acquiring a digital sound signal detected by the bone conduction sensor, and performing voice recognition on the digital sound signal;
step S102, determining that the wearer of the earphone device is outputting voice information when performing voice recognition on the digital sound signal to detect voice information from the digital sound signal.
In this embodiment, when the earphone device continuously collects a digital sound signal generated by a wearer of the earphone device through a bone conduction sensor configured for the earphone device, the earphone device first obtains the digital sound signal collected by the bone conduction sensor in real time, and then performs voice recognition on the digital sound signal through an algorithm module of the earphone device. As such, the ear speaker device immediately determines that the wearer is outputting voice information at the present moment when voice information uttered by the wearer is recognized from among the digital sound signals by performing voice recognition on the digital sound signals.
Furthermore, in some possible embodiments, if the headset device does not recognize voice information from the digital sound signal during the voice recognition process of the digital signal collected by the bone conduction sensor, the headset device will determine that the wearer is not currently outputting voice information.
Step S20, if yes, determining whether the wearer correctly wears the mask according to an analog signal obtained by acquiring the voice information by the analog microphone;
in this embodiment, after determining that the wearer of the earphone device is outputting the voice information at the current time based on the digital sound signal acquired by the bone conduction sensor, the earphone device further determines whether the wearer correctly wears the mask at the current time according to the analog signal acquired by the analog microphone configured by the earphone device for the voice information output by the wearer.
Further, in some possible embodiments, the step S20 may include:
step S201, acquiring an analog signal acquired by the analog microphone aiming at the voice information continuously output by the wearer;
in this embodiment, after determining that the wearer of the earphone device is outputting the voice information at the current time according to the digital sound signal acquired by the bone conduction sensor, the earphone device immediately acquires the analog microphone configured by the earphone device to acquire the voice information continuously output by the wearer, so as to obtain the analog signal.
And step S202, determining whether the wearer correctly wears the mask according to the ratio relation between the high-frequency energy and the low-frequency energy in the analog signal.
In this embodiment, after acquiring an analog signal obtained by acquiring voice information continuously output by a wearer through an analog microphone, immediately performing fast fourier transform on the analog signal to obtain a frequency domain, calculating high-frequency energy and low-frequency energy in the analog signal, and calculating a ratio relationship between the high-frequency energy and the low-frequency energy, so as to determine whether the wearer correctly wears a mask at the current time based on the ratio relationship.
In this embodiment, after fast fourier transforming the model signal collected by the analog microphone into the frequency domain, the headphone apparatus calculates the high-frequency energy (greater than 4 KHZ) and the low-frequency energy (less than 4 KHZ) with the frequency of 4KHZ as the threshold.
Further, in some possible embodiments, the step S202 may specifically include:
step S2021, performing fast Fourier transform on the analog signal, then respectively calculating high-frequency energy and low-frequency energy in the analog signal, and determining a ratio relationship between the high-frequency energy and the low-frequency energy;
step S2022, if the proportion relation is that the proportion of the low-frequency energy exceeds a preset threshold value, determining that the wearer wears the mask correctly;
step S2022, if the proportion relationship is that the low-frequency energy proportion exceeds a preset threshold, determining that the wearer does not wear the mask or does not wear the mask correctly.
In this embodiment, after the earphone device performs fast fourier transform on an analog signal collected by an analog microphone to a frequency domain, and calculates high-frequency energy and low-frequency energy in the analog signal, and calculates a ratio relationship between the high-frequency energy and the low-frequency energy, if the ratio relationship calculated by the earphone device is that the ratio of the low-frequency energy exceeds a preset threshold, the earphone device immediately determines that a wearer of the earphone device is wearing a mask correctly at the current time, or if the ratio relationship calculated by the earphone device is that the ratio of the low-frequency energy does not exceed the preset threshold, the earphone device immediately determines that the wearer of the earphone device is not wearing a mask correctly or wearing a mask at the current time.
It should be noted that, in this embodiment, the preset threshold may specifically be a minimum ratio of low-frequency energy in the analog signal corresponding to the voice information output by the wearer when the earphone device performs analog signal acquisition on the wearer who correctly wears the mask in advance through the analog microphone, and determines that the wearer correctly wears the mask after performing simulation processing on the acquired analog signal through an algorithm. It should be understood that, based on different practical applications, the types of the headset devices themselves or the algorithms adopted by the headset devices themselves may be different, and thus, the specific size of the preset threshold determined by the headset devices based on the above process may also be different, and the call noise reduction method based on the headset devices of the present invention is not limited to the specific size of the preset threshold.
In addition, in some possible embodiments, after the step of "determining whether the wearer correctly wears the mask according to the analog signal obtained by collecting the voice information by the analog microphone" in step S20, the method for reducing noise in conversation based on an earphone device of the present invention may further include:
and step A, outputting a prompt voice for reminding a wearer of the mask according to the standard through a loudspeaker of the earphone device when the wearer is determined not to wear the mask or not to wear the mask correctly.
In this embodiment, the ratio of the high-frequency energy to the low-frequency energy in the analog signal calculated by the earphone device is that the ratio of the low-frequency energy does not exceed the preset threshold, so that when it is determined that the wearer of the earphone device does not correctly wear the mask or does not wear the mask at the current time, the earphone device further outputs a prompt voice for prompting the wearer to regularly wear the mask through the speaker configured by the earphone device.
Exemplarily, as an application flow shown in fig. 3, an analog signal of a wearer when outputting voice information, which is collected by an analog microphone configured by the ear speaker device (assumed as a TWS ear speaker), is subjected to AD conversion (analog-to-digital conversion) to convert the analog signal into a digital signal, and then, the TWS ear speaker transfers the digital signal into its own algorithm module together with a digital sound signal generated by the wearer and collected by a VPU bone conduction transducer;
then, the TWS headset detects the digital sound signal collected by the VPU bone conduction sensor through the algorithm module by VAD voice recognition, and if the TWS headset detects that the frame of digital sound signal is that the wearer is speaking (voice information is recognized from the frame of digital sound signal through voice recognition), the TWS headset further uses the digital signal corresponding to the analog signal collected by the analog microphone when the wearer outputs the voice information in the same frame to perform mask wearing detection and judgment. That is, the TWS earphone performs FFT (fast fourier transform) on a digital signal corresponding to the analog signal through its own mask detection module, and then separately calculates high-frequency energy (greater than 4 KHZ) and low-frequency energy (less than 4K), so that when the digital signal corresponding to several frames of analog signals continuously speaking by the wearer has a high low-frequency energy ratio (higher than the preset threshold), the TWS earphone will determine that the wearer correctly wears the mask at the current time, otherwise, the TWS earphone will determine that the wearer does not wear the mask at the current time or the mask is worn incorrectly;
furthermore, when the TWS earphone judges that the wearer correctly wears the mask, the TWS earphone sets the mask wearing flag to "true", and if the TWS earphone judges that the wearer does not wear the mask at the current time or the mask is worn incorrectly, the TWS earphone not only sets the mask wearing flag to "false", but also plays a warning sound "please wear the mask" through the speaker to remind the wearer of wearing the mask regularly.
And S30, when the wearer is determined to correctly wear the mask and the wearer is determined to carry out voice call based on the earphone equipment, carrying out call noise reduction according to the first voice signal acquired by the bone conduction sensor and the second voice signal acquired by the analog microphone.
In this embodiment, the earphone device determines that the wearer is correctly wearing the mask at the current time based on the ratio of the high-frequency energy to the low-frequency energy in the analog signal, and further determines that when the wearer is performing a voice call based on the earphone device at the current time, the earphone device performs noise reduction on the voice signal output by the wearer during the voice call according to a first voice signal acquired by a bone conduction sensor configured in the earphone device in real time during the call of the wearer and a second voice signal acquired by an analog microphone configured in the earphone device in real time during the call of the wearer.
It should be noted that, because the software logic in the TWS headset usually triggers the audio stream of the call and music playing through the bluetooth signal, i.e. the audio stream is only available in the call and music scene after the bluetooth connection. Therefore, on the one hand, the TWS headset needs to start a new audio stream after being confirmed to be worn by the user, which is specially used for the process of detecting whether the mask is worn correctly in step S10 and step S20. On the other hand, the TWS headset determines whether the user is currently engaged in a voice call on its own based on whether a bluetooth signal transmitted from the connected terminal device is received.
Based on this, in a feasible embodiment, the above-mentioned headset device establishes a bluetooth connection with the mobile terminal in advance, and the method for reducing noise in a call based on a headset device of the present invention may further include:
and step B, when receiving the voice Bluetooth signal transmitted by the mobile terminal through the Bluetooth connection, determining that the wearer is currently carrying out voice call based on the earphone equipment.
In this embodiment, the headset device establishes a bluetooth connection with an intelligent terminal device (such as a terminal device of a smart phone, a tablet computer, a smart television, a personal computer, and the like) through a bluetooth module configured by the headset device, so that the headset device can receive bluetooth data transmitted by the intelligent terminal device based on the bluetooth connection to form an audio stream or a call voice stream inside the headset device and output the audio stream or the call voice stream to a wearer of the headset device. Therefore, when receiving a voice Bluetooth signal transmitted by the intelligent terminal device through Bluetooth connection, the earphone device immediately initializes the audio data output by the earphone device, and determines that the wearer of the earphone device is performing voice communication with users of other intelligent terminal devices based on the earphone device at the current moment.
Further, in a possible embodiment, the step of performing call noise reduction according to the first voice signal collected by the bone conduction sensor and the second voice signal collected by the analog microphone in the step S30 may include:
step S301, extracting a low-frequency voice signal from a first voice signal acquired by the bone conduction sensor when the wearer carries out voice call;
step S302, extracting a high-frequency voice signal from a second voice signal collected by the analog microphone when the wearer carries out voice communication;
step S302, mixing the low-frequency voice signal and the high-frequency voice signal into 1-channel voice data to be output so as to reduce the noise of the call.
In this embodiment, when the earphone device performs noise reduction on the voice signal output by the wearer according to the first voice signal and the second voice signal respectively acquired by the bone conduction sensor and the analog microphone in real time during the conversation process of the wearer, the earphone device first extracts a low-frequency voice signal from the first voice signal and synchronously or asynchronously extracts a high-frequency voice signal from the second voice signal, and then the earphone device mixes the low-frequency voice signal and the high-frequency voice signal to form 1-channel voice data, and outputs the voice data to the intelligent terminal device through bluetooth connection with the intelligent terminal device to perform conversation noise reduction.
It should be noted that, in this embodiment, after the TWS headset triggers the call audio flow through bluetooth, if the TWS headset determines that the mask wearing flag is set to "true" at this time, the TWS headset adds an algorithm for performing noise reduction processing on the mask interference sound in the normal call data processing flow. However, the interference generated by the mask friction is mainly concentrated on the low frequency, but the digital sound signal acquired by the VPU bone conduction transducer is acquired by a bone conduction transmission mode, that is, there is almost no interference sound generated by the mask friction in the low frequency of the digital sound signal, so the TWS headset uses the low frequency of the digital sound signal acquired by the VPU bone conduction transducer in the voice communication process of the wearer as the audio frequency of the algorithm output signal.
Exemplarily, as shown in fig. 4, in the present embodiment, the flow of the noise reduction process of the TWS headset for the disturbing sound generated by the mask friction is as follows:
(1) The TWS earphone carries out FFT fast Fourier transform operation on a first voice signal and an MIC analog microphone which are collected by the VPU bone conduction sensor in the voice call process of a wearer and a second voice signal which is collected by the MIC analog microphone in the voice call process to form corresponding VPU frequency domain data and MIC frequency domain data;
(2) The TWS earphone inputs VPU frequency domain data into an LP low-pass filter to extract a low-frequency signal below 1KHz in a first voice signal, inputs MIC data into an HP high-pass filter to extract a high-frequency signal above 1KHz in a second voice signal, and performs MIX mixing on the low-frequency signal and the high-frequency signal to form 1 path of complete voice data;
(3) And the TWS tunes the 1-channel voice data formed after mixing through an EQ (equalizer) to brighten the voice, and then outputs the voice through Bluetooth connection between the TWS and the intelligent terminal equipment.
In this way, in this embodiment, during the whole process of detecting and determining wearing, the earphone device continuously collects the data sound signal generated by the wearer through the bone conduction sensor configured in itself, and then determines whether the wearer is outputting the voice information at the present time based on the collected digital sound signal. And then, the earphone equipment further determines whether the wearer correctly wears the mask at the current moment according to the analog signal acquired by the analog microphone configured by the earphone equipment aiming at the voice information output by the wearer. Finally, when the earphone device determines that the wearer is carrying out voice call based on the earphone device at the current moment, the earphone device carries out noise reduction on the voice signal output by the wearer in the voice call process according to a first voice signal acquired by the bone conduction sensor configured by the earphone device in real time in the call process of the wearer and a second voice signal acquired by the analog microphone configured by the earphone device in real time in the call process of the wearer.
Therefore, the embodiment of the invention realizes that whether the user correctly wears the mask is accurately detected through the bone conduction sensor and the analog microphone, and further, under the condition that the user wears the mask, the noise of the voice signal in the voice call process of the user using the earphone equipment is reduced through the bone conduction sensor and the analog microphone respectively, so that the voice quality of the user for calling based on the earphone equipment is improved through the little brother.
In addition, the embodiment of the invention also provides a conversation noise reduction device based on the earphone equipment, and the conversation noise reduction device based on the earphone equipment is applied to the earphone equipment configured with the analog microphone and the bone conduction sensor. Referring to fig. 5, fig. 5 is a schematic functional block diagram of an embodiment of a communication noise reduction apparatus based on an earphone device according to the present invention, and as shown in fig. 5, the communication noise reduction apparatus based on an earphone device according to the present invention includes:
a mask detection module 10, configured to determine whether a wearer of the earphone device is outputting voice information according to the digital sound signal detected by the bone conduction sensor; if yes, determining whether the wearer correctly wears the mask according to an analog signal obtained by acquiring the voice information by the analog microphone;
and the conversation noise reduction module 20 is configured to perform conversation noise reduction according to the first voice signal acquired by the bone conduction sensor and the second voice signal acquired by the analog microphone when it is determined that the wearer correctly wears the mask and it is determined that the wearer performs voice conversation based on the earphone device.
Optionally, the conversation noise reduction module 20 includes:
the low-frequency voice extraction unit is used for extracting a low-frequency voice signal from a first voice signal acquired by the bone conduction sensor when the wearer carries out voice call;
the high-frequency voice extracting unit is used for extracting a high-frequency voice signal from a second voice signal acquired by the analog microphone when the wearer carries out voice call;
and the mixed output unit is used for mixing the low-frequency voice signal and the high-frequency voice signal into 1-channel voice data to be output so as to reduce the noise of the call.
Optionally, the mask detection module 10 includes:
the bone conduction transducer comprises a first acquisition unit, a second acquisition unit and a control unit, wherein the first acquisition unit is used for acquiring a digital sound signal detected by the bone conduction transducer and carrying out voice recognition on the digital sound signal;
a first determination unit for determining that a wearer of the earphone device is outputting voice information when voice recognition is performed on the digital sound signal to detect voice information from the digital sound signal.
Optionally, the mask detecting module 10 further includes:
the second acquisition unit is used for acquiring an analog signal acquired by the analog microphone aiming at the voice information continuously output by the wearer;
and the second determining unit is used for determining whether the mask is worn correctly by the wearer according to the ratio relation between the high-frequency energy and the low-frequency energy in the analog signal.
Optionally, the second determining unit includes:
the proportion determining subunit is used for respectively calculating high-frequency energy and low-frequency energy in the analog signal after performing fast Fourier transform on the analog signal, and determining the proportion relation between the high-frequency energy and the low-frequency energy;
the first determining subunit is used for determining that the wearer correctly wears the mask if the proportion relation is that the low-frequency energy proportion exceeds a preset threshold;
and the second determining subunit is used for determining that the wearer does not wear the mask or does not wear the mask correctly if the proportion relation is that the low-frequency energy proportion exceeds a preset threshold.
Optionally, the device for reducing noise in a call based on a headset device of the present invention further includes:
and the prompt module is used for outputting prompt voice for reminding a wearer of the mask according to the standard through the loudspeaker of the earphone equipment when the wearer is determined not to wear the mask or not to correctly wear the mask.
Optionally, the device for reducing noise in a call based on a headset device of the present invention further includes:
and the call scene determining module is used for determining that the wearer carries out voice call based on the earphone equipment at present when receiving the voice Bluetooth signal transmitted by the mobile terminal through the Bluetooth connection.
The specific embodiment of the operation of each functional module of the call noise reduction device based on the earphone device in the present invention is substantially the same as each embodiment of the call noise reduction program method based on the earphone device in the present invention, and is not described herein again.
The present invention also provides a computer storage medium, which stores a call noise reduction program based on an earphone device, and when the call noise reduction program based on the earphone device is executed by a processor, the steps of the call noise reduction program method based on the earphone device according to any one of the above embodiments are implemented.
The specific embodiment of the computer storage medium of the present invention is substantially the same as the embodiments of the above-mentioned method for a call noise reduction program based on an earphone device of the present invention, and is not described herein again.
The present invention further provides a computer program product, where the computer program product includes a computer program, and when the computer program is executed by a processor, the steps of the method for reducing noise in a call based on an earphone device according to any one of the above embodiments are implemented, which are not described herein again.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrases "comprising a," "8230," "8230," or "comprising" does not exclude the presence of other like elements in a process, method, article, or system comprising the element.
The above-mentioned serial numbers of the embodiments of the present invention are only for description, and do not represent the advantages and disadvantages of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on this understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) as described above and includes instructions for causing a headset device (e.g. TWS headset, etc.) to perform the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention, and all equivalent structures or equivalent processes performed by the present invention or directly or indirectly applied to other related technical fields are also included in the scope of the present invention.
Claims (10)
1. A conversation noise reduction method based on earphone equipment is characterized in that the conversation noise reduction method based on earphone equipment is applied to the earphone equipment configured with an analog microphone and a bone conduction sensor, and comprises the following steps:
determining whether a wearer of the earphone device is outputting voice information from the digital sound signal detected by the bone conduction sensor;
if yes, determining whether the wearer correctly wears the mask according to a simulation signal obtained by collecting the voice information by the simulation microphone;
when the fact that the wearer correctly wears the mask is determined, and the fact that the wearer carries out voice call based on the earphone device is determined, call noise reduction is carried out according to a first voice signal collected by the bone conduction sensor and a second voice signal collected by the analog microphone.
2. The method of claim 1, wherein the step of reducing the noise of the call according to the first voice signal collected by the bone conduction sensor and the second voice signal collected by the analog microphone comprises:
extracting a low-frequency voice signal from a first voice signal acquired by the bone conduction sensor when the wearer carries out voice communication;
extracting a high-frequency voice signal from a second voice signal acquired by the analog microphone when the wearer carries out voice call;
and mixing the low-frequency voice signal and the high-frequency voice signal into 1-path voice data to be output so as to reduce the noise of the call.
3. The headset-device-based call noise reduction method of claim 1, wherein the step of determining whether the wearer of the headset device is outputting voice information from the digital sound signal detected by the bone conduction sensor comprises:
acquiring a digital sound signal detected by the bone conduction sensor, and performing voice recognition on the digital sound signal;
determining that a wearer of the headset device is outputting voice information upon voice recognition of the digital sound signal to detect voice information from the digital sound signal.
4. The method for reducing noise of a call based on an earphone device as claimed in claim 1, wherein the step of determining whether the wearer is wearing the mask correctly according to the analog signal obtained by collecting the voice information by the analog microphone comprises:
acquiring an analog signal acquired by the analog microphone aiming at the voice information continuously output by the wearer;
and determining whether the wearer correctly wears the mask according to the ratio relation between the high-frequency energy and the low-frequency energy in the analog signal.
5. The method for reducing noise of a call based on an earphone device as claimed in claim 4, wherein the step of determining whether the wearer is wearing the mask correctly according to the ratio between the high frequency energy and the low frequency energy in the analog signal comprises:
after carrying out fast Fourier transform on the analog signal, respectively calculating high-frequency energy and low-frequency energy in the analog signal, and determining the ratio relationship between the high-frequency energy and the low-frequency energy;
if the proportion relation is that the low-frequency energy proportion exceeds a preset threshold value, determining that the wearer correctly wears the mask;
and if the proportion relation is that the low-frequency energy proportion exceeds a preset threshold value, determining that the wearer does not wear the mask or does not wear the mask correctly.
6. The headset-device-based call noise reduction method according to any one of claims 1 to 5, wherein after the step of determining whether the wearer is wearing a mask correctly according to the analog signal obtained by collecting the voice information by the analog microphone, the method further comprises:
and when the wearer is determined not to wear the mask or not to wear the mask correctly, outputting a prompt voice for reminding the wearer of wearing the mask according to the standard through a loudspeaker of the earphone device.
7. The method for reducing the noise of the conversation based on the earphone device according to any one of the claims 1 to 5, wherein the earphone device establishes a Bluetooth connection with the mobile terminal in advance, and the method further comprises the following steps:
and when receiving a voice Bluetooth signal transmitted by the mobile terminal through the Bluetooth connection, determining that the wearer is currently carrying out voice call based on the earphone equipment.
8. The utility model provides a conversation based on earphone equipment falls device of making an uproar which characterized in that, conversation based on earphone equipment falls the device of making an uproar and is applied to the earphone equipment that disposes analog microphone and bone conduction sensor, conversation based on earphone equipment falls the device of making an uproar and includes:
the mask detection module is used for determining whether a wearer of the earphone device outputs voice information according to the digital sound signals detected by the bone conduction sensor; if yes, determining whether the wearer correctly wears the mask according to an analog signal obtained by acquiring the voice information by the analog microphone;
and the conversation noise reduction module is used for determining that the wearer correctly wears the mask and determining that the wearer can make a conversation noise reduction according to the first voice signal acquired by the bone conduction sensor and the second voice signal acquired by the analog microphone when making a voice conversation based on the earphone equipment.
9. An earphone device, characterized in that the earphone device comprises: a memory, a processor and a headset device based call noise reduction program stored on the memory and executable on the processor, the headset device based call noise reduction program when executed by the processor implementing the steps of the headset device based call noise reduction method according to any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a headset device based call noise reduction program, which when executed by a processor implements the steps of the headset device based call noise reduction method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210760779.1A CN115190212A (en) | 2022-06-30 | 2022-06-30 | Call noise reduction method and device based on earphone equipment, earphone equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210760779.1A CN115190212A (en) | 2022-06-30 | 2022-06-30 | Call noise reduction method and device based on earphone equipment, earphone equipment and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115190212A true CN115190212A (en) | 2022-10-14 |
Family
ID=83516210
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210760779.1A Pending CN115190212A (en) | 2022-06-30 | 2022-06-30 | Call noise reduction method and device based on earphone equipment, earphone equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115190212A (en) |
-
2022
- 2022-06-30 CN CN202210760779.1A patent/CN115190212A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113873378B (en) | Earphone noise processing method and device and earphone | |
| CN107533839B (en) | Method and device for processing ambient environment sound | |
| CN102124758B (en) | Hearing aid, hearing assistance system, walking detection method, and hearing assistance method | |
| CN113676804A (en) | Active noise reduction method and device | |
| US12014716B2 (en) | Method for reducing occlusion effect of earphone, and related apparatus | |
| CN109493877B (en) | Voice enhancement method and device of hearing aid device | |
| CN108551604B (en) | Noise reduction method, noise reduction device and noise reduction earphone | |
| US20230164475A1 (en) | Mode Control Method and Apparatus, and Terminal Device | |
| CN107566658A (en) | Call method, device, storage medium and mobile terminal | |
| CN105430546A (en) | Earset and control method for the same | |
| CN103618835A (en) | Method and system for automatically switching scene mode according to magnitude of peripheral noise | |
| US20240096343A1 (en) | Voice quality enhancement method and related device | |
| US9826303B2 (en) | Portable terminal and portable terminal system | |
| CN105100367A (en) | Traffic whistling safety warning system and traffic whistling safety warning method | |
| TWI624183B (en) | Method of processing telephone voice and computer program thereof | |
| CN114466278B (en) | Method for determining parameters corresponding to earphone mode, earphone, terminal and system | |
| CN115190212A (en) | Call noise reduction method and device based on earphone equipment, earphone equipment and medium | |
| CN113808566B (en) | Vibration noise processing method and device, electronic equipment and storage medium | |
| CN111757211B (en) | Noise reduction method, terminal device and storage medium | |
| CN114710730A (en) | Volume prompting method and device, earphone and storage medium | |
| CN207518804U (en) | The telecommunication devices of formula interactive voice earphone are worn for neck | |
| CN113766385A (en) | Earphone noise reduction method and device | |
| CN207518801U (en) | The remote music playing device of formula interactive voice earphone is worn for neck | |
| EP2362680A1 (en) | Electronic device for receiving and transmitting audio signals | |
| CN111462747B (en) | Hearing assistance device and setting method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |