CN109218882B - Earphone and ambient sound monitoring method thereof - Google Patents
Earphone and ambient sound monitoring method thereof Download PDFInfo
- Publication number
- CN109218882B CN109218882B CN201810937218.8A CN201810937218A CN109218882B CN 109218882 B CN109218882 B CN 109218882B CN 201810937218 A CN201810937218 A CN 201810937218A CN 109218882 B CN109218882 B CN 109218882B
- Authority
- CN
- China
- Prior art keywords
- signal
- microphone
- earphone
- voice signal
- voice
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
- H04R1/1041—Mechanical or electronic switches, or control elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2410/00—Microphones
- H04R2410/01—Noise reduction using microphones having different directional characteristics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2420/00—Details of connection covered by H04R, not provided for in its groups
- H04R2420/03—Connection circuits to selectively connect loudspeakers or headphones to amplifiers
Abstract
The invention discloses an earphone and an environmental sound monitoring method thereof. The method comprises the following steps: in a monitoring mode, acquiring an environmental sound signal; extracting a speech signal from the ambient sound signal; outputting the voice signal to an earphone for playing; and/or, removing the speech signal from the ambient sound signal to obtain a noise signal; and carrying out noise reduction processing on the noise signal, generating a noise reduction signal and outputting the noise reduction signal to an earphone for playing.
Description
Technical Field
The present invention relates to the field of sound processing technologies, and in particular, to an environmental sound monitoring method for an earphone and an earphone.
Background
The noise reduction earphone can reduce the influence of external environment sound on a user, and the noise reduction modes of the earphone in the prior art mainly comprise three modes of active noise reduction, passive noise reduction and active noise reduction and hybrid passive noise reduction.
Headphones with active noise reduction typically have two modes of operation:
when the earphone is in the noise reduction mode, the earphone carries out phase reversal processing on the external environment sound signals collected by the microphone through the noise reduction module to generate equivalent phase reversal sound wave signals which are played by the earphone so as to offset the external environment sound signals. Under the mode of making an uproar, the speech signal that contains in the external environment sound signal also can be eliminated simultaneously, leads to wearing the earphone person to be difficult for hearing the other side's sound when talking with the people.
When the earphone is in a monitoring mode, the active noise reduction function is closed, the external environment sound signal collected by the microphone is transmitted to the earphone to be played, and a user can talk with others under the condition of wearing the earphone. At this moment, because the external environment sound signal that the microphone was gathered includes speech signal and noise signal, speech signal and noise signal are played by the earphone simultaneously, and the user still can receive noise signal's interference in the conversation process, lead to user experience nature poor. Therefore, it is necessary to provide a method capable of improving the listening effect of the headset.
Disclosure of Invention
An object of the present invention is to provide an ambient sound monitoring scheme for a headset, so as to improve the monitoring effect of the headset.
According to a first aspect of the present invention, there is provided an ambient sound monitoring method for a headset, including:
in a monitoring mode, acquiring an environmental sound signal;
extracting a speech signal from the ambient sound signal;
outputting the voice signal to an earphone for playing; and/or the presence of a gas in the gas,
removing the speech signal from the ambient sound signal to obtain a noise signal;
and carrying out noise reduction processing on the noise signal, generating a noise reduction signal and outputting the noise reduction signal to an earphone for playing.
Optionally, the voice signal comprises the ambient sound signal within a preset angular range from a direction of sound production by the wearer of the headset.
Optionally, the preset angle range is 0 ° to 45 °.
Optionally, the headset comprises a first microphone and a second microphone, the first and second microphones being collinear with the mouth of the wearer of the headset; the speech signal includes: the ambient sound signals within a preset angle range deviating from the reference direction by taking the direction of the first microphone and the second microphone towards the mouth of the earphone wearer as the reference direction;
the acquiring of the ambient sound signal comprises: respectively acquiring an ambient sound signal through the first microphone and the second microphone to acquire a first path of ambient sound signal and a second path of ambient sound signal;
the extracting of the speech signal from the ambient sound signal comprises:
and performing beam forming processing on the first path of environment sound signal and the second path of environment sound signal to acquire the voice signal.
Optionally, the preset angle range is 0 ° to 45 °.
Optionally, the first microphone is a feedforward microphone, and the second microphone is a call microphone.
Optionally, the outputting the voice signal to an earphone for playing includes:
and performing gain amplification processing on the voice signal and then playing.
Optionally, the outputting the voice signal to an earphone for playing includes:
and filtering the voice signal, and reserving the voice signal in a preset frequency band for playing.
Optionally, the outputting the voice signal to an earphone for playing includes:
filtering the voice signal, and reserving the voice signal in a preset frequency band;
and performing gain amplification processing on the voice signals in the preset frequency band and then performing playing.
Optionally, the preset frequency band is 200Hz-2 KHz.
According to a second aspect of the present invention, there is provided an earphone, comprising a microphone, a speaker, a voice signal extraction module, a monitoring module, a noise signal extraction module and a noise reduction module;
the microphone is used for picking up an environmental sound signal in a monitoring mode;
the voice signal extraction module is used for extracting a voice signal from the environment sound signal;
the monitoring module is used for outputting the voice signal to the loudspeaker for playing;
the noise extraction module is used for removing the voice signal from the environment sound signal to obtain a noise signal;
and the noise reduction module is used for performing noise reduction processing on the noise signal, generating a noise reduction signal and outputting the noise reduction signal to the loudspeaker for playing.
Optionally, the voice signal comprises the ambient sound signal within a preset angular range from a direction of sound production by the wearer of the headset.
Optionally, the preset angle range is 0 ° to 45 °.
Optionally, the microphone comprises a first microphone and a second microphone, the first and second microphones being collinear with the mouth of the wearer of the headset; the speech signal includes: the ambient sound signals within a preset angle range deviating from the reference direction by taking the direction of the first microphone and the second microphone towards the mouth of the earphone wearer as the reference direction;
the microphone picks up an ambient sound signal, comprising: respectively acquiring an ambient sound signal through the first microphone and the second microphone to acquire a first path of ambient sound signal and a second path of ambient sound signal;
the voice signal extraction module comprises a beam forming module;
the beam forming module is configured to perform beam forming processing on the first path of environmental sound signal and the second path of environmental sound signal to obtain the voice signal.
Optionally, the preset angle range is 0 ° to 45 °.
Optionally, the first microphone is a feedforward microphone, and the second microphone is a call microphone.
Optionally, the listening module comprises a gain module;
the gain module is used for performing gain amplification processing on the voice signal and outputting the voice signal after gain to the loudspeaker for playing.
Optionally, the monitoring module includes a filtering module;
the filtering module is used for filtering the voice signals, reserving the voice signals in a preset frequency band, and outputting the voice signals in the preset frequency band to the loudspeaker for playing.
Optionally, the monitoring module includes a filtering module and a gain module;
the filtering module is configured to filter the voice signal, and reserve the voice signal in a preset frequency band:
the gain module is used for performing gain amplification processing on the voice signals in the preset frequency band and outputting the voice signals in the preset frequency band after gain to the loudspeaker for playing.
Optionally, the preset frequency band is 200Hz-2 KHz.
According to a third aspect of the present invention, there is provided a headset comprising: a memory for storing instructions for controlling the processor to operate to perform the method of any one of claims 1-10, and a processor.
Optionally, the headset comprises a first microphone and a second microphone, the first and second microphones being collinear with the mouth of the wearer of the headset.
Optionally, the first microphone is a feedforward microphone, and the second microphone is a call microphone.
The method provided by the embodiment of the invention has the beneficial effects that in the monitoring mode, the voice signal in the environmental sound signal can be extracted for playing, and/or the noise signal in the environmental sound signal can be subjected to noise reduction processing, so that an earphone wearer can hear the external voice signal more clearly, and a better monitoring effect is realized.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description, serve to explain the principles of the invention.
Fig. 1 is a schematic flow chart of an ambient sound listening method of a headset according to an embodiment of the invention;
fig. 2 is a schematic view of the arrangement position of a microphone of the earphone according to the embodiment of the present invention;
FIG. 3 is a block diagram of a headset according to one embodiment of the present invention;
fig. 4 is a block diagram of a headset according to another embodiment of the invention;
fig. 5 is a schematic diagram of a hardware structure of a headset with an active noise reduction function according to an embodiment of the present invention.
Detailed Description
Various exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. It should be noted that: the relative arrangement of the components and steps, the numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present invention unless specifically stated otherwise.
The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the invention, its application, or uses.
Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate.
In all examples shown and discussed herein, any particular value should be construed as merely illustrative, and not limiting. Thus, other examples of the exemplary embodiments may have different values.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, further discussion thereof is not required in subsequent figures.
The earphone with the active noise reduction function has two working modes, namely a noise reduction mode and a monitoring mode. The headset comprises a speaker, a microphone exposed to the outside of the headset, and a mode switching module. The earphone is switched between a noise reduction mode and a monitoring mode through a mode switching module. The mode switching module can be realized by arranging a button, a sliding key and the like on the earphone.
Referring to fig. 1, an ambient sound monitoring method of a headset according to an embodiment of the present invention is described.
3100. In the listening mode, an ambient sound signal is acquired.
Specifically, when the earphone enters the monitoring mode, a microphone of the earphone is automatically turned on, and the microphone picks up the environmental sound signal.
3200. A speech signal is extracted from the ambient sound signal.
In a specific example, the voice signal includes the ambient sound signal within a preset angular range from a direction of sound production by the wearer of the headset. The predetermined angle range may be, for example, 0 ° to 45 °. In actual conversation process, the ambient sound signal within this preset angle range of the departure earphone wearer's direction of sound production mainly includes the sound that earphone wearer's conversation object sent and the sound that earphone wearer oneself sent, consequently in step 3200, can draw out the ambient sound signal within this preset angle range of the departure earphone wearer's direction of sound production as speech signal.
In step 3200, a speech signal may be extracted from the ambient sound signal by a beamforming technique.
3300. And outputting the voice signal to a loudspeaker of an earphone for playing.
That is to say, in the embodiment of the present invention, in the listening mode, the headset extracts the voice signal from the environmental sound signal and inputs the voice signal to the speaker of the headset for playing, so that the user can listen to the sound emitted by the user and the conversation object even when wearing the headset, thereby realizing normal communication with the conversation object.
(1) In one example of the present invention, in step 3300, the voice signal is directly output to the speaker of the earphone for playing. Specifically, the voice signal can be directly output to a loudspeaker of the earphone for playing through a monitoring module arranged in the earphone.
(2) In one example of the present invention, step 3300 may further include step 3310.
3310. And filtering the voice signals, and only reserving the voice signals in the preset frequency band for playing.
In this embodiment, the voice signal is defined by a preset angle range, and the ambient sound signal in the preset angle range is mainly human voice generated by the earphone wearer and the conversation object, but may also include some noise signals, such as noise introduced from the transmission medium and noise generated by hardware factors of the earphone itself. At this time, if the voice signal is directly output to the speaker of the earphone for playing, a little noise may be introduced, which may affect the conversation between the wearer of the earphone and others. Therefore, in step 3310, the voice signal is filtered, and only the voice signal in the preset frequency band is reserved for playing, wherein the preset frequency band is set according to the main frequency band of the human voice, that is, the noise is further filtered by filtering in this embodiment, and the signal conforming to the main frequency band of the human voice is reserved. The voice frequency of the human speaking is mostly within 200Hz-2KHz, therefore, the preset frequency band is preferably 200Hz-2KHz, and the filter can use a band-pass filter.
Therefore, according to the method for monitoring the environmental sound, the earphone can extract the voice signal from the acquired environmental sound signal in the monitoring mode, filter the voice signal, and only keep the signal in the main frequency band of the human voice to be output to the earphone for playing, so that the noise signals outside the main frequency band of the human voice are reduced, and a user wearing the earphone can clearly hear the sound sent by the user and a conversation object.
(3) In one example of the present invention, step 3300 may further include step 3320.
3320 and the earphone performs gain amplification on the voice signal to be played and then plays the voice signal.
Specifically, the speech signal to be played may be gain-amplified by a signal amplifier disposed in the monitoring module of the earphone.
Therefore, in the ambient sound monitoring method of the embodiment, the earphone can extract the voice signal from the acquired ambient sound signal in the monitoring mode, and perform gain amplification processing on the voice signal to be played and then play the voice signal, so that the sound emitted by the earphone wearer and the talking object is further highlighted.
(4) In another example of the present invention, step 3310 may be executed to filter the voice signal, and the voice signal within the preset frequency band is retained, and then step 3320 may be executed to gain amplify the voice signal within the retained preset frequency band, and then play the voice signal.
In this example, the earphone first filters the voice signal through a filter disposed in a monitoring module of the earphone, only the voice signal within the frequency band of 200Hz-2KHz is retained, and then the voice signal within the frequency band of 200Hz-2KHz is amplified by a signal amplifier disposed in the monitoring module of the earphone and then played.
Therefore, according to the ambient sound monitoring method of the embodiment, the earphone can extract the voice signal from the acquired ambient sound signal in the monitoring mode, filter the voice signal, only retain the signal in the main frequency band of the human voice, and amplify the signal in the main frequency band of the retained human voice in a gain manner, so that the noise signal outside the human voice frequency band is reduced, the sound emitted by the earphone wearer and the sound emitted by the conversation object are further highlighted, and a better monitoring effect is provided for the earphone wearer.
3400. Removing the speech signal from the ambient sound signal to obtain a noise signal.
Specifically, the ambient sound signal and the voice signal may be subtracted by a subtractor provided in the headset to obtain a noise signal.
3500. And carrying out noise reduction processing on the noise signal, generating a noise reduction signal and outputting the noise reduction signal to an earphone for playing.
Specifically, in step 3500, the noise signal may be subjected to phase inversion processing by using a filter to generate a noise reduction signal with the same magnitude as the noise signal and an opposite phase, the noise reduction signal is output to the earphone for playing, and the noise reduction signal is cancelled to achieve the active noise reduction effect.
It should be noted that, in another embodiment, only step 3100 and 3300 may be performed, and step 3400 and step 3500 may not be performed. In another embodiment, only steps 3100, 3200, 3400 and 3500 may be performed, without performing step 3300. The three modes can help the user to hear the external voice signal more clearly in the mode of monitoring, thereby realizing better monitoring effect.
The method provided by the embodiment of the invention has the beneficial effects that in the monitoring mode, the voice signal in the environmental sound signal can be extracted for playing, and/or the noise signal in the environmental sound signal can be subjected to noise reduction processing, so that an earphone wearer can hear the external voice signal more clearly, and a better monitoring effect is realized.
The above step 3200 of embodiments of the present invention is illustrated by a specific example. Referring to fig. 2, a schematic diagram of a microphone of an earphone according to an embodiment of the present invention is shown.
The headset comprises a first microphone a and a second microphone B. When designing the positions of the first microphone a and the second microphone B, it is ensured that the position of the first microphone a, the position of the second microphone B, and the position C of the mouth of the wearer of the headset are all substantially collinear, as indicated by the dashed lines in fig. 2. The first microphone a and the second microphone B may be omnidirectional or directional. The distance between the first microphone a and the second microphone B can be designed and adjusted according to actual needs.
If the earphone is a dual-microphone uplink noise reduction earphone, the first microphone A can be realized by using a feedforward microphone of the earphone, the second microphone B can be realized by using a conversation microphone of the earphone, and the feedforward microphone, the conversation microphone and the mouth of an earphone wearer are basically on the same straight line.
For step 3100, in the listening mode, acquiring an ambient sound signal, specifically:
the earphone respectively acquires the ambient sound signals through the first microphone A and the second microphone B so as to acquire a first path of ambient sound signals and a second path of ambient sound signals. The first ambient sound signal and the second ambient sound signal are substantially the same.
For step S3200, the earphone extracts a speech signal from the ambient sound signal, specifically:
the voice signal comprises an environment sound signal which takes the direction of the first microphone A and the second microphone B towards the mouth of the earphone wearer as a reference direction and deviates from the reference direction within a preset angle theta. Referring to fig. 2, the reference direction is a direction from the first microphone a toward the position C of the mouth of the wearer of the headset, and the preset angle θ may be 45 °, and the ambient sound signal within the range of the conical region formed by the solid lines AC1 and AC2 is extracted as the voice signal. In the actual conversation process, the ambient sound signals within the preset angle range mainly include the sound emitted by the conversation object of the earphone wearer and the sound emitted by the earphone wearer, so that in step 3200, the ambient sound signals within the preset angle θ range deviating from the reference direction can be extracted as the voice signals.
In step S3200, extracting the speech signal from the environmental sound signal may further include: and carrying out beam forming processing on the first path of environment sound signal and the second path of environment sound signal to obtain a voice signal.
Specifically, the first path of ambient sound signal and the second path of ambient sound signal may be processed by beamforming to obtain a voice signal. For example, the beamforming process may be based on a delay-accumulate microphone array beamforming method. For example, the beam forming module calculates a time difference between a target sound source and a first microphone and a time difference between the target sound source and a second microphone according to a preset angle, performs delay compensation on the first path of environmental sound signal and the second path of environmental sound signal according to the time difference between the target sound source and the first microphone and the second microphone, synchronizes the compensated first path of environmental sound signal and the compensated second path of environmental sound signal, and then obtains an output signal through product accumulation of fixed weighting coefficients, where the output signal is a voice signal.
Referring to fig. 3, a headset according to an embodiment of the present invention is illustrated:
the headset includes a microphone 10, a speaker 60, a voice signal extraction module 20, a listening module 40, a noise signal extraction module 30, and a noise reduction module 50.
A microphone 10 for picking up ambient sound signals in a listening mode.
A voice signal extracting module 20, configured to extract a voice signal from the ambient sound signal picked up by the microphone 10.
And the monitoring module 40 is configured to output the voice signal to a speaker 60 for playing.
A noise extraction module 30, configured to remove the voice signal from the ambient sound signal picked up by the microphone 10 to obtain a noise signal.
And the noise reduction module 50 is configured to perform noise reduction processing on the noise signal, generate a noise reduction signal, and output the noise reduction signal to the loudspeaker 60 for playing.
In a specific example, the voice signal includes the ambient sound signal within a preset angular range from a direction of sound production by the wearer of the headset. The preset angle range may be, for example, 0 ° to 45 °.
In one particular example, the listening module 40 includes a gain module. The gain module is used for carrying out gain amplification processing on the voice signal and outputting the voice signal after gain to a loudspeaker for playing.
In one particular example, the listening module 40 includes a filtering module. The filtering module is used for filtering the voice signals, reserving the voice signals in a preset frequency band, and outputting the voice signals in the preset frequency band to a loudspeaker for playing. The preset frequency range can be 200Hz-2 KHz.
In one particular example, the listening module 40 includes a filtering module and a gain module. The filtering module is used for filtering the voice signals and reserving the voice signals in a preset frequency band. The gain module is used for carrying out gain amplification processing on the voice signals in the preset frequency band and outputting the voice signals in the preset frequency band after gain to a loudspeaker for playing. The preset frequency range can be 200Hz-2 KHz.
Referring to fig. 4, a headset according to another embodiment of the present invention is illustrated:
the headset includes a first microphone 11, a second microphone 12, a speaker 60, a voice signal extraction module 20, a listening module 40, a noise signal extraction module 30, and a noise reduction module 50. The voice signal extracting module 20 includes a beam forming module 21, and the monitoring module 40 includes a filtering module 41 and a gain module 42. The first microphone 11 and the second microphone 12 are substantially in line with the mouth of the wearer of the headset. The first microphone 11 is a feedforward microphone, and the second microphone 12 is a conversation microphone.
The first microphone 11 is configured to pick up an ambient sound signal in the listening mode, and output the ambient sound signal as a first ambient sound signal.
The first microphone 12 is configured to pick up an ambient sound signal in the listening mode, and output the ambient sound signal as a second ambient sound signal.
A speech signal extracting module 20, configured to extract a speech signal from the ambient sound signal. Specifically, the beam forming module 21 performs beam forming processing on the first path of ambient sound signal and the second path of ambient sound signal to obtain the voice signal. The speech signal includes: and taking the direction of the first microphone 11 and the second microphone 12 towards the mouth of the earphone wearer as a reference direction, and deviating the ambient sound signal within a preset angle range from the reference direction. The preset angle range may be, for example, 0 ° to 45 °.
And the monitoring module 40 is configured to output the voice signal to a speaker 60 for playing. Specifically, the voice signal is filtered by the filtering module 41, and the voice signal in a preset frequency band is reserved, where the preset frequency band is, for example, 200Hz-2 KHz. And then gain amplification processing is performed on the voice signal in the preset frequency band through a gain module 42, and the voice signal in the preset frequency band after gain is output to a loudspeaker 60 for playing.
A noise extraction module 30, configured to remove the speech signal from the ambient sound signal to obtain a noise signal.
And the noise reduction module 50 is configured to perform noise reduction processing on the noise signal, generate a noise reduction signal, and output the noise reduction signal to the loudspeaker 60 for playing.
Therefore, in the earphone according to the embodiment of the invention, the earphone can perform noise reduction processing on the noise signal in the environmental sound signal in the monitoring mode, so as to generate a noise reduction signal with the same size and opposite phase with the noise signal to offset the noise signal, and simultaneously, the earphone performs filtering and gain amplification processing on the voice signal in the environmental sound signal, so that a user wearing the earphone can clearly hear the sound emitted by the conversation party, and the anti-noise performance of the earphone in the monitoring mode is improved.
It should be noted that, in the earphone provided by another embodiment of the present invention, the listening module 40 may include only one of the filtering module 41 and the gain module 42.
Fig. 5 is a schematic diagram of a hardware structure of a headset with an active noise reduction function according to an embodiment of the present invention. As shown in fig. 5, a headset with active noise reduction may include one or more memories 200 and one or more processors 100.
The processor 100 may be, for example, a central processing unit CPU, a microprocessor MCU, or the like. The memory 200 may include, for example, a ROM (read only memory), a RAM (random access memory), a nonvolatile memory such as a hard disk, and the like.
The processor 100 is connected to the microphone 10, the speaker 60, and the memory 200, respectively. The memory 200 is used to store computer instructions for controlling the processor 100 to operate to perform an ambient sound listening method according to an embodiment of the present invention,
the skilled person can design the instructions according to the technical solution disclosed in the present invention. How the instructions control the processor to operate is well known in the art, and thus, embodiments of the present invention are not described in detail herein.
It should be noted that the above-mentioned embodiments provide a headset corresponding to the above-mentioned ambient sound monitoring method for a headset, and the related contents of the above-mentioned ambient sound monitoring method for a headset are also used for explaining the headset.
The present invention may be a system, method and/or computer program product. The computer program product may include a computer-readable storage medium having computer-readable program instructions embodied therewith for causing a processor to implement various aspects of the present invention.
The computer readable storage medium may be a tangible device that can hold and store the instructions for use by the instruction execution device. The computer readable storage medium may be, for example, but not limited to, an electronic memory device, a magnetic memory device, an optical memory device, an electromagnetic memory device, a semiconductor memory device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a Static Random Access Memory (SRAM), a portable compact disc read-only memory (CD-ROM), a Digital Versatile Disc (DVD), a memory stick, a floppy disk, a mechanical coding device, such as punch cards or in-groove projection structures having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media as used herein is not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., optical pulses through a fiber optic cable), or electrical signals transmitted through electrical wires.
The computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to a respective computing/processing device, or to an external computer or external storage device via a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. The network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in the respective computing/processing device.
The computer program instructions for carrying out operations of the present invention may be assembler instructions, Instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, aspects of the present invention are implemented by personalizing an electronic circuit, such as a programmable logic circuit, a Field Programmable Gate Array (FPGA), or a Programmable Logic Array (PLA), with state information of computer-readable program instructions, which can execute the computer-readable program instructions.
Aspects of the present invention are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.
These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer-readable program instructions may also be stored in a computer-readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer-readable medium storing the instructions comprises an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions. It is well known to those skilled in the art that implementation by hardware, by software, and by a combination of software and hardware are equivalent.
Having described embodiments of the present invention, the foregoing description is intended to be exemplary, not exhaustive, and not limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terms used herein were chosen in order to best explain the principles of the embodiments, the practical application, or technical improvements to the techniques in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein. The scope of the invention is defined by the appended claims.
Claims (10)
1. An ambient sound monitoring method for a headset, comprising:
in a monitoring mode, acquiring an environmental sound signal;
extracting a speech signal from the ambient sound signal; wherein the voice signal comprises the environmental sound signal within a preset angle range deviating from the sounding direction of the earphone wearer;
outputting the voice signal to an earphone for playing; and/or the presence of a gas in the gas,
removing the speech signal from the ambient sound signal to obtain a noise signal;
carrying out noise reduction processing on the noise signal to generate a noise reduction signal, and outputting the noise reduction signal to an earphone for playing;
wherein, outputting the voice signal to an earphone for playing comprises:
filtering the voice signal, and reserving the voice signal in a preset frequency band;
and performing gain amplification processing on the voice signals in the preset frequency band and then performing playing.
2. The method according to claim 1, wherein the preset angle range is 0-45 degrees.
3. The method of claim 1, wherein the headset includes a first microphone and a second microphone, the first and second microphones being collinear with the mouth of the wearer of the headset; the speech signal includes: the ambient sound signals within a preset angle range deviating from the reference direction by taking the direction of the first microphone and the second microphone towards the mouth of the earphone wearer as the reference direction;
the acquiring of the ambient sound signal comprises: respectively acquiring an ambient sound signal through the first microphone and the second microphone to acquire a first path of ambient sound signal and a second path of ambient sound signal;
the extracting of the speech signal from the ambient sound signal comprises:
and performing beam forming processing on the first path of environment sound signal and the second path of environment sound signal to acquire the voice signal.
4. The method according to claim 3, wherein the preset angle range is 0-45 degrees.
5. The method of claim 3, wherein the first microphone is a feed-forward microphone and the second microphone is a talk microphone.
6. The method according to any one of claims 1-5, wherein outputting the voice signal to a headset for playback comprises:
and performing gain amplification processing on the voice signal and then playing.
7. The method according to any one of claims 1-5, wherein outputting the voice signal to a headset for playback comprises:
and filtering the voice signal, and reserving the voice signal in a preset frequency band for playing.
8. The method of claim 1, wherein the predetermined frequency range is 200Hz-2 KHz.
9. An earphone is characterized by comprising a microphone, a loudspeaker, a voice signal extraction module, a monitoring module, a noise signal extraction module and a noise reduction module;
the microphone is used for picking up an environmental sound signal in a monitoring mode;
the voice signal extraction module is used for extracting a voice signal from the environment sound signal;
the monitoring module is used for outputting the voice signal to the loudspeaker for playing;
the noise extraction module is used for removing the voice signal from the environment sound signal to obtain a noise signal;
the noise reduction module is used for performing noise reduction processing on the noise signal, generating a noise reduction signal and outputting the noise reduction signal to the loudspeaker for playing;
wherein, the monitoring module also comprises a filtering module and a gain module,
the filtering module is used for filtering the voice signal and reserving the voice signal in a preset frequency band;
and the gain module is used for performing gain amplification processing on the voice signals in the preset frequency band and then playing the voice signals.
10. An earphone, comprising: a memory for storing instructions for controlling the processor to operate to perform the method of any one of claims 1-8, and a processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810937218.8A CN109218882B (en) | 2018-08-16 | 2018-08-16 | Earphone and ambient sound monitoring method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810937218.8A CN109218882B (en) | 2018-08-16 | 2018-08-16 | Earphone and ambient sound monitoring method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109218882A CN109218882A (en) | 2019-01-15 |
| CN109218882B true CN109218882B (en) | 2021-02-26 |
Family
ID=64988540
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810937218.8A Active CN109218882B (en) | 2018-08-16 | 2018-08-16 | Earphone and ambient sound monitoring method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109218882B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110211599B (en) * | 2019-06-03 | 2021-07-16 | Oppo广东移动通信有限公司 | Application awakening method and device, storage medium and electronic equipment |
| CN110753285A (en) * | 2019-10-24 | 2020-02-04 | 歌尔股份有限公司 | Method, device and equipment for processing sound signal of noise reduction earphone and storage medium |
| CN114666695A (en) * | 2020-12-22 | 2022-06-24 | 华为技术有限公司 | Active noise reduction method, device and system |
| CN112770214B (en) * | 2021-01-28 | 2022-11-11 | 歌尔科技有限公司 | Earphone control method and device and earphone |
| CN113099338A (en) * | 2021-03-08 | 2021-07-09 | 头领科技（昆山）有限公司 | Intelligent control's audio chip and wireless earphone of making an uproar that falls |
| CN113099348A (en) * | 2021-04-09 | 2021-07-09 | 泰凌微电子(上海)股份有限公司 | Noise reduction method, noise reduction device and earphone |
| CN113098901B (en) * | 2021-04-29 | 2022-09-09 | 心动互动娱乐有限公司 | High-concurrency real-time voice call method, system, device and medium |
| CN113596661A (en) * | 2021-07-28 | 2021-11-02 | 维沃移动通信有限公司 | Earphone, feedback noise reduction method and device |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101009820A (en) * | 2007-01-26 | 2007-08-01 | 北京佳讯飞鸿电气有限责任公司 | A maintenance method and device for the call signal device |
| WO2012115785A2 (en) * | 2011-02-25 | 2012-08-30 | Beevers Manufacturing & Supply, Inc. | Electronic communication system that mimics natural range and orientation dependence |
| CN103269465A (en) * | 2013-05-22 | 2013-08-28 | 歌尔声学股份有限公司 | Headset communication method under loud-noise environment and headset |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100892095B1 (en) * | 2007-01-23 | 2009-04-06 | 삼성전자주식회사 | Apparatus and method for processing of transmitting/receiving voice signal in a headset |
| US9202455B2 (en) * | 2008-11-24 | 2015-12-01 | Qualcomm Incorporated | Systems, methods, apparatus, and computer program products for enhanced active noise cancellation |
| CN101859568B (en) * | 2009-04-10 | 2012-05-30 | 比亚迪股份有限公司 | Method and device for eliminating voice background noise |
| US20120029912A1 (en) * | 2010-07-27 | 2012-02-02 | Voice Muffler Corporation | Hands-free Active Noise Canceling Device |
| CN102300140B (en) * | 2011-08-10 | 2013-12-18 | 歌尔声学股份有限公司 | Speech enhancing method and device of communication earphone and noise reduction communication earphone |
| CN103310796B (en) * | 2013-06-28 | 2016-06-08 | 姜鸿彦 | Voice signal extraction method |
| CN103310797B (en) * | 2013-06-28 | 2015-08-26 | 姜鸿彦 | Noise and voice signal extraction device |
| US10203762B2 (en) * | 2014-03-11 | 2019-02-12 | Magic Leap, Inc. | Methods and systems for creating virtual and augmented reality |
| CN106548781A (en) * | 2015-09-21 | 2017-03-29 | 上海日趋信息技术有限公司 | A kind of method for eliminating background noise for speech recognition system |
| CN105719657A (en) * | 2016-02-23 | 2016-06-29 | 惠州市德赛西威汽车电子股份有限公司 | Human voice extracting method and device based on microphone |
| CN107045778A (en) * | 2017-04-26 | 2017-08-15 | 兰州交通大学 | A kind of Multifunctional noise bucking-out system |
-
2018
- 2018-08-16 CN CN201810937218.8A patent/CN109218882B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101009820A (en) * | 2007-01-26 | 2007-08-01 | 北京佳讯飞鸿电气有限责任公司 | A maintenance method and device for the call signal device |
| WO2012115785A2 (en) * | 2011-02-25 | 2012-08-30 | Beevers Manufacturing & Supply, Inc. | Electronic communication system that mimics natural range and orientation dependence |
| CN103269465A (en) * | 2013-05-22 | 2013-08-28 | 歌尔声学股份有限公司 | Headset communication method under loud-noise environment and headset |
Non-Patent Citations (1)
| Title |
|---|
| 基于局域网的音频实时记录和监听系统的设计与实现;曹辉;《中国优秀硕士学位论文全文数据库-信息科技辑》;20110515;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109218882A (en) | 2019-01-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109218882B (en) | Earphone and ambient sound monitoring method thereof | |
| CN112770214B (en) | Earphone control method and device and earphone | |
| JP4631939B2 (en) | Noise reducing voice reproducing apparatus and noise reducing voice reproducing method | |
| US10803857B2 (en) | System and method for relative enhancement of vocal utterances in an acoustically cluttered environment | |
| US10341759B2 (en) | System and method of wind and noise reduction for a headphone | |
| US9779716B2 (en) | Occlusion reduction and active noise reduction based on seal quality | |
| CN111149369A (en) | On-ear state detection for a headset | |
| US20140257802A1 (en) | Signal processing device, signal processing method, and storage medium | |
| WO2008014018A1 (en) | System and method for noise canceling in a portable mobile communication device coupled with a headset assembly and corresponding computer program product | |
| US11743662B2 (en) | Voice input/output apparatus, hearing aid, voice input/output method, and voice input/output program | |
| US10529358B2 (en) | Method and system for reducing background sounds in a noisy environment | |
| WO2023284402A1 (en) | Audio signal processing method, system, and apparatus, electronic device, and storage medium | |
| WO2023092761A1 (en) | Noise reduction earphone audio processing method, noise reduction earphone, apparatus, and readable storage medium | |
| CN113038318B (en) | Voice signal processing method and device | |
| Miyahara et al. | A hearing device with an adaptive noise canceller for noise-robust voice input | |
| JP2018512754A (en) | Technology for sharing stereo audio among many users | |
| US11533555B1 (en) | Wearable audio device with enhanced voice pick-up | |
| CN115866474A (en) | Transparent transmission noise reduction control method and system of wireless earphone and wireless earphone | |
| Sugiyama et al. | A noise robust hearable device with an adaptive noise canceller and its DSP implementation | |
| CN112969126B (en) | Acoustic sensor system, signal processing system, method and electronic device | |
| US10418048B1 (en) | Noise reference estimation for noise reduction | |
| CN113259797B (en) | Noise reduction circuit, noise reduction method and earphone | |
| US20240071404A1 (en) | Input selection for wind noise reduction on wearable devices | |
| JP2015220482A (en) | Handset terminal, echo cancellation system, echo cancellation method, program | |
| CN115580678A (en) | Data processing method, device and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |