EP4018681A1 - Microphone blocking detection control - Google Patents
Microphone blocking detection controlInfo
- Publication number
- EP4018681A1 EP4018681A1 EP19765468.4A EP19765468A EP4018681A1 EP 4018681 A1 EP4018681 A1 EP 4018681A1 EP 19765468 A EP19765468 A EP 19765468A EP 4018681 A1 EP4018681 A1 EP 4018681A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- signal
- microphone
- blocking
- processor
- pair
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000000903 blocking effect Effects 0.000 title claims abstract description 133
- 238000001514 detection method Methods 0.000 title claims abstract description 58
- 238000000034 method Methods 0.000 claims abstract description 31
- 238000012544 monitoring process Methods 0.000 claims description 5
- 230000005856 abnormality Effects 0.000 abstract description 4
- 230000005236 sound signal Effects 0.000 description 12
- 238000004422 calculation algorithm Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 7
- 238000012545 processing Methods 0.000 description 7
- 238000004891 communication Methods 0.000 description 5
- 230000001771 impaired effect Effects 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000006735 deficit Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 230000001419 dependent effect Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000010801 machine learning Methods 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 238000000926 separation method Methods 0.000 description 2
- OKTJSMMVPCPJKN-UHFFFAOYSA-N Carbon Chemical compound [C] OKTJSMMVPCPJKN-UHFFFAOYSA-N 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 239000003990 capacitor Substances 0.000 description 1
- 229910052799 carbon Inorganic materials 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000008867 communication pathway Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000006866 deterioration Effects 0.000 description 1
- 239000000428 dust Substances 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000002245 particle Substances 0.000 description 1
- 238000007637 random forest analysis Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
- H04R3/005—Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R29/00—Monitoring arrangements; Testing arrangements
- H04R29/004—Monitoring arrangements; Testing arrangements for microphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2499/00—Aspects covered by H04R or H04S not otherwise provided for in their subgroups
- H04R2499/10—General applications
- H04R2499/11—Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's
Definitions
- the disclosure relates in general to digital audio signal processing techniques, and in particular to methods and systems for controlling automatic detection of microphone blocking in apparatuses (such as mobile devices with headsets) comprising multiple microphones.
- Systems comprising an audio recording apparatus, such as a headset connected physically or via wireless connection to a mobile device, can make use of more than one microphone to pick-up and record audio from the surrounding environment, such as the voice of the user of the mobile device. Occasionally, the operation of one or more of these microphones may become blocked, partially blocked, broken or otherwise impaired in operation.
- a microphone may become blocked or partially blocked by a finger or other body part, or by some item the user is wearing (such as a scarf or a hat).
- a microphone may also break or partially break due to a mechanical or other cause, and/or a microphone may become impaired due to sound distortion introduced by environmental factors such as wind. This may lead to a reduction in the quality of the recorded audio.
- any beamforming - usually used for noise reduction and better sound pick-up from desired direction - needs to be switched off during microphone blocking since it will lead to an erroneous output.
- the system can switch from the blocked microphone to one that is not blocked.
- microphone blocking is detected by comparing microphone power levels.
- blocking detection calculated in this way leads to erroneous result during wind noise or handling noise (handling noise emerges when user touches microphone or microphone hole). This is because during wind noise or handling noise microphone power levels usually vary fast in relation to one another. Also, in a silent situation (with no or very low background noise) the comparison of microphone power levels does not produce a reliable result.
- US9467779B2 Microphone partial occlusion detector, Apple Inc, Oct.
- a microphone partial occlusion detector determines a low frequency band separation of the first and second audio signals and a high frequency band separation of the first and second audio signals to generate a microphone partial occlusion function that indicates whether one of the microphones is partially occluded.
- Voice activity detection VAD is utilized for evaluating partial occlusion conditions.
- a first microphone is configured to wake-up other microphones.
- handover command is sent to second microphone.
- microphone impairment is detected by different methods by comparing microphone signals or powers calculated from them to selected threshold.
- an apparatus comprising: at least one pair of microphones, each microphone configured to generate at least one microphone signal; a processor configured to monitor at least one pair of microphone signals, wherein each microphone signal is generated by a different one of a pair of microphones, determine at least one blocking signal by comparing the at least one pair of microphone signals, each blocking signal indicating if a microphone is blocked, and update a blocking status of at least one of the pair of microphones based on the blocking signal; and a control unit configured to monitor the presence of at least one of a wind noise or a handling noise based at least partly on the microphone signals, and generate a control signal indicating the presence; wherein the processor is further configured to prevent updating the blocking status if the control signal indicates presence of at least one of a wind noise or a handling noise.
- Preventing blocking detection when the control unit has identified wind noise, handling noise or other abnormalities results in a microphone blocking detection method that can be used in an apparatus such as a headset which is more reliable and more accurate than previously known methods.
- the processor is further configured to determine the at least one blocking signal by calculating a signal power ratio between the at least one pair of microphone signals over a predetermined frequency band; and comparing the signal power ratio to at least one predetermined threshold value.
- the processor is further configured to determine a blocking signal for each of the at least one pair of microphones, wherein comparing the signal power ratio to a higher threshold value determines a blocking signal for one microphone and comparing the signal power ratio to a lower threshold value determines a blocking signal for the other microphone of the pair of microphones.
- At least one of the control signals is a binary signal, the value of the control signal being 1 when any presence of a wind noise or a handling noise is detected and 0 otherwise; or the blocking signal is a binary signal, the value of the blocking signal being 1 if a microphone is blocked and 0 otherwise.
- the apparatus further comprises at least one inner sensor arranged in a housing; and the control unit is further configured to detect the presence of at least one of a wind noise or a handling noise based on at least one of said microphone signals and at least one inner sensor signal from the at least one inner sensor.
- the inner sensor is at least one of a voice accelerometer, VACC, a voice pickup sensor, VPU, or an inner microphone. Utilizing an inner sensor (e.g. integrated in a headset) in addition to microphone signals helps determining the control signal in a more accurate way.
- control unit is further configured to detect the presence of a user’s own voice based on at least one of the microphone signals and the at least one signal from the at least one inner sensor, and generate an own voice detection, OVD, signal; and the processor is further configured to only update the blocking status if the OVD signal indicates presence of a user’s own voice.
- This solution helps to limit the blocking detection to those time periods when a user’s own voice is detected, thereby improving the reliability of the microphone blocking detection especially in a silent situation.
- the OVD signal is a binary signal, the value of the OVD signal being 1 if a user’s own voice is detected and 0 otherwise.
- the processor is further configured to detect a background noise value by analyzing at least one of the at least one microphone signal and the at least one signal from the at least one inner sensor; and only update the blocking status if at least one of the background noise value exceeds a predetermined background noise threshold value or the OVD signal indicates presence of a user’s own voice, otherwise prevent updating the blocking status. This helps further improving the reliability of the microphone blocking detection by stopping the blocking detection if the noise level is not high enough.
- a method for controlling microphone blocking detection in an apparatus comprising a processor, a control unit, and at least one pair of microphones, the method comprising: monitoring, by the processor, at least one pair of microphone signals, wherein each microphone signal is generated by a different one of a pair of microphones; determining, by the processor, at least one blocking signal by comparing the at least one pair of microphone signals, each blocking signal indicating if a microphone is blocked; updating, by the processor, a blocking status of at least one of the pair of microphones based on the blocking signal; monitoring, by the control unit, the presence of at least one of a wind noise or a handling noise based at least partly on the microphone signals, and generating a control signal indicating the presence; and configuring the processor to prevent updating the blocking status is if the control signal indicates presence of at least one of a wind noise or a handling noise.
- determining the at least one blocking signal comprises: calculating a signal power ratio between the at least one pair of microphone signals over a predetermined frequency band; and comparing the signal power ratio to at least one predetermined threshold value.
- determining the at least one blocking signal comprises determining a blocking signal for each of the at least one pair of microphones, wherein comparing the signal power ratio to a higher threshold value determines a blocking signal for one microphone and comparing the signal power ratio to a lower threshold value determines a blocking signal for the other microphone of the pair of microphones.
- At least one of the control signal is a binary signal, the value of the control signal being 1 when any presence of a wind noise or a handling noise is detected and 0 otherwise; or the blocking signal is a binary signal, the value of the blocking signal being 1 if a microphone is blocked and 0 otherwise.
- the apparatus further comprises at least one inner sensor arranged in a housing; and the method further comprises detecting the presence of at least one of a wind noise or a handling noise by the control unit based on at least one of said microphone signals and at least one inner sensor signal from the at least one inner sensor.
- the inner sensor is at least one of a voice accelerometer, VACC, a voice pickup sensor, VPU, or an inner microphone. Utilizing an inner sensor (e.g. integrated in a headset) in addition to microphone signals helps determining the control signal in a more accurate way.
- the method further comprises detecting, by the control unit, the presence of a user’s own voice based on at least one of the microphone signals and the at least one signal from the at least one inner sensor, and generating an own voice detection, OVD, signal; and configuring the processor to only update the blocking status if the OVD signal indicates presence of a user’s own voice.
- This solution helps to limit the blocking detection to those time periods when a user’s own voice is detected, thereby improving the reliability of the microphone blocking detection method especially in a silent situation.
- the OVD signal is a binary signal, the value of the OVD signal being 1 if a user’s own voice is detected and 0 otherwise.
- the method further comprises: detecting, by the processor, a background noise value by analyzing at least one of the at least one microphone signal and the at least one signal from the at least one inner sensor; and configuring the processor to only update the blocking status if at least one of 1 ) the background noise value exceeds a predetermined background noise threshold value or 2) the OVD signal indicates presence of a user’s own voice, otherwise prevent updating the blocking status. This helps further improving the reliability of the microphone blocking detection by stopping the blocking detection if the noise level is not high enough.
- a system for controlling microphone blocking comprising a processor, a control unit, at least one pair of microphones, and a storage device configured to store instructions that, when executed by the processor, cause the components of the system to perform a method according to any possible implementation form of the second aspect.
- FIG. 1 illustrates in a combined flow diagram an apparatus in accordance with an embodiment of the first aspect and a method in accordance with an embodiment of the second aspect;
- Fig. 2 illustrates in a combined flow diagram an apparatus in accordance with another embodiment of the first aspect and a method in accordance with another embodiment of the second aspect;
- FIG. 3 illustrates in a combined flow diagram an apparatus in accordance with another embodiment of the first aspect and a method in accordance with another embodiment of the second aspect;
- Fig. 4 illustrates in a combined flow diagram an apparatus in accordance with another embodiment of the first aspect and a method in accordance with another embodiment of the second aspect;
- Fig. 5 illustrates a system in accordance with an embodiment of the third aspect
- Figs. 6 to 9 illustrate algorithm performances in different situations as a result of using an apparatus in accordance with another embodiment of the first aspect, a method in accordance with another embodiment of the second aspect, or a system in accordance with another embodiment of the third aspect.
- Fig. 10 illustrates in a flow diagram a method in accordance with another embodiment of the second aspect.
- Fig. 1 illustrates in a combined flow diagram an apparatus as well as method steps for controlling microphone blocking detection in an apparatus 1 according to the present disclosure.
- the apparatus comprises at least a processor 6, a control unit 4, and one pair of microphones 2, indicated separately as a first microphone 2A and a second microphone 2B.
- any number of microphones 2 could be used in the apparatus 1 as long as they are each capable of generating at least one microphone signal 3.
- the processor 6 is configured to monitor a pair of incoming microphone signals 3A,3B, each microphone signal 3A,3B generated by a different microphone 2A,2B, and comparing the microphone signals 3A,3B to each other.
- processor 6 determines at least one blocking signal 7 for each of the microphones 2A,2B based on the comparison, the blocking signal 7 indicating if a microphone 2A,2B is detected as being blocked.
- processor 6 tries to update a blocking status 8 of at least one of the pair of microphones 2 based on the blocking signal 7.
- control unit 4 is continuously monitoring 104 the microphone signals 3 for detecting the presence of at least one of a wind noise or a handling noise, and generates in a next step 105 a control signal 5 indicating the presence.
- control signal 5 indicates presence of at least one of a wind noise or a handling noise
- the processor 6 is instructed, as a step before step 103, to prevent updating the blocking status 8.
- the control signal 5 is a binary signal, the value of the control signal 5 being 1 when any presence of a wind noise or a handling noise is detected and 0 otherwise.
- the apparatus 1 also comprises at least one inner sensor 9 arranged in a housing 12, and the control unit 4 is configured to detect the presence of wind noise or handling noise using an additional inner sensor signal 10 from the inner sensor 9.
- the inner sensor 9 is a voice accelerometer (VACC), a voice pickup sensor (VPU), or an inner microphone.
- VACC voice accelerometer
- VPU voice pickup sensor
- control unit 4 can be a part of the processor 6, e.g. as part of the algorithm package of the processor 6. However, in some embodiments processing of the control signal 5 and determination of the blocking signal 7 can happen in a connected device comprising a separate processor, such as a mobile device 14 shown in Fig. 5.
- the step of determining 102 the at least one blocking signal 7 comprises the step 1021 of calculating a signal power ratio (Rp) between the power of the pair of microphone signals 3A and 3B from the pair of microphones 2A and 2B respectively and, in a next step 1022, comparing the signal power ratio (Rp) to at least one predetermined threshold value T (see below in more detail).
- Rp signal power ratio
- only certain frequencies between predetermined frequency bands are used for comparing the pair of microphone signals 3A and 3B and calculating the signal power ratio (Rp).
- the frequency band between 2kHz and 2.5kHz is used for the comparison.
- a blocking signal 7 is determined in a step 1023 for each of the pair of microphones 2A and 2B.
- this blocking signal 7 is a binary signal, the value of the blocking signal 7 being 1 if a microphone 2A,2B is blocked and 0 otherwise.
- the blocking signal 7 is set as zero (not blocked) for each microphone.
- a blocking signal 7 for each of the pair of microphones is determined by comparing the signal power ratio (Rp) to a predetermined lower threshold value (Tl) to determine a blocking signal 7 for the first microphone 2A (change to 1 if Rp ⁇ Tl), and if the signal power ratio (Rp) is equal or higher than the predetermined lower threshold value (Tl), comparing the signal power ratio (Rp) to a predetermined higher threshold value (Tl) to determine a blocking signal 7 for the second microphone 2B (change to 1 if Rp > Th, leave unchanged if Rp £ Th).
- the blocking signal 7 stays zero (not blocked) if the condition Tl ⁇ Rp ⁇ Th is fulfilled.
- the blocking signal 7 is then used for updating the (temporary) blocking status 8 of any or each of the microphones 2A,2B.
- Fig. 4 illustrates in a combined flow diagram a further possible embodiment of the apparatus as well as the respective method steps according to the present disclosure.
- features that are the same or similar to corresponding features previously described or shown herein are denoted by the same reference numeral as previously used for simplicity.
- control unit 4 is a part of the algorithm package of the processor 6.
- the processor 6 can be integrated in a headset and thus provide a standalone apparatus 1 for controlling microphone blocking detection.
- control unit 4 is further configured to detect, in a further step 107, the presence of a user’s own voice based on at least one of a microphone signal 3 from the pair of microphones 2 and an inner sensor signal 10 from an inner sensor 9 and generate an own voice detection (OVD) signal 11 accordingly, indicating the presence of a user’s own voice.
- ODD own voice detection
- the processor 6 is configured to only update the blocking status 8 in a further step 108 if the OVD signal 11 indicates presence of a user’s own voice.
- this OVD signal 11 is a binary signal, the value of the OVD signal 11 being 1 if a user’s own voice is detected and 0 otherwise.
- a continuous OVD signal 11 is also conceivable.
- the processor 6, or the control unit 4 can also be configured to, in a step 109 before the optional own voice detection step 107, detect a background noise value (noise level) N by analyzing at least one of a microphone signal 3, an OVD signal 11 , and an inner sensor signal 10, and determine whether this background noise value N exceeds a predetermined background noise threshold value Nt.
- the processor 6 is configured to only update the blocking status 8 if N > Nt, otherwise either check in an optional own voice detection step 107, as described above, the presence of a user’s own voice, or directly prevent updating the blocking status 8.
- the processor 6 is configured to check 110 and only update the blocking status 8 if at least one of the background noise value N exceeds a predetermined background noise threshold value Nt or the OVD signal 11 indicates presence of a user’s own voice, otherwise prevent updating the blocking status 8.
- This solution allows to stop the blocking detection if the noise level is not high enough and limit the blocking detection to those time periods when OVD (user’s own voice) is detected. In other words, microphone blocking detection can be prevented in a silent situation when there is no background noise or speech, thereby avoiding false block detection.
- OVD signal 11 for blocking detection is optional, it can be used in all cases or for example only in silent cases, or it can be left out of the algorithm completely.
- using the determined background noise value N for blocking detection is also optional, it can be used in all cases, in some cases, or it can be left out of the algorithm completely.
- Fig. 5 illustrates a system according to the present disclosure, comprising a processor 6, a control unit 4, at least one pair of microphones 2A and 2B, and a storage device 13 configured to store instructions that, when executed by the processor 6, cause the components of the system to perform a method according to any one of the possible embodiments described above.
- a processor 6 a control unit 4, at least one pair of microphones 2A and 2B, and a storage device 13 configured to store instructions that, when executed by the processor 6, cause the components of the system to perform a method according to any one of the possible embodiments described above.
- features that are the same or similar to corresponding features previously described or shown herein are denoted by the same reference numeral as previously used for simplicity.
- control unit 4 is a part of the algorithm package of the processor 6.
- the processor 6 and the storage device 13 can both be integrated in a headset and thus provide a standalone apparatus 1 for controlling microphone blocking detection.
- the apparatus 1 can further include at least one inner sensor 9 arranged in a housing 12, the inner sensor 9 preferably being at least one of a voice accelerometer, VACC, a voice pickup sensor, VPU, or an inner microphone.
- the control unit 4 is configured to detect the presence of at least one of a wind noise or a handling noise based on at least one inner sensor signal 10 from the at least one inner sensor 9.
- the control unit 4 can be further configured to detect the presence of a user’s own voice and generate an own voice detection (OVD) signal 11 , as well as to detect a background noise value (noise level) N.
- ODD own voice detection
- the microphones 2A and 2B can be included in a headset as shown in Fig. 5.
- the headset can be a set of earphones or headphones that are either cordless or connect to a mobile device 14 via a wired connection.
- both microphones 2A and 2B are integrated in or near the housing 12 of a pair of earphones/headphones that connect to a mobile device in a cordless manner (such as via Bluetooth, Bluetooth LE, or Wireless signals).
- both microphones 2A and 2B can be integrated in the housing 12 of the same earpiece.
- each microphone 2A and 2B can be integrated in a different earpiece.
- the microphones 2 can be integrated into the wires, either both a first microphone 2A and a second microphone 2B integrated into the side of the wire leading to the same side of the earphones/headphones, or the first microphone 2A and a second microphone 2B can be integrated into different (left and right) sides of the wires.
- the mobile device 14 may for example be a mobile communications handset device such as a smartphone or a multi-function cellular phone, or a mobile terminal or user equipment of a wireless communication system.
- the apparatus can be an audio recorder, such as an MP3 player, a media recorder/player (also known as an MP4 player), or any suitable portable apparatus suitable for recording audio or audio/video camcorder/memory audio or video recorder.
- any or each of the microphones 2A,2B can be a solid state microphone, in other words capable of capturing audio signals and outputting a suitable digital format signal
- the microphones 2 can comprise any suitable microphone or audio capture means, for example a condenser microphone, capacitor microphone, electrostatic microphone, Electret condenser microphone, dynamic microphone, ribbon microphone, carbon microphone, piezoelectric microphone, or micro electrical- mechanical system (MEMS) microphone.
- the microphone 2 is a digital microphone array, in other words configured to generate a digital signal output (and thus not requiring an analogue-to-digital converter).
- the microphone 2 or array of microphones can in some embodiments output the audio captured signal to an analogue-to-digital converter (ADC).
- ADC an analogue-to-digital converter
- the apparatus can further comprise an analogue-to-digital converter (ADC) configured to receive the analogue captured audio signal from the microphones 2A,2B and outputting the audio captured signal in a suitable digital form.
- ADC analogue-to-digital converter
- the analogue-to-digital converter can be any suitable analogue-to-digital conversion or processing means.
- the microphones are 'integrated' microphones containing both audio signal generating and analogue-to- digital conversion capability.
- the apparatus 1 comprises audio subsystems with a digital-to- analogue converter for converting digital audio signals from a processor to a suitable analogue format.
- the digital-to-analogue converter (DAC) or signal processing means can in some embodiments be any suitable DAC technology.
- the mobile device 14 can comprise in some embodiments a speaker.
- the speaker can in some embodiments receive the output from the digital-to-analogue converter and present the analogue audio signal to the user.
- the speaker can be representative of multi-speaker arrangement, a headset, for example a set of headphones, or cordless headphones.
- the apparatus 1 is shown having both audio capture and audio presentation components (in the form of a headset comprising both speakers and microphones), it would be understood that in some embodiments the apparatus 1 can comprise only the audio capture part of the audio subsystem such that in some embodiments of the apparatus the microphones (for audio capture) are present.
- the processor 6 can be configured to execute various program codes.
- the implemented program codes can comprise for example audio recording and microphone defect detection routines.
- the apparatus 1 further comprises a memory.
- the processor 6 is coupled to memory.
- the memory can be any suitable storage means 13.
- the memory comprises a program code section for storing program codes implementable upon the processor 6.
- the memory can further comprise a stored data section for storing data, for example data that has been recorded or analysed in accordance with the application. The implemented program code stored within the program code section, and the data stored within the stored data section can be retrieved by the processor 6 whenever needed via the memory-processor coupling.
- the apparatus 1 can comprise a user interface.
- the user interface can be coupled in some embodiments to the processor 6.
- the processor can control the operation of the user interface and receive inputs from the user interface.
- the user interface can enable a user to input commands to the electronic device or apparatus, for example via a keypad, and/or to obtain information from the apparatus 1 , for example via a display which is part of the user interface.
- the user interface can in some embodiments comprise a touch screen or touch interface capable of both enabling information to be entered to the apparatus 1 and further displaying information to the user of the apparatus 1.
- the apparatus further comprises a transceiver, the transceiver in such embodiments can be coupled to the processor 6 and configured to enable a communication with a cordless headset, other apparatus or electronic devices, for example via a wireless communications network.
- the transceiver or any suitable transceiver or transmitter and/or receiver means can in some embodiments be configured to communicate with other electronic devices or apparatus via a wire or wired coupling.
- the coupling can be any suitable known communications protocol, for example in some embodiments the transceiver or transceiver means can use a suitable universal mobile telecommunications system (UMTS) protocol, a wireless local area network (WLAN) protocol such as for example IEEE 802.X, a suitable short-range radio frequency communication protocol such as Bluetooth, or infrared data communication pathway (IRDA).
- UMTS universal mobile telecommunications system
- WLAN wireless local area network
- IRDA infrared data communication pathway
- the signals can be downmixed which is can be represented on the display. It would be understood that in some embodiments the number of microphones used as an input can be more than two and the number of input channels can be more than two and the number of downmixed channels output can be more than or fewer than two (where the number of downmixed channels is less than the number of input channels). In some embodiments where the apparatus 1 is configured to receive microphone signals 3 from four or more microphones 2 then an impaired or non-functional microphone 2A can be replaced by a functional microphone 2B such that the apparatus 1 can continue to record or capture a multichannel signal.
- the indicator can be configured to modify the user's habits, such as the way the user is holding the apparatus. For example, a user may hold the apparatus 1 and one or more of microphones may be blocked by the user's fingers. In the case where audio is being recorded with the first microphone 2A and the second microphone 2B being active, some embodiments may determine or detect that the active microphone has been blocked and switch the functionality of that active microphone with one of the passive microphones. Furthermore, in some embodiments, on determining that a third microphone is also blocked then a fourth microphone can be selected. In some embodiments the indicator can further be used to determine or select microphone or audio signal processing parameters. These can in some embodiments be equalisation or signal processing parameters to acoustically tune the input audio signals.
- these parameters can be associated with the location or distribution of the microphones selected. For example in some embodiments where a distance and relative direction between the microphone inputs is required, for example in directional analysis of the input audio signals, then the indicator can be used not only to select the functional microphone but generate, determine or select the microphone related distance and relative direction parameters used in processing the audio signals.
- FIGs. 6 to 9 illustrate algorithm performances in different situations as a result of using an apparatus according to the present disclosure.
- microphones 2A and 2B are represented as microphone 1 and microphone 2.
- microphone 2 is correctly detected as blocked in a situation where there is background noise, based on the signal power ratio (Rp) between microphone 1 and microphone 2.
- the ratio Rp is greater than the higher threshold (Th), thus the second microphone is detected as blocked.
- microphone 2 is correctly detected as blocked in a silent situation (i.e. when there is no background noise).
- the signal power ratio (Rp) value is between the higher and lower threshold, and thus blocking detection cannot be correctly detected.
- the OVD signal helps to find the time periods where blocking can be reliably detected and thus blocking detection results remain correct throughout the test signal.
- control information WIND can prevent updating blocking detection result when there is wind noise. Otherwise the blocking status would be updated erroneously, since sometimes the microphone signal power ratio is lower than the lower threshold, which would indicate that microphone 1 is blocked.
- Fig. 6 and Fig. 9 it can be seen that during background noise, using OVD is not necessary for blocking detection.
- the microphone signal power ratio remains constantly higher than the higher threshold (Th).
- the microphone signal power ratio remains between the thresholds indicating that no microphone is blocked.
- Fig. 10 illustrates a further embodiment of the method according to the present disclosure.
- the steps and components illustrated in this figure correspond to that of Fig. 3 and 4, but the right side of the figure further illustrates an aspect wherein the processor is configured prevent occasional fast changes in the blocking status of any of the microphones.
- using the OVD signal for blocking detection is optional - it can be used in all cases or for example only in silent cases, or then it can be left out completely.
- Blockl and block2 denote temporary blocking status for microphones 2A and 2B, respectively.
- counters for setting blocking detection status to ON (1) and OFF (0) are utilized for both of the microphones.
- Block_off_counter_1 and block_off_counter_2 are compared to a threshold block_off_thd and blocking detection status of the corresponding microphone is set to 0 only after block_off_counter for that microphone is above the threshold.
- block_on_counter_1 and block_on_counter_2 are compared to block_on_thr and blocking detection status of the corresponding microphone is set to 1 after block_on_counter for that microphone is above the threshold.
- microphone signal power ratios at selected frequency bands can be utilized as features together with control features obtained from the control unit 4 and optional further OVD signals, possibly in combination of other features, as input data for a machine learning algorithm for blocking detection.
- Such machine learning algorithm could be for example classification or regression trees, K-nearest neighbors, random forest, or a neural network.
- a control signal 5 indicating presence of wind or handling noise obtained from a control unit 4 in accordance with the present disclosure optionally using inner sensor signals 10 from an inner sensor 9 such as a voice accelerometer (VACC), a voice pickup sensor (VPU), or an inner microphone, can be used as input for an algorithm to control microphone calibration gain estimation. This way calibration gain estimation can be prevented during those time periods that contain wind noise or handling noise.
- VACC voice accelerometer
- VPU voice pickup sensor
- an inner microphone can be used as input for an algorithm to control microphone calibration gain estimation.
- a computer program may be stored/distributed on a suitable medium, such as an optical storage medium or a solid-state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems.
- a suitable medium such as an optical storage medium or a solid-state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems.
Landscapes
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Otolaryngology (AREA)
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
Description
Claims
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/EP2019/073777 WO2021043414A1 (en) | 2019-09-05 | 2019-09-05 | Microphone blocking detection control |
Publications (1)
Publication Number | Publication Date |
---|---|
EP4018681A1 true EP4018681A1 (en) | 2022-06-29 |
Family
ID=67875469
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP19765468.4A Pending EP4018681A1 (en) | 2019-09-05 | 2019-09-05 | Microphone blocking detection control |
Country Status (3)
Country | Link |
---|---|
EP (1) | EP4018681A1 (en) |
CN (1) | CN114303389A (en) |
WO (1) | WO2021043414A1 (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113746976B (en) * | 2021-07-23 | 2023-03-28 | 荣耀终端有限公司 | Audio module detection method, electronic device and computer storage medium |
WO2023038911A1 (en) * | 2021-09-10 | 2023-03-16 | Dolby Laboratories Licensing Corporation | Audio enhancement for mobile capture |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2006007441A1 (en) * | 2004-06-16 | 2006-01-19 | Cardo Systems Inc. | Wireless communication headset with microphone switching system |
US20110317848A1 (en) * | 2010-06-23 | 2011-12-29 | Motorola, Inc. | Microphone Interference Detection Method and Apparatus |
US9711127B2 (en) * | 2011-09-19 | 2017-07-18 | Bitwave Pte Ltd. | Multi-sensor signal optimization for speech communication |
US9699581B2 (en) | 2012-09-10 | 2017-07-04 | Nokia Technologies Oy | Detection of a microphone |
CN103501375B (en) * | 2013-09-16 | 2017-04-19 | 华为终端有限公司 | Method and device for controlling sound effect |
US9467779B2 (en) | 2014-05-13 | 2016-10-11 | Apple Inc. | Microphone partial occlusion detector |
US9924288B2 (en) * | 2014-10-29 | 2018-03-20 | Invensense, Inc. | Blockage detection for a microelectromechanical systems sensor |
US9699550B2 (en) | 2014-11-12 | 2017-07-04 | Qualcomm Incorporated | Reduced microphone power-up latency |
CN105979053B (en) * | 2016-04-18 | 2017-09-29 | 广东欧珀移动通信有限公司 | The detection method of microphone, device and mobile terminal in mobile terminal |
GB2555139A (en) * | 2016-10-21 | 2018-04-25 | Nokia Technologies Oy | Detecting the presence of wind noise |
JP7009165B2 (en) * | 2017-02-28 | 2022-01-25 | パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ | Sound pickup device, sound collection method, program and image pickup device |
CN106911996A (en) * | 2017-03-03 | 2017-06-30 | 广东欧珀移动通信有限公司 | The detection method of microphone state, device and terminal device |
US10885907B2 (en) * | 2018-02-14 | 2021-01-05 | Cirrus Logic, Inc. | Noise reduction system and method for audio device with multiple microphones |
-
2019
- 2019-09-05 EP EP19765468.4A patent/EP4018681A1/en active Pending
- 2019-09-05 WO PCT/EP2019/073777 patent/WO2021043414A1/en unknown
- 2019-09-05 CN CN201980099955.8A patent/CN114303389A/en active Pending
Also Published As
Publication number | Publication date |
---|---|
WO2021043414A1 (en) | 2021-03-11 |
CN114303389A (en) | 2022-04-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10045141B2 (en) | Detection of a microphone | |
US10051396B2 (en) | Automatic microphone switching | |
US8792648B2 (en) | Apparatus and method for transmitting/receiving voice signal through headset | |
CN109982228B (en) | Microphone fault detection method and mobile terminal | |
CN113726940B (en) | Recording method and device | |
CN108848267B (en) | Audio playing method and mobile terminal | |
CN113630708A (en) | Earphone microphone abnormality detection method and device, earphone kit and storage medium | |
EP4018681A1 (en) | Microphone blocking detection control | |
CN114845213A (en) | Method for adjusting volume of terminal and terminal | |
KR20200017702A (en) | Electronic device and method for adjusting the output intensity of a speaker based on distance from an external electronic device | |
WO2018035868A1 (en) | Method for outputting audio, electronic device, and storage medium | |
WO2015030642A1 (en) | Volume reduction for an electronic device | |
WO2022135071A1 (en) | Earphone playback control method and apparatus, and electronic device and storage medium | |
CN105721710A (en) | Recording method and apparatus, and electronic device | |
EP2594088B1 (en) | Audio device | |
CN114567849A (en) | Detection method and device, wireless earphone and storage medium | |
CN109151195B (en) | Earphone control method and control system during running exercise | |
JP2018148539A (en) | Information processing apparatus, control method of the same, and control program | |
US10997984B2 (en) | Sounding device, audio transmission system, and audio analysis method thereof | |
CN112911056A (en) | Audio recording calibration method and device and computer readable storage medium | |
JP2022148031A (en) | Reproducer, reproduction system, reproduction method, and reproduction program | |
WO2015098196A1 (en) | Electronic device, sound output control method, and program | |
KR100798460B1 (en) | Mobile communication terminal changing frequency of calling bell and its operating method | |
US11782673B2 (en) | Controlling audio output | |
JP2018084843A (en) | Input/output device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20220324 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
PUAG | Search results despatched under rule 164(2) epc together with communication from examining division |
Free format text: ORIGINAL CODE: 0009017 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |