CN112788513B - Method and related device for intelligently detecting hole blockage of microphone of wireless earphone - Google Patents

Method and related device for intelligently detecting hole blockage of microphone of wireless earphone Download PDF

Info

Publication number
CN112788513B
CN112788513B CN202010481091.0A CN202010481091A CN112788513B CN 112788513 B CN112788513 B CN 112788513B CN 202010481091 A CN202010481091 A CN 202010481091A CN 112788513 B CN112788513 B CN 112788513B
Authority
CN
China
Prior art keywords
energy value
wireless
distance
microphone
earphone
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010481091.0A
Other languages
Chinese (zh)
Other versions
CN112788513A (en
Inventor
刘熙民
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangxi Risound Electronics Co ltd
Original Assignee
Shenzhen Ruier Electronic Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Ruier Electronic Co ltd filed Critical Shenzhen Ruier Electronic Co ltd
Priority to CN202010481091.0A priority Critical patent/CN112788513B/en
Priority to CN202211103532.9A priority patent/CN116193307A/en
Publication of CN112788513A publication Critical patent/CN112788513A/en
Application granted granted Critical
Publication of CN112788513B publication Critical patent/CN112788513B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2201/00—Details of transducers, loudspeakers or microphones covered by H04R1/00 but not provided for in any of its subgroups
    • H04R2201/10—Details of earpieces, attachments therefor, earphones or monophonic headphones covered by H04R1/10 but not provided for in any of its subgroups
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00—Reducing energy consumption in communication networks
    • Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks

Abstract

The embodiment of the application discloses a method for intelligently detecting the blockage of a microphone of a wireless earphone and a related device, wherein the method comprises the following steps: collecting audible sound waves by using a microphone of the first wireless earphone and a microphone of the second wireless earphone; determining a first energy value of the audible sound waves collected by the first wireless headset and determining a second energy value of the audible sound waves collected by the second wireless headset; and when the absolute difference value between the first energy value and the second energy value is detected to exceed a first preset threshold value and the first energy value is smaller than the second energy value, determining that the microphone of the first wireless earphone is in a hole blocking state. The embodiment of the application can realize the detection of the hole plugging state of the microphone of the wireless earphone, and is favorable for improving the convenience, accuracy and intelligence of hole plugging detection.

Description

Method and related device for intelligently detecting hole blockage of microphone of wireless earphone
Technical Field
The application relates to the technical field of electronics, in particular to a method for intelligently detecting a hole blockage of a microphone of a wireless earphone and a related device.
Background
The earphone is a media listening accessory and is visible everywhere in people's life. The wired earphone as its name implies communicates with a mobile terminal (such as a mobile phone, a walkman, a radio, etc.) by means of wired connection. However, the wired earphone is limited by the earphone cord, if the earphone cord is too short, inconvenience may be brought to a user, if the earphone cord is too long, problems such as winding and knotting of the earphone cord may easily occur, and the earphone cord is easily damaged, so that the service life of the wired earphone is not long. Based on the above problems, wireless earphones are produced.
Wireless headsets are increasingly popular with users because of their portability and freedom from being tied by headset cords. However, in practical applications, people often find that a microphone of the wireless headset is plugged, for example, a dust plug, a water drop plug, etc., which causes the voice data acquired by the microphone of the wireless headset to have intermittent sound and low volume, and affects the normal use of the wireless headset.
Disclosure of Invention
The embodiment of the application provides a method and a related device for intelligently detecting the hole blockage of a microphone of a wireless headset, which can realize the detection of the hole blockage state of the microphone of the wireless headset and is beneficial to improving the convenience, accuracy and intelligence of hole blockage detection.
A first aspect of the embodiments of the present application provides a method for intelligently detecting a hole blockage of a microphone of a wireless headset, where the method is applied to a mobile terminal, the mobile terminal is connected to the wireless headset, and the wireless headset includes a first wireless headset and a second wireless headset, where both the first wireless headset and the second wireless headset are provided with microphones; the method comprises the following steps:
collecting audible acoustic waves with a microphone of the first wireless headset and a microphone of the second wireless headset;
determining a first energy value of the audible sound waves collected by the first wireless headset and determining a second energy value of the audible sound waves collected by the second wireless headset;
when the absolute difference value between the first energy value and the second energy value is detected to exceed a first preset threshold value, and the first energy value is smaller than the second energy value, it is determined that the microphone of the first wireless earphone is in a hole blocking state.
As an optional implementation manner, in the first aspect of this embodiment of the present application, the method further includes:
acquiring a first distance between the first wireless earphone and a sound source and acquiring a second distance between the second wireless earphone and the sound source;
wherein the determining that the microphone of the first wireless headset is in a hole blocking state when it is detected that the absolute difference between the first energy value and the second energy value exceeds a first preset threshold and the first energy value is smaller than the second energy value comprises:
when the absolute difference value between the first energy value and the second energy value is detected to exceed a first preset threshold value, the first energy value is smaller than the second energy value, and the first distance is smaller than or equal to the second distance, it is determined that the microphone of the first wireless earphone is in a hole blocking state.
As an optional implementation manner, in the first aspect of this embodiment of the present application, the method further includes:
acquiring a third distance between the first wireless earphone and the mobile terminal and acquiring a fourth distance between the second wireless earphone and the mobile terminal;
wherein determining that the microphone of the first wireless headset is in a hole blocking state when detecting that the absolute difference between the first energy value and the second energy value exceeds a first preset threshold, the first energy value is smaller than the second energy value, and the first distance is smaller than or equal to the second distance comprises:
when it is detected that the absolute difference value between the first energy value and the second energy value exceeds a first preset threshold value, the first energy value is smaller than the second energy value, the first distance is smaller than or equal to the second distance, and the third distance is smaller than or equal to the fourth distance, it is determined that the microphone of the first wireless headset is in a hole blocking state.
As an optional implementation manner, in the first aspect of this embodiment of the present application, the method further includes:
when detecting that the absolute difference value of the first energy value and the second energy value exceeds the first preset threshold value, the second energy value is smaller than the first energy value, the second distance is smaller than or equal to the first distance, and the fourth distance is smaller than or equal to the third distance, determining that the microphone of the second wireless headset is in a hole blocking state.
As an optional implementation manner, in the first aspect of this embodiment of the present application, the method further includes:
when detecting that the absolute difference value of the first energy value and the second energy value does not exceed the first preset threshold value, disconnecting the mobile terminal from the wireless headset;
collecting the audible sound wave by using a microphone of the mobile terminal;
determining a third energy value of the audible sound wave collected by the mobile terminal;
when the absolute difference value between the first energy value and the third energy value is detected to exceed a second preset threshold value, and the first energy value is smaller than the third energy value, determining that a microphone of the first wireless earphone is in a hole blocking state;
and when the absolute difference value between the second energy value and the third energy value is detected to exceed the second preset threshold value and the second energy value is smaller than the third energy value, determining that the microphone of the second wireless earphone is in a hole blocking state.
A second aspect of the embodiments of the present application provides a device for intelligently detecting a hole blockage of a microphone of a wireless headset, where the device is applied to a mobile terminal, the mobile terminal is connected to the wireless headset, and the wireless headset includes a first wireless headset and a second wireless headset, where both the first wireless headset and the second wireless headset are provided with microphones; the device comprises:
a first acquisition unit for acquiring audible sound waves using the microphone of the first wireless headset and the microphone of the second wireless headset;
a determining unit for determining a first energy value of the audible sound waves collected by the first wireless headset and determining a second energy value of the audible sound waves collected by the second wireless headset;
the detection unit is used for determining that the microphone of the first wireless earphone is in a hole blocking state when the absolute difference value between the first energy value and the second energy value is detected to exceed a first preset threshold value and the first energy value is smaller than the second energy value.
As an optional implementation manner, in the second aspect of the embodiments of the present application, the apparatus further includes:
the acquisition unit is used for acquiring a first distance between the first wireless earphone and a sound source and acquiring a second distance between the second wireless earphone and the sound source;
the detection unit is specifically configured to determine that the microphone of the first wireless headset is in a hole blocking state when it is detected that an absolute difference between the first energy value and the second energy value exceeds a first preset threshold, the first energy value is smaller than the second energy value, and the first distance is smaller than or equal to the second distance.
As an optional implementation manner, in a second aspect of embodiments of the present application, the obtaining unit is further configured to obtain a third distance between the first wireless headset and the mobile terminal, and obtain a fourth distance between the second wireless headset and the mobile terminal;
the detection unit is specifically configured to determine that the microphone of the first wireless headset is in a hole blocking state when it is detected that an absolute difference between the first energy value and the second energy value exceeds a first preset threshold, the first energy value is smaller than the second energy value, the first distance is smaller than or equal to the second distance, and the third distance is smaller than or equal to the fourth distance.
As an optional implementation manner, in the second aspect of the embodiments of the present application, the detecting unit is further configured to determine that the microphone of the second wireless headset is in a hole blocking state when it is detected that an absolute difference between the first energy value and the second energy value exceeds the first preset threshold, the second energy value is smaller than the first energy value, the second distance is smaller than or equal to the first distance, and the fourth distance is smaller than or equal to the third distance.
As an optional implementation manner, in the second aspect of this embodiment of this application, the apparatus further includes:
the control unit is used for disconnecting the mobile terminal from the wireless earphone when the detection unit detects that the absolute difference value of the first energy value and the second energy value does not exceed the first preset threshold value;
the second acquisition unit is used for acquiring the audible sound wave by utilizing a microphone of the mobile terminal;
the determining unit is further configured to determine a third energy value of the audible sound wave collected by the mobile terminal;
the detection unit is further configured to determine that a microphone of the first wireless headset is in a hole blocking state when it is detected that an absolute difference between the first energy value and the third energy value exceeds a second preset threshold and the first energy value is smaller than the third energy value;
the detection unit is further configured to determine that a microphone of the second wireless headset is in a hole blocking state when it is detected that an absolute difference between the second energy value and the third energy value exceeds the second preset threshold and the second energy value is smaller than the third energy value.
A third aspect of embodiments of the present application provides a mobile terminal, comprising a processor, a memory, and at least one or more programs; the at least one or more programs are stored in the memory and configured to be executed by the processor, the programs including instructions for performing the steps described in any of the methods of the first aspect of the embodiments of the present application.
A fourth aspect of embodiments of the present application provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program for electronic data exchange, and the computer program specifically includes instructions for performing some or all of the steps described in any one of the methods according to the first aspect of embodiments of the present application.
A fifth aspect of embodiments of the present application provides a computer program product, wherein the computer program product comprises a non-transitory computer readable storage medium storing a computer program, the computer program being operable to cause a computer to perform some or all of the steps as described in any one of the methods of the first aspect of embodiments of the present application. The computer program product may be, for example, a software installation package.
In order to detect whether a microphone of a wireless headset is plugged, a first wireless headset and a second wireless headset included in the wireless headset can be in communication connection with a mobile terminal, the mobile terminal respectively collects audible sound waves through a microphone of the first wireless headset and a microphone of the second wireless headset, and a first energy value of the audible sound waves collected by the first wireless headset and a second energy value of the audible sound waves collected by the second wireless headset are determined; when it is detected that the absolute difference between the first energy value and the second energy value exceeds a first preset threshold value and the first energy value is smaller than the second energy value, it may be determined that the microphone of the first wireless headset is in a hole blocking state. Therefore, the mobile terminal can simultaneously acquire audible sound waves by utilizing the two wireless earphones for hole blockage detection, and because the two wireless earphones are positioned in the same environment, the influence of environmental noise on the sound waves can be eliminated, the influence of the environment on a detection result can be further reduced, and the convenience and the accuracy of hole blockage detection are improved; in addition, adopt two wireless earphones to acquire the sound wave and carry out stifled hole and detect, can not have the hardware difference to cause the inaccuracy of testing result because of equipment structure is different, promoted the accuracy and the intellectuality that stifled hole detected.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required to be used in the embodiments will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic diagram of a system architecture for detecting a microphone blockage of a wireless headset according to an embodiment of the present disclosure;
fig. 2 is a schematic flowchart of a method for intelligently detecting a microphone hole blockage of a wireless headset according to an embodiment of the present disclosure;
fig. 3 is a schematic flowchart of another method for intelligently detecting a microphone blockage of a wireless headset according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of an apparatus for intelligently detecting a microphone of a wireless headset from being plugged in a hole according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of another apparatus for intelligently detecting a microphone blockage of a wireless headset according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of a mobile terminal according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
It should be noted that the terms "comprises" and "comprising," and any variations thereof, in the embodiments of the present application, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus. Furthermore, the terms "first," "second," and "third," etc. are used to distinguish between different objects and are not used to describe a particular order. The following describes embodiments of the present application in detail.
The embodiment of the application provides a system for detecting a microphone hole blockage of a wireless earphone. As shown in fig. 1, the system may at least include a mobile terminal 100, a first wireless headset 200 and a second wireless headset 300, wherein both the first wireless headset 200 and the second wireless headset 300 have microphones built therein, so as to implement a sound pickup function. The mobile terminal 100 may be in communication connection with the first wireless headset 100 and the second wireless headset 200 in a wireless manner, respectively, so that the mobile terminal 100 may interact with the first wireless headset 200 and the second wireless headset 300, respectively. For example, the mobile terminal 100 may output multimedia data (e.g., audio data) through the first wireless headset 200 and the second wireless headset 300, and the mobile terminal 100 may also acquire voice data collected by the microphones of the first wireless headset 200 and the second wireless headset 300. Specifically, the mobile terminal 100 may perform communication connection with the first wireless headset 200 and the second wireless headset 300 through bluetooth technology, and at this time, the first wireless headset 200 and the second wireless headset 300 may be regarded as bluetooth headsets; the mobile terminal 100 may also be in communication connection with the first wireless headset 200 and the second wireless headset 300 through an infrared technology, and at this time, the first wireless headset 200 and the second wireless headset 300 may be regarded as infrared headsets; the mobile terminal 100 may also be communicatively coupled to the first wireless headset 200 and the second wireless headset 300 via 2.4G technology, in which case the first wireless headset 200 and the second wireless headset 300 may be considered as 2.4G headsets. The embodiment of the present application does not limit what wireless manner the mobile terminal 100 and the first wireless headset 200 and the second wireless headset 300 are communicatively connected, and what type of wireless headset the first wireless headset 200 and the second wireless headset 300 are. The mobile terminal 100 may include, but is not limited to, various handheld devices (e.g., smart phones, mobile tablets, etc.) having wireless communication capabilities, in-vehicle devices, wearable devices (e.g., smart watches, smart bands, pedometers, etc.), multimedia playing devices (e.g., walkman) or other processing devices capable of connecting to a wireless modem, and so forth. For convenience of description, the above-mentioned devices may be collectively referred to as a mobile terminal.
The earphone of this application embodiment can be the intelligent earphone that includes the artificial intelligence chip, and still can include microprocessor among the intelligent earphone, microprocessor and artificial intelligence chip among the intelligent earphone come interconnect communication through the dedicated channel, but microprocessor independent control intelligence earphone work, microprocessor also can be under the guide of artificial intelligence chip control intelligence earphone work, some intelligent control strategies can be exported for microprocessor to the artificial intelligence chip, guide the better work of microprocessor. The microprocessor can construct a microprocessor software platform, the artificial intelligence chip can construct an artificial intelligence chip software platform, the microprocessor software platform and the artificial intelligence chip software platform are two mutually independent software platforms, and the artificial intelligence chip software platform is in communication connection with the microprocessor software platform.
Wherein, artificial intelligence chip and microprocessor all can be through bluetooth communication module or wired link and mobile terminal communication connection, and mobile terminal can be through sending dormancy instruction to the microprocessor of arbitrary one intelligent earphone in intelligent earphone pair (intelligent earphone pair is including two earphones that pair), and this microprocessor gets into dormant state from waking up the state, and when the microprocessor of intelligent earphone was in dormant state, the audio playback function of this intelligent earphone will be invalid so. The mobile terminal can also instruct the artificial intelligence chip to inform the microprocessor to enter the awakening state from the dormancy state by sending the awakening instruction to the artificial intelligence chip of the intelligent earphone. In some possible embodiments, the artificial intelligence chip may always be in the wake-up state when the power is normally supplied. In some possible embodiments, the microprocessor in the sleep state can only receive the instruction from the artificial intelligence chip, that is, the dedicated channel between the microprocessor and the artificial intelligence chip is not closed at this time, but all other communication channels of the microprocessor are in the closed state, and for example, the microprocessor in the sleep state can only receive the instruction from the artificial intelligence chip, that is, the microprocessor in the sleep state can only be woken up by the artificial intelligence chip. When the artificial intelligence chip wakes up the microprocessor in the dormant state and fails, the artificial intelligence chip can be switched to the working mode of the microprocessor, the microprocessor is replaced to control the intelligent earphone to work in the coming time, and when the artificial intelligence chip is switched to the working mode of the microprocessor, the audio playing function of the intelligent earphone can normally run under the support of the artificial intelligence chip.
The embodiment of the application provides a method for intelligently detecting the blockage of a microphone of a wireless earphone. The method can be applied to a mobile terminal, the mobile terminal is connected with a wireless earphone, the wireless earphone comprises a first wireless earphone and a second wireless earphone, and the first wireless earphone and the second wireless earphone are both provided with microphones. As shown in fig. 2, the method may include the steps of:
210. the mobile terminal collects the audible acoustic waves using a microphone of the first wireless headset and a microphone of the second wireless headset.
In the embodiment of the application, the audible sound is the sound which can be heard by human ears and has the frequency range of 20 Hz-20 kHz. The audible sound may be ambient sound in the environment in which the wireless headset is located, or may be sound emitted by a speaker of the mobile terminal, or may be sound emitted by a user wearing the first wireless headset and/or wearing the second wireless headset, or may be sound emitted by other electronic devices, etc., without being limited thereto.
220. The mobile terminal determines a first energy value of the audible sound waves collected by the first wireless headset and determines a second energy value of the audible sound waves collected by the second wireless headset.
In the embodiment of the present application, the sound wave is a propagation form of sound, and an object emitting the sound is referred to as a sound source. An acoustic wave is a mechanical wave that is generated by the vibration of an acoustic source, and the propagation of an acoustic wave is essentially the transfer of energy in a medium. The transmission of sound needs three elements: an acoustic source, a propagation medium, and a receiver. Wherein, a sound source is an object which emits sound, such as a person or equipment; the propagation medium is a channel through which energy flows, such as air; the receiver is a device that senses sound, such as a human ear or a microphone. The energy of sound wave is called sound energy, the transmission of sound has energy loss and is also called absorption, when the distance between the sound source and the receiver is far, the sound received by the receiver is small, namely the energy is low; conversely, when the sound source is closer to the receiver, the receiver receives more sound, i.e., more energy.
The energy value of the sound wave can be calculated by the medium density, the sound frequency, the amplitude and the wave speed of the propagation medium, namely, how much of the average value (within one period) of the energy flowing through the medium per unit area per unit time represents the energy (intensity) of the sound per unit area. The formula for calculating the energy value of the sound wave may be: (P w c a)/2, wherein P is the medium density, w is the sound frequency, a is the amplitude, and c is the wave velocity.
230. When the absolute difference value between the first energy value and the second energy value is detected to exceed a first preset threshold value, and the first energy value is smaller than the second energy value, the mobile terminal determines that the microphone of the first wireless earphone is in a hole blocking state.
In this embodiment of the application, when the mobile terminal detects that an absolute difference (i.e., an absolute value of the difference) between a first energy value of the audible sound wave collected by the microphone of the first wireless headset and a second energy value of the audible sound wave collected by the microphone of the second wireless headset exceeds a first preset threshold value stored in advance, and the first energy value is smaller than the second energy value, it may be considered that there is a large difference between the sound energy acquired by the first wireless headset and the sound energy acquired by the second wireless headset, and the former is significantly lower than the latter. In the case that the first wireless headset and the second wireless headset are in the same environment and collect audible sound waves emitted by the same sound source, the difference between sound energy theoretically received by the two wireless headsets in a normal state should be small, if the difference between sound energy received by the two wireless headsets is large, it is likely that one of the wireless headsets is in an abnormal state (such as a hole blocking state), and because the first energy value is obviously lower than the second energy value, the microphone of the first wireless headset can be considered to be in the hole blocking state.
The first preset threshold is the maximum critical value of the difference value of sound wave energy values received by the two wireless earphones theoretically by receiving the same sound source in the normal state and in the same environment. The first preset threshold may be a fixed value, or may be adaptively modified according to actual requirements. When the absolute difference value between the first energy value and the second energy value is within the first preset threshold range, the difference between the first energy value and the second energy value can be considered to be within an acceptable normal range, and the first wireless earphone and the second wireless earphone can be considered to be both in a non-hole blocking state. When the absolute difference between the first energy value and the second energy value exceeds the first preset threshold, the difference between the first energy value and the second energy value can be considered to be too large, which may be caused by one of the wireless earphones being blocked.
Although the embodiment of the present application uses the absolute difference between the first energy value and the second energy value and the magnitude relationship between the first energy value and the second energy value to perform the hole blockage detection, this is not the only detection method. The hole plugging detection may also be performed according to a ratio between the first energy value and the second energy value and a magnitude relationship between the first energy value and the second energy value, and if the ratio between the first energy value and the second energy value is smaller than a predetermined value and the first energy value is smaller than the second energy value, the first wireless earphone may be considered to be in the hole plugging state. The hole blockage detection may also be performed according to other criteria, such as a square ratio, a square root ratio, etc. of the first energy value and the second energy value, which is not limited herein. In addition, the embodiments of the present application may use, in addition to the energy value of the audible sound wave, other speech parameters of the audible sound wave, such as volume, audio frequency, timbre, etc., to perform hole blockage detection, which is not limited herein.
In an alternative embodiment, the method depicted in fig. 2 may further include the following steps:
21) acquiring a first distance between a first wireless earphone and a sound source and acquiring a second distance between a second wireless earphone and the sound source;
accordingly, when it is detected that the absolute difference between the first energy value and the second energy value exceeds the first preset threshold and the first energy value is smaller than the second energy value, the specific implementation manner of the mobile terminal determining that the microphone of the first wireless headset is in the hole plugging state in step 230 may include the following steps:
22) and when the absolute difference value between the first energy value and the second energy value is detected to exceed a first preset threshold value, the first energy value is smaller than the second energy value, and the first distance is smaller than or equal to the second distance, determining that the microphone of the first wireless earphone is in a hole blocking state.
Since the sound transmission has energy loss, the energy loss of the sound transmission is larger when the microphone of the wireless earphone is farther away from the sound source, that is, the size of the sound wave energy value is related to the distance from the microphone of the wireless earphone to the sound source, the farther away, the smaller the sound wave energy value, and the closer the distance, the larger the sound wave energy value.
In order to prevent the situation that the hole is blocked by the first wireless earphone due to the fact that the distance from the first wireless earphone to the sound source is larger than the distance from the second wireless earphone to the sound source, the first distance between the first wireless earphone and the sound source and the second distance between the second wireless earphone and the sound source can be acquired. If the mobile terminal detects that the absolute difference value between the first energy value and the second energy value exceeds the first preset threshold value, the first energy value is smaller than the second energy value, and the first distance is smaller than or equal to the second distance, the received sound wave energy value is smaller on the contrary under the condition that the first wireless earphone is closer to the sound source, and the first wireless earphone can be considered to be in the hole blocking state. Therefore, on the basis of carrying out hole blockage detection through the absolute difference between the energy values received by the two wireless earphones and the magnitude relation between the energy values of the two wireless earphones, the distance between the two wireless earphones and the sound source is combined, the accuracy of hole blockage detection can be further improved, and the false detection rate is reduced.
In an alternative embodiment, the method depicted in fig. 2 may further include the following steps:
23) acquiring a third distance between the first wireless earphone and the mobile terminal and acquiring a fourth distance between the second wireless earphone and the mobile terminal;
accordingly, the specific embodiment of step 22) determining that the microphone of the first wireless headset is in the hole plugging state when it is detected that the absolute difference between the first energy value and the second energy value exceeds the first preset threshold, the first energy value is smaller than the second energy value, and the first distance is smaller than or equal to the second distance, may include the following steps:
24) and when detecting that the absolute difference value of the first energy value and the second energy value exceeds a first preset threshold value, the first energy value is smaller than the second energy value, the first distance is smaller than or equal to the second distance, and the third distance is smaller than or equal to the fourth distance, determining that the microphone of the first wireless earphone is in a hole blocking state.
The mobile terminal is in communication connection with the first wireless earphone and the second wireless earphone respectively in a wireless mode, and the mobile terminal can perform data transmission with the first wireless earphone and the second wireless earphone in a wireless mode. Because the quality of data transmission between the wireless earphone and the mobile terminal is affected by the distance between the wireless earphone and the mobile terminal, the closer the distance between the wireless earphone and the mobile terminal is, the higher the transmission quality is, and the farther the distance is, the lower the transmission quality is. For example, the maximum transmission distance between a common quality bluetooth headset and a mobile phone in the market is about 10 meters or 15 meters, and the transmission distance of a good quality bluetooth headset may be correspondingly far. The first wireless earphone and the second wireless earphone respectively utilize a microphone of the first wireless earphone and the second wireless earphone to collect audible sound waves and then respectively transmit the audible sound waves to the mobile terminal in a wireless mode.
In order to avoid the situation that the transmission quality is influenced by the fact that the distance from the first wireless earphone to the mobile terminal is larger than the distance from the second wireless earphone to the mobile terminal to cause false detection of the hole blockage of the first wireless earphone, a third distance from the first wireless earphone to the mobile terminal and a fourth distance from the second wireless earphone to the mobile terminal can be obtained. If the mobile terminal detects that the absolute difference value between the first energy value and the second energy value exceeds a first preset threshold value, the first energy value is smaller than the second energy value, the first distance is smaller than or equal to the second distance, and the third distance is smaller than or equal to the fourth distance, so that the received sound wave energy value is smaller on the contrary under the condition that the first wireless earphone is closer to the sound source and closer to the mobile terminal, the first wireless earphone can be considered to be in the hole blocking state. Therefore, on the basis of carrying out hole blockage detection through the absolute difference between the energy values received by the two wireless earphones, the size relation between the energy values and the distance between the two wireless earphones and the sound source, and the distance between the two wireless earphones and the mobile terminal, the accuracy of hole blockage detection can be further improved, and the false detection rate is reduced.
In an alternative embodiment, the method depicted in fig. 2 may further include the following steps:
25) and when detecting that the absolute difference value of the first energy value and the second energy value exceeds a first preset threshold value, the second energy value is smaller than the first energy value, the second distance is smaller than or equal to the first distance, and the fourth distance is smaller than or equal to the third distance, determining that the microphone of the second wireless earphone is in a hole blocking state.
When the mobile terminal detects that the absolute difference value between the first energy value and the second energy value exceeds a first preset threshold value, the second energy value is smaller than the first energy value, the second distance is smaller than or equal to the first distance, and the fourth distance is smaller than or equal to the third distance, so that the received sound wave energy value is smaller on the contrary under the condition that the second wireless earphone is closer to the sound source and closer to the mobile terminal, the second wireless earphone can be considered to be in the hole blocking state.
Optionally, when the mobile terminal detects that the first wireless headset is in the hole blocking state and the second wireless headset is in the non-hole blocking state, in order to improve the voice quality, the microphone of the first wireless headset may be turned off, and only the microphone of the second wireless headset is used for picking up sound. Or, when the mobile terminal detects that the second wireless headset is in the hole blocking state and the first wireless headset is in the non-hole blocking state, in order to improve the voice quality, the microphone of the second wireless headset may be turned off, and only the microphone of the first wireless headset is used for picking up the sound. Or, when the mobile terminal detects that the first wireless earphone and the second wireless earphone are both in the hole blocking state, in order to improve the voice quality, the microphones of the first wireless earphone and the second wireless earphone can be simultaneously turned off, and only the microphone of the mobile terminal is used for picking up sound.
To sum up, in order to detect whether a microphone of the wireless headset is plugged, the first wireless headset and the second wireless headset included in the wireless headset may be in communication connection with the mobile terminal, and the mobile terminal collects the audible sound waves through the microphone of the first wireless headset and the microphone of the second wireless headset respectively, and determines a first energy value of the audible sound waves collected by the first wireless headset and a second energy value of the audible sound waves collected by the second wireless headset; when it is detected that the absolute difference between the first energy value and the second energy value exceeds a first preset threshold value and the first energy value is smaller than the second energy value, it may be determined that the microphone of the first wireless headset is in a hole blocking state. Therefore, the mobile terminal can simultaneously acquire audible sound waves by utilizing the two wireless earphones for hole blockage detection, and because the two wireless earphones are positioned in the same environment, the influence of environmental noise on the sound waves can be eliminated, the influence of the environment on a detection result can be further reduced, and the convenience and the accuracy of hole blockage detection are improved; in addition, adopt two wireless earphones to acquire the sound wave and carry out the stifled hole and detect, can not have the hardware difference because of equipment structure is different and cause the inaccuracy of testing result, promoted the accuracy and the intelligence that the stifled hole detected.
The embodiment of the application provides another method for intelligently detecting the blockage of the microphone of the wireless earphone. As shown in fig. 3, the method may include the steps of:
310. the mobile terminal collects the audible acoustic waves using a microphone of the first wireless headset and a microphone of the second wireless headset.
320. The mobile terminal determines a first energy value of the audible sound waves collected by the first wireless headset and determines a second energy value of the audible sound waves collected by the second wireless headset.
330. When the absolute difference value between the first energy value and the second energy value is detected to exceed a first preset threshold value, and the first energy value is smaller than the second energy value, the mobile terminal determines that the microphone of the first wireless earphone is in a hole blocking state.
In the embodiment of the present application, the content of step 310 to step 330 in the foregoing embodiment may be referred to in the description of step 210 to step 230, and is not described herein again.
340. And when detecting that the absolute difference value of the first energy value and the second energy value does not exceed a first preset threshold value, the mobile terminal disconnects the mobile terminal from the wireless earphone.
350. The mobile terminal collects audible sound waves by using a microphone of the mobile terminal.
360. The mobile terminal determines a third energy value of the audible sound waves collected by the mobile terminal.
In this embodiment, when the mobile terminal detects that the absolute difference between the first energy value and the second energy value does not exceed the range of the first preset threshold, at this time, it is possible that neither the first wireless earphone nor the second wireless earphone blocks the hole, or it is possible that both the first wireless earphone and the second wireless earphone block the hole. Therefore, the hole blocking state of the first wireless earphone and the second wireless earphone needs to be further judged. Specifically, the mobile terminal may disconnect the first wireless headset and the second wireless headset, start a microphone built in the mobile terminal, and collect the audible sound wave by using the microphone. The audible sound wave and the audible sound wave collected by the first wireless earphone and the second wireless earphone are emitted by the same sound source, the voice parameters (such as volume, audio frequency, tone and the like) of the audible sound wave emitted by the sound source twice are the same, and the transmission medium and the environment of the audible sound wave are also the same. That is, the sound source emits the same audible sound wave twice and propagates in the same environment. Therefore, the inaccuracy of the detection result caused by the difference between the audible sound wave and the environment can be avoided, and the interference caused by different environmental noises can be eliminated by the transmission in the same environment.
It can be understood that, when the microphone built in the mobile terminal can normally start collecting sound in the state of connecting the wireless earphone, the mobile terminal may not be disconnected from the wireless earphone.
370. And when the absolute difference value between the first energy value and the third energy value exceeds a second preset threshold value and the first energy value is smaller than the third energy value, the mobile terminal determines that the microphone of the first wireless earphone is in a hole blocking state.
380. And when detecting that the absolute difference value of the second energy value and the third energy value exceeds a second preset threshold value and the second energy value is smaller than the third energy value, the mobile terminal determines that the microphone of the second wireless earphone is in a hole blocking state.
In this embodiment of the application, when an absolute difference between a first energy value of the audible sound wave collected by the first wireless headset and a third energy value of the audible sound wave collected by the mobile terminal exceeds a second preset threshold value stored in advance, and the first energy value is smaller than the third energy value, it may be considered that there is a large difference between the sound energy acquired by the first wireless headset and the sound energy acquired by the mobile terminal, and the former is significantly lower than the latter. Since the first wireless headset and the mobile terminal are different types of devices, hardware structures of the first wireless headset and the mobile terminal are different, and sound energy received by microphones of the first wireless headset and the mobile terminal is different even in the same environment, the setting of the size of the second preset threshold is different from that of the first preset threshold, preferably, the second preset threshold may be larger than the first preset threshold, that is, the difference between sound energy received by the wireless headset and sound energy received by the mobile terminal is allowed to be larger than the difference between sound energy received by the two wireless headsets. When the absolute difference between the sound energy received by the first wireless earphone and the sound energy received by the mobile terminal exceeds the allowed maximum critical value (i.e., the second preset threshold), and the sound energy received by the first wireless earphone is significantly lower than the sound energy received by the mobile terminal, it can be considered that the microphone of the first wireless earphone is in the hole blocking state. When the absolute difference value of the sound energy received by the first wireless earphone and the mobile terminal is within the second preset threshold range, the microphone of the first wireless earphone can be considered to be in a non-hole blocking state.
Similarly, when the absolute difference between the sound energy received by the second wireless headset and the sound energy received by the mobile terminal exceeds the allowable maximum critical value (i.e., the second preset threshold), and the sound energy received by the second wireless headset is significantly lower than the sound energy received by the mobile terminal, it may be determined that the microphone of the second wireless headset is in the hole blocking state. When the absolute difference value of the sound energy received by the second wireless earphone and the mobile terminal is within a second preset threshold range, the microphone of the second wireless earphone can be considered to be in a non-hole blocking state.
Optionally, whether the first wireless headset is plugged may be further detected by combining the distance from the first wireless headset to the sound source and the distance from the mobile terminal to the sound source, for example, when it is detected that the absolute difference between the first energy value and the third energy value exceeds a second preset threshold, the first energy value is smaller than the third energy value, and the distance from the first wireless headset to the sound source is smaller than or equal to the distance from the mobile terminal to the sound source, the mobile terminal determines that the microphone of the first wireless headset is in a plugged state.
And further detecting whether the second wireless earphone blocks the hole or not by combining the distance from the second wireless earphone to the sound source and the distance from the mobile terminal to the sound source, for example, when it is detected that the absolute difference value between the second energy value and the third energy value exceeds a second preset threshold value, the second energy value is smaller than the third energy value, and the distance from the second wireless earphone to the sound source is smaller than or equal to the distance from the mobile terminal to the sound source, the mobile terminal determines that the microphone of the second wireless earphone is in a hole blocking state. Therefore, the detection accuracy can be further improved, and the false detection rate can be reduced.
Therefore, by implementing the method described in fig. 3, the mobile terminal simultaneously acquires the audible sound waves by using the two wireless earphones to perform hole blockage detection, and because the two wireless earphones are located in the same environment, the influence of environmental noise on the sound waves can be eliminated, the influence of the environment on the detection result can be further reduced, and the convenience and the accuracy of hole blockage detection are improved; in addition, adopt two wireless earphones to acquire the sound wave and carry out stifled hole and detect, can not have the hardware difference to cause the inaccuracy of testing result because of equipment structure is different, promoted the accuracy and the intellectuality that stifled hole detected.
Further, under the condition that it cannot be determined whether the two wireless earphones are not plugged or plugged, the same audible sound wave emitted by the same sound source can be collected by a microphone of the mobile terminal under the same environment, and the energy values received by the mobile terminal are respectively compared with the energy values received by the two wireless earphones to realize hole plugging detection. Therefore, the inaccuracy of the detection result caused by the difference between audible sound waves and the environment can be avoided, the interference caused by different environmental noises can be eliminated by the transmission in the same environment, and the accuracy of the hole blockage detection is improved; in addition, because wireless earphone and mobile terminal are the equipment of different grade type, the hardware structure of both is different, adopts the judgement parameter basis when being different from utilizing two wireless earphones, can eliminate the influence of equipment to the testing result as far as possible, has promoted the accuracy and the intelligence that stifled hole detected.
Further, after the mobile terminal determines that the microphone of the first wireless earphone or the second wireless earphone is in the hole blocking state, a hole blocking voice prompt is sent out to prompt a user that the hole blocking occurs.
Further, in a possible example, before the voice prompt for hole blockage is issued, the method further includes: detecting face feature information of the user; determining whether the user is a preset authority user or not according to the face feature information; and if the user is determined to be the authorized user, executing a step of giving out a hole plugging voice prompt.
Specifically, it can be understood that, since the user sets the authority in advance, the face recognition is performed on the user, that is, the face feature information of the current user is extracted, and whether the current user has the authority is determined. For example, a user inputs a face image of the user into an intelligent earphone or a terminal in advance, the intelligent earphone or the terminal extracts feature information of the face image and stores the feature information, so that when face recognition verification is performed next time, the extracted face feature information of the current user is compared with the face feature information stored in advance, and whether the user is a preset authority user is determined.
For example, the terminal extracts the face feature information, and optionally, the face feature information extraction model training is performed in advance for the terminal in order to improve the accuracy of feature extraction. The training process of the face feature information extraction model comprises the following steps:
acquiring X face area images of the user, and carrying out N key point labels on each face area image in the X face area images to obtain X face area images with N key point labels; inputting the X face region images marked with N key points into a primary face feature information extraction model to generate X groups of feature parameters; inputting a face image of the user in a natural expression state, and acquiring characteristic parameters of the face image of the user in the natural expression state to obtain target characteristic parameters; and fitting and optimizing the X groups of characteristic parameters to obtain X groups of general two-dimensional face standard model parameters, calculating loss values of the target characteristic parameters and the X groups of characteristic parameters through iterative processing, and obtaining the high-grade face characteristic information extraction model when the loss values are smaller than a loss threshold value. The two-dimensional face standard model parameters comprise any one or more of the identity parameters, expression parameters and posture parameters.
Further, the terminal detects the face feature information of the user, and the method includes: and acquiring the face image of the user, inputting the face image of the user into the high-level face feature information extraction model, and generating the face feature information of the user.
The X face region images may be collected face image data sets of about 10 ten thousand faces each having a uniform distribution of pose, a comprehensive race, a comprehensive and uniform distribution of age group, a balanced gender ratio, and a wide face shape. After the face images are collected, face detection is carried out on the 10 ten thousand face images by using a face detection algorithm to obtain a face area, the face area is cut, then key point detection is carried out on the cut face area by using an N-point face key point marking algorithm to obtain face image data with N key point marks after cutting. Inputting the X face region images marked with N key points into a primary face feature information extraction model to generate X groups of feature parameters. The key point labels may be 106 key point labels, 100 key point labels, and the like. Each vertex of the two-dimensional face region corresponds to different coordinates and numbers, for example, 55 corresponds to the right eye corner, 65 corresponds to the left eye corner, and the like.
The advanced face feature information extraction model is shown as the following formula:
Figure BDA0002517409130000171
wherein
Figure BDA0002517409130000172
For an average face, X represents the ith face identity orthogonal basis, B i Represents the ith orthogonal base, alpha, of the individual's facial expression i Representing the ith personal face identity parameter, beta i Indicating the ith personal facial expression parameter.
The embodiment of the application provides a device for intelligently detecting the microphone plugging hole of a wireless earphone, which can be used for executing the method for intelligently detecting the microphone plugging hole of the wireless earphone provided by the embodiment. The apparatus may be applied to a mobile terminal, i.e. the apparatus may be a mobile terminal or a part of a mobile terminal. The mobile terminal is connected with a wireless earphone, the wireless earphone comprises a first wireless earphone and a second wireless earphone, and the first wireless earphone and the second wireless earphone are both provided with microphones. As shown in fig. 4, the apparatus may include:
a first collecting unit 41 for collecting audible sound waves with a microphone of the first wireless headset and a microphone of the second wireless headset.
A determination unit 42 is adapted to determine a first energy value of the audible sound waves collected by the first wireless headset and to determine a second energy value of the audible sound waves collected by the second wireless headset.
The detecting unit 43 is configured to determine that the microphone of the first wireless headset is in the hole blocking state when it is detected that the absolute difference between the first energy value and the second energy value exceeds a first preset threshold and the first energy value is smaller than the second energy value.
Referring to fig. 5, another apparatus for intelligently detecting a microphone blockage of a wireless headset is provided in an embodiment of the present application. The device can further include, on the basis of the device shown in fig. 4:
an obtaining unit 44 for obtaining a first distance between the first wireless headset and the sound source and obtaining a second distance between the second wireless headset and the sound source;
accordingly, the detecting unit 43 is specifically configured to determine that the microphone of the first wireless headset is in the hole plugging state when it is detected that the absolute difference between the first energy value and the second energy value exceeds a first preset threshold, the first energy value is smaller than the second energy value, and the first distance is smaller than or equal to the second distance.
Optionally, the obtaining unit 44 is further configured to obtain a third distance between the first wireless headset and the mobile terminal, and obtain a fourth distance between the second wireless headset and the mobile terminal;
accordingly, the detecting unit 43 is specifically configured to determine that the microphone of the first wireless headset is in the hole plugging state when it is detected that the absolute difference between the first energy value and the second energy value exceeds a first preset threshold, the first energy value is smaller than the second energy value, the first distance is smaller than or equal to the second distance, and the third distance is smaller than or equal to the fourth distance.
Optionally, the detecting unit 43 is further configured to determine that the microphone of the second wireless headset is in the hole plugging state when it is detected that the absolute difference between the first energy value and the second energy value exceeds a first preset threshold, the second energy value is smaller than the first energy value, the second distance is smaller than or equal to the first distance, and the fourth distance is smaller than or equal to the third distance.
Optionally, the apparatus shown in fig. 5 may further include:
the control unit 45 is used for disconnecting the mobile terminal from the wireless headset when the detection unit 43 detects that the absolute difference value of the first energy value and the second energy value does not exceed a first preset threshold value;
a second collecting unit 46, configured to collect audible sound waves by using a microphone of the mobile terminal;
a determining unit 42, further configured to determine a third energy value of the audible sound wave collected by the mobile terminal;
the detecting unit 43 is further configured to determine that the microphone of the first wireless headset is in a hole blocking state when it is detected that the absolute difference between the first energy value and the third energy value exceeds a second preset threshold and the first energy value is smaller than the third energy value;
the detecting unit 43 is further configured to determine that the microphone of the second wireless headset is in a hole blocking state when it is detected that the absolute difference between the second energy value and the third energy value exceeds a second preset threshold and the second energy value is smaller than the third energy value.
The device shown in fig. 4 and 5 is implemented, and the two wireless earphones are used for simultaneously acquiring the audible sound waves for hole blockage detection, so that the influence of environmental noise on the sound waves can be eliminated because the two wireless earphones are in the same environment, the influence of the environment on the detection result can be reduced, and the convenience and the accuracy of hole blockage detection are improved; in addition, adopt two wireless earphones to acquire the sound wave and carry out the stifled hole and detect, can not have the hardware difference because of equipment structure is different and cause the inaccuracy of testing result, promoted the accuracy and the intelligence that the stifled hole detected.
Further, under the condition that it cannot be determined whether the two wireless earphones are not plugged or plugged, the same audible sound wave emitted by the same sound source can be collected by a microphone of the mobile terminal under the same environment, and the energy values received by the mobile terminal are respectively compared with the energy values received by the two wireless earphones to realize hole plugging detection. Therefore, the inaccuracy of the detection result caused by the difference between audible sound waves and the environment can be avoided, the interference caused by different environmental noises can be eliminated by the transmission in the same environment, and the accuracy of the hole blockage detection is improved; in addition, because wireless earphone and mobile terminal are the equipment of different grade type, the hardware structure of both has some differences, adopts the judgement parameter basis when being different from utilizing two wireless earphones, can eliminate the influence of equipment to the testing result as far as possible, has promoted the accuracy and the intelligence that stifled hole detected.
The embodiment of the application also provides a mobile terminal which can be used for executing the method for intelligently detecting the blockage of the microphone of the wireless earphone. As shown in fig. 6, the mobile terminal 600 may include: at least one processor 601, such as a Central Processing Unit (CPU), at least one communication interface 602, memory 603, and the like. Wherein the components are communicatively coupled via one or more buses 604. Those skilled in the art will appreciate that the structure of the mobile terminal shown in fig. 6 is not limited to the embodiments of the present application, and may be a bus structure, a star structure, a combination of more or less components than those shown, or a different arrangement of components. Wherein:
in this embodiment, the communication interface 602 may include a wired communication interface, a wireless communication interface, and the like, and may be configured to perform communication interaction with the wireless headset, for example, receive voice data collected by a microphone of the wireless headset, and/or transmit the voice data to the wireless headset for output, and the like.
In the embodiment of the present application, the memory 603 may be a high-speed RAM memory, or may be a non-volatile memory (non-volatile memory), for example, at least one disk memory. The memory 603 may optionally be at least one storage device located remotely from the processor 601. As shown in fig. 6, the memory 603 may include one or more programs, data, and the like, and the embodiments of the present application are not limited thereto.
In the mobile terminal shown in fig. 6, the processor 601 may be configured to invoke one or more programs stored in the memory 603 to perform the following operations:
controlling a microphone of the first wireless headset and a microphone of the second wireless headset to collect audible acoustic waves through the communication interface 602;
determining a first energy value of the audible sound waves collected by the first wireless headset and determining a second energy value of the audible sound waves collected by the second wireless headset;
when it is detected that the absolute difference between the first energy value and the second energy value exceeds the first preset threshold stored in the memory 603, and the first energy value is smaller than the second energy value, it is determined that the microphone of the first wireless headset is in the hole plugging state.
Optionally, the processor 601 may be further configured to call one or more programs stored in the memory 603 to perform the following operations:
acquiring a first distance between a first wireless earphone and a sound source and acquiring a second distance between a second wireless earphone and the sound source;
when it is detected that the absolute difference between the first energy value and the second energy value exceeds the first preset threshold stored in the memory 603 and the first energy value is smaller than the second energy value, the specific implementation of determining that the microphone of the first wireless headset is in the hole plugging state may be:
when it is detected that the absolute difference between the first energy value and the second energy value exceeds the first preset threshold stored in the memory 603, the first energy value is smaller than the second energy value, and the first distance is smaller than or equal to the second distance, it is determined that the microphone of the first wireless headset is in the hole blocking state.
Optionally, the processor 601 may be further configured to call one or more programs stored in the memory 603 to perform the following operations:
acquiring a third distance between the first wireless headset and the mobile terminal 600, and acquiring a fourth distance between the second wireless headset and the mobile terminal 600;
when detecting that the absolute difference between the first energy value and the second energy value exceeds the first preset threshold stored in the memory 603, and the first energy value is smaller than the second energy value, and the first distance is smaller than or equal to the second distance, the specific implementation of determining that the microphone of the first wireless headset is in the hole-blocking state may be:
when it is detected that the absolute difference between the first energy value and the second energy value exceeds a first preset threshold stored in the memory 603, the first energy value is smaller than the second energy value, the first distance is smaller than or equal to the second distance, and the third distance is smaller than or equal to the fourth distance, it is determined that the microphone of the first wireless headset is in the hole plugging state.
Optionally, the processor 601 may be further configured to call one or more programs stored in the memory 603 to perform the following operations:
when it is detected that the absolute difference between the first energy value and the second energy value exceeds the first preset threshold stored in the memory 603, the second energy value is smaller than the first energy value, the second distance is smaller than or equal to the first distance, and the fourth distance is smaller than or equal to the third distance, it is determined that the microphone of the second wireless headset is in the hole plugging state.
Optionally, the mobile terminal 600 may further comprise at least one microphone, and the processor 601 may be further configured to invoke one or more programs stored in the memory 603 to perform the following operations:
when detecting that the absolute difference value between the first energy value and the second energy value does not exceed the first preset threshold value stored in the memory 603, controlling the communication interface 602 to disconnect the mobile terminal 600 from the wireless headset;
collecting audible sound waves using a microphone of the mobile terminal 600;
determining a third energy value of the audible sound waves collected by the mobile terminal 600;
when detecting that the absolute difference value between the first energy value and the third energy value exceeds a second preset threshold value stored in the memory 603 and the first energy value is smaller than the third energy value, determining that the microphone of the first wireless headset is in a hole blocking state;
when it is detected that the absolute difference between the second energy value and the third energy value exceeds the second preset threshold stored in the memory 603, and the second energy value is smaller than the third energy value, it is determined that the microphone of the second wireless headset is in the hole plugging state.
Specifically, the mobile terminal described in this embodiment of the present application may implement part or all of the processes in the embodiment of the method for intelligently detecting a hole blockage of a microphone of a wireless headset described in this application with reference to fig. 2 or fig. 3.
The modules or sub-modules in all embodiments of the present Application may be implemented by a general-purpose Integrated Circuit, such as a CPU, or by an ASIC (Application Specific Integrated Circuit).
Embodiments of the present application further provide a computer readable storage medium, where the computer readable storage medium stores a computer program for electronic data exchange, and the computer program causes a computer to perform some or all of the steps described in the method for intelligently detecting a microphone of a wireless headset in a hole blockage, as provided in an embodiment of the present application. The computer may comprise a mobile terminal.
Embodiments of the present application further provide a computer program product, where the computer program product includes a non-transitory computer-readable storage medium storing a computer program, the computer program is operable to cause a computer to perform some or all of the steps described in the method for intelligently detecting a microphone of a wireless headset from being plugged as provided by the embodiments of the present application. The computer program product may be a software installation package and the computer may comprise a mobile terminal.
It should be noted that, for simplicity of description, the above-mentioned embodiments of the method are described as a series of acts or combinations, but those skilled in the art should understand that the present application is not limited by the order of acts described, as some steps may be performed in other orders or simultaneously according to the present application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
The steps in the method of the embodiment of the application can be sequentially adjusted, combined and deleted according to actual needs.
The units in the device of the embodiment of the application can be combined, divided and deleted according to actual needs.
It will be understood by those skilled in the art that all or part of the steps in the methods of the embodiments described above may be implemented by hardware instructions of a program, and the program may be stored in a computer-readable storage medium, where the storage medium includes Read-Only Memory (ROM), Random Access Memory (RAM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), One-time Programmable Read-Only Memory (OTPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Compact Disc Read-Only Memory (CD-ROM), or other Memory, such as a magnetic disk, or a combination thereof, A tape memory, or any other medium readable by a computer that can be used to carry or store data.
The method for intelligently detecting the microphone blockage of the wireless headset and the related device provided by the embodiment of the application are introduced in detail, a specific example is applied in the text to explain the principle and the implementation mode of the application, and the description of the embodiment is only used for helping to understand the method and the core idea of the application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims (10)

1. The method for intelligently detecting the hole blockage of the microphone of the wireless earphone is characterized in that the method is applied to a mobile terminal, the mobile terminal is connected with the wireless earphone, the wireless earphone comprises a first wireless earphone and a second wireless earphone, and the first wireless earphone and the second wireless earphone are both provided with microphones; the method comprises the following steps:
collecting audible acoustic waves with a microphone of the first wireless headset and a microphone of the second wireless headset;
determining a first energy value of the audible sound waves collected by the first wireless headset and determining a second energy value of the audible sound waves collected by the second wireless headset;
when the absolute difference value between the first energy value and the second energy value is detected to exceed a first preset threshold value, and the first energy value is smaller than the second energy value, determining that a microphone of the first wireless earphone is in a hole blocking state;
the energy value of the sound wave is obtained by calculating the medium density, the sound frequency, the amplitude and the wave speed of the propagation medium, and the calculation formula of the energy value of the sound wave is as follows: (P w c a)/2, wherein P is the medium density, w is the sound frequency, a is the amplitude, c is the wave velocity;
wherein the content of the first and second substances,
the first preset threshold is a maximum critical value of a difference value of sound wave energy values received by the two wireless earphones theoretically by the same sound source when the two wireless earphones are in a normal state and in the same environment, the first preset threshold is a fixed value, and when an absolute difference value of the first energy value and the second energy value is within a first preset threshold range, the difference between the first energy value and the second energy value is within an acceptable normal range;
the wireless earphone is an intelligent earphone comprising an artificial intelligence chip, the intelligent earphone further comprises a microprocessor, the microprocessor and the artificial intelligence chip in the intelligent earphone are in mutual communication through a special channel, the microprocessor can independently control the intelligent earphone to work, the microprocessor can also control the intelligent earphone to work under the guidance of the artificial intelligence chip, and the artificial intelligence chip can output an intelligent control strategy to the microprocessor to guide the microprocessor to work better;
wherein, the first and the second end of the pipe are connected with each other,
the mobile terminal is used for controlling the microprocessor to enter a sleep state from a wake-up state by sending a sleep instruction to the microprocessor of any one of the pair of intelligent earphones, and when the microprocessor of the intelligent earphone is in the sleep state, the audio playing function of the intelligent earphone is disabled; the mobile terminal is also used for indicating the artificial intelligence chip to inform the microprocessor to enter a wakeup state from a sleep state by sending a wakeup instruction to the artificial intelligence chip of the intelligent earphone;
the microprocessor in the dormant state can only receive the instruction from the artificial intelligence chip, namely the microprocessor in the dormant state can only be awakened by the artificial intelligence chip; when the artificial intelligence chip wakes up the microprocessor in the dormant state and fails, the artificial intelligence chip can be switched to the microprocessor working mode, the microprocessor is replaced to control the intelligent earphone to work when coming, and when the artificial intelligence chip is switched to the microprocessor working mode, the audio playing function of the intelligent earphone can normally run under the support of the artificial intelligence chip.
2. The method of claim 1, further comprising:
acquiring a first distance between the first wireless earphone and a sound source and acquiring a second distance between the second wireless earphone and the sound source;
wherein the determining that the microphone of the first wireless headset is in a hole blocking state when it is detected that the absolute difference between the first energy value and the second energy value exceeds a first preset threshold and the first energy value is smaller than the second energy value comprises:
when it is detected that the absolute difference value between the first energy value and the second energy value exceeds a first preset threshold value, the first energy value is smaller than the second energy value, and the first distance is smaller than or equal to the second distance, it is determined that the microphone of the first wireless headset is in a hole blocking state.
3. The method of claim 2, further comprising:
acquiring a third distance between the first wireless earphone and the mobile terminal and acquiring a fourth distance between the second wireless earphone and the mobile terminal;
wherein determining that the microphone of the first wireless headset is in a hole blocking state when detecting that the absolute difference between the first energy value and the second energy value exceeds a first preset threshold, the first energy value is smaller than the second energy value, and the first distance is smaller than or equal to the second distance comprises:
when detecting that the absolute difference value of the first energy value and the second energy value exceeds a first preset threshold value, the first energy value is smaller than the second energy value, the first distance is smaller than or equal to the second distance, and the third distance is smaller than or equal to the fourth distance, determining that the microphone of the first wireless earphone is in a hole blocking state.
4. The method of claim 3, further comprising:
when detecting that the absolute difference value of the first energy value and the second energy value exceeds the first preset threshold value, the second energy value is smaller than the first energy value, the second distance is smaller than or equal to the first distance, and the fourth distance is smaller than or equal to the third distance, determining that the microphone of the second wireless headset is in a hole blocking state.
5. The method of any of claims 1-4, further comprising:
when detecting that the absolute difference value of the first energy value and the second energy value does not exceed the first preset threshold value, disconnecting the mobile terminal from the wireless headset;
collecting the audible sound wave by using a microphone of the mobile terminal;
determining a third energy value of the audible sound wave collected by the mobile terminal;
when the absolute difference value between the first energy value and the third energy value is detected to exceed a second preset threshold value, and the first energy value is smaller than the third energy value, determining that a microphone of the first wireless earphone is in a hole blocking state;
and when the absolute difference value between the second energy value and the third energy value is detected to exceed the second preset threshold value and the second energy value is smaller than the third energy value, determining that the microphone of the second wireless earphone is in a hole blocking state.
6. The device for intelligently detecting the hole blockage of the microphone of the wireless earphone is characterized in that the device is applied to a mobile terminal, the mobile terminal is connected with the wireless earphone, the wireless earphone comprises a first wireless earphone and a second wireless earphone, and the first wireless earphone and the second wireless earphone are both provided with microphones; the device comprises:
a first acquisition unit for acquiring audible sound waves using the microphone of the first wireless headset and the microphone of the second wireless headset;
a determining unit for determining a first energy value of the audible sound waves collected by the first wireless headset and determining a second energy value of the audible sound waves collected by the second wireless headset;
the detection unit is used for determining that a microphone of the first wireless earphone is in a hole blocking state when detecting that the absolute difference value of the first energy value and the second energy value exceeds a first preset threshold value and the first energy value is smaller than the second energy value;
the energy value of the sound wave is obtained by calculating the medium density, the sound frequency, the amplitude and the wave speed of the propagation medium, and the calculation formula of the energy value of the sound wave is as follows: (P w c a)/2, wherein P is the medium density, w is the sound frequency, a is the amplitude, c is the wave velocity;
wherein the content of the first and second substances,
the first preset threshold is a maximum critical value of a difference value of sound wave energy values received by the two wireless earphones theoretically by the same sound source when the two wireless earphones are in a normal state and in the same environment, the first preset threshold is a fixed value, and when an absolute difference value of the first energy value and the second energy value is within a first preset threshold range, the difference between the first energy value and the second energy value is within an acceptable normal range;
the wireless earphone is an intelligent earphone comprising an artificial intelligence chip, the intelligent earphone further comprises a microprocessor, the microprocessor and the artificial intelligence chip in the intelligent earphone are in mutual communication through a special channel, the microprocessor can independently control the intelligent earphone to work, the microprocessor can also control the intelligent earphone to work under the guidance of the artificial intelligence chip, and the artificial intelligence chip can output an intelligent control strategy to the microprocessor to guide the microprocessor to work better;
wherein the content of the first and second substances,
the mobile terminal is used for controlling the microprocessor to enter a sleep state from a wake-up state by sending a sleep instruction to the microprocessor of any one of the pair of intelligent earphones, and when the microprocessor of the intelligent earphone is in the sleep state, the audio playing function of the intelligent earphone is disabled; the mobile terminal is also used for indicating the artificial intelligence chip to inform the microprocessor to enter the awakening state from the dormant state by sending the awakening instruction to the artificial intelligence chip of the intelligent earphone;
the microprocessor in the dormant state can only receive the instruction from the artificial intelligence chip, namely the microprocessor in the dormant state can only be awakened by the artificial intelligence chip; when the artificial intelligence chip wakes up the microprocessor in the dormant state and fails, the artificial intelligence chip can be switched to the microprocessor working mode, the microprocessor is replaced to control the intelligent earphone to work when coming, and when the artificial intelligence chip is switched to the microprocessor working mode, the audio playing function of the intelligent earphone can normally run under the support of the artificial intelligence chip.
7. The apparatus of claim 6, further comprising:
the acquisition unit is used for acquiring a first distance between the first wireless earphone and a sound source and acquiring a second distance between the second wireless earphone and the sound source;
the detection unit is specifically configured to determine that the microphone of the first wireless headset is in a hole blocking state when it is detected that an absolute difference between the first energy value and the second energy value exceeds a first preset threshold, the first energy value is smaller than the second energy value, and the first distance is smaller than or equal to the second distance.
8. The apparatus of claim 7,
the acquiring unit is further configured to acquire a third distance between the first wireless headset and the mobile terminal, and acquire a fourth distance between the second wireless headset and the mobile terminal;
the detection unit is specifically configured to determine that the microphone of the first wireless headset is in a hole blocking state when it is detected that an absolute difference between the first energy value and the second energy value exceeds a first preset threshold, the first energy value is smaller than the second energy value, the first distance is smaller than or equal to the second distance, and the third distance is smaller than or equal to the fourth distance.
9. The apparatus of claim 8,
the detection unit is further configured to determine that the microphone of the second wireless headset is in a hole blocking state when it is detected that an absolute difference between the first energy value and the second energy value exceeds the first preset threshold, the second energy value is smaller than the first energy value, the second distance is smaller than or equal to the first distance, and the fourth distance is smaller than or equal to the third distance.
10. The apparatus of any of claims 6-9, further comprising:
the control unit is used for disconnecting the mobile terminal from the wireless headset when the detection unit detects that the absolute difference value of the first energy value and the second energy value does not exceed the first preset threshold value;
the second acquisition unit is used for acquiring the audible sound wave by utilizing a microphone of the mobile terminal;
the determining unit is further configured to determine a third energy value of the audible sound wave collected by the mobile terminal;
the detection unit is further configured to determine that a microphone of the first wireless headset is in a hole blocking state when it is detected that an absolute difference between the first energy value and the third energy value exceeds a second preset threshold and the first energy value is smaller than the third energy value;
the detection unit is further configured to determine that a microphone of the second wireless headset is in a hole blocking state when it is detected that an absolute difference between the second energy value and the third energy value exceeds the second preset threshold and the second energy value is smaller than the third energy value.
CN202010481091.0A 2020-05-31 2020-05-31 Method and related device for intelligently detecting hole blockage of microphone of wireless earphone Active CN112788513B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202010481091.0A CN112788513B (en) 2020-05-31 2020-05-31 Method and related device for intelligently detecting hole blockage of microphone of wireless earphone
CN202211103532.9A CN116193307A (en) 2020-05-31 2020-05-31 Medium and mobile terminal for realizing intelligent detection method for wireless earphone microphone hole blocking

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010481091.0A CN112788513B (en) 2020-05-31 2020-05-31 Method and related device for intelligently detecting hole blockage of microphone of wireless earphone

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202211103532.9A Division CN116193307A (en) 2020-05-31 2020-05-31 Medium and mobile terminal for realizing intelligent detection method for wireless earphone microphone hole blocking

Publications (2)

Publication Number Publication Date
CN112788513A CN112788513A (en) 2021-05-11
CN112788513B true CN112788513B (en) 2022-09-02

Family

ID=75749146

Family Applications (2)

Application Number Title Priority Date Filing Date
CN202211103532.9A Pending CN116193307A (en) 2020-05-31 2020-05-31 Medium and mobile terminal for realizing intelligent detection method for wireless earphone microphone hole blocking
CN202010481091.0A Active CN112788513B (en) 2020-05-31 2020-05-31 Method and related device for intelligently detecting hole blockage of microphone of wireless earphone

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN202211103532.9A Pending CN116193307A (en) 2020-05-31 2020-05-31 Medium and mobile terminal for realizing intelligent detection method for wireless earphone microphone hole blocking

Country Status (1)

Country Link
CN (2) CN116193307A (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110582111A (en) * 2018-06-08 2019-12-17 华为技术有限公司 Awakening method and device
CN110636428A (en) * 2018-06-21 2019-12-31 杭州海康威视数字技术股份有限公司 Audio fault detection method and system

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103929707B (en) * 2014-04-08 2019-03-01 努比亚技术有限公司 A kind of method and mobile terminal detecting microphone audio tunnel condition
GB201715824D0 (en) * 2017-07-06 2017-11-15 Cirrus Logic Int Semiconductor Ltd Blocked Microphone Detection
CN109104684B (en) * 2018-07-26 2020-10-30 Oppo广东移动通信有限公司 Microphone hole blockage detection method and related product
CN109151700B (en) * 2018-07-26 2020-04-21 Oppo广东移动通信有限公司 Microphone hole blockage detection method and related product
CN110337055A (en) * 2019-08-22 2019-10-15 百度在线网络技术（北京）有限公司 Detection method, device, electronic equipment and the storage medium of speaker

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110582111A (en) * 2018-06-08 2019-12-17 华为技术有限公司 Awakening method and device
CN110636428A (en) * 2018-06-21 2019-12-31 杭州海康威视数字技术股份有限公司 Audio fault detection method and system

Also Published As

Publication number Publication date
CN112788513A (en) 2021-05-11
CN116193307A (en) 2023-05-30

Similar Documents

Publication Publication Date Title
CN105280195B (en) The processing method and processing device of voice signal
US20160234589A1 (en) Audio apparatus and methods
CN108886653B (en) Earphone sound channel control method, related equipment and system
CN108710615B (en) Translation method and related equipment
CN109151698B (en) Microphone hole blockage detection method and related product
CN107799125A (en) A kind of audio recognition method, mobile terminal and computer-readable recording medium
US20110235817A1 (en) Earphone, electronic system and power-saving method
CN106164845A (en) Based on the dynamic audio frequency horizontal adjustment paid close attention to
CN101840700A (en) Voice recognition method based on mobile terminal and mobile terminal
CN105049977A (en) Automatic earphone volume adjusting method and device
CN110460721B (en) Starting method and device and mobile terminal
US20210144495A1 (en) Microphone Hole Blockage Detection Method, Microphone Hole Blockage Detection Device, and First Wireless Earphone
CN107251571A (en) personalized earphone
CN111491236A (en) Active noise reduction earphone, awakening method and device thereof and readable storage medium
CN112399297A (en) Earphone, voice awakening method thereof and computer storage medium
CN110234044A (en) A kind of voice awakening method, voice Rouser and earphone
CN113194383A (en) Sound playing method and device, electronic equipment and readable storage medium
CN108337604A (en) Audio system and audio control method
CN107040655A (en) Mobile terminal and audio adaptive equilibrium method
CN112788513B (en) Method and related device for intelligently detecting hole blockage of microphone of wireless earphone
CN108270913B (en) Mobile terminal and hearing protection method
CN109361987B (en) Sports earphone and control method, device and equipment thereof
CN112788174B (en) Intelligent retrieving method of wireless earphone and related device
CN109511036A (en) A kind of earphone automatic mute method and can automatic mute earphone
CN110058837B (en) Audio output method and terminal

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20221026

Address after: 343000 southwest corner of the intersection of Jingjiu Avenue and Chuangxin Avenue, Jinggangshan economic and Technological Development Zone, Ji'an City, Jiangxi Province (No. 271 Chuangxin Avenue)

Patentee after: JIANGXI RISOUND ELECTRONICS Co.,Ltd.

Address before: No.502, No.2 factory building, No.7 ganliliu Road, gankeng community, Jihua street, Longgang District, Shenzhen, Guangdong 518000

Patentee before: Shenzhen Ruier Electronic Co.,Ltd.

TR01 Transfer of patent right