WO2020055048A1

WO2020055048A1 - Method for determining earphone wearing state, method for controlling electronic apparatus, and electronic apparatus

Info

Publication number: WO2020055048A1
Application number: PCT/KR2019/011576
Authority: WO
Inventors: Heng Zhu; Lufen TAN; Lizhong Wang; Weiqin Wang; Changtao Liu
Original assignee: Samsung Electronics Co., Ltd.
Priority date: 2018-09-13
Filing date: 2019-09-06
Publication date: 2020-03-19
Also published as: CN110896509A

Abstract

The present application provides a method for determining an earphone wearing state, a method for controlling an electronic apparatus, and an electronic apparatus, which the method for determining an earphone wearing state comprises: acquiring an audio signal collected by a body conduction audio collecting device of the earphone; determining a wearing state of the earphone, based on an audio signal collected by the body conduction audio collecting device. The solution provided by the embodiment of the present application may achieve detecting an earphone wearing state based on an audio signal collected by a body conduction audio collecting device of the earphone itself without adding a new hardware structure.

Description

METHOD FOR DETERMINING EARPHONE WEARING STATE, METHOD FOR CONTROLLING ELECTRONIC APPARATUS, AND ELECTRONIC APPARATUS

The present application relates to the field of information processing technologies, and in particular, to a method for determining an earphone wearing state, a method for controlling an electronic apparatus, and an electronic apparatus.

With continuous improvement of people's living requirement, an earphone has become a necessity for people's lives. An earphone is used in a wide application range, and may be used by connecting with an electronic apparatus for a user to listen to multimedia sound played by an apparatus through an earphone, make or answer a call through an earphone, and the like.

However, during using an earphone, a user often encounters the following troubles: when an electronic apparatus is connecting with an earphone via wireless connection (e.g. Bluetooth), the user may forget that the mobile phone is connecting with the earphone and accordingly cannot hear the other party's sound in case of a call suddenly coming if the user does not properly wear the earphone on the ear, since that the sound of other party is being played by a speaker of the earphone. In another case, if the user forgets that the electronic apparatus is connecting with the earphone and the user is not wearing the earphone, when the user wants to listen to multimedia sound in the mobile phone, it will not be heard, since that the multimedia sound is being played by the earphone of the earphone at this moment. Of course, a Bluetooth connecting state between the earphone and the mobile phone may be viewed on the mobile phone, but the user often forgets or does not know it.

If it is possible to judge whether the user is wearing the earphone, and provide the corresponding service for the user based on the judgment result, the user's actual application requirement may be better satisfied. The methods in the prior art for judging a wearing state of the user's earphone are generally implemented by adding sensors to the earphone, and however, with this solution, the hardware structure of the earphones is increased, thereby resulting in wasting the hardware resources and increasing cost of the earphone.

The present application aims to solve at least one of the above-mentioned technical defects, and the technical solutions employed by the present application are as follows:

In a first aspect, the present application provides a method for determining an earphone wearing state, the method comprising:

acquiring an audio signal collected by a body conduction audio collecting device of the earphone;

determining a wearing state of an earphone, based on the audio signal collected by a body conduction audio collecting device.

In a second aspect, the present provides a method for controlling an electronic apparatus, comprising:

acquiring a wearing state of an earphone connected to the electronic apparatus;

controlling the electronic apparatus to perform corresponding processing, based on the wearing state of the earphone.

In a third aspect, the present application provides a device for determining an earphone wearing state, the device comprising:

an audio signal acquiring module, configured to acquire an audio signal collected by a body conduction audio collecting device of the earphone;

a wearing state determining module, configured to determine a wearing state of the earphone based on the audio signal collected by the body conduction audio collecting device.

In a fourth aspect, the present application provides a device for controlling an electronic apparatus, the device comprising:

an earphone wearing state acquiring module, configured to acquire a wearing state of the earphone connected to the electronic apparatus;

a processing module, configured to control the electronic apparatus to perform corresponding processing, based on the wearing state of the earphone.

In a fifth aspect, the present application provides an electronic apparatus, wherein the electronic apparatus comprises a memory and a processor;

the memory stores a computer program instruction;

the processor is for invoking the computer program instruction to execute the method shown in the first or second aspect of the present application.

In a sixth aspect, the present application provides an electronic apparatus, wherein the electronic apparatus comprises an audio playing device, a body conduction audio collecting device and a processor;

the audio playing device is for playing an audio signal;

the body conduction audio collecting device is for collecting an audio signal;

the processor is for acquiring an audio signal collected by the body conduction audio collecting device, and determining a wearing state of the electronic apparatus, based on the audio signal collected by the body conduction audio collecting device.

In a seventh aspect, the present application provides a computer readable storage program, wherein the storage medium stores a computer program instruction, and when the program instruction being invoked by a processor, the processor executes the method shown in the first or second aspect of the present application.

The technical solutions provided the embodiments of the present application have the following beneficial effects: the method for determining an earphone wearing state, the method for controlling an electronic apparatus, and the electronic apparatus provided by the embodiments of the present application, utilizes a component on the earphone itself, i.e., a body conduction audio collecting device, to achieve judgment whether a user is wearing the earphone, without adding hardware structure of the earphone, thereby saving resources, avoiding increasing cost of the earphone, and further satisfying practical application requirements.

In order to more clearly illustrate technical solutions of embodiments of the present application, the drawings to be used in the description of the embodiments of the present application will be briefly described below.

Fig. 1 illustrates a schematic flowchart of a method for determining an earphone wearing state provided by an embodiment of the present application;

Fig. 2 illustrates a structural schematic diagram of a bone-conduction-microphone earphone in an example of the present application;

Fig. 3a illustrates a schematic diagram of a signal energy variation curve of an audio signal collected by a body conduction audio collecting device when a user is wearing an earphone in an example of the present application;

Fig. 3b illustrates a schematic diagram of a signal energy variation curve of an audio signal collected by a body conduction audio collecting device when a user is not wearing an earphone in an example of the present application;

Fig. 4a illustrates a schematic diagram of a frequency response curve of an audio signal collected by a body conduction audio collecting device and a frequency response curve of an audio signal collected by an air conduction audio collecting device when a user is wearing an earphone in an example of the present application;

Fig. 4b illustrates a schematic diagram of a frequency response curve of an audio signal collected by a body conduction audio collecting device and a frequency response curve of an audio signal collected by an air conduction audio collecting device when a user is not wearing an earphone in an example of the present application;

Fig. 5 illustrates a schematic flowchart of a method for determining an earphone wearing state based on a difference of two types of signal characters of an audio signal collected by an in-ear microphone (MIC) and an audio signal collected by an out-ear MIC in an example of the present application;

Fig. 6a illustrates a schematic diagram of a signal energy variation curve of an audio signal collected by an air conduction audio collecting device when a user is wearing an earphone in an example of the present application;

Fig. 6b illustrates a schematic diagram of a signal energy variation curve of an audio signal collected by an air conduction audio collecting device when a user is not wearing an earphone in an example of the present application;

Fig. 7 illustrates a schematic flowchart of a method for determining an earphone wearing state based on a difference of two types of signal characters of an audio signal collected by an in-ear MIC and an audio signal collected by an out-ear MIC in an example of the present application;

Fig. 8 illustrates a schematic flowchart of a method for determining an earphone wearing state based on a correlation between an audio signal collected by an in-ear MIC and an audio signal collected by an out-ear MIC in an example of the present application;

Fig. 9a illustrates a schematic diagram of a propagation path of an audio signal played by a speaker when a user is wearing an earphone in an example of the present application;

Fig. 9b illustrates a schematic diagram of a propagation path of an audio signal played by a speaker when a user is not wearing an earphone in an example of the present application;

Fig. 10 illustrates a schematic diagram of a method for determining an earphone wearing state based on a change of a propagation path of an audio signal played by a speaker arriving to a body conduction microphone in an example of the present application;

Fig. 11 illustrates a schematic diagram of a method for determining an earphone wearing state based on a change in a propagation path of an audio signal played by an audio playing device arriving to a body conduction microphone in another example of the present application;

Fig. 12 illustrates a schematic flowchart of a method for determining an earphone wearing state based on two manners in an example of the present application;

Fig. 13 illustrates a schematic flowchart of a method for determining an earphone wearing state when detecting a voice event requirement of a user in an example of the present application;

Fig. 14a illustrates a schematic diagram of a user's mobile phone connecting with an earphone wirelessly via Bluetooth in an example of the present application;

Fig. 14b illustrates a schematic diagram of a voice event requirement of a user in an example of the present application;

Fig. 14c illustrates a schematic diagram of controlling an electronic apparatus to perform corresponding processing based on a wearing state of an earphone in an example of the present application;

Fig. 15 illustrates a schematic flowchart of determining whether a user is wearing an earphone based on an audio signal collected by an in-ear MIC and an audio signal collected by an out-ear MIC in an example of the present application;

Fig. 16 illustrates a schematic flowchart of a method for determining an earphone wearing state based on a change of a propagation path of an audio signal played by a speaker arriving to a body conduction microphone in another example of the present application;

Fig. 17 illustrates a schematic flowchart of a method for determining an earphone wearing state based on two manners in another example of the present application;

Fig. 18 illustrates a structural schematic diagram of a device for determining an earphone wearing state provided by an embodiment of the present application;

Fig. 19 illustrates a schematic flowchart of a method for controlling an electronic apparatus provided by an embodiment of the present application;

Fig. 20 illustrates a structural schematic diagram of a device for controlling an electronic apparatus provided by an embodiment of the present application;

Fig. 21 illustrates a structural schematic diagram of an electronic apparatus provided by an embodiment of the present application;

Fig. 22 illustrates a structural schematic diagram of an electronic apparatus provided by an embodiment of the present application.

Embodiments of the present invention will be described in detail hereafter. The examples of these embodiments have been illustrated in the drawings throughout which same or similar reference numerals refer to same or similar elements or elements having same or similar functions. The embodiments described hereafter with reference to the drawings are illustrative, merely used for explaining the present invention and should not be regarded as any limitations thereto.

It should be understood by those skill in the art that singular forms "a", "an", "the", and "said" may be intended to include plural forms as well, unless otherwise stated. It should be further understood that terms "include/including" used in this specification specify the presence of the stated features, integers, steps, operations, elements and/or components, but not exclusive of the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or combinations thereof. It should be understood that when a component is referred to as being "connected to" or "coupled to" another component, it may be directly connected or coupled to other elements or provided with intervening elements therebetween. In addition, "connected to" or "coupled to" as used herein may include wireless connection or coupling. As used herein, term "and/or" includes all or any of one or more associated listed items or combinations thereof.

Technical solutions of the present application and the ways to solve the above-mentioned technical problems by technical solutions of the present application are described in detail below with respect to specific embodiments. The following specific embodiments may be combined with one another. Details of the same or similar concepts or processes may not be given again in some embodiments. With reference to the accompanying drawings, embodiments of the present application will now be described.

Fig. 1 illustrates a schematic flowchart of a method for determining an earphone wearing state provided by an embodiment of the present application. As shown in Fig. 1, the method may comprise:

Step 110: acquiring an audio signal collected by a body conduction audio collecting device of the earphone;

Step 120: determining a wearing state of the earphone, based on the audio signal collected by the body conduction audio collecting device.

Wherein, the body conduction audio collecting device is a signal collecting device that achieves sound collection based on a change (e.g., vibration) of a human body part by contacting a specific part of a human body (for example, an in-ear part of a human body, a part of the head that touches the bone, or the like). Since the body conduction audio collecting device achieves collecting audio signal by contacting with a human body part, when the earphone is connecting with an electronic apparatus, the audio signals collected by the body conduction audio collecting device in the two cases of when a user is wearing the earphone or is not wearing the earphone are different. Therefore, the wearing state of the earphone of the user may be determined based on audio signals collected by the body conduction audio collecting device of the earphone.

In an alternative embodiment of the present application, the body conduction audio collecting device may be a bone conduction audio collecting device, which is a signal collecting device for collecting sound by using a bone conduction technology. For the bone conduction audio collecting device, sound waves are transmitted to the audio collecting device via bones.

It should be noted that the execution body of the method for determining an earphone wearing state, may be an electronic apparatus connected to an earphone, or may be an earphone. When the execution body is an electronic apparatus connected to an earphone, the electronic apparatus determines an earphone wear state of a user by acquiring the audio signal collected by the body conduction audio collecting device from the earphone; when the execution body is an earphone, a processor of the earphone determines an earphone wearing state of a user based on the audio signal collected by the body conduction audio collecting device of the earphone.

The method for determining an earphone wearing state in the embodiment of the present application, utilizes a component on the earphone, i.e., a body conduction audio collecting device, to achieve judgment whether the earphone is being worn by a user, without adding hardware structure of the earphone, thereby saving resources, avoiding increasing cost of the earphone, and further satisfying practical application requirements.

It should be noted that earphones with a body conduction audio collecting device are all included in the scope of the earphone of the embodiments in the present application.

In an alternative embodiment of the present application, the determining a wearing state of the earphone, based on the audio signal collected by the body conduction audio collecting device, comprises at least one of the following manners:

determining the wearing state of the earphone, based on a signal characteristic of the audio signal collected by the body conduction audio collecting device;

determining the wearing state of the earphone, based on the audio signal collected by the body conduction audio collecting device and an audio signal collected by an air conduction audio collecting device of the earphone;

determining the wearing state of the earphone, based on the audio signal played by an audio playing device of the earphone and the audio signal collected by the body conduction audio collecting device.

Wherein, the air conduction audio collecting device is a common audio collecting device, and for the air conduction audio collecting device, sound waves are transmitted to the audio collecting device via air. In the embodiment of the present application, for convenience of description, the body conduction audio collecting device is simply referred as an in-ear audio collecting device (e.g., MIC, microphone) or an inner MIC, and the air conduction audio collecting device is simply referred to as an out-ear MIC or an outer MIC.

It should be noted that the specific types of the body conduction audio collecting device and the air conduction audio collecting device in the embodiment of the present application include, but are not limited to, any type or form of common audio collecting device in an earphone, and in an alternative solution, the body conduction audio collecting device may be a body conduction microphone, while the air conduction audio collecting device may be an air conduction microphone. Similarly, types or forms of the audio playing device are not limited in the embodiment of the present application. In an alternative embodiment the audio playing device may be a speaker.

It may be understood that, in practical applications, the manner of determining an earphone wearing state of a user may be selected according to practical application requirement and/or the structure of an earphone itself. As an example, Fig. 2 illustrates a structural schematic diagram of a bone-conduction-microphone earphone. In the civilian field, the bone-conduction-microphone earphone is used for scenario with strong background noise. Besides a speaker 30 possessed by a conventional earphone and an out-ear MIC 20 for collecting local sound, the earphone also includes a bone conduction microphone, i.e., an in-ear MIC 10, fitting in-ear skin in the earplug. The earplug of such earphone has good sealing properties and can effectively isolate the sound outside the ear. Therefore, when a user is in a strong background noise environment, the in-ear MIC replaces or combines the signals collected by the out-ear MIC to obtain a clean and clear sound of the local user.

The bone-conduction-microphone earphone shown in Fig. 2, includes an in-ear MIC 10, an out-ear MIC 20, and a speaker 30. In this case, any one or more of the manners of determining an earphone wearing state of a user may be used to determine the earphone wearing state of a user. If the earphone itself includes an in-ear MIC and a speaker, rather than an out-ear MIC, the manner of determining the earphone wearing state of a user based on at least one of the signal characteristics of the audio signal collected by the in-ear MIC described above is employed, and/or, the manner of determining the earphone wearing state of a user based on the audio signal played by the audio playing device of the earphone and the audio signal collected by the body conduction audio collecting device may be employed.

In an alternative implementation of the present application, determining a wearing state of the earphone, based on the audio signal collected by the body conduction audio collecting device and an audio signal collected by an air conduction audio collecting device of the earphone, may include:

determining the wearing state of the earphone, based on a difference between the audio signal collected by the body conduction audio collecting device and the audio signal collected by the air conduction audio collecting device of the earphone;

and/or,

determining the wearing state of the earphone, based on a correlation between the audio signal collected by the body conduction audio collecting device and the audio signal collected by the air conduction audio collecting device;

determining the wearing state of the earphone, based on an audio signal played by an audio playing device of the earphone and the audio signal collected by the body conduction audio collecting device, includes:

determining the wearing state of the earphone, based on a change of a propagation path of an audio signal played by the audio playing device arriving to the body conduction audio collecting device.

In an alternative implementation of the present application, determining the wearing state of the earphone, based on a signal characteristic of the audio signal collected by the body conduction audio collecting device, comprises:

determining the earphone wearing state of the user based on at least one signal characteristic of the audio signals collected by the body conduction audio collecting device.

Specifically, the at least one signal characteristic of the audio signal collected by the body conduction audio collecting device may be compared with a corresponding first threshold, to determine a wearing state of the earphone according to the comparison result;

In this manner, the determination of the wearing state of the earphone may be achieved according to the signal characteristic of the local user voice collected by the body conduction audio collecting device. When the user is speaking, the signal characteristic of the audio signal collected by the in-ear MIC are significantly different whether the earphone is worn on the user's ear. Therefore, whether the user is wearing an earphone may be determined according to the comparison result of the signal characteristic of the audio signal collected by the in-ear MIC with the first threshold corresponding to the signal characteristic.

Wherein, the signal characteristic of the audio signal includes, but are not limited to, signal energy characteristic and signal frequency characteristic of the audio signal. The first threshold corresponding to the signal energy characteristic and the first threshold corresponding to the signal frequency characteristic may be determined according to practical requirement, for example, may be determined according to an empirical value and/or an experimental value.

As an example, Fig. 3a and Fig. 3b respectively illustrates schematic diagrams for experimental results of the energy curves, i.e., the curves of the amplitude of the signal varies as time, of the audio signals collected by the in-ear MIC when the user is wearing the earphone and is not wearing the earphone, during the user speaking, i.e., when the local user's voice may be detected, wherein, the x-coordinate represents time (the unit is s) and the y-coordinate represents the signal intensity, i.e., the magnitude of the energy (the unit is Decibel (dB)). It may be seen from the figure that when the earphone is worn and not worn, the energy characters of the audio signals collected by the in-ear MIC are significantly different, and the signal energy collected when the in-ear MIC is worn on the user's ear is much greater than the signal energy collected when the in-ear MIC is not worn on the user's ear. Therefore, the earphone wearing state of the user may be determined based on the signal energy characteristic of the audio signal collected by the in-ear MIC.

In an alternative implementation of the present application, when determining the earphone wearing state based on the signal energy characteristic of the audio signal collected by the in-ear MIC, the method may specifically include:

if the signal energy value of the audio signal collected by the in-ear MIC is greater than the first threshold corresponding to the signal energy characteristic, determining that the wearing state of the earphone is worn, and if the signal energy value of the audio signal collected by the in-ear MIC is not greater than the first threshold, then determining that the wearing state of the earphone is not worn.

It should be noted that, in practical applications, the signal energy value generally refers to the energy of the signal within a set duration, and may specifically be the average of all signal intensity within the set duration, or may be the sum of the total signal intensity within the set duration, and, it is also possible to perform logarithmic calculation of all signal intensity within the set duration, and the still like. When the signal energy value refers to the mean value, sum, or logarithm of the signal intensity of the signal within the set duration, that comparison of the signal energy value of the audio signal collected by the in-ear MIC with the first threshold corresponding to the signal energy characteristic, may refer to the comparison of the mean, sum, or logarithm value with a first threshold corresponding to the signal energy characteristic.

As an example, the curves A1 and A2 in Figs. 4a and 4b respectively illustrates schematic diagrams for the experimental results of the frequency response curves of the audio signal collected by the in-ear MIC when the user is wearing the earphone and not wearing the earphone during user speaking, wherein the x-coordinate represents the frequency (the unit is Hertz (HZ)) and the y-coordinate represents the loudness of the signal, i.e. the signal intensity (the unit is dB). As may be seen from the figure, when the earphone is worn on the user's ear, the low frequency signal of the audio signal collected by the in-ear MIC is strong, and the high frequency signal component is rapidly attenuated, while the in-ear MIC may almost collect any little signal, when the earphone is not worn on the user's ear. Therefore, the judgement of the earphone wearing state of the user may be achieved based on the signal frequency characteristics of the audio signal collected by the in-ear MIC.

In an alternative implementation of the present application, determining the wearing state of the earphone based on a signal frequency characteristic of the audio signal collected by the body conduction audio collecting device may specifically include:

if in the audio signal collected by the body conduction audio collecting device, the frequency width corresponding to the frequency whose signal intensity is greater than the signal intensity threshold, is greater than the first threshold corresponding to the signal frequency characteristic, then the wearing state of the earphone is determined to be worn, and if the frequency width corresponding to the frequency whose signal intensity is greater than the signal intensity threshold, is not greater than the first threshold corresponding to the signal frequency characteristic, then the wearing state of the earphone is determined to be not worn.

As a specific example, for the curves A1 and A2 shown in Fig. 4a and Fig. 4b, the first threshold corresponding to the signal frequency characteristic may be set to 1000 Hz, and the signal intensity threshold may be set to -108 dB. The frequency width corresponding to the frequency whose signal intensity of the audio signal corresponding to the curve A1 in Fig. 4a is greater than -108 dB, is 4000 Hz and greater than the first threshold value, i.e.,1000 Hz, and therefore the user is wearing the earphone at this time. The frequency width corresponding to the frequency whose signal intensity of the audio signal corresponding to the curve A2 in Fig. 4b is greater than -108 dB, is about 0 and less than the first threshold value, i.e., 1000 Hz, and therefore the user is not wearing the earphone at this time.

In an alternative implementation of the present application, determining the earphone wearing state of the user based on the signal energy characteristic and the signal frequency characteristic of the audio signal collected by the body conduction audio collecting device, may specifically include:

determining that the wearing state of the earphone is worn, when the wearing state of the earphone is determined to be worn based on the signal energy characteristic of the audio signal collected by the body conduction audio collecting device, and/or when the wearing state of the earphone is determined to be worn based on the signal frequency characteristic of the audio signal collected by the body conduction audio collecting device.

In other words, when determining the wearing state of the earphone based on the signal energy characteristic and the signal frequency characteristic of the audio signal collected by the in-ear MIC, the wearing state of the earphone may be determined to be worn based on any one of signal characteristics, or the wearing state of the earphone may be determined to be worn based on both the two signal characteristics. In practical applications, specific determination manners may be selected according to application requirements.

In an alternative implementation of the present application, determining the wearing state of the earphone based on a difference between the audio signal collected by the body conduction audio collecting device and the audio signal collected by the air conduction audio collecting device of the earphone includes:

acquiring a difference between the signal characteristic of the audio signal collected by the body conduction audio collecting device and the signal characteristic of the audio signal collected by the air conduction audio collecting device, comparing the difference with a second threshold, and determining the wearing state of the earphone according to the comparison result.

As may be seen from the foregoing description, signal characteristics include signal energy characteristic and/or signal frequency characteristic. The second threshold corresponding to the signal characteristic may be determined according to empirical values and/or experimental values.

As may be seen from the foregoing description, during user speaking, when the user is wearing the earphone and is not wearing the earphone, the difference between the audio signal collected by the in-ear MIC and the signal characteristic of the audio signal collected by the out-ear MIC is significantly different. Compared with the in-ear MIC, for the out-ear MIC, when the user is wearing the earphone and is not wearing the earphone, the difference of the signal characteristics of the audio signal collected by the out-ear MIC is small. Therefore, the wearing state of the earphone may be determined by comparing the difference between the signal characteristic of the audio signal collected by the in-ear MIC and the signal characteristic of the audio signal collected by the out-ear MIC with the second threshold.

As an example, Fig. 5 illustrates a flow diagram of a method for determining an earphone wearing state based on a difference between signal characteristics of an audio signal collected by an in-ear MIC and an audio signal collected by an out-ear MIC. As shown in the figure, the in-ear MIC and the out-ear MIC respectively collect sounds (510, 520), and the difference (detecting characteristic of difference of in-ear and out-ear MICs signals shown in the figure) of signal characteristics of the audio signals collected by the two MICs is acquired based on the audio signals collected by the in-ear MIC and the out-ear MIC (530), and by comparing (detecting characteristic change shown in the figure) the characteristic of the difference of the detected signals of the in-ear and out-ear MICs with the corresponding second threshold (difference characteristic of in-ear and out-ear MICs when wearing earphone or not wearing earphone shown in the figure) (535, 540), the earphone wearing state is determined according to the comparison result (550 or 560). For example, the characteristic change is detected (or the difference of signal characteristics of the audio signals collected by the two MICs is not less than the second threshold), it may be determined that the wearing state of the earphone is not worn (560). If the characteristic change is not detected (or the difference of signal characteristics of the audio signals collected by the two MICs is less than the second threshold), it may be determined that the wearing state of the earphone is worn (550).In an alternative implementation of the present application, when the signal characteristic is an energy signal characteristic, the difference is compared with the second threshold, and determining the wearing state of the earphone according to the comparison result may include:

comparing the difference between the signal energy value of the audio signal collected by the body conduction audio collecting device and the signal energy value of the audio signal collected by the air conduction audio collecting device with the second threshold corresponding to the signal energy characteristic, and if the difference is not less than the corresponding second threshold, determining that the wearing state of the earphone is not worn, and if the difference is less than the corresponding second threshold, determining that the wearing state of the earphone is worn.

As an example, Fig. 6a and Fig. 6b respectively illustrates schematic diagrams for experimental results of energy characteristics of an audio signal collected by the out-ear MIC when the user is wearing the earphone and when the user is not wearing the earphone during the user speaking, wherein the x-coordinate represents time (the unit is s), and the y-coordinate represents the signal intensity (the unit is dB). As may be seen from the figure, for the out-ear MIC, the signal energy collected when the out-ear MIC is worn on the user's ear is not much different from the signal energy collected when the out-ear MIC is not worn on the user's ear. As may be seen from Fig. 3a and Fig. 3b, the energy of the sound signal collected when the in-ear MIC is worn on the user's ear is much greater than the energy of the signal collected when the earphone is not worn on the user's ear. Therefore, the difference between the signal energy characteristics of the audio signal collected by the in-ear MIC and the signal energy characteristic of the audio signal collected by the out-ear MIC when the user is wearing the earphone should be smaller than the difference when not wearing.

In an alternative implementation of the present application, when the signal characteristic is a signal frequency characteristic, the difference is compared with the second threshold, and determining the wearing state of the earphone according to the comparison result may include:

comparing the difference between the frequency width corresponding to the frequency whose signal intensity greater than the signal intensity threshold in the audio signal collected by the body conduction audio collecting device and the frequency width corresponding to the frequency whose signal intensity greater than the signal intensity threshold in the audio signal collected by the air conduction audio collecting device, with the second threshold corresponding to the signal frequency characteristic, and if the difference is less than the corresponding second threshold, determining that the wearing state of the earphone is worn, and if the difference is not less than the corresponding second threshold, determining that the wearing state of the earphone is not worn.

As an example, the curves B1 and B2 in Figs. 4a and 4b respectively illustrates schematic diagrams for experimental results of the frequency response curves of the audio signal collected by the out-ear MIC when the user is wearing the earphone and not wearing the earphone during the user speaking, wherein the x-coordinate represents the frequency (the unit is HZ) and the y-coordinate represents the loudness of the signal, i.e. the signal intensity (the unit is dB). As comparing the curve A1 with the curve B1, when the earphone is worn on the user's ear, the low frequency signal of the in-ear MIC signal is stronger than that of the out-ear MIC, and the high frequency signal component is rapidly attenuated, but the signal frequency component collected by the out-ear MIC is relatively complete. As comparing the curve A2 with the curve B2, when the earphone is not worn on the user's ear, the in-ear MIC can hardly collect any signals, but the out-ear MIC can still collect the user's voice normally and the frequency component is still intact. Therefore, when the user is wearing the earphone, the difference between the signal frequency characteristic of the audio signal collected by the in-ear MIC and the signal frequency characteristic of the audio signal collected by the out-ear MIC should be smaller than the difference when not worn.

In an alternative implementation of the present application, when the signal characteristic is a signal energy characteristic and a signal frequency characteristic, the difference is compared with the second threshold, and determining the wearing state of the earphone according to the comparison result may include:

determining that the wearing state of the earphone is worn, when determining that the wearing state of the earphone is worn according to the comparison result of the difference between the signal energy characteristic of the audio signal collected by the body conduction audio collecting device and the signal energy characteristics of the audio signal collected by the air conduction audio collecting device with the second threshold corresponding to the signal energy characteristic, and/or, when determining that the wearing state of the earphone is worn according to the comparison result of the difference between the signal frequency characteristic of the audio signal collected by the body conduction audio collecting device and the signal frequency characteristics of the audio signal collected by the air conduction audio collecting device with the second threshold corresponding to the signal frequency characteristic.

In other words, when determining the earphone wearing state of the user based on the difference of the signal energy characteristics and the difference of the signal frequency characteristics, the wearing state of the earphone may be determined to be worn when the wearing state of the earphone may be determined based on the difference of any one of the signal characteristic, or, the wearing state of the earphone may be determined to be worn when determining the wearing state of the earphone is wearing the earphone based on the difference of two signal characteristics. In practical applications, a plurality of differences of signal characteristics may be jointly applied to detect the wearing state of the earphone.

As an example, Fig. 7 illustrates a schematic flowchart for determining a wearing state of the earphone, by combining the difference between the signal energy characteristic of the audio signal collected by the in-ear MIC and the signal energy characteristic of the audio signal collected by the out-ear MIC, and the difference of the signal frequency characteristics of the audio signals collected by the two MICs. As shown in the figure, the out-ear MIC may be used for detecting (710) user speech to calculate (720, 730) the difference (the sound energy difference shown in the figure) of the signal energy characteristics of the audio signals collected by the two MICs, and the difference (the sound frequency width difference shown in the figure, which may also be referred to as the spectrum width difference) of signal frequency characteristics of the audio signals collected by the two MICs, and then the wearing state of the earphone may be determined (760, 770) based on the comparison result (750) of the sound energy difference with the threshold (the empirical value shown in the figure) corresponding to signal energy characteristic, and the comparison result (740) of the spectrum width difference with the threshold (the empirical value shown in the figure) corresponding to the signal frequency characteristic. As may be seen from the figure, when the spectrum width difference is less than the empirical value and the energy difference is less than the empirical value (740, 750), it is determined that the user is wearing the earphone (770), that is, in this example, when determining that the user is wearing the earphone based on the sound energy difference, and also determining the user is wearing the earphone based on the spectrum width difference, it is determined that the user is wearing the earphone. When the spectrum width difference is not less than the empirical value (740) or the energy difference is not less than the empirical value (750), it may be determined that the user is not wearing the earphone (760).

In an alternative implementation of the present application, determining the wearing state of the earphone based on the correlation between the audio signal collected by the body conduction audio collecting device and the audio signal collected by the air conduction audio collecting device may include:

calculating the correlation between the audio signal collected by the body conduction audio collecting device and the audio signal collected by the air conduction audio collecting device, comparing the calculated correlation with a third threshold, and determining the wearing state of the earphone according to the comparison result.

As may be seen from the foregoing description, for the out-ear MIC, the signal components collected when the user is wearing the earphone and is not wearing the earphone are complete, such that the out-ear MIC may be used to detect the local sound, and when detecting sound, then the correlation between the audio signal collected by the in-ear MIC and the audio signal collected by the out-ear MIC may be calculated, which the correlation when the earphone is worn is much greater than that when the earphone is not worn. Accordingly, the wearing state of the earphone may be determined according to the comparison result of the correlation with the third threshold.

As an example, Fig. 8 illustrates a flowchart of determining the wearing state of the earphone according to the correlation between the audio signal collected by the body conduction audio collecting device and the audio signal collected by the air conduction audio collecting device. As shown in the figure, the out-ear MIC is used for detecting (810) user speech, the in-ear MIC and the out-ear MIC respectively acquires audio signals, and after acquiring the audio signal collected by the in-ear MIC and the audio signal collected by the out-ear MIC, the correlation between the two audio signals is calculated (820), wherein, if the calculated correlation is greater than the threshold (the threshold in this example may be the empirical value shown in the figure) (830), then it may be determined that the user is wearing the earphone (840), and if the calculated correlation is not greater than the empirical value (830), it is determined that the user is not wearing the earphone (850).

In a practical application, the specific calculation manner of the correlation between the audio signal collected by the in-ear MIC and the audio signal collected by the out-ear MIC may be selected or configured according to requirements. The specific calculation manner of the correlation is not limited in the embodiments of the present application.

In an alternative implementation of the present application, determining the wearing state of the earphone, based on the change of the propagation path of the audio signal played by the audio playing device of the earphone arriving to the body conduction audio collecting device, may include:

according to the audio signal played by the audio playing device of the earphone and the audio signal collected by the body conduction audio collecting device, estimating the propagation path characteristic of the audio signal played by the audio playing device arriving to the body conduction audio collecting device, and acquiring the difference between the estimated propagation path characteristic and the predetermined propagation path characteristic, and comparing the difference with a fourth threshold, and determining the wearing state of the earphone according to the comparison result.

In this manner, the sound is played by the audio playing device, and collected by the in-ear MIC. As an example, in this example, a bone conduction microphone and a speaker are taken as an example for description. Fig. 9a illustrates a schematic diagram of a propagation path of the audio signal played by the speaker arriving to the bone conduction microphone when the user is wearing the earphone. As shown in Fig. 9a, when the earphone is being worn on the user's ear, the sound made by the speaker a propagates in the ear canal and is reflected in the in-ear skin, at this time the in-ear MIC b is attached to the in-ear skin to collect the sound vibration, and usually the sound leakage of the device itself is also collected at this time. The line pointed by c and the lines intersecting with d in the figure indicate the reflection path of the sound made by the speaker c in the in-ear skin, and the line pointed by d indicates the propagation path of the sound made by the speaker c in the ear canal. When the earphone is not worn on the user's ear, for example, on the table, as shown in an example in Fig. 9b, the sounds collected by the in-ear MIC are only the sound leakage e of the device with almost negligible vibration g from the table. In other words, when the user is wearing the earphone and is not wearing the earphone, the sound played by the speaker arrives to the in-ear MIC via different propagation paths. Therefore, it may be detected whether the user is wearing the earphone by detecting the change of the propagation path of the sound signal played by the speaker arriving to the in-ear MIC.

As an example, Fig. 10 illustrates a schematic flowchart of determining the wearing state of the earphone based on the change of the propagation path of the audio signal played by the speaker of the earphone arriving to the body conduction audio collecting device. As shown in the figure, when the speaker playing sound, i.e., the audio signal, the in-ear MIC collects sound (1010, 1020), the characteristic of the sound propagation path of the audio signal played by the speaker arriving to the in-ear MIC may be estimated (1030) according to the sound played by the speaker and the sound collected by the in-ear MIC, and by comparing (1050) the difference between the estimated sound propagation path characteristic and a predetermined propagation path characteristic (e.g., the characteristic of the sound propagation path when wearing the earphone shown in 1040 of the figure) with a fourth threshold, it may be determined (1060 or 1070) that whether the estimated sound propagation path characteristic and the predetermined sound propagation path when the earphone is worn have changed according to the comparison result (the detected propagation change shown in the figure), wherein, since that the predetermined propagation path characteristic is the sound propagation path characteristic when wearing the earphone, accordingly, if the path has changed (1050), then it may be determined that the user is not wearing the earphone (1070), and if the path has not changed (1050), then it may be determined that the user is wearing the earphone (1060).

It may be understood that, in practical applications, the detection of whether the path change is obtained based on comparison result of the difference between the estimated sound propagation path characteristic and the predetermined sound propagation path when the earphone is worn, with the fourth threshold. For example, based on the example shown in Fig. 10, the predetermined sound propagation path characteristic is a sound propagation path characteristic when the earphone is worn. At this time, if the difference is greater than the fourth threshold, it is determined that the user is not wearing the earphone, and if the difference is not greater than the fourth threshold, it is determined that the user is wearing the earphone.

It should be noted that, in practical applications, the predetermined propagation path characteristic may be a predetermined propagation path characteristic when a user is wearing the earphone, or may be a predetermined propagation path characteristic when the user is not wearing the earphone. For example, in the example shown in Fig. 10, if the characteristic of the sound propagation path when the earphone is worn is replaced with the sound propagation path characteristic when the earphone is not worn, the difference between the estimated sound propagation path characteristic and the predetermined sound propagation path characteristic when the earphone is worn is greater than the fourth threshold, it is determined that the user is wearing the earphone, and if the difference is not greater than the predetermined value, it is determined that the user is wearing the earphone.

In an alternative manner, the estimation of the propagation path of the sound signal may be implemented by using an adaptive filter method. As an example shown in Fig. 11, the propagation path of the audio signal played by the audio playing device may be represented as a system. which the system may be represented by an adaptive filter, and the sound propagation path is the path from the audio playing device to the in-ear MIC. The adaptive filter in 1110 of Fig. 11 is the estimated propagation path. In this example, the adaptive filter is used to estimate the propagation path characteristic of the audio signal collected by the in-ear MIC arriving to the in-ear MIC. The audio signal played by the audio playing device may be represented by a discrete time signal sequence, such as x(n) shown in the figure, which is a discrete time signal, where n is an integer representing a sequence number of discrete time signals in a discrete time signal sequence. When the audio playing device plays the signal x(n), according to the signal x(n) played by the audio playing device and the signal d(n) actually collected by the in-ear MIC, the propagation path characteristic of the signal played by the audio playing device arriving to the body conduction audio collecting device is estimated. In this example, the propagation path characteristic may be a filter coefficient calculated by the adaptive filter, to calculate (1130) the difference between the estimated propagation path characteristic (calculating filter system response of the adaptive filter shown in the figure) and the predetermined propagation path characteristic (empirical value of the system shown in the figure). In this example, the predetermined propagation path characteristic is a propagation path characteristic when the user is wearing the earphone, if the calculated difference is greater than the fourth threshold (the empirical value shown in 1140 of the figure), then it is determined that the user is not wearing the earphone (1160), and if the calculated difference is not greater than the fourth threshold (1140), then it is determined that the user is wearing the earphone (1150).

It may be understood that, in practical applications, when predicting an audio signal arriving to the in-ear MIC through an adaptive filter, an adaptive algorithm (the update adaptive filter shown in 1120 of Fig. 11), such as a minimum mean square error filtering algorithm, may be configured. According to the input signal of the adaptive filter, that is, the audio signal x(n) played by the audio playing device, and the difference e(n) between the estimated audio signal x'(n) arriving to the in-ear MIC and the audio signal d(n) actually arriving to the in-ear MIC, the time-varying coefficient of the adaptive filter may be constantly updated, i.e., calculating the adaptive filter coefficient in real time, such that the difference e(n) between the estimated audio signal x'(n) arriving to the in-ear MIC and the audio signal d(n) actually arriving to the in-ear MIC is minimized to update the adaptive filter.

In an alternative implementation of the present application, when determining the earphone wearing state of the user based on the at least two manners, the method may further include:

if it is determined that the earphone wearing state of the user is not wearing the earphone based on at least one of the at least two manners, it is determined that the earphone wearing state of the user is that the earphone is not worn.

As an example, Fig. 12 illustrates a schematic flowchart of one manner for determining whether the user is wearing the earphone by using the difference between the audio signal collected by the in-ear MIC and the audio signal collected by the out-ear MIC, as well as using the signal of the speaker (the change of the propagation path of the audio signal played by the audio playing device arriving to the body conduction collecting device), that is, judging whether the user is wearing the earphone by jointly detecting a local user's voice and detecting a sound path change.

As shown in Fig. 12, the in-ear MIC and the out-ear MIC respectively detect the local sounds (1210), that is, the voice of the local user, and based on the difference between the audio signal collected by the out-ear MIC and the audio signal collected by the in-ear MIC, it is determined that whether the user is wearing the earphone. The in-ear MIC collects the audio signal played by the speaker (1220), and based on the audio signal played by the speaker collected by the in-ear MIC and the audio signal played by the speaker, the propagation path characteristic of the audio signal played by the speaker arriving to the in-ear MIC is estimated (1220), and based on the difference between the estimated propagation path characteristic and the predetermined propagation path characteristic (detecting sound path changes shown in 1220 of the figure), it is determined whether the user is wearing the earphone (1240 or 1250). In any of the above two manners, when detecting that the user is not wearing the earphone ("Detected by any method?" shown in 1230 of the figure), then it is determined that the user's earphone wearing state is that the earphone is not worn (1250). In this example, only the two manners both determine that the user is wearing the earphone (1230), and then the user's earphone wearing state is determined to be worn (1240).

In an alternative implementation of the present application, before determining the wearing state of the earphone based on the audio signal collected by the body conduction audio collecting device, the method further includes:

detecting the user's voice event requirement.

The method for determining a wearing state of the earphone in the present application may start detecting earphone wearing state when detecting the user's voice event requirement, that is detecting that the user needs to use the earphone. In other words, there may be a necessary judgement on the state of whether the user is wearing the earphone, thereby reducing the consumption of resources for detecting earphone wearing state on an electronic apparatus or an earphone. Based on the solution, it is not necessary to detect earphone wearing state in real time, and when the user needs to use the earphone, the wearing state of the earphone may be then determined to assist the user to smoothly use the earphone.

In an alternative solution of the present application, the user's voice event requirement includes a voice event requirement triggered by the user and/or a triggered user's voice event requirement. The voice event requirement includes listening requirement and/or speaking requirement.

Wherein, the voice event requirement triggered by the user corresponds to the triggered user's voice event requirement, and refers to a voice event requirement actively triggered by the user, that is, an event driven by the user itself using the electronic apparatus, for example, an MIC and an audio playing device are needed when the user making a call, and an audio playing device is needed when the user listening to music. For another example, when a call is coming, the user needs to talk with the caller, which belongs to a user's voice event requirement, but this requirement is triggered by the caller, that is, a triggered voice event requirement of the user. Therefore, an event when the user actively or passively activates an application that needs to use the earphone, it is equivalent to detecting an event that needs to use the earphone. The event that drives the detection of whether the earphone is properly worn by the user is driven by the event.

As an example, Fig. 13 illustrates a schematic flowchart of a method for determining an earphone wearing state. As shown in the figure, when the earphone is connected to an electronic terminal via Bluetooth (1310), if it detects that the user actively or passively activates a certain application that needs to use the earphone (1320), then it starts to acquire the audio signal collected by the body conduction audio collecting device of the earphone, and determines whether the earphone is properly worn by the user based on the acquired audio signal (1330).

Specifically, as shown in Fig. 14a, when the user's earphone (1401) and the electronic terminal (1405) are in a wireless connection state via Bluetooth, if the detected voice event requirement includes the event requirement of the local user listening to the sound, then the event requirement of the local user's voice is collected, or if the detected voice event requirement includes the event requirement of the local user listening to the sound and the event requirement of collecting the local user's voice, e.g., the voice event requirement for listening and speaking corresponding to making a call shown in 1410 of Fig. 14b, or only the listening-to-sound event requirement of listening to music shown in 1420 of Fig. 14b, then the device (1405) automatically detects whether the earphone (1401) is worn on the user's ears. If being worn, then the earphone mode is employed to achieve sound collecting or playing; if detecting that the user is not wearing the earphone, then the device (1405) automatically switches to a handset mode or a speaker mode, which, as shown in 1430 of Fig. 14c, an acoustic element in the electronic apparatus (1405) may achieve sound collecting or playing, or the user is reminded to use the earphone mode by a manner of reminding the user. The method for automatically switching or reminding may be set according to the user's own setting in advance, or by using the manner of first reminding and then switching.

In an alternative implementation of the present application, after determining the earphone wearing state of the user, the method further includes:

controlling the electronic apparatus connected to the earphone to perform corresponding processing, based on the wearing state of the earphone.

In this alternative solution, after determining the earphone wearing state of the user, the electronic apparatus connected to the earphone may also be controlled to perform corresponding processing based on the determined wearing state of the earphone.

In an alternative implementation of the present application, controlling the electronic apparatus connected to the earphone to perform corresponding processing may include at least one of the following:

controlling the sound playing mode of the electronic apparatus;

controlling the electronic apparatus to send a prompt message;

controlling the state of the application program on the electronic apparatus.

For example, when it is determined that the earphone wearing state of the user is not worn, the sound playing mode of the electronic apparatus may be controlled to be speaker playing or earpiece playing, that is, the sound is played by the speaker or the earpiece of the electronic terminal, and the user may also be reminded the current connection state of the user's earphone by the electronic apparatus sending a prompt message to the user.

It may be understood that specific forms of the prompt messages may be set according to practical requirement, and may include, but is not limited to, text, voice, indicator light, and the like. For example, it may be a prompt message for prompting the user that the electronic apparatus is connecting to the earphone, or a prompt message for prompting the user to wear the earphone, or a prompt message for prompting the user to switch the sound playing mode of the mobile phone.

Controlling the state of the application program on the electronic apparatus may include, but is not limited to, controlling the operating state of the application program to be paused or muted, deactivating the application program, or the like. For example, when the user wants to play a multimedia file through the application program on the electronic apparatus related to the multimedia file, if detecting that the wearing state of the earphone is not worn, the application program may be controlled to pause or deactivate the application program.

It may be seen from the foregoing description that the execution body of the method for determining earphone wearing state of the present application may be an electronic apparatus connected to the earphone, or may be an earphone. When the execution body is an electronic apparatus connected to the earphone, the electronic apparatus can directly control the sound playing mode of the electronic apparatus, and/or send a corresponding prompt message to the user; when the executing body is an earphone, after the earphone determines the user's earphone wearing state, the earphone may send a corresponding control instruction to the electronic apparatus, control the sound playing mode of the electronic apparatus by the control instruction, and/or send a corresponding prompt message to the user, or send the determined earphone wearing state to the electronic apparatus to enable the electronic apparatus to control the electronic apparatus to perform corresponding processing according to the earphone wearing state.

In the embodiment of the present application, the connection of electronic apparatus and the earphone, may be a wireless connection, such as a Bluetooth connection, or may be a wired connection. When the electronic apparatus is connecter with the earphone via the wireless connection, the user often forgets the connection state of the electronic apparatus and the earphone, resulting in inconvenience in use. When the electronic apparatus is connected with the earphone via wired connection, and when the user wants to use the external device (speaker mode) of the electronic apparatus, the earphone is required to be first unplugged from the electronic apparatus, causing inconvenience to the user. By employing the solution provided by the present application, after determining the wearing state of the earphone, the sound playing mode of the terminal device may be controlled according to the wearing state of the earphone, thereby solving the inconvenience of using for the user.

As an example, Fig. 15 illustrates a schematic flowchart of detecting whether the user is wearing the earphone by using an audio signal collected by an in-ear MIC and an audio signal collected by an out-ear MIC, that is, judging whether the user is wearing the earphone by the method for detecting local user's voice, which the detection of the local voice may implemented by the first sentence spoken by the user to connect to the phone. For example, when the user's electronic terminal (e.g., a mobile phone) and the earphone are being wirelessly connected, that is, when the electronic terminal is in the earphone mode (1510), at this time, if the user makes a call by himself (1520), the mobile phone detects the user's voice event requirement (1530), and starts to detect whether the earphone is properly worn, wherein the detection of the wearing state of the earphone is implemented by the difference between audio signals collected by the in-ear MIC and the out-ear MIC when the user talking (the user usually says "Hi" when a call connected), and when detecting that the earphone is not worn, then the mobile phone may be controlled to switch to the handset mode or the speaker mode, or prompt the user to talk by the earphone mode (1540).

In practical applications, the determination of the earphone wearing state may also be implemented in combination with the user's voice instruction. For example, at this time the user's mobile phone is connected with the earphone via Bluetooth, the user sends a voice instruction "I want to listen to the music" to the mobile phone, and it is detected whether the earphone is properly worn by the difference between the audio signal collected by the in-ear MIC of the earphone and the audio signal collected by the out-ear MIC.

As an example, Fig. 16 illustrates that detecting whether a user is wearing an earphone by using the audio signal played by the speaker and the audio signal collected by the in-ear MIC, that is, determining the earphone wearing state based on the change of the propagation path of the audio signal played by the speaker arriving to the in-ear MIC. For example, at this time, when the user's electronic terminal (such as a mobile phone) is connected with the earphone by wireless connection (1610), and when the user is opening the music player to listen to music or a call is coming to the phone (1620), after detecting the user's voice event request, the user may start to detect whether the earphone is properly worn, and the earphone wearing state is determined based on the change of the propagation path of the audio signal played by the speaker arriving to the in-ear MIC (1630). At this time, the sound played by the speaker may be the content played by the music player or an incoming call ringtone. At this time, the sound of the speaker required for detection may be from the sound played by the player itself. When it is detected that the earphone is not worn, the mobile phone may be controlled to switch to the handset mode or the speaker mode, or prompt the user to talk by the earphone mode (1640).

As an example, Fig. 17 illustrates a schematic flowchart of determining the earphone wearing state by using the difference between the audio signal collected by the in-ear MIC and the audio signal collected by the out-ear MIC (detection path of the user's voice shown in the figure), and the change of the propagation path of the audio signal played by the speaker arriving to the in-ear MIC (the detection path of the sound propagation path in the figure), that is, judging whether the user is wearing the earphone by jointly detecting a local user's voice and detecting a sound path change. In this example, for example, when detecting an event of a user making a call or receiving a call, two detection methods may be initiated: in the uplink path (the path from the terminal device to the earphone), that is, the transmitting terminal, using the detection (1712) of the user voice, acquiring the audio signal collected by the in-ear MIC and the out-ear MIC, processing (1714) the audio signals collected by the two MICs by the transmitting terminal, and encoding (1716) and outputting the processing result; in the downlink path (the path from the earphone to the electronic apparatus), that is, the receiving terminal using the detection (1722) of the change of the sound propagation path, the sound played by the speaker after decoding (1726) is passing through signal processing (1724) and then output by the receiving terminal, by detecting the change of the propagation path of the audio signal played by the speaker arriving to the in-ear MIC, the wearing state of the earphone is determined. If any method detecting that the user is not wearing the earphone, then the user may be prompted or then the mode is automatically switched (1730).

It should be noted that, for speaking requirement, that is, the requirement of MIC collecting signal, the out-ear MIC is usually used to collect the local sound for the earphone, but the out-ear MIC is not sensitive to the distance, that is, the local sound may be collected by the out-ear MIC no matter that the user is wearing the earphone or not. Therefore, for the speaking requirement only, in practical application, it is not necessary to detect whether the earphone is worn.

The embodiment of the present application further provides a device for determining an earphone wearing state. As shown in Fig. 18, the device for determining an earphone wearing state 1800 may include an audio signal acquiring module 1810 and a wearing state determining module 1820, wherein:

the audio signal acquiring module 1810 is for acquiring an audio signal collected by the body conduction audio collecting device of the earphone;

the wearing state determining module 1820 is for determining a wearing state of the earphone based on the audio signal collected by the bone conduction audio collecting device.

In the embodiment of the present application, when determining a wearing state of the earphone based on the audio signal collected by the body conduction audio collecting device, the wearing state determining module 1820 is specifically configured to determine the wearing state of the earphone by using at least one of the following manners:

determining the earphone wearing state based on the signal characteristic of the audio signal collected by the body conduction audio collecting device;

determining the earphone wearing state based on the audio signal collected by the body conduction audio collecting device and the audio signal collected by the air conduction audio collecting device of the earphone;

determining the earphone wearing state based on the audio signal played by the audio playing device of the earphone and the audio signal collected by the body conduction audio collecting device.

In an alternative implementation of the embodiment of the present application, when determining the earphone wearing state based on the audio signal collected by the body conduction audio collecting device and the audio signal collected by the air conduction audio collecting device of the earphone, the wearing state determining module 120 is specifically used for:

determining the wearing state of the earphone based on the difference between the audio signal collected by the body conduction audio collecting device and the audio signal collected by the air conduction audio collecting device of the earphone; and/or;

determining the wearing state of the earphone based on the correlation between the audio signal collected by the body conduction audio collecting device and the audio signal collected by the air conduction audio collecting device;

When determining the wearing state of the earphone based on the audio signal played by the audio playing device of the earphone and the audio signal collected by the body conduction audio collecting device, the wearing state determining module 120 may be specifically used for:

determining the wearing state of the earphone based on the change of the propagation path of the audio signal played by the audio playing device of the earphone arriving to the body conduction audio collecting device.

It may be understood that each module of the device for determining earphone wearing state in the embodiment of the present application may have functions of implementing corresponding steps in the method for determining earphone wearing state shown in the embodiments of the present application. Wherein, the functions may be implemented by hardware, or may be implemented by hardware executing a corresponding software. Each of the above modules may be software and/or hardware, and each module may be implemented separately or integrated by multiple modules. The description of the functions of each module of the device for determining earphone wearing state, may be referred to the corresponding description in the method for determining earphone wearing state, and details are not described herein again.

In addition, in the practical application, the device for determining earphone wearing state in the embodiment of the present application may be operated on an electronic apparatus or an earphone according to a practical application scenario.

The embodiment of the present application further provides a method for controlling electronic apparatus. As shown in Fig. 19, the method may include:

Step 1910: acquiring a wearing state of an earphone connected to an electronic apparatus;

Step 1920: controlling the electronic apparatus to perform corresponding processing based on the wearing state of the earphone.

The method for controlling electronic apparatus in the embodiment of the present application may control the electronic apparatus to perform corresponding processing based on the wearing state of the earphone, to implement the user-based earphone wearing state, and provide a corresponding service for the user to better meet the user's practical application requirement.

It should be noted that the execution body of the method for controlling electronic apparatus in the embodiment of the present application may be an electronic apparatus connected to the earphone, or may be an earphone. Specifically, when the execution body is an electronic apparatus connected to the earphone, the electronic apparatus may directly control the electronic apparatus to perform corresponding processing according to the wearing state of the earphone after acquiring the wearing state of the earphone. When the execution body is an earphone, after acquiring the wearing state of the earphone, the earphone may send a corresponding control instruction to the electronic apparatus based on the wearing state of the earphone, and control the electronic apparatus to perform corresponding processing by the control instruction, or send the determined wearing state of the earphone to the electronic apparatus to enable the electronic apparatus to control the electronic apparatus to perform corresponding processing according to the wearing state of the earphone.

Wherein, in the method for controlling electronic apparatus in the embodiment of the present application, the specific implementation of acquiring the wearing state of the earphone connected to the electronic apparatus may be the wearing state of the earphone acquired by using the method for determining earphone wearing state provided in any one of the embodiments of the present application.

In an alternative implementation of the present application, controlling the electronic apparatus to perform corresponding processing includes:

controlling the sound playing mode of the electronic apparatus, and/or controlling the electronic apparatus to send a prompt message.

Specifically, controlling the sound playing mode of the electronic apparatus may include:

when the wearing mode of the earphone is not worn, controlling the sound playing mode of the electronic apparatus to be the earpiece mode or the speaker mode;

controlling the electronic apparatus to send a prompt message may include:

when the wearing mode of the earphone is not worn, controlling the electronic apparatus to send a prompt message for prompting the electronic apparatus to connect with the earphone, and/or send a prompt message for prompting the user to wear the earphone, and/or send a prompt message to prompt the user to switch the sound playing mode of the electronic apparatus.

Corresponding to the method for controlling electronic apparatus shown in Fig. 19, the embodiment of the present application further provides a device for controlling an electronic apparatus as shown in Fig. 20, and the device for controlling an electronic apparatus 2000 may include an earphone wearing state acquiring module 2010 and processing module 2020, wherein:

the earphone wearing state acquiring module 2010 is for acquiring a wearing state of the earphone connected to the electronic apparatus;

the processing module 2020 is for controlling the electronic apparatus to perform corresponding processing based on the wearing state of the earphone.

Each module of the device for controlling an electronic apparatus in the embodiment of the present application may have functions of implementing corresponding steps in the method for controlling electronic apparatus in the embodiment of the present application. Wherein, the functions may be implemented by hardware, or may be implemented by hardware executing a corresponding software. Each of the above modules may be software and/or hardware, and each module may be implemented separately or integrated by multiple modules. The description of the functions of each module of the device for controlling an electronic apparatus, may be referred to the corresponding description in the above-mentioned method for controlling electronic apparatus, and details are not described herein again.

The embodiment of the present application further provides an electronic apparatus. As shown in Fig. 21, the electronic apparatus 2100 may include an audio playing device 2110, a body conduction audio collecting device 2120, and a processor 2130, wherein:

the audio playing device 2110 is for playing an audio signal;

the body conduction audio collecting device 2120 is for collecting an audio signal;

the processor 2130 is for acquiring an audio signal collected by the body conduction audio collecting device, and determining a wearing state of the electronic apparatus based on the audio signal collected by the body conduction audio collecting device.

It may be understood that, in practical applications, the specific implementation of the electronic apparatus 2100 may include, but is not limited to, an audio playing device 2110, a body conduction audio collecting device 2120, and a processor 2130, and may further include other components according to actual requirement, for example, a memory may also be included.

The electronic apparatus 2100 may be used as an execution device of the method for determining earphone wearing state shown in the embodiments of the present application, and for corresponding to some embodiments of the methods for determining earphone wearing state in the embodiments of the present application, the electronic apparatus may further include an air conduction audio collecting device.

In an alternative solution, the electronic apparatus 2100 may be implemented as an earphone.

An embodiment of the present application provides an electronic apparatus. As shown in Fig. 22, the electronic apparatus 2200 includes a processor 2201 and a memory 2203. Wherein, the processor 2201 is connected to the memory 2203, for example via a bus 2202. Alternatively, the electronic apparatus 2200 may further include a transceiver 2204. It should be noted that, in the actual application, the transceiver 2204 is not limited to one, and the structure of the electronic apparatus 2200 does not constitute a limitation on the embodiments of the present application.

Wherein, the processor 2201 is applied in the embodiment of the present application for implementing the functions of the modules of the apparatus shown in Fig. 18 or Fig. 20. The transceiver 2204 includes a receiver and a transmitter. The transceiver 2204 is applied in the embodiment of the present application to implement communication between the electronic apparatus 2200 and other devices to implement data reception and transmission.

The processor 2201 may be a CPU, a general-purpose processor, a DSP, an ASIC, an FPGA or other programmable logic device, a transistor logic device, a hardware component, or any combination thereof. It is possible to implement or carry out the various illustrative logical blocks, modules and circuits described in connection with the present disclosure. The processor 2201 can also be a combination of computing functions, such as including one or more microprocessor combinations, a combination of DSPs and microprocessors, and the like.

The bus 2202 may include a path for communicating information between the above components. The bus 2202 may be a PCI bus, an EISA bus or the like. The bus 2202 may be divided into an address bus, a data bus, a control bus, and the like. For convince of representation, only one bold line is shown in Fig. 22, but it does not mean that there is only one bus or one type of bus.

The memory 2203 may be a ROM or other types of static storage device that may store static information and instructions, a RAM or other types of dynamic storage devices that may store information and instructions, and can also be an EEPROM, a CD-ROM or other optical disk storage, optical disk storage (including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or any other media that may be used to carry or store desired program codes in the form of instructions or data structures and may be accessed by a computer, but not limited to this.

Alternatively, the memory 2203 is applied to store an application program code for executing the solution of the present application, and is controlled by the processor 2201 for execution. The processor 2201 is for executing the application program code stored in the memory 2203 to implement the actions of the device for determining earphone wearing state or the device for controlling electronic apparatus provided by the embodiment of the present application.

The embodiment of the present application provides a computer readable storage medium, where the computer readable storage medium stores a computer program, and when the program is executed by the processor, the method for determining earphone wearing state or the method for controlling electronic apparatus shown in any embodiment of the present application is implemented.

It should be understood that although the various steps in the flowchart of the drawings are presented sequentially as indicated by the arrows, these steps will not be successively performed necessarily in the order indicated by the arrows. Unless explicitly stated herein, the execution of these steps will not be strictly limited, but may be performed in any order. Moreover, at least some of the steps in the flowchart of the drawings may include a plurality of sub-steps or stages, which are not necessarily performed at the same time, but may be executed in different time, and the execution order thereof will also not be necessarily performed successively, but may be performed alternatively or alternately with at least a part of other steps or sub-steps or stages of other steps.

The preceding examples of are preferable examples of the invention. Those skilled in the art may make some improvements and modifications without departing from principles of the invention, and these improvements and modifications also belong to the protection scope of the invention.

The electronic device (the electronic device may be referred to as one of the electronic apparatus, the terminal, the device, or the module) according to various embodiments may be one of various types of electronic devices. The electronic devices may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. According to an embodiment of the disclosure, the electronic devices are not limited to those described above.

It should be appreciated that various embodiments of the present disclosure and the terms used therein are not intended to limit the technological features set forth herein to particular embodiments and include various changes, equivalents, or replacements for a corresponding embodiment. With regard to the description of the drawings, similar reference numerals may be used to refer to similar or related elements. It is to be understood that a singular form of a noun corresponding to an item may include one or more of the things, unless the relevant context clearly indicates otherwise. As used herein, each of such phrases as "A/B," "A and/or B," "A or B," "at least one of A and B," "at least one of A or B," "A, B, or C," "at least one of A, B, and C," and "at least one of A, B, or C," may include any one of, or all possible combinations of the items enumerated together in a corresponding one of the phrases. As used herein, such terms as "1st" and "2nd," or "first" and "second" may be used to simply distinguish a corresponding component from another, and does not limit the components in other aspect (e.g., importance or order). It is to be understood that if an element (e.g., a first element) is referred to, with or without the term "operatively" or "communicatively", as "coupled with," "coupled to," "connected with," or "connected to" another element (e.g., a second element), it means that the element may be coupled with the other element directly (e.g., wiredly), wirelessly, or via a third element.

As used herein, the term "module" may include a unit implemented in hardware, software, or firmware, and may interchangeably be used with other terms, for example, "logic," "logic block," "part," or "circuitry". A module may be a single integral component, or a minimum unit or part thereof, adapted to perform one or more functions. For example, according to an embodiment, the module may be implemented in a form of an application-specific integrated circuit (ASIC).

The expression "configured to (or set to)" as used herein may be used interchangeably with "suitable for," "having the capacity to," "designed to," " adapted to," "made to," or "capable of" according to a context. The term "configured to (set to)" does not necessarily mean "specifically designed to" in a hardware level. Instead, the expression "apparatus configured to…" may mean that the apparatus is "capable of…" along with other devices or parts in a certain context. For example, "a processor configured to (set to) perform A, B, and C" may mean a dedicated processor (e.g., an embedded processor) for performing a corresponding operation, or a generic-purpose processor (e.g., a central processing unit (CPU) or an application processor (AP)) capable of performing a corresponding operation by executing one or more software programs stored in a memory device.

Various embodiments as set forth herein may be implemented as software including one or more instructions that are stored in a storage medium (e.g., internal memory or external memory) that is readable by a machine (e.g., the electronic device). For example, a processor(e.g., the processor) of the machine (e.g., the electronic device) may invoke at least one of the one or more instructions stored in the storage medium, and execute it, with or without using one or more other components under the control of the processor. This allows the machine to be operated to perform at least one function according to the at least one instruction invoked. The one or more instructions may include a code generated by a complier or a code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Wherein, the term "non-transitory" simply means that the storage medium is a tangible device, and does not include a signal (e.g., an electromagnetic wave), but this term does not differentiate between where data is semi-permanently stored in the storage medium and where the data is temporarily stored in the storage medium.

According to an embodiment, a method according to various embodiments of the disclosure may be included and provided in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read only memory (CD-ROM)), or be distributed (e.g., downloaded or uploaded) online via an application store (e.g., PlayStoreTM), or between two user devices (e.g., smart phones) directly. If distributed online, at least part of the computer program product may be temporarily generated or at least temporarily stored in the machine-readable storage medium, such as memory of the manufacturer's server, a server of the application store, or a relay server.

According to various embodiments, each component (e.g., a module or a program) of the above-described components may include a single entity or multiple entities. According to various embodiments, one or more of the above-described components may be omitted, or one or more other components may be added. Alternatively or additionally, a plurality of components (e.g., modules or programs) may be integrated into a single component. In such a case, according to various embodiments, the integrated component may still perform one or more functions of each of the plurality of components in the same or similar manner as they are performed by a corresponding one of the plurality of components before the integration. According to various embodiments, operations performed by the module, the program, or another component may be carried out sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations may be executed in a different order or omitted, or one or more other operations may be added.

Claims

A method for determining an earphone wearing state, comprising:

acquiring an audio signal collected by a body conduction audio collecting device of the earphone; and,

determining a wearing state of the earphone, based on the audio signal collected by the body conduction audio collecting device.
The method according to claim 1, wherein, determining a wearing state of the earphone, based on the audio signal collected by the body conduction audio collecting device, comprises at least one of the following manners:

determining a wearing state of the earphone, based on a signal characteristic of the audio signal collected by the body conduction audio collecting device;

determining a wearing state of the earphone, based on the audio signal collected by the body conduction audio collecting device and an audio signal collected by an air conduction audio collecting device of the earphone; and,

determining a wearing state of the earphone, based on an audio signal played by an audio playing device of the earphone and the audio signal collected by the body conduction audio collecting device.
The method according to claim 2, wherein, determining a wearing state of the earphone, based on the audio signal collected by the body conduction audio collecting device and an audio signal collected by an air conduction audio collecting device of the earphone, comprises:

determining a wearing state of the earphone, based on a difference between the audio signal collected by the body conduction audio collecting device and the audio signal collected by the air conduction audio collecting device;

and/or,

determining a wearing state of the earphone, based on a correlation between the audio signal collected by the body conduction audio collecting device and the audio signal collected by the air conduction audio collecting device;

determining a wearing state of the earphone, based on an audio signal played by an audio playing device of the earphone and the audio signal collected by the body conduction audio collecting device, comprises:

determining a wearing state of the earphone, based on a change of a propagation path of an audio signal played by the audio playing device arriving to the body conduction audio collecting device.
The method according to claim 3, wherein, determining a wearing state of the earphone, based on a signal characteristic of the audio signal collected by the body conduction collecting device, comprises:

comparing at least one signal characteristic of the audio signal collected by the body conduction audio collecting device with a corresponding first threshold, and determining a wearing state of the earphone according to the comparison result;

determining a wearing state of the earphone, based on a difference between the audio signal collected by the body conduction audio collecting device and the audio signal collected by the air conduction audio collecting device, comprises:

acquiring a difference between the signal characteristic of the audio signal collected by the body conduction audio collecting device and the signal characteristic of the audio signal collected by the air conduction audio collecting device, comparing the difference with a second threshold, and determining a wearing state of the earphone according to the comparison result;

determining a wearing state of the earphone, based on a correlation between the audio signal collected by the body conduction audio collecting device and the audio signal collected by the air conduction audio collecting device, comprises:

calculating the correlation between the audio signal collected by the body conduction audio collecting device and the audio signal collected by the air conduction audio collecting device, comparing the correlation with a third threshold, and determining a wearing state of the earphone according to the comparison result;

determining a wearing state of the earphone, based on a change of a propagation path of the audio signal played by the audio playing device arriving to the body conduction audio collecting device, comprises:

estimating a propagation path characteristic of the audio signal played by the audio playing device arriving to the body conduction audio collecting device according to the audio signal played by the audio playing device and the audio signal collected by the body conduction audio collecting device, acquiring a difference between the estimated propagation path characteristic and a predetermined propagation path characteristic, comparing the difference with a fourth threshold, and determining a wearing state of the earphone according to the comparison result.
The method according to claim 1, wherein, before determining a wearing state of the earphone, based on the audio signal collected by the body conduction audio collecting device, the method further comprises:

detecting a voice event requirement of a user.
The method according to claim 1, wherein, after determining a wearing state of the earphone, the method further comprises:

controlling an electronic apparatus connected to the earphone to perform corresponding processing based on the wearing state of the earphone.
The method according to claim 6, wherein, the controlling an electronic apparatus connected to the earphone to perform corresponding processing, comprises:

controlling a sound playing mode of the electronic apparatus, and/or controlling the electronic apparatus to send a prompt message.
A method for controlling an electronic apparatus, comprising:

acquiring a wearing state of an earphone connected to the electronic apparatus;

controlling the electronic apparatus to perform corresponding processing based on the wearing state of the earphone.
The method according to claim 8, wherein, the controlling the electronic apparatus to perform corresponding processing comprises:

controlling a sound playing mode of the electronic apparatus, and/or, controlling the electronic apparatus to send a prompt message.
The method according to claim 9, wherein, the controlling a sound playing mode of the electronic apparatus, comprises:

if the wearing state of the earphone is not worn, controlling the sound playing mode of the electronic apparatus to be an earpiece mode or a speaker mode;

the controlling the electronic apparatus to send a prompt message, comprises:

if the wearing state of the earphone is not worn, controlling the electronic apparatus to send a prompt message for prompting to connect the electronic apparatus with the earphone, and/or, to send a prompt message for prompting a user to wear the earphone, and/or to send a prompt message for prompting a user to switch a sound playing mode of the electronic apparatus.
A device for determining an earphone wearing state, comprising:

an audio signal acquiring module, configured to acquire an audio signal collected by a body conduction audio collecting device of the earphone; and,

a wearing state determining module, configured to determine a wearing state of the earphone, based on an audio signal collected by the body conduction audio collecting device.
A device for controlling an electronic apparatus, comprising:

an earphone wearing state acquiring module, configured to acquire a wearing state of the earphone connected to the electronic apparatus; and,

a processing module, configured to control the electronic apparatus to perform corresponding processing, based on the wearing state of the earphone.
An electronic apparatus comprising:

a processor; and

a memory coupled to the processor,

wherein the memory stores instructions that, when executed by the processor, cause the electronic apparatus to:

acquire an audio signal collected by a body conduction audio collecting device of an earphone, and

determine a wearing state of the earphone, based on the audio signal collected by the body conduction audio collecting device.
An electronic apparatus, comprising: an audio playing device, a body conduction audio collecting device, and a processor;

the audio playing device is for playing an audio signal,

the body conduction audio collecting device is for collecting an audio signal;

the processor is for acquiring an audio signal collected by the body conduction audio collecting device, and determining a wearing state of the earphone, based on the audio signal collected by the body conduction audio collecting device.
A computer readable storage medium, wherein, the storage medium stores a computer program instruction, and when the program instruction being invoked by a processor, the processor executes the method comprising:

acquiring an audio signal collected by a body conduction audio collecting device of an earphone, and

determining a wearing state of the earphone, based on the audio signal collected by the body conduction audio collecting device.