CN110896509A

CN110896509A - Earphone wearing state determining method, electronic equipment control method and electronic equipment

Info

Publication number: CN110896509A
Application number: CN201811069738.8A
Authority: CN
Inventors: 朱恒; 谭璐芬; 王立众; 王维钦; 刘长滔
Original assignee: Beijing Samsung Telecommunications Technology Research Co Ltd; Samsung Electronics Co Ltd
Current assignee: Beijing Samsung Telecom R&D Center; Beijing Samsung Telecommunications Technology Research Co Ltd; Samsung Electronics Co Ltd
Priority date: 2018-09-13
Filing date: 2018-09-13
Publication date: 2020-03-20
Also published as: WO2020055048A1

Abstract

The embodiment of the application provides a method for determining a wearing state of an earphone, a method for controlling electronic equipment and the electronic equipment, wherein the method comprises the following steps: acquiring an audio signal acquired by a body conduction audio acquisition device of the earphone; and determining the wearing state of the earphone based on the audio signal acquired by the body conduction audio acquisition equipment. According to the scheme provided by the embodiment of the application, the detection of the wearing state of the earphone can be realized based on the audio signals collected by the body conduction audio collecting equipment of the earphone, and a new hardware structure is not required to be added.

Description

Earphone wearing state determining method, electronic equipment control method and electronic equipment

Technical Field

The application relates to the technical field of information processing, in particular to a method for determining wearing state of an earphone, a method for controlling electronic equipment and the electronic equipment.

Background

With the continuous improvement of the living demands of people, the earphone is almost a necessity of the living of people. The earphone has a wide application range, and by connecting the earphone with the electronic device, a user can listen to multimedia sound played by the device through the earphone, make a call through the earphone, receive a call and the like.

However, during the use of the headset, the user often encounters the following troubles: when the electronic equipment is wirelessly (such as Bluetooth) connected with the earphone, if the user does not normally wear the earphone on the ear, the user suddenly calls, forgets that the mobile phone of the user is connected with the earphone, and then speaks with the receiver after the telephone is connected, and at this time, the user cannot hear the sound of the other party at all because the sound of the other party is played through the loudspeaker of the earphone. If the user forgets that the electronic equipment of the user is connected with the earphone and the user does not wear the earphone, the user cannot hear the multimedia sound in the mobile phone because the multimedia sound is played through the player of the earphone at the moment. Of course, the bluetooth connection status of the headset to the handset can be viewed on the handset, but the user often forgets or does not know it.

If the user can be judged whether wearing the earphone, corresponding service is provided for the user based on the judgment result, and the practical application requirements of the user can be better met. The existing method for judging the wearing state of the earphone of the user is generally realized by adding a sensor on the earphone, but by adopting the scheme, the hardware structure of the earphone is increased, the waste of hardware resources is caused, and the cost of the earphone is increased.

Disclosure of Invention

The purpose of this application is to solve at least one of the above technical drawbacks, and the technical solution adopted in this application is as follows:

in a first aspect, the present application provides a method for determining a wearing state of an earphone, including:

acquiring an audio signal acquired by a body conduction audio acquisition device of the earphone;

and determining the wearing state of the earphone based on the audio signal acquired by the body conduction audio acquisition equipment.

In a second aspect, the present application provides an electronic device control method, including:

acquiring the wearing state of an earphone connected with electronic equipment;

and controlling the electronic equipment to perform corresponding processing based on the wearing state of the earphone.

In a third aspect, the present application provides an earphone wearing state determination apparatus, including:

the audio signal acquisition module is used for acquiring audio signals acquired by the body conduction audio acquisition equipment of the earphone;

and the wearing state determining module is used for determining the wearing state of the earphone based on the audio signals acquired by the body conduction audio acquisition equipment.

In a fourth aspect, the present application provides an electronic device control apparatus, comprising:

the earphone wearing state acquisition module is used for acquiring the wearing state of an earphone connected with the electronic equipment;

and the processing module is used for controlling the electronic equipment to perform corresponding processing based on the wearing state of the earphone.

In a fifth aspect, the present application provides an electronic device comprising a memory and a processor;

the memory has stored therein computer program instructions that,

a processor for invoking computer program instructions to perform the method as shown in the first or second aspect of the present application.

In a sixth aspect, the present application provides an electronic device comprising an audio playback device, a body conduction audio acquisition device, and a processor;

the audio playing device is used for playing the audio signal;

the body conduction audio acquisition equipment is used for acquiring audio signals;

the processor is used for acquiring the audio signals acquired by the body conduction audio acquisition equipment and determining the wearing state of the electronic equipment based on the audio signals acquired by the body conduction audio acquisition equipment.

In a seventh aspect, the present application provides a computer readable storage medium having computer program instructions stored thereon that, when invoked by a processor, perform the method of the first or second aspect of the present application.

The technical scheme provided by the embodiment of the application has the following beneficial effects: according to the earphone wearing state determining method, the electronic equipment control method and the electronic equipment, whether the user is wearing the earphone can be judged by using the part on the earphone, namely the body conduction audio acquisition equipment, without increasing the hardware structure of the earphone, resources are saved, the cost of the earphone is not increased, and the actual application requirements are met.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings used in the description of the embodiments of the present application will be briefly described below.

Fig. 1 shows a schematic flowchart of a method for determining a wearing state of an earphone according to an embodiment of the present application;

fig. 2 shows a schematic structural diagram of a bone conduction microphone headset in an example of the present application;

fig. 3a is a schematic diagram illustrating a signal energy variation curve of an audio signal collected by a body conduction audio collecting device when a user wears earphones according to an example of the present application;

fig. 3b is a schematic diagram illustrating a signal energy variation curve of an audio signal collected by a body conduction audio collecting device when a user does not wear a headset according to an example of the present application;

FIG. 4a is a schematic diagram illustrating a frequency response curve of an audio signal collected by a body conduction audio collection device and a frequency response curve of an audio signal collected by an air conduction audio collection device when a user wears a headset according to an example of the present application;

FIG. 4b is a schematic diagram illustrating a frequency response curve of an audio signal collected by a body conduction audio collection device and a frequency response curve of an audio signal collected by an air conduction audio collection device when a user is not wearing headphones according to an example of the present application;

fig. 5 is a schematic flowchart illustrating a method for determining a wearing state of an earphone based on a difference between two signal characteristics of an audio signal collected by an inner ear MIC and an audio signal collected by an outer ear MIC in an example of the present application;

FIG. 6a is a schematic diagram illustrating a signal energy profile of an audio signal collected by an air conduction audio collection device when a user wears headphones according to an example of the present application;

FIG. 6b is a schematic diagram illustrating a signal energy profile of an audio signal collected by an air conduction audio collection device when a user is not wearing headphones according to an example of the present application;

fig. 7 is a schematic flow chart illustrating a method for determining a wearing state of an earphone based on a difference between two signal characteristics of an audio signal collected by an inner ear MIC and an audio signal collected by an outer ear MIC in another example of the present application;

fig. 8 is a flowchart illustrating a method for determining a wearing state of an earphone based on a correlation between an audio signal collected by an inner ear MIC and an audio signal collected by an outer ear MIC in an example of the present application;

FIG. 9a is a schematic diagram illustrating the propagation path of an audio signal played by a speaker when a user wears headphones according to an example of the present application;

FIG. 9b is a schematic diagram illustrating the propagation path of an audio signal played by a speaker when a user is not wearing headphones in an example of the present application;

fig. 10 is a flowchart illustrating a method for determining a wearing state of a headset according to a change of a propagation path of an audio signal played by a speaker to a body conduction microphone in an example of the present application;

fig. 11 is a flowchart illustrating a method for determining a wearing state of a headset based on a change in a propagation path of an audio signal played by an audio playing device to a body conduction microphone in another example of the present application;

fig. 12 is a flow chart illustrating a method for determining the wearing state of the headset based on two ways in an example of the present application;

FIG. 13 is a flow chart illustrating a method of determining a wearing state of a headset upon detecting a sound event demand of a user in an example of the present application;

FIG. 14a is a diagram illustrating an example of a user's handset wirelessly connected to a headset via Bluetooth in accordance with the present application;

FIG. 14b is a diagram illustrating a user's voice event requirements in an example of the present application;

fig. 14c is a schematic diagram illustrating an example of the present application in which the electronic device is controlled to perform corresponding processing based on the wearing state of the headset;

fig. 15 is a schematic flow chart illustrating a process of determining whether a user is wearing a headset based on an audio signal collected by an inner ear MIC and an audio signal collected by an outer ear MIC in an example of the present application;

fig. 16 is a schematic flow chart of a method for determining the wearing state of the headset based on the change of the propagation path of the audio signal played by the speaker to the body conduction microphone in another example of the present application;

fig. 17 is a flow chart illustrating a method for determining a wearing state of a headset based on two ways in another example of the present application;

fig. 18 is a schematic structural diagram of an earphone wearing state determining apparatus according to an embodiment of the present application;

fig. 19 is a flowchart illustrating an electronic device control method according to an embodiment of the present application;

fig. 20 is a schematic structural diagram illustrating an electronic device control apparatus according to an embodiment of the present application;

fig. 21 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;

fig. 22 shows a schematic structural diagram of an electronic device provided in an embodiment of the present application.

Detailed Description

Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary only for the purpose of explaining the present application and are not to be construed as limiting the present invention.

As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Further, "connected" or "coupled" as used herein may include wirelessly connected or wirelessly coupled. As used herein, the term "and/or" includes all or any element and all combinations of one or more of the associated listed items.

The following describes the technical solutions of the present application and how to solve the above technical problems with specific embodiments. The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments. Embodiments of the present application will be described below with reference to the accompanying drawings.

Fig. 1 shows a flowchart of a method for determining a wearing state of an earphone according to an embodiment of the present application, where as shown in fig. 1, the method may include:

step S110: acquiring an audio signal acquired by a body conduction audio acquisition device of the earphone;

step S120: and determining the wearing state of the earphone based on the audio signal acquired by the body conduction audio acquisition equipment.

The body conduction audio collecting device is a signal collecting device which collects sound based on changes (such as vibration) of a human body part by contacting a specific part of the human body (for example, the inside of an ear of the human body or a part of a head contacting a bone). Because the body conduction audio acquisition equipment realizes the acquisition of audio signals through the contact with the human body part, when the electronic equipment is connected with the earphone, when a user wears the earphone and does not wear the earphone, the audio signals acquired by the body conduction audio acquisition equipment are different under two conditions, and therefore, the wearing state of the earphone of the user can be determined based on the audio signals acquired by the body conduction audio acquisition equipment of the earphone.

In an alternative embodiment of the present application, the body conduction audio collecting device may be a bone conduction audio collecting device, and the bone conduction audio collecting device is a signal collecting device that collects sound using a bone conduction technique. For bone conduction audio acquisition devices, sound waves are transmitted through the bone to the audio acquisition device.

The execution main body of the method for determining the wearing state of the headset according to the embodiment of the present application may be an electronic device connected to the headset, or may be the headset. When the execution main body is electronic equipment connected with the earphone, the electronic equipment acquires the audio signal acquired by the body conduction audio acquisition equipment from the earphone, and determines the wearing state of the earphone of the user; when the execution main body is the earphone, the processor of the earphone determines the wearing state of the earphone of the user based on the audio signal collected by the body conduction audio collection device of the earphone.

The method for determining the wearing state of the earphone can judge the state of whether the user wears the earphone or not by utilizing the part on the earphone, namely the body conduction audio acquisition equipment, does not need to increase the hardware structure of the earphone, saves resources, does not cause the increase of the cost of the earphone, and can better meet the requirements of practical application.

It should be noted that headphones having a body conduction audio capture device are included in the scope of the headphones of the embodiments of the present application.

In an optional embodiment of the present application, determining the wearing state of the earphone based on the audio signal collected by the body conduction audio collecting device includes at least one of the following manners:

determining the wearing state of the earphone based on the signal characteristics of the audio signals acquired by the body conduction audio acquisition equipment;

determining the wearing state of the earphone based on the audio signals acquired by the body conduction audio acquisition equipment and the audio signals acquired by the air conduction audio acquisition equipment of the earphone;

and determining the wearing state of the earphone based on the audio signal played by the audio playing equipment of the earphone and the audio signal collected by the body conduction audio collecting equipment.

The air conduction audio acquisition equipment is common audio acquisition equipment, and for the air conduction audio acquisition equipment, sound waves are transmitted to the audio acquisition equipment through air. In the embodiment of the application, for convenience of description, the body conduction audio acquisition device is referred to as an inner ear audio acquisition device (MIC) or an inner MIC, and the air conduction audio acquisition device is referred to as an outer ear MIC or an outer MIC.

It should be noted that, specific models of the body conduction audio collecting device and the air conduction audio collecting device in the embodiments of the present application include, but are not limited to, a model or a form of an audio collecting device of an existing common earphone, and in an alternative, the body conduction audio collecting device may be a body conduction microphone, and the air conduction audio collecting device may be an air conduction microphone. Also, the style or form of the audio playing device of the earphone is not limited in the embodiments of the present application, and in an alternative, the audio playing device may be a speaker.

It will be appreciated that in practical applications, the above-mentioned manner of determining the wearing state of the headset of the user can be selected according to practical application requirements and/or the structure of the headset itself. As an example, fig. 2 shows a schematic structure of a bone conduction microphone headset. In the civil field, a bone conduction microphone headset is used in a scene of strong background noise, which includes a bone conduction microphone attached to the skin of the ear, i.e., an inner ear MIC 10, at an ear plug in addition to a speaker 30 possessed by a general headset and an outer ear MIC 20 for collecting local sound. The earplug of the earphone has good sealing performance and can effectively isolate sound outside the ear. Therefore, when the user is in a strong background noise environment, the inner ear MIC replaces or combines the signals collected by the outer ear MIC, so as to obtain clean and clear sound of the local user.

The bone conduction microphone headset shown in fig. 2, which includes an inner ear MIC 10, an outer ear MIC 20 and a speaker 30, may then determine the headset wearing state of the user in any one or more of the above-described manners of determining the headset wearing state of the user. If the earphone itself includes the inner ear MIC and the speaker, but not the outer ear MIC, the wearing state of the earphone of the user may be determined based on at least one signal characteristic of the audio signal collected by the inner ear MIC, and/or based on the audio signal played by the audio playing device of the earphone and the audio signal collected by the body conduction audio collecting device.

In an optional embodiment of the present application, determining the wearing state of the earphone based on the audio signal collected by the body conduction audio collecting device and the audio signal collected by the air conduction audio collecting device of the earphone may include:

determining the wearing state of the earphone based on the difference between the audio signal acquired by the body conduction audio acquisition device and the audio signal acquired by the air conduction audio acquisition device of the earphone;

and/or the presence of a gas in the gas,

determining the wearing state of the earphone based on the correlation between the audio signal acquired by the body conduction audio acquisition equipment and the audio signal acquired by the air conduction audio acquisition equipment;

determining the wearing state of the headset based on the audio signal played by the audio playing device of the headset and the audio signal collected by the body conduction audio collecting device, may include:

the wearing state of the earphone is determined based on the change of the propagation path of the audio signal played by the audio playing device of the earphone to the body conduction audio collecting device.

In an optional embodiment of the present application, determining a wearing state of an earphone based on a signal characteristic of an audio signal collected by a body conduction audio collecting device includes:

determining the wearing state of the earphone of the user based on at least one signal characteristic of the signal characteristics of the audio signals collected by the body conduction audio collecting equipment.

Specifically, at least one signal characteristic of the audio signal acquired by the body conduction audio acquisition device may be compared with a corresponding first threshold, and the wearing state of the headset may be determined according to the comparison result.

In the mode, the wearing state of the earphone can be determined according to the signal characteristics of the speaking voice of the local user, which is acquired by the body conduction audio acquisition equipment. When a user speaks, whether the earphone is worn on the ear of the user or not is judged, and the signal characteristics of the audio signals collected by the inner ear MIC are obviously different, so that whether the user wears the earphone or not can be determined according to the comparison result of the signal characteristics of the audio signals collected by the inner ear MIC and the first threshold corresponding to the signal characteristics.

The signal characteristics of the audio signal include, but are not limited to, signal energy characteristics and signal frequency characteristics of the audio signal. The first threshold corresponding to the signal energy characteristic and the first threshold corresponding to the signal frequency characteristic may be determined according to actual needs, for example, may be determined according to empirical values and/or experimental values.

As an example, fig. 3a and 3b respectively show experimental results of energy curves of audio signals collected by an inner ear MIC when a user is speaking, i.e. can detect a local user's voice, when the user is wearing a headset and when the user is not wearing the headset, i.e. curves of signal amplitude changes with time, wherein an abscissa represents time in seconds(s) and an ordinate represents signal strength, i.e. energy amplitude, in decibels (dB). As can be seen from the figure, the energy characteristics of the audio signal collected by the inner ear MIC are clearly different when the headset is worn and when it is not worn, and the signal energy collected by the inner ear MIC when it is worn on the user's ear is much greater than the signal energy collected when it is not worn on the user's ear. Therefore, the wearing state of the headset of the user can be determined based on the signal energy characteristics of the audio signal collected by the inner ear MIC.

In an optional embodiment of the present application, when determining the wearing state of the earphone based on the signal energy characteristic of the audio signal collected by the inner ear MIC, the determining may specifically include:

and if the signal energy value of the audio signal acquired by the inner ear MIC is not greater than the first threshold value corresponding to the signal energy characteristic, determining that the wearing state of the earphone is not worn.

It should be noted that, in practical application, the signal energy value generally refers to the energy of a signal within a set time duration, and specifically may be an average value of all signal intensities within the set time duration, a sum of all signal intensities within the set time duration, or a logarithmic calculation performed on all signal intensities within the set time duration. When the signal energy value is the mean value, the sum, or the logarithm value of the signal intensity of the signal in a set time length, the comparison between the signal energy value of the audio signal acquired by the inner ear MIC and the first threshold value corresponding to the signal energy characteristic is the comparison between the mean value, the sum, or the logarithm value and the first threshold value corresponding to the signal energy characteristic.

As an example, curves a1 and a2 in fig. 4a and 4b show graphs of experimental results of frequency response curves of audio signals collected by the inner ear MIC when the user is speaking, when the user is wearing headphones, and when the user is not wearing headphones, respectively, wherein the abscissa represents frequency in Hertz (HZ) and the ordinate represents loudness of the signals, i.e., signal strength, in decibels (dB). As can be seen from the figure, when the earphone is worn on the ear of the user, the low-frequency signal of the audio signal collected by the inner ear MIC is strong, the high-frequency signal component is rapidly attenuated, and when the earphone is not worn on the ear of the user, almost no signal is collected by the inner ear MIC. Therefore, the judgment of the wearing state of the earphone of the user can be realized based on the signal frequency characteristics of the audio signal collected by the inner ear MIC.

In an optional embodiment of the present application, determining a wearing state of an earphone based on a signal frequency characteristic of an audio signal collected by a body conduction audio collecting device may specifically include:

if the frequency width corresponding to the frequency with the signal intensity being greater than the signal intensity threshold value is greater than the first threshold value corresponding to the signal frequency characteristic in the audio signals collected by the body conduction audio collecting device, the wearing state of the earphone is determined to be worn, and if the frequency width corresponding to the frequency with the signal intensity being greater than the signal intensity threshold value is not greater than the first threshold value corresponding to the signal frequency characteristic, the wearing state of the earphone is determined to be unworn.

As a specific example, for the curves a1 and a2 shown in fig. 4a and 4b, the first threshold corresponding to the signal frequency characteristic may be set to 1000HZ, the signal strength threshold may be set to-108 dB, and the frequency width corresponding to the frequency of the audio signal corresponding to the curve a1 in fig. 4a, in which the signal strength is greater than-108 dB, is about 4000HZ and greater than the first threshold 1000HZ, so that the user wears the headset at this time. The frequency width corresponding to the frequency at which the signal strength of the audio signal corresponding to curve a2 in fig. 4b is greater than-108 dB is about 0, less than the first threshold 1000HZ, and therefore the user does not wear the headset.

In an optional embodiment of the present application, determining a wearing state of an earphone of a user based on a signal energy characteristic and a signal frequency characteristic of an audio signal collected by a body conduction audio collecting device may specifically include:

the wearing state of the earphone is determined to be wearing based on the signal energy characteristics of the audio signals collected by the body conduction audio collecting device, and/or the wearing state of the earphone is determined to be wearing when the wearing state of the earphone is determined to be wearing based on the signal frequency characteristics of the audio signals collected by the body conduction audio collecting device.

That is to say, when determining the wearing state of the earphone based on the signal energy characteristic and the signal frequency characteristic of the audio signal acquired by the MIC of the inner ear, the wearing state of the earphone may be determined as wearing when determining that the wearing state of the earphone is wearing based on any signal characteristic, that is, the wearing state of the earphone is wearing, or the wearing state of the earphone may be determined as wearing only when determining that the wearing state of the earphone is wearing based on both signal characteristics. In practical application, a specific determination mode can be selected according to application requirements.

In an optional embodiment of the present application, determining a wearing state of the earphone based on a difference between an audio signal collected by the body conduction audio collecting device and an audio signal collected by the air conduction audio collecting device of the earphone includes:

and acquiring the difference between the signal characteristics of the audio signals acquired by the body conduction audio acquisition equipment and the signal characteristics of the audio signals acquired by the air conduction audio acquisition equipment, comparing the difference with a second threshold value, and determining the wearing state of the earphone according to the comparison result.

As can be seen from the foregoing description, the signal characteristics include signal energy characteristics and/or signal frequency characteristics. The second threshold value corresponding to the signal characteristic may be determined based on empirical and/or experimental values.

As can be seen from the foregoing description, when a user speaks, and the user wears the earphone and does not wear the earphone, the difference between the signal characteristics of the audio signal collected by the inner ear MIC and the audio signal collected by the outer ear MIC is obviously different. Compared with the inner ear MIC, the difference in signal characteristics of an audio signal collected by the outer ear MIC is small between when a user wears the earphone and when the user does not wear the earphone. Therefore, the wearing state of the headphone can be determined by the result of comparison of the difference between the signal characteristic of the audio signal collected by the inner ear MIC and the signal characteristic of the audio signal collected by the outer ear MIC with the second threshold value.

As an example, fig. 5 is a flowchart illustrating a method for determining a wearing state of an earphone based on a difference between signal characteristics of an audio signal collected by an inner ear MIC and an audio signal collected by an outer ear MCI. As shown in the drawing, the inner ear MIC and the outer ear MIC collect sounds respectively, a difference in signal characteristics of the audio signals collected by the two MICs (a characteristic shown in the drawing to detect a difference between the inner and outer MIC signals) is obtained based on the audio signals collected by the inner ear MIC and the outer ear MIC, and the wearing state of the earphone is determined according to the comparison result by comparing the characteristic of the difference between the detected inner and outer MIC signals with a corresponding second threshold (a characteristic shown in the drawing to detect a difference between the inner and outer MIC when the earphone is worn or not worn) (a detection characteristic shown in the drawing is changed).

In an alternative embodiment of the present application, when the signal characteristic is an energy signal characteristic, the comparing the difference with a second threshold, and determining the wearing state of the earphone according to the comparison result may include:

and comparing the difference between the signal energy value of the audio signal acquired by the body conduction audio acquisition equipment and the signal energy value of the audio signal acquired by the air conduction audio acquisition equipment with a second threshold corresponding to the signal energy characteristic, if the difference is not less than the corresponding second threshold, determining that the wearing state of the earphone is not worn, and if the difference is less than the corresponding second threshold, determining that the wearing state of the earphone is worn.

As an example, fig. 6a and 6b are schematic diagrams illustrating experimental results of energy characteristics of an audio signal collected by an external ear MIC when a user is speaking, the user is wearing a headset, and the user is not wearing the headset, respectively, wherein an abscissa represents time in s and an ordinate represents intensity of the signal in dB. As can be seen from the figure, for the outer ear MIC, the signal energy collected when the outer ear MIC is worn on the user's ear and the signal energy collected when the outer ear MIC is not worn on the user's ear are not much different. As can be seen from fig. 3a and 3b, the energy of the collected sound signal when the inner ear MIC is worn on the user's ear is much larger than the energy of the collected sound signal when the earphone is not worn on the user's ear. Therefore, the difference between the signal energy characteristics of the audio signal collected by the inner ear MIC and the signal energy characteristics of the audio signal collected by the outer ear MIC when the user wears the headphone should be smaller than when not wearing the headphone.

In an alternative embodiment of the present application, when the signal characteristic is a signal frequency characteristic, the comparing the difference with a second threshold, and determining the wearing state of the earphone according to the comparison result may include:

comparing the frequency width corresponding to the frequency with which the signal intensity in the audio signal acquired by the body conduction audio acquisition equipment is greater than the signal intensity threshold value with the difference between the frequency width corresponding to the frequency with which the signal intensity in the audio signal acquired by the air conduction audio acquisition equipment is greater than the signal intensity threshold value with a second threshold value corresponding to the signal frequency characteristic, if the difference is less than the corresponding second threshold value, determining that the wearing state of the earphone is wearing, and if the difference is not less than the corresponding second threshold value, determining that the wearing state of the earphone is not wearing.

As an example, curves B1 and B2 in fig. 4a and 4B show graphs of experimental results of frequency response curves of audio signals collected by an outer ear MIC when a user is speaking, when the user is wearing headphones, and when the user is not wearing headphones, respectively, where the abscissa represents frequency in HZ and the ordinate represents loudness of the signals, i.e., signal strength, in dB. Comparing the curve a1 and the curve B1, it can be seen that when the earphone is worn on the ear of the user, the low-frequency signal of the inner ear MIC is stronger than that of the outer ear MIC, but the high-frequency signal component is attenuated rapidly, and the frequency component of the signal collected by the outer ear MIC is relatively intact. Comparing the curve a2 and the curve B2, it can be seen that when the earphone is not worn on the user's ear, almost no signal is collected by the inner ear MIC, but the outer ear MIC can normally collect the user's voice, and the frequency components are still intact. Therefore, when the user wears the earphone, the difference between the signal frequency characteristic of the audio signal collected by the inner ear MIC and the signal frequency characteristic of the audio signal collected by the outer ear MIC should be smaller than the difference when the user does not wear the earphone.

In an alternative embodiment of the present application, when the signal characteristic is a signal energy characteristic and a signal frequency characteristic, the comparing the difference with a second threshold, and determining the wearing state of the headset according to the comparison result may include:

and/or determining that the wearing state of the earphone is wearing according to a comparison result of the difference between the signal energy characteristics of the audio signals collected by the body conduction audio collecting device and the signal energy characteristics of the audio signals collected by the air conduction audio collecting device and a second threshold corresponding to the signal energy characteristics, and/or determining that the wearing state of the earphone is wearing according to a comparison result of the difference between the signal frequency characteristics of the audio signals collected by the body conduction audio collecting device and the signal frequency characteristics of the audio signals collected by the air conduction audio collecting device and a second threshold corresponding to the signal frequency characteristics.

That is to say, when determining the wearing state of the headset of the user based on the difference between the signal energy characteristics and the difference between the signal frequency characteristics, the wearing state of the headset may be determined as wearing when determining that the wearing state of the headset is wearing based on the difference between any one of the signal characteristics, or the wearing state of the headset may be determined as wearing when determining that the wearing state of the headset of the user is wearing the headset based on the difference between both the signal characteristics. It can be seen that, in practical applications, the wearing state of the headset can also be detected by jointly using the differences of the multiple signal characteristics.

As an example, fig. 7 shows a schematic flow chart of determining the wearing state of the earphone by combining the difference between the signal energy characteristic of the audio signal collected by the inner ear MIC and the signal energy characteristic of the audio signal collected by the outer ear MIC and the difference between the signal frequency characteristics of the audio signals collected by the two MICs, as shown in the figure, the user speaking detection can be performed by using the outer ear MIC, the difference between the signal energy characteristics of the audio signals collected by the two MICs (the sound energy difference shown in the figure) and the difference between the signal frequency characteristics of the audio signals collected by the two MICs (the sound frequency width difference shown in the figure, which may also be referred to as a spectrum width difference) are calculated, and based on the comparison result of the threshold value (the empirical value shown in the figure) corresponding to the sound energy difference and the signal frequency characteristics and the comparison result of the threshold value (the empirical value shown in the figure) corresponding to the spectrum width difference and the signal frequency characteristics, and determining the wearing state of the earphone. As can be seen from the figure, when the spectral width difference is smaller than the empirical value and the energy difference is smaller than the empirical value, it is determined that the user is wearing the headset, that is, in this example, it is determined that the user is wearing the headset when it is determined that the user is wearing the headset based on the sound energy difference and it is also determined that the user is wearing the headset based on the spectral width difference.

In an optional embodiment of the present application, determining a wearing state of the earphone based on a correlation between an audio signal collected by the body conduction audio collecting device and an audio signal collected by the air conduction audio collecting device may include:

and calculating the correlation between the audio signal acquired by the body conduction audio acquisition equipment and the audio signal acquired by the air conduction audio acquisition equipment, comparing the calculated correlation with a third threshold value, and determining the wearing state of the earphone according to the comparison result.

As can be seen from the foregoing description, for the outer ear MIC, the signal components collected when the user wears the earphone and does not wear the earphone are complete, so that it is possible to detect local sound using the outer MIC, and when sound is detected, calculate the correlation between the audio signal collected by the inner ear MIC and the audio signal collected by the outer ear MIC, which is much larger than the value when the user wears the earphone. Therefore, the wearing state of the headphone can be determined from the result of the comparison of the correlation with the third threshold.

As an example, fig. 8 is a schematic flow chart illustrating a process of determining a wearing state of an earphone according to a correlation between an audio signal collected by a body conduction audio collecting device and an audio signal collected by an air conduction audio collecting device, where as shown in the drawing, a user utterance detection is performed by using an outer ear MIC, audio signals are collected by an inner ear MIC and an outer ear MIC, respectively, and after the audio signal collected by the inner ear MIC and the audio signal collected by the outer ear MIC are obtained, a correlation between the two audio signals is calculated, and if the calculated correlation is greater than a threshold (in this example, the threshold may be an empirical value shown in the drawing), it may be determined that the user is wearing the earphone, and if the calculated correlation is not greater than the empirical value, it may be determined that the user is not wearing the earphone.

In practical application, a specific calculation mode of the correlation between the audio signal collected by the inner ear MIC and the audio signal collected by the outer ear MIC may be selected or configured as required, and the specific calculation mode of the correlation is not limited in the embodiment of the present application.

In an optional embodiment of the present application, determining a wearing state of the earphone based on a change of a propagation path of an audio signal played by an audio playing device of the earphone to a body conduction audio collecting device may include:

estimating the propagation path characteristics of the audio signals played by the audio playing device to reach the body conduction audio collecting device according to the audio signals played by the audio playing device of the earphone and the audio signals collected by the body conduction audio collecting device, acquiring the difference between the estimated propagation path characteristics and the preset propagation path characteristics, comparing the difference with a fourth threshold value, and determining the wearing state of the earphone according to the comparison result.

In this manner, sound is played by an audio playback device and collected by the inner ear MIC. As an example, in this example, a bone conduction microphone and a speaker are taken as an example for explanation, and fig. 9a shows a schematic diagram of a propagation path of an audio signal played by the speaker to reach the bone conduction microphone when a user wears an earphone. As shown in fig. 9a, when the earphone is worn on the ear of the user, the sound emitted from the speaker a propagates in the ear canal and is reflected in the skin of the inner ear, and the inner ear MIC b is attached to the skin of the inner ear, so that the vibration of the sound is collected, and the sound leakage of the apparatus itself is also collected, such as a line pointed at c in the figure and a line intersecting d, which indicate the reflection path of the sound emitted from the speaker c in the skin of the inner ear, and a line pointed at d indicates the propagation path of the sound emitted from the speaker c in the ear canal. When the headset is not worn on the user's ear, for example on a table, as shown in fig. 9b for an example, the inner ear MIC picks up only the device sound leakage e and almost negligible vibrations g from the table. In other words, when the user wears the headphone and does not wear the headphone, the sound played by the speaker reaches the inner ear MIC via different propagation paths. We can detect whether the user is wearing the headset by detecting a change in the propagation path of the sound signal played by the speaker to the inner ear MIC.

As an example, a flow chart for determining the wearing state of the headset based on the change of the propagation path of the audio signal played by the speaker of the headset to the body-conduction audio capturing device is shown in fig. 10. As shown in the drawing, when a sound, that is, an audio signal is played by a speaker, an inner ear MIC collects the sound, a characteristic of a sound propagation path through which the audio signal played by the speaker reaches the inner ear MIC can be estimated from the sound played by the speaker and the sound collected by the inner ear MIC, by comparing a difference between the estimated sound propagation path characteristic and a predetermined propagation path characteristic (a characteristic of the sound propagation path when the earphone is worn shown in the drawing) with a fourth threshold value, and by finding whether the estimated sound propagation path characteristic and the predetermined sound propagation path when the earphone is worn have changed or not from a comparison result (a detected path change shown in the drawing), since the predetermined propagation path characteristic is the sound propagation path characteristic when the earphone is worn, it can be determined that the user does not wear the earphone if the path has changed, if the path has not changed, it may be determined that the user is wearing the headset.

It is understood that, in practical applications, the detection of whether the path has changed is based on the comparison result of the difference between the estimated sound propagation path characteristic and the predetermined sound propagation path when the user wears the headphone and the fourth threshold, for example, based on the example shown in fig. 10, the predetermined sound propagation path characteristic is the sound propagation path characteristic when the user wears the headphone, and at this time, if the difference is greater than the fourth threshold, it is determined that the user does not wear the headphone, and if the difference is not greater than the fourth threshold, it is determined that the user wears the headphone.

In practical applications, the predetermined propagation path characteristic may be a predetermined propagation path characteristic when the user wears the earphone, or a predetermined propagation path characteristic when the user does not wear the earphone. For example, in the example shown in fig. 10, if the feature of the sound propagation path when the headphone is worn is replaced with the feature of the sound propagation path when the headphone is not worn, it is determined that the user wears the headphone when the difference of the estimated sound propagation path feature from the predetermined sound propagation path when the headphone is worn is larger than the fourth threshold, and if the difference is not larger than the set value, it is determined that the user does not wear the headphone.

In an alternative, the estimation of the propagation path of the sound signal may be implemented by using an adaptive filter, for example, as shown in fig. 11, the propagation path of the audio signal played by the audio playing device may be represented as a system, and the system may be represented by the adaptive filter, and the sound propagation path is the path from the audio playing device to the inner ear MIC. As shown in fig. 11, the adaptive filter is an estimated propagation path, and in this example, the adaptive filter is used to estimate propagation path characteristics of an audio signal collected by an inner ear MIC reaching the inner ear MIC. The audio signal played by the audio playing device may be represented by a discrete-time signal sequence, such as x (n) shown in the figure, i.e. the discrete-time signal, where n is an integer and represents a serial number of the discrete-time signal in the discrete-time signal sequence. Estimating the propagation path characteristic of the signal played by the audio playing device to reach the body conduction audio acquisition device according to the signal x (n) played by the audio playing device and the signal d (n) actually acquired by the inner ear MIC when the audio playing device plays the signal x (n), in this example, the propagation path characteristic may be a filter coefficient calculated by an adaptive filter, calculating the difference between the estimated propagation path characteristic (shown in the figure as the filter system response of the calculated adaptive filter) and a predetermined propagation path characteristic (shown in the figure as the empirical value of the system), in this example, the predetermined propagation path characteristic is the propagation path characteristic when the user wears the headphone, if the calculated difference is greater than a fourth threshold value (shown in the figure as the empirical value), determining that the user does not wear the headphone, if the calculated difference is not greater than the fourth threshold value, the user is wearing a headset.

It is understood that, in practical applications, when predicting the audio signal reaching the inner ear MIC by the adaptive filter, an adaptive algorithm (the updated adaptive filter shown in fig. 11) such as a minimum mean square error adaptive filter algorithm may be configured, and the adaptive filter is updated by continuously updating the time-varying coefficients of the adaptive filter, i.e., calculating the adaptive filter coefficients in real time, based on the input signal of the adaptive filter, i.e., the audio signal x (n) played by the audio playing device, and the difference e (n) between the estimated audio signal x '(n) reaching the inner ear MIC and the audio signal d (n) actually reaching the inner ear MIC, so as to minimize the difference e (n) between the estimated audio signal x' (n) reaching the inner ear MIC and the audio signal d (n) actually reaching the inner ear MIC.

In an optional embodiment of the present application, when determining the wearing state of the headset of the user based on at least two ways, the method may further include:

and if the wearing state of the earphone of the user is determined to be not wearing the earphone based on at least one of the at least two types, determining that the wearing state of the earphone of the user is not wearing the earphone.

As an example, as shown in fig. 12, a flow diagram of a manner of determining whether a user is wearing a headphone or not by using a difference of audio signals collected at an outer ear MIC of audio signals collected by an inner ear MIC and a signal of a speaker (a change of a propagation path of an audio signal played by an audio playing device to a body conduction audio collecting device), that is, by jointly detecting a local user sound and detecting a sound path change to determine whether a user is wearing a headphone or not.

As shown in fig. 12, the inner ear MIC and the outer ear MIC detect local sounds, that is, sounds spoken by a local user, respectively, and determine whether the user wears the headset based on a difference between audio signals collected by the outer ear MIC of audio signals collected by the inner ear MIC. The inner ear MIC collects an audio signal played by a speaker, estimates a propagation path characteristic that the audio signal played by the speaker reaches the inner ear MIC based on the audio signal played by the speaker collected by the inner ear MIC and the audio signal played by the speaker, and determines whether the user wears an earphone based on a difference (a detection sound path change shown in the figure) between the estimated propagation path characteristic and a predetermined propagation path characteristic. When it is detected that the user does not wear the headset in any of the two manners (as detected by any of the methods shown in the figures.

In an optional embodiment of the present application, before determining the wearing state of the earphone, the method further includes, based on the audio signal collected by the body conduction audio collecting device:

a voice event demand of a user is detected.

The method for determining the wearing state of the earphone can be used for starting the detection of the wearing state of the earphone of the user when the requirement of the sound event of the user is detected, namely the requirement that the user needs to use the earphone is detected. That is, it is possible to determine whether or not the user wears the headphone, and thus it is possible to reduce the consumption of resources for detecting the wearing state of the headphone by the electronic device or the headphone. Based on the scheme, the wearing state of the earphone does not need to be detected in real time, and the wearing state of the earphone can be determined when the user needs to use the earphone, so that the user is assisted to smoothly use the earphone.

In an alternative aspect of the present application, the user's voice event requirements include voice event requirements triggered by the user and/or voice event requirements of the triggered user. The sound event requirements include listening requirements and/or speaking requirements.

The voice event requirement triggered by the user corresponds to the voice event requirement of the triggered user, and refers to the voice event requirement actively triggered by the user, i.e. driven by the event that the user uses the electronic device, for example, the user makes a call, the MIC and the audio playing device are needed, and the user listens to music and needs the audio playing device. As another example, when a call is made, the user needs to communicate with the person making the call, which is the voice event requirement of the user, but the requirement is triggered by the person making the call, which is the voice event requirement of the triggered user. It is equivalent to detecting an event requiring the use of the headset when the user actively or passively turns on an application requiring the use of the headset. The event that detects whether the headset is normally worn by the user is driven by the event.

As an example, fig. 13 is a flowchart illustrating a method for determining a wearing state of an earphone, and as shown in the drawing, when the earphone is connected to an electronic terminal through bluetooth, if it is detected that a user actively or passively starts an application that needs to use the earphone, the method may start to acquire an audio signal acquired by a body conduction audio acquisition device of the earphone, and detect whether the earphone is normally worn by the user based on the acquired audio signal.

Specifically, as shown in fig. 14a, when the earphone of the user and the electronic terminal are in a state of wireless connection via bluetooth, if a requirement of a sound event, including an event requirement of listening to sound by the local user, an event requirement of acquiring sound of the local user, or both of the event requirements of listening to sound by the local user and the local user, such as a sound event requirement of listening and speaking corresponding to making a call or a sound event requirement of listening to music only, as shown in fig. 14b, is detected, the device automatically detects whether the earphone is worn on the ear of the user at the time, and if the device is worn, the earphone mode is used to acquire or play sound, that is, the acoustic device on the earphone is used to acquire or play sound; if it is detected that the user does not wear the headset at this time, the device automatically switches to a handheld mode or a speaker mode, that is, sound is collected or played by an acoustic device on the electronic device, or the user is prompted to use the headset mode by way of prompting the user, as shown in fig. 14 c. The automatic switching or reminding mode can be set in advance according to the user, or a mode of reminding first and then switching is adopted.

In an optional embodiment of the present application, after determining the wearing state of the headset of the user, the method further includes:

and controlling the electronic equipment connected with the earphone to perform corresponding processing based on the wearing state of the earphone.

In this alternative, after the wearing state of the headset of the user is determined, the electronic device connected with the headset may be controlled to perform corresponding processing based on the determined wearing state of the headset.

In an optional embodiment of the present application, controlling the electronic device connected to the headset to perform corresponding processing may include at least one of:

controlling a sound playing mode of the electronic equipment;

controlling the electronic equipment to send prompt information;

controlling the state of an application on the electronic device.

For example, when it is determined that the wearing state of the earphone with the user is not wearing the earphone, the sound playing mode of the electronic device may be controlled to be speaker playing or earphone playing, that is, the sound is played by the speaker or the earphone of the electronic terminal, and a prompt message may be sent to the user through the electronic device to prompt the current connection state of the earphone of the user.

It is understood that the specific form of the prompt message may be set according to actual needs, and may include, but is not limited to, text, voice, indicator light, and the like. For example, the prompt information may be a prompt message for prompting the user that the electronic device is connected to an earphone, a prompt message for prompting the user to wear an earphone, a prompt message for prompting the user to switch a sound playing mode of a mobile phone, and the like.

Controlling the state of the application on the electronic device may include, but is not limited to, controlling the running state of the application to be a paused or muted state, or closing the application, etc. For example, when a user wants to play a multimedia file through an application program related to the multimedia file on the electronic device, if the wearing state of the headset is detected as not worn, the application program can be controlled to be paused or closed.

As can be seen from the foregoing description, the execution subject of the headset wearing state determination method of the present application may be an electronic device connected to a headset, or may be a headset. When the execution main body is the electronic equipment connected with the earphone, the electronic equipment can directly control the sound playing mode of the electronic equipment and/or send corresponding prompt information to a user; when the execution main body is the earphone, after the earphone determines the wearing state of the earphone of the user, the earphone can send a corresponding control instruction to the electronic equipment, the sound playing mode of the electronic equipment is controlled through the control instruction, and/or corresponding prompt information is sent to the user, or the determined wearing state of the earphone can be sent to the electronic equipment, so that the electronic equipment can control the electronic equipment to perform corresponding processing according to the wearing state of the earphone.

In the embodiment of the application, the electronic device is connected with the earphone, and may be in wireless connection, such as bluetooth connection, or in wired connection. When the electronic device is wirelessly connected with the earphone, the user often forgets the connection state of the electronic device and the earphone, which causes inconvenience in use. When the electronic device is connected to the earphone in a wired manner, the user needs to pull the earphone from the electronic device first when the user wants to use the speaker mode, which is the external playing mode of the electronic device, and the user is also inconvenienced. By adopting the scheme provided by the application, the sound playing mode of the terminal equipment can be controlled according to the wearing state of the earphone after the wearing state of the earphone is determined, and the inconvenience in use of the user is solved.

As an example, fig. 15 shows a schematic flow chart of detecting whether a user is wearing a headset by using an audio signal collected by an inner ear MIC and an audio signal collected by an outer ear MIC, that is, determining whether the user is wearing the headset by detecting a local user sound, where the detection based on the local sound may be a first sentence of speech when the user turns on the telephone. For example, when an electronic terminal (e.g., a mobile phone) of a user and an earphone are wirelessly connected, that is, when the electronic terminal is in an earphone mode, if the user makes a call by himself, the mobile phone detects a sound event requirement of the user, starts a detection on whether the earphone is normally worn, detects a wearing state of the earphone based on a difference between audio signals collected by an inner ear MIC and an outer ear MIC when the user speaks (when the user generally speaks "feeding" when the user makes a call), and when it is detected that the earphone is not worn, may control the mobile phone to switch to a handheld mode or a speaker mode, or prompt the user to talk in the earphone mode.

In practical application, the determination of the wearing state of the earphone can be realized by combining with a voice instruction of a user. For example when the user's handset and headset are being connected via bluetooth. The user sends a voice instruction 'i want to listen to a song' to the mobile phone, and whether the earphone is normally worn is detected through the difference between the audio signal collected by the inner ear MIC and the audio signal collected by the outer ear MIC of the earphone.

As an example, a method of detecting whether a user is wearing a headphone using an audio signal played by a speaker and an audio signal collected by an inner ear MIC, that is, determining a wearing state of the headphone based on a change in a propagation path of the audio signal played by the speaker to the inner ear MIC, is shown in fig. 16. For example, at this time, an electronic terminal (e.g., a mobile phone) of a user and an earphone are connected in a wireless manner, and at this time, the user opens a music player to listen to music or the mobile phone comes on the phone, and then after detecting the sound event requirement of the user, the detection whether the earphone is normally worn may be started, and the wearing state of the earphone is determined based on the change of the propagation path of the audio signal played by the speaker to reach the inner ear MIC. At this time, the sound played by the speaker may be the content played by the music player or the incoming call ringtone. The sound of the speaker required for detection may come from the sound played by the player itself. When detecting that the earphone is not worn, the mobile phone can be controlled to be switched to a handheld mode or a loudspeaker mode, or a user is prompted to use the earphone mode to carry out conversation.

As an example, fig. 17 shows a schematic flow chart of determining a wearing state of an earphone by using a difference between an audio signal collected by an inner ear MIC and an audio signal collected by an outer ear MIC (a detection path of a user sound shown in the figure) and a change of a propagation path of an audio signal played by a speaker to the inner ear MIC (a detection path of a sound propagation path in the figure), that is, detecting a local user sound and detecting a sound path change to determine whether the user is wearing the earphone. In this example, an event is detected in which the user places or receives a call, for example, two detection methods may be initiated, that is, in the channel uplink (channel from the terminal device to the earphone), that is, the transmitting end, the audio signals collected by the inner ear MIC and the outer ear MIC are obtained by using the detection of the user's voice, the transmitting end processes the audio signals collected by the two MICs, encodes and outputs the processing result, and in the channel downlink (channel from the earphone to the electronic device), namely, the receiving end, the sound played by the loudspeaker is decoded and processed by the receiving end to be output after signal processing by using the detection of the sound propagation path change, the wearing state of the earphone is determined by detecting the change of a propagation path of an audio signal played by a loudspeaker to reach an inner ear MIC, and the user is reminded or the mode is automatically switched when the condition that the user does not wear the earphone is detected in any mode.

It should be noted that, for the speaking requirement, that is, the requirement for acquiring a signal by the MIC, the earphone usually uses the external MIC to acquire a local sound, however, the external MIC is not sensitive to the distance, that is, whether the user wears the earphone or not, the external MIC can acquire the local sound, so that, for the speaking requirement only, in the practical application, it may not be necessary to detect whether the earphone is being worn or not.

The embodiment of the present application also provides an earphone wearing state determining apparatus, as shown in fig. 18, the earphone wearing state determining apparatus 100 may include an audio signal acquiring module 110 and a wearing state determining module 120. Wherein:

the audio signal acquisition module 110 is configured to acquire an audio signal acquired by a body conduction audio acquisition device of an earphone;

the wearing state determining module 120 is configured to determine a wearing state of the headset based on the audio signal acquired by the bone conduction audio acquisition device.

In this embodiment of the application, when determining the wearing state of the earphone based on the audio signal acquired by the body conduction audio acquisition device, the wearing state determination module 120 is specifically configured to determine the wearing state of the earphone by using at least one of the following manners:

In an optional implementation manner of the embodiment of the application, when determining the wearing state of the earphone based on the audio signal collected by the body conduction audio collecting device and the audio signal collected by the air conduction audio collecting device of the earphone, the wearing state determining module 120 may specifically be configured to:

determining the wearing state of the earphone based on the difference between the audio signal acquired by the body conduction audio acquisition device and the audio signal acquired by the air conduction audio acquisition device of the earphone; and/or;

when determining the wearing state of the earphone based on the audio signal played by the audio playing device of the earphone and the audio signal collected by the body conduction audio collecting device, the wearing state determining module 120 may be specifically configured to:

It can be understood that each module of the earphone wearing state determination apparatus in the embodiment of the present application may have a function of implementing a corresponding step in the earphone wearing state determination method shown in the embodiment of the present application. The functions may be implemented by hardware, or may be implemented by hardware executing corresponding software. The modules can be software and/or hardware, and can be implemented individually or by integrating a plurality of modules. For the functional description of each module of the earphone wearing state determining apparatus, reference may be made to the corresponding description in the earphone wearing state determining method, which is not described herein again.

In addition, the earphone wearing state determining device of the embodiment of the application can be operated in electronic equipment or earphones according to actual application scenes in actual application.

An embodiment of the present application further provides an electronic device control method, as shown in fig. 19, where the control method may include:

step S210: acquiring the wearing state of an earphone connected with electronic equipment;

step S220: and controlling the electronic equipment to perform corresponding processing based on the wearing state of the earphone.

The electronic equipment control method can control the electronic equipment to perform corresponding processing based on the wearing state of the earphone, so that the earphone wearing state based on the user is achieved, corresponding service is provided for the user, and the actual application requirements of the user are better met.

The execution main body of the electronic device control method according to the embodiment of the present application may be an electronic device connected to a headset, or may be a headset. Specifically, when the execution main body is the electronic device connected to the earphone, the electronic device may directly control the electronic device to perform corresponding processing according to the wearing state of the earphone after acquiring the wearing state of the earphone. When the execution main body is the earphone, after the wearing state of the earphone is acquired, the earphone can send a corresponding control instruction to the electronic device based on the wearing state of the earphone, and the electronic device is controlled to perform corresponding processing through the control instruction, or the determined wearing state of the earphone can be sent to the electronic device, so that the electronic device can control the electronic device to perform corresponding processing according to the wearing state of the earphone.

In the electronic device control method according to the embodiment of the present application, the specific implementation of obtaining the wearing state of the headset connected to the electronic device may be the wearing state of the headset obtained by using the headset wearing state determining method provided in any embodiment of the present application.

In an optional embodiment of the present application, the controlling the electronic device to perform corresponding processing includes:

controlling the sound playing mode of the electronic equipment and/or controlling the electronic equipment to send out prompt information.

Specifically, controlling the sound playing mode of the electronic device may include:

when the wearing mode of the earphone is not wearing, controlling the sound playing mode of the electronic equipment to be an earphone mode or a loudspeaker mode;

controlling the electronic device to issue the prompt message may include:

when the wearing mode of the earphone is not wearing, the electronic equipment is controlled to send out prompt information for prompting the electronic equipment to be connected with the earphone, and/or send out prompt information for prompting a user to wear the earphone, and/or send out prompt information for prompting the user to switch the sound playing mode of the electronic equipment.

Corresponding to the electronic device control method shown in fig. 19, an embodiment of the present application further provides an electronic device control apparatus, as shown in fig. 20, the electronic device control apparatus 200 may include a headset wearing state acquisition module 210 and a processing module 220. Wherein:

the earphone wearing state acquiring module 210 is configured to acquire a wearing state of an earphone connected to the electronic device;

and the processing module 220 is configured to control the electronic device to perform corresponding processing based on the wearing state of the headset.

Each module of the electronic device control apparatus according to the embodiment of the present application may have a function of implementing a corresponding step in the electronic device control method shown in the embodiment of the present application. The functions may be implemented by hardware, or may be implemented by hardware executing corresponding software. The modules can be software and/or hardware, and can be implemented individually or by integrating a plurality of modules. For the functional description of each module of the electronic device control apparatus, reference may be made to the corresponding description in the electronic device control method, which is not described herein again.

An electronic device is further provided in the embodiments of the present application, as shown in fig. 21, the electronic device 300 may include an audio playing device 310, a body conduction audio collecting device 320, and a processor 330. Wherein:

an audio playing device 310 for playing an audio signal;

a body conduction audio collection device 320 for collecting audio signals;

the processor 330 is configured to acquire an audio signal acquired by the body conduction audio acquisition device, and determine a wearing state of the electronic device based on the audio signal acquired by the body conduction audio acquisition device.

It is understood that in practical applications, the specific implementation of the electronic device 300 may include, but is not limited to, the audio playing device 310, the body-conduction audio capturing device 320 and the processor 330, and may further include other components according to practical needs, for example, a memory.

The electronic device 300 may be an executing device of the method for determining the wearing state of the headset shown in the embodiment of the present application, and may further include an air conduction audio collecting device corresponding to some embodiments of the method for determining the wearing state of the headset shown in the embodiment of the present application.

In an alternative, the electronic device 300 may be embodied as a headset.

An electronic device 2000 includes a processor 2001 and a memory 2003, as shown in fig. 22. Wherein the processor 2001 is coupled to a memory 2003, such as via a bus 2002. Optionally, the electronic device 2000 may also include a transceiver 2004. It should be noted that the transceiver 2004 is not limited to one in practical applications, and the structure of the electronic device 2000 is not limited to the embodiment of the present application.

The processor 2001 is applied to the embodiment of the present application to realize the functions of each module of the apparatus shown in fig. 18 or fig. 20. The transceiver 2004 includes a receiver and a transmitter, and the transceiver 2004 is applied to the embodiment of the present application to realize communication between the electronic device 2000 and another device, and to realize reception and transmission of data.

The processor 2001 may be a CPU, general purpose processor, DSP, ASIC, FPGA or other programmable logic device, transistor logic device, hardware component, or any combination thereof. Which may implement or perform the various illustrative logical blocks, modules, and circuits described in connection with the disclosure. The processor 2001 may also be a combination of computing functions, e.g., comprising one or more microprocessors, DSPs and microprocessors, and the like.

Bus 2002 may include a path that conveys information between the aforementioned components. The bus 2002 may be a PCI bus or an EISA bus, etc. The bus 2002 may be divided into an address bus, a data bus, a control bus, and the like. For ease of illustration, only one thick line is shown in FIG. 22, but this does not indicate only one bus or one type of bus.

The memory 2003 may be, but is not limited to, a ROM or other type of static storage device that can store static information and instructions, a RAM or other type of dynamic storage device that can store information and instructions, an EEPROM, a CD-ROM or other optical disk storage, optical disk storage (including compact disk, laser disk, optical disk, digital versatile disk, blu-ray disk, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer.

Optionally, the memory 2003 is used for storing application program code for performing the disclosed aspects, and is controlled in execution by the processor 2001. The processor 2001 is configured to execute application program codes stored in the memory 2003 to implement the actions of the headset wearing state determination apparatus or the electronic device control apparatus provided in the embodiment of the present application.

The embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, and the computer program, when executed by a processor, implements a headset wearing state determination method or an electronic device control method shown in any embodiment of the present application.

It should be understood that, although the steps in the flowcharts of the figures are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and may be performed in other orders unless explicitly stated herein. Moreover, at least a portion of the steps in the flow chart of the figure may include multiple sub-steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed alternately or alternately with other steps or at least a portion of the sub-steps or stages of other steps.

The foregoing is only a partial embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.

Claims

1. A method for determining a wearing state of an earphone, comprising:

2. The method of claim 1, wherein determining the wearing state of the headset based on the audio signals captured by the body-conducted audio capture device comprises at least one of:

determining the wearing state of the earphone based on the signal characteristics of the audio signals collected by the body conduction audio collecting equipment;

determining the wearing state of the earphone based on the audio signals collected by the body conduction audio collecting device and the audio signals collected by the air conduction audio collecting device of the earphone;

3. The method of claim 2, wherein determining the wearing state of the headset based on the audio signals collected by the body-conduction audio collection device and the audio signals collected by the air-conduction audio collection device of the headset comprises:

determining a wearing state of the headset based on a difference between an audio signal collected by the body conduction audio collecting device and an audio signal collected by the air conduction audio collecting device;

and/or the presence of a gas in the gas,

determining the wearing state of the earphone based on the correlation between the audio signals collected by the body conduction audio collecting device and the audio signals collected by the air conduction audio collecting device;

the determining the wearing state of the earphone based on the audio signal played by the audio playing device of the earphone and the audio signal collected by the body conduction audio collecting device comprises:

and determining the wearing state of the earphone based on the change of the propagation path of the audio signal played by the audio playing device to the body conduction audio acquisition device.

4. The method of claim 3, wherein determining the wearing state of the headset based on the signal characteristics of the audio signals captured by the body-conducted audio capture device comprises:

comparing at least one signal characteristic of the audio signal acquired by the body conduction audio acquisition equipment with a corresponding first threshold value, and determining the wearing state of the earphone according to the comparison result;

the determining the wearing state of the earphone based on the difference between the audio signal collected by the body conduction audio collecting device and the audio signal collected by the air conduction audio collecting device comprises:

acquiring the difference between the signal characteristics of the audio signals acquired by the body conduction audio acquisition equipment and the signal characteristics of the audio signals acquired by the air conduction audio acquisition equipment, comparing the difference with a second threshold value, and determining the wearing state of the earphone according to the comparison result;

the determining the wearing state of the earphone based on the correlation between the audio signal collected by the body conduction audio collecting device and the audio signal collected by the air conduction audio collecting device comprises:

calculating the correlation between the audio signals collected by the body conduction audio collecting device and the audio signals collected by the air conduction audio collecting device, comparing the correlation with a third threshold value, and determining the wearing state of the earphone according to the comparison result;

the determining the wearing state of the earphone based on the change of the propagation path of the audio signal played by the audio playing device to the body conduction audio collecting device includes:

estimating the propagation path characteristics of the audio signals played by the audio playing device reaching the body conduction audio acquisition device according to the audio signals played by the audio playing device and the audio signals acquired by the body conduction audio acquisition device, acquiring the difference between the estimated propagation path characteristics and the preset propagation path characteristics, comparing the difference with a fourth threshold value, and determining the wearing state of the earphone according to the comparison result.

5. The method according to any one of claims 1 to 4, wherein determining the wearing state of the headset based on the audio signal captured by the body-conduction audio capturing device further comprises:

a voice event demand of a user is detected.

6. The method according to any one of claims 1 to 5, wherein after determining the wearing state of the headset, further comprising:

7. The method of claim 6, wherein the controlling the electronic device connected to the headset to perform corresponding processing comprises:

and controlling the sound playing mode of the electronic equipment and/or controlling the electronic equipment to send prompt information.

8. An electronic device control method, comprising:

acquiring the wearing state of an earphone connected with electronic equipment;

9. The method according to claim 8, wherein the controlling the electronic device to perform the corresponding processing comprises:

10. The method of claim 9, wherein the controlling the sound play mode of the electronic device comprises:

when the wearing mode of the earphone is not worn, controlling the sound playing mode of the electronic equipment to be an earphone mode or a loudspeaker mode;

the controlling the electronic device to send out the prompt message comprises:

when the wearing mode of the earphone is not wearing, the electronic equipment is controlled to send prompt information for prompting that the electronic equipment is connected with the earphone, and/or send prompt information for prompting a user to wear the earphone, and/or send prompt information for prompting the user to switch the sound playing mode of the electronic equipment.

11. An earphone wearing state determination device, comprising:

12. An electronic device control apparatus, comprising:

13. An electronic device, comprising a memory and a processor;

the memory has stored therein computer program instructions that,

the processor for invoking the computer program instructions to perform the method of any of claims 1-10.

14. An electronic device, comprising: the device comprises an audio playing device, a body conduction audio acquisition device and a processor;

the audio playing device is used for playing audio signals;

15. A computer-readable storage medium, characterized in that the storage medium has stored therein computer program instructions, which when called by a processor, perform the method of any of claims 1 to 10.