CN111131950A

CN111131950A - Method for controlling microphone switch through triaxial acceleration sensor, electronic equipment and computer readable storage medium

Info

Publication number: CN111131950A
Application number: CN201911366381.4A
Authority: CN
Inventors: 陈洪太; 吴长凤; 闫荣辉
Original assignee: Guangdong Spark Technology Co ltd
Current assignee: Guangdong Spark Technology Co ltd
Priority date: 2019-12-26
Filing date: 2019-12-26
Publication date: 2020-05-08
Anticipated expiration: 2039-12-26
Also published as: CN111131950B

Abstract

The invention relates to a method for controlling a microphone switch by a triaxial acceleration sensor, electronic equipment and a computer readable storage medium, which are used for reducing the power consumption of an earphone, wherein the method comprises the following steps: a, starting a triaxial acceleration sensor in an earphone to carry out X, Y, Z triaxial data acquisition on vocal cord vibration caused by skull incidental muscle when a user speaks, and controlling a Z axis of the triaxial acceleration sensor to be vertical to the direction of human ears and to be parallel to the horizontal direction in the acquisition process; b, circularly detecting an energy accumulation value of Z-axis data in a set detection period, and triggering and starting a microphone to pick up sound when the energy accumulation value of the Z-axis exceeds a set bone vibration switch threshold; and C, after the microphone is started, if the energy accumulation value of the Z axis does not exceed the bone vibration switch threshold value continuously for a set time length, the microphone is closed.

Description

Method for controlling microphone switch through triaxial acceleration sensor, electronic equipment and computer readable storage medium

Technical Field

The invention relates to the field of earphone broadcasting, in particular to a method for controlling a microphone to be switched on and switched off by a triaxial acceleration sensor, electronic equipment and a computer readable storage medium.

Background

Bone vibration detects inductor (being triaxial acceleration sensor), indicates that detects skull motion induction inductor when speaking, and traditional microphone that carries out the pickup through air conduction is different, and it is a research direction of comparing the fever in recent years, especially the chinese of coming to the market is Freebuds3 and apple's airpots Pro, has driven the development of various bone conduction class wearing product techniques in market, and wherein the bone conduction environment noise reduction technique is comparatively hot.

The bone conduction environment noise reduction technology is used for detecting vocal cord vibration transmitted from muscles attached to a skull when a user speaks by using a bone vibration detection sensor so as to perform frequency spectrum cancellation with audio picked up by a microphone, and thus noise reduction is achieved. The present defect of this technique is, when implementing the technique of making an uproar falls in the bone conduction environment, traditional pickup equipment who takes bone vibration to detect the inductor, its microphone can always be opened always, leads to the earphone consumption increase, is unfavorable for the requirement that the earphone used for a long time.

Disclosure of Invention

The invention provides a method for controlling a microphone switch by a triaxial acceleration sensor, electronic equipment and a computer readable storage medium, aiming at reducing the power consumption of an earphone, aiming at overcoming the defects in the prior art.

Therefore, the method for controlling the microphone switch by the triaxial acceleration sensor comprises the following steps which are sequentially executed:

a, starting a triaxial acceleration sensor in an earphone to carry out X, Y, Z triaxial data acquisition on vocal cord vibration caused by skull incidental muscle when a user speaks, and controlling a Z axis of the triaxial acceleration sensor to be vertical to the direction of human ears and to be parallel to the horizontal direction in the acquisition process;

b, circularly detecting an energy accumulation value of Z-axis data in a set detection period, and triggering and starting a microphone to pick up sound when the energy accumulation value of the Z-axis exceeds a set bone vibration switch threshold;

and C, after the microphone is started, if the energy accumulation value of the Z axis does not exceed the bone vibration switch threshold value continuously for a set time length, the microphone is closed.

As a modification, in step B, the method further comprises:

and detecting the exercise intensity of the user in real time, and dynamically adjusting the bone vibration switch threshold according to the positive correlation characteristic between the exercise intensity and the bone vibration switch threshold.

Preferably, the manner of dynamically adjusting the bone vibration switch threshold in step B specifically is:

a plurality of energy gears which are sequentially increased are set in advance, and a corresponding bone vibration switch threshold value is allocated for each energy gear;

and circularly detecting energy accumulation values of the data of the XY axes in a period in a set detection period, averaging the energy accumulation values of the XY axes to obtain an energy accumulation average value, and selecting a bone vibration switch threshold value corresponding to the energy gear according to the energy gear reached by the energy accumulation average value to compare with the energy accumulation value of the Z axis.

As a modification, in step C, the method further includes:

and picking up environmental noise, and dynamically adjusting the bone vibration switch threshold value required to be judged when the microphone is started next time according to the positive correlation characteristic between the environmental noise and the bone vibration switch threshold value.

Preferably, the manner of dynamically adjusting the bone vibration switch threshold in step C specifically is:

detecting whether the microphone is closed in real time, and if the microphone is detected to be closed, taking audio collected within a certain time period before the microphone is closed as environmental noise;

the signal-to-noise ratio of the energy value of the environmental noise and the energy value collected by the microphone during voice interaction is obtained;

if the signal-to-noise ratio is lower than the noise threshold, the bone vibration switch threshold required to be judged when the microphone is started next time is increased in a set step mode, otherwise, the bone vibration switch threshold required to be judged when the microphone is started next time is decreased in a set step mode.

As a modification, the following step B1 is further included before step B is executed:

at the same time, averaging the data of the XY two shafts to obtain a mean value, and subtracting the product of the mean value multiplied by a set coefficient from the Z-axis data;

or the X, Y, Z triaxial data is subjected to frequency domain transformation, a point with the energy in the triaxial frequency spectrum at the peak on the same frequency is found, the point is deleted from the Z axis, then the energy of the left and right adjacent points of the point is averaged, and the obtained average value replaces the numerical value of the point.

As a modification, the following step B2 is further included before step B is executed:

and carrying out high-pass filtering on the Z-axis data by adopting a high-pass filter with set frequency.

As a modification, the method further comprises the following step a1 executed before the step a is executed:

the human body sensing module is used for detecting the contact degree of the sensing surface and the surface of the human body in real time, and only when the strength of the output signal of the human body sensing module exceeds a wake-up threshold value, the subsequent steps are started and executed.

There is also provided an electronic device, wherein the electronic device comprises:

a controller; and the number of the first and second groups,

a memory arranged to store computer executable instructions which, when executed, cause the controller to implement the method described above.

A computer-readable storage medium is also provided, wherein the computer-readable storage medium stores one or more programs which, when executed by a controller, implement the above-described method.

Has the advantages that:

the invention detects vocal cord vibration caused by skull incidental muscle when a user speaks through a Z axis in the triaxial acceleration sensor, starts the microphone to pick up sound when the energy accumulated value of the Z axis exceeds a set bone vibration switch threshold value, continues to detect the energy accumulated value of the Z axis after the starting, and closes the microphone when the energy accumulated value of the Z axis does not exceed the bone vibration switch threshold value when the energy accumulated value of the Z axis continuously exceeds the set time length, thereby realizing the microphone switch control.

The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.

Drawings

Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:

fig. 1 shows the internal system architecture of the headset of the present invention;

FIG. 2 shows a flow chart of a microphone switch control method of the present invention;

FIG. 3 is a schematic diagram of three-axis waveforms collected by a three-axis acceleration sensor;

FIG. 4 is a schematic structural diagram of an electronic device according to the present invention;

fig. 5 is a schematic structural diagram of a computer-readable storage medium according to the present invention.

Detailed Description

As shown in fig. 1, the earphone of the present embodiment has an algorithm processing unit, and a human body sensing module, a three-axis acceleration sensor and a microphone module electrically connected to the algorithm processing unit, respectively, wherein:

an algorithm processing unit: a conventional controller is adopted to mainly operate the drive and algorithm of each inductor;

human response module: the earphone comprises but is not limited to one or more infrared/capacitive sensors, and the core of the earphone is to output signals with different intensities by detecting the contact degree of the infrared/capacitive sensors and the surface of a human body so as to judge whether the earphone is worn in place, which is the prior art and is not repeated herein;

triaxial acceleration sensor: the method is used for detecting vocal cord vibration caused by attached muscles of the skull when a user speaks, and mainly detects the direction vertical to the surface of an inductor, namely the direction vertical to the human ear (defined as a Z axis), and judges the current directionality and the motion condition of the user through the XY axis, which is detailed in the following;

a microphone module: a conventional microphone array is employed for detecting a sound pressure signal in the air.

In this embodiment, a memory of the earphone stores computer-executable instructions, and when the computer-executable instructions are executed by the algorithm processing unit, the method for controlling the microphone switch as shown in fig. 2 is implemented, specifically, the method includes the following steps that are executed in sequence:

s11, in order to improve the recognition rate and reduce false triggering behaviors caused by movement, a human body sensing module is adopted to detect the contact degree of a sensing surface of the human body sensing module and the surface of a human body in real time, when the strength of an output signal of the human body sensing module exceeds an awakening threshold value, the earphone is considered to be in a wearing state, the follow-up steps are started, and otherwise, the earphone is always circularly detected without entering the follow-up state so as to reduce the power consumption of the earphone;

and S12, starting the three-axis acceleration sensor to acquire data, enabling the three axes to generate a strong correlation waveform as shown in figure 3, wherein the Z axis of the three-axis acceleration sensor is perpendicular to the direction of the human ear and parallel to the horizontal direction by controlling the position arrangement of the three-axis acceleration sensor so as to accord with the bone vibration detection direction.

Furthermore, because the three-axis data has correlation, the Z-axis data can be subjected to interference elimination by adopting an algorithm of time domain amplitude coefficient cancellation or frequency domain corresponding frequency point cancellation through reference of an X axis and a Y axis,

specifically, when the time domain amplitude coefficient cancellation method is adopted, the method is as follows:

at the same time, averaging is carried out by using data of the two X and Y axes to obtain a mean value, and a Z-axis data-mean value x coefficient is 0.2, so that interference elimination is realized, wherein the coefficient 0.2 is only taken as an example here, actual calibration is carried out according to the wearing direction of the earphone, and the mean value is taken.

Specifically, when the frequency point cancellation corresponding to the frequency domain is adopted, the method is as follows:

x, Y, Z three-axis data is subjected to frequency domain transformation, a point with energy in a three-axis frequency spectrum at a wave crest on the same frequency is found, the point is deleted from a Z axis, then the energy of the left and right adjacent points of the point is averaged, the obtained average value replaces the value of the point, interference elimination is realized, for example, at a position of 5HZ, if the three axes have a wave crest, the three axes can be considered as caused by motion interference, and therefore the energy value of the point in the Z axis is weakened, namely the point value is replaced by the averaging mode of the energy of the left and right adjacent points.

And S13, because the head of the person moves, most of the head of the person is in low frequency, even if the person walks and runs, the step frequency is below 10Hz, and in S13, a 200Hz high-pass filter is adopted to carry out high-pass filtering on Z-axis data, so that most of the obtained movement interference and higher harmonic components are eliminated.

And S14, circularly detecting the energy accumulation value of the Z-axis data in a period by taking 20ms as a detection period, if the energy accumulation value of the Z-axis exceeds a set bone vibration switch threshold, considering that the user starts speaking, turning on a microphone to pick up sound, and if the energy accumulation value of the Z-axis does not exceed the bone vibration switch threshold continuously for more than 2000ms, considering that the voice interaction is finished, and turning off the microphone.

Further, in step S14, in order to reduce the interference caused by the user' S movement, the degree of exercise intensity of the user needs to be detected in real time, and the bone vibration switch threshold is dynamically adjusted according to the degree of exercise intensity, which is specifically represented as: the stronger the movement, the stronger the human voice is required to turn on the microphone, and thus the required bone vibration switch threshold is higher; the gentler the movement, the lower the required threshold value, whereby the following sub-steps are performed in step S14:

s141, setting a plurality of energy gears which are sequentially increased in advance, and allocating a corresponding bone vibration switch threshold value for each energy gear in an experimental test mode;

and S142, circularly detecting energy accumulation values of the data of the XY axes in the period by taking 20ms as a detection period, averaging the energy accumulation values of the XY axes to obtain an energy accumulation average value, and selecting a bone vibration switch threshold value corresponding to the energy level to compare with the energy accumulation value of the Z axis according to the energy level reached by the energy accumulation average value, thereby effectively avoiding motion interference.

Step S15, after the microphone is started, the microphone is controlled to pick up environmental noise, and according to the environmental noise, a bone vibration switch threshold value required to be judged when the microphone is started next time is adjusted in reverse to improve the recognition success rate, which is specifically represented as follows: if the environmental noise is very large, the bone vibration switch threshold value required to be judged when the microphone is started next time is increased, so that the microphone needs to be turned on by stronger human voice; otherwise, the bone vibration switch threshold value required to be determined when the microphone is started next time is decreased, and the step S15 specifically includes the following sub-steps:

step S151, detecting whether the microphone is closed in real time, and if the microphone is detected to be closed, taking audio collected within a certain time period before the microphone is closed as environmental noise;

s152, comparing the energy value of the environmental noise with the energy value collected by a microphone during voice interaction by taking 20ms as a time window, so as to obtain the signal-to-noise ratio of the environmental noise and the energy value;

and S153, if the signal-to-noise ratio is lower than the noise threshold, increasing the bone vibration switch threshold required to be judged when the microphone is started next time in a set step mode, and otherwise, decreasing the bone vibration switch threshold required to be judged when the microphone is started next time in a set step mode.

The microphone switch control method of the embodiment has the following characteristics:

1. detecting motion through XY axes in the triaxial acceleration sensor, and detecting vocal cord vibration caused by skull incidental muscles when a user speaks through a Z axis;

2. the motion condition of a user is detected through an XY axis, motion interference in Z-axis data is eliminated, and further low-frequency motion interference is eliminated through a high-pass filter;

3. in order to improve the recognition rate, a human body sensing module is adopted to reduce the false triggering behavior caused by movement;

4. if the current motion disturbance is detected to be large, dynamically adjusting the bone conduction vibration switch threshold value, which is specifically represented as: the stronger the movement, the stronger the human voice is required to turn on the microphone, and thus the required bone vibration switch threshold is higher; the more gradual the movement, the lower the threshold required.

5. After the microphone is turned on, if the current environment is detected to have high noise, the bone conduction vibration switch threshold is synchronously adjusted in reverse, which is specifically represented as follows: if the environmental noise is very large, the bone vibration switch threshold value required to be judged when the microphone is started next time is increased, so that the microphone needs to be turned on by stronger human voice; otherwise, the bone vibration switch threshold value required to be judged when the microphone is started next time is reduced.

It should be noted that:

in this embodiment, the microphone array may be a single microphone, a dual microphone, or a multi-microphone.

The method of the present embodiment may be implemented by a method that is converted into program steps and apparatuses that can be stored in a computer storage medium and invoked and executed by a controller.

The algorithms and displays presented herein are not inherently related to any particular computer, virtual machine, or other apparatus nor is the particular language used to disclose the best mode of the invention.

In the description provided herein, numerous specific details are set forth. It is understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.

Similarly, it will be appreciated that in order to streamline the disclosure and facilitate an understanding of one or more of the various inventive aspects, a switch is made. Various general purpose devices may be used with the teachings herein. The required structure for constructing such a device will be apparent from the description above. Moreover, the present invention is not directed to any particular programming language. It should be appreciated that the subject matter of the present invention described herein can be implemented with various programming languages, and in the above description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof. However, the disclosed method should not be interpreted as reflecting an intention that: that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.

Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and furthermore they may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments.

The various component embodiments of the invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. It will be appreciated by those skilled in the art that a microprocessor or Digital Signal Processor (DSP) may be used in practice to implement some or all of the functions of some or all of the components of the apparatus for detecting a wearing state of an electronic device according to embodiments of the present invention. The present invention may also be embodied as apparatus or device programs (e.g., computer programs and computer program products) for performing a portion or all of the methods described herein. Such programs implementing the present invention may be stored on computer-readable media or may be in the form of one or more signals. Such a signal may be downloaded from an internet website or provided on a carrier signal or in any other form.

For example, fig. 4 shows a schematic structural diagram of an electronic device according to an embodiment of the invention. The electronic device conventionally comprises a processor 41 and a memory 42 arranged to store computer executable instructions (program code). The memory 42 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM. The memory 42 has a storage space 43 storing program code 44 for performing any of the method steps in the embodiments. For example, the storage space 43 for the program code may comprise respective program codes 44 for respectively implementing the various steps in the above method. The program code can be read from or written to one or more computer program products. These computer program products comprise a program code carrier such as a hard disk, a Compact Disc (CD), a memory card or a floppy disk. Such a computer program product is typically a computer readable storage medium such as described in fig. 5. The computer readable storage medium may have memory segments, memory spaces, etc. arranged similarly to the memory 42 in the electronic device of fig. 4. The program code may be compressed, for example, in a suitable form. In general, the memory unit stores program code 51 for performing the steps of the method according to the invention, i.e. program code readable by a processor such as 41, which when run by an electronic device causes the electronic device to perform the individual steps of the method described above.

It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.

Claims

1. The method for controlling the microphone switch by the triaxial acceleration sensor is characterized by comprising the following steps of:

b, circularly detecting an energy accumulation value of Z-axis data in a set detection period, and triggering and starting a microphone in the earphone to pick up sound when the energy accumulation value of the Z-axis exceeds a set bone vibration switch threshold;

2. The method of claim 1, wherein in step B, further comprising:

3. The method according to claim 2, wherein the dynamic adjustment of the bone vibration switch threshold in step B is performed by:

4. The method of claim 1, wherein in step C, further comprising:

5. The method according to claim 4, wherein the dynamic adjustment of the bone vibration switch threshold in step C is performed by:

6. The method of claim 1, further comprising the following step B1 performed before step B is performed:

7. The method of claim 1, further comprising the following step B2 performed before step B is performed:

8. The method of claim 1, further comprising the following step a1 performed before step a is performed:

9. Computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1-8.

10. An electronic device, wherein the electronic device comprises:

a controller; and the number of the first and second groups,

a memory arranged to store computer executable instructions that, when executed, cause the controller to implement the method of any one of claims 1-8.