CN114827813A

CN114827813A - Noise reduction method, earphone device and storage medium

Info

Publication number: CN114827813A
Application number: CN202210446969.6A
Authority: CN
Inventors: 赵玉贵
Original assignee: Goertek Inc
Current assignee: Goertek Inc
Priority date: 2022-04-26
Filing date: 2022-04-26
Publication date: 2022-07-29

Abstract

The invention discloses a noise reduction method, earphone equipment and a storage medium, wherein a vibration sensor is arranged in the earphone equipment, and the noise reduction method comprises the following steps: the vibration sensor acquires a vibration signal, the vibration signal is processed to obtain a noise elimination signal, the noise elimination signal is used for offsetting noise corresponding to the vibration signal, and a loudspeaker of the earphone device is adopted to output the noise elimination signal. The invention realizes the reduction of the noise perceived by the user and improves the comfort of wearing the earphone by the user.

Description

Noise reduction method, earphone device and storage medium

Technical Field

The present invention relates to the field of earphone technologies, and in particular, to a noise reduction method, an earphone device, and a storage medium.

Background

With the improvement of entertainment living standard, the earphone is becoming an indispensable part of people's life. In the using process of the earphone, when an external object is in contact with the earphone shell, vibration can be caused, or when a user uses the touch function of the earphone, the user slightly collides with the earphone shell, and vibration can also be caused. When the earphone vibrates, vibration noise generated by the vibration can be transmitted through the earphone shell or picked up by the built-in microphone and further transmitted into the ears of a user, so that the user can sense the vibration noise and the comfort of the user when wearing the earphone is influenced.

The above is only for the purpose of assisting understanding of the technical aspects of the present invention, and does not represent an admission that the above is prior art.

Disclosure of Invention

The invention mainly aims to provide a noise reduction method, and aims to solve the technical problem that comfort of a user is deteriorated due to vibration noise when the user wears an earphone.

In order to achieve the above object, the present invention provides a noise reduction method, which is applied to a headphone device, where a vibration sensor is disposed on the headphone device, and the noise reduction method includes the following steps:

acquiring a vibration signal through the vibration sensor;

processing the vibration signal to obtain a noise elimination signal, wherein the noise elimination signal is used for offsetting noise corresponding to the vibration signal;

outputting the noise cancellation signal using a speaker of the headset device.

Optionally, at least two vibration sensors are disposed in the earphone device, and the step of processing the vibration signals to obtain noise cancellation signals includes:

acquiring a weighting coefficient group of each vibration sensor, wherein the weighting coefficient group comprises weighting coefficients corresponding to the vibration sensors respectively;

and processing a signal obtained by weighting and superposing the vibration signals corresponding to the vibration sensors by adopting the weighting coefficient group to obtain the noise elimination signal.

Optionally, the step of acquiring the weighting coefficient set of each vibration sensor includes:

respectively calculating vibration signal energy of the vibration signals corresponding to the vibration sensors;

determining a current weighting coefficient group corresponding to each vibration sensor according to the ratio of the energy of each vibration signal to the energy sum of the energy of each vibration signal;

the step of processing the signal obtained by weighting and superimposing the vibration signal corresponding to each vibration sensor by using the weighting coefficient group to obtain the noise elimination signal includes:

weighting and superposing the vibration signals corresponding to the vibration sensors by adopting the current weighting coefficient group to obtain superposed vibration signals;

acquiring target compensation parameters corresponding to the current weighting coefficient group from preset compensation parameters corresponding to different weighting coefficient groups;

and performing compensation processing on the superposed vibration signals by adopting the target compensation parameters to obtain compensation signals, and performing anti-phase processing on the compensation signals to obtain the noise elimination signals.

Optionally, the step of processing the vibration signal to obtain a noise cancellation signal includes:

acquiring a preset target compensation parameter;

performing compensation processing on signals of the target frequency points in the vibration signals by adopting the target compensation parameters to obtain compensation signals;

and performing anti-phase processing on the compensation signal to obtain the noise elimination signal.

Optionally, the step of performing compensation processing on the signal of the target frequency point in the vibration signal by using the target compensation parameter to obtain a compensation signal includes:

dividing the vibration signal into a plurality of frequency bands, and respectively determining the target frequency point from each frequency band;

calculating the frequency point signal energy of the target frequency point and the frequency band signal energy of the frequency band of the target frequency point in the vibration signal, and determining the energy coefficient of the target frequency point according to the ratio of the frequency band signal energy to the frequency point signal energy;

and processing the signals of the target frequency points in the vibration signals by adopting the energy coefficients to obtain energy equivalent signals, and performing compensation processing on the energy equivalent signals by adopting the target compensation parameters to obtain the compensation signals.

Optionally, after the step of outputting the noise cancellation signal by using the speaker of the earphone device, the method further includes:

acquiring a residual noise signal through a feedback microphone in the earphone device;

determining residual signal energy of a frequency band where the target frequency point is located in the residual noise signal and cancellation signal energy of a frequency band where the target frequency point is located in the noise cancellation signal;

determining the actual signal energy of the frequency band where the target frequency point is located according to the elimination signal energy and the residual signal energy, and determining the actual compensation parameter of the target frequency point according to the ratio of the actual signal energy to the frequency band signal energy;

and updating the target compensation parameters corresponding to the target frequency points into the actual compensation parameters.

when the phase of the residual noise signal corresponding to the target frequency point is the same as that of the noise elimination signal, reducing the target compensation parameter of the target frequency point;

and when the phase of the residual noise signal corresponding to the target frequency point is different from the phase of the noise elimination signal, increasing the target compensation parameter of the target frequency point.

acquiring a valid sound signal, wherein the valid sound signal comprises an external sound signal picked up by a feedforward microphone of the earphone device and/or an internal sound source signal of the earphone device;

acquiring a feedback sound signal through a feedback microphone of the earphone device;

removing the effective sound signal from the feedback sound signal to obtain a residual noise signal;

and adjusting the target compensation parameter according to the residual noise signal.

In order to achieve the above object, the present invention further provides a noise reduction apparatus disposed in an earphone device, wherein a vibration sensor is disposed in the earphone device, and the noise reduction apparatus includes:

the acquisition module is used for acquiring a vibration signal through the vibration sensor;

the processing module is used for processing the vibration signal to obtain a noise elimination signal, wherein the noise elimination signal is used for offsetting the noise corresponding to the vibration signal;

and the output module is used for outputting the noise elimination signal by adopting a loudspeaker of the earphone equipment.

To achieve the above object, the present invention also provides an earphone device, including: a memory, a processor and a noise reduction program stored on the memory and executable on the processor, the noise reduction program when executed by the processor implementing the steps of the noise reduction method as described above.

Furthermore, to achieve the above object, the present invention also provides a computer readable storage medium, which stores a noise reduction program, and the noise reduction program implements the steps of the noise reduction method as described above when executed by a processor.

In the invention, a vibration sensor is arranged in the earphone equipment, a vibration signal is obtained through the vibration sensor, the vibration signal is processed to obtain a noise elimination signal, wherein the noise elimination signal is used for offsetting noise corresponding to the vibration signal, and a loudspeaker of the earphone equipment is adopted to output the noise elimination signal. The invention realizes the reduction of the vibration noise sensed by the user and improves the comfort of wearing the earphone by the user.

Drawings

FIG. 1 is a schematic flow chart illustrating a noise reduction method according to a first embodiment of the present invention;

FIG. 2 is a flow chart of an embodiment of a noise reduction method according to the present invention;

FIG. 3 is a flow chart of an embodiment of a noise reduction method according to the present invention;

fig. 4 is a schematic diagram of functional modules of a noise reduction apparatus according to an embodiment of the present invention.

The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.

Detailed Description

It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

An embodiment of the present invention provides a noise reduction method, and referring to fig. 1, fig. 1 is a schematic flow diagram of a first embodiment of a noise reduction method according to the present invention. It should be noted that, although a logical order is shown in the flow chart, in some cases, the steps shown or described may be performed in an order different than that shown or described herein. The noise reduction method in the embodiment of the present invention is applied to an earphone device, which may be a headphone device, an ear-hook earphone device, an in-ear earphone device, and the like, and is not limited in this embodiment. The earphone device is provided with a vibration sensor, and the noise reduction method comprises the following steps:

step A10, obtaining a vibration signal through the vibration sensor;

when an external object touches or collides with the earphone device to cause the earphone device to vibrate, sound generated by the vibration of the earphone device is transmitted through the earphone device shell or picked up by the built-in microphone and further transmitted into the ear canal of a user to be perceived by the user, so that the comfort of the user wearing the earphone is poor.

In this embodiment, a noise reduction method is provided, in which a vibration signal corresponding to a vibration sensor is processed and then output by using a speaker of an earphone device, so as to cancel noise generated by vibration of the earphone device in an ear canal of a user, so that the noise generated by the vibration of the earphone device sensed by the user is reduced, and comfort of the user when wearing the earphone is improved.

Specifically, in the present embodiment, a sensor capable of picking up a vibration signal, i.e., a vibration sensor, is provided on the headphone apparatus. The vibration sensor may be a vibration acceleration sensor or a vibration displacement sensor, and is not limited in this embodiment. The vibration sensor can be arranged in a touch control area for performing function control on the earphone device, and can also be arranged at any position of a shell of the earphone device, and the specific setting position can be set according to different earphone types and requirements, and is not limited in the embodiment. The number of the vibration sensors on the earphone device can be one or more. The earphone device may acquire a vibration signal through the vibration sensor.

In a specific embodiment, the vibration frequency and the vibration acceleration may be obtained by a vibration acceleration sensor to obtain a vibration signal. Further, the frequency and amplitude of the vibration signal can be calculated according to the vibration frequency and the vibration acceleration acquired by the vibration acceleration sensor.

It should be noted that, the vibration signal is acquired through the vibration sensor, and compared with the sound signal generated by acquiring vibration through a microphone on the earphone device, all vibration signals in the arrangement range of the vibration sensor can be acquired more comprehensively, so that the effect of canceling noise by using a noise cancellation signal obtained after the vibration signal is subjected to subsequent processing is better, and the comfort of a user when wearing the earphone device is improved.

Step A20, processing the vibration signal to obtain a noise elimination signal, wherein the noise elimination signal is used for counteracting the noise corresponding to the vibration signal;

after the vibration signal is acquired by the vibration sensor, the vibration signal may be processed to obtain a signal for canceling noise corresponding to the vibration signal (hereinafter, referred to as a noise canceling signal for distinction). There are various methods for processing the vibration signal to obtain the noise cancellation signal, and the method is not limited in this embodiment. In a specific embodiment, the vibration signal may be processed to obtain the noise cancellation signal based on the principle that signals with equal amplitude and/or energy and opposite phases may cancel each other out. For example, in one embodiment, when a vibration sensor is provided on the headphone apparatus, the vibration signal obtained by the vibration sensor may be subjected to anti-phase processing to obtain a noise cancellation signal.

In a specific embodiment, when a plurality of vibration sensors are disposed on the earphone device, the vibration signals corresponding to the respective vibration sensors may also be processed to obtain noise cancellation signals. The vibration signals corresponding to the respective vibration sensors may be processed in a variety of ways. For example, in one embodiment, the vibration signals corresponding to the respective vibration sensors may be weighted and superimposed, and then subjected to anti-phase processing to obtain noise cancellation signals; in another embodiment, the vibration signals corresponding to the respective vibration sensors may be subjected to anti-phase processing and then to weighted superposition to obtain noise cancellation signals; in another embodiment, the vibration signal corresponding to one of the vibration sensors may be subjected to anti-phase processing to obtain a noise cancellation signal.

Step a30, outputting the noise cancellation signal using a speaker of the headphone apparatus.

After the noise elimination signal is obtained through processing, the noise elimination signal can be output by adopting a loudspeaker of the earphone device, so that when the noise elimination signal enters the ear canal of a user, noise corresponding to the vibration signal in the ear canal of the user can be offset, and vibration noise which can be heard by the user can be reduced.

In this embodiment, the vibration signal is obtained through the vibration sensor arranged on the earphone device, the vibration signal is processed to obtain a noise elimination signal for offsetting the noise corresponding to the vibration signal, and the speaker of the earphone device is adopted to output the noise elimination signal, so that the vibration noise generated by the vibration of the earphone is offset by the noise elimination signal, the vibration noise sensed by a user is reduced, and the comfort of wearing the earphone by the user is improved.

Further, based on the first embodiment described above, a second embodiment of the noise reduction method of the present invention is proposed, in which step a20 includes:

step A201, acquiring a preset target compensation parameter;

in an actual application scenario, due to the fact that a certain distance exists between a position where vibration occurs and a setting position of a vibration sensor, the sensitivity of a device of the vibration sensor is not enough, and the like, a certain loss may exist in comparison with a signal actually generated by vibration of earphone equipment through a vibration signal acquired by the vibration sensor, so that when a noise cancellation signal obtained by processing the vibration signal cancels noise, the vibration noise may not be completely cancelled, that is, for a user, a certain residual vibration noise still exists. In contrast, in this embodiment, the vibration signal is compensated to make the compensated vibration signal as close as possible to the actual vibration signal, and then the noise cancellation signal is obtained by processing the compensated vibration signal, so as to further improve the effect of the noise cancellation signal in cancelling the noise.

The parameter for performing the compensation process on the vibration signal is referred to as a compensation parameter. The headphone device may be provided with compensation parameters in advance as needed. When the vibration signal needs to be compensated, a preset compensation parameter (hereinafter, referred to as a target compensation parameter for distinction) is obtained.

In a specific embodiment, when there are a plurality of vibration sensors, the compensation parameters corresponding to the respective vibration sensors may be the same or different; when the compensation parameters corresponding to the vibration sensors are different, for each vibration sensor, the earphone device can acquire the compensation parameters corresponding to the vibration sensor to perform compensation processing on the vibration signals corresponding to the vibration sensor.

In an embodiment, the preset compensation parameter may be set in the headset device after the laboratory test is obtained, and the test process may be: during testing, a vibration exciter is arranged to send a standard vibration signal with a certain frequency and a certain amplitude to a shell of the earphone device, the earphone device obtains a vibration signal (called a feedback vibration signal to be distinguished from the standard vibration signal) through a vibration sensor, and a compensation parameter corresponding to the vibration sensor is determined according to a ratio between signal energy of the standard vibration signal and signal energy of the feedback vibration signal.

The expression form of the compensation parameter and the corresponding compensation process may be various, and are not limited in this embodiment. For example, in one embodiment, the compensation parameter may be obtained by dividing the signal energy of the standard vibration signal by the signal energy of the feedback vibration signal, where the compensation process is to multiply the vibration signal by the corresponding compensation parameter; in another embodiment, the compensation parameter may be obtained by calculating the signal energy of the feedback vibration signal and the signal energy of the standard vibration signal, and in this case, the compensation process may be to divide the vibration signal by the compensation parameter or to multiply the vibration signal by the inverse of the compensation parameter.

Step A202, performing compensation processing on signals of a target frequency point in the vibration signals by adopting the target compensation parameters to obtain compensation signals;

the vibration signal includes a signal corresponding to each frequency point, and the processing of the vibration signal may specifically be performing compensation processing on the signal corresponding to each frequency point in the vibration signal. The frequency points corresponding to the signals that need to be compensated in the vibration signals are referred to as target frequency points for distinguishing, the target frequency points may be all frequency points in the vibration signals, or one or more frequency points in the vibration signals, and are not limited in this embodiment.

And performing compensation processing on signals corresponding to the target frequency points in the vibration signals by using the target compensation parameters to obtain compensated signals, which are referred to as compensation signals hereinafter for distinction. It should be noted that the compensation signal includes only the signal of the target frequency point after compensation processing, and does not include signals of other frequency points except the target frequency point.

The method for performing compensation processing on the signal of the target frequency point in the vibration signal is determined according to the expression form of the compensation parameter, and may be to multiply the signal of the target frequency point by the corresponding compensation parameter, divide the signal of the target frequency point by the corresponding compensation parameter, or multiply the signal of the target frequency point by the reciprocal of the corresponding compensation parameter, which is not limited in this embodiment.

Step a203, performing anti-phase processing on the compensation signal to obtain the noise cancellation signal.

And respectively carrying out anti-phase processing on the signals of each target frequency point in the compensation signals, and taking the signals after the anti-phase processing corresponding to each target frequency point as noise elimination signals. And the phase of the signal of the target frequency point in the vibration signal obtained after the anti-phase processing is opposite to the phase of the signal of the target frequency point in the vibration signal before the anti-phase processing.

It should be noted that, by performing compensation processing on the vibration signal, the loss of the vibration signal acquired by the vibration sensor relative to the signal actually generated by the vibration of the earphone device may be reduced, so that the effect of canceling the noise after the compensation processing is better.

Further, in one embodiment, step a202 includes:

step A2021, dividing the vibration signal into a plurality of frequency bands, and respectively determining the target frequency point from each frequency band;

the vibration signal can be divided into signals of a plurality of frequency bands, and the signal of each frequency band comprises signals of a plurality of frequency points. The frequency band may be selected according to the requirement, and is not limited herein. And respectively determining target frequency points from each frequency band so as to compensate the signals of the target frequency points. One target frequency point or a plurality of target frequency points can be selected from one frequency band. In one embodiment, the intermediate frequency point of the frequency band may be used as the target frequency point in the frequency band.

Step A2022, calculating frequency point signal energy of the target frequency point and frequency band signal energy of a frequency band where the target frequency point is located in the vibration signal, and determining an energy coefficient of the target frequency point according to a ratio of the frequency band signal energy to the frequency point signal energy;

the signal energy of the signal of the target frequency point in the vibration signal, hereinafter referred to as frequency point signal energy, is calculated, and the sum of the signal energy of the frequency band in which the target frequency point is located in the vibration signal, hereinafter referred to as frequency band signal energy, is calculated for distinction. The signal energy may be calculated according to an existing energy calculation method, and is not limited in this embodiment.

The energy coefficient can be determined according to the ratio of the frequency point signal energy of the target frequency point to the frequency band signal energy of the frequency band where the target frequency point is located. The energy coefficient determined according to the ratio has various expression forms, and in one embodiment, the energy coefficient can be obtained by dividing the frequency band signal energy by the frequency point signal energy; in another embodiment, the energy coefficient may be obtained by dividing the frequency-point signal energy by the frequency-band signal energy, which is not limited in this embodiment. In an embodiment, the energy coefficient may make the frequency point signal energy and the frequency band signal energy corresponding to the target frequency point equal.

It should be noted that, in an embodiment, when a plurality of target frequency points are selected from one frequency band, the sum of frequency point signal energies of the target frequency points may be calculated, and the energy coefficient may be determined according to the ratio of the frequency point signal energy sum to the frequency band signal energy. It can be understood that, further, in the specific embodiment, the frequency point signal energy may be divided by the frequency band signal energy to obtain an energy coefficient, and the frequency band signal energy may also be divided by the frequency point signal energy and obtain the energy coefficient.

Step A2023, processing the signals of the target frequency points in the vibration signals by using the energy coefficients to obtain energy equivalent signals, and performing compensation processing on the energy equivalent signals by using the target compensation parameters to obtain the compensation signals.

And (3) processing the signals of the target frequency points in the vibration signals by adopting an energy coefficient to obtain signals called energy equivalent signals for distinguishing, and equivalently replacing the signals of the frequency band where the target frequency points are located by adopting the energy equivalent signals to carry out subsequent processing. A signal obtained by performing compensation processing on the energy equivalent signal using the target compensation signal is referred to as a compensation signal.

The method for processing the signals of the target frequency points in the vibration signals by adopting the energy coefficients is not limited, and is specifically determined according to the expression form of the energy coefficients. For example, in an embodiment, when the energy coefficient is obtained by dividing the frequency band signal energy by the frequency point signal energy, the signal of the target frequency point in the vibration signal may be multiplied by the energy coefficient; in another embodiment, when the energy coefficient is obtained by dividing the frequency point signal energy by the frequency band signal energy, the signal of the target frequency point in the vibration signal may be multiplied by the reciprocal of the energy coefficient, or the signal of the target frequency point in the vibration signal may be divided by the energy coefficient.

It should be noted that, the energy coefficient is adopted to process the signal of the target frequency point in the vibration signal to obtain an energy equivalent signal, and the energy equivalent signal is subjected to subsequent processing.

Further, in another embodiment, a preset target compensation parameter is obtained, signals corresponding to all frequency points in the vibration signal are compensated to obtain a compensation signal, and the compensation signal is subjected to anti-phase processing to obtain a noise elimination signal. It is understood that, in the present embodiment, the manner of the compensation process may be various, and is determined according to the expression form of the compensation parameter.

It should be noted that, by performing compensation processing on signals corresponding to all frequency points in the vibration signal, loss between the vibration signal acquired by the vibration sensor and a signal actually generated by vibration of the earphone device can be reduced more accurately, so that the effect of cancelling noise after compensation processing is better.

In this embodiment, carry out the antiphase processing again after compensating the vibration signal and be used for offsetting the noise, compare and directly carry out antiphase processing to the vibration signal and be used for offsetting the noise, the effect when can make the noise cancellation signal offset the vibration noise is better, improves the travelling comfort that the user wore earphone equipment.

Further, based on the first embodiment described above, a third embodiment of the noise reduction method of the present invention is proposed, in which at least two vibration sensors are provided in the headphone apparatus, and step a20 includes:

step A204, obtaining a weighting coefficient group of each vibration sensor, wherein the weighting coefficient group comprises weighting coefficients corresponding to each vibration sensor;

when the earphone device vibrates, the earphone device obtains vibration signals through the vibration sensors, and in this embodiment, the vibration signals corresponding to the vibration sensors are weighted and superposed, so that the processed signals are close to signals actually generated by the vibration of the earphone device.

And acquiring a weighting coefficient group consisting of weighting coefficients respectively corresponding to the vibration sensors, wherein the weighting coefficients are used for weighting and superposing the vibration signals. The weighting coefficients may be determined in a variety of ways, for example, in one embodiment, the weighting coefficients may be determined based on the signal energy of the vibration signal corresponding to each vibration sensor, and in another embodiment, the weighting coefficients may be set empirically.

Step a205, processing a signal obtained by weighting and superimposing the vibration signal corresponding to each vibration sensor by using the weighting coefficient set to obtain the noise cancellation signal.

And weighting the corresponding vibration signals by adopting the weighting coefficients in the weighting coefficient group, superposing the weighted signals, and processing the signals obtained by weighted superposition to obtain the noise elimination signals.

The signal obtained after performing the weighted overlap-add is processed in various ways, and is not limited in this embodiment. For example, in one embodiment, the compensation process and the anti-phase process are performed after the vibration signals corresponding to the vibration sensors are weighted and superimposed, and in another embodiment, the anti-phase process is performed directly after the vibration signals corresponding to the vibration sensors are weighted and superimposed.

It should be noted that, when a plurality of vibration sensors are disposed on the earphone device, a signal obtained by weighting and superimposing vibration signals of the vibration sensors is as identical as possible to a signal actually generated by vibration of the earphone device, so that the effect of noise cancellation performed on a noise cancellation signal obtained after processing is better.

Further, in another embodiment, signals obtained by performing anti-phase processing on the respective vibration signals may be subjected to weighted superposition. Specifically, the vibration signals corresponding to the vibration sensors are subjected to anti-phase processing respectively, weighting processing is performed on the signals subjected to the anti-phase processing by adopting weighting coefficients in the weighting coefficient group, and the signals subjected to the weighting processing are superposed to obtain noise elimination signals.

Further, in one embodiment, step a204 includes:

step A2041, respectively calculating vibration signal energy of the vibration signals corresponding to the vibration sensors;

in the present embodiment, the weighting coefficient may be determined by the signal energy of the vibration signal corresponding to each vibration sensor.

Specifically, the signal energy of the vibration signal corresponding to each vibration sensor is calculated, and hereinafter referred to as vibration signal energy for distinction.

Step A2042, determining a current weighting coefficient group corresponding to each vibration sensor according to the ratio of the energy of each vibration signal to the energy sum of the energy of each vibration signal;

and calculating the energy sum of the vibration signal energy corresponding to each vibration sensor after calculating the signal energy of the vibration signal corresponding to each vibration sensor.

And determining the weighting coefficient corresponding to the vibration sensor according to the ratio of the vibration signal energy corresponding to the vibration sensor to the energy sum of the vibration signal energy. And respectively calculating the ratio of the vibration signal energy corresponding to each vibration sensor to the energy sum of the vibration signal energy, and respectively determining the weighting coefficient corresponding to each vibration sensor according to each ratio. The weighting coefficients corresponding to the respective vibration sensors constitute a weighting coefficient group (hereinafter referred to as a current weighting coefficient group for distinction). The expression of the weighting coefficients and the corresponding weighting process may be various. For example, in one embodiment, the weighting process may be performed by multiplying the vibration signal corresponding to the vibration sensor by the weighting coefficient, and in another embodiment, the weighting process may be performed by dividing the energy sum of the vibration signal energy by the vibration signal energy corresponding to the vibration sensor, and in this case, the weighting process may be performed by dividing the vibration signal corresponding to the vibration sensor by the weighting coefficient, or may be performed by multiplying the vibration signal corresponding to the vibration sensor by the inverse number of the weighting coefficient.

Step a205 includes:

step A2051, performing weighted superposition on the vibration signals corresponding to the vibration sensors by adopting the current weighting coefficient group to obtain superposed vibration signals;

and weighting the corresponding vibration signals by adopting the weighting coefficients in the current weighting coefficient group, superposing the signals after weighting respectively, and calling the signals obtained by weighting superposition as superposed vibration signals for distinguishing.

Step A2052, obtaining target compensation parameters corresponding to the current weighting coefficient group from preset compensation parameters corresponding to different weighting coefficient groups;

and after the current weighting coefficient group is determined, acquiring a target compensation parameter corresponding to the current weighting coefficient group from preset compensation parameters corresponding to different weighting coefficient groups.

The preset compensation parameters corresponding to the weighting coefficient sets may be set in the headphone device after laboratory tests are obtained, and specifically, the process of testing the compensation parameters corresponding to different weighting coefficient sets in the laboratory may be: the earphone equipment provided with a plurality of vibration sensors is sent a standard vibration signal through a vibration exciter, and a feedback vibration signal is obtained through each vibration sensor. And determining the weighting coefficients corresponding to the vibration sensors according to the ratio of the signal energy of the feedback vibration signal to the sum of the energy of the feedback vibration signal, wherein the weighting coefficients corresponding to each vibration sensor form a weighting coefficient group.

And weighting the feedback vibration signals corresponding to the vibration sensor by adopting the weighting coefficients, weighting each vibration signal by adopting the corresponding weighting coefficient in the weighting coefficient group, superposing each signal after weighting, and determining the compensation parameters corresponding to the weighting coefficient groups according to the ratio of the superposed signal to the standard vibration signal.

And adjusting the positions of the vibration exciters relative to the earphone equipment for multiple times to repeat the test, so that multiple different weighting coefficient groups and corresponding compensation parameters can be obtained.

And A2053, performing compensation processing on the superposed vibration signal by using the target compensation parameter to obtain a compensation signal, and performing anti-phase processing on the compensation signal to obtain the noise elimination signal.

And adopting the target compensation parameters to perform compensation processing on the superposed vibration signals to obtain compensation signals. And performing anti-phase processing on the compensation signal to obtain a noise elimination signal.

It should be noted that, by adopting the way of weighting and superimposing first and then compensating processing on the vibration signal corresponding to the vibration sensor, the processing process can be simplified, the processing time can be reduced, the time delay of the noise elimination signal can be reduced, and the comfort of the user wearing the earphone device can be improved.

Further, in another embodiment, the vibration signals of the plurality of vibration sensors may be compensated and then subjected to weighted superposition and anti-phase processing. Specifically, after the current weighting coefficient group is determined, a set of target compensation parameters corresponding to the current weighting coefficient group is obtained from preset compensation parameters corresponding to different weighting coefficient groups.

And for each vibration sensor, compensating the vibration signal corresponding to the vibration sensor by adopting the target compensation parameter corresponding to the vibration sensor in the obtained group of target compensation parameters to obtain the compensation signal corresponding to the vibration sensor.

And weighting the corresponding compensation signals by adopting the weighting coefficients in the current weighting coefficient group, and superposing a plurality of signals obtained after weighting to obtain superposed vibration signals. And performing anti-phase processing on the compensation signal to obtain a noise elimination signal.

The preset compensation parameter set corresponding to the weighting coefficient set may be set in the headphone device after the laboratory test is obtained, and specifically, the process of testing the compensation parameter set corresponding to different weighting coefficient sets in the laboratory may be: the earphone equipment provided with a plurality of vibration sensors is sent a standard vibration signal through a vibration exciter, and a feedback vibration signal is obtained through each vibration sensor. For each vibration sensor, the weighting coefficient corresponding to the vibration sensor can be determined according to the ratio of the signal energy of the feedback vibration signal corresponding to the vibration sensor to the sum of the energy of each feedback vibration signal, and the weighting coefficients corresponding to each vibration sensor form a weighting coefficient group.

And calculating the ratio of the vibration signal corresponding to the vibration sensor to the standard vibration signal, and determining the compensation parameter corresponding to the vibration sensor according to the ratio. The compensation parameters corresponding to each vibration sensor can be respectively determined according to the ratio of the vibration signal corresponding to each vibration sensor to the standard vibration signal. And a set of compensation parameters corresponding to each vibration sensor corresponds to a set of weighting coefficients.

And adjusting the position of the vibration exciter relative to the earphone equipment for multiple times, and repeating the test to obtain multiple groups of weighting coefficient groups and corresponding compensation parameter groups.

For each vibration sensor, the target compensation parameters corresponding to the vibration sensor are adopted to perform compensation processing on the vibration signals corresponding to the vibration sensor to obtain compensation signals corresponding to the vibration sensor, weighting and superposition are performed on the compensation signals by adopting weighting coefficient groups to obtain superposed vibration signals, and then anti-phase processing is performed on the superposed vibration signals to obtain noise elimination signals.

Further, referring to fig. 2, two vibration sensors are provided on the ear speaker device. The first vibration signal f1 and the second vibration signal f2 are acquired by two vibration sensors, respectively. And acquiring current weighting coefficient groups corresponding to the two vibration sensors, wherein the current weighting coefficient groups comprise a first weighting coefficient g1 corresponding to the first vibration signal and a second weighting coefficient g2 corresponding to the second vibration signal. And acquiring a first target compensation parameter corresponding to the first vibration signal and a second target compensation parameter corresponding to the second vibration signal from the adapter according to the current weighting coefficient group. The first vibration signal is compensated by the compensator H1 using the first target compensation parameter to obtain a first compensation signal, and the second vibration signal is compensated by the compensator H2 using the second target compensation parameter to obtain a second compensation signal. The first compensation signal is weighted by the first weighting coefficient to obtain a first weighted vibration signal S1, the second compensation signal is weighted by the second weighting coefficient to obtain a second weighted vibration signal S2, the first weighted vibration signal and the second weighted vibration signal are superposed to obtain a superposed vibration signal, and then the superposed vibration signal is subjected to anti-phase processing to obtain a noise elimination signal S.

It should be noted that, in this embodiment, the vibration signal corresponding to the vibration sensor is processed in a manner of performing compensation processing and then performing weighted superposition, so that the amplitude and/or energy of the processed signal is closer to the signal actually generated by the vibration of the earphone device, and the finally obtained noise cancellation signal has a better noise cancellation effect.

In this embodiment, the earphone device is provided with vibration signals corresponding to the plurality of vibration sensors, and the vibration signals corresponding to the vibration sensors are weighted and superposed, so that the amplitude and/or energy of the signals obtained by weighting and superposing are close to the signals actually generated by the vibration of the earphone device, the effect of noise cancellation of the noise cancellation signals obtained by processing is better, and the comfort of wearing the earphone device by a user is improved.

Further, based on the second embodiment, a fourth embodiment of the noise reduction method according to the present invention is provided, in this embodiment, after step a30, the method further includes:

step B10, obtaining effective sound signals, wherein the effective sound signals comprise external sound signals picked up by a feedforward microphone of the earphone device and/or internal sound source signals of the earphone device;

in the embodiment, the target compensation parameter is adjusted according to the residual noise signal by acquiring the noise elimination signal and the residual noise signal after the noise cancellation, so that the amplitude and/or the energy of the noise elimination signal are closer to the noise, the noise reduction effect is better, and the comfort when the user wears the earphone device is improved.

In the present embodiment, a valid sound signal can be acquired. The valid sound signal may comprise an external sound signal picked up by a feed-forward microphone of the headphone arrangement and/or an internal sound source signal of the headphone arrangement.

Step B20, obtaining a feedback sound signal through a feedback microphone of the earphone device;

the sound signal in the ear canal of the user, hereinafter referred to as feedback sound signal, is picked up by a feedback microphone arranged at the in-ear part of the earphone device for distinction. The feedback sound signal may comprise a variety of sound signals, for example, the feedback sound signal may comprise a valid sound signal and a residual noise signal, and may also comprise a residual noise signal and other sound signals.

Step B30, removing the effective sound signal from the feedback sound signal to obtain a residual noise signal;

the signal obtained by cancelling the noise cancellation signal and the vibration noise is referred to as a residual noise signal. In the present embodiment, the residual noise signal is obtained by removing the effective sound signal from the feedback sound signal.

And step B40, adjusting the target compensation parameter according to the residual noise signal.

The target compensation parameters are adjusted according to the residual noise signals, and the target compensation parameters can be adjusted according to the comparison result by comparing the phases of the residual noise signals corresponding to the target frequency points with the noise elimination signals and comparing the amplitudes and/or the energies of the residual noise signals corresponding to the target frequency points with the noise elimination signals.

It should be noted that, by obtaining the residual noise signal after the noise cancellation signal and the vibration noise are cancelled, and adjusting the target compensation parameter according to the residual noise signal, the amplitude and/or the energy of the noise cancellation signal finally obtained after the compensation processing is performed on the vibration signal subsequently obtained by the vibration sensor is closer to the noise generated by the vibration of the earphone device, so that a better noise reduction effect can be obtained.

Further, in an embodiment, after the step a30, the method further includes:

step B50, obtaining a residual noise signal through a feedback microphone in the earphone device;

the residual noise signal is acquired by a feedback microphone of the headphone device. For example, the earphone device may output an effective sound signal through a speaker, at this time, a signal obtained by extracting the effective sound signal from a feedback sound signal in the ear canal may be used as the residual noise signal, the earphone device may not output the effective sound signal, at this time, the feedback sound signal may be directly used as the residual noise signal, and in particular, the present embodiment is not limited.

Step B60, when the phase of the residual noise signal corresponding to the target frequency point is the same as the phase of the noise elimination signal, reducing the target compensation parameter of the target frequency point;

and analyzing the residual noise signal and the noise elimination signal, and determining the phase of the signal of the target frequency point in the residual noise signal and the phase of the signal of the corresponding target frequency point in the noise elimination signal. When the phases of the residual noise signal and the corresponding target frequency point in the noise elimination signal are the same, the amplitude or the energy of the noise elimination signal corresponding to the target frequency point can be determined to exceed the amplitude or the energy of the vibration noise, and at the moment, the target compensation parameter corresponding to the target frequency point can be reduced. The target compensation parameter may be reduced by reducing the target compensation parameter with a reduced scale, or may be directly subtracted from the target compensation parameter by a set value, which is not limited in this embodiment.

Step B70, when the phase of the residual noise signal corresponding to the target frequency point is different from the phase of the noise elimination signal, increasing the target compensation parameter of the target frequency point.

When the phases of the residual noise signal and the corresponding target frequency point in the noise elimination signal are the same, it can be determined that the amplitude or energy of the vibration noise of the corresponding target frequency point exceeds the amplitude or energy of the noise elimination signal, and at the moment, the target compensation parameter of the corresponding target frequency point is increased. The target compensation parameter may be increased by increasing the target compensation parameter with an increase ratio, or may be directly added with a set value, which is not limited in this embodiment.

It should be noted that, by adjusting the target compensation parameter of the target frequency point and performing compensation processing on the vibration signal subsequently acquired by the vibration sensor by using the adjusted compensation parameter, the amplitude and/or the energy of the noise cancellation signal after the compensation processing is closer to the amplitude and/or the energy of the vibration noise, a better noise reduction effect can be obtained, and the use feeling of the user using the earphone device is improved.

Further, in an embodiment, after the step a30, the method further includes:

step C10, obtaining a residual noise signal through a feedback microphone in the earphone device;

the residual noise signal is acquired by a feedback microphone of the headphone device. The residual noise signal may be obtained in various ways, for example, the earphone device may output an effective sound signal through a speaker, and at this time, a signal obtained by extracting the effective sound signal from a feedback sound signal in the ear canal may be used as the residual noise signal; the headphone apparatus may not output the valid sound signal, and the feedback sound signal may be directly used as the residual noise signal, which is not limited in this embodiment.

Step C20, determining the residual signal energy of the frequency band of the target frequency point in the residual noise signal and the eliminating signal energy of the frequency band of the target frequency point in the noise eliminating signal;

and calculating the signal energy of the frequency band of the target frequency point in the residual noise signal (hereinafter referred to as residual signal energy for distinguishing), and calculating the signal energy of the frequency band of the target frequency point in the noise elimination signal (hereinafter referred to as elimination signal energy for distinguishing).

Step C30, determining the actual signal energy of the frequency band where the target frequency point is located according to the elimination signal energy and the residual signal energy, and determining the actual compensation parameter of the target frequency point according to the ratio of the actual signal energy to the frequency band signal energy;

the actual signal energy of the frequency band where the target frequency point is located can be calculated according to the elimination signal energy and the residual signal energy corresponding to the target frequency point, and the signal energy is called as the actual signal energy for distinguishing.

The calculation of the actual signal energy may be performed according to specific situations, in one embodiment, when the phase of the residual noise signal corresponding to the target frequency point is the same as the phase of the noise cancellation signal, it is indicated that the energy of the noise cancellation signal is higher than the noise, and the difference between the energy of the cancellation signal and the energy of the residual signal may be calculated to obtain the actual signal energy, in another embodiment, when the phase of the residual noise signal corresponding to the target frequency point is different from the phase of the noise cancellation signal, it is indicated that the energy of the noise cancellation signal is lower than the noise, and the sum of the energy of the cancellation signal and the energy of the residual signal may be calculated to obtain the actual signal energy.

And determining a compensation parameter of the target frequency point according to the ratio of the actual signal energy to the frequency band signal energy, wherein the compensation parameter is called as an actual compensation parameter for distinguishing. The actual compensation parameters may be expressed in various forms, in one embodiment, the actual signal energy corresponding to the frequency band of the target frequency point may be divided by the frequency band signal energy to obtain the actual compensation parameters, in another embodiment, the frequency band signal energy corresponding to the frequency band of the target frequency point may be divided by the actual signal energy to obtain the actual compensation parameters, and in this embodiment, the present invention is not limited specifically. It can be understood that the compensation processing modes corresponding to the actual compensation parameters of different expressions are different, and the actual compensation parameters of different expressions are the same as the target compensation parameters of the corresponding expressions in the compensation processing mode.

And step C40, updating the target compensation parameters corresponding to the target frequency points into the actual compensation parameters.

And updating the target compensation parameters corresponding to the target frequency points into actual compensation parameters for processing the signals of the target frequency points in the vibration signals subsequently acquired by the vibration sensor.

In another embodiment, the target compensation parameter may be adjusted by comparing amplitudes of the residual noise signal and the noise cancellation signal corresponding to the target frequency point.

And acquiring a signal amplitude of a target frequency point in the residual noise signal, hereinafter referred to as residual signal amplitude, and acquiring a signal amplitude of a target frequency point in the noise elimination signal, hereinafter referred to as elimination signal amplitude, for distinguishing. And calculating the actual signal amplitude of the target frequency point according to the residual signal amplitude and the elimination signal amplitude, wherein the actual signal amplitude is referred to as the actual signal amplitude for distinguishing.

The calculation of the actual signal amplitude may be performed according to specific conditions, in one embodiment, when the phase of the residual noise signal corresponding to the target frequency point is the same as the phase of the noise cancellation signal, it is indicated that the amplitude of the noise cancellation signal is higher than the vibration noise, and the difference between the amplitude of the cancellation signal and the amplitude of the residual signal may be calculated to obtain the actual signal amplitude, in another embodiment, when the phase of the residual noise signal corresponding to the target frequency point is different from the phase of the noise cancellation signal, it is indicated that the amplitude of the noise cancellation signal is lower than the vibration noise, and the sum of the amplitude of the cancellation signal and the amplitude of the residual signal may be calculated to obtain the actual signal amplitude.

And determining a compensation parameter of the target frequency point according to the ratio of the actual signal amplitude to the signal amplitude of the target frequency point in the vibration signal (hereinafter referred to as the frequency point signal amplitude for distinguishing), wherein the compensation parameter is referred to as the actual compensation parameter for distinguishing. The actual compensation parameters may be expressed in various forms, in one embodiment, the actual signal amplitude of the target frequency point may be divided by the actual compensation parameters of the frequency point signal amplitude, in another embodiment, the actual compensation parameters may be obtained by dividing the frequency point signal amplitude of the target frequency point by the actual signal amplitude, and in this embodiment, the present invention is not limited specifically. It can be understood that the compensation processing modes corresponding to the actual compensation parameters of different expressions are different, and the actual compensation parameters of different expressions are the same as the target compensation parameters of the corresponding expressions in the compensation processing mode.

In this embodiment, by obtaining the residual noise signal and adjusting the target compensation parameter according to the residual noise signal, the amplitude and/or the energy of the noise cancellation signal after compensation processing is closer to the amplitude and/or the energy of the vibration noise, a better noise reduction effect can be obtained, and the use feeling of the user using the earphone device is improved.

In one embodiment, referring to fig. 3, an external sound signal is acquired by a feedforward microphone of the headphone device, an analog signal is generated, the analog signal is converted into a digital signal by an analog-to-digital converter, a low-frequency signal possibly acquired by the feedforward microphone is filtered by a high-frequency filter in the drawing, and the processed external sound signal is superimposed with a sound source signal inside the headphone device to obtain an effective sound signal. One path of effective sound signal is converted into an analog signal through a digital-analog converter and is emitted through a loudspeaker of the earphone device, and the other path of effective sound signal is input into the controller.

The method comprises the steps that a vibration signal is obtained through a vibration sensor on the earphone device, an analog-digital converter converts an analog signal into a digital signal, the digital signal is input into a low-frequency filter and a digital signal processor, a low-frequency filter filters out a high-frequency signal which can be obtained by the vibration sensor, the digital signal processor processes the vibration signal to obtain a noise elimination signal, the noise elimination signal is converted into an analog signal through a digital-analog converter, and the analog signal is sent out through a loudspeaker of the earphone device.

A feedback microphone is arranged at the position of a loudspeaker of the earphone device to pick up an effective sound signal, a noise elimination signal and noise in an ear canal of a user, the effective sound signal, the noise elimination signal and the noise are converted into a digital signal through an analog-digital converter, difference calculation is carried out on the digital signal and the effective sound signal in a controller to obtain residual signal energy of a residual noise signal, and compensation parameters in a digital signal processor are adjusted according to the residual signal energy.

The present invention also provides a noise reduction apparatus disposed in a headset device, wherein the headset device is provided with a vibration sensor, and with reference to fig. 3, the noise reduction apparatus includes:

the acquisition module 10 is used for acquiring a vibration signal through the vibration sensor;

the processing module 20 is configured to process the vibration signal to obtain a noise cancellation signal, where the noise cancellation signal is used to cancel noise corresponding to the vibration signal;

and an output module 30 for outputting the noise cancellation signal using a speaker of the earphone device.

Further, the processing module 20 is further configured to:

the processing module 20 is further configured to:

Further, the processing module 20 is further configured to:

acquiring a preset target compensation parameter;

Further, the processing module 20 is further configured to:

Further, the noise reduction apparatus further includes an adjusting module, where the adjusting module is configured to:

Further, the adjusting module is further configured to:

For each embodiment of the noise reduction device of the present invention, reference may be made to each embodiment of the noise reduction method of the present invention, and details are not repeated here.

In addition, the embodiment of the invention also provides earphone equipment, which comprises a structural shell, a communication module, a main control module (such as a Micro Control Unit (MCU)), a vibration sensor, a loudspeaker, a microphone, a memory and the like. The main control module can comprise a microprocessor, an audio decoding unit, a power supply and power supply management unit, a sensor and other active or passive devices required by the system and the like (which can be replaced, deleted or added according to actual functions), so that the audio receiving and playing functions are realized. The earphone device can establish a communication connection with the user terminal through the communication module. The memory of the headset may have a sound signal processing program stored therein, and the microprocessor may be configured to call the sound signal processing program stored in the memory and perform the following operations:

acquiring a vibration signal through the vibration sensor;

outputting the noise cancellation signal using a speaker of the headphone apparatus.

Further, at least two vibration sensors are disposed in the earphone device, and the operation of processing the vibration signals to obtain noise cancellation signals includes:

Further, the operation of acquiring the weighting coefficient set of each of the vibration sensors includes:

the operation of processing the signal obtained by weighting and superimposing the vibration signal corresponding to each vibration sensor by using the weighting coefficient group to obtain the noise elimination signal includes:

Further, the processing the vibration signal to obtain a noise cancellation signal includes:

acquiring a preset target compensation parameter;

Further, the operation of performing compensation processing on the signals of the target frequency points in the vibration signals by using the target compensation parameters to obtain compensation signals includes:

Further, after the operation of outputting the noise cancellation signal by using the speaker of the earphone device, the microprocessor may be further configured to call a sound signal processing program stored in the memory, and perform the following operations:

For the embodiments of the earphone device of the present invention, reference may be made to the embodiments of the sound signal processing method of the present invention, and details are not repeated here.

Furthermore, an embodiment of the present invention further provides a computer-readable storage medium, where a noise reduction program is stored on the storage medium, and the noise reduction program, when executed by a processor, implements the steps of the noise reduction method as described above.

For the embodiments of the computer-readable storage medium of the present invention, reference may be made to the embodiments of the noise reduction method of the present invention, and details are not described herein again.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.

The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) as described above and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.

The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims

1. A noise reduction method is applied to a headset device, a vibration sensor is arranged on the headset device, and the noise reduction method comprises the following steps:

acquiring a vibration signal through the vibration sensor;

2. The noise reduction method according to claim 1, wherein at least two of the vibration sensors are provided in the headphone apparatus, and the step of processing the vibration signals to obtain noise cancellation signals comprises:

3. The noise reduction method according to claim 2, wherein the step of obtaining the set of weighting coefficients for each of the vibration sensors includes:

4. A method of reducing noise according to any of claims 1 to 3, wherein the step of processing the vibration signal to obtain a noise cancellation signal comprises:

acquiring a preset target compensation parameter;

5. The noise reduction method according to claim 4, wherein the step of performing compensation processing on the signals of the target frequency points in the vibration signals by using the target compensation parameters to obtain compensation signals comprises:

6. The noise reduction method as claimed in claim 5, wherein after the step of outputting the noise cancellation signal using the speaker of the headphone apparatus, further comprising:

7. The noise reduction method according to claim 4, wherein after the step of outputting the noise cancellation signal using the speaker of the headphone apparatus, further comprising:

8. The noise reduction method according to claim 4, wherein after the step of outputting the noise cancellation signal with the speaker of the headphone apparatus, further comprising:

9. An earphone device, characterized in that the device comprises: a memory, a processor and a noise reduction program stored on the memory and executable on the processor, the noise reduction program being configured to implement the steps of the noise reduction method according to any of claims 1 to 8.

10. A storage medium having stored thereon a noise reduction program which, when executed by a processor, implements the steps of the noise reduction method according to any one of claims 1 to 8.