WO2020248113A1 - 一种骨传声信号处理方法、装置、芯片、耳机及存储介质 - Google Patents

一种骨传声信号处理方法、装置、芯片、耳机及存储介质 Download PDF

Info

Publication number
WO2020248113A1
WO2020248113A1 PCT/CN2019/090662 CN2019090662W WO2020248113A1 WO 2020248113 A1 WO2020248113 A1 WO 2020248113A1 CN 2019090662 W CN2019090662 W CN 2019090662W WO 2020248113 A1 WO2020248113 A1 WO 2020248113A1
Authority
WO
WIPO (PCT)
Prior art keywords
gain
frame
bone
wave signal
acoustic
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2019/090662
Other languages
English (en)
French (fr)
Inventor
陈高波
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Goodix Technology Co Ltd
Original Assignee
Shenzhen Goodix Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Goodix Technology Co Ltd filed Critical Shenzhen Goodix Technology Co Ltd
Priority to PCT/CN2019/090662 priority Critical patent/WO2020248113A1/zh
Priority to CN201980001396.2A priority patent/CN112400326B/zh
Publication of WO2020248113A1 publication Critical patent/WO2020248113A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Electric hearing aids

Definitions

  • This application relates to the field of signal processing, and in particular to a method, device, chip, earphone, and storage medium for bone-borne sound signal processing.
  • the human ear can hear its own voice through three paths, the A3 path: the sound wave signal less than 1.5kHz passes through the mouth 6, the air around the head 7, into the ear canal 2, and finally causes the eardrum 3 to vibrate; Path A2: Part of the sound wave signal less than 1.5kHz passes through the throat bone and cartilage tissue of the neck to reach the ear canal 2, causing the eardrum 3 to vibrate; Path A1: The sound wave signal higher than 1.5kHz passes through the cartilage tissue of the throat and head Reach middle ear 4 or inner ear 5. After the earphone is inserted into the human ear 1, the eardrum 3, the ear canal 2, and the earphone form a three-dimensional closed space.
  • part of the sound wave signals below 1.5 kHz can still reach the ear canal 2 through the throat bone and neck soft tissue.
  • the three-dimensional airtight space blocks the sound wave transmission channel, and the sound wave signal will oscillate in the ear canal 2, and the sound pressure will increase when it reaches the eardrum, which makes the wearer uncomfortable and produces an occlusion effect.
  • the most common method to improve the occlusion effect is to design one or more through holes in the earpiece, but this method can cause environmental noise to leak into the ear.
  • this application provides a bone sound signal processing method, device, chip, earphone, and storage medium.
  • the first aspect of the embodiments of the present application provides a bone acoustic signal processing method, including: a bone acoustic sensor collects a bone conduction acoustic wave signal, and the bone acoustic sensor contacts the ear canal or is formed between a solid medium and the ear canal. Vibration conduction path; processing the bone conduction acoustic wave signal, including inversion; transmitting the processed bone conduction acoustic wave signal to the human ear.
  • transmitting the processed bone conduction sound wave signal to the human ear includes: the speaker of the earphone plays the processed bone conduction sound wave signal; or the bone conduction sound sensor transmits The processed bone conduction sound wave signal is transmitted to the human ear.
  • the processing further includes adjusting the amplitude of the bone conduction acoustic wave signal in the preset frequency band according to the sensitivity of the bone acoustic sensor;
  • adjusting the amplitude of the bone conduction acoustic wave signal in the preset frequency band according to the sensitivity of the bone acoustic sensor includes: setting the frequency point The first gain of the amplitude of the bone conduction acoustic wave signal is inversely proportional to the sensitivity of the bone acoustic sensor corresponding to the frequency point.
  • the processing before adjusting the amplitude of the bone conduction acoustic wave signal in the preset frequency band according to the sensitivity of the bone acoustic sensor, the processing further includes The frequency sensitivity curve of the bone acoustic sensor is fitted, and the fitting includes a linear fitting, a quadratic curve fitting or a cubic curve fitting.
  • the processing further includes adjusting according to the fourth sound wave signal of the previous frame The second gain of the amplitude of the bone conduction acoustic wave signal, and the amplification factor of the amplitude includes the second gain;
  • the fourth sound wave signal is obtained by subtracting the useful sound signal from the second sound wave signal.
  • the second sound wave signal is collected by the microphone of the headset in the ear canal when the speaker plays the processed bone conduction sound wave signal.
  • the useful sound signal is processed by the speaker.
  • the speaker broadcasts the sound wave signal except the processed bone conduction sound wave signal.
  • adjusting the second gain of the amplitude of the bone conduction acoustic wave signal according to the fourth acoustic wave signal of the previous frame includes:
  • the second gain of the Nth frame is less than the second gain of the (N-1)th frame, and the energy of the fourth sound wave signal of the Nth frame is greater than the energy of the fourth sound wave signal of the (N-1)th frame
  • set The second gain of the (N+1)th frame is greater than the second gain of the Nth frame, or if the energy of the fourth acoustic wave signal of the Nth frame is less than or equal to the energy of the fourth acoustic wave signal of the (N-1)th frame , Then set the second gain of the (N+1)th frame to be less than or equal to the second gain of the Nth frame; or if the second gain of the Nth frame is greater than the second gain of the (N-1)th frame, and the Nth frame If the energy of the fourth acoustic signal of the frame is greater than the energy of the fourth acoustic signal of the (N-1)th frame, the second gain of the (N+1)th frame is set to be smaller than the second gain of the Nth frame
  • setting the second gain of the (N+1)th frame to be less than or equal to the second gain of the Nth frame includes:
  • the second gain of the (N+1)th frame is set to be smaller than the second gain of the Nth frame, or the fourth sound wave signal of the Nth frame does not satisfy the first Under a preset condition, set the second gain of the (N+1)th frame to be equal to the second gain of the current frame;
  • Setting the second gain of the (N+1)th frame to be greater than or equal to the second gain of the Nth frame includes: when the fourth sound wave signal of the Nth frame meets the first preset condition, setting the (N+1)th frame The second gain is greater than the second gain of the Nth frame, or when the fourth acoustic signal of the Nth frame does not meet the first preset condition, the second gain of the (N+1) frame is set equal to the second gain of the current frame.
  • the first preset condition includes:
  • the energy of the fourth acoustic wave signal is greater than or equal to the first energy threshold, and the first energy threshold is less than or equal to 3dB; or
  • the energy ratio is greater than or equal to the energy ratio threshold; the energy ratio is the ratio of the energy of the fourth acoustic wave signal to the energy of the processed bone conduction acoustic wave signal, and the energy ratio threshold is less than or equal to 0.1, 0.2, 0.3, 0.4 or 0.5.
  • the first aspect of the (N+1)th frame when the fourth acoustic signal of the Nth frame satisfies the first preset condition, the first aspect of the (N+1)th frame is set
  • the second gain is less than the second gain of the Nth frame, or setting the second gain of the (N+1)th frame to be greater than the second gain of the Nth frame includes:
  • the difference between the second gain of the (N+1)th frame and the second gain of the Nth frame is set to be greater Including:
  • the difference between the second gain of the (N+1)th frame and the second gain of the Nth frame is set to be proportional to the difference between the energy ratio of the Nth frame and the energy ratio threshold.
  • adjusting the second gain of the amplitude of the bone conduction acoustic wave signal according to the fourth acoustic wave signal of the previous frame further includes:
  • the second gain of the second frame is set to be smaller than the second gain of the first frame, or the second gain of the second frame is set to be greater than the second gain of the first frame.
  • the second gain of the second frame is set equal to the second gain of the first frame.
  • the processing further includes adjusting the bone conduction sound wave signal of the next frame. Phase.
  • it further includes selecting a bone acoustic sensor, and selecting the bone acoustic sensor includes:
  • the bone acoustic sensor is selected according to the flatness of the frequency sensitivity curve of the normalized bone acoustic sensor.
  • a second aspect of the embodiments of the present application provides a bone sound signal processing device, including:
  • the bone sound sensor module is used to collect bone conduction sound wave signals.
  • the bone sound sensor module contacts the ear canal or forms a vibration transmission path between the solid medium and the ear canal;
  • the bone sound transmission processing module is used to process bone conduction sound wave signals, and the bone sound transmission processing module includes an inversion module; and
  • the output module is used to transmit the processed bone conduction sound wave signal to the human ear.
  • the output module includes:
  • the speaker module is used to play the processed bone conduction sound wave signal
  • the bone sound processing module is also used to transmit the processed bone conduction sound wave signal to the human ear.
  • the bone-borne sound processing module further includes
  • the first amplitude processing module is configured to adjust the amplitude of the bone conduction acoustic wave signal in the preset frequency band according to the sensitivity of the bone acoustic sensor module;
  • the first amplitude processing module is further configured to set the first gain and frequency of the amplitude of the bone conduction acoustic wave signal at the frequency point.
  • the sensitivity of the bone acoustic sensor module corresponding to the point is inversely proportional.
  • the bone sound transmission processing module before the first amplitude processing module, further includes a fitting module, which is used to align the bone The frequency sensitivity curve of the acoustic sensor module is fitted, and the fitting includes a linear fitting, a quadratic curve fitting, or a cubic curve fitting.
  • the bone-borne sound processing module further includes a second amplitude processing module, and the second amplitude processing module is used for Adjusting the second gain of the amplitude of the bone conduction acoustic wave signal according to the fourth acoustic wave signal of the previous frame;
  • the fourth sound wave signal is obtained by subtracting the useful sound signal from the second sound wave signal.
  • the second sound wave signal is collected by the microphone of the headset in the ear canal when the speaker module plays the processed bone conduction sound wave signal, and the useful sound signal is played by the speaker module When the processed bone conduction sound wave signal is processed, the speaker module plays a sound wave signal other than the processed bone conduction sound wave signal.
  • the second amplitude processing module includes:
  • Gain adjustment module if the second gain of the Nth frame is smaller than the second gain of the (N-1)th frame, and the energy of the fourth acoustic wave signal of the Nth frame is greater than that of the fourth acoustic wave signal of the (N-1)th frame Energy, the gain adjustment module is used to set the second gain of the (N+1)th frame to be greater than the second gain of the Nth frame, or if the energy of the fourth acoustic wave signal of the Nth frame is less than or equal to the (N-1)th frame The energy of the fourth acoustic wave signal of the frame, the gain adjustment module is further configured to set the second gain of the (N+1)th frame to be less than or equal to the second gain of the Nth frame; or
  • gain adjustment The module is also used to set the second gain of the (N+1)th frame to be less than the second gain of the Nth frame, or, if the energy of the fourth acoustic signal of the Nth frame is less than or equal to the energy of the (N-1)th frame
  • the gain adjustment module is also used to set the second gain of the (N+1)th frame to be greater than or equal to the second gain of the Nth frame, where N>1 and an integer.
  • the gain adjustment module is further configured to set the second gain of the (N+1)th frame to be less than or equal to the second gain of the Nth frame.
  • Two gains include:
  • the gain adjustment module is further configured to set the second gain of the (N+1)th frame to be smaller than the second gain of the Nth frame, or the second gain of the Nth frame
  • the gain adjustment module is further configured to set the second gain of the (N+1)th frame equal to the second gain of the current frame
  • the gain adjustment module is further configured to set the second gain of the (N+1)th frame to be greater than or equal to the second gain of the Nth frame, including:
  • the gain adjustment module is further configured to set the second gain of the (N+1)th frame to be greater than the second gain of the Nth frame, or the second gain of the Nth frame
  • the gain adjustment module is further configured to set the second gain of the (N+1) frame equal to the second gain of the current frame.
  • the first preset condition includes:
  • the energy of the fourth acoustic signal is greater than or equal to the first energy threshold, and the first energy threshold is less than or equal to 3dB; or
  • the energy ratio is greater than or equal to the energy ratio threshold; the energy ratio is the ratio of the energy of the fourth acoustic wave signal to the energy of the processed bone conduction acoustic wave signal, and the energy ratio threshold is less than or equal to 0.1, 0.2, 0.3, 0.4 or 0.5.
  • the gain adjustment module when the fourth acoustic signal of the Nth frame meets the first preset condition, the gain adjustment module is also used to set the (Nth) +1) The second gain of the frame is smaller than the second gain of the Nth frame, or the gain adjustment module is further configured to set the second gain of the (N+1)th frame to be greater than the second gain of the Nth frame, including:
  • the gain adjustment module is also used to set the greater the difference between the second gain of the (N+1)th frame and the second gain of the Nth frame .
  • the gain adjustment module is further configured to set the second gain of the (N+1)th frame and the second gain of the Nth frame The greater the difference between includes:
  • the gain adjustment module is further configured to set the difference between the second gain of the (N+1)th frame and the second gain of the Nth frame to be proportional to the energy of the fourth sound wave signal of the Nth frame;
  • the gain adjustment module is also used to set the difference between the second gain of the (N+1)th frame and the second gain of the Nth frame and the energy of the fourth acoustic wave signal of the Nth frame and the first energy threshold.
  • the difference is proportional; or
  • the gain adjustment module is also used to set the difference between the second gain of the (N+1)th frame and the second gain of the Nth frame to be proportional to the energy ratio of the Nth frame;
  • the gain adjustment module is also used to set the difference between the second gain of the (N+1)th frame and the second gain of the Nth frame in proportion to the difference between the energy ratio of the Nth frame and the energy ratio threshold.
  • the second amplitude processing module is configured to adjust the amplitude of the bone conduction acoustic wave signal according to the fourth acoustic wave signal of the previous frame.
  • the second gain also includes:
  • the second amplitude processing module is further configured to set the second gain of the second frame to be smaller than the second gain of the first frame, or the second amplitude processing module It is also used to set the second gain of the second frame to be greater than the second gain of the first frame; or
  • the second amplitude processing module is further configured to set the second gain of the second frame to be equal to the second gain of the first frame.
  • the bone transmission processing module further includes:
  • the phase adjustment module is used to adjust the phase of the bone conduction sound wave signal in the next frame.
  • the phase adjustment module when the second amplitude processing module continuously adjusts the bone conduction acoustic wave signal of M frames according to the fourth acoustic wave signal of the previous frame After the second gain of the amplitude, the phase adjustment module is also used to adjust the phase of the bone conduction acoustic wave signal of the next frame of the bone conduction acoustic wave signal of frame M.
  • the adjustment range of the phase is -20 degrees to +20 degrees, and M is an integer. And M>1.
  • the bone sound sensor selection module is used to select the bone sound sensor module.
  • the bone sound sensor selection module selects the bone sound sensor module according to the flatness of the frequency sensitivity curve of the normalized bone sound sensor module.
  • the third aspect of the embodiments of the present application provides a chip for executing the bone sound signal processing method of the first aspect.
  • a fourth aspect of the embodiments of the present application provides a headset, including the chip of the third aspect.
  • a fifth aspect of the embodiments of the present application provides a computer-readable storage medium, including a computer program stored thereon, and the computer program is executed by a processor to implement the bone-borne sound signal processing method of the first aspect.
  • the beneficial effects of the embodiments of the present application are: the embodiments of the present application provide a bone-borne sound signal processing method, device, chip, earphone, and storage medium, and the bone-conductive sound wave signal is collected by the bone-borne sound sensor In addition, the bone conduction sound wave signal is inverted and transmitted to the human ear, which solves the problem of the occlusion effect of the earphone and significantly improves the user experience.
  • Figure 1 is a schematic diagram of an acoustic signal transmission path according to an embodiment of the application
  • Fig. 2 is a flowchart of a bone sound signal processing method according to an embodiment of the application
  • FIG. 3 is a system block diagram of a bone sound signal processing method according to an embodiment of the application.
  • FIG. 4 is a system block diagram of another bone sound signal processing method according to an embodiment of the application.
  • Fig. 5 is a frequency sensitivity curve of the bone acoustic sensor according to an embodiment of the application.
  • Figure 6 is a frequency sensitivity curve and a fitting curve of an embodiment of the application.
  • FIG. 7 is a flowchart of another bone sound signal processing method according to an embodiment of the application.
  • FIG. 8 is a schematic diagram of another acoustic signal transmission path in an embodiment of the application.
  • FIG. 9 is a flowchart of another bone sound signal processing method according to an embodiment of the application.
  • FIG. 10 is a flowchart of another bone sound signal processing method according to an embodiment of the application.
  • FIG. 11 is a flowchart of another bone sound signal processing method according to an embodiment of the application.
  • FIG. 12 is a schematic structural diagram of a bone sound signal processing device provided by this embodiment.
  • FIG. 2 is a flowchart of the bone-borne sound signal processing method according to an embodiment of the application. The method includes the following steps:
  • the bone sound sensor collects bone conduction sound wave signals, and the bone sound sensor contacts the ear canal or forms a vibration transmission path between the solid medium and the ear canal.
  • the bone sound sensor can directly or indirectly contact the ear canal in order to collect the sound wave signal transmitted into the ear canal 2 through the A2 path.
  • the bone conduction sound wave signal includes the sound wave signal less than 1.5kHz, and can also include part greater than Or equal to 1.5kHz sound wave signal, the bone acoustic sensor can be in contact with the ear canal through a solid medium.
  • the solid can be metal or non-metal.
  • the bone acoustic sensor can be mounted on a flexible circuit board or a printed circuit board.
  • the flexible circuit board or printed circuit board contacts the ear canal through the earphone housing structure, thereby constructing a solid vibration transmission path to collect the sound wave signal transmitted to the ear canal 2 through the A2 path, or the bone sound sensor can be injected It is set inside the plastic of the earphone shell.
  • the bone sound sensor can also directly contact the ear canal.
  • the bone sound sensor can be arranged outside the earphone shell structure and attached to the surface of the earphone shell to contact the ear canal. .
  • the bone conduction sound wave signal After the bone conduction sound wave signal is collected by the bone sound sensor, it reverses the bone conduction sound wave signal, that is, rotates the phase of the bone conduction sound wave signal by 180°.
  • the bone conduction sound wave signal can be understood as the sound wave transmitted to the ear canal 2 through the A2 path
  • FIG. 3 is a system block diagram of the bone sound signal processing method according to an embodiment of the application.
  • the bone sound sensor 8 collects the bone conduction sound wave signal and passes through the system H(w ) Process the bone conduction acoustic wave signal.
  • H(w) includes inversion processing.
  • Transmitting the inverted bone conduction acoustic wave signal 10 to the human ear can cancel the acoustic wave signal 11 transmitted into the ear canal 2 through the A2 path.
  • the inverted bone conduction acoustic wave signal 10 and the acoustic wave signal 11 transmitted to the ear canal 2 through the A2 path have the same amplitude and opposite phase. After the two are superimposed, the acoustic wave signal 12 with an amplitude of 0 is eliminated.
  • the sound wave signal 10 transmitted through the A2 path to the ear canal 2 can improve the occlusion effect.
  • transmitting the processed bone conduction sound wave signal to the human ear through the speaker 9 is only an example, and other The processed bone conduction sound wave signal is transmitted to the human ear.
  • the processed bone conduction sound wave signal can be played at the same time as the useful sound signal.
  • the sound signal is a sound wave signal that the user actively chooses to play, for example, music or call voice.
  • This embodiment can be applied to various types of earphones such as earphones, in-ear earphones, or headsets.
  • FIG. 4 is another system block diagram of the bone sound signal processing method according to the embodiment of the application.
  • the bone sound sensor 8 collects bone conduction sound wave signals, and the bone sound sensor 8 directly or indirectly interacts with The ear canal contacts, thereby constructing a solid conductive path A21 to collect the sound wave signal transmitted into the ear canal 2 through the A2 path.
  • the bone conduction sound wave signal can be processed by the processor 14 in the earphone 0.
  • the processing includes inversion. Therefore, the processor can also be an inverter.
  • the processed bone conduction signal can be processed through the speaker 9
  • the sound wave signal is transmitted to the human ear, but this embodiment does not limit the specific manner of transmitting the processed bone conduction sound wave signal to the human ear.
  • the transmission of the processed bone conduction sound wave signal to the human ear may include the following two methods:
  • Method 1 The speaker of the earphone plays the processed bone conduction sound wave signal
  • Method 2 The bone sound sensor transmits the processed bone conduction sound wave signal to the human ear.
  • the processed bone conduction sound wave signal is transmitted to the human ear by way 1, as shown in FIG. 4, the processed bone conduction sound wave signal can be transmitted to the human ear through the speaker 9 to achieve the purpose of improving the occlusion effect.
  • the speaker 9 plays the processed bone conduction sound wave signal, if there is a useful sound signal that needs to be played, the processed bone conduction sound wave signal can be played simultaneously with the useful sound signal.
  • the processed bone conduction sound wave signal can be transmitted to the human ear directly through the vibration of the vibrator of the bone sound sensor 8.
  • the source can be a duplex vibrator, which can output vibration signals and collect vibration signals.
  • a bone sound sensor can be used to simultaneously collect bone conduction sound wave signals and transmit the processed bone conduction sound wave signals to people. Ear, this embodiment can also be implemented by using two bone conduction sound sensors, one bone sound sensor collects bone conduction sound wave signals, and the other bone sound sensor transmits the processed bone conduction sound wave signals to the human ear.
  • the processing further includes adjusting the amplitude of the bone conduction acoustic wave signal in the preset frequency band according to the sensitivity of the bone acoustic sensor. Due to the difference in the sensitivity of the bone acoustic sensor at different vibration frequencies, it may cause the amplitude of different frequency components in the bone conduction sound wave signal collected by the bone acoustic sensor to have different changes. For example, as shown in Figure 5 Take the frequency sensitivity curve of the acoustic sensor as an example.
  • the bone conduction acoustic wave signal below 1kHz is more attenuated, while the bone conduction acoustic wave signal above 1kHz is relatively less attenuated, so that the bone conduction acoustic wave signal is transmitted to the A2 path.
  • the acoustic signals in the ear canal 2 are quite different, so that the improvement effect of the occlusion effect is not obvious.
  • the attenuation of the bone conduction acoustic wave signal at different frequency points is different by the bone acoustic sensor. Adjusting the amplitude of the bone conduction acoustic wave signal according to the sensitivity of the bone acoustic sensor can further improve the effect of improving the occlusion effect.
  • the frequency range of the voice signal is 300Hz-3.4kHz, so the preset frequency band can be 300Hz-3.4kHz; because the sound wave signal transmitted to the ear canal 2 through the A2 path is mainly concentrated in the frequency band below 1.5kHz, therefore, the preset The frequency band may also be 300 Hz-1.5 kHz, and this embodiment does not limit the specific frequency interval of the preset frequency band. Adjusting the amplitude of the bone conduction acoustic wave signal in the preset frequency band according to the sensitivity of the bone acoustic sensor can further improve the effect of improving the occlusion effect.
  • the sensitivity of the bone acoustic sensor corresponding to the frequency point in the preset frequency band when the sensitivity of the bone acoustic sensor corresponding to the frequency point in the preset frequency band is higher, you can set the amplitude of the bone conduction acoustic wave signal at that frequency point The smaller the first gain.
  • the amplification factor of the amplitude includes the first gain, that is, the first gain is one of the amplification factors of the amplitude. The higher the sensitivity of the bone acoustic sensor to a certain frequency point, the more the signal at that frequency point is attenuated It can be almost completely collected by the bone sound sensor or amplified by the bone sound sensor.
  • the first gain of the amplitude of the bone conduction sound wave signal at this frequency point can be set to be smaller, for example, it can be set to be smaller than 1.
  • the first gain of the amplitude of the bone conduction acoustic wave signal at this frequency point can be set larger, for example, it can be set to be greater than 1, in order to correct the bone conduction acoustic wave signal collected by the bone acoustic sensor. The role of the occlusion effect is further improved.
  • the correlation value between the useful sound signal and the collected bone conduction sound wave signal can also be calculated to evaluate whether the collected useful sound signal is weak. If the useful sound signal is more correlated with the collected bone conduction sound wave signal Weak, it proves that the collected useful sound signal is weak, and there is no need to eliminate the weak useful sound signal contained in the collected bone conduction sound wave signal. If the useful sound signal has a strong correlation with the collected bone conduction sound wave signal, then It can eliminate the weak useful sound signal contained in the collected bone conduction sound wave signal. For example, subtract the product of the inverted useful sound signal and the phase relationship from the collected bone conduction sound wave signal to make the collected bone conduction sound signal The sound wave signal is closer to the sound wave signal transmitted into the ear canal 2 through the A2 path.
  • adjusting the amplitude of the bone conduction acoustic wave signal in the preset frequency band according to the sensitivity of the bone acoustic sensor includes: setting the first gain of the amplitude of the bone conduction acoustic wave signal at the frequency point
  • the sensitivity of the bone acoustic sensor corresponding to this frequency point is inversely proportional.
  • the f represents frequency
  • Y(f) represents sensitivity
  • B represents the DC compensation value of the frequency sensitivity curve
  • k represents the slope of the frequency sensitivity curve
  • * represents the product
  • the first gain of the amplitude of the bone conduction acoustic wave signal in the current frame can be set by setting the value of the system function H(w). Since the sensitivity of the bone acoustic sensor corresponding to each frequency point may be different, any frequency can be set.
  • the first gain of the amplitude of the bone conduction acoustic wave signal at a point is inversely proportional to the sensitivity corresponding to the frequency point, so as to perform data correction on the bone conduction acoustic wave signal collected by the bone acoustic sensor, and further improve the effect of improving the occlusion effect .
  • the processing before adjusting the amplitude of the bone conduction acoustic wave signal in the preset frequency band according to the sensitivity of the bone acoustic sensor, the processing also includes fitting the frequency sensitivity curve of the bone acoustic sensor Generally, the frequency sensitivity curve of the bone acoustic sensor is not flat.
  • the frequency sensitivity curve of the bone acoustic sensor can be fitted, and the frequency sensitivity curve of the bone acoustic sensor can be fitted according to the fitted bone transmission.
  • the sensitivity of the acoustic sensor adjusts the amplitude of the bone conduction sound wave signal in the preset frequency band, and there is no need to store the sensitivity corresponding to each frequency point, so as to save memory and reduce power consumption.
  • the fitting can include linear fitting, quadratic curve fitting, cubic curve fitting, etc.
  • the frequency sensitivity curve and fitting curve of the bone acoustic sensor shown in Figure 6 Take the frequency sensitivity curve and fitting curve of the bone acoustic sensor shown in Figure 6 as an example, assuming that the preset frequency band is 300Hz-1.5 kHz, the frequency sensitivity curve of the preset frequency band is a thick black line with a black square mark in the figure.
  • the fitting of the frequency sensitivity curve can be a quadratic curve fitting, for example, the black thin line shown in Figure 6
  • the resultant curve: Y(f) -2e -6 f 2 +0.0044f-23.476, Y(f) represents the sensitivity, the fitting curve is the fitting of the thick black line with the black square mark, it should be noted that, The fitting curve is only illustrative. For different frequency sensitivity curves, different fitting curves and fitting parameters can be selected. The smaller the fitting error, the more obvious the improvement of the occlusion effect, but the higher the number of fittings, the calculation The larger the amount, the power consumption will increase to
  • the processing further includes:
  • FIG. 8 is a schematic diagram of the acoustic wave signal transmission path in the embodiment of the application.
  • the fourth acoustic wave signal s 4 (n) is subtracted from the second acoustic wave signal s 2 (n) by the useful acoustic signal s 0 (n) Obtained, where the second sound wave signal s 2 (n) is the bone conduction sound wave signal processed by the speaker
  • the microphone 13 of the headset collects in the ear canal 2
  • the signal collected by the microphone 13 will be fed back to the earphone to determine whether the sound wave signal transmitted to the ear canal 2 through the A2 path has been completely eliminated.
  • the acoustic signal transmitted by the A2 path to the ear canal 2 is represented by x(n), then the second acoustic signal
  • the useful sound signal s 0 (n) is the sound wave signal played by the speaker other than the processed bone conduction sound wave signal when the speaker plays the processed bone conduction sound wave signal. For example, the user actively chooses to play music or call voice. It is that s 0 (n) can also be equal to 0, that is, no useful sound signal is played through the speaker at this time.
  • Fourth acoustic signal When the energy of the fourth sound wave signal exists, it means that the sound wave signal transmitted to the ear canal 2 through the A2 path has not been completely eliminated. The fourth sound wave signal The resulting occlusion effect may be perceived by users.
  • the fourth sound wave signal of the previous frame To adjust the second gain of the bone conduction sound wave signal of the current frame to achieve The purpose of better eliminating x(n), as shown in Figure 8, the fourth sound wave signal of the previous frame It can be understood as the amount of feedback. Using this amount of feedback to adjust the amplitude of the bone conduction acoustic signal in the current frame can make the effect of improving the occlusion effect better and better.
  • the bone conduction of the current frame can be adjusted by setting the value of the system function H(w) The second gain of the amplitude of the acoustic signal.
  • the second gain of the amplitude of the bone conduction acoustic wave signal of the current frame can also be adjusted according to the fourth acoustic wave signal of the previous frame.
  • the amplification factor includes the first gain and the second gain, and the system function H(w) can be the product of the first gain and the second gain; if the amplitude of the bone conduction acoustic wave signal is not adjusted according to the sensitivity, it can also be based on the previous frame
  • the fourth acoustic wave signal adjusts the second gain of the amplitude of the bone conduction acoustic wave signal.
  • the amplification factor of the amplitude includes the second gain
  • the system function H(w) includes the second gain.
  • FIG. 9 is a flowchart of a bone-borne sound signal processing method according to an embodiment of the application.
  • the bone-conduction sound wave signal is adjusted according to the fourth sound wave signal in the previous frame.
  • the second gain of amplitude may include the following steps:
  • N the number of frames in the current frame
  • the (N+1)th frame as the next frame
  • the (N-1)th frame as the previous frame
  • the second gain of the current frame is less than the previous frame
  • the acoustic signal adjusts the second gain of the amplitude of the bone conduction acoustic signal of the next frame.
  • the energy of the fourth acoustic signal of the current frame is greater than the energy of the fourth acoustic signal of the previous frame, it means that the second gain of the current frame is set to be less than After the second gain of the previous frame, the occlusion effect becomes more and more obvious. Therefore, set the second gain of the amplitude of the bone conduction acoustic wave signal of the next frame to be greater than the second gain of the amplitude of the current frame to improve the occlusion effect The phenomenon of deterioration; if the energy of the fourth sound wave signal of the current frame is less than the energy of the fourth sound wave signal of the previous frame, the occlusion effect is becoming less and less obvious.
  • the second gain of the next frame is less than the current
  • the second gain of the frame you can also set the second gain of the next frame equal to the second gain of the current frame to continuously improve the occlusion effect. If the energy of the fourth acoustic signal of the current frame is equal to that of the fourth acoustic signal of the previous frame Energy, you can set the second gain of the next frame to be less than or equal to the second gain of the current frame, and then adjust the energy of the next frame by judging the energy of the fourth acoustic signal of the next frame and the energy of the fourth acoustic signal of the current frame.
  • the second gain of the amplitude of the bone conduction acoustic wave signal is equal to that of the fourth acoustic signal of the previous frame Energy
  • adjusting the second gain of the amplitude of the bone conduction acoustic wave signal according to the fourth acoustic wave signal of the previous frame may include the following steps. Specifically, it may be based on the fourth acoustic wave signal of the current frame and the fourth acoustic wave signal of the previous frame.
  • FIG. 9 is a flowchart of a bone conduction acoustic signal processing method according to an embodiment of the application.
  • the energy of the fourth acoustic signal of the Nth frame is less than or equal to the energy of the fourth acoustic signal of the (N-1)th frame, set the second gain of the (N+1)th frame to be greater than or equal to the Nth frame The second gain.
  • N the number of frames as the current frame, the (N+1)th frame as the next frame, and the (N-1)th frame as the previous frame as an example.
  • the second gain of the current frame is greater than the previous frame.
  • Second gain it is necessary to adjust the second gain of the amplitude of the bone conduction acoustic signal of the next frame according to the fourth acoustic signal of the current frame. If the energy of the fourth acoustic signal of the current frame is greater than the energy of the fourth acoustic signal of the previous frame , Indicating that the occlusion effect is becoming more and more obvious.
  • the second gain of the amplitude of the bone conduction acoustic wave signal of the next frame to be smaller than the second gain of the amplitude of the current frame to improve the deterioration of the occlusion effect; if the current frame The energy of the fourth sound wave signal of is less than the energy of the fourth sound wave signal of the previous frame, indicating that the occlusion effect is becoming less and less obvious. Therefore, you can continue to set the second gain of the next frame to be greater than the second gain of the current frame. You can set the second gain of the next frame equal to the second gain of the current frame to continuously improve the occlusion effect.
  • the energy of the fourth acoustic signal of the current frame is equal to the energy of the fourth acoustic signal of the previous frame, you can set the next frame
  • the second gain of is greater than or equal to the second gain of the current frame, and the amplitude of the bone conduction acoustic wave signal of the next frame is adjusted by judging the energy of the fourth acoustic wave signal of the next frame and the energy of the fourth acoustic wave signal of the current frame The second gain;
  • step 101b the (N+1)th frame is set
  • the second gain whose second gain is less than or equal to the Nth frame may include the following steps:
  • the Nth frame is the current frame
  • the (N+1)th is the next frame as an example. If the second gain of the current frame is less than the second gain of the previous frame, it needs to be based on the The four sound wave signals adjust the second gain of the amplitude of the bone conduction sound wave signal in the next frame. If the energy of the fourth sound wave signal in the current frame is less than the energy of the fourth sound wave signal in the previous frame, the occlusion effect is less and less obvious At this time, you can determine whether the second gain of the next frame is equal to or less than the second gain of the current frame by judging whether the fourth acoustic signal of the current frame meets the first preset condition, so as to continuously improve the occlusion effect.
  • the fourth sound wave signal meets the first preset condition, it means that although the occlusion effect of the current frame is less and less obvious, the occlusion effect of the current frame still does not meet the needs of the user, and the user can perceive it. Therefore, it is necessary to continue to adjust the next frame
  • For the second gain of the amplitude of the bone conduction acoustic wave signal set the second gain of the next frame to be smaller than the second gain of the current frame to continue to improve the occlusion effect; when the fourth acoustic wave signal of the current frame does not meet the first preset condition, It shows that the occlusion effect of the current frame can be ignored, and it has almost no impact on the user experience to a certain extent. Therefore, the second gain of the next frame can be set equal to the second gain of the current frame to maintain the effect of improving the occlusion effect, so that the next The fourth sound wave signal of the frame still does not meet the first preset condition.
  • step 102b setting the second gain of the (N+1)th frame to be greater than or equal to the second gain of the Nth frame can be It includes the following steps:
  • the Nth frame is the current frame
  • the (N+1)th is the next frame as an example. If the second gain of the current frame is greater than the second gain of the previous frame, the The four sound wave signals adjust the second gain of the amplitude of the bone conduction sound wave signal in the next frame.
  • the occlusion effect is less and less obvious Therefore, you can continue to set the second gain of the next frame to be greater than the second gain of the current frame, or set the second gain of the next frame equal to the second gain of the current frame to continuously improve the occlusion effect; in this case, you can Determine whether the second gain of the next frame is equal to or greater than the second gain of the current frame by judging whether the fourth acoustic signal of the current frame meets the first preset condition to continuously improve the occlusion effect.
  • the fourth acoustic signal of the current frame meets In the first preset condition, it means that although the occlusion effect is less and less obvious, the occlusion effect of the current frame still does not meet the needs of the user, and the user can perceive it. Therefore, it is necessary to continue to adjust the amplitude of the bone conduction sound wave signal in the next frame.
  • Value of the second gain set the second gain of the next frame to be greater than the second gain of the current frame to continue to improve the occlusion effect; when the fourth sound wave signal of the current frame does not meet the first preset condition, it indicates the occlusion effect of the current frame It can be ignored and has little effect on user experience to a certain extent. Therefore, the second gain of the next frame can be set equal to the second gain of the current frame to maintain the effect of improving the occlusion effect, so that the fourth sound wave signal of the next frame Still does not meet the first preset condition.
  • the first preset condition may include:
  • First preset condition 1 The energy of the fourth acoustic wave signal is greater than or equal to the first energy threshold, and the first energy threshold is less than or equal to 3 dB;
  • the fourth sound wave signal of the previous frame is taken as an example.
  • the fourth sound wave signal of the previous frame can not only indicate the effect of improving the occlusion effect in the previous frame, but also can be used to adjust the bone conduction sound wave of the current frame
  • the second gain reference value of the signal amplitude When the energy of the fourth acoustic signal of the previous frame exists, it means that the acoustic signal of the previous frame transmitted to the ear canal 2 through the A2 path has not been completely eliminated.
  • the energy of the fourth sound wave signal in one frame is greater than or equal to the first energy threshold, The resulting occlusion effect may be perceived by the user.
  • the second gain of the amplitude of the bone conduction sound wave signal in the current frame needs to be adjusted to achieve the purpose of better eliminating x(n). It does not offset x(n-1) very well. Therefore, if you continue to process the bone conduction acoustic wave signal of the current frame according to the processing method of the bone conduction acoustic wave signal of the previous frame, the processed bone conduction acoustic wave signal of the current frame signal It is also very likely that x(n) cannot be offset well.
  • the second gain of the amplitude of the bone conduction acoustic wave signal of the current frame needs to be adjusted to make the processed bone conduction acoustic wave signal of the current frame Closer to x(n), for the fourth acoustic signal of the subsequent frame, for example, s 4 (n+1) also needs to be compared with the first energy threshold to determine whether the amplitude of the bone conduction acoustic signal of the next frame needs to be adjusted , In order to continuously improve the effect of improving the occlusion effect.
  • the selection of the first energy threshold can be selected according to application scenarios or user needs.
  • the first energy threshold can be set to be less than or equal to 3dB, and the first energy threshold can also be set to 0 or other values. It should be noted that this The embodiment does not limit the method of calculating the signal energy, and it can be solved in the time domain and the frequency domain.
  • the first preset condition 2 the energy ratio is greater than or equal to the energy ratio threshold
  • the energy ratio is the ratio of the energy of the fourth acoustic wave signal s 4 (n) to the energy of the processed bone conduction acoustic wave signal, and the energy ratio can be expressed as:
  • the energy ratio threshold may be less than or equal to 0.1, 0.2, 0.3, 0.4, or 0.5, and the energy ratio threshold may be other values selected according to application scenarios or user requirements.
  • the energy ratio of the previous frame is an example. The larger the energy ratio of the previous frame, the greater the energy ratio of the previous frame, the greater the energy ratio of the previous frame. energy of, The larger the energy ratio of, the more obvious the occlusion effect of the previous frame.
  • the energy ratio is greater than or equal to the energy ratio threshold, it means that the acoustic signal transmitted to the ear canal 2 through the A2 path has not been completely eliminated. Therefore, If you continue to follow the bone conduction sound wave signal of the previous frame
  • the processing method to process the bone conduction acoustic wave signal of the current frame then the processed bone conduction acoustic wave signal of the current frame It is also very likely that x(n) cannot be offset well. Therefore, the second gain of the amplitude of the bone conduction acoustic wave signal of the current frame needs to be adjusted to further improve the occlusion effect.
  • the energy of the fourth acoustic wave signal of the previous frame is less than the first energy threshold, or the energy ratio of the previous frame is less than the energy ratio threshold.
  • the energy of the fourth sound wave signal of the previous frame is less than the first energy threshold, or the energy ratio of the previous frame is less than the energy ratio threshold, which can indicate that the effect of improving the occlusion effect is better.
  • it is transmitted to the ear canal 2 through the A2 path
  • the sound wave signal can be almost completely eliminated, or even if there is a part of the sound wave signal transmitted to the ear canal 2 through the A2 path, it will not be perceived by the user.
  • the second gain of the amplitude of the bone conduction acoustic wave signal of the next frame can be adjusted according to the method of adjusting the second gain of the amplitude of the bone conduction acoustic wave signal of the current frame, so that the processed bone conduction of the next frame
  • the sound wave signal can also cause the sound wave signal transmitted into the ear canal 2 through the A2 path to be mostly or completely eliminated without being perceived by the user.
  • the second gain of the amplitude of the bone conduction sound wave signal at a certain frequency point of the current frame is 1.3.
  • the frequency point of the current frame is The energy of the fourth acoustic wave signal is less than the first energy threshold, and the second gain of the amplitude of the bone conduction acoustic wave signal at this frequency point in the next frame can be adjusted according to the amplitude of the bone conduction acoustic wave signal at this frequency point in the current frame.
  • Method to adjust, the amplitude of the bone conduction acoustic wave signal at this frequency point in the next frame is also amplified by 1.3 times to be able to stably and continuously improve the occlusion effect; assuming that the amplitude of the bone conduction acoustic wave signal at a certain frequency point in the current frame is equal to The second gain is 1.
  • the bone conduction sound wave signal at the frequency point in the next frame is The second gain of the amplitude can also be set to 1, that is, the amplitude of the bone conduction acoustic wave signal at this frequency point in the next frame is not processed, so as to be able to stably and continuously improve the occlusion effect.
  • the bone conduction acoustic wave signal of the current frame is the bone conduction acoustic wave signal of the first frame
  • the second gain of the amplitude of the bone conduction acoustic wave signal of the first frame cannot be based on the previous one.
  • the fourth sound wave signal of the frame is adjusted. Therefore, the bone conduction sound wave signal of the first frame does not need to adjust the second gain of its amplitude according to the fourth sound wave signal of the previous frame.
  • the second gain of the amplitude of the bone conduction acoustic wave signal in the second frame may be set to 1.
  • the second gain of the (N+1)th frame is set to be smaller than the second gain of the Nth frame
  • setting the second gain of the (N+1)th frame to be greater than the second gain of the Nth frame includes the following two methods:
  • Method 1 When the energy of the fourth acoustic wave signal of the Nth frame is greater, or the difference between the energy of the fourth acoustic wave signal of the Nth frame and the first energy threshold is greater, set the (N+1)th frame The greater the difference between the second gain of the amplitude of the bone conduction acoustic wave signal and the second gain of the Nth frame;
  • the fourth acoustic signal of the Nth frame is The energy of the fourth sound wave signal is positive.
  • the energy of the fourth sound wave signal of the Nth frame is greater, or the energy of the fourth sound wave signal of the Nth frame
  • the greater the difference between the first energy threshold and the first energy threshold it indicates that the energy of the acoustic signal x(n) transmitted into the ear canal 2 through the A2 path and the processed bone conduction acoustic wave signal played by the speaker
  • the larger the energy difference is, the larger the difference between the second gain of the amplitude of the bone conduction acoustic wave signal of the (N+1)th frame and the second gain of the Nth frame can be set to Further improve the effect of improving the occlusion effect.
  • Method 2 When the energy ratio of the Nth frame is greater, or the difference between the energy ratio of the Nth frame and the energy ratio threshold is greater, set the amplitude of the bone conduction acoustic wave signal of the (N+1)th frame The larger the difference between the second gain and the second gain of the amplitude of the bone conduction acoustic wave signal of the Nth frame;
  • the fourth acoustic signal of the Nth frame The energy of the fourth acoustic wave signal is a positive value, and when the fourth acoustic wave signal of the Nth frame meets the first preset condition, the energy ratio The greater, or the greater the difference between the energy ratio and the energy ratio threshold, indicating that In terms of energy, the energy of the acoustic signal x(n) transmitted through the A2 path into the ear canal 2 and the processed bone conduction acoustic signal played by the speaker The greater the difference in energy.
  • the second of the amplitude of the bone conduction acoustic wave signal of the (N+1)th frame can be set The greater the difference between the gain and the second gain of the Nth frame is to further improve the effect of improving the occlusion effect.
  • setting the larger the difference between the second gain of the (N+1)th frame and the second gain of the Nth frame includes the following four setting methods:
  • Method 1 Set the difference between the second gain of the amplitude of the bone conduction acoustic wave signal of the (N+1)th frame and the second gain of the amplitude of the bone conduction acoustic wave signal of the Nth frame and the difference between the second gain of the bone conduction acoustic wave signal of the Nth frame and the Nth frame
  • the energy of the four sound wave signals is proportional; the greater the energy of the fourth sound wave signal of the Nth frame, the greater the adjustment range of the bone conduction sound wave signal of the (N+1)th frame needs to be adjusted, so the (Nth) +1)
  • the difference between the second gain of the amplitude of the bone conduction acoustic wave signal of frame and the second gain of the amplitude of the bone conduction acoustic wave signal of the Nth frame is proportional to the energy of the fourth acoustic wave signal of the Nth frame, The effect of improving the occlusion effect can be further improved.
  • Method 2 Set the difference between the second gain of the amplitude of the bone conduction acoustic wave signal of the (N+1)th frame and the second gain of the Nth frame and the energy of the fourth acoustic wave signal of the Nth frame and the first
  • the difference between the energy thresholds is proportional; the greater the difference between the energy of the fourth acoustic wave signal in the Nth frame and the first energy threshold, the greater is the amplitude of the bone conduction acoustic wave signal in the (N+1)th frame
  • the adjustment range needs to be larger.
  • Method 3 Set the difference between the second gain of the amplitude of the bone conduction acoustic wave signal of the (N+1)th frame and the second gain of the Nth frame in proportion to the energy ratio of the Nth frame; The larger the energy ratio, the larger the adjustment range of the amplitude of the bone conduction acoustic wave signal of the (N+1)th frame is required.
  • Set the second gain and the amplitude of the bone conduction acoustic wave signal of the (N+1)th frame The difference between the second gains of the Nth frame is proportional to the energy ratio, which can further improve the effect of improving the occlusion effect.
  • Method 4 Set the difference between the second gain of the amplitude of the bone conduction acoustic wave signal of the (N+1)th frame and the second gain of the Nth frame and the energy ratio and the energy ratio threshold of the Nth frame The difference is proportional; the larger the difference between the energy ratio of the Nth frame and the energy ratio threshold, the larger the adjustment range of the bone conduction acoustic wave signal amplitude of the (N+1)th frame needs to be. Therefore, set The difference between the second gain of the amplitude of the bone conduction acoustic wave signal of the (N+1) frame and the second gain of the previous frame is proportional to the difference between the energy ratio of the Nth frame and the energy ratio threshold , Can further improve the effect of improving the occlusion effect.
  • adjusting the second gain of the amplitude of the bone conduction acoustic wave signal according to the fourth acoustic wave signal of the previous frame further includes:
  • 010 Determine whether the fourth sound wave signal of the first frame meets the first preset condition
  • 010a When the fourth acoustic signal of the first frame meets the first preset condition, set the second gain of the second frame to be smaller than the second gain of the first frame, or set the second gain of the second frame to be greater than the first frame The second gain;
  • adjusting the second gain of the amplitude of the bone conduction acoustic wave signal of the second frame may include the following two ways: setting the bone conduction acoustic wave signal of the second frame The second gain of the amplitude is smaller than the second gain of the amplitude of the bone conduction acoustic wave signal of the first frame, or the second gain of the amplitude of the bone conduction acoustic wave signal of the second frame is set to be greater than the bone conduction acoustic wave signal of the first frame The second gain of the amplitude.
  • the specific method for setting the second gain of the amplitude of the bone conduction acoustic wave signal in the second frame can be referred to the above-mentioned embodiment.
  • the greater the energy of the fourth acoustic wave signal in the first frame Either the greater the difference between the energy of the fourth acoustic wave signal of the first frame and the first energy threshold, or the greater the energy ratio of the first frame, or the difference between the energy ratio of the first frame and the energy ratio threshold
  • the difference between the second gain of the second frame and the second gain of the first frame is greater.
  • the difference between the second gain of the second frame and the second gain of the first frame is set to be proportional to the energy of the fourth acoustic signal of the first frame;
  • the difference between the second gain of the second frame and the second gain of the first frame is set to be proportional to the difference between the energy ratio of the first frame and the energy ratio threshold.
  • 010b When the fourth acoustic wave signal in the first frame does not meet the first preset condition, set the second gain of the amplitude of the bone conduction acoustic wave signal in the second frame to be equal to the second gain of the amplitude of the bone conduction acoustic wave signal in the first frame Gain.
  • the second gain of the amplitude of the bone conduction acoustic wave signal of the second frame is processed differently to adjust the amplitude of the bone conduction acoustic wave signal of the second frame
  • the fourth sound wave signal of the first frame can be used as the feedback amount, and the amplitude of the bone conduction sound wave signal of the current frame is adjusted according to the feedback amount, which can further eliminate the occlusion effect and continuously improve the user experience.
  • the processing further includes adjusting the phase of the bone conduction sound wave signal of the next frame.
  • the processed bone conduction acoustic wave signal may not be completely inverse to the phase of the acoustic wave signal transmitted to the ear canal 2 through the A2 path. Therefore, the phase of the bone conduction acoustic wave signal in the next frame needs to be adjusted to improve the effect of improving the occlusion effect.
  • the bone conduction acoustic wave signal of the M frame is adjusted
  • the phase of the bone conduction sound wave signal in the next frame is -20 degrees to +20 degrees
  • M is an integer and M>1.
  • the bone conduction acoustic wave signal in the next frame of the acoustic wave signal can further improve the effect of improving the occlusion effect.
  • the bone conduction acoustic wave signal in the next frame can be adjusted by changing the value of the system function H(w). Phase.
  • This embodiment does not limit the specific value of M.
  • the phase adjustment range is set to -20 degrees to +20 degrees, which can avoid the phase adjustment too much so that the bone conduction acoustic wave signal after adjusting the phase cannot well cancel the acoustic wave signal transmitted to the ear canal 2 through the A2 path.
  • this embodiment further includes selecting a bone acoustic sensor, and selecting a bone acoustic sensor includes:
  • the bone acoustic sensor is selected according to the flatness of the frequency sensitivity curve of the normalized bone acoustic sensor.
  • the bone acoustic sensor can be selected according to the flatness of the frequency sensitivity curve of the bone acoustic sensor.
  • the frequency sensitivity curve of the bone acoustic sensor can be normalized, for example, normalized to 1kHz or other frequencies, after normalization This can facilitate the lateral comparison of the bone acoustic sensor, and the method for solving the flatness of the frequency sensitivity curve is not limited in this embodiment, and it can be obtained by solving the variance, the mean square error, and the like.
  • the embodiment of the present application may also provide a bone-borne sound signal processing device for executing the bone-borne sound signal processing method proposed in the foregoing embodiment.
  • FIG. 14 shows the structure of a bone-borne sound signal processing device provided by this embodiment. In a schematic diagram, the device can execute the method shown in FIG. 2 above.
  • the bone sound signal processing device 20 includes:
  • the bone sound sensor module 21 is used to collect bone conduction sound wave signals, and the bone sound sensor module contacts the ear canal or forms a vibration conduction path between the solid medium and the ear canal;
  • the bone-borne sound processing module 22 is used to process bone conduction sound wave signals, and the bone-borne sound processing module includes an inversion module; and
  • the output module 23 is used to transmit the processed bone conduction sound wave signal to the human ear.
  • the output module includes:
  • the speaker module is used to play the processed bone conduction sound wave signal
  • the bone sound processing module is also used to transmit the processed bone conduction sound wave signal to the human ear.
  • the bone sound processing module also includes
  • the first amplitude processing module is configured to adjust the amplitude of the bone conduction acoustic wave signal in the preset frequency band according to the sensitivity of the bone acoustic sensor module;
  • the first amplitude processing module is further configured to set the first gain of the amplitude of the bone conduction acoustic wave signal at the frequency point to be inversely proportional to the sensitivity of the bone acoustic sensor module corresponding to the frequency point.
  • the bone-borne sound processing module further includes a fitting module.
  • the fitting module is used to fit the frequency sensitivity curve of the bone-borne sound sensor module.
  • the fitting includes a linear fitting, Quadratic curve fitting or cubic curve fitting.
  • the bone sound processing module further includes a second amplitude processing module, and the second amplitude processing module is used to adjust the second amplitude of the bone conduction sound wave signal according to the fourth sound wave signal of the previous frame.
  • Gain the second amplitude processing module is used to adjust the second amplitude of the bone conduction sound wave signal according to the fourth sound wave signal of the previous frame.
  • the fourth sound wave signal is obtained by subtracting the useful sound signal from the second sound wave signal.
  • the second sound wave signal is collected by the microphone of the headset in the ear canal when the speaker module plays the processed bone conduction sound wave signal, and the useful sound signal is played by the speaker module When the processed bone conduction sound wave signal is processed, the speaker module plays a sound wave signal other than the processed bone conduction sound wave signal.
  • the second amplitude processing module includes:
  • Gain adjustment module if the second gain of the Nth frame is smaller than the second gain of the (N-1)th frame, and the energy of the fourth acoustic wave signal of the Nth frame is greater than that of the fourth acoustic wave signal of the (N-1)th frame Energy, the gain adjustment module is used to set the second gain of the (N+1)th frame to be greater than the second gain of the Nth frame, or if the energy of the fourth acoustic wave signal of the Nth frame is less than or equal to the (N-1)th frame The energy of the fourth acoustic wave signal of the frame, the gain adjustment module is further configured to set the second gain of the (N+1)th frame to be less than or equal to the second gain of the Nth frame; or
  • gain adjustment The module is also used to set the second gain of the (N+1)th frame to be less than the second gain of the Nth frame, or, if the energy of the fourth acoustic signal of the Nth frame is less than or equal to the energy of the (N-1)th frame
  • the gain adjustment module is also used to set the second gain of the (N+1)th frame to be greater than or equal to the second gain of the Nth frame, where N>1 and an integer.
  • the gain adjustment module is further configured to set the second gain of the (N+1)th frame to be less than or equal to the second gain of the Nth frame includes:
  • the gain adjustment module is further configured to set the second gain of the (N+1)th frame to be smaller than the second gain of the Nth frame, or the second gain of the Nth frame
  • the gain adjustment module is further configured to set the second gain of the (N+1)th frame equal to the second gain of the current frame
  • the gain adjustment module is further configured to set the second gain of the (N+1)th frame to be greater than or equal to the second gain of the Nth frame, including:
  • the gain adjustment module is further configured to set the second gain of the (N+1)th frame to be greater than the second gain of the Nth frame, or the second gain of the Nth frame
  • the gain adjustment module is further configured to set the second gain of the (N+1) frame equal to the second gain of the current frame.
  • the first preset condition includes:
  • the energy of the fourth acoustic signal is greater than or equal to the first energy threshold, and the first energy threshold is less than or equal to 3dB; or
  • the energy ratio is greater than or equal to the energy ratio threshold; the energy ratio is the ratio of the energy of the fourth acoustic wave signal to the energy of the processed bone conduction acoustic wave signal, and the energy ratio threshold is less than or equal to 0.1, 0.2, 0.3, 0.4 or 0.5.
  • the gain adjustment module is further configured to set the second gain of the (N+1)th frame to be smaller than the second gain of the Nth frame, or gain adjustment The module is also used to set the second gain of the (N+1)th frame to be greater than the second gain of the Nth frame, including:
  • the gain adjustment module is also used to set the greater the difference between the second gain of the (N+1)th frame and the second gain of the Nth frame .
  • the gain adjustment module is further configured to set the larger the difference between the second gain of the (N+1)th frame and the second gain of the Nth frame, including:
  • the gain adjustment module is further configured to set the difference between the second gain of the (N+1)th frame and the second gain of the Nth frame to be proportional to the energy of the fourth sound wave signal of the Nth frame;
  • the gain adjustment module is also used to set the difference between the second gain of the (N+1)th frame and the second gain of the Nth frame and the energy of the fourth acoustic wave signal of the Nth frame and the first energy threshold.
  • the difference is proportional; or
  • the gain adjustment module is also used to set the difference between the second gain of the (N+1)th frame and the second gain of the Nth frame to be proportional to the energy ratio of the Nth frame;
  • the gain adjustment module is also used to set the difference between the second gain of the (N+1)th frame and the second gain of the Nth frame in proportion to the difference between the energy ratio of the Nth frame and the energy ratio threshold.
  • the second gain used by the second amplitude processing module to adjust the amplitude of the bone conduction acoustic wave signal according to the fourth acoustic wave signal of the previous frame further includes:
  • the second amplitude processing module is further configured to set the second gain of the second frame to be smaller than the second gain of the first frame, or the second amplitude processing module It is also used to set the second gain of the second frame to be greater than the second gain of the first frame; or
  • the second amplitude processing module is further configured to set the second gain of the second frame to be equal to the second gain of the first frame.
  • the bone sound processing module further includes:
  • the phase adjustment module is used to adjust the phase of the bone conduction sound wave signal in the next frame.
  • the phase adjustment module is also used to adjust the bone conduction of the M frame
  • the phase of the bone conduction acoustic wave signal of the next frame of the acoustic wave signal, the adjustment range of the phase is -20 degrees to +20 degrees, M is an integer and M>1.
  • the bone sound sensor selection module is used to select the bone sound sensor module.
  • the bone sound sensor selection module selects the bone sound sensor module according to the flatness of the frequency sensitivity curve of the normalized bone sound sensor module.
  • the embodiment of the application provides a bone conduction sound signal processing device, which collects bone conduction sound wave signals through a bone conduction sound sensor module and performs inversion processing on the bone conduction sound wave signals and transmits them to the human ear, which solves the problem of the occlusion effect of headphones , which significantly improves the user experience.
  • the embodiment of the present application may also provide a chip for executing the bone sound signal method proposed in the above embodiment
  • the chip provided in the embodiment of the present application can execute the bone sound signal processing method provided in any of the above-mentioned embodiments.
  • the specific implementation process and beneficial effects refer to the above, and will not be repeated here.
  • An earphone provided by an embodiment of the present application includes the chip provided in any one of the above-mentioned embodiments.
  • the earphone also includes a bone-borne sound sensor.
  • the bone-borne sound sensor is in contact with the ear canal or forms a vibration between the bone sound sensor and the ear canal through a solid medium. Conduction path.
  • the earphone provided by the embodiment of the present application can execute the bone sound signal processing method provided by any of the above-mentioned embodiments.
  • An embodiment of the present application may further provide a computer-readable storage medium, including a computer program stored thereon, and when the computer program is executed by a processor, any bone-borne sound signal processing method executed by the device is implemented.
  • the computer-readable storage medium provided in the embodiment of the present application can execute the bone-borne sound signal processing method provided in any of the above-mentioned embodiments.
  • the specific implementation process and beneficial effects refer to the above, and will not be repeated here.
  • the processor may be an integrated circuit chip with signal processing capabilities.
  • the steps of the foregoing method embodiments can be completed by hardware integrated logic circuits in the processor or instructions in the form of software.
  • the above-mentioned processor may be a general-purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a ready-made programmable gate array (field programmable gate array, FPGA) or other Programming logic devices, discrete gates or transistor logic devices, discrete hardware components.
  • DSP digital signal processor
  • ASIC application specific integrated circuit
  • FPGA field programmable gate array
  • Programming logic devices discrete gates or transistor logic devices, discrete hardware components.
  • the general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.
  • the steps of the method disclosed in the embodiments of the present application may be directly embodied as being executed and completed by a hardware decoding processor, or executed and completed by a combination of hardware and software modules in the decoding processor.
  • the software module can be located in a mature storage medium in the field such as random access memory, flash memory, read-only memory, programmable read-only memory, or electrically erasable programmable memory, registers.
  • the storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.
  • the memory in the embodiment of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memory.
  • the non-volatile memory can be read-only memory (ROM), programmable read-only memory (programmable rom, PROM), erasable programmable read-only memory (erasable PROM, EPROM), and electrically available Erase programmable read-only memory (electrically EPROM, EEPROM) or flash memory.
  • the volatile memory may be random access memory (RAM), which is used as an external cache.
  • RAM random access memory
  • static random access memory static random access memory
  • dynamic RAM dynamic random access memory
  • DRAM dynamic random access memory
  • SDRAM synchronous dynamic random access memory
  • double data rate synchronous dynamic random access memory double data rate SDRAM, DDR SDRAM
  • enhanced synchronous dynamic random access memory enhanced SDRAM, ESDRAM
  • serial link DRAM SLDRAM
  • direct rambus RAM direct rambus RAM
  • B corresponding to A means that B is associated with A, and B can be determined according to A.
  • determining B according to A does not mean that B is determined only according to A, and B can also be determined according to A and/or other information.
  • the disclosed system, device, and method may be implemented in other ways.
  • the device embodiments described above are only illustrative.
  • the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components can be combined or It can be integrated into another system, or some features can be ignored or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • each unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium.
  • the technical solution of this application essentially or the part that contributes to the existing technology or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including Several instructions are used to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the method described in each embodiment of the present application.
  • the aforementioned storage media include: U disk, mobile hard disk, read-only memory (read-only memory, ROM), random access memory (random access memory, RAM), magnetic disk or optical disk and other media that can store program code .

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Neurosurgery (AREA)
  • Otolaryngology (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Details Of Audible-Bandwidth Transducers (AREA)

Abstract

本申请涉及信号处理领域，尤其涉及一种骨传声信号处理方法、装置、芯片、耳机及存储介质。一种骨传声信号处理方法包括：骨传声传感器采集骨传导声波信号，骨传声传感器与耳道接触或通过固体介质与耳道之间形成振动传导路径；对骨传导声波信号进行处理，处理包括反相；将处理后的骨传导声波信号传输到人耳。通过骨传声传感器采集骨传导声波信号并对骨传导声波信号进行反相处理后传输到人耳，解决了耳机的闭塞效应的问题，显著的提升了用户体验。

Description

一种骨传声信号处理方法、装置、芯片、耳机及存储介质 技术领域
本申请涉及信号处理领域，尤其涉及一种骨传声信号处理方法、装置、芯片、耳机及存储介质。
背景技术
如图1所示，人耳可以通过三条路径听到自己的声音，A3路径：小于1.5kHz的声波信号经由嘴巴6，人头7周围的空气，进入到耳道2，最终引起耳膜3的振动；A2路径：部分小于1.5kHz的声波信号，经过喉骨、颈部的软骨组织等到达耳道2，引起耳膜3振动；A1路径：高于1.5kHz的声波信号，经过喉咙、头部的软骨组织到达中耳4或内耳5。耳机塞入人耳1后，耳膜3、耳道2、耳机三者构成立体密闭空间，人体声带发声时，部分1.5kHz以下声波信号仍然可以通过喉骨、颈部软组织等到达耳道2，由于立体密闭空间阻隔了声波传输通道，声波信号在耳道2中会形成振荡，到达耳膜时声压会增强，使佩戴者不舒服，产生闭塞效应。改善闭塞效应的最常见的方法是在听筒中设计一个或多个通孔，但是这种方法会导致环境噪音泄露到耳朵中。
发明内容
针对现有技术中入耳式耳机导致的闭塞效应的问题，本申请提供了一种骨传声信号处理方法、装置、芯片、耳机及存储介质。
本申请的实施例的第一方面提供了一种骨传声信号处理方法，包 括：骨传声传感器采集骨传导声波信号，骨传声传感器与耳道接触或通过固体介质与耳道之间形成振动传导路径；对骨传导声波信号进行处理，处理包括反相；将处理后的骨传导声波信号传输到人耳。
另外，结合第一方面，在第一方面的一种实现方式中，将处理后的骨传导声波信号传输到人耳包括：耳机的扬声器播放处理后的骨传导声波信号；或者骨传声传感器将处理后的骨传导声波信号传输到人耳。
另外，结合第一方面及其上述实现方式，在第一方面的另一种实现方式中，处理还包括根据骨传声传感器的灵敏度调整预设频段内的骨传导声波信号的幅值；
预设频段内的频点对应的骨传声传感器的灵敏度越高，频点的骨传导声波信号的幅值的第一增益越小，幅值的放大倍数包括第一增益。
另外，结合第一方面及其上述实现方式，在第一方面的另一种实现方式中，根据骨传声传感器的灵敏度调整预设频段内的骨传导声波信号的幅值包括：设置频点的骨传导声波信号的幅值的第一增益与频点对应的骨传声传感器的灵敏度成反比。
另外，结合第一方面及其上述实现方式，在第一方面的另一种实现方式中，根据骨传声传感器的灵敏度调整预设频段内的骨传导声波信号的幅值前，处理还包括对骨传声传感器的频率灵敏度曲线进行拟合，拟合包括一次线性拟合、二次曲线拟合或者三次曲线拟合。
另外，结合第一方面及其上述实现方式，在第一方面的另一种实现方式中，耳机的扬声器播放处理后的骨传导声波信号之后，处理还包括根据上一帧的第四声波信号调整骨传导声波信号的幅值的第二增益，幅值的放大倍数包括第二增益；
第四声波信号为第二声波信号减去有用声音信号得到，第二声波信号为扬声器播放处理后的骨传导声波信号时，耳机的麦克风在耳道内采集到的，有用声音信号为扬声器播放处理后的骨传导声波信号时，扬声器播放的除处理后的骨传导声波信号之外的声波信号。
另外，结合第一方面及其上述实现方式，在第一方面的另一种实 现方式中，根据上一帧的第四声波信号调整骨传导声波信号的幅值的第二增益包括：
若第N帧的第二增益小于第(N-1)帧的第二增益，且第N帧的第四声波信号的能量大于第(N-1)帧的第四声波信号的能量，则设置第(N+1)帧的第二增益大于第N帧的第二增益，或者，若第N帧的第四声波信号的能量小于或等于第(N-1)帧的第四声波信号的能量，则设置第(N+1)帧的第二增益小于或等于第N帧的第二增益；或者若第N帧的第二增益大于第(N-1)帧的第二增益，且第N帧的第四声波信号的能量大于第(N-1)帧的第四声波信号的能量，则设置第(N+1)帧的第二增益小于第N帧的第二增益，或者，若第N帧的第四声波信号的能量小于或等于第(N-1)帧的第四声波信号的能量，则设置第(N+1)帧的第二增益大于或等于第N帧的第二增益，N>1且为整数。
另外，结合第一方面及其上述实现方式，在第一方面的另一种实现方式中，设置第(N+1)帧的第二增益小于或等于第N帧的第二增益包括：
第N帧的第四声波信号满足第一预设条件时，设置第(N+1)帧的第二增益小于第N帧的第二增益，或者，第N帧的第四声波信号不满足第一预设条件时，设置第(N+1)帧的第二增益等于当前帧的第二增益；
设置第(N+1)帧的第二增益大于或等于第N帧的第二增益包括：第N帧的第四声波信号满足第一预设条件时，设置第(N+1)帧的第二增益大于第N帧的第二增益，或者，第N帧的第四声波信号不满足第一预设条件时，设置(N+1)帧的第二增益等于当前帧的第二增益。
另外，结合第一方面及其上述实现方式，在第一方面的另一种实现方式中，第一预设条件包括：
第四声波信号的能量大于或者等于第一能量阈值，第一能量阈值 小于或者等于3dB；或者
能量比值大于或等于能量比值阈值；能量比值为第四声波信号的能量与处理后的骨传导声波信号的能量的比值，能量比值阈值小于或等于0.1、0.2、0.3、0.4或0.5。
另外，结合第一方面及其上述实现方式，在第一方面的另一种实现方式中，第N帧的第四声波信号满足第一预设条件时，设置第(N+1)帧的第二增益小于第N帧的第二增益，或者，设置第(N+1)帧的第二增益大于第N帧的第二增益，包括：
第N帧的第四声波信号的能量越大，或者第N帧的第四声波信号的能量和第一能量阈值之间的差值越大，或者第N帧的能量比值越大，或者第N帧的能量比值和能量比值阈值之间的差值越大时，设置第(N+1)帧的第二增益和第N帧的第二增益之间的差值越大。
另外，结合第一方面及其上述实现方式，在第一方面的另一种实现方式中，设置第(N+1)帧的第二增益和第N帧的第二增益之间的差值越大包括：
设置第(N+1)帧的第二增益和第N帧的第二增益之间的差值与第N帧的第四声波信号的能量成正比；或者
设置第(N+1)帧的第二增益和第N帧的第二增益之间的差值与第N帧的第四声波信号的能量和第一能量阈值之间的差值成正比；或者
设置第(N+1)帧的第二增益和第N帧的第二增益之间的差值与第N帧的能量比值成正比；或者
设置第(N+1)帧的第二增益和第N帧的第二增益之间的差值与第N帧的能量比值和能量比值阈值之间的差值成正比。
另外，结合第一方面及其上述实现方式，在第一方面的另一种实现方式中，根据上一帧的第四声波信号调整骨传导声波信号的幅值的第二增益还包括：
第一帧的第四声波信号满足第一预设条件时，设置第二帧的第二增益小于第一帧的第二增益，或者，设置第二帧的第二增益大于第一 帧的第二增益；或者
第一帧的第四声波信号不满足第一预设条件时，设置第二帧的第二增益等于第一帧的第二增益。
另外，结合第一方面及其上述实现方式，在第一方面的另一种实现方式中，耳机的扬声器播放处理后的骨传导声波信号之后，处理还包括调整下一帧的骨传导声波信号的相位。
另外，结合第一方面及其上述实现方式，在第一方面的另一种实现方式中，当根据上一帧的第四声波信号连续调整M帧的骨传导声波信号的幅值的第二增益后，调整M帧的骨传导声波信号的下一帧的骨传导声波信号的相位，相位的调整范围为-20度至+20度，M为整数且M>1。
另外，结合第一方面及其上述实现方式，在第一方面的另一种实现方式中，还包括选择骨传声传感器，选择骨传声传感器包括：
根据归一化后的骨传声传感器的频率灵敏度曲线的平坦度选择骨传声传感器。
本申请的实施例的第二方面提供了一种骨传声信号处理装置，包括：
骨传声传感器模块，用于采集骨传导声波信号，骨传声传感器模块与耳道接触或通过固体介质与耳道之间形成振动传导路径；
骨传声处理模块，用于对骨传导声波信号进行处理，骨传声处理模块包括反相模块；以及
输出模块，用于将处理后的骨传导声波信号传输到人耳。
另外，结合第二方面，在第二方面的一种实现方式中，输出模块包括：
扬声器模块，用于播放处理后的骨传导声波信号；或者
骨传声处理模块还用于将处理后的骨传导声波信号传输到人耳。
另外，结合第二方面及其上述实现方式，在第二方面的另一种实现方式中，骨传声处理模块还包括
第一幅值处理模块，第一幅值处理模块用于根据骨传声传感器模 块的灵敏度调整预设频段内的骨传导声波信号的幅值；
预设频段内的频点对应的骨传声传感器模块的灵敏度越高，频点的骨传导声波信号的幅值的第一增益越小，幅值的放大倍数包括第一增益。
另外，结合第二方面及其上述实现方式，在第二方面的另一种实现方式中，第一幅值处理模块还用于设置频点的骨传导声波信号的幅值的第一增益与频点对应的骨传声传感器模块的灵敏度成反比。
另外，结合第二方面及其上述实现方式，在第二方面的另一种实现方式中，第一幅值处理模块前，骨传声处理模块还包括拟合模块，拟合模块用于对骨传声传感器模块的频率灵敏度曲线进行拟合，拟合包括一次线性拟合、二次曲线拟合或者三次曲线拟合。
另外，结合第二方面及其上述实现方式，在第二方面的另一种实现方式中，扬声器模块之后，骨传声处理模块还包括第二幅值处理模块，第二幅值处理模块用于根据上一帧的第四声波信号调整骨传导声波信号的幅值的第二增益；
第四声波信号为第二声波信号减去有用声音信号得到，第二声波信号为扬声器模块播放处理后的骨传导声波信号时，耳机的麦克风在耳道内采集到的，有用声音信号为扬声器模块播放处理后的骨传导声波信号时，扬声器模块播放的除处理后的骨传导声波信号之外的声波信号。
另外，结合第二方面及其上述实现方式，在第二方面的另一种实现方式中，第二幅值处理模块包括：
增益调节模块，若第N帧的第二增益小于第(N-1)帧的第二增益，且第N帧的第四声波信号的能量大于第(N-1)帧的第四声波信号的能量，增益调节模块用于设置第(N+1)帧的第二增益大于第N帧的第二增益，或者，若第N帧的第四声波信号的能量小于或等于第(N-1)帧的第四声波信号的能量，增益调节模块还用于设置第(N+1)帧的第二增益小于或等于第N帧的第二增益；或者
若第N帧的第二增益大于第(N-1)帧的第二增益，且第N帧的 第四声波信号的能量大于第(N-1)帧的第四声波信号的能量，增益调节模块还用于设置第(N+1)帧的第二增益小于第N帧的第二增益，或者，若第N帧的第四声波信号的能量小于或等于第(N-1)帧的第四声波信号的能量，增益调节模块还用于设置第(N+1)帧的第二增益大于或等于第N帧的第二增益，N>1且为整数。
另外，结合第二方面及其上述实现方式，在第二方面的另一种实现方式中，增益调节模块还用于设置第(N+1)帧的第二增益小于或等于第N帧的第二增益包括：
第N帧的第四声波信号满足第一预设条件时，增益调节模块还用于设置第(N+1)帧的第二增益小于第N帧的第二增益，或者，第N帧的第四声波信号不满足第一预设条件时，增益调节模块还用于设置第(N+1)帧的第二增益等于当前帧的第二增益；
增益调节模块还用于设置第(N+1)帧的第二增益大于或等于第N帧的第二增益，包括：
第N帧的第四声波信号满足第一预设条件时，增益调节模块还用于设置第(N+1)帧的第二增益大于第N帧的第二增益，或者，第N帧的第四声波信号不满足第一预设条件时，增益调节模块还用于设置(N+1)帧的第二增益等于当前帧的第二增益。
另外，结合第二方面及其上述实现方式，在第二方面的另一种实现方式中，第一预设条件包括：
第四声波信号的能量大于或者等于第一能量阈值，第一能量阈值小于或者等于3dB；或者
能量比值大于或等于能量比值阈值；能量比值为第四声波信号的能量与处理后的骨传导声波信号的能量的比值，能量比值阈值小于或等于0.1、0.2、0.3、0.4或0.5。
另外，结合第二方面及其上述实现方式，在第二方面的另一种实现方式中，第N帧的第四声波信号满足第一预设条件时，增益调节模块还用于设置第(N+1)帧的第二增益小于第N帧的第二增益，或者增益调节模块还用于设置第(N+1)帧的第二增益大于第N帧的第 二增益，包括：
第N帧的第四声波信号的能量越大，或者第N帧的第四声波信号的能量和第一能量阈值之间的差值越大，或者第N帧的能量比值越大，或者第N帧的能量比值和能量比值阈值之间的差值越大时，增益调节模块还用于设置第(N+1)帧的第二增益和第N帧的第二增益之间的差值越大。
另外，结合第二方面及其上述实现方式，在第二方面的另一种实现方式中，增益调节模块还用于设置第(N+1)帧的第二增益和第N帧的第二增益之间的差值越大包括：
增益调节模块还用于设置第(N+1)帧的第二增益和第N帧的第二增益之间的差值与第N帧的第四声波信号的能量成正比；或者
增益调节模块还用于设置第(N+1)帧的第二增益和第N帧的第二增益之间的差值与第N帧的第四声波信号的能量和第一能量阈值之间的差值成正比；或者
增益调节模块还用于设置第(N+1)帧的第二增益和第N帧的第二增益之间的差值与第N帧的能量比值成正比；或者
增益调节模块还用于设置第(N+1)帧的第二增益和第N帧的第二增益之间的差值与第N帧的能量比值和能量比值阈值之间的差值成正比。
另外，结合第二方面及其上述实现方式，在第二方面的另一种实现方式中，第二幅值处理模块用于根据上一帧的第四声波信号调整骨传导声波信号的幅值的第二增益还包括：
第一帧的第四声波信号满足第一预设条件时，第二幅值处理模块还用于设置第二帧的第二增益小于第一帧的第二增益，或者，第二幅值处理模块还用于设置第二帧的第二增益大于第一帧的第二增益；或者
第一帧的第四声波信号不满足第一预设条件时，第二幅值处理模块还用于设置第二帧的第二增益等于第一帧的第二增益。
另外，结合第二方面及其上述实现方式，在第二方面的另一种实 现方式中，扬声器模块之后，骨传声处理模块还包括：
相位调整模块，用于调整下一帧骨传导声波信号的相位。
另外，结合第二方面及其上述实现方式，在第二方面的另一种实现方式中，当第二幅值处理模块根据上一帧的第四声波信号连续调整M帧的骨传导声波信号的幅值的第二增益后，相位调整模块还用于调整M帧的骨传导声波信号的下一帧的骨传导声波信号的相位，相位的调整范围为-20度至+20度，M为整数且M>1。
另外，结合第二方面及其上述实现方式，在第二方面的另一种实现方式中，还包括
骨传声传感器选择模块，用于选择骨传声传感器模块，骨传声传感器选择模块根据归一化后的骨传声传感器模块的频率灵敏度曲线的平坦度选择骨传声传感器模块。
本申请的实施例的第三方面提供了一种芯片，用于执行上述第一方面的骨传声信号处理方法。
本申请的实施例的第四方面提供了一种耳机，包括上述第三方面的芯片。
本申请的实施例的第五方面提供了一种计算机可读存储介质，包括：其上存储有计算机程序，计算机程序被处理器执行时实现上述第一方面的骨传声信号处理方法。
与现有技术相比，本申请实施例的有益效果在于：本申请实施例提供了一种骨传声信号处理方法、装置、芯片、耳机及存储介质，通过骨传声传感器采集骨传导声波信号并对骨传导声波信号进行反相处理后传输到人耳，解决了耳机的闭塞效应的问题，显著的提升了用户体验。
附图说明
为了更清楚地说明本申请实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而 易见地，下面描述中的附图仅仅是本申请的一些实施例，对于本领域技术人员来讲，在不付出创造性劳动性的前提下，还可以根据这些附图获得其他的附图。
图1为本申请实施例的声波信号传输路径示意图；
图2为本申请实施例的骨传声信号处理方法的流程图；
图3为本申请实施例的骨传声信号处理方法的系统框图；
图4为本申请实施例的又一骨传声信号处理方法的系统框图；
图5为本申请实施例的骨传声传感器的频率灵敏度曲线；
图6为本申请实施例的频率灵敏度曲线和拟合曲线；
图7为本申请实施例的又一骨传声信号处理方法的流程图；
图8为本申请实施例中的又一声波信号传输路径示意图；
图9为本申请实施例的再一骨传声信号处理方法的流程图；
图10为本申请实施例的再一骨传声信号处理方法的流程图；
图11为本申请实施例的再一骨传声信号处理方法的流程图；
图12为本实施例提供的一种骨传声信号处理装置的结构示意图。
具体实施方式
为使本申请的目的、技术方案和优点更加清楚，下面将结合附图对本申请的部分实施例采用举例的方式进行详细的阐述。然而，本领域的普通技术人员可以理解，在各例子中，为了使读者更好地理解本申请而提出了许多技术细节。但是，即使没有这些技术细节和基于以下各实施例的种种变化和修改，也可以实现本申请所要求保护的技术方案。
本申请实施例提供了一种骨传声信号处理方法，请参考图2，图2是本申请实施例的骨传声信号处理方法的流程图，该方法包括以下步骤：
001：骨传声传感器采集骨传导声波信号，骨传声传感器与耳道接触或通过固体介质与耳道之间形成振动传导路径。
骨传声传感器可以直接或间接地与耳道接触以便于采集到通过 A2路径传输到耳道2内的声波信号，该骨传导声波信号除了包括小于1.5kHz的声波信号外，还可以包括部分大于或等于1.5kHz的声波信号，该骨传声传感器可以通过固体介质与耳道接触，该固体可以是金属，也可以是非金属，例如，骨传声传感器可以安装在柔性电路板或者印刷电路板上，柔性电路板或者印刷电路电路板经由耳机外壳结构接触耳道，从而构建一条固体的振动传导路径来采集通过A2路径传输到耳道2内的声波信号，或者，可以将骨传声传感器通过注塑的方式设置在耳机外壳的塑料内部，另外，骨传声传感器也可以直接与耳道接触，例如，骨传声可以设置在耳机外壳结构外部，贴在耳机壳外部的表面，从而与耳道接触。
002：对骨传导声波信号进行处理，处理包括反相；
骨传声传感器采集骨传导声波信号后，对骨传导声波信号进行反相，即将骨传导声波信号相位旋转180°，骨传导声波信号可以理解为是对通过A2路径传输到耳道2内的声波信号的估计，请参考图3，图3所示为本申请实施例的骨传声信号处理方法的系统框图，图3中，骨传声传感器8采集骨传导声波信号后，经过系统H(w)对骨传导声波信号进行处理，本实施例中，H(w)包括反相处理。
003：将处理后的骨传导声波信号传输到人耳。
将该反相后的骨传导声波信号10传输到人耳可以抵消通过A2路径传输到耳道2内的声波信号11。该反相后的骨传导声波信号10与通过A2路径传输到耳道2内的声波信号11的幅值相等、相位相反，二者叠加后为幅值为0的声波信号12，因而消除了通过A2路径传输到耳道2内的声波信号10，达到改善闭塞效应的作用，本实施例中，通过扬声器9将处理后的骨传导声波信号传输到人耳仅为示例性说明，也可以采用其他方式将处理后的骨传导声波信号传输到人耳，本实施例对此不做限制，如果存在有用声音信号s 0(n)，处理后的骨传导声波信号可以和有用声音信号同时播放，有用声音信号为用户主动选择播放的声波信号，例如，音乐或者通话语音等。本实施例可以适用于耳塞式耳机、入耳式耳机或者头戴式耳机等各种类型的耳机。
请参考图4，图4所示为本申请实施例的骨传声信号处理方法的又一系统框图，图4中骨传声传感器8采集骨传导声波信号，骨传声传感器8直接或间接与耳道接触，从而构建一条固体传导路径A21来采集通过A2路径传输到耳道2内的声波信号。对骨传导声波信号进行处理可以由耳机0中的处理器14实现，处理包括反相，因此，该处理器也可以为反相器，本实施例中，可以通过扬声器9将处理后的骨传导声波信号传输到人耳，但本实施例对将处理后的骨传导声波信号传输到人耳的具体方式不做限制。
基于上述实施例公开的内容，本实施例中，将处理后的骨传导声波信号传输到人耳可以包括以下两种方式：
方式一：耳机的扬声器播放处理后的骨传导声波信号；
方式二：骨传声传感器将处理后的骨传导声波信号传输到人耳。
通过方式一将处理后的骨传导声波信号传输到人耳，如图4所示，可以通过扬声器9将处理后的骨传导声波信号传输到人耳，以达到改善闭塞效应的目的。扬声器9在播放处理后的骨传导声波信号时，如果存在需要播放的有用声音信号，处理后的骨传导声波信号可以和有用声音信号同时播放。
通过方式二将处理后的骨传导声波信号传输到人耳，例如，可以直接通过骨传声传感器8的振子的振动，将处理后的骨传导声波信号传输到人耳，骨传声传感器的振动源可以是一个双工振子，该振子既能够输出振动信号，又能够采集振动信号，本实施例可以使用一个骨传声传感器同时采集骨传导声波信号和将处理后的骨传导声波信号传输到人耳，本实施例也可以采用两个骨传声传感器实现，一个骨传声传感器采集骨传导声波信号，另一个骨传声传感器将处理后的骨传导声波信号传输到人耳。
基于上述实施例公开的内容，本实施例中，处理还包括根据骨传声传感器的灵敏度调整预设频段内的骨传导声波信号的幅值。由于骨传声传感器在不同振动频率下的灵敏度存在差异，可能会导致骨传声传感器采集到的骨传导声波信号中不同频率成分的幅值有不同的变 化，例如，以图5所示的骨传声传感器的频率灵敏度曲线为例，1kHz以下的骨传导声波信号被衰减得较多，而1kHz以上的骨传导声波信号相对被衰减的较少，以至于骨传导声波信号与通过A2路径传输到耳道2内的声波信号相差较大，从而使得闭塞效应改善效果不明显。骨传声传感器对不同频点的骨传导声波信号的衰减不同，根据骨传声传感器的灵敏度调整骨传导声波信号的幅值可以进一步提高改善闭塞效应的效果。一般地，语音信号频率范围为300Hz-3.4kHz，因此，预设频段可以为300Hz-3.4kHz；因为通过A2路径传输到耳道2内的声波信号主要集中在1.5kHz以下频段，因此，预设频段也可以为300Hz-1.5kHz，本实施例对预设频段具体的频率区间不做限定。根据骨传声传感器的灵敏度调整预设频段内的骨传导声波信号的幅值可以进一步提高改善闭塞效应的效果。
根据灵敏度调整预设频段内的骨传导声波信号的幅值时，预设频段内的频点对应的骨传声传感器的灵敏度越高时，可以设置该频点的骨传导声波信号的幅值的第一增益越小。幅值的放大倍数包括该第一增益，即，该第一增益是幅值的放大倍数之一，骨传声传感器对某一频点的灵敏度越高，则该频点的信号被衰减得越少，几乎可以完全被骨传声传感器采集到或者被骨传声传感器予以放大，因此，该频点的骨传导声波信号的幅值的第一增益可以设置得较小，例如，可以设置为小于1，以起到对骨传声传感器采集到骨传导声波信号进行数据修正的作用；同理，骨传声传感器对某一频点的灵敏度越低，则该频点的信号被衰减得越多，因此，该频点的骨传导声波信号的幅值的第一增益就可以设置得较大，例如，可以设置为大于1，以起到对骨传声传感器采集到骨传导声波信号进行数据修正的作用，进一步提高改善闭塞效应的效果。
本实施例中，骨传声传感器若采集到微弱的有用声音信号，由于有用声音信号比较微弱，因此，采集到该微弱的有用声音信号之后也不会影响到有用声音信号的质量；在某些应用场景中，也可以通过计算该有用声音信号与采集到的骨传导声波信号的相关值，以评估采集 到的有用声音信号是否微弱，若有用声音信号与采集到的骨传导声波信号相关性较弱，则证明采集到的有用声音信号较微弱，不需要消除采集到的骨传导声波信号中包含的微弱的有用声音信号，若有用声音信号与采集到的骨传导声波信号相关性较强，则可以消除采集到的骨传导声波信号中包含的微弱的有用声音信号，例如，将采集到的骨传导声波信号减去反相后的有用声音信号与相关系的乘积，以使得采集到的骨传导声波信号更接近通过A2路径传输到耳道2内的声波信号。
基于上述实施例公开的内容，本实施例中，根据骨传声传感器的灵敏度调整预设频段内的骨传导声波信号的幅值包括：设置频点的骨传导声波信号的幅值的第一增益与该频点对应的骨传声传感器的灵敏度成反比。假设骨传声传感器的预设频段内的频率灵敏度曲线为Y(f)＝k*f+B，所述f表示频率，Y(f)表示灵敏度，B表示频率灵敏度曲线的直流补偿值，k表示频率灵敏度曲线的斜率，*表示乘积，假设通过A2路径传输到耳道2内的声波信号为S(f)，则骨传声传感器采集到的骨传导声波信号S′(f)＝S(f)·Y(f)，因此，由骨传声传感器采集到的骨传导声波信号和骨传声传感器的频率灵敏度曲线得到的通过A2路径传输到耳道2内的声波信号
Figure PCTCN2019090662-appb-000001
因此，可以设置骨传导声波信号的幅值的第一增益为
Figure PCTCN2019090662-appb-000002
即骨传导声波信号的幅值的第一增益与骨传声传感器的灵敏度成反比。可以通过设置系统函数H(w)的值来设置当前帧骨传导声波信号的幅值的第一增益，由于每个频点对应的骨传声传感器的灵敏度可能不同，因此，可以设置任一频点的骨传导声波信号的幅值的第一增益与该频点对应的灵敏度成反比，以起到对骨传声传感器采集到骨传导声波信号进行数据修正的作用，进一步提高改善闭塞效应的效果。
基于上述实施例公开的内容，本实施例中，根据骨传声传感器的灵敏度调整预设频段内的骨传导声波信号的幅值前，处理还包括对骨传声传感器的频率灵敏度曲线进行拟合，一般地，骨传声传感器的频率灵敏度曲线不是平坦的，当根据骨传声传感器的灵敏度调整骨传导声波信号的幅值时，如果需要存储每个频点对应的灵敏度，将会占用较大的存储空间而提高成本或者增加功耗，因此，可以对该骨传声传 感器的频率灵敏度曲线进行拟合，对骨传声传感器的频率灵敏度曲线进行拟合后，可以根据拟合后的骨传声传感器的灵敏度调整预设频段内的骨传导声波信号的幅值，不需要存储每个频点对应的灵敏度，以节约内存并且降低功耗。该拟合可以包括一次线性拟合、二次曲线拟合或者三次曲线拟合等，以图6所示骨传声传感器的频率灵敏度曲线和拟合曲线为例，假设预设频段为300Hz-1.5kHz，预设频段的频率灵敏度曲线为图中带黑色方形标记的黑色粗线，对该频率灵敏度曲线的拟合可以为二次曲线拟合，例如，如图6中黑色细线所示的拟合曲线：Y(f)＝-2e -6f 2+0.0044f-23.476，Y(f)表示灵敏度，该拟合曲线是对带黑色方形标记的黑色粗线的拟合，需要说明的是，该拟合曲线仅仅为示例性说明，对于不同的频率灵敏度曲线，可以选择不同的拟合曲线和拟合参数，拟合误差越小，闭塞效应改善得越明显，但是拟合次数越高，计算量也越大，会在一定程度上增加功耗。
基于上述实施例公开的内容，本实施例中，如图7所示，耳机的扬声器播放处理后的所述骨传导声波信号之后，处理还包括：
004：根据上一帧的第四声波信号调整骨传导声波信号的幅值的第二增益，幅值的放大倍数包括第二增益。
图8为本申请实施例中的声波信号传输路径示意图，如图8所示，第四声波信号s 4(n)由第二声波信号s 2(n)减去有用声音信号s 0(n)得到，其中，第二声波信号s 2(n)为扬声器播放处理后的骨传导声波信号
Figure PCTCN2019090662-appb-000003
时，耳机的麦克风13在耳道2内采集到的，
Figure PCTCN2019090662-appb-000004
为处理后的骨传导声波信号，如图4所示，麦克风13采集到信号将反馈至耳机中，以用于判断通过A2路径传输到耳道2内的声波信号是否被完全消除掉，假设通过A2路径传输到耳道2内的声波信号用x(n)表示，则第二声波信号
Figure PCTCN2019090662-appb-000005
有用声音信号s 0(n)为扬声器播放处理后的骨传导声波信号时扬声器播放的除处理后的骨传导声波信号之外的声波信号，例如用户主动选择播放的音乐或者通话语音等，需要说明的是s 0(n)也可以等于0，即此时没有有用声音信号通过扬声器播放。第四声波信号
Figure PCTCN2019090662-appb-000006
Figure PCTCN2019090662-appb-000007
当第四声波信号的能量存在时，说明此时通过A2路径传输到耳道2内的声波信号没有被完全消除掉，第四声波信号
Figure PCTCN2019090662-appb-000008
导致的闭塞效应可能会被用户感知到。因此，可以根据上一帧的第四声波信号
Figure PCTCN2019090662-appb-000009
来调整当前帧的骨传导声波信号的第二增益以达到使得
Figure PCTCN2019090662-appb-000010
更好地消除x(n)的目的，如图8所示，上一帧的第四声波信号
Figure PCTCN2019090662-appb-000011
可以理解为反馈量，通过该反馈量来调整当前帧骨传导声波信号的幅值可以使得改善闭塞效应的效果越来越好，可以通过设置系统函数H(w)的值来调整当前帧骨传导声波信号的幅值的第二增益。
在上述实施例中，根据灵敏度调整骨传导声波信号的幅值后，还可以根据上一帧的第四声波信号调整当前帧骨传导声波信号的幅值的第二增益，此时，幅值的放大倍数包括第一增益和第二增益，系统函数H(w)则可以为第一增益和第二增益的乘积；若未根据灵敏度调整骨传导声波信号的幅值，也可以根据上一帧的第四声波信号调整骨传导声波信号的幅值的第二增益，此时，幅值的放大倍数包括第二增益，系统函数H(w)则包括第二增益。
基于上述实施例公开的内容，本实施例中，请参考图9，图9为本申请实施例的骨传声信号处理方法的流程图，根据上一帧的第四声波信号调整骨传导声波信号的幅值的第二增益可以包括以下步骤：
100：判断第N帧的所述第二增益是否小于第(N-1)帧的第二增益；
101：若第N帧的第二增益小于第(N-1)帧的第二增益，判断第N帧的第四声波信号的能量是否大于第(N-1)帧的第四声波信号的能量；
101a：若第N帧的第四声波信号的能量大于第(N-1)帧的第四声波信号的能量，则设置第(N+1)帧的第二增益大于第N帧的第二增益；
101b：若第N帧的第四声波信号的能量小于或等于第(N-1)帧的第四声波信号的能量，则设置第(N+1)帧的第二增益小于或等于 第N帧的第二增益。
本实施例中，N>1且为整数。为了方便描述，以第N帧为当前帧，第(N+1)为下一帧，第(N-1)帧为上一帧为例进行说明，若当前帧的第二增益小于上一帧的第二增益，需要根据当前帧的第四声波信号调整下一帧的骨传导声波信号的幅值的第二增益，具体地，可以根据当前帧的第四声波信号和上一帧的第四声波信号调整下一帧的骨传导声波信号的幅值的第二增益，如果当前帧的第四声波信号的能量大于上一帧的第四声波信号的能量，说明设置当前帧的第二增益小于上一帧的第二增益后，闭塞效应越来越明显了，因此，设置下一帧的骨传导声波信号的幅值的第二增益大于当前帧的幅值的第二增益，以改善闭塞效应恶化的现象；如果当前帧的第四声波信号的能量小于上一帧的第四声波信号的能量，说明闭塞效应越来越不明显了，因此，可以继续设置下一帧的第二增益小于当前帧的第二增益，也可以设置下一帧的第二增益等于当前帧的第二增益，以持续改善闭塞效应，如果当前帧的第四声波信号的能量等于上一帧的第四声波信号的能量，可以设置下一帧的第二增益小于或等于当前帧的第二增益，再通过判断下一帧的第四声波信号的能量与当前帧的第四声波信号的能量调整下下一帧的骨传导声波信号的幅值的第二增益；
或者，根据上一帧的第四声波信号调整骨传导声波信号的幅值的第二增益可以包括下述步骤，具体地，可以根据当前帧的第四声波信号和上一帧的第四声波信号调整下一帧的骨传导声波信号的幅值的第二增益，请参考图9，图9为本申请实施例的骨传声信号处理方法的流程图。
100：判断第N帧的第二增益是否小于第(N-1)帧的第二增益；
100a：若不是，则判断第N帧的第二增益是否大于第(N-1)帧的第二增益；
102：若第N帧的第二增益大于第(N-1)帧的第二增益，判断第N帧的第四声波信号的能量是否大于第(N-1)帧的第四声波信号的能量；
102a：若第N帧的第四声波信号的能量大于第(N-1)帧的第四声波信号的能量，则设置第(N+1)帧的第二增益小于当前帧的第二增益；
102b：若第N帧的第四声波信号的能量小于或等于第(N-1)帧的第四声波信号的能量，则设置第(N+1)帧的第二增益大于或等于第N帧的第二增益。
本实施例中，N>1且为整数。为了方便描述，以第N帧为当前帧，第(N+1)为下一帧，第(N-1)帧为上一帧为例进行说明，当前帧的第二增益大于上一帧第二增益，需要根据当前帧的第四声波信号调整下一帧的骨传导声波信号的幅值的第二增益，如果当前帧的第四声波信号的能量大于上一帧的第四声波信号的能量，说明闭塞效应越来越明显了，因此，设置下一帧的骨传导声波信号的幅值的第二增益小于当前帧的幅值的第二增益，以改善闭塞效应恶化的现象；如果当前帧的第四声波信号的能量小于上一帧的第四声波信号的能量，说明闭塞效应越来越不明显了，因此，可以继续设置下一帧的第二增益大于当前帧的第二增益，也可以设置下一帧的第二增益等于当前帧的第二增益，以持续改善闭塞效应，如果当前帧的第四声波信号的能量等于上一帧的第四声波信号的能量，可以设置下一帧的第二增益大于或等于当前帧的第二增益，再通过判断下一帧的第四声波信号的能量与当前帧的第四声波信号的能量调整下下一帧的骨传导声波信号的幅值的第二增益；
基于上述实施例公开的内容，本实施例中，请参考图10，图10为本申请实施例的骨传声信号处理方法的流程图，101b步骤中，设置第(N+1)帧的第二增益小于或等于第N帧的第二增益可以包括以下步骤：
103:判断第N帧的第四声波信号是否满足第一预设条件；
103a：第N帧的第四声波信号满足第一预设条件时，设置第(N+1)帧的第二增益小于第N帧的第二增益；
103b：第N帧的第四声波信号不满足第一预设条件时，设置第(N+1)帧的第二增益等于当前帧的第二增益；
本实施例中，以第N帧为当前帧，第(N+1)为下一帧为例进行 说明，若当前帧的第二增益小于上一帧的第二增益，需要根据当前帧的第四声波信号调整下一帧的骨传导声波信号的幅值的第二增益，如果当前帧的第四声波信号的能量小于上一帧的第四声波信号的能量，说明闭塞效应越来越不明显了，此时，可以通过判断当前帧的第四声波信号是否满足第一预设条件来确定设置下一帧的第二增益等于还是小于当前帧的第二增益，以持续改善闭塞效应，当前帧的第四声波信号满足第一预设条件时，说明虽然闭塞效应越来越不明显，但是当前帧的闭塞效应依然达不到用户需求，用户可以感知到，因此，需要继续调整下一帧的骨传导声波信号的幅值的第二增益，设置下一帧的第二增益小于当前帧的第二增益，以继续改善闭塞效应；当前帧的第四声波信号不满足第一预设条件时，说明当前帧的闭塞效应已经可以忽略，一定程度上对用户体验几乎没有影响，因此，可以设置下一帧的第二增益等于当前帧的第二增益，以保持改善闭塞效应的效果，使得下一帧的第四声波信号依然不满足第一预设条件。
请参考图11，图11为本申请实施例的骨传声信号处理方法的流程图，102b步骤中，设置第(N+1)帧的第二增益大于或等于第N帧的第二增益可以包括以下步骤：
104：判断第N帧的第四声波信号是否满足第一预设条件；
104a：第N帧的第四声波信号满足第一预设条件时，设置第(N+1)帧的第二增益大于第N帧的第二增益，
104b：第N帧的第四声波信号不满足第一预设条件时，设置第(N+1)帧的第二增益等于第N帧的第二增益。
本实施例中，以第N帧为当前帧，第(N+1)为下一帧为例进行说明，若当前帧的第二增益大于上一帧第二增益，还需要根据当前帧的第四声波信号调整下一帧的骨传导声波信号的幅值的第二增益，如果当前帧的第四声波信号的能量小于上一帧的第四声波信号的能量，说明闭塞效应越来越不明显了，因此，可以继续设置下一帧的第二增益大于当前帧的第二增益，也可以设置下一帧的第二增益等于当前帧的第二增益，以持续改善闭塞效应；此时，可以通过判断当前帧的第四声波信号是否满足第一预设条件来确定设置下一帧的第二增益等 于还是大于当前帧的第二增益，以持续改善闭塞效应，当前帧的第四声波信号满足第一预设条件时，说明虽然闭塞效应越来越不明显，但是当前帧的闭塞效应依然达不到用户需求，用户可以感知到，因此，需要继续调整下一帧的骨传导声波信号的幅值的第二增益，设置下一帧的第二增益大于当前帧的第二增益，以继续改善闭塞效应；当前帧的第四声波信号不满足第一预设条件时，说明当前帧的闭塞效应已经可以忽略，一定程度上对用户体验几乎没有影响，因此，可以设置下一帧的第二增益等于当前帧的第二增益，以保持改善闭塞效应的效果，使得下一帧的第四声波信号依然不满足第一预设条件。
基于上述实施例公开的内容，本实施例中，第一预设条件可以包括：
第一预设条件1：第四声波信号的能量大于或者等于第一能量阈值，第一能量阈值小于或者等于3dB；
第四声波信号的能量
Figure PCTCN2019090662-appb-000012
可以理解为反馈量，以上一帧的第四声波信号为例进行说明，上一帧的第四声波信号既可以表明上一帧改善闭塞效应的效果，也可以进一步作为调整当前帧的骨传导声波信号的幅值的第二增益参考量，当上一帧的第四声波信号的能量存在时，说明通过A2路径传输到耳道2内的上一帧的声波信号没有被完全消除掉，当上一帧的第四声波信号的能量大于或者等于第一能量阈值时，
Figure PCTCN2019090662-appb-000013
导致的闭塞效应可能会被用户感知到，因此，需要对当前帧的骨传导声波信号的幅值的第二增益进行调整以达到更好地消除x(n)的目的，由于上一帧的
Figure PCTCN2019090662-appb-000014
并没有很好的抵消x(n-1)，因此，如果继续按照对上一帧的骨传导声波信号的处理方法去处理当前帧的骨传导声波信号，则处理后的当前帧的骨传导声波信号
Figure PCTCN2019090662-appb-000015
也很大可能会不能很好地抵消x(n)。
当上一帧的第四声波信号的能量大于第一能量阈值时，需要调整 当前帧的骨传导声波信号的幅值的第二增益，以使得处理后的当前帧骨传导声波信号
Figure PCTCN2019090662-appb-000016
更接近x(n)，对于后续帧的第四声波信号，例如，s 4(n+1)也需要与第一能量阈值相比，以判断是否需要调整下一帧骨传导声波信号的幅值，以持续提高改善闭塞效应的效果。
该第一能量阈值的选取可以根据应用场景或者用户的需求进行选择，该第一能量阈值可以设置为小于或者等于3dB，第一能量阈值也可以设置为0或者其他数值，需要说明的是，本实施例对信号能量的求法不做限制，可以在时域求解和频域求解。
第一预设条件2：能量比值大于或等于能量比值阈值；
该能量比值为第四声波信号s 4(n)的能量与处理后的骨传导声波信号的能量的比值，该能量比值可以表示为：
Figure PCTCN2019090662-appb-000017
该能量比值阈值可以小于或等于0.1、0.2、0.3、0.4或0.5，该能量比值阈值可以根据应用场景或者用户的需求选择其他数值。以上一帧的能量比值为例进行说明，上一帧的能量比值越大，说明相对于处理后的骨传导声波信号
Figure PCTCN2019090662-appb-000018
的能量，
Figure PCTCN2019090662-appb-000019
的能量占比越大，表明上一帧的闭塞效应越明显，能量比值大于或等于能量比值阈值时，说明此时通过A2路径传输到耳道2内的声波信号没有被完全消除掉，因此，如果继续按照对上一帧的骨传导声波信号
Figure PCTCN2019090662-appb-000020
的处理方法去处理当前帧的骨传导声波信号，则处理后的当前帧的骨传导声波信号
Figure PCTCN2019090662-appb-000021
也很大可能会不能很好地抵消x(n)，因此需要调整当前帧的骨传导声波信号的幅值的第二增益，以进一步改善闭塞效应。
当上一帧的第四声波信号不满足第一预设条件时，上一帧的第四声波信号的能量小于第一能量阈值，或者，上一帧的能量比值小于能量比值阈值。
上一帧的第四声波信号的能量小于第一能量阈值，或者上一帧的 能量比值小于能量比值阈值，都可以说明改善闭塞效应的效果较好，此时通过A2路径传输到耳道2内的声波信号几乎可以被完全消除掉，或者是即使存在部分的通过A2路径传输到耳道2内的声波信号，也不会被用户感知到。因此，可以按照调整当前帧的骨传导声波信号的幅值的第二增益的方法去调整下一帧的骨传导声波信号的幅值的第二增益，以使得处理后的下一帧的骨传导声波信号也可以使得通过A2路径传输到耳道2内的声波信号被大部分或者完全消除掉，不被用户感知到。例如，当前帧的某一频点的骨传导声波信号的幅值的第二增益为1.3，当前帧的处理后的骨传导声波信号被耳机的扬声器播放后，若当前帧的某一频点的第四声波信号的能量小于第一能量阈值，则下一帧的该频点的骨传导声波信号的幅值的第二增益可以按照调整当前帧的该频点的骨传导声波信号的幅值的方法去调整，对下一帧该频点的骨传导声波信号的幅值也放大1.3倍，以能够稳定持续地改善闭塞效应；假设当前帧的某一频点的骨传导声波信号的幅值的第二增益为1，该处理后的骨传导声波信号被耳机的扬声器播放后，当前帧的第四声波信号的能量小于第一能量阈值，则下一帧的该频点的骨传导声波信号的幅值的第二增益也可以设置为1，即对下一帧的该频点的骨传导声波信号的幅值也不做处理，以能够稳定持续地改善闭塞效应。
假设当前帧的骨传导声波信号为第一帧的骨传导声波信号，由于不存在上一帧的骨传导声波信号，因此第一帧的骨传导声波信号的幅值的第二增益无法根据上一帧的第四声波信号去调整，因此，第一帧的骨传导声波信号可以不需要根据上一帧的第四声波信号调整其幅值的第二增益，第一帧骨传导声波信号播放后，若第一帧的第四声波信号的能量小于第一能量阈值，则第二帧骨传导声波信号的幅值的第二增益可以设置为1。
基于上述实施例公开的内容，本实施例中，第N帧的第四声波信号满足第一预设条件时，设置第(N+1)帧的第二增益小于第N帧的第二增益，或者，设置第(N+1)帧的第二增益大于第N帧的第二 增益，包括以下两种方法：
方法一：第N帧的第四声波信号的能量越大，或者第N帧的第四声波信号的能量和第一能量阈值之间的差值越大时，设置第(N+1)帧的骨传导声波信号的幅值的第二增益和第N帧的第二增益之间的差值越大；
方法一中，第N帧的第四声波信号为
Figure PCTCN2019090662-appb-000022
第四声波信号的能量为正值，第N帧的第四声波信号满足第一预设条件时，第N帧的第四声波信号的能量越大，或者第N帧的第四声波信号的能量与第一能量阈值之间的差值越大，说明通过A2路径传输到耳道2内的声波信号x(n)的能量与扬声器播放的处理后的骨传导声波信号
Figure PCTCN2019090662-appb-000023
的能量差值越大，此时，可以将第(N+1)帧的骨传导声波信号的幅值的第二增益与第N帧的第二增益之间的差值设置得越大，以进一步提高改善闭塞效应的效果。
方法二：第N帧的能量比值越大，或者第N帧的能量比值和能量比值阈值之间的差值越大时，设置第(N+1)帧的骨传导声波信号的幅值的第二增益和第N帧的骨传导声波信号的幅值的第二增益之间的差值越大；
方法二中，第N帧的第四声波信号
Figure PCTCN2019090662-appb-000024
第四声波信号的能量为正值，第N帧的第四声波信号满足第一预设条件时，能量比值
Figure PCTCN2019090662-appb-000025
越大，或者是能量比值与能量比值阈值之间的差值越大，说明相对于
Figure PCTCN2019090662-appb-000026
的能量来说，通过A2路径传输到耳道2内的声波信号x(n)的能量与扬声器播放的处理后的骨传导声波信号
Figure PCTCN2019090662-appb-000027
的能量差值越大。当第N帧的能量比值越大或者是第N帧的能量比值与能量比值阈值之间的差值越大时，可以设置第(N+1)帧的骨传导声波信号的幅值的第二增益与第N帧的第二增益之间的差值越大，以进一步提高改善闭塞效应的效果。
基于上述实施例公开的内容，本实施例中，设置第(N+1)帧的第二增益和第N帧的第二增益之间的差值越大包括以下四种设置方式：
方式一：设置第(N+1)帧的骨传导声波信号的幅值的第二增益和第N帧的骨传导声波信号的幅值的第二增益之间的差值与第N帧的第四声波信号的能量成正比；第N帧的第四声波信号的能量越大，说明对第(N+1)帧的骨传导声波信号的幅值的调整幅度需要越大，因此设置第(N+1)帧骨传导声波信号的幅值的第二增益和第N帧的骨传导声波信号的幅值的第二增益之间的差值与第N帧的第四声波信号的能量成正比，可以进一步提高改善闭塞效应的效果。
方式二：设置第(N+1)帧的骨传导声波信号的幅值的第二增益和第N帧的第二增益之间的差值与第N帧的第四声波信号的能量和第一能量阈值之间的差值成正比；第N帧的第四声波信号的能量和第一能量阈值之间的差值越大，说明对第(N+1)帧的骨传导声波信号的幅值的调整幅度需要越大，因此，设置第(N+1)帧的骨传导声波信号的幅值的第二增益和第N帧的第二增益之间的差值与第N帧的第四声波信号的能量和第一能量阈值之间的差值成正比，可以进一步提高改善闭塞效应的效果。
方式三：设置第(N+1)帧的骨传导声波信号的幅值的第二增益和第N帧的第二增益之间的差值与第N帧的能量比值成正比；第N帧的能量比值越大，说明对第(N+1)帧的骨传导声波信号的幅值的调整幅度需要越大，设置第(N+1)帧的骨传导声波信号的幅值的第二增益和第N帧的第二增益之间的差值与能量比值成正比，可以进一步提高改善闭塞效应的效果。
方式四：设置第(N+1)帧的骨传导声波信号的幅值的第二增益和第N帧的第二增益之间的差值与第N帧的能量比值和能量比值阈值之间的差值成正比；第N帧的能量比值和能量比值阈值之间的差值越大，说明对第(N+1)帧的骨传导声波信号的幅值的调整幅度需要越大，因此，设置第(N+1)帧的骨传导声波信号的幅值的第二增益和上一帧的第二增益之间的差值与第N帧的能量比值和能量比值阈值之间的差值成正比，可以进一步提高改善闭塞效应的效果。
基于上述实施例公开的内容，本实施例中，根据上一帧的第四声 波信号调整所述骨传导声波信号的幅值的第二增益还包括：
010：判断第一帧的第四声波信号是否满足第一预设条件；
010a：当第一帧的第四声波信号满足第一预设条件时，设置第二帧的第二增益小于第一帧的第二增益，或者，设置第二帧的第二增益大于第一帧的第二增益；
当第一帧的第四声波信号满足第一预设条件时，调整第二帧的骨传导声波信号的幅值的第二增益可以包括以下两种方式：设置第二帧的骨传导声波信号的幅值的第二增益小于第一帧的骨传导声波信号的幅值的第二增益，或者，设置第二帧的骨传导声波信号的幅值的第二增益大于第一帧的骨传导声波信号的幅值的第二增益。需要说明的是，本实施例中，设置第二帧的骨传导声波信号的幅值的第二增益的具体方法可以参见上述实施例，例如，第一帧的第四声波信号的能量越大，或者第一帧的第四声波信号的能量和第一能量阈值之间的差值越大，或者第一帧的所述能量比值越大，或者第一帧的能量比值和能量比值阈值之间的差值越大时，设置第二帧的第二增益和所述第一帧的第二增益之间的差值越大。
具体地，设置第二帧的第二增益和第一帧的第二增益之间的差值与第一帧的第四声波信号的能量成正比；或者
设置第二帧的第二增益和第一帧的第二增益之间的差值与第一帧的第四声波信号的能量和第一能量阈值之间的差值成正比；或者
设置第二帧的第二增益和第一帧的第二增益之间的差值与所述第一帧的能量比值成正比；或者
设置第二帧的第二增益和所述第一帧的第二增益之间的差值与第一帧的能量比值和能量比值阈值之间的差值成正比。
010b：第一帧的第四声波信号不满足第一预设条件时，设置第二帧的骨传导声波信号的幅值的第二增益等于第一帧的骨传导声波信号的幅值的第二增益。
根据第一帧的第四声波信号是否满足第一预设条件，对第二帧的骨传导声波信号的幅值的第二增益做不同的处理以调整第二帧骨传 导声波信号的幅值，本实施例中，第一帧的第四声波信号可以作为反馈量，根据该反馈量调整当前帧的骨传导声波信号的幅值，可以进一步消除闭塞效应，不断提高用户体验感。
基于上述实施例公开的内容，本实施例中，耳机的扬声器播放处理后的骨传导声波信号之后，处理还包括调整下一帧的骨传导声波信号的相位。处理后的骨传导声波信号可能与通过A2路径传输到耳道2内的声波信号的相位不是完全反相，因此，需要调整下一帧的骨传导声波信号的相位以提高改善闭塞效应的效果。
基于上述实施例公开的内容，本实施例中，当根据上一帧的第四声波信号连续调整M帧的骨传导声波信号的幅值的第二增益后，调整该M帧的骨传导声波信号的下一帧的骨传导声波信号的相位，相位的调整范围为-20度至+20度，M为整数且M>1。连续调整M帧的骨传导声波信号的幅值的第二增益后，可能通过A2路径传输到耳道2内的声波信号依然没有被抵消，这种情况下，可以通过调整该M帧的骨传导声波信号的下一帧的骨传导声波信号的相位以进一步提高改善闭塞效应的效果，如图8所示，可以通过改变系统函数H(w)的值来调整下一帧的骨传导声波信号的相位。本实施例对M的具体值不做限制。相位的调整范围设置为-20度至+20度，可以避免相位调节过多以至于调节相位后的骨传导声波信号不能很好的抵消通过A2路径传输到耳道2内的声波信号。
基于上述实施例公开的内容，本实施例中，还包括选择骨传声传感器，选择骨传声传感器包括：
根据归一化后的骨传声传感器的频率灵敏度曲线的平坦度选择骨传声传感器。
本实施例中，对多个骨传声传感器的频率灵敏度曲线归一化后，可以根据骨传声传感器的频率灵敏度曲线的平坦度选择骨传声传感器，频率灵敏度曲线的平坦度越好，则骨传声传感器的性能越好，骨传声传感器采集到的骨传导声波信号就可以更接近通过A2路径传输到耳道2内的声波信号x(n)。在根据骨传声传感器的频率灵敏度曲线的平坦度选择骨传声传感器时，可以对骨传声传感器的频率灵敏度曲线进行归一化，例如归一化到1kHz或者是其他频率，归一化之后， 可以便于骨传声传感器的横向对比，对于频率灵敏度曲线的平坦度的求解方法本实施例不做限制，可以是通过求解方差、均方误差等得到。
本申请实施例还可提供一种骨传声信号处理装置，用于执行前述实施例中提出的骨传声信号处理方法，图14为本实施例提供的一种骨传声信号处理装置的结构示意图，该装置可以执行上述图2所示的方法，如图12所示，该骨传声信号处理装置20包括：
骨传声传感器模块21，用于采集骨传导声波信号，骨传声传感器模块与耳道接触或通过固体介质与耳道之间形成振动传导路径；
骨传声处理模块22，用于对骨传导声波信号进行处理，骨传声处理模块包括反相模块；以及
输出模块23，用于将处理后的骨传导声波信号传输到人耳。
可选的，输出模块包括：
扬声器模块，用于播放处理后的骨传导声波信号；或者
骨传声处理模块还用于将处理后的骨传导声波信号传输到人耳。
可选的，骨传声处理模块还包括
第一幅值处理模块，第一幅值处理模块用于根据骨传声传感器模块的灵敏度调整预设频段内的骨传导声波信号的幅值；
预设频段内的频点对应的骨传声传感器模块的灵敏度越高，频点的骨传导声波信号的幅值的第一增益越小，幅值的放大倍数包括第一增益。
可选的，第一幅值处理模块还用于设置频点的骨传导声波信号的幅值的第一增益与频点对应的骨传声传感器模块的灵敏度成反比。
可选的，第一幅值处理模块前，骨传声处理模块还包括拟合模块，拟合模块用于对骨传声传感器模块的频率灵敏度曲线进行拟合，拟合包括一次线性拟合、二次曲线拟合或者三次曲线拟合。
可选的，扬声器模块之后，骨传声处理模块还包括第二幅值处理模块，第二幅值处理模块用于根据上一帧的第四声波信号调整骨传导声波信号的幅值的第二增益；
第四声波信号为第二声波信号减去有用声音信号得到，第二声波 信号为扬声器模块播放处理后的骨传导声波信号时，耳机的麦克风在耳道内采集到的，有用声音信号为扬声器模块播放处理后的骨传导声波信号时，扬声器模块播放的除处理后的骨传导声波信号之外的声波信号。
可选的，第二幅值处理模块包括：
增益调节模块，若第N帧的第二增益小于第(N-1)帧的第二增益，且第N帧的第四声波信号的能量大于第(N-1)帧的第四声波信号的能量，增益调节模块用于设置第(N+1)帧的第二增益大于第N帧的第二增益，或者，若第N帧的第四声波信号的能量小于或等于第(N-1)帧的第四声波信号的能量，增益调节模块还用于设置第(N+1)帧的第二增益小于或等于第N帧的第二增益；或者
若第N帧的第二增益大于第(N-1)帧的第二增益，且第N帧的第四声波信号的能量大于第(N-1)帧的第四声波信号的能量，增益调节模块还用于设置第(N+1)帧的第二增益小于第N帧的第二增益，或者，若第N帧的第四声波信号的能量小于或等于第(N-1)帧的第四声波信号的能量，增益调节模块还用于设置第(N+1)帧的第二增益大于或等于第N帧的第二增益，N>1且为整数。
可选的，增益调节模块还用于设置第(N+1)帧的第二增益小于或等于第N帧的第二增益包括：
第N帧的第四声波信号满足第一预设条件时，增益调节模块还用于设置第(N+1)帧的第二增益小于第N帧的第二增益，或者，第N帧的第四声波信号不满足第一预设条件时，增益调节模块还用于设置第(N+1)帧的第二增益等于当前帧的第二增益；
增益调节模块还用于设置第(N+1)帧的第二增益大于或等于第N帧的第二增益，包括：
第N帧的第四声波信号满足第一预设条件时，增益调节模块还用于设置第(N+1)帧的第二增益大于第N帧的第二增益，或者，第N帧的第四声波信号不满足第一预设条件时，增益调节模块还用于设置(N+1)帧的第二增益等于当前帧的第二增益。
可选的，第一预设条件包括：
第四声波信号的能量大于或者等于第一能量阈值，第一能量阈值小于或者等于3dB；或者
能量比值大于或等于能量比值阈值；能量比值为第四声波信号的能量与处理后的骨传导声波信号的能量的比值，能量比值阈值小于或等于0.1、0.2、0.3、0.4或0.5。
可选的，第N帧的第四声波信号满足第一预设条件时，增益调节模块还用于设置第(N+1)帧的第二增益小于第N帧的第二增益，或者增益调节模块还用于设置第(N+1)帧的第二增益大于第N帧的第二增益，包括：
第N帧的第四声波信号的能量越大，或者第N帧的第四声波信号的能量和第一能量阈值之间的差值越大，或者第N帧的能量比值越大，或者第N帧的能量比值和能量比值阈值之间的差值越大时，增益调节模块还用于设置第(N+1)帧的第二增益和第N帧的第二增益之间的差值越大。
可选的，增益调节模块还用于设置第(N+1)帧的第二增益和第N帧的第二增益之间的差值越大包括：
增益调节模块还用于设置第(N+1)帧的第二增益和第N帧的第二增益之间的差值与第N帧的第四声波信号的能量成正比；或者
增益调节模块还用于设置第(N+1)帧的第二增益和第N帧的第二增益之间的差值与第N帧的第四声波信号的能量和第一能量阈值之间的差值成正比；或者
增益调节模块还用于设置第(N+1)帧的第二增益和第N帧的第二增益之间的差值与第N帧的能量比值成正比；或者
增益调节模块还用于设置第(N+1)帧的第二增益和第N帧的第二增益之间的差值与第N帧的能量比值和能量比值阈值之间的差值成正比。
可选的，其特征在于，第二幅值处理模块用于根据上一帧的第四声波信号调整骨传导声波信号的幅值的第二增益还包括：
第一帧的第四声波信号满足第一预设条件时，第二幅值处理模块还用于设置第二帧的第二增益小于第一帧的第二增益，或者，第二幅值处理模块还用于设置第二帧的第二增益大于第一帧的第二增益；或者
第一帧的第四声波信号不满足第一预设条件时，第二幅值处理模块还用于设置第二帧的第二增益等于第一帧的第二增益。
可选的，扬声器模块之后，骨传声处理模块还包括：
相位调整模块，用于调整下一帧骨传导声波信号的相位。
可选的，当第二幅值处理模块根据上一帧的第四声波信号连续调整M帧的骨传导声波信号的幅值的第二增益后，相位调整模块还用于调整M帧的骨传导声波信号的下一帧的骨传导声波信号的相位，相位的调整范围为-20度至+20度，M为整数且M>1。
可选的，还包括
骨传声传感器选择模块，用于选择骨传声传感器模块，骨传声传感器选择模块根据归一化后的骨传声传感器模块的频率灵敏度曲线的平坦度选择骨传声传感器模块。
本申请实施例提供了一种骨传声信号处理装置，通过骨传声传感器模块采集骨传导声波信号并对骨传导声波信号进行反相处理后传输到人耳，解决了耳机的闭塞效应的问题，显著的提升了用户体验。
本申请实施例还可提供一种芯片，用于执行上述实施例提出的骨传声信号方法；
本申请实施例提供的芯片，可执行上述任一所述实施例提供的骨传声信号处理方法，其具体的实现过程及有益效果参见上述，在此不再赘述。
本申请实施例提供的一种耳机，包括上述任一所述实施例提供的芯片，该耳机还包括骨传声传感器，骨传声传感器与耳道接触或通过固体介质与耳道之间形成振动传导路径。
本申请实施例提供的耳机，可执行上述任一所述实施例提供的骨传声信号处理方法，其具体的实现过程及有益效果参见上述，在此不 再赘述。
本申请实施例还可提供一种计算机可读存储介质，包括：其上存储有计算机程序，该计算机程序被处理器执行时实现该设备执行的任一骨传声信号处理方法。
本申请实施例提供的计算机可读存储介质，可执行上述任一所述实施例提供的骨传声信号处理方法，其具体的实现过程及有益效果参见上述，在此不再赘述。
应注意，本申请上述方法实施例可以应用于处理器中，或者由处理器实现。处理器可能是一种集成电路芯片，具有信号的处理能力。在实现过程中，上述方法实施例的各步骤可以通过处理器中的硬件的集成逻辑电路或者软件形式的指令完成。上述的处理器可以是通用处理器、数字信号处理器(digital signal processor，DSP)、专用集成电路(application specific integrated circuit，ASIC)、现成可编程门阵列(field programmable gate array，FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。可以实现或者执行本申请实施例中的公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。结合本申请实施例所公开的方法的步骤可以直接体现为硬件译码处理器执行完成，或者用译码处理器中的硬件及软件模块组合执行完成。软件模块可以位于随机存储器，闪存、只读存储器，可编程只读存储器或者电可擦写可编程存储器、寄存器等本领域成熟的存储介质中。该存储介质位于存储器，处理器读取存储器中的信息，结合其硬件完成上述方法的步骤。
可以理解，本申请实施例中的存储器可以是易失性存储器或非易失性存储器，或可包括易失性和非易失性存储器两者。其中，非易失性存储器可以是只读存储器(read-only memory，ROM)、可编程只读存储器(programmable rom，PROM)、可擦除可编程只读存储器(erasable PROM，EPROM)、电可擦除可编程只读存储器(electrically EPROM，EEPROM)或闪存。易失性存储器可以是随机存取存储器 (random access memory，RAM)，其用作外部高速缓存。通过示例性但不是限制性说明，许多形式的RAM可用，例如静态随机存取存储器(static RAM，SRAM)、动态随机存取存储器(dynamic RAM，DRAM)、同步动态随机存取存储器(synchronous DRAM，SDRAM)、双倍数据速率同步动态随机存取存储器(double data rate SDRAM，DDR SDRAM)、增强型同步动态随机存取存储器(enhanced SDRAM，ESDRAM)、同步连接动态随机存取存储器(synchlink DRAM，SLDRAM)和直接内存总线随机存取存储器(direct rambus RAM，DR RAM)。应注意，本文描述的系统和方法的存储器旨在包括但不限于这些和任意其它适合类型的存储器。
应理解，在本申请实施例中，“与A相应的B”表示B与A相关联，根据A可以确定B。但还应理解，根据A确定B并不意味着仅仅根据A确定B，还可以根据A和/或其它信息确定B。
另外，本文中术语“和/或”，仅仅是一种描述关联对象的关联关系，表示可以存在三种关系，例如，A和/或B，可以表示：单独存在A，同时存在A和B，单独存在B这三种情况。另外，本文中字符“/”，一般表示前后关联对象是一种“或”的关系。
本领域普通技术人员可以意识到，结合本文中所公开的实施例描述的各示例的单元及算法步骤，能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行，取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本申请的范围。
所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，上述描述的系统、装置和单元的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。
在本申请所提供的几个实施例中，应该理解到，所揭露的系统、装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，所述单元的划分，仅仅为一种逻辑功能 划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或单元的间接耦合或通信连接，可以是电性，机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外，在本申请各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。
所述功能如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(read-only memory，ROM)、随机存取存储器(random access memory，RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述，仅为本申请的具体实施方式，但本申请的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本申请揭露的技术范围内，可轻易想到变化或替换，都应涵盖在本申请的保护范围之内。因此，本申请的保护范围应以所述权利要求的保护范围为准。

Claims (33)

  1. 一种骨传声信号处理方法，其特征在于，包括：
    骨传声传感器采集骨传导声波信号，所述骨传声传感器与耳道接触或通过固体介质与所述耳道之间形成振动传导路径；
    对所述骨传导声波信号进行处理，所述处理包括反相；
    将处理后的所述骨传导声波信号传输到人耳。
  2. 根据权利要求1所述的骨传声信号处理方法，其特征在于，所述将处理后的所述骨传导声波信号传输到人耳包括：
    耳机的扬声器播放所述处理后的所述骨传导声波信号；或者
    所述骨传声传感器将所述处理后的所述骨传导声波信号传输到所述人耳。
  3. 根据权利要求1或2所述的骨传声信号处理方法，其特征在于，所述处理还包括根据所述骨传声传感器的灵敏度调整预设频段内的所述骨传导声波信号的幅值；
    所述预设频段内的频点对应的所述骨传声传感器的所述灵敏度越高，所述频点的所述骨传导声波信号的幅值的第一增益越小，所述幅值的放大倍数包括所述第一增益。
  4. 根据权利要求3所述的骨传声信号处理方法，其特征在于，所述根据所述骨传声传感器的灵敏度调整预设频段内的所述骨传导声波信号的幅值包括：设置所述频点的所述骨传导声波信号的所述幅值的所述第一增益与所述频点对应的所述骨传声传感器的所述灵敏度成反比。
  5. 根据权利要求3或4所述的骨传声信号处理方法，其特征在于，所述根据所述骨传声传感器的灵敏度调整预设频段内的所述骨传导声波信号的幅值前，所述处理还包括对所述骨传声传感器的频率灵敏度曲线进行拟合，所述拟合包括一次线性拟合、二次曲线拟合或者三次曲线拟合。
  6. 根据权利要求2至5中任一项所述的骨传声信号处理方法，其特征在于，所述耳机的扬声器播放所述处理后的所述骨传导声波信号之后，所述处理还包括根据上一帧的第四声波信号调整所述骨传导声波信号的幅值的第二增益，所述幅值的放大倍数包括所述第二增益；
    所述第四声波信号为第二声波信号减去有用声音信号得到，所述第二声波信号为所述扬声器播放所述处理后的所述骨传导声波信号时，所述耳机的麦克风在所述耳道内采集到的，所述有用声音信号为所述扬声器播放所述处理后的所述骨传导声波信号时，所述扬声器播放的除所述处理后的所述骨传导声波信号之外的声波信号。
  7. 根据权利要求6所述的骨传声信号处理方法，其特征在于，所述根据上一帧的第四声波信号调整所述骨传导声波信号的幅值的第二增益包括：
    若第N帧的所述第二增益小于第(N-1)帧的所述第二增益，且所述第N帧的所述第四声波信号的能量大于所述第(N-1)帧的所述第四声波信号的能量，则设置第(N+1)帧的所述第二增益大于所述第N帧的所述第二增益，或者，若所述第N帧的所述第四声波信号的所述能量小于或等于所述第(N-1)帧的所述第四声波信号的所述能量，则设置所述第(N+1)帧的所述第二增益小于或等于所述第N帧的所述第二增益；或者
    若所述第N帧的所述第二增益大于所述第(N-1)帧的所述第二增益，且所述第N帧的所述第四声波信号的所述能量大于所述第(N-1)帧的所述第四声波信号的所述能量，则设置所述第(N+1)帧的所述第二增益小于所述第N帧的所述第二增益，或者，若所述第N帧的所述第四声波信号的所述能量小于或等于所述第(N-1)帧的所述第四声波信号的所述能量，则设置所述第(N+1)帧的所述第二增益大于或等于所述第N帧的所述第二增益，所述N>1且为整数。
  8. 根据权利要求7所述的骨传声信号处理方法，其特征在于，所述设置第(N+1)帧的所述第二增益小于或等于所述第N帧的所述第二增益包括：
    所述第N帧的所述第四声波信号满足第一预设条件时，设置所述第(N+1)帧的所述第二增益小于所述第N帧的所述第二增益，或者，所述第N帧的所述第四声波信号不满足所述第一预设条件时，设置所述第(N+1)帧的所述第二增益等于所述当前帧的所述第二增益；
    所述设置所述第(N+1)帧的所述第二增益大于或等于所述第N帧的所述第二增益包括：
    所述第N帧的所述第四声波信号满足所述第一预设条件时，设置所述第(N+1)帧的所述第二增益大于所述第N帧的所述第二增益，或者，所述第N帧的所述第四声波信号不满足所述第一预设条件时，设置所述(N+1)帧的所述第二增益等于所述当前帧的所述第二增益。
  9. 根据权利要求8所述的骨传声信号处理方法，其特征在于，所述第一预设条件包括：
    所述第四声波信号的能量大于或者等于第一能量阈值，所述第一能量阈值小于或者等于3dB；或者
    能量比值大于或等于能量比值阈值；所述能量比值为所述第四声波信号的能量与所述处理后的所述骨传导声波信号的能量的比值，所述能量比值阈值小于或等于0.1、0.2、0.3、0.4或0.5。
  10. 根据权利要求9所述的骨传声信号处理方法，其特征在于，所述第N帧的所述第四声波信号满足第一预设条件时，设置所述第(N+1)帧的所述第二增益小于所述第N帧的所述第二增益，或者，设置所述第(N+1)帧的所述第二增益大于所述第N帧的所述第二增益，包括：
    所述第N帧的所述第四声波信号的能量越大，或者所述第N帧的所述第四声波信号的能量和所述第一能量阈值之间的差值越大，或者所述第N帧的所述能量比值越大，或者所述第N帧的所述能量比值和所述能量比值阈值之间的差值越大时，设置所述第(N+1)帧的所述第二增益和所述第N帧的所述第二增益之间的差值越大。
  11. 根据权利要求10所述的骨传声信号处理方法，其特征在于，所述设置所述第(N+1)帧的所述第二增益和所述第N帧的所述第二增益之间的差值越大包括：
    设置所述第(N+1)帧的所述第二增益和所述第N帧的所述第二增益之间的差值与所述第N帧的所述第四声波信号的能量成正比；或者
    设置所述第(N+1)帧的所述第二增益和所述第N帧的所述第二增益之间的差值与所述第N帧的所述第四声波信号的能量和所述第一能量阈值之间的差值成正比；或者
    设置所述第(N+1)帧的所述第二增益和所述第N帧的所述第二增益 之间的差值与所述第N帧的所述能量比值成正比；或者
    设置所述第(N+1)帧的所述第二增益和所述第N帧的所述第二增益之间的差值与所述第N帧的所述能量比值和所述能量比值阈值之间的差值成正比。
  12. 根据权利要求8至11所述的骨传声信号处理方法，其特征在于，所述根据上一帧的所述第四声波信号调整所述骨传导声波信号的幅值的第二增益还包括：
    第一帧的所述第四声波信号满足所述第一预设条件时，设置第二帧的所述第二增益小于所述第一帧的所述第二增益，或者，设置所述第二帧的所述第二增益大于所述第一帧的所述第二增益；或者
    所述第一帧的所述第四声波信号不满足所述第一预设条件时，设置所述第二帧的所述第二增益等于所述第一帧的所述第二增益。
  13. 根据权利要求6至12中任一项所述的骨传声信号处理方法，其特征在于，所述耳机的扬声器播放所述处理后的所述骨传导声波信号之后，所述处理还包括调整所述下一帧的所述骨传导声波信号的相位。
  14. 根据权利要求13所述的骨传声信号处理方法，其特征在于，当根据所述上一帧的所述第四声波信号连续调整M帧的所述骨传导声波信号的幅值的所述第二增益后，调整所述M帧的所述骨传导声波信号的下一帧的所述骨传导声波信号的相位，所述相位的调整范围为-20度至+20度，所述M为整数且M>1。
  15. 根据权利要求1至14中任一项所述的骨传声信号处理方法，其特征在于，还包括选择所述骨传声传感器，所述选择所述骨传声传感器包括：
    根据归一化后的所述骨传声传感器的频率灵敏度曲线的平坦度选择所述骨传声传感器。
  16. 一种骨传声信号处理装置，包括：
    骨传声传感器模块，用于采集骨传导声波信号，所述骨传声传感器模块与耳道接触或通过固体介质与所述耳道之间形成振动传导路径；
    骨传声处理模块，用于对所述骨传导声波信号进行处理，所述骨传声处理模块包括反相模块；以及
    输出模块，用于将处理后的所述骨传导声波信号传输到人耳。
  17. 根据权利要求16所述的骨传声信号处理装置，其特征在于，所述输出模块包括：
    扬声器模块，用于播放所述处理后的所述骨传导声波信号；或者
    所述骨传声处理模块还用于将所述处理后的所述骨传导声波信号传输到所述人耳。
  18. 根据权利要求16或17所述的骨传声信号处理装置，其特征在于，所述骨传声处理模块还包括
    第一幅值处理模块，所述第一幅值处理模块用于根据所述骨传声传感器模块的灵敏度调整预设频段内的所述骨传导声波信号的幅值；
    所述预设频段内的频点对应的所述骨传声传感器模块的所述灵敏度越高，所述频点的所述骨传导声波信号的幅值的第一增益越小，所述幅值的放大倍数包括所述第一增益。
  19. 根据权利要求18所述的骨传声信号处理装置，其特征在于，所述第一幅值处理模块还用于设置所述频点的所述骨传导声波信号的所述幅值的所述第一增益与所述频点对应的所述骨传声传感器模块的所述灵敏度成反比。
  20. 根据权利要求18或19所述的骨传声信号处理装置，其特征在于，所述第一幅值处理模块前，所述骨传声处理模块还包括拟合模块，所述拟合模块用于对所述骨传声传感器模块的频率灵敏度曲线进行拟合，所述拟合包括一次线性拟合、二次曲线拟合或者三次曲线拟合。
  21. 根据权利要求17至20中任一项所述的骨传声信号处理装置，其特征在于，所述扬声器模块之后，所述骨传声处理模块还包括第二幅值处理模块，所述第二幅值处理模块用于根据上一帧的第四声波信号调整所述骨传导声波信号的幅值的第二增益；
    所述第四声波信号为第二声波信号减去有用声音信号得到，所述第二声波信号为所述扬声器模块播放所述处理后的所述骨传导声波信号时，耳机的麦克风在所述耳道内采集到的，所述有用声音信号为所述扬声器模块播放所述处理后的所述骨传导声波信号时，所述扬声器模块播放的除所述 处理后的所述骨传导声波信号之外的声波信号。
  22. 根据权利要求21所述的骨传声信号处理装置，其特征在于，所述第二幅值处理模块包括：
    增益调节模块，若第N帧的所述第二增益小于第(N-1)帧的所述第二增益，且所述第N帧的所述第四声波信号的能量大于所述第(N-1)帧的所述第四声波信号的能量，所述增益调节模块用于设置第(N+1)帧的所述第二增益大于所述第N帧的所述第二增益，或者，若所述第N帧的所述第四声波信号的所述能量小于或等于所述第(N-1)帧的所述第四声波信号的所述能量，所述增益调节模块还用于设置所述第(N+1)帧的所述第二增益小于或等于所述第N帧的所述第二增益；或者
    若所述第N帧的所述第二增益大于所述第(N-1)帧的所述第二增益，且所述第N帧的所述第四声波信号的所述能量大于所述第(N-1)帧的所述第四声波信号的所述能量，所述增益调节模块还用于设置所述第(N+1)帧的所述第二增益小于所述第N帧的所述第二增益，或者，若所述第N帧的所述第四声波信号的所述能量小于或等于所述第(N-1)帧的所述第四声波信号的所述能量，所述增益调节模块还用于设置所述第(N+1)帧的所述第二增益大于或等于所述第N帧的所述第二增益，所述N>1且为整数。
  23. 根据权利要求22所述的骨传声信号处理装置，其特征在于，所述增益调节模块还用于设置所述第(N+1)帧的所述第二增益小于或等于所述第N帧的所述第二增益包括：
    所述第N帧的所述第四声波信号满足第一预设条件时，所述增益调节模块还用于设置所述第(N+1)帧的所述第二增益小于所述第N帧的所述第二增益，或者，所述第N帧的所述第四声波信号不满足所述第一预设条件时，所述增益调节模块还用于设置所述第(N+1)帧的所述第二增益等于所述当前帧的所述第二增益；
    所述增益调节模块还用于设置所述第(N+1)帧的所述第二增益大于或等于所述第N帧的所述第二增益，包括：
    所述第N帧的所述第四声波信号满足所述第一预设条件时，所述增益调节模块还用于设置所述第(N+1)帧的所述第二增益大于所述第N帧的 所述第二增益，或者，所述第N帧的所述第四声波信号不满足所述第一预设条件时，所述增益调节模块还用于设置所述(N+1)帧的所述第二增益等于所述当前帧的所述第二增益。
  24. 根据权利要求23所述的骨传声信号处理装置，其特征在于，所述第一预设条件包括：
    所述第四声波信号的能量大于或者等于第一能量阈值，所述第一能量阈值小于或者等于3dB；或者
    能量比值大于或等于能量比值阈值；所述能量比值为所述第四声波信号的能量与所述处理后的所述骨传导声波信号的能量的比值，所述能量比值阈值小于或等于0.1、0.2、0.3、0.4或0.5。
  25. 根据权利要求24所述的骨传声信号处理装置，其特征在于，所述第N帧的所述第四声波信号满足第一预设条件时，所述增益调节模块还用于设置所述第(N+1)帧的所述第二增益小于所述第N帧的所述第二增益，或者所述增益调节模块还用于设置所述第(N+1)帧的所述第二增益大于所述第N帧的所述第二增益，包括：
    所述第N帧的所述第四声波信号的能量越大，或者所述第N帧的所述第四声波信号的能量和所述第一能量阈值之间的差值越大，或者所述第N帧的所述能量比值越大，或者所述第N帧的所述能量比值和所述能量比值阈值之间的差值越大时，所述增益调节模块还用于设置所述第(N+1)帧的所述第二增益和所述第N帧的所述第二增益之间的差值越大。
  26. 根据权利要求25所述的骨传声信号处理装置，其特征在于，所述增益调节模块还用于设置所述第(N+1)帧的所述第二增益和所述第N帧的所述第二增益之间的差值越大包括：
    所述增益调节模块还用于设置所述第(N+1)帧的所述第二增益和所述第N帧的所述第二增益之间的差值与所述第N帧的所述第四声波信号的能量成正比；或者
    所述增益调节模块还用于设置所述第(N+1)帧的所述第二增益和所述第N帧的所述第二增益之间的差值与所述第N帧的所述第四声波信号的能量和所述第一能量阈值之间的差值成正比；或者
    所述增益调节模块还用于设置所述第(N+1)帧的所述第二增益和所述第N帧的所述第二增益之间的差值与所述第N帧的所述能量比值成正比；或者
    所述增益调节模块还用于设置所述第(N+1)帧的所述第二增益和所述第N帧的所述第二增益之间的差值与所述第N帧的所述能量比值和所述能量比值阈值之间的差值成正比。
  27. 根据权利要求23至26中任一项所述的骨传声信号处理装置，其特征在于，所述第二幅值处理模块用于根据上一帧的第四声波信号调整所述骨传导声波信号的幅值的第二增益还包括：
    第一帧的所述第四声波信号满足所述第一预设条件时，所述第二幅值处理模块还用于设置第二帧的所述第二增益小于所述第一帧的所述第二增益，或者，所述第二幅值处理模块还用于设置所述第二帧的所述第二增益大于所述第一帧的所述第二增益；或者
    所述第一帧的所述第四声波信号不满足所述第一预设条件时，所述第二幅值处理模块还用于设置所述第二帧的所述第二增益等于所述第一帧的所述第二增益。
  28. 根据权利要求21至27中任一项所述的骨传声信号处理装置，其特征在于，所述扬声器模块之后，所述骨传声处理模块还包括：
    相位调整模块，用于调整所述下一帧所述骨传导声波信号的相位。
  29. 根据权利要求28所述的骨传声信号处理装置，其特征在于，当所述第二幅值处理模块根据所述上一帧的所述第四声波信号连续调整M帧的所述骨传导声波信号的幅值的所述第二增益后，所述相位调整模块还用于调整所述M帧的所述骨传导声波信号的下一帧的所述骨传导声波信号的相位，所述相位的调整范围为-20度至+20度，所述M为整数且M>1。
  30. 根据权利要求16至29中任一项所述的骨传声信号处理装置，其特征在于，还包括
    骨传声传感器选择模块，用于选择所述骨传声传感器模块，所述骨传声传感器选择模块根据归一化后的所述骨传声传感器模块的频率灵敏度曲线的平坦度选择所述骨传声传感器模块。
  31. 一种芯片，其特征在于，用于执行如权利要求1至15中任一项所述的骨传声信号处理方法。
  32. 一种耳机，其特征在于，包括如权利要求31所述的芯片。
  33. 一种计算机可读存储介质，其特征在于，包括：其上存储有计算机程序，其特征在于，所述计算机程序被处理器执行时实现上述权利要求1至15中任一项所述的骨传声信号处理方法。
PCT/CN2019/090662 2019-06-11 2019-06-11 一种骨传声信号处理方法、装置、芯片、耳机及存储介质 Ceased WO2020248113A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2019/090662 WO2020248113A1 (zh) 2019-06-11 2019-06-11 一种骨传声信号处理方法、装置、芯片、耳机及存储介质
CN201980001396.2A CN112400326B (zh) 2019-06-11 2019-06-11 一种骨传声信号处理方法、装置、芯片、耳机及存储介质

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/090662 WO2020248113A1 (zh) 2019-06-11 2019-06-11 一种骨传声信号处理方法、装置、芯片、耳机及存储介质

Publications (1)

Publication Number Publication Date
WO2020248113A1 true WO2020248113A1 (zh) 2020-12-17

Family

ID=73780929

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/090662 Ceased WO2020248113A1 (zh) 2019-06-11 2019-06-11 一种骨传声信号处理方法、装置、芯片、耳机及存储介质

Country Status (2)

Country Link
CN (1) CN112400326B (zh)
WO (1) WO2020248113A1 (zh)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113645534A (zh) * 2021-08-31 2021-11-12 歌尔科技有限公司 一种耳机闭塞效应消除方法及耳机
CN113873388A (zh) * 2021-10-27 2021-12-31 歌尔科技有限公司 一种耳机闭塞效应消除方法及耳机
CN114071306A (zh) * 2021-11-29 2022-02-18 歌尔科技有限公司 降噪耳机音频处理方法、降噪耳机、装置及可读存储介质
WO2023000602A1 (zh) * 2021-07-19 2023-01-26 歌尔科技有限公司 一种耳机及其音频处理方法、装置、存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090310805A1 (en) * 2008-06-14 2009-12-17 Michael Petroff Hearing aid with anti-occlusion effect techniques and ultra-low frequency response
US20160105751A1 (en) * 2013-06-03 2016-04-14 Sonova Ag Method for operating a hearing device and a hearing device
CN105721973A (zh) * 2016-01-26 2016-06-29 王泽玲 一种骨传导耳机及其音频处理方法
EP3171612A1 (fr) * 2015-11-19 2017-05-24 Parrot Drones Casque audio à contrôle actif de bruit, contrôle anti-occlusion et annulation de l'atténuation passive, en fonction de la présence ou de l'absence d'une activité vocale de l'utilisateur de casque
CN106888414A (zh) * 2015-12-15 2017-06-23 索尼移动通讯有限公司 具有闭塞耳朵的说话者的自身语音体验的控制

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102273232B (zh) * 2008-11-10 2016-03-16 伯恩同通信有限公司 用于播放双声道和单声道信号的耳机和方法
JP2011075989A (ja) * 2009-10-01 2011-04-14 Yamaguchi Univ 操作指令信号生成方法及び操作指令信号生成装置
CN106162405A (zh) * 2016-07-27 2016-11-23 努比亚技术有限公司 降噪装置、耳机及降噪方法
CN107302731A (zh) * 2017-08-15 2017-10-27 常德沁音科技有限公司 一种基于骨传导的耳机及其降噪方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090310805A1 (en) * 2008-06-14 2009-12-17 Michael Petroff Hearing aid with anti-occlusion effect techniques and ultra-low frequency response
US20160105751A1 (en) * 2013-06-03 2016-04-14 Sonova Ag Method for operating a hearing device and a hearing device
EP3171612A1 (fr) * 2015-11-19 2017-05-24 Parrot Drones Casque audio à contrôle actif de bruit, contrôle anti-occlusion et annulation de l'atténuation passive, en fonction de la présence ou de l'absence d'une activité vocale de l'utilisateur de casque
CN106888414A (zh) * 2015-12-15 2017-06-23 索尼移动通讯有限公司 具有闭塞耳朵的说话者的自身语音体验的控制
CN105721973A (zh) * 2016-01-26 2016-06-29 王泽玲 一种骨传导耳机及其音频处理方法

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023000602A1 (zh) * 2021-07-19 2023-01-26 歌尔科技有限公司 一种耳机及其音频处理方法、装置、存储介质
US20240323586A1 (en) * 2021-07-19 2024-09-26 Goertek Technology Co., Ltd. Earphone and audio processing method and apparatus therefor, and storage medium
CN113645534A (zh) * 2021-08-31 2021-11-12 歌尔科技有限公司 一种耳机闭塞效应消除方法及耳机
WO2023029144A1 (zh) * 2021-08-31 2023-03-09 歌尔股份有限公司 一种耳机闭塞效应消除方法及耳机
CN113873388A (zh) * 2021-10-27 2021-12-31 歌尔科技有限公司 一种耳机闭塞效应消除方法及耳机
WO2023070916A1 (zh) * 2021-10-27 2023-05-04 歌尔科技有限公司 一种耳机闭塞效应消除方法及耳机
CN114071306A (zh) * 2021-11-29 2022-02-18 歌尔科技有限公司 降噪耳机音频处理方法、降噪耳机、装置及可读存储介质
CN114071306B (zh) * 2021-11-29 2023-02-28 歌尔科技有限公司 降噪耳机音频处理方法、降噪耳机、装置及可读存储介质
WO2023092761A1 (zh) * 2021-11-29 2023-06-01 歌尔科技有限公司 降噪耳机音频处理方法、降噪耳机、装置及可读存储介质
US12626681B2 (en) 2021-11-29 2026-05-12 Goertek Technology Co., Ltd. Audio processing method for noise-reduction earphone, noise-reduction earphone, device and readable storage medium

Also Published As

Publication number Publication date
CN112400326B (zh) 2023-02-28
CN112400326A (zh) 2021-02-23

Similar Documents

Publication Publication Date Title
KR102512311B1 (ko) 이어버드 스피치 추정
EP4531431B1 (en) Volume control in open audio device
US9779716B2 (en) Occlusion reduction and active noise reduction based on seal quality
CN106664333B (zh) 频率相关侧音校准
CN107426643B (zh) 上行降噪耳机
US20100166206A1 (en) Device for and a method of processing audio data
CN112400326B (zh) 一种骨传声信号处理方法、装置、芯片、耳机及存储介质
CN114697782B (zh) 耳机风噪识别方法、装置及耳机
CN105284126A (zh) 包括自适应消噪系统的系数的动态偏置的自适应消噪系统及方法
CN106416290A (zh) 基于换能器状态的检测来提高音频换能器的性能的系统及方法
WO2021083326A1 (zh) 一种智能头戴设备
AU2009201462A1 (en) Method and apparatus for determining a degree of closure in hearing devices
US20170372691A1 (en) Speech enhancement for headsets with in-ear microphones
CN108462763B (zh) 降噪终端和降噪方法
WO2021129197A1 (zh) 一种语音信号处理方法及装置
EP2613562A2 (en) Ultrasonic sound reproduction on eardrum
CN115398934A (zh) 再现音频信号时主动抑制闭塞效应的方法、装置、耳机及计算机程序
CN108352158B (zh) 用于分布式自适应噪声消除的系统及方法
WO2024113810A1 (zh) 降噪方法、耳机、装置、存储介质及计算机程序产品
CN208015947U (zh) 耳机
CN118828301A (zh) 音频处理方法、装置、服务器和可读存储介质
WO2024119396A1 (zh) 开放式可穿戴声学设备及其主动降噪方法
WO2024119393A1 (zh) 开放式可穿戴声学设备及主动降噪方法
CN115225998A (zh) 耳机降噪方法、装置、耳机设备及计算机可读存储介质
US20240276171A1 (en) Method for processing audio input data and a device thereof

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19933051

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19933051

Country of ref document: EP

Kind code of ref document: A1