CN113613134B - earphone - Google Patents

earphone Download PDF

Info

Publication number
CN113613134B
CN113613134B CN202110898455.XA CN202110898455A CN113613134B CN 113613134 B CN113613134 B CN 113613134B CN 202110898455 A CN202110898455 A CN 202110898455A CN 113613134 B CN113613134 B CN 113613134B
Authority
CN
China
Prior art keywords
signal
heartbeat sound
microphone
earphone
signals
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110898455.XA
Other languages
Chinese (zh)
Other versions
CN113613134A (en
Inventor
徐银海
刘益帆
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Ansheng Haolang Technology Co ltd
Original Assignee
Beijing Ansheng Haolang Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Ansheng Haolang Technology Co ltd filed Critical Beijing Ansheng Haolang Technology Co ltd
Priority to CN202110898455.XA priority Critical patent/CN113613134B/en
Publication of CN113613134A publication Critical patent/CN113613134A/en
Application granted granted Critical
Publication of CN113613134B publication Critical patent/CN113613134B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/10Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1091Details not provided for in groups H04R1/1008 - H04R1/1083
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/024Detecting, measuring or recording pulse rate or heart rate
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/024Detecting, measuring or recording pulse rate or heart rate
    • A61B5/02438Detecting, measuring or recording pulse rate or heart rate with portable devices, e.g. worn by the patient
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/024Detecting, measuring or recording pulse rate or heart rate
    • A61B5/02444Details of sensor
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/68Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6801Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
    • A61B5/6802Sensor mounted on worn items
    • A61B5/6803Head-worn items, e.g. helmets, masks, headphones or goggles
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones
    • H04R3/005Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones

Abstract

The application provides an earphone, comprising: a housing; the first microphone is positioned on the shell and is used for collecting external noise signals; the loudspeaker is positioned in the inner cavity of the shell and used for playing audio signals; the second microphone is positioned at the sound outlet of the earphone and is used for collecting initial heartbeat sound signals; and the filter is connected with the first microphone and the second microphone in a wind power mode and is used for filtering the external noise signal and the audio signal from the initial heartbeat sound signal to obtain a target heartbeat sound signal. After the initial heartbeat sound signal is acquired by the microphone, other signals are filtered from the initial heartbeat sound signal, and the target heartbeat sound signal is obtained. The technical scheme of the application can improve the signal-to-noise ratio of the target heartbeat sound signal, thereby improving the accuracy of heartbeat sound signal detection, and the application only utilizes the hardware of the earphone for normal use to finish the detection of the heartbeat sound signal, and the scheme cost is lower.

Description

Earphone
Technical Field
The application relates to the technical field of electronic equipment, in particular to an earphone.
Background
Along with the improvement of the living standard of substances, the attention of people to the health of the people is continuously improved, so that the intelligent wearable equipment with the health management function is more and more widely used. Among health management functions of the intelligent wearable device, heartbeat detection is one function of which the user is concerned. The existing intelligent wearing equipment (such as a sport bracelet and a sport watch) mainly adopts a light sensation detection system to carry out heartbeat detection, the wearing requirement of the detection system on the equipment is higher, and the user wrist has a slightly nonstandard wearing posture and can possibly generate false induction or even can not induce, so that the reliability of heartbeat detection is lower.
Disclosure of Invention
In view of the foregoing, the present application is directed to providing an earphone to improve the accuracy of detecting the heartbeat sound signal.
The earphone provided by the application comprises: a housing; the first microphone is positioned on the shell and is used for collecting external noise signals; the loudspeaker is positioned in the inner cavity of the shell and used for playing audio signals; the second microphone is positioned at the sound outlet of the earphone and is used for collecting initial heartbeat sound signals; and the filter is connected with the first microphone and the second microphone in a wind power mode and is used for filtering the external noise signal and the audio signal from the initial heartbeat sound signal to obtain a target heartbeat sound signal.
Optionally, the filter includes: a first estimating unit, configured to obtain an estimated signal of the external noise signal according to a transfer function corresponding to a transmission path from the first microphone to the second microphone; a second estimating unit, configured to obtain an estimated signal of the audio signal according to a transfer function corresponding to a transmission path from the speaker to the second microphone; and the adder unit is used for subtracting the estimated signal of the external noise signal and the estimated signal of the audio signal from the initial heartbeat sound signal to obtain the target heartbeat sound signal.
Optionally, the number of the second microphones is at least two, and the filter is used for: filtering out corresponding external noise signals and audio signals from initial heartbeat sound signals acquired by each second microphone respectively to obtain at least two heartbeat sound signals to be processed; and carrying out weighting processing on the at least two heartbeat sound signals to be processed so as to further relatively attenuate the external noise signals and the audio signals and obtain the target heartbeat sound signals.
Optionally, the filter includes a beamformer, a main lobe direction of the beamformer pointing in the ear and a null direction pointing out of the ear, the beamformer being configured to: and respectively inputting the heartbeat sound signals to be processed corresponding to each second microphone into the beam forming device to carry out the weighting processing, so as to obtain the target heartbeat sound signals.
Optionally, the earphone is a semi-in-ear earphone.
Optionally, the filter is further configured to: and obtaining the waveform record and/or heart rate index of the heartbeat sound signal according to the target heartbeat sound signal.
Optionally, the earphone further includes an in-ear detection unit, where the in-ear detection unit is configured to determine, according to the target heartbeat acoustic signal, whether the earphone is in-ear: if the target heartbeat sound signal exists, determining that the earphone is in the ear; and if the target heartbeat sound signal does not exist, determining that the earphone is not in the ear.
Optionally, the in-ear detection unit is further configured to determine a tightness of wearing of the earphone according to the intensity of the target heartbeat acoustic signal; the earphone performs corresponding tone quality equalization adjustment on the audio signal based on the compactness.
Optionally, the filter is further configured to: the second estimation unit is determined based on the audio signal, an estimated signal of the audio signal, and the initial heartbeat sound signal.
Optionally, the second microphone is a talking microphone of the earphone.
After the initial heartbeat sound signal is acquired by the microphone, other signals are filtered from the initial heartbeat sound signal, and the target heartbeat sound signal is obtained. The technical scheme of the application can improve the signal-to-noise ratio of the target heartbeat sound signal, thereby improving the accuracy of heartbeat sound signal detection, and the embodiment of the application only utilizes the hardware which is reserved in the earphone to finish the detection of the heartbeat sound signal, so that the scheme cost is lower.
Drawings
Fig. 1 is a schematic structural diagram of an earphone according to an embodiment of the present application.
Fig. 2 is a schematic structural diagram of a filter according to an embodiment of the present application.
Fig. 3 is a schematic structural diagram of an earphone according to another embodiment of the present application.
Fig. 4 is a schematic flow chart of an in-ear detection method according to an embodiment of the present application.
Fig. 5 is a schematic structural diagram of an earphone according to another embodiment of the present application.
Fig. 6 is a flowchart of a heartbeat sound signal detection method applied to an earphone according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present application, but not all embodiments.
It should be understood that "inner", "outer" in the present application refers to the housing of the headset. The direction from the outer shell of the earphone to the internal circuit structure is the inner direction, and the opposite direction is the outer direction; and not to a particular limitation of the structure of the device of the present application.
It should be appreciated that in the present disclosure, the terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.
Along with the improvement of the living standard of substances, the attention of people to the health of the people is continuously improved, so that the intelligent wearable equipment with the health management function is more and more widely used. Among health management functions of the intelligent wearable device, heartbeat detection is one function of which the user is concerned.
The existing intelligent wearable equipment (such as a sports bracelet and a sports watch) mainly adopts a light sensation detection system to perform heartbeat detection, and takes the sports bracelet as an example, a sensor in the sports bracelet emits light beams and detects the absorption quantity of blood to the emitted light beams, so that the heartbeat detection is performed on a user according to the absorption quantity of light. That is, when the user wears the movement bracelet, the movement bracelet can strike the light beam on the skin. When the heart pumps blood, blood vessels are filled with blood, the blood tends to absorb green light and reflect red light, so that the heart can generate reflected light with different colors during contraction and relaxation, and the moving wristband can detect the heartbeat by monitoring the reflected light. It can be seen that the user needs to wear the exercise bracelet correctly to effectively use the exercise bracelet for heartbeat detection, light leakage is avoided, and blood smoothness at the wearing position is guaranteed. This relatively stringent wearing requirement results in lower reliability of detection results when performing heartbeat detection with existing smart wearable devices using light-sensitive detection systems. In addition, the intelligent wearable device using the light sensation detection system is high in cost, and the cruising ability of the intelligent wearable device can be influenced after long-time use.
In order to solve the problems and achieve the purpose of convenient and accurate heartbeat detection, the embodiment of the application provides the earphone, wherein the pressure signals of the inner ear skin periodically changing along with the heart beat in the auditory canal are collected by the microphone arranged in the earphone, so that the purpose of detecting the heartbeat sound signals is achieved, the signal to noise ratio of the heartbeat sound signals collected by the microphone is improved, and the accuracy of heartbeat sound signal detection is improved.
The application is not limited to the type of earphone. For example, headphones mentioned in the present application may be wired headphones, but also bluetooth headphones (e.g., true wireless stereo (True Wireless Stereo, TWS) headphones); alternatively, the earphone may be an in-ear earphone or a half-in-ear earphone. Preferably, the earphone of the present application may be a semi-in-ear earphone.
Fig. 1 is a schematic structural diagram of an earphone according to an embodiment of the present application. As shown in fig. 1, the earphone 100 includes a housing 110, a first microphone 120, a speaker 130, a second microphone 140, and a filter 150.
The housing 110 may be a one-piece housing or a detachable housing. The housing 110 has an interior cavity in which various electronic components may be disposed.
A first microphone 120 may be located on the housing 110 for capturing ambient noise signals. As one implementation, the first microphone 120 may be located on the housing 110 and within an interior cavity of the housing 110. If the first microphone 120 is located in the inner cavity of the housing 110, a microphone through hole 111 may be provided in the housing 110. The first microphone 120 corresponds to the microphone through hole 111 such that the first microphone 120 collects an external noise signal through the microphone through hole 111.
In some embodiments, the first microphone 120 may be a talk microphone. The existing communication microphone is used for collecting external noise signals, so that the cost can be saved.
The number of the first microphones 120 is not particularly limited in the present application. In some embodiments, only one first microphone 120 may be provided on the housing 110. In other embodiments, at least two first microphones 120 may be provided on the housing 110.
When at least two first microphones 120 are provided on the housing 110, each of the first microphones 120 may be provided at different positions of the housing 110. Meanwhile, microphone through holes 111 corresponding to each of the first microphones 120 may be respectively provided at different positions of the housing 110 so that each of the first microphones 120 collects an external noise signal through the respective corresponding microphone through hole 111.
Speaker 130 may be located within an interior cavity of housing 110. Speaker 130 may be used to play audio signals, for example, when a user wears headphones to listen to music, the audio signals in a music playing device (e.g., a cell phone) may be played through speaker 130 after being transmitted into the headphones; alternatively, when the user wears the earphone to make a voice call, an audio signal of the other party speaking may be played through the speaker 130.
The second microphone 140 may be located in the inner cavity of the housing 110 and at the sound outlet of the earphone. The second microphone 140 may be used to collect an initial heartbeat sound signal. Since other non-heart beat sound signals may be collected by the second microphone 140 when the second microphone 140 collects heart beat sound signals, other signals may be mixed in the initial heart beat sound signals collected by the second microphone 140. For example, the initial heartbeat sound signal collected by the second microphone 140 may be mixed with an external noise signal and an audio signal played by a speaker.
The number of the second microphones 140 is not particularly limited in the present application. In some embodiments, the second microphone 140 may be a microphone array, i.e. the number of second microphones 140 may be at least two.
The filter 150 may be electrically connected to the first microphone 120 and the second microphone 140. The filter 150 may receive the ambient noise signal collected by the first microphone 120, the audio signal played by the speaker 130, and the initial heartbeat sound signal collected by the second microphone 140. After receiving the external noise signal, the audio signal, and the initial heartbeat sound signal, the filter 150 may filter the external noise signal and the audio signal from the initial heartbeat sound signal to obtain the target heartbeat sound signal.
The type and structure of the filter 150 are not particularly limited by the present application. For example, the filter 150 may employ a band pass filter to filter out ambient noise signals and audio signals in the initial heartbeat sound signal. Further, in designing the band-pass filter, the cutoff frequency of the band-pass filter may be designed based on the frequency range of the heartbeat sound signal.
Fig. 2 is a schematic structural diagram of a filter according to an embodiment of the present application. As shown in fig. 2, the filter 150 may include a first estimation unit 151, a second estimation unit 152, and an adder unit 153.
Since the external noise signal and the audio signal played by the speaker will change along with the propagation path during the propagation process of the external noise signal and the audio signal played by the speaker entering the ear, in order to more accurately calculate the external noise signal mixed in the initial heartbeat sound signal and the audio signal played by the speaker, the first estimation unit 151 and the second estimation unit 152 may be used to simulate the corresponding estimation signals when the external noise signal and the audio signal played by the speaker reach the position of the second microphone 140, respectively.
For example, the first estimating unit 151 may be configured to obtain an estimated signal of the external noise signal according to a transfer function (referred to as a "primary path") corresponding to the transmission path from the first microphone 120 to the second microphone 140; the second estimating unit 152 may obtain an estimated signal of the audio signal according to a transfer function (referred to as a "secondary path") corresponding to a transmission path from the speaker 130 to the second microphone 140. The present application is not limited thereto, and for example, the first estimation unit 151 may be used to obtain an estimated signal of an audio signal, and the second estimation unit 152 may be used to obtain an estimated signal of an external noise signal.
As an implementation, the first estimation unit 151 may be used to simulate the response of the primary path to the amplitude, phase of the different frequency signals, and the second estimation unit 152 may be used to simulate the response of the secondary path to the amplitude, phase of the different frequency signals. From the simulation results of the first estimation unit 151 and the second estimation unit 152, estimated signals of the external noise signal and the audio signal can be obtained.
The first estimation unit 151 and the second estimation unit 152 may be physically separated or may be integrated in one estimation unit, and functions of the first estimation unit 151 and the second estimation unit 152 are performed by different modules, respectively.
The adder unit 153 may be electrically connected to the first estimation unit 151 and the second estimation unit 152 for adding and/or subtracting the received signals. For example, after the adder unit 153 receives the estimated signal of the external noise signal sent by the first estimation unit 151, the estimated signal of the audio signal sent by the second estimation unit 152, and the initial heartbeat sound signal acquired by the second microphone 140, the estimated signal of the external noise signal and the estimated signal of the audio signal may be subtracted from the initial heartbeat sound signal to obtain the target heartbeat sound signal.
After the external noise signals and the audio signals are filtered from the initial heartbeat sound signals acquired by the second microphone by using the filter, the signal-to-noise ratio of the obtained target heartbeat sound signals can be obviously improved, and therefore the accuracy rate of heartbeat sound signal detection can be improved. Based on the above, the obtained target heartbeat sound signal can be used for processing such as heartbeat sound waveform recording and heart rate index statistics, so as to obtain more accurate processing results.
In some embodiments, after the target heartbeat acoustic signal is obtained for a period of time, the period of the target heartbeat acoustic signal may be detected according to the waveform of the target heartbeat acoustic signal for the period of time, for example, the period of the target heartbeat acoustic signal may be detected by using a method such as threshold analysis, fourier analysis, and the like. After the period of the target heartbeat sound signal is detected, the heart rate can be calculated according to the period, and heart rate index statistics is further carried out.
Because wearing habits of different users are different or the wearing habits are influenced by inherent errors of parameters of a filter system, after the estimated signals of the external noise signals and the estimated signals of the audio signals are subtracted from the initial heartbeat sound signals, the signal to noise ratio in the obtained target heartbeat sound signals is greatly improved, but part of the external noise signals and the audio signals can still be mixed.
Therefore, in the embodiment of the present application, when the number of the second microphones is at least two, the filter may filter the corresponding external noise signal and the audio signal from the initial heartbeat sound signal acquired by each of the second microphones, so as to obtain at least two heartbeat sound signals to be processed, where a part of the external noise signal and the audio signal may still be mixed in each heartbeat sound signal to be processed. After obtaining the heartbeat acoustic signals to be processed, the filter can perform weighting processing on the heartbeat acoustic signals to be processed so as to further relatively attenuate the external noise signals and the audio signals mixed in the heartbeat acoustic signals to be processed, thereby obtaining the target heartbeat signals.
In the present application, relatively attenuating the external noise signal and the audio signal mixed in the heartbeat acoustic signal to be processed may refer to enhancing the heartbeat acoustic signal in the heartbeat acoustic signal to be processed to relatively attenuate the external noise signal and the audio signal mixed in the heartbeat acoustic signal to be processed; but may also refer to attenuating (or suppressing) ambient noise signals and audio signals in the heartbeat acoustic signal to be processed.
As an implementation, the beamformer may be used to weight the heartbeat acoustic signal to be processed. Fig. 3 is a schematic structural diagram of an earphone according to another embodiment of the present application. In this embodiment, the headset 300 may include a housing 310, a first microphone 320, a speaker 330, second microphones 341, 342, and a filter 350. The filter 350 may also include a beamformer 354, among other things.
The beamformer 354 may distinguish between signals from different directions, extract (or boost) signals from certain directions, and cancel (or suppress) interfering signals from other directions, thereby achieving spatial filtering.
In the present application, the heartbeat sound signal to be processed corresponding to each second microphone may be input into the beam former 354, and the beam former 354 is used to perform weighting processing on each input heartbeat sound signal to be processed, so as to obtain the target heartbeat sound signal.
In some embodiments, the main lobe direction of the beamformer 354 may be directed in the ear and the null direction may be directed out of the ear. After the heartbeat sound signal to be processed is filtered by the beam former 354, the signal in the in-ear direction can be effectively enhanced, and the signal in the out-of-ear direction can be restrained. That is, after filtering by the beamformer 354, the heart beat sound signal from the in-ear direction can be effectively enhanced, and the external noise signal from the out-of-ear direction and the audio signal played by the speaker can be effectively suppressed.
The present application is not limited to the beamforming method employed by the beamformer 354. For example, the beamformer 354 may perform weighting processing on the heartbeat acoustic signal to be processed using a delay-and-add beamforming method; alternatively, the beamformer 354 may perform weighting processing on the heartbeat sound signal to be processed by means of filter addition.
The beam forming device is used for carrying out weighting processing on each signal to be processed, so that the signal to noise ratio in the obtained target heartbeat sound signal can be further improved, the influence caused by different wearing habits of users and inherent errors of different system parameters is eliminated, and the consistency of the heartbeat sound signals detected by the earphone is improved. Particularly, for the semi-in-ear earphone, the structural design does not comprise an earplug part which invades the auditory canal, the earphone part does not have the capability of being fixed relative to the auditory canal, and the positions and the postures of the earphone on ears of different users and different moments are different.
The headset provided by the application may further comprise an in-ear detection unit (not shown in the figures). The in-ear detection unit can judge whether the earphone is in the ear or not according to the obtained target heartbeat sound signal.
As an implementation manner, the step of in-ear detection by using the in-ear detection unit according to the embodiment of the present application may be referred to as fig. 4.
In step S410, it is detected whether a target heartbeat sound signal is present.
In step S420, it is determined whether the earphone is in the ear. If the in-ear detection unit detects that the target heartbeat sound signal exists, determining that the earphone is in-ear; if the in-ear detection unit detects that the target heartbeat sound signal does not exist, the earphone is determined to be not in-ear.
In some embodiments, the in-ear detection unit may also determine the tightness of the headset wearing based on the strength of the target heartbeat acoustic signal. Specifically, when the in-ear detection unit detects that the target heartbeat sound signal exists and the intensity of the target heartbeat sound signal is greater than a certain threshold value, the wearing compactness of the earphone can be considered to be higher; when the in-ear detection unit detects that the target heartbeat sound signal exists, but the strength of the target heartbeat sound signal is smaller than the threshold value, the wearing compactness of the earphone can be considered to be low.
Further, the headphones may make a corresponding tone quality equalization adjustment to the audio signal based on the tightness of wear. For example, when the wearing compactness of the earphone is high, the intensity of the audio signal can be slightly reduced, so that the influence of the excessive intensity of the audio signal on the hearing of a user is avoided; or when the wearing compactness of the earphone is low, the intensity of the audio signal can be properly enhanced, and the user can be ensured to normally enjoy music or normally talk; in addition, the method further comprises the step of determining the correction quantity of the current frequency response of the earphone compared with the optimal frequency response based on the current wearing compactness of the user, so that corresponding tone quality balance adjustment is carried out on the audio signal to be played, the consistency of the optimal tone quality is guaranteed, and the user experience is improved.
When the tone quality balance adjustment is performed on the audio signal based on the tightness of the earphone wearing, the secondary path changes along with the state of the earphone wearing by the user. Based on this, in some embodiments, the second estimation unit may be adjusted in real time based on the audio signal.
Referring to fig. 5, fig. 5 is a schematic structural diagram of an earphone according to another embodiment of the present application. The second estimation unit 552 may be determined online in an adaptive manner during the user use phase.
As shown in fig. 5, the headset 500 may include a housing 510, a first microphone 520, a speaker 530, a second microphone 540, and a filter 550.
The filter 550 may include a first estimation unit 551, a second estimation unit 552, and a determination unit 554.
The determining unit 554 may determine the second estimating unit 552 based on the audio signal, the estimated signal of the audio signal, and the initial heartbeat sound signal. As an implementation, the determining unit 554 may determine the second estimating unit 552 online in an adaptive manner.
When the second estimation unit 552 is determined online in an adaptive manner, an adaptive algorithm may be employed. The application is not limited to the specific type of adaptive algorithm employed, and for example, a least mean square (Least Mean Square, LMS) algorithm may be employed for the adaptive iteration.
An embodiment of the device of the present application is described above in connection with fig. 1 to 5. A heartbeat sound detection method applied to an earphone according to an embodiment of the present application is described below with reference to fig. 6. The specific content of each step in the method embodiment of the present application may be referred to the related description of the device embodiment of the present application, which is not described herein.
Fig. 6 is a flowchart of a heartbeat sound signal detection method applied to an earphone according to an embodiment of the present application. Referring to fig. 6, in steps 610 to 620, an ambient noise signal acquired by a first microphone and an initial heartbeat sound signal acquired by a second microphone are acquired.
In step 630, the external noise signal collected by the first microphone and the audio signal played by the speaker are filtered from the initial heartbeat signal, so as to obtain the target heartbeat signal.
As an implementation manner, the estimated signal of the external noise signal acquired by the first microphone and the estimated signal of the audio signal played by the loudspeaker may be subtracted from the initial heartbeat sound signal to obtain the target heartbeat sound signal.
In some embodiments, at least two second microphones may be used to collect initial heartbeat sound signals, and corresponding external noise signals and audio signals are filtered from the initial heartbeat sound signals collected by each second microphone, so as to obtain at least two heartbeat sound signals to be processed. Further, the at least two heartbeat sound signals to be processed may be weighted, so as to further relatively attenuate the external noise signal and the audio signal, and obtain the target heartbeat sound signal.
Specifically, as an implementation manner, the at least two heartbeat sound signals to be processed may be weighted by a beam forming algorithm, so as to obtain a target heartbeat sound signal.
The method for detecting the heartbeat sound signal applied to the earphone can improve the signal to noise ratio of the obtained target heartbeat sound signal, thereby improving the accuracy of heartbeat sound signal detection.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Those skilled in the art may implement the described functionality using different approaches for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiments of the present application, it should be understood that the systems, apparatuses, and methods disclosed in the embodiments of the present application may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, as the partitioning of elements is merely a logical functional partitioning, and there may be additional partitioning in actual implementation, e.g., multiple elements or components may be combined or integrated into another system, or some features may be omitted, or not implemented. In addition, the communication connections shown or discussed may be electrical, mechanical, or other forms.
The foregoing is merely illustrative of the present application, and the present application is not limited thereto, and any person skilled in the art will readily recognize that variations or substitutions are within the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (9)

1. An earphone, comprising:
a housing;
the first microphone is positioned on the shell and is used for collecting external noise signals;
the loudspeaker is positioned in the inner cavity of the shell and used for playing audio signals;
the second microphone is positioned at the sound outlet of the earphone and is used for collecting initial heartbeat sound signals;
the filter is connected with the first microphone and the second microphone in a wind power mode and is used for filtering the external noise signals and the audio signals from the initial heartbeat sound signals to obtain target heartbeat sound signals, and the filter comprises a first estimation unit, a second estimation unit and an adder unit;
the first estimation unit is configured to obtain an estimated signal of the external noise signal according to a transfer function corresponding to a transmission path from the first microphone to the second microphone;
the second estimating unit is configured to obtain an estimated signal of the audio signal according to a transfer function corresponding to a transmission path from the speaker to the second microphone;
the adder unit is configured to subtract the estimated signal of the external noise signal and the estimated signal of the audio signal from the initial heartbeat sound signal to obtain the target heartbeat sound signal.
2. The earphone of claim 1, wherein the second microphones are at least two, and the filter is configured to:
filtering out corresponding external noise signals and audio signals from initial heartbeat sound signals acquired by each second microphone respectively to obtain at least two heartbeat sound signals to be processed;
and carrying out weighting processing on the at least two heartbeat sound signals to be processed so as to further relatively attenuate the external noise signals and the audio signals and obtain the target heartbeat sound signals.
3. The headset of claim 2, wherein the filter comprises a beamformer having a main lobe direction pointing in the ear and a null direction pointing out of the ear, the beamformer being configured to:
and respectively inputting the heartbeat sound signals to be processed corresponding to each second microphone into the beam forming device to carry out the weighting processing, so as to obtain the target heartbeat sound signals.
4. The earphone of claim 1, wherein the earphone is a semi-in-ear earphone.
5. The earphone of claim 1, wherein the filter is further configured to:
and obtaining the waveform record and/or heart rate index of the heartbeat sound signal according to the target heartbeat sound signal.
6. The earphone of claim 1, further comprising an in-ear detection unit,
the in-ear detection unit is used for judging whether the earphone is in the ear or not according to the target heartbeat sound signal: if the target heartbeat sound signal exists, determining that the earphone is in the ear; and if the target heartbeat sound signal does not exist, determining that the earphone is not in the ear.
7. The headset of claim 6, wherein the in-ear detection unit is further configured to determine a tightness of the headset wearing based on an intensity of the target heartbeat sound signal; the earphone performs corresponding tone quality equalization adjustment on the audio signal based on the compactness.
8. The headset of claim 7, wherein the filter is further configured to:
the second estimation unit is determined based on the audio signal, an estimated signal of the audio signal, and the initial heartbeat sound signal.
9. The headset of claim 1, wherein the second microphone is a talk microphone of the headset.
CN202110898455.XA 2021-08-05 2021-08-05 earphone Active CN113613134B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110898455.XA CN113613134B (en) 2021-08-05 2021-08-05 earphone

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110898455.XA CN113613134B (en) 2021-08-05 2021-08-05 earphone

Publications (2)

Publication Number Publication Date
CN113613134A CN113613134A (en) 2021-11-05
CN113613134B true CN113613134B (en) 2023-11-07

Family

ID=78307234

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110898455.XA Active CN113613134B (en) 2021-08-05 2021-08-05 earphone

Country Status (1)

Country Link
CN (1) CN113613134B (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102215740A (en) * 2008-11-17 2011-10-12 索尼爱立信移动通讯有限公司 Apparatus, method, and computer program for detecting a physiological measurement from a physiological sound signal
CN102293012A (en) * 2009-01-23 2011-12-21 索尼爱立信移动通讯有限公司 Acoustic in-ear detection for earpiece
CN102456351A (en) * 2010-10-14 2012-05-16 清华大学 Voice enhancement system
CN104244125A (en) * 2014-08-25 2014-12-24 歌尔声学股份有限公司 Heart rate detection method applied to ear phone and ear phone capable of detecting heart rate
CN108429950A (en) * 2018-03-22 2018-08-21 恒玄科技(上海)有限公司 The high-efficient noise-reducing earphone and noise reduction system of low-power consumption
CN110324753A (en) * 2019-07-31 2019-10-11 歌尔科技有限公司 A kind of sound playing method based on earphone, device and earphone
CN111935589A (en) * 2020-09-28 2020-11-13 深圳市汇顶科技股份有限公司 Active noise reduction method and device, electronic equipment and chip
CN112735370A (en) * 2020-12-29 2021-04-30 紫光展锐(重庆)科技有限公司 Voice signal processing method and device, electronic equipment and storage medium
CN112866890A (en) * 2021-01-14 2021-05-28 厦门新声科技有限公司 In-ear detection method and system

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102215740A (en) * 2008-11-17 2011-10-12 索尼爱立信移动通讯有限公司 Apparatus, method, and computer program for detecting a physiological measurement from a physiological sound signal
CN102293012A (en) * 2009-01-23 2011-12-21 索尼爱立信移动通讯有限公司 Acoustic in-ear detection for earpiece
CN102456351A (en) * 2010-10-14 2012-05-16 清华大学 Voice enhancement system
CN104244125A (en) * 2014-08-25 2014-12-24 歌尔声学股份有限公司 Heart rate detection method applied to ear phone and ear phone capable of detecting heart rate
CN108429950A (en) * 2018-03-22 2018-08-21 恒玄科技(上海)有限公司 The high-efficient noise-reducing earphone and noise reduction system of low-power consumption
CN110324753A (en) * 2019-07-31 2019-10-11 歌尔科技有限公司 A kind of sound playing method based on earphone, device and earphone
CN111935589A (en) * 2020-09-28 2020-11-13 深圳市汇顶科技股份有限公司 Active noise reduction method and device, electronic equipment and chip
CN112735370A (en) * 2020-12-29 2021-04-30 紫光展锐(重庆)科技有限公司 Voice signal processing method and device, electronic equipment and storage medium
CN112866890A (en) * 2021-01-14 2021-05-28 厦门新声科技有限公司 In-ear detection method and system

Also Published As

Publication number Publication date
CN113613134A (en) 2021-11-05

Similar Documents

Publication Publication Date Title
US11304014B2 (en) Hearing aid device for hands free communication
CN107071647B (en) A kind of sound collection method, system and device
CN104980865B (en) Binaural hearing aid system including binaural noise reduction
CN104980870B (en) Self calibration is carried out using more microphone noise reduction systems of the auxiliary device to auditory prosthesis
US11245976B2 (en) Earphone signal processing method and system, and earphone
US11259127B2 (en) Hearing device adapted to provide an estimate of a user's own voice
CN110754096B (en) System and method for detecting voice activity of a user of a headset
US20230396940A1 (en) Hearing aid having a sensor
CN112866864A (en) Environment sound hearing method and device, computer equipment and earphone
CN113613134B (en) earphone
CN113329312A (en) Hearing aid for determining microphone transitions
US20220174428A1 (en) Hearing aid system comprising a database of acoustic transfer functions
CN113630681A (en) Active noise reduction earphone
CN112911485B (en) Wireless earphone in and out ear detection method, wireless earphone and medium
CN207369229U (en) A kind of earphone
CN207518802U (en) Neck wears formula interactive voice earphone
WO2023160275A1 (en) Processing method for sound signal, and earphone device
CN112218224B (en) HRTF (head-mounted HRTF) measuring method and device based on head-mounted loudspeaker system
CN109729454A (en) The sound wheat processing unit of formula interactive voice earphone is worn for neck
CN109729471A (en) The ANC denoising device of formula interactive voice earphone is worn for neck
CN218772357U (en) Earphone set
WO2023093412A1 (en) Active noise cancellation method and electronic device
US20230054213A1 (en) Hearing system comprising a database of acoustic transfer functions
US20240114296A1 (en) Hearing aid comprising a speaker unit
US20230388721A1 (en) Hearing aid system comprising a sound source localization estimator

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant