CN113676804B - Active noise reduction method and device - Google Patents

Active noise reduction method and device Download PDF

Info

Publication number
CN113676804B
CN113676804B CN202011120314.7A CN202011120314A CN113676804B CN 113676804 B CN113676804 B CN 113676804B CN 202011120314 A CN202011120314 A CN 202011120314A CN 113676804 B CN113676804 B CN 113676804B
Authority
CN
China
Prior art keywords
earphone
frequency response
signal
curve information
parameters
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011120314.7A
Other languages
Chinese (zh)
Other versions
CN113676804A (en
Inventor
余晓伟
李玉龙
范泛
覃景繁
杨小洪
欧阳山
孙宇皓
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to KR1020227043382A priority Critical patent/KR20230009487A/en
Priority to JP2022568881A priority patent/JP2023525138A/en
Priority to PCT/CN2021/084774 priority patent/WO2021227695A1/en
Priority to PCT/CN2021/084775 priority patent/WO2021227696A1/en
Publication of CN113676804A publication Critical patent/CN113676804A/en
Priority to US17/986,549 priority patent/US20230080298A1/en
Application granted granted Critical
Publication of CN113676804B publication Critical patent/CN113676804B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/10Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1008Earpieces of the supra-aural or circum-aural type
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1781Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase characterised by the analysis of input or output signals, e.g. frequency range, modes, transfer functions
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1787General system configurations
    • G10K11/17879General system configurations using both a reference signal and an error signal
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/10Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1083Reduction of ambient noise
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Abstract

The embodiment of the application provides an active noise reduction method and device, and relates toAnd the audio frequency technical field, can promote the noise reduction effect of earphone. The method is applied to the earphone with the ANC function, and comprises the following steps: when the earphone is in the ANC working mode, a first group of filtering parameters are obtained, and noise reduction is carried out by using the first group of filtering parameters. The first set of filtering parameters is N pre-stored by the earphone 1 One of the sets of filter parameters, N 1 The group filtering parameters are respectively used for N 1 Noise reduction of environmental sound is performed in the leakage state, and N is 1 The leakage state is formed by earphone and N 1 Formed by different ear canal environments. The noise reduction effect of the earphone when the first group of filtering parameters are applied is better than that of the earphone when N is applied aiming at the same environmental noise under the current wearing state of the earphone 1 Noise reduction effect when other filter parameters in the group of filter parameters, N 1 Is a positive integer greater than or equal to 2.

Description

Active noise reduction method and device
The present application claims priority from the chinese patent application filed on 14 months 05 in 2020, filed on the national intellectual property agency, application number 202010407692.7, application name "a method for active noise reduction for semi-open headphones", the entire contents of which are incorporated herein by reference.
Technical Field
The embodiment of the application relates to the technical field of audio, in particular to an active noise reduction method and device.
Background
Compared with the in-ear earphone, the semi-open earphone has no rubber sleeve at the sound outlet, is good in wearing comfort, has no stethoscope effect and is suitable for long-term wearing.
Because the semi-open earphone has no rubber sleeve, noise cannot be passively isolated, and the playing effect difference of the audio frequency of the semi-open earphone is large under different ears and different wearing postures, the active noise reduction of the semi-open earphone is an important problem.
Disclosure of Invention
The embodiment of the application provides an active noise reduction method and device, which can improve the noise reduction effect of an earphone.
In order to achieve the above purpose, the embodiment of the application adopts the following technical scheme:
in a first aspect, an embodiment of the present application provides an active noise reduction method applied to an earphone with an ANC function, where the method includes: when the earphone is in an ANC working mode, the earphone acquires a first group of filtering parameters; and the earpiece uses the first set of filter parameters to reduce noise. Wherein the first set of filtering parameters is N pre-stored by the earphone 1 One set of filter parameters; the N is 1 The group filtering parameters are respectively used for N 1 Environmental noise reduction is carried out in the leakage state; the N is 1 The leakage state is formed by the earphone and N 1 Formed by different ear canal environments; the noise reduction effect of the earphone when the first group of filtering parameters are applied is better than that of the earphone when the earphone is applied N aiming at the same environmental noise in the current wearing state 1 Noise reduction effect when other filtering parameters in the group of filtering parameters; n (N) 1 Is a positive integer greater than or equal to 2.
It is to be understood that N is as described above 1 The seed leakage state may express N 1 The fit degree range of the earphone and the human ear can express N 1 The sealing degree of the earphone and the human ear; any leakage state is not a specific wearing state of the earphone, but the impedance according to the leakage state is specificThe properties are counted in a large number, and typical or differentiable leakage scenes are obtained.
According to the active noise reduction method provided by the embodiment of the application, a group of filter parameters (namely the first group of filter parameters) matched with the current leakage state (also can be understood as the current wearing state) can be determined according to the leakage state formed by the ear canal environment of the user and the earphone when the user wears the earphone, and the environmental noise is reduced based on the group of filter parameters, so that the personalized noise reduction requirement of the user can be met, and the noise reduction effect is improved.
In a possible implementation manner, the active noise reduction method provided in the embodiment of the application further includes: generating N based at least on the first and second sets of filter parameters 2 And (5) a group of filtering parameters. The N is 2 The group filtering parameters respectively correspond to different ANC noise reduction intensities; the second set of filtering parameters is N pre-stored by the earphone 1 One set of filter parameters; the second set of filtering parameters is used for filtering the signal in N 1 The environmental noise is reduced in a state where the leakage degree is minimum among the leakage states. It should be understood that the N 2 The set of filter parameters includes the first set of filter parameters and the second set of filter parameters.
In a possible implementation manner, the active noise reduction method provided in the embodiment of the application further includes: acquiring the noise reduction intensity of the target ANC; and from N according to target ANC noise reduction intensity 2 Determining a third set of filter parameters from the sets of filter parameters; and denoising with the third set of filter parameters.
In the active noise reduction method provided in the embodiment of the present application, after the first set of filtering parameters is determined, N adapted to the current user is generated based on the first set of filtering parameters and the second set of filtering parameters 2 Group filtering parameters, and from the N 2 And a third group of filtering parameters corresponding to the target ANC noise reduction intensity is further determined in the group of filtering parameters, so that noise reduction is performed by adopting the third group of filtering parameters, and therefore, the proper ANC noise reduction intensity can be selected according to the state of the environmental noise, and the noise reduction effect is more in line with the requirements of users.
In a possible implementation manner, the method for obtaining the first set of filtering parameters includes: and receiving first indication information from the terminal, wherein the first indication information is used for indicating the earphone to make noise reduction by using the first group of filtering parameters.
In a possible implementation manner, the earphone includes an error microphone; the method for acquiring the first set of filtering parameters comprises the following steps: collecting a first signal through an error microphone of the earphone, and obtaining a downlink signal of the earphone; determining current frequency response curve information of the secondary channel according to the first signal and the downlink signal; and from a preset N 1 Determining target frequency response curve information matched with the current frequency response curve information in the frequency response curve information of the secondary channels; and determining a set of filter parameters corresponding to the target frequency response curve information as a first set of filter parameters, N 1 Group filtering parameters correspond to N 1 Frequency response curve information for each secondary channel.
In a possible implementation manner, the earphone includes an error microphone and a reference microphone; the method for acquiring the first set of filtering parameters comprises the following steps: collecting a first signal through an error microphone of the earphone, collecting a second signal through a reference microphone of the earphone, and obtaining a downlink signal of the earphone; then determining a residual signal of the error microphone based on the first signal and the second signal; determining current frequency response curve information of the secondary channel according to the residual signal and the downlink signal of the error microphone; and from a preset N 1 Determining target frequency response curve information matched with the current frequency response curve information in the frequency response curve information of the secondary channels; further, a group of filter parameters corresponding to the target frequency response curve information is determined as a first group of filter parameters, N 1 Group filtering parameters correspond to N 1 Frequency response curve information for each secondary channel.
In a possible implementation manner, the earphone includes an error microphone and a reference microphone; the method for acquiring the first set of filtering parameters comprises the following steps: collecting a first signal through an error microphone of the earphone, and collecting a second signal through a reference microphone of the earphone; then determining current frequency response curve information of the primary channel according to the first signal and the second signal; and from a preset N 1 Determining the match between the frequency response curve information of each primary channel and the current frequency response curve informationMatching target frequency response curve information; and determining a set of filter parameters corresponding to the target frequency response curve information as a first set of filter parameters, N 1 Group filtering parameters correspond to N 1 Frequency response curve information of the individual primary channels.
In a possible implementation manner, the earphone includes an error microphone and a reference microphone; the method for acquiring the first set of filtering parameters comprises the following steps: collecting a first signal through an error microphone of the earphone, collecting a second signal through a reference microphone of the earphone, and obtaining a downlink signal of the earphone; then determining current frequency response curve information of the primary channel according to the first signal and the second signal, and determining current frequency response curve information of the secondary channel according to the first signal and the downlink signal; determining current frequency response ratio curve information, wherein the current frequency response ratio curve information is the ratio of the current frequency response curve information of the primary channel to the current frequency response curve information of the secondary channel; then from a preset N 1 Determining target frequency response ratio curve information matched with the current frequency response ratio curve information in the individual frequency response ratio curve information; further, a group of filter parameters corresponding to the target frequency response ratio curve information are determined as a first group of filter parameters, N 1 Group filtering parameters correspond to N 1 And frequency response ratio curve information.
In a possible implementation manner, the earphone includes an error microphone and a reference microphone; the method for acquiring the first set of filtering parameters comprises the following steps: determining N 1 Frequency response difference curve information of the error microphone and the reference microphone respectively corresponding to the group filtering parameters; will N 1 N corresponding to the group filtering parameters 1 The frequency response difference curve with the minimum amplitude corresponding to the target frequency band is determined as a target frequency response difference curve, and the frequency response difference curve information of the error microphone and the reference microphone is the difference between the frequency response curve information of the error microphone and the frequency response curve information of the reference microphone; and further determining a group of filtering parameters corresponding to the target frequency response difference curve information as a first group of filtering parameters.
In a possible implementation manner, the generating N is based on at least the first set of filtering parameters and the second set of filtering parameters 2 The method for the group filtering parameters comprises the following steps: interpolation is carried out on the first group of filtering parameters and the second group of filtering parameters to generate N 2 And (5) a group of filtering parameters.
In a possible implementation manner, the method for obtaining the noise reduction strength of the target ANC includes: and receiving second instruction information from the terminal, wherein the second instruction information is used for instructing the earphone to utilize a third group of filtering parameters corresponding to the target ANC noise reduction intensity to reduce noise.
In a possible implementation manner, the method for obtaining the noise reduction strength of the target ANC includes: and determining the noise reduction strength of the target ANC according to the state of the current environmental noise. For example, the current environment is quite, and the earphone adaptively selects the ANC noise reduction intensity with weaker noise reduction intensity according to the environment noise state; when the current environment is noisy, the earphone adaptively selects ANC noise reduction intensity with stronger noise reduction intensity according to the state of the environmental noise.
In a possible implementation manner, before acquiring the first set of filtering parameters, the active noise reduction method provided in the embodiment of the application further includes: receiving a first instruction, wherein the earphone works in an ANC working mode, and the first instruction is used for controlling the earphone to work in the ANC working mode; or detecting whether the earphone is in the ear; and under the condition that the earphone is detected to be in the ear, the earphone works in an ANC working mode.
The active noise reduction method provided by the embodiment of the invention is applied to a scene that the earphone is in the ANC working mode, and the fact that the earphone is in the ANC working mode is a trigger condition for determining the first group of filtering parameters can be known.
In one implementation, when the ANC function is turned on, the earphone plays an ANC-turned alert tone, determines a first set of filtering parameters during playing the in-ear alert tone, i.e., the in-ear alert tone is used as a test signal, and the user determines the first set of filtering parameters according to subjective listening experience.
In another implementation, when it is detected that the earphone is in the ear, the earphone is operated in the ANC operation mode, and at the same time, the earphone will play the in-ear alert sound, and the first set of filtering parameters is determined in the process of playing the in-ear alert sound, that is, the in-ear alert sound is used as a test signal, and the user determines the first set of filtering parameters according to subjective listening experience.
In a possible implementation manner, the method for obtaining the first set of filtering parameters specifically includes: receiving a second instruction under the condition that the earphone is in an ANC working mode, wherein the second instruction is used for indicating the earphone to acquire a first group of filtering parameters; wherein the first set of filter parameters is different from the filter parameters employed by the earpiece before receiving the second instruction.
In one case, after the first set of filtering parameters are determined, the earphone performs noise reduction based on the first set of filtering parameters, and subsequently, in the process of working the earphone, the user can select to re-determine a set of filtering parameters for noise reduction according to actual conditions, and at this time, the earphone can also be instructed to acquire the first set of filtering parameters by sending a second instruction.
In a possible implementation, after the first set of filter parameters is obtained, N is generated at least from the first set of filter parameters and the second set of filter parameters 2 Before the filtering parameter is set, the active noise reduction method provided by the embodiment of the application further includes: receiving a third instruction, wherein the third instruction is used for triggering the earphone to generate N 2 And (5) a group of filtering parameters.
In one case, N is generated from the first and second sets of filter parameters 2 After the set of filtering parameters, from N 2 And determining a third group of filter parameters in the group of filter parameters, denoising the earphone based on the third group of filter parameters, and subsequently, in the working process of the earphone, the user can select to redefine a group of filter parameters for denoising according to actual requirements, namely, the earphone reacquires the first group of filter parameters. Specifically, the earphone will have N in the earphone 2 Restoring the group filtering parameters to the above N 1 Group filtering parameters, further from N 1 And re-determining the first group of filter parameters in the group of filter parameters, and carrying out noise reduction by utilizing the re-acquired first group of filter parameters. Further, optionally, new N can be regenerated according to the re-acquired first and second sets of filtering parameters 2 Group filter parameters and from N 2 And determining a third group of filtering parameters in the group of filtering parameters, and reducing noise by using the third group of filtering parameters.
In a possible implementation manner, the above N 1 The group filtering parameters are determined from the recorded signal of the secondary channel SP mode and the recorded signal of the primary channel PP mode. The SP mode recording signals comprise downlink signals, signals of a tympanic membrane microphone and signals of an error microphone of the earphone; the PP-mode recording signal includes a signal of a tympanic microphone, a signal of an error microphone of an earphone, and a signal of a reference microphone of the earphone.
In a possible implementation manner, the active noise reduction method provided in the embodiment of the application further includes: detecting whether an anomaly noise is present, the anomaly noise comprising at least one of: howling noise, clipping noise or background noise; updating the filter parameters in case the presence of abnormal noise is detected, the filter parameters comprising a first set of filter parameters or a third set of filter parameters; and the sound signals are collected through a reference microphone and an error microphone of the earphone; and processing the sound signals collected by the reference microphone and the sound signals collected by the error microphone based on the updated filtering parameters to generate reverse noise signals.
In this embodiment of the present application, the above-mentioned inverse noise signal is used to attenuate an in-ear noise signal of a user, where the in-ear noise signal may be understood as residual noise after the user wears the earphone and environmental noise is isolated by the earphone, and the signal of the residual noise is related to factors such as external environmental noise, the earphone, and the fitting degree between the earphone and the ear canal; after the earphone generates the reverse noise signal, the earphone plays the reverse noise signal, and the phase of the reverse noise signal is opposite to that of the in-ear noise signal of the user, so that the reverse noise signal can weaken the in-ear noise signal of the user, and abnormal noise in the ear is reduced.
According to the active noise reduction method, the earphone can detect abnormal noise, noise reduction processing is conducted on the abnormal noise, interference of the abnormal noise is weakened, stability of the earphone is improved, and listening experience of a user can be improved.
In one possible implementation, the earphone includes a semi-open active noise reduction earphone.
In a second aspect, an embodiment of the present application provides an active noise reduction method, which is applied to a terminal that establishes a communication connection with an earphone, where the earphone is in an ANC working mode, and the method includes: determining a first set of filter parameters; and sending first indication information to the earphone, wherein the first indication information is used for indicating the earphone to make noise reduction by using the first group of filtering parameters. Wherein the first set of filtering parameters is N pre-stored by the earphone 1 One set of filter parameters; n (N) 1 The group filtering parameters are respectively used for N 1 Environmental noise reduction is carried out in the leakage state; n (N) 1 The leakage state is formed by earphone and N 1 Formed by different ear canal environments; the noise reduction effect of the earphone when the first group of filtering parameters are applied is better than that of the earphone when the earphone is applied N aiming at the same environmental noise in the current wearing state 1 Noise reduction effect when other filtering parameters in the group of filtering parameters; n (N) 1 Is a positive integer greater than or equal to 2.
According to the active noise reduction method provided by the embodiment of the application, a group of filter parameters (namely the first group of filter parameters) matched with the current leakage state can be determined according to the leakage state formed by the ear canal environment of the user and the earphone when the user wears the earphone, and the environment noise is reduced based on the group of filter parameters, so that the personalized noise reduction requirement of the user can be met, and the noise reduction effect is improved.
In a possible implementation manner, the method for determining the first set of filtering parameters includes: receiving a first signal acquired by an error microphone of the earphone, and acquiring a downlink signal of the earphone; then determining current frequency response curve information of the secondary channel according to the first signal and the downlink signal; and from a preset N 1 Determining target frequency response curve information matched with the current frequency response curve information in the frequency response curve information of the secondary channels; and determining a set of filter parameters corresponding to the target frequency response curve information as a first set of filter parameters, the N 1 Group filtering parameters correspond to N 1 Frequency response curve information for each secondary channel.
In a possible implementation manner, the method for determining the first set of filtering parameters includes: receiving a first signal collected by an error microphone of an earphone and a reference microphone collection of the earphoneThe second signal is used for acquiring a downlink signal of the earphone; then determining a residual signal of the error microphone based on the first signal and the second signal; determining current frequency response curve information of the secondary channel according to the residual error signal and the downlink signal of the error microphone; then from a preset N 1 Determining target frequency response curve information matched with the current frequency response curve information in the frequency response curve information of the secondary channels; further, the filter parameters corresponding to the target frequency response curve information are determined to be a first group of filter parameters, N 1 Group filtering parameters correspond to N 1 Frequency response curve information for each secondary channel.
In a possible implementation manner, the method for determining the first set of filtering parameters includes: receiving a first signal acquired by an error microphone of the earphone and a second signal acquired by a reference microphone of the earphone; then determining current frequency response curve information of the primary channel according to the first signal and the second signal; and from a preset N 1 Determining target frequency response curve information matched with the current frequency response curve information in the frequency response curve information of the primary channels; and determining the filter parameters corresponding to the target frequency response curve information as a first group of filter parameters, N 1 Group filtering parameters correspond to N 1 Frequency response curve information of the individual primary channels.
In a possible implementation manner, the method for determining the first set of filtering parameters includes: receiving a first signal acquired by an error microphone of the earphone and a second signal acquired by a reference microphone of the earphone, and acquiring a downlink signal of the earphone; then determining current frequency response curve information of the primary channel according to the first signal and the second signal, and determining current frequency response curve information of the secondary channel according to the first signal and the downlink signal; determining current frequency response ratio curve information, wherein the current frequency response ratio curve information is the ratio of the current frequency response curve information of the primary channel to the current frequency response curve information of the secondary channel; then from preset N 1 Determining target frequency response ratio curve information matched with the current frequency response ratio curve information in the individual frequency response ratio curve information; further, the filtering parameters corresponding to the target frequency response ratio curve information are determined to be a first group of filtering parameters, N 1 Group filtering parameters correspond to N 1 And frequency response ratio curve information.
In a possible implementation manner, the method for determining the first set of filtering parameters includes: determining N 1 Frequency response difference curve information of the error microphone and the reference microphone respectively corresponding to the group filtering parameters; then N is added 1 N corresponding to the group filtering parameters 1 The frequency response difference curve with the minimum amplitude corresponding to the target frequency band is determined as a target frequency response difference curve, and the frequency response difference curve information of the error microphone and the reference microphone is the difference between the frequency response curve information of the error microphone and the frequency response curve information of the reference microphone; and further determining the filter parameters corresponding to the target frequency response difference curve information as a first group of filter parameters.
In a possible implementation manner, before determining the first set of filtering parameters, the active noise reduction method provided in the embodiment of the application further includes: receiving operation of a first option of a first interface of the terminal, wherein the first interface is an interface for setting a working mode of the earphone; and responding to the operation of the first option, sending a first instruction to the earphone, wherein the first instruction is used for controlling the earphone to work in the ANC working mode.
In a possible implementation manner, after the operation of receiving the first option of the first interface of the terminal, the active noise reduction method provided in the embodiment of the application further includes: displaying an ANC control list; the ANC control list includes at least one of the following options: a first control option, a second control option, or a third control option; wherein the first control option is used for triggering and determining a first group of filtering parameters, and the second control option is used for triggering and generating N 2 The set of filter parameters and the third control option is used to trigger a redetermination of the first set of filter parameters.
In a possible implementation manner, the method for determining the first set of filtering parameters includes: receiving an operation on a first control option in the ANC control list, displaying a first control, the first control comprising N 1 Preset positions, N 1 Corresponding N of preset positions 1 A group filtering parameter; and receiving an operation for a first location in the first control; the first positionIs N 1 One of the preset positions, and the noise reduction effect of the group of filter parameters corresponding to the first position when applied to the earphone is better than N 1 The noise reduction effect when the filter parameters corresponding to other positions in the preset positions are applied to the earphone; and determining a set of filter parameters corresponding to the first position as a first set of filter parameters in response to the operation on the first position.
In a possible implementation manner, the active noise reduction method provided in the embodiment of the application further includes: receiving an operation on a third control option in the ANC control list; and re-determining the first set of filter parameters in response to operation of the third control option.
In a possible implementation manner, the active noise reduction method provided in the embodiment of the application further includes: receiving an operation on a third control option in the ANC control list; and in response to operation of the third control option, sending a second instruction to the headset, the second instruction for instructing the headset to acquire the first set of filter parameters; wherein the first set of filter parameters is different from the filter parameters employed by the earpiece before receiving the second instruction.
In a possible implementation manner, the active noise reduction method provided in the embodiment of the application further includes: receiving an operation on a second control option in the ANC control list; and in response to operation of the second control option, sending a third instruction to the headset, the third instruction for triggering the headset to generate N 2 Group filter parameters, N 2 The set of filter parameters is generated from a first set of filter parameters and a second set of filter parameters, the second set of filter parameters being N 1 One of a set of filter parameters, the second set of filter parameters being for use in N 1 The environmental noise is reduced in a state where the leakage degree is minimum among the leakage states.
In a possible implementation manner, after the operation of receiving the second control option in the ANC control list, the active noise reduction method provided in the embodiment of the application further includes: displaying a second control; the second control includes N 2 Preset positions, N 2 Corresponding N of preset positions 2 Noise reduction intensity of seed ANC, N 2 Seed ANC noise reduction intensity corresponds to N 2 A group filtering parameter; and receiving an operation for a second location in the second control; the second position is N 2 One of the preset positions, and the noise reduction effect of the filtering parameter corresponding to the ANC noise reduction intensity at the second position when the filtering parameter is applied to the earphone is better than N 2 The noise reduction effect when the filtering parameters corresponding to the ANC noise reduction intensity at other positions in the preset positions are applied to the earphone; and in response to the operation on the second location, determining an ANC noise reduction intensity corresponding to the second location as a target ANC noise reduction intensity; and further sending second indication information to the earphone, wherein the second indication information is used for indicating the earphone to reduce noise by utilizing a third group of filtering parameters corresponding to the target ANC noise reduction intensity.
In a third aspect, an embodiment of the present application provides an earphone, where the earphone has an ANC function, and the earphone includes an acquisition module and a processing module. The acquisition module is used for acquiring a first group of filtering parameters under the condition that the earphone is in an ANC working mode; the first set of filtering parameters is N pre-stored by the earphone 1 One set of filter parameters; n (N) 1 The group filtering parameters are respectively used for N 1 Environmental noise reduction is carried out in the leakage state; n (N) 1 The leakage state is formed by earphone and N 1 Formed by different ear canal environments; the noise reduction effect of the earphone when the first group of filtering parameters are applied is better than that of the earphone when the earphone is applied N aiming at the same environmental noise in the current wearing state 1 Noise reduction effect when other filtering parameters in the group of filtering parameters; n (N) 1 Is a positive integer greater than or equal to 2. The processing module is used for reducing noise by using the first group of filtering parameters.
In a possible implementation manner, the earphone provided by the embodiment of the application further comprises a generating module; the generating module is used for generating N according to at least the first set of filtering parameters and the second set of filtering parameters 2 A group filtering parameter; the N is 2 The group filtering parameters respectively correspond to different ANC noise reduction intensities; the second set of filtering parameters is N pre-stored by the earphone 1 One set of filter parameters; the second set of filtering parameters is used for filtering the signals in N 1 The environmental noise is reduced in a state where the leakage degree is minimum among the leakage states.
PossibleIn an implementation manner, the earphone provided by the embodiment of the application further includes a determining module; the acquisition module is also used for acquiring the noise reduction strength of the target ANC; the determining module is used for reducing noise intensity from N according to the target ANC 2 Determining a third set of filter parameters from the sets of filter parameters; the processing module is further configured to reduce noise using a third set of filter parameters.
In a possible implementation manner, the earphone provided by the embodiment of the application further includes a receiving module; the receiving module is used for receiving first indication information from the terminal, wherein the first indication information is used for indicating the earphone to make noise reduction by using the first group of filtering parameters.
In a possible implementation manner, the earphone provided by the embodiment of the application further includes a first signal acquisition module; the first signal acquisition module is used for acquiring a first signal through an error microphone of the earphone; the acquisition module is also used for acquiring downlink signals of the earphone; the determining module is further configured to determine current frequency response curve information of the secondary channel according to the first signal and the downlink signal; and from a preset N 1 Determining target frequency response curve information matched with the current frequency response curve information in the frequency response curve information of the secondary channels; and determining a set of filter parameters corresponding to the target frequency response curve information as a first set of filter parameters, N 1 Group filtering parameters correspond to N 1 Frequency response curve information for each secondary channel.
In a possible implementation manner, the earphone provided by the embodiment of the application further includes a first signal acquisition module and a second signal acquisition module. The first signal acquisition module is used for acquiring a first signal through an error microphone of the earphone; the second signal acquisition module is used for acquiring a second signal through a reference microphone of the earphone; the acquisition module is also used for acquiring downlink signals of the earphone; the determining module is further configured to determine a residual signal of the error microphone based on the first signal and the second signal; determining current frequency response curve information of the secondary channel according to the residual signal and the downlink signal of the error microphone; from preset N 1 Determining target frequency response curve information matched with the current frequency response curve information in the frequency response curve information of the secondary channels; and pairing the target frequency response curve informationThe set of filtering parameters to be used is determined as the first set of filtering parameters, N 1 Group filtering parameters correspond to N 1 Frequency response curve information for each secondary channel.
In a possible implementation manner, the earphone provided by the embodiment of the application further includes a first signal acquisition module and a second signal acquisition module. The first signal acquisition module is used for acquiring a first signal through an error microphone of the earphone; the second signal acquisition module is used for acquiring a second signal through a reference microphone of the earphone; the determining module is further configured to determine current frequency response curve information of the primary channel according to the first signal and the second signal; and from a preset N 1 Determining target frequency response curve information matched with the current frequency response curve information in the frequency response curve information of the primary channels; and determining a set of filter parameters corresponding to the target frequency response curve information as a first set of filter parameters, N 1 Group filtering parameters correspond to N 1 Frequency response curve information of the individual primary channels.
In a possible implementation manner, the earphone provided by the embodiment of the application further includes a first signal acquisition module and a second signal acquisition module. The first signal acquisition module is used for acquiring a first signal through an error microphone of the earphone; the second signal acquisition module is used for acquiring a second signal through a reference microphone of the earphone; the acquisition module is also used for acquiring downlink signals of the earphone; the determining module is further configured to determine current frequency response curve information of the primary channel according to the first signal and the second signal, and determine current frequency response curve information of the secondary channel according to the first signal and the downlink signal; determining current frequency response ratio curve information, wherein the current frequency response ratio curve information is the ratio of the current frequency response curve information of the primary channel to the current frequency response curve information of the secondary channel; and then from preset N 1 Determining target frequency response ratio curve information matched with the current frequency response ratio curve information in the individual frequency response ratio curve information; and determining a group of filter parameters corresponding to the target frequency response ratio curve information as a first group of filter parameters, N 1 Group filtering parameters correspond to N 1 And frequency response ratio curve information.
In a possible implementation manner, the foregoingThe determining module is also used for determining N 1 Frequency response difference curve information of the error microphone and the reference microphone respectively corresponding to the group filtering parameters; and will N 1 N corresponding to the group filtering parameters 1 The frequency response difference curve with the minimum amplitude corresponding to the target frequency band is determined as a target frequency response difference curve, and the frequency response difference curve information of the error microphone and the reference microphone is the difference between the frequency response curve information of the error microphone and the frequency response curve information of the reference microphone; and determining a group of filtering parameters corresponding to the target frequency response difference curve information as a first group of filtering parameters.
In a possible implementation manner, the generating module is specifically configured to interpolate the first set of filtering parameters and the second set of filtering parameters to generate N 2 And (5) a group of filtering parameters.
In a possible implementation manner, the receiving module is further configured to receive second indication information from the terminal, where the second indication information is used to instruct the earphone to perform noise reduction with the target ANC noise reduction strength corresponding to the third set of filtering parameters.
In a possible implementation manner, the determining module is further configured to determine the target ANC noise reduction strength according to a state of the current environmental noise.
In a possible implementation manner, the earphone provided by the embodiment of the application further includes a detection module. The receiving module is further configured to receive a first instruction, where the earphone is configured to operate in an ANC operation mode, and the first instruction is configured to control the earphone to operate in the ANC operation mode. The detection module is used for detecting whether the earphone is in the ear, and the earphone works in the ANC working mode under the condition that the detection module detects that the earphone is in the ear.
In a possible implementation manner, the receiving module is further configured to receive a second instruction, where the second instruction is used to instruct the earphone to acquire the first set of filtering parameters when the earphone is in the ANC working mode; wherein the first set of filter parameters is different from the filter parameters employed by the earpiece before receiving the second instruction.
In a possible implementation manner, the receiving module is further configured to receive a third instruction, where the third instruction is used to trigger the earphone to generate N 2 And (5) a group of filtering parameters.
In a possible implementation manner, the above N 1 The group filtering parameters are determined according to the recording signal of the secondary channel SP mode and the recording signal of the primary channel PP mode; the SP mode recording signals comprise downlink signals, signals of a tympanic membrane microphone and signals of an error microphone of the earphone; the PP-mode recording signal includes a signal of a tympanic microphone, a signal of an error microphone of an earphone, and a signal of a reference microphone of the earphone.
In a possible implementation manner, the earphone provided by the embodiment of the application further includes an updating module. The detection module is further configured to detect whether abnormal noise exists, where the abnormal noise includes at least one of: howling noise, clipping noise or background noise; the updating module is used for updating the filtering parameters under the condition that the detection module detects that abnormal noise exists, and the filtering parameters comprise a first group of filtering parameters or a third group of filtering parameters. The first signal acquisition module is also used for acquiring sound signals through a reference microphone of the earphone; the second signal acquisition module is also used for acquiring sound signals through an error microphone of the earphone; the processing module is further configured to process the sound signal collected by the reference microphone and the sound signal collected by the error microphone based on the updated filtering parameter, so as to generate an inverse noise signal.
In a fourth aspect, an embodiment of the present application provides a terminal, where the terminal establishes a communication connection with an earphone, and the earphone is in an ANC working mode, and the terminal includes a determining module and a sending module. Wherein the determining module is used for determining a first group of filtering parameters; the first set of filtering parameters is N pre-stored by the earphone 1 One set of filter parameters; n (N) 1 The group filtering parameters are respectively used for N 1 Environmental noise reduction is carried out in the leakage state; n (N) 1 The leakage state is formed by earphone and N 1 Formed by different ear canal environments; the noise reduction effect of the earphone when the first group of filtering parameters are applied is better than that of the earphone when the earphone is applied N aiming at the same environmental noise in the current wearing state 1 Noise reduction effect when other filtering parameters in the group of filtering parameters; n (N) 1 Is a positive integer greater than or equal to 2.The sending module is used for sending first indication information to the earphone, wherein the first indication information is used for indicating the earphone to make noise reduction by using the first group of filtering parameters.
In a possible implementation manner, the terminal provided in the embodiment of the application further includes a receiving module and an obtaining module. The receiving module is used for receiving a first signal acquired by an error microphone of the earphone; the acquisition module is used for acquiring downlink signals of the earphone; the determining module is specifically configured to determine current frequency response curve information of the secondary channel according to the first signal and the downlink signal; and from a preset N 1 Determining target frequency response curve information matched with the current frequency response curve information in the frequency response curve information of the secondary channels; and determining a set of filter parameters corresponding to the target frequency response curve information as a first set of filter parameters, N 1 Group filtering parameters correspond to N 1 Frequency response curve information for each secondary channel.
In a possible implementation manner, the terminal provided in the embodiment of the application further includes a receiving module and an obtaining module. The receiving module is used for receiving a first signal acquired by an error microphone of the earphone and a second signal acquired by a reference microphone of the earphone; the acquisition module is used for acquiring downlink signals of the earphone; the determining module is specifically configured to determine a residual signal of the error microphone based on the first signal and the second signal; then determining the current frequency response curve information of the secondary channel according to the residual error signal and the downlink signal of the error microphone; and from a preset N 1 Determining target frequency response curve information matched with the current frequency response curve information in the frequency response curve information of the secondary channels; and determining the filter parameters corresponding to the target frequency response curve information as a first group of filter parameters, N 1 Group filtering parameters correspond to N 1 Frequency response curve information for each secondary channel.
In a possible implementation manner, the terminal provided in the embodiment of the application further includes a receiving module; the receiving module is used for receiving a first signal acquired by an error microphone of the earphone and a second signal acquired by a reference microphone of the earphone; the determining module is specifically configured to determine current frequency response curve information of a primary channel according to the first signal and the second signal; and from a preset A kind of electronic device N (N) 1 Determining target frequency response curve information matched with the current frequency response curve information in the frequency response curve information of the primary channels; and determining a filter parameter corresponding to the target frequency response curve information as the first group of filter parameters, wherein N is the same as the first group of filter parameters 1 Group filtering parameters correspond to N 1 Frequency response curve information of the individual primary channels.
In a possible implementation manner, the terminal provided in the embodiment of the application further includes a receiving module and an obtaining module. The receiving module is used for receiving a first signal acquired by an error microphone of the earphone and a second signal acquired by a reference microphone of the earphone; the acquisition module is used for acquiring downlink signals of the earphone; the determining module is specifically configured to determine current frequency response curve information of the primary channel according to the first signal and the second signal, and determine current frequency response curve information of the secondary channel according to the first signal and the downlink signal; determining current frequency response ratio curve information, wherein the current frequency response ratio curve information is the ratio of the current frequency response curve information of the primary channel to the current frequency response curve information of the secondary channel; and then from preset N 1 Determining target frequency response ratio curve information matched with the current frequency response ratio curve information in the individual frequency response ratio curve information; and determining the filter parameters corresponding to the target frequency response ratio curve information as a first group of filter parameters, N 1 Group filtering parameters correspond to N 1 And frequency response ratio curve information.
In a possible implementation manner, the determining module is specifically configured to determine N 1 Frequency response difference curve information of the error microphone and the reference microphone respectively corresponding to the group filtering parameters; and will N 1 N corresponding to the group filtering parameters 1 The frequency response difference curve with the minimum amplitude corresponding to the target frequency band is determined as a target frequency response difference curve, and the frequency response difference curve information of the error microphone and the reference microphone is the difference between the frequency response curve information of the error microphone and the frequency response curve information of the reference microphone; and determining the filtering parameters corresponding to the target frequency response difference curve information as the first group of filtering parameters.
In a possible implementation manner, the receiving module is further configured to receive an operation of a first option of a first interface of the terminal, where the first interface is an interface for setting an operation mode of the earphone; the sending module is further configured to send a first instruction to the headset in response to the operation of the first option, where the first instruction is used to control the headset to operate in the ANC operation mode.
In a possible implementation manner, the terminal provided in the embodiment of the application further includes a display module; the display module is used for displaying an ANC control list; the ANC control list includes at least one of the following options: the first control option, the second control option, or the third control option. Wherein the first control option is used for triggering and determining a first group of filtering parameters, and the second control option is used for triggering and generating N 2 The set of filter parameters and the third control option is used to trigger a redetermination of the first set of filter parameters.
In a possible implementation manner, the receiving module is further configured to receive an operation on a first control option in the ANC control list; the display module is further configured to display a first control, where the first control includes N 1 Preset positions, N 1 Corresponding N of preset positions 1 A group filtering parameter; the receiving module is further used for receiving operation on a first position in the first control; the first position is N 1 One of the preset positions, and the noise reduction effect of the group of filter parameters corresponding to the first position when applied to the earphone is better than N 1 The noise reduction effect when the filter parameters corresponding to other positions in the preset positions are applied to the earphone; the determining module is specifically configured to determine, in response to an operation on the first location, a set of filtering parameters corresponding to the first location as a first set of filtering parameters.
In a possible implementation manner, the receiving module is further configured to receive an operation on a third control option in the ANC control list; the determination module is further configured to re-determine the first set of filter parameters in response to operation of the third control option.
In a possible implementation manner, the receiving module is further configured to receive an operation on a third control option in the ANC control list; the sending module is further configured to send a second instruction to the earphone in response to the operation of the third control option, where the second instruction is used to instruct the earphone to obtain the first set of filtering parameters; wherein the first set of filter parameters is different from the filter parameters employed by the earpiece before receiving the second instruction.
In a possible implementation manner, the receiving module is further configured to receive an operation on a second control option in the ANC control list; the sending module is further configured to send a third instruction to the earphone in response to the operation of the second control option, where the third instruction is used to trigger the earphone to generate N 2 Group filter parameters, N 2 The set of filter parameters is generated from a first set of filter parameters, a second set of filter parameters, the second set of filter parameters being N 1 One set of filter parameters; the second set of filtering parameters is used for filtering the signals in N 1 The environmental noise is reduced in a state where the leakage degree is minimum among the leakage states.
In a possible implementation manner, the display module is further configured to display a second control; the second control includes N 2 Preset positions, N 2 Corresponding N of preset positions 2 Noise reduction intensity of seed ANC, N 2 Seed ANC noise reduction intensity corresponds to N 2 A group filtering parameter; the receiving module is further used for receiving operation on a second position in the second control; the second position is N 2 One of the preset positions, and the noise reduction effect of the filtering parameter corresponding to the ANC noise reduction intensity at the second position when the filtering parameter is applied to the earphone is better than N 2 The noise reduction effect when the filtering parameters corresponding to the ANC noise reduction intensity at other positions in the preset positions are applied to the earphone; the determining module is further configured to determine, in response to an operation on the second location, an ANC noise reduction strength corresponding to the second location as a target ANC noise reduction strength; the sending module is further configured to send second indication information to the earphone, where the second indication information is used to instruct the earphone to reduce noise by using a third set of filtering parameters corresponding to the noise reduction strength of the target ANC.
In a fifth aspect, an embodiment of the present application provides an earphone, including a memory and at least one processor connected to the memory, where the memory is configured to store instructions, and when the instructions are read by the at least one processor, perform the method according to any one of the first aspect and a possible implementation manner thereof.
In a sixth aspect, embodiments of the present application provide a computer readable storage medium comprising a computer program which, when run on a computer, performs the method of any one of the first aspect and its possible implementation manners.
In a seventh aspect, embodiments of the present application provide a computer program product comprising instructions which, when run on a computer, cause the computer to perform the method of any one of the first aspect and its possible implementation forms.
In an eighth aspect, embodiments of the present application provide a chip including a memory and a processor. The memory is used for storing computer instructions. The processor is configured to call and execute the computer instructions from the memory to perform the method according to any one of the first aspect and its possible implementation forms.
In a ninth aspect, an embodiment of the present application provides a terminal, including a memory and at least one processor connected to the memory, where the memory is configured to store instructions, and when the instructions are read by the at least one processor, perform the method according to any one of the second aspect and a possible implementation manner of the second aspect.
In a tenth aspect, embodiments of the present application provide a computer readable storage medium comprising a computer program which, when run on a computer, performs the method of any one of the second aspect and its possible implementation manners.
In an eleventh aspect, embodiments of the present application provide a computer program product comprising instructions which, when run on a computer, cause the computer to perform the method of any one of the second aspect and its possible implementation manners.
In a twelfth aspect, embodiments of the present application provide a chip including a memory and a processor. The memory is used for storing computer instructions. The processor is configured to call and execute the computer instructions from the memory to perform the method according to any one of the second aspect and its possible implementation manners.
It should be appreciated that the technical solutions of the second aspect to the twelfth aspect and the corresponding possible embodiments of the present application may refer to the technical effects of the first aspect and the second aspect and the corresponding possible embodiments thereof, which are not described herein.
Drawings
Fig. 1 is a schematic application scenario diagram of an active noise reduction method according to an embodiment of the present application;
Fig. 2 is a hardware schematic diagram of a semi-open active noise reduction earphone according to an embodiment of the present application;
fig. 3 is a hardware schematic of a mobile phone according to an embodiment of the present application;
fig. 4 is a schematic process flow diagram of an active noise reduction method according to an embodiment of the present application;
fig. 5 is a hardware schematic diagram of a recording device according to an embodiment of the present application;
FIG. 6 is a flow chart of secondary channel modeling from speaker to error microphone according to an embodiment of the present application;
fig. 7 is a schematic flow chart of secondary channel modeling from a speaker to a tympanic microphone according to an embodiment of the present disclosure;
fig. 8 is a schematic flow chart of determining filtering parameters according to an embodiment of the present application;
FIG. 9 is a schematic diagram of an active noise reduction method according to an embodiment of the present disclosure;
FIG. 10 is a schematic diagram of a method for determining a first set of filtering parameters according to an embodiment of the present disclosure;
FIG. 11 is a second schematic diagram of a method for determining a first set of filtering parameters according to an embodiment of the present disclosure;
FIG. 12 is a third exemplary method for determining a first set of filtering parameters according to an embodiment of the present disclosure;
fig. 13 is a schematic diagram fourth of a method for determining a first set of filtering parameters according to an embodiment of the present application;
Fig. 14 is a schematic diagram fifth method for determining a first set of filtering parameters according to an embodiment of the present application;
fig. 15 is a schematic diagram of a second active noise reduction method according to an embodiment of the present disclosure;
fig. 16 is a schematic diagram III of an active noise reduction method according to an embodiment of the present application;
FIG. 17 is a schematic diagram showing a first display effect in the active noise reduction method according to the embodiment of the present application;
FIG. 18A is a second schematic diagram of a display effect in the active noise reduction method according to the embodiment of the present disclosure;
fig. 18B is a schematic diagram III of a display effect in the active noise reduction method according to the embodiment of the present application;
fig. 19A is a schematic diagram showing a display effect in the active noise reduction method according to the embodiment of the present application;
fig. 19B is a schematic diagram showing a fifth display effect in the active noise reduction method according to the embodiment of the present application;
fig. 20 is a schematic diagram showing a display effect in the active noise reduction method according to the embodiment of the present application;
fig. 21A is a schematic diagram seventh of a display effect in the active noise reduction method according to the embodiment of the present application;
fig. 21B is a schematic diagram eight of a display effect in the active noise reduction method according to the embodiment of the present application;
fig. 22 is a schematic diagram fourth of an active noise reduction method according to an embodiment of the present disclosure;
fig. 23A is a schematic diagram showing a display effect in the active noise reduction method according to the embodiment of the present application;
Fig. 23B is a schematic view showing a display effect in the active noise reduction method according to the embodiment of the present application;
fig. 24 is a schematic diagram fifth of an active noise reduction method according to an embodiment of the present disclosure;
fig. 25 is a schematic diagram of an operating principle of a semi-open active noise reduction earphone according to an embodiment of the present application;
fig. 26 is a schematic diagram of a howling detection method according to an embodiment of the present application;
fig. 27 is a schematic diagram two of a howling detection method according to an embodiment of the present application;
fig. 28 is a schematic diagram of an operating principle of howling detection and noise reduction processing according to an embodiment of the present application;
fig. 29 is a schematic diagram of a clipping detection method according to an embodiment of the present application;
fig. 30 is a schematic diagram of an operating principle of clipping detection and noise reduction processing according to an embodiment of the present application;
fig. 31 is a schematic diagram of a background noise detection method according to an embodiment of the present application;
fig. 32 is a schematic diagram of a working principle of a noise reduction process and a noise detection method according to an embodiment of the present application;
fig. 33 is a schematic diagram of a wind noise detection method according to an embodiment of the present application;
fig. 34 is a schematic diagram of an operating principle of wind noise detection and noise reduction according to an embodiment of the present disclosure;
fig. 35 is a schematic diagram of a wind noise control state according to an embodiment of the present application;
Fig. 36 is a schematic diagram of filtering parameters corresponding to a wind noise control state according to an embodiment of the present application;
fig. 37 is a schematic diagram showing a display effect in an active noise reduction method according to an embodiment of the present application;
fig. 38 is a schematic diagram seventh of a display effect in an active noise reduction method according to an embodiment of the present application;
fig. 39 is a schematic structural diagram of an earphone according to an embodiment of the present application;
fig. 40 is a schematic structural diagram of a terminal according to an embodiment of the present application.
Detailed Description
The term "and/or" is herein merely an association relationship describing an associated object, meaning that there may be three relationships, e.g., a and/or B, may represent: a exists alone, A and B exist together, and B exists alone.
The terms first and second and the like in the description and in the claims of embodiments of the present application are used for distinguishing between different objects and not necessarily for describing a particular sequential order of objects. For example, the first set of filter parameters, the second set of filter parameters, the third set of filter parameters, etc. are used to distinguish between different filter parameters and are not used to describe a particular order of filter parameters.
In the embodiments of the present application, words such as "exemplary" or "such as" are used to mean serving as examples, illustrations, or descriptions. Any embodiment or design described herein as "exemplary" or "for example" should not be construed as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete fashion.
In the description of the embodiments of the present application, unless otherwise indicated, the meaning of "a plurality" means two or more. For example, the plurality of processing units refers to two or more processing units; the plurality of systems means two or more systems.
Based on the problems existing in the background art, the embodiments of the present application provide an active noise reduction method and device, which are applied to an earphone with an active noise reduction (active noise cancellation, ANC) function, when the earphone is in an ANC working mode, the earphone acquires a first set of filtering parameters, and uses the first set of filtering parameters to perform noise reduction, where the first set of filtering parameters is N pre-stored in the earphone 1 One of the sets of filter parameters, N 1 The group filtering parameters are respectively used for N 1 Noise reduction of environmental sound is performed in the leakage state, and N is 1 The leakage state is formed by earphone and N 1 Formed by different ear canal environments. The noise reduction effect of the earphone when the first group of filtering parameters are applied is better than that of the earphone when the earphone is applied N aiming at the same environmental noise in the current wearing state 1 Noise reduction effect when other filter parameters in the group of filter parameters, N 1 Is a positive integer greater than or equal to 2. In summary, the active noise reduction method provided by the embodiment of the application can determine a group of filtering parameters matched with the current leakage state according to the leakage state formed by the ear canal environment of the user and the earphone when the user wears the earphone, and perform environmental noise reduction based on the group of filtering parameters, so that personalized noise reduction requirements of the user can be met, and the noise reduction effect is improved.
Optionally, the active noise reduction method provided by the embodiment of the application can be applied to an earphone with sound leakage with the auditory canal of the user. It should be understood that sound leakage specifically means that after a user wears the earphone, the earphone cannot be closely attached to an ear canal of the user, and a gap exists between the ear canal of the user and the earphone to cause sound leakage, and different ear characteristics and different wearing postures exist in leakage. For example, the active noise reduction method provided in the embodiment of the present application may be applied to semi-open active noise reduction (the sound outlet of the semi-open active noise reduction earphone has no rubber sleeve, so that a gap exists between the earphone and the ear canal), and in the following embodiment, the earphone is taken as a semi-open active noise reduction earphone for illustration.
Fig. 1 is a schematic diagram of an application scenario of an active noise reduction method provided in an embodiment of the present application. In fig. 1, the semi-open active noise reduction earphone 101 and the electronic device 102 communicate through wired transmission, or may communicate through wireless transmission, for example, the semi-open active noise reduction earphone 101 and the electronic device 102 communicate through bluetooth, or communicate through other wireless networks. It should be understood that the embodiments of the present application relate to transmitting audio data and control signaling between the semi-open active noise reduction earphone 101 and the electronic device 102, for example, the electronic device 102 sends the audio data to the semi-open active noise reduction earphone 101 to play, and for example, the electronic device 102 sends the control signaling to the semi-open active noise reduction earphone 101 to control the working mode of the semi-open active noise reduction earphone 101.
Alternatively, the electronic device 102 in fig. 1 may be an electronic device such as a mobile phone, a computer (e.g., a notebook computer, a desktop computer), a tablet computer (e.g., a handheld tablet computer, a vehicle-mounted tablet computer), or other terminal devices, for example, a smart speaker, a vehicle-mounted speaker, etc. The specific type and structure of the electronic device 102, etc. are not limited by the embodiments of the present application.
Optionally, the semi-open active noise reduction earphone provided in the embodiment of the present application may be wired or wireless, and is not limited. The following describes the hardware structure of the semi-open active noise reduction earphone in conjunction with the wearing form of the semi-open active noise reduction earphone in the ear of a person, as shown in fig. 2, the semi-open active noise reduction earphone 200 includes a speaker (loudspeaker) 201, a microprocessor (micro control unit, MCU) 202, an ANC chip 203, a memory 204, and a plurality of microphones, which may include a reference microphone 205, a talk microphone 206, and an error microphone 207.
The speaker 201 is used for playing a downlink signal (music or voice), and in the semi-open active noise reduction earphone, the speaker 201 is also used for playing a reverse noise signal (may be simply referred to as an ANTI signal), and the reverse noise signal is used for weakening a noise signal in an ear canal of a user, so that an effect of actively reducing noise is achieved.
A Microprocessor (MCU) 202 is used to control the filtering parameters, e.g. from N 1 A first set of filter parameters is determined among the sets of filter parameters, etc., and the determined first set of filter parameters is written to the ANC chip 203 or the filter parameters stored in the memory 204 are modified.
The ANC chip 203 is configured to reduce noise of environmental sounds, specifically, process signals collected by the reference microphone 205 and the error microphone 207, and generate an inverse noise signal to attenuate noise signals in the ear canal of the user.
The memory 204 is configured to store a plurality of sets of filtering parameters (also referred to as ANC parameters), where a set of filtering parameters includes a filtering parameter (also referred to as FF coefficient) corresponding to the feedforward path, a filtering parameter (also referred to as FB coefficient) corresponding to the feedback path, and a filtering parameter (SPE coefficient) corresponding to the downlink compensation path, for example, N in the embodiment of the present application is stored 1 Group filtering parameters and N 2 And (5) a group of filtering parameters. In implementing the active noise reduction method, the microprocessor 202 is configured to reduce noise from N 1 After determining the first set of filtering parameters from the set of filtering parameters, the first set of filtering parameters is read from the memory 204 and written into the ANC chip 203, so that the ANC chip 203 processes the audio signal collected by the relevant microphone based on the first set of filtering parameters to generate an inverse noise signal.
The reference microphone 205 is used to collect external ambient noise.
The conversation microphone 206 is used to collect a voice signal of a user when the user is making a conversation.
The error microphone 207 is used to collect noise signals within the user's ear canal.
Optionally, the semi-open active noise reduction earphone may also include other elements, such as a proximity light sensor for detecting whether the semi-open active noise reduction earphone is in the ear. If the semi-open active noise reduction earphone is a wireless earphone, the semi-open active noise reduction earphone may further include a wireless communication module, where the wireless communication module may be a wireless local area network (wireless local area networks, WLAN) (such as Wi-Fi network) module or a Bluetooth (BT) module. The Bluetooth module is used for the semi-open active noise reduction earphone to communicate with other devices through Bluetooth.
It will be appreciated that the structures illustrated in the embodiments of the present application do not constitute a particular limitation of the semi-open active noise reduction headphones, and in other embodiments of the present application, the semi-open active noise reduction headphones may include more or fewer components than illustrated, or may combine certain components, or may split certain components, or may have a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
For example, taking the electronic device 102 shown in fig. 1 as an example of a mobile phone, fig. 3 is a schematic hardware structure of the mobile phone according to the embodiment of the present application. As shown in fig. 3, the handset 300 includes a processor 310, a memory (including an external memory interface 320 and an internal memory 321), a universal serial bus (universal serial bus, USB) interface 330, a charge management module 340, a power management module 341, a battery 342, an antenna 1, an antenna 2, a mobile communication module 350, a wireless communication module 360, an audio module 370, a speaker 370A, a receiver 370B, a microphone 370C, an earphone interface 370D, a sensor module 380, keys 390, a motor 391, an indicator 392, a camera 393, a display 394, and a subscriber identity module (subscriber identification module, SIM) card interface 395, etc. The sensor module 380 may include, among other things, a gyroscope sensor 380A, an acceleration sensor 380B, an ambient light sensor 380C, a depth sensor 380D, a magnetic sensor, a pressure sensor, a distance sensor, a proximity light sensor, a heart rate sensor, a barometric pressure sensor, a fingerprint sensor, a temperature sensor, a touch sensor, a bone conduction sensor, and the like.
It should be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the mobile phone 300. In other embodiments of the present application, the handset 300 may include more or fewer components than shown, or certain components may be combined, or certain components may be split, or different arrangements of components may be provided. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
The processor 310 may include one or more processing units, such as: the processor 310 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video or audio codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural network processor (neural-network processing unit, NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors.
The controller may be a neural center and a command center of the mobile phone 300. The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.
A memory may also be provided in the processor 310 for storing instructions and data. In some embodiments, the memory in the processor 310 is a cache memory. The memory may hold instructions or data that the processor 310 has just used or recycled. If the processor 310 needs to reuse the instruction or data, it may be called directly from the memory. Repeated accesses are avoided and the latency of the processor 310 is reduced, thereby improving the efficiency of the system.
In some embodiments, processor 310 may include one or more interfaces. The interfaces may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver transmitter (universal asynchronous receiver/transmitter, UART) interface, a mobile industry processor interface (mobile industry processor interface, MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (subscriber identity module, SIM) interface, and/or a universal serial bus (universal serial bus, USB) interface, among others.
The I2C interface is a bi-directional synchronous serial bus comprising a serial data line (SDA) and a serial clock line (derail clock line, SCL). In some embodiments, the processor 310 may contain multiple sets of I2C buses. The processor 310 may be coupled to a touch sensor, charger, flash, camera 393, etc., respectively, through different I2C bus interfaces. For example: the processor 310 may be coupled to the touch sensor through an I2C interface, so that the processor 310 communicates with the touch sensor 3 through an I2C bus interface to implement the touch function of the mobile phone 300.
The I2S interface may be used for audio communication. In some embodiments, the processor 310 may contain multiple sets of I2S buses. The processor 310 may be coupled to the audio module 370 via an I2S bus to enable communication between the processor 310 and the audio module 370. In some embodiments, the audio module 370 may communicate audio signals to the wireless communication module 360 via the I2S interface to enable answering calls via the bluetooth headset.
PCM interfaces may also be used for audio communication to sample, quantize and encode analog signals. In some embodiments, the audio module 370 and the wireless communication module 360 may be coupled by a PCM bus interface. In some embodiments, the audio module 370 may also transmit audio signals to the wireless communication module 360 via the PCM interface to enable phone answering via the bluetooth headset. Both the I2S interface and the PCM interface may be used for audio communication.
The UART interface is a universal serial data bus for asynchronous communications. The bus may be a bi-directional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is typically used to connect the processor 310 with the wireless communication module 360. For example: the processor 310 communicates with a bluetooth module in the wireless communication module 360 through a UART interface to implement a bluetooth function. In some embodiments, the audio module 370 may transmit audio signals to the wireless communication module 360 through a UART interface to implement a function of playing music through a bluetooth headset.
The MIPI interface may be used to connect the processor 310 to peripheral devices such as the display screen 394, the camera 393, and the like. The MIPI interfaces include camera serial interfaces (camera serial interface, CSI), display serial interfaces (display serial interface, DSI), and the like. In some embodiments, processor 310 and camera 393 communicate through a CSI interface to implement the photographing function of handset 300. The processor 310 and the display screen 394 communicate through the DSI interface to implement the display function of the handset 300.
The GPIO interface may be configured by software. The GPIO interface may be configured as a control signal or as a data signal. In some embodiments, a GPIO interface may be used to connect processor 310 with camera 393, display 394, wireless communication module 360, audio module 370, sensor module 380, and the like. The GPIO interface may also be configured as an I2C interface, an I2S interface, a UART interface, an MIPI interface, etc.
It should be understood that the connection relationship between the modules illustrated in the embodiments of the present application is only illustrative, and is not limited to the structure of the mobile phone 300. In other embodiments of the present application, the mobile phone 300 may also use different interfacing manners, or a combination of multiple interfacing manners in the foregoing embodiments.
The charge management module 340 is configured to receive a charge input from a charger. The power management module 341 is configured to connect the battery 342, the charge management module 340 and the processor 310. The power management module 341 receives input from the battery 342 and/or the charge management module 340 to power the processor 310, the internal memory 321, the display screen 394, the camera 393, the wireless communication module 360, and the like. The power management module 341 may also be configured to monitor battery capacity, battery cycle number, battery health (leakage, impedance), and other parameters.
The wireless communication function of the mobile phone 300 may be implemented by the antenna 1, the antenna 2, the mobile communication module 350, the wireless communication module 360, a modem processor, a baseband processor, and the like.
The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in handset 300 may be used to cover a single or multiple communication bands. Different antennas may also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed into a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.
The mobile communication module 350 may provide a solution for wireless communication including 2G/3G/4G/5G, etc. applied to the handset 300. The mobile communication module 350 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA), etc. The mobile communication module 350 may receive electromagnetic waves from the antenna 1, perform processes such as filtering, amplifying, and the like on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 350 may amplify the signal modulated by the modem processor, and convert the signal into electromagnetic waves through the antenna 1 to radiate the electromagnetic waves. In some embodiments, at least some of the functional modules of the mobile communication module 350 may be disposed in the processor 310. In some embodiments, at least some of the functional modules of the mobile communication module 350 may be provided in the same device as at least some of the modules of the processor 310.
The modem processor may include a modulator and a demodulator. The modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low frequency baseband signal to the baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 370A, receiver 370B, etc.), or displays images or video through display screen 394. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 350 or other functional module, independent of the processor 310.
The wireless communication module 360 may provide solutions for wireless communication including wireless local area network (wireless local area networks, WLAN) (e.g., wi-Fi network), bluetooth (BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field wireless communication technology (near field communication, NFC), infrared technology (IR), etc. applied to the handset 300. The wireless communication module 360 may be one or more devices that integrate at least one communication processing module. The wireless communication module 360 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signals, filters the electromagnetic wave signals, and transmits the processed signals to the processor 310. The wireless communication module 360 may also receive a signal to be transmitted from the processor 310, frequency modulate it, amplify it, and convert it to electromagnetic waves for radiation via the antenna 2.
In some embodiments, the antenna 1 and the mobile communication module 350 of the handset 300 are coupled, and the antenna 2 and the wireless communication module 360 are coupled, so that the handset 300 can communicate with a network and other devices through wireless communication technology. The wireless communication techniques may include the Global System for Mobile communications (global system for mobile communications, GSM), general packet Radio service (general packet Radio service, GPRS), code division multiple access (code division multiple access, CDMA), wideband code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), new Radio (NR), BT, GNSS, WLAN, NFC, FM, and/or IR techniques, among others.
The handset 300 implements display functions through the GPU, the display screen 394, and the application processor, etc. The GPU is a microprocessor for image processing, connected to the display screen 394 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. In the embodiment of the application, the GPU can be used for performing three-dimensional model rendering and virtual-real superposition. Processor 310 may include one or more GPUs that execute program instructions to generate or change display information.
The display screen 394 is used for displaying images, videos, and the like. In embodiments of the present application, display screen 394 may be used to display the virtually superimposed image. The display screen 394 includes a display panel. The display panel may employ a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED) or an active-matrix organic light-emitting diode (matrix organic light emitting diode), a flexible light-emitting diode (flex), a mini, a Micro led, a Micro-OLED, a quantum dot light-emitting diode (quantum dot light emitting diodes, QLED), or the like. In some embodiments, the handset 300 may include 1 or N displays 394, N being a positive integer greater than 1.
The handset 300 may implement shooting functions through an ISP, a camera 393, a video codec, a GPU, a display 394, an application processor, and the like.
The ISP is used to process the data fed back by camera 393. For example, when photographing, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electric signal, and the camera photosensitive element transmits the electric signal to the ISP for processing and is converted into an image visible to naked eyes. ISP can also optimize the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be provided in the camera 393.
Camera 393 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (charge coupled device, CCD) or a Complementary Metal Oxide Semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then transferred to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, or the like format. In some embodiments, the handset 300 may include 1 or N cameras 393, N being a positive integer greater than 1.
The digital signal processor is used for processing digital signals, for example digital image signals or digital audio signals, but may also process other digital signals. For example, in the frequency point selection, the digital signal processor is used to perform fourier transform or the like on the frequency point energy.
Video or audio codecs are used to compress or decompress digital video or audio. The handset 300 may support one or more audio codecs such as an advanced audio transport protocol (advanced audio distribution profile, A2 DP) default SBC, an advanced audio coding (advanced audio coding, AAC) family of encoders of the moving picture experts group (moving picture experts group, MPEG), and the like. In this way, the handset 300 may play or record audio in a variety of encoding formats.
The NPU is a neural-network (NN) computing processor, and can rapidly process input information by referencing a biological neural network structure, for example, referencing a transmission mode between human brain neurons, and can also continuously perform self-learning. Applications such as intelligent cognition of the mobile phone 300 can be realized through the NPU, for example: image recognition, face recognition, speech recognition, text understanding, action generation, and so forth.
The external memory interface 320 may be used to connect an external memory card, such as a Micro SD card, to extend the memory capabilities of the handset 300. The external memory card communicates with the processor 310 through an external memory interface 320 to implement data storage functions.
The internal memory 321 may be used to store computer executable program code comprising instructions. The internal memory 321 may include a storage program area and a storage data area. The storage program area may store an application program (such as a sound playing function, an image playing function, etc.) required for at least one function of the operating system, etc. The storage data area may store data (e.g., audio data, phonebook, etc.) created during use of the handset 300, etc. In addition, the internal memory 321 may include a high-speed random access memory, and may also include a nonvolatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (universal flash storage, UFS), and the like. The processor 310 performs various functional applications and data processing of the handset 300 by executing instructions stored in the internal memory 321, and/or instructions stored in a memory provided in the processor.
The handset 300 may implement audio functions through an audio module 370, a speaker 370A, a receiver 370B, a microphone 370C, an earphone interface 370D, an application processor, and the like. Such as music playing, recording, etc.
The audio module 370 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 370 may also be used to encode and decode audio signals.
Speaker 370A, also known as a "horn," is used to convert audio electrical signals into sound signals. The handset 300 may listen to music, or to hands-free calls, through the speaker 370A.
A receiver 370B, also referred to as a "earpiece", is used to convert the audio electrical signal into a sound signal. When the handset 300 is answering a telephone call or voice message, the voice can be received by placing the receiver 370B close to the human ear.
Microphone 370C, also referred to as a "microphone," is used to convert sound signals into electrical signals. When making a call or transmitting voice information, the user can sound near the microphone 370C through the mouth, inputting a sound signal to the microphone 370C. The handset 300 may be provided with at least one microphone 370C. In other embodiments, the handset 300 may be provided with two microphones 370C, and may implement a noise reduction function (the microphone of the noise reduction function is a feedback microphone) in addition to collecting sound signals. In other embodiments, the handset 300 may also be provided with three, four or more microphones 370C to enable collection of sound signals, noise reduction, identification of sound sources, directional recording, etc.
The gyro sensor 380A may be used to determine the motion pose of the handset 300. In some embodiments, the angular velocity of the handset 300 about three axes (i.e., x, y, and z axes) may be determined by the gyro sensor 380A.
The acceleration sensor 380B may detect a movement direction and a movement acceleration of the cellular phone 300. The magnitude and direction of gravity can be detected when the handset 300 is stationary. The method can also be used for identifying the gesture of the mobile phone 300, and can be applied to applications such as horizontal and vertical screen switching, pedometer and the like.
The ambient light sensor 380C is used to sense ambient light level. The handset 300 can adaptively adjust the brightness of the display 394 based on the perceived ambient light level. The ambient light sensor 380C may also be used to automatically adjust white balance during photographing. In some embodiments, the ambient light sensor 380C may also cooperate with the proximity light sensor to detect if the handset 300 is in a pocket to prevent false touches.
The depth sensor 380D is used to determine the distance of each point on the object to the handset 300. In some embodiments, depth sensor 380D may collect depth data of a target object, generating a depth map of the target object. Each pixel in the depth map represents a distance from a point on the object corresponding to the pixel to the mobile phone 300.
The indicator 392 may be an indicator light, which may be used to indicate a state of charge, a change in charge, a message indicating a missed call, a notification, etc.
The keys 390 include a power on key, a volume key, etc. Key 390 may be a mechanical key. Or may be a touch key. The motor 391 may generate a vibration alert. The indicator 392 may be an indicator light, which may be used to indicate a state of charge, a change in charge, a message indicating a missed call, a notification, etc. The SIM card interface 395 is for interfacing with a SIM card. The SIM card may be inserted into the SIM card interface 395 or removed from the SIM card interface 395 to enable contact and separation with the handset 300.
On the basis of understanding the hardware structure of the semi-open active noise reduction earphone, some concepts related to the active noise reduction method and device provided in the embodiments of the present application are explained below.
1. Introduction to Filter parameters
In this embodiment of the present application, the set of filtering parameters includes a filtering parameter corresponding to a feedforward path, a filtering parameter corresponding to a feedback path, and a filtering parameter corresponding to a downlink compensation path. The ANC chip 203 processes the sound signals of the feedforward path, the feedback path, and the downlink compensation path based on the filtering parameters, respectively, so as to realize active noise reduction. Illustratively, the feedforward path, the feedback path, and the downstream compensation path are each described briefly in connection with the process flow diagram described in FIG. 4.
Feed-forward path: the reference microphone is used for processing the sound signal acquired by the reference microphone, and the corresponding filtering parameter of the feedforward path is related to a signal processing method in the feedforward path, for example, the feedforward path includes gain processing, biquad filtering processing, clipping processing and the like, and then the corresponding filtering parameter of the feedforward path may include gain of the feedforward path, parameters of the biquad filter in the feedforward path, parameters of the clipping device and the like.
Feedback path: the method refers to a path for processing the sound signal collected by the error microphone, and similarly, the filtering parameters corresponding to the feedback path are related to a signal processing method in the feedback path, for example, the filtering parameters corresponding to the feedback path may include the gain of the feedback path, the parameters of a biquad filter in the feedback path, the parameters of a limiter, and the like.
And a downlink compensation path: the channel is a channel for processing a downlink signal (such as music played by a user), and the filtering parameters corresponding to the downlink compensation channel may include a gain of the downlink compensation channel, parameters of a downlink compensation filter, and the like.
In connection with fig. 4, it should be noted that, in the process of processing the signal collected by the error microphone through the feedback path, the signal obtained by processing the downlink signal through the downlink compensation path is used as an input signal of the feedback path, so that the signal collected by the error microphone and the processed downlink signal are processed through the feedback path, and a reverse noise signal of the feedback path is obtained; and the sound signals collected by the reference microphone are processed through the feedforward path to obtain reverse noise signals of the feedforward path; and then the directional noise signal of the feedforward path and the inverse noise signal of the feedback path are summed to obtain an inverse noise signal.
2. Leakage state
In the embodiment of the application, the leakage state is formed by the earphone and different ear canal environments, and the ear canal environments are related to the ear canal characteristics of the user (refer to the physiological characteristics of the ear canal, such as the width, shape and the like of the ear canal) and the posture of the user wearing the earphone. For example, different ear canal environments may include: the ear canal environments formed by the earphone at different positions of the ear canal of the same user, the ear canal environments formed by the earphone at the same position of the ear canal of different users, or a combination of the two cases, the embodiments of the present application are not limited.
It will be appreciated that the ear canal may be divided into a small ear canal, a middle ear canal, a large ear canal, etc., depending on the size of the user's ear canal. When a user wears the semi-open active noise reduction earphone, for the user with a small auditory canal, the sealing degree of the earphone and the auditory canal is good, and the sound leakage played by the earphone is less, namely the sound leakage played by the earphone is less; for users with large auditory meatus, the sealing degree of the earphone and the auditory meatus is poor (gaps are reserved between the earphone and the auditory meatus), the sound played by the earphone is more leaked, and the degree of sound leakage is larger. Of course, the degree of leakage of sound played by the earphone is also related to the posture of the user wearing the earphone, for example, the earphone is located at different positions of the auditory canal, and the leakage degree may be different. In summary, the leakage state may reflect the sealing degree between the earphone and the ear canal of the user. The smaller the leakage level, the better the seal of the earphone to the user's ear canal, the less prone the sound to leak.
3. The type of abnormal noise in the embodiment of the present application is described.
Howling: the phenomenon that the amplitude or energy of a single-frequency sound signal is suddenly increased is caused by small sudden increase, and the occurrence of howling of the semi-open active noise reduction earphone can be caused by actions such as extrusion of the earphone or rapid change of wearing postures of the earphone by a user, so that the sound signal emitted during howling is called howling noise, the howling can cause discomfort to the user, and the playing of a downlink signal is interfered, so that the playing effect of audio is seriously affected.
Clipping: clipping is a phenomenon in which low-frequency signals overflow to produce a crackling noise, which is called clipping noise. Typically, clipping occurs when low frequency large noise is bursty in the environment, such as when a vehicle jolts, aircraft landing, etc.
And (3) bottom noise: i.e., noise floor, which may also be referred to as background noise, is noise due to performance limitations of the hardware of the device (e.g., circuitry or other components in the headset), such as sand in television sound, in addition to program sound, etc. In noisy environments, the background noise is generally not perceived (heard) by the user, who can perceive the background noise when the environment is quiet. Too strong a noise floor can not only be annoying, but can also drown out weaker details in the sound.
Wind noise: when wind exists in the environment, the generated calling sound is generated, and the wind noise influences the normal use of the earphone by a user. And because the randomness of the direction of wind noise is larger, the influence of wind noise on ears of a user is different, namely, the left ear and the right ear have inconsistent hearing under the influence of wind noise.
The above howling noise, clipping noise, background noise and wind noise bring serious influence to the listening feeling of the user, and are all abnormal noise.
It should be understood that, for applications in semi-open active noise reduction headphones, the active noise reduction method provided in the embodiments of the present application includes three stages, specifically as follows:
the first stage: n (N) 1 And (3) designing a group filtering parameter.
And a second stage: a process for determining, for a particular user, a set of filter parameters appropriate for that user.
And a third stage: after a group of filtering parameters are determined for a user, abnormal noise detection and updating of the filtering parameters are performed in the noise reduction process by using the group of filtering parameters.
The following examples are detailed respectively in relation to the three stages described above.
The first stage: ### 1 And (3) designing a group filtering parameter.
In this embodiment of the present application, the filters of the feedforward path, the feedback path, and the downlink compensation path may be FIR filters or IIR filters. In the following embodiment, the generation of N is described by taking the filters of the feedforward path, the feedback path, and the downstream compensation path as FIR filters 1 A method of group filtering parameters.
The generation of N 1 The process of the set of filtering parameters is performed by a sound recording device 500, as shown in fig. 5, which includes a semi-open active noise reduction earphone 501, a tympanic microphone 502, an ANC circuit board 503, and a computing device 504. The hardware structure of the semi-open active noise reduction earphone 501 is the same as that of the semi-open active noise reduction earphone shown in fig. 2, and the tympanic microphone 502 is a tiny microphone that can be placed at the tympanic membrane of the ear canal. The reference microphone, the error microphone, the speaker of the semi-open active noise reduction earphone 501 are respectively connected with the ANC circuit board 503, and the tympanic membrane microphone 502 is also connected with the ANC circuit board 503, and the ANC circuit board 503 is connected with the computing device 504 through an integrated chip digital audio transmission interface (IIS), so that the signals of the reference microphone, the error microphone, the speaker and the tympanic membrane microphone are sent to the computing device 504 through the ANC circuit board 503 to complete recording, and then the computing device 504 processes the recorded signals to generate N 1 Group filtering parameters, subsequently, the N 1 The group filtering parameters are pre-stored in the memory of the semi-open active noise reduction earphone.
It is to be understood that N is as described above 1 The group filtering parameter is based on the recording device, and is represented by N 1 And processing the signals recorded in the ear canal environment. Specifically, N 1 The group filtering parameters are determined from the recorded signal of the secondary channel SP mode and the recorded signal of the primary channel PP mode. The SP mode recording signals comprise downlink signals, signals of a tympanic membrane microphone and signals of an error microphone of the semi-open active noise reduction earphone; the PP-mode recording signals include signals from the tympanic membrane microphone, signals from the error microphone of the semi-open active noise reduction earphone, and signals from the reference microphone.
The process of generating a set of filter parameters includes steps 601 through 609 for 1 ear canal environment.
And step 601, when the downlink signal exists, acquiring the downlink signal of the loudspeaker, the signal of the error microphone and the signal of the tympanic microphone.
And 602, when no downlink signal exists, acquiring signals of a reference microphone, an error microphone and a tympanic microphone.
The signal collected in the step 601 may be used for performing secondary channel modeling, the recording process with the downlink signal in the step 601 is simply referred to as a secondary channel (SP) mode, the signal collected in the step 602 may be used for performing primary channel modeling, and the recording process without the downlink signal in the step 602 is simply referred to as a primary channel (PP) mode.
Step 603, performing secondary channel modeling according to the downlink signal, the signal of the error microphone and the signal of the tympanic membrane microphone obtained in step 601, so as to obtain a filtering parameter corresponding to the downlink compensation channel.
It should be understood that in embodiments of the present application, secondary channel modeling includes speaker-to-error microphone secondary channel modeling and speaker-to-tympanic microphone secondary channel modeling.
Step 604, determining a filtering parameter corresponding to the feedforward path and a filtering parameter corresponding to the feedback path by combining the secondary channel model from the speaker to the error microphone and the secondary channel model from the speaker to the tympanic microphone, and the signal obtained in the PP mode.
Fig. 6 is a schematic flow chart of modeling the secondary channel from the speaker to the error microphone, and in combination with fig. 6, the process of modeling the secondary channel from the speaker to the error microphone includes steps 6031a to 6031d.
Step 6031a, filtering the downlink signal by a first filter.
It should be noted that, during initialization, the first filter is an FIR filter, and parameters of the first filter may be a preset set of parameters, or may be all set to 0, or a set of parameters generated randomly, which is not limited in the embodiment of the present application.
Step 6031b, superposing the signal of the error microphone obtained in the SP mode and the inverted signal of the filtered downlink signal to obtain the residual signal of the error microphone.
Step 6031c, framing the residual signal of the error microphone and performing Fourier transform; and carrying out framing processing on the downlink signals and carrying out Fourier transformation.
In step 6031d, the downlink signal after fourier transformation is used as a reference signal, the residual signal after fourier transformation is used as an error, the error is processed by a Normalized Least Mean Square (NLMS) algorithm, and the processing result is subjected to inverse fourier transformation, and the result after inverse fourier transformation is the parameter of the first filter.
In this embodiment, the parameters of the first filter obtained in step 6031d are used to update the parameters of the first filter initialized in step 6031a, and steps 6031a to 6031d are repeatedly performed, so that the model of the first filter that converges (refers to the convergence of the residual signal of the error microphone) is the model of the secondary channel from the speaker to the error microphone.
In the embodiment of the present application, parameters of a converged set of filters are taken as filtering parameters corresponding to a downlink compensation path.
Fig. 7 is a schematic flow chart of modeling a secondary channel from a speaker to a tympanic microphone, and in combination with fig. 7, the process of modeling the secondary channel from the speaker to the tympanic microphone includes steps 6032a to 6032d.
Step 6032a, filtering the downlink signal by a second filter.
It should be noted that, during initialization, the second filter is an FIR filter, and parameters of the second filter may be a preset set of parameters, or may be all set to 0, or a set of parameters generated randomly, which is not limited in the embodiment of the present application.
Step 6021b, superposing the signal of the tympanic membrane microphone obtained in the SP mode and the inverted signal of the filtered downlink signal to obtain a residual signal of the tympanic membrane microphone.
Step 6031c, framing the residual signal of the tympanic membrane microphone, and performing fourier transform; and carrying out framing processing on the downlink signals and carrying out Fourier transformation.
In step 6031d, the downlink signal after fourier transformation is used as a reference signal, the residual signal after fourier transformation is used as an error, the error is processed by a Normalized Least Mean Square (NLMS) algorithm, and the processing result is subjected to inverse fourier transformation, and the result after inverse fourier transformation is the parameter of the second filter.
In this embodiment, the parameters of the second filter initialized in step 6032a are updated by using the parameters of the second filter obtained in step 6032d, and steps 6032a to 6032d are repeatedly performed, so that the model of the second filter that converges (refers to convergence of the residual signal of the tympanic microphone) is finally the model of the secondary channel from the speaker to the tympanic microphone.
Fig. 8 is a flowchart illustrating determining the filter parameters corresponding to the feedforward path and the filter parameters corresponding to the feedback path, and in combination with fig. 8, determining the filter parameters corresponding to the feedforward path and the filter parameters corresponding to the feedback path specifically includes steps 6041a to 6041i.
Step 6041a, filtering the signal of the reference microphone acquired in PP mode by the filter of the feedforward path to obtain the inverse noise signal (denoted as anti ff signal) of the feedforward path.
Similarly, when step 6041a is performed for the first time, the parameters of the filter of the feedforward path are a set of initialized parameters, for example, the parameters of the filter of the feedforward path may be a preset set of parameters, or the parameters of the filter of the feedforward path may be all set to 0, or a randomly generated set of parameters, which is not limited in the embodiment of the present application.
Step 6041b, processing the residual signal of the error microphone by the filter of the feedback path to obtain an inverse noise signal (labeled as anti fb signal) of the feedback path.
The residual signal of the error microphone in step 6041b is the sum of the processing result of the inverse noise signal (recorded as the Anti signal) from the previous time processed by the secondary channel model from the speaker to the error microphone and the signal of the error microphone obtained in the PP mode. The Anti signal at the previous time is the sum of the Anti ff signal at the previous time and the Anti fb signal at the previous time.
The Anti-ff signal in step 6041c and the Anti-fb signal in step 6041a are superimposed (i.e. summed) to obtain an inverse noise signal (i.e. Anti signal), and the Anti-noise signal is processed by the secondary channel model from the speaker to the tympanic microphone, and then is inverted and superimposed with the signal of the tympanic microphone in PP mode to obtain a residual signal of the tympanic microphone.
The signals of the reference microphone in step 6041d, PP mode are processed through the speaker to tympanic microphone secondary channel model.
Step 6041e, framing the processing result in step 6041d, and performing fourier transform; and framing the residual signal of the tympanic microphone and performing Fourier transform.
Step 6041f, taking the signal after fourier transformation in step 6041e (the signal obtained by framing the processing result in step 6041d and performing fourier transformation) as a reference signal, taking the residual signal of the tympanic microphone after fourier transformation in step 6041e as an error, processing by a Normalized Least Mean Square (NLMS) algorithm, and performing inverse fourier transformation on the processing result, wherein the result after inverse fourier transformation is the parameter of the filter of the feedforward path.
Step 6041g, processing the residual signal of the error microphone by the secondary channel model from the loudspeaker to the error microphone.
Step 6041h, framing the processing result of step 6041g, and performing Fourier transform; and framing the residual signal of the tympanic microphone and performing Fourier transform.
Step 6041i, taking the signal after fourier transformation in step 6041h (the signal obtained by framing the processing result in step 6041g and performing fourier transformation) as a reference signal, taking the residual signal of the tympanic microphone after fourier transformation in step 6041h as an error, processing by a Normalized Least Mean Square (NLMS) algorithm, and performing inverse fourier transformation on the processing result, wherein the result after inverse fourier transformation is the parameter of the filter of the feedback path.
In the embodiment of the present application, the parameters of the initialized feedforward path filter are updated by using the parameters of the feedforward path filter obtained in step 6041f, and the parameters of the initialized feedback path filter are updated by using the parameters of the feedback path filter obtained in step 6041 i; and steps 6041a to 6041i are repeatedly performed, and finally, parameters of the converged filter (parameters of the filter of the feedforward path and parameters of the filter of the feedback path) are taken as the filter parameters corresponding to the feedforward path and the filter parameters corresponding to the feedback path.
In summary, the filtering parameter generating method is used for generating N 1 Recording signals corresponding to different auditory canal environments are processed to obtain N 1 Group filtering parameters, and to filter the N 1 The group filtering parameters are stored in the memory of the semi-open active noise reduction earphone. It should be understood that the N 1 Group filter parameters for N 1 The environment noise is reduced in the leakage state, and the environment noise reducing device has universal applicability and meets the personalized requirements of different people.
When a user wears the semi-open active noise reduction earphone and the semi-open active noise reduction earphone is in the ANC working mode, the N is that 1 The group filter parameters are selected as alternative filter parameters.
And a second stage: a process for determining, for a particular user, a set of filter parameters appropriate for that user.
As shown in fig. 9, an embodiment of the present application provides an active noise reduction method applied to an earphone with ANC function (for example, a semi-open active noise reduction earphone shown in fig. 1), where the active noise reduction method includes steps 901 to 904.
Step 901, when the earphone is in an ANC working mode, the earphone acquires a first set of filtering parameters, where the first set of filtering parameters is N pre-stored in the earphone 1 One of the sets of filter parameters, N 1 The group filtering parameters are respectively used for N 1 And (5) performing environmental noise reduction in a leakage state.
Above N 1 The leakage state is formed by earphone and N 1 Different ear canal environments are formed, wherein the noise reduction effect of the earphone when the first group of filtering parameters are applied to the same environmental noise is better than that of the earphone when N is applied to the earphone in the current wearing state 1 Noise reduction effect when other filter parameters in the group of filter parameters, N 1 Is a positive integer greater than or equal to 2.
In the embodiment of the application, the leakage state is formed by the earphone and different ear canal environments, the ear canal environments are related to the ear canal characteristics of the user and the posture of the user wearing the earphone, and the combination of the different ear canal characteristics and the different postures of wearing the earphone can form various ear canal environments and also correspond to various leakage states.
It is to be understood that N is as described above 1 The seed leakage state may express N 1 The fit degree range of the earphone and the human ear can express N 1 The sealing degree of the earphone and the human ear; any leakage state is not a specific wearing state of the earphone, but a large amount of statistics is carried out according to the impedance characteristics of the leakage state, so that a typical leakage scene or a differential leakage scene is obtained.
The wearing state of the earphone corresponds to an ear canal environment, thereby forming a leakage state, and the wearing state of the earphone is different due to the change of the ear canal characteristics of the user and the posture of the user wearing the earphone. The current state of wear of the headset corresponds to a stable ear canal environment, i.e. to a stable ear canal characteristic and wearing posture. Above N 1 The noise reduction effect when the group of filtering parameters are applied to the earphone varies with the wearing state of the earphone, and the first group of filtering parameters are that the earphone applies N in the current wearing state 1 And when the group of filter parameters reduce noise of the same environmental sound, the noise reduction effect is optimal.
In this embodiment of the present application, the environmental noise is noise formed by the external environment in the ear canal of the user, where the environmental noise includes background noise of different scenes, for example, a high-speed rail scene, an office scene, an aircraft flight scene, and the like, and the embodiment of the present application is not limited.
As can be seen from the description of the above embodiments, the set of filtering parameters includes the filtering parameters (FF coefficients) corresponding to the feedforward path, the filtering parameters (FB coefficients) corresponding to the feedback path, and the filtering parameters (SPE coefficients) corresponding to the downlink compensation path.
In this embodiment of the present application, the first set of filtering parameters may be determined by a subjective test performed by a user based on a terminal, or determined by the terminal or determined by performing a parameter matching algorithm by an earphone. Based on this, the above-mentioned earphone acquiring the first set of filtering parameters includes the earphone acquiring the first set of filtering parameters from the terminal or the earphone determining the first set of filtering parameters, the specific details of which will be described in the following embodiments.
Step 902, the headset performs noise reduction using the first set of filtering parameters.
In this embodiment of the present application, referring to fig. 3, performing noise reduction by using the first set of filtering parameters specifically includes: and processing the sound signals collected by the reference microphone of the earphone and the sound signals collected by the error microphone of the earphone by using the first group of filtering parameters to generate reverse noise signals, wherein the reverse noise signals can weaken part of the environmental noise signals in the auditory canal of the user, so that the noise signals in the auditory canal of the user are weakened, and the environmental noise is reduced.
According to the active noise reduction method provided by the embodiment of the application, a group of filter parameters (namely the first group of filter parameters) matched with the current leakage state (also can be understood as the current wearing state) can be determined according to the leakage state formed by the ear canal environment of the user and the earphone when the user wears the earphone, and the environmental noise is reduced based on the group of filter parameters, so that the personalized noise reduction requirement of the user can be met, and the noise reduction effect is improved.
In one implementation, when the first set of filtering parameters is obtained from the terminal, the first set of filtering parameters is obtained from N by the terminal 1 And determining a first group of filtering parameters in the group of filtering parameters, and sending indication information to the earphone to indicate the first group of filtering parameters.
In another implementation, when the first set of filter parameters is determined by a headset (a semi-open active noise reduction headset as shown in fig. 1), the headset performs a matching algorithm to determine the first set of filter parameters. Specifically, the steps 1001 to 1004, 1101 to 1105, 1201 to 1204, 1301 to 1304, 1401 to 1403 described below are included.
As shown in fig. 10, the earphone is shown from N 1 The method of determining the first set of filter parameters from the set of filter parameters comprises steps 1001 to 1004.
Step 1001, a first signal is acquired through an error microphone of the earphone, and a downlink signal of the earphone is acquired.
Step 1002, determining current frequency response curve information of the secondary channel according to the first signal and the downlink signal.
In this embodiment of the present application, the frequency response of the secondary channel is a ratio of the frequency spectrum (i.e., the amplitude) of the first signal after fourier transformation to the frequency spectrum of the downlink signal after fourier transformation, and the current frequency response curve information of the secondary channel is a curve describing a trend of variation of the ratio between the frequency spectrum of the first signal after fourier transformation and the frequency spectrum of the downlink signal after fourier transformation.
In one implementation manner, the downlink signal may be a test audio signal (for example, playing a customized music signal online), and the test is performed within a frequency range of 100 hertz (Hz) -500Hz to obtain a frequency response curve of the secondary channel, where the frequency range may of course also be other frequency ranges, specifically determined according to actual requirements, and the embodiment of the present application is not limited.
Step 1003, determining target frequency response curve information matched with the current frequency response curve information from preset frequency response curve information of multiple groups of secondary channels.
In this embodiment of the present application, the preset frequency response curve information of multiple sets of secondary channels is frequency response curve information of secondary channels of different users (specifically, users with different ear canal characteristics, such as a large ear canal, a middle ear canal or a small ear canal) in offline test, and the test frequency range is also 100Hz-500Hz.
Optionally, the number of the preset sets of frequency response curve information of the secondary channels may be determined according to practical situations, which is not limited in this embodiment, for example, the number of the preset sets of frequency response curve information of the secondary channels is 9, and the frequency response curves of the 9 sets of secondary channels are frequency response curves capable of reflecting different ear canal characteristics.
Step 1004, determining a set of filtering parameters corresponding to the target frequency response curve information as a first set of filtering parameters.
Above N 1 Group filtering parameters correspond to N 1 Frequency response curve information for each secondary channel.
As shown in fig. 11, the earphone is shown from N 1 Group filtering parameter validationThe method of determining the first set of filter parameters includes steps 1101 through 1105.
Step 1101, collecting a first signal through an error microphone of the earphone, collecting a second signal through a reference microphone of the earphone, and obtaining a downlink signal of the earphone.
Step 1102, determining a residual signal of the error microphone based on the first signal and the second signal.
Specifically, short-time fourier transform is performed on the first signal and the second signal respectively, then the second signal after fourier transform is used as a reference signal, the first signal after fourier transform is used as a target signal, and kalman filtering and normalized least mean square (normalized least mean square, NLMS) filtering are adopted to obtain a residual signal of the error microphone. It should be appreciated that the residual signal of the error microphone is the spectrum (i.e., amplitude) of the residual signal.
Step 1103, determining current frequency response curve information of the secondary channel according to the residual signal and the downlink signal of the error microphone.
It should be understood that, at this time, the current frequency response of the secondary channel is a ratio of the spectrum of the residual signal of the error microphone to the spectrum of the fourier-transformed downstream signal, and the current frequency response curve of the secondary channel is a curve describing a trend of variation of the ratio between the spectrum of the residual signal of the error microphone and the spectrum of the fourier-transformed downstream signal.
Alternatively, a time-linear recursive smoothing may be performed on the current frequency response curve of the secondary channel to remove outliers or noise points on the frequency response curve.
Step 1104, determining target frequency response curve information matched with the current frequency response curve information from preset frequency response curve information of a plurality of groups of secondary channels.
Step 1105, determining a set of filtering parameters corresponding to the target frequency response curve information as a first set of filtering parameters.
The N is 1 Group filtering parameters correspond to N 1 Frequency response curve information for each secondary channel.
In this embodiment of the present application, since the state of the external environmental noise and the sound signal of the wearer (user) affect the accuracy of the frequency response curve of the secondary channel, in order to improve the accuracy of the frequency response curve of the secondary channel, an adaptive filtering algorithm is adopted, after the environmental noise and the sound signal of the wearer are filtered, the frequency response curve information of the secondary channel is calculated, so as to improve the accuracy of the frequency response curve of the secondary channel.
Optionally, the downlink signal used for determining the first set of filtering parameters may be an alert tone when the ANC function is turned on, that is, the alert tone when the ANC function is turned on is used as a test signal, and no separate test is required, so that the working efficiency of the earphone may be improved.
As shown in fig. 12, the earphone is shown from N 1 The method of determining the first set of filter parameters from the set of filter parameters comprises steps 1201 to 1204.
Step 1201, collecting a first signal through an error microphone of the headset and collecting a second signal through a reference microphone of the headset.
Step 1202, determining current frequency response curve information of the primary channel according to the first signal and the second signal.
In this embodiment of the present application, the frequency response of the primary channel is a ratio of the frequency spectrum (i.e. the amplitude) of the first signal after fourier transformation to the frequency spectrum of the second signal after fourier transformation, and the current frequency response curve information of the secondary channel is a curve describing a trend of variation of the ratio between the frequency spectrum of the first signal after fourier transformation and the frequency spectrum of the downlink signal after fourier transformation.
Step 1203, determining target frequency response curve information matched with the current frequency response curve information from preset frequency response curve information of multiple groups of primary channels.
The preset frequency response curve information of the primary channels is the frequency response curve information of the primary channels of different users (particularly users with different auditory canal characteristics, such as a large auditory canal, a middle auditory canal or a small auditory canal) in an offline test.
Optionally, the frequency response curve information of the plurality of groups of primary channels and the current frequency response curve information can be matched in the target frequency band, so as to determine the target frequency response curve information. For example, if the target frequency band is 1000Hz-2000Hz, matching the information of the frequency response curve information of multiple groups of primary channels in the 1000Hz-2000Hz frequency band with the information of the current frequency response curve in the 1000Hz-2000Hz frequency band, and determining the target frequency response curve information. Of course, the target frequency band may also be other frequency bands, which are specifically determined according to actual requirements, and the embodiments of the present application are not limited.
Step 1204, determining a set of filtering parameters corresponding to the target frequency response curve information as a first set of filtering parameters.
Above N 1 Group filtering parameters correspond to N 1 Frequency response curve information of the individual primary channels.
Optionally, in the embodiment of the present application, an adaptive filtering algorithm may be further used to determine the frequency response curve information of the current primary channel, and further determine the target frequency response curve information of the primary channel. The method for determining the frequency response curve information of the current primary channel by adopting the adaptive filtering algorithm comprises the following steps: and respectively carrying out short-time Fourier transform on the first signal and the second signal, taking the second signal after Fourier transform as a reference signal, taking the first signal after Fourier transform as a target signal, adopting Kalman filtering or NLMS filtering to minimize the residual signal of the error microphone, and finally obtaining the frequency response curve of the primary channel by the amplitude-frequency curve of the Kalman filtering or the NLMS filter after convergence.
As shown in fig. 13, the earphone is shown from N 1 The method of determining the first set of filter parameters from the set of filter parameters comprises steps 1301 to 1304.
Step 1301, collecting a first signal through an error microphone of the earphone, collecting a second signal through a reference microphone of the earphone, and obtaining a downlink signal of the earphone.
Step 1302, determining current frequency response curve information of the primary channel according to the first signal and the second signal, determining current frequency response curve information of the secondary channel according to the first signal and the downlink signal, and determining current frequency response ratio curve information.
The current frequency response ratio curve information is the ratio of the current frequency response curve information of the primary channel to the current frequency response curve information of the secondary channel.
Step 1303, determining target frequency response ratio curve information matched with the current frequency response ratio curve information from preset multiple sets of frequency response ratio curve information.
And 1304, determining a set of filtering parameters corresponding to the target frequency response ratio curve information as a first set of filtering parameters.
The N is 1 Group filtering parameters correspond to N 1 And frequency response ratio curve information.
As shown in fig. 14, the slave earphone N 1 The method of determining the first set of filter parameters from the set of filter parameters comprises steps 1401 to 1403.
Step 1401, obtain N 1 Frequency response difference curve information of the error microphone and the reference microphone corresponding to the group filtering parameters respectively.
In this embodiment, taking a set of filtering parameters as an example, the method for obtaining the frequency response difference curve information of the error microphone and the reference microphone corresponding to the set of filtering parameters may include: setting the filtering parameters of the semi-open active noise reduction earphone as the set of filtering parameters, acquiring a first signal through an error microphone of the semi-open active noise reduction earphone, and acquiring a second signal through a reference microphone of the semi-open active noise reduction earphone; and determining frequency response curve information of the error microphone and frequency response curve information of the reference microphone according to the first signal and the second signal, and determining frequency response difference value curve information of the error microphone and the reference microphone. The frequency response difference curve information of the error microphone and the reference microphone is the difference between the frequency response curve information of the error microphone and the frequency response curve information of the reference microphone.
Step 1402, N 1 N corresponding to the group filtering parameters 1 And in the frequency response difference curve information, determining the frequency response difference curve with the minimum amplitude corresponding to the target frequency band as a target frequency response difference curve.
Step 1403, determining a set of filtering parameters corresponding to the target frequency response difference curve information as a first set of filtering parameters.
Optionally, in conjunction with fig. 9, as shown in fig. 15, the active noise reduction method provided in the embodiment of the present application further includes step 903.
Step 903, the earphone generates N according to at least the first set of filtering parameters and the second set of filtering parameters 2 Group filter parameters, N 2 The group filtering parameters correspond to different ANC noise reduction strengths, respectively.
The second set of filtering parameters is N pre-stored by the earphone 1 One set of filter parameters; the second set of filtering parameters is used for filtering the signal in N 1 The environmental noise is reduced in a state where the leakage degree is minimum among the leakage states.
It will be appreciated that N is as described above 1 Group filter parameters for N 1 Ambient noise reduction in the leakage state, optionally the N 1 The leakage degree corresponding to the leakage state is sequentially increased, and the second set of filtering parameters is a set of filtering parameters corresponding to a leakage state with the minimum leakage degree.
In the embodiment of the present application, the step 903 may be implemented by step 9031.
Step 9031, the earphone interpolates the first set of filter parameters and the second set of filter parameters to generate N 2 And (5) a group of filtering parameters.
In the embodiment of the present application, it is assumed that a set of filtering parameters includes K parameters, which generate N 2 When the filter parameters are set, the first filter parameter is taken as N 2 Nth of group filtering parameters 2 Group filter parameters, denoted as P N2,1 ,P N2,2 ,……,P N2,K The method comprises the steps of carrying out a first treatment on the surface of the Let the second set of filter parameters be N 2 Group 1 filter parameters of the group of filter parameters, denoted P 1,1 ,P 1,2 ,……,P 1,K By adopting a linear interpolation method, the 1 st group of filtering parameters and the N th group of filtering parameters 2 The set of filter parameters are linearly interpolated and N-2 sets of new filter parameters are inserted. It should be appreciated that the first set of filter parameters, the interpolated N-2 set of filter parameters, and the second set of filter parameters constitute the N 2 And (5) a group of filtering parameters.
Specifically, the filter parameters of the ith group are determined according to the following formula, wherein the values of i are 2,3, … … and N 2 -1。
P i,1 =P 1,1 ++ (i-1) x.DELTA.1, wherein,
P i,2 =P 1,2 ++ (i-1) x.DELTA.2, wherein,
……
P i,K =P 1,K ++ (i-1) x.DELTA.K, wherein,
it should be appreciated that Δ1, Δ2, … …, Δk described above are step factors for K parameters in a set of filter parameters, respectively.
To sum up, i is 2,3, … …, N respectively 2 -1, which can be interpolated to N 2 And (5) a group of filtering parameters.
It should be noted that, in the embodiment of the present application, the execution order of the step 902 and the step 903 is not limited, and the step 902 may be executed first and then the step 903 may be executed, the step 903 may be executed first and then the step 902 may be executed, or the step 902 and the step 903 may be executed simultaneously.
Optionally, as shown in fig. 15, after the step 903, the active noise reduction method provided in the embodiment of the present application further includes steps 904 to 906.
Step 904, the earphone acquires the noise reduction strength of the target ANC.
Alternatively, in the embodiment of the present application, the target ANC noise reduction strength may be determined by a subjective test performed by the user based on the terminal, or determined by the earphone, or determined by the terminal. When the target ANC noise reduction intensity is determined by the earphone, the earphone determines the target ANC noise reduction intensity according to the state of the current environmental noise. For example, the current environment is quite, and the earphone adaptively selects the ANC noise reduction intensity with weaker noise reduction intensity according to the environment noise state; when the current environment is noisy, the earphone adaptively selects ANC noise reduction intensity with stronger noise reduction intensity according to the state of the environmental noise.
Step 905, the earphone reduces noise from N according to the target ANC noise intensity 2 Group filteringA third set of filter parameters is determined from the wave parameters.
In the embodiment of the application, ANC noise reduction strength and N 2 The group filtering parameters have a corresponding relation, N 2 The noise reduction intensities corresponding to the group filtering parameters are different, and the noise reduction effects are different. Noise reduction strength and N based on ANC 2 Correspondence of group filtering parameters, from N 2 And determining a third group of filtering parameters corresponding to the target ANC noise reduction intensity from the group of filtering parameters.
Step 906, the headset uses the third set of filtering parameters to reduce noise.
It should be appreciated that, based on step 904 and step 905, the above-mentioned first set of filtering parameters is replaced by a third set of filtering parameters, that is, the sound signal collected by the reference microphone of the earphone and the sound signal collected by the error microphone of the earphone are processed by using the third set of filtering parameters, so as to generate an inverse noise signal, and the inverse noise signal may weaken a part of the environmental noise signal in the ear canal, so as to realize noise reduction of the environmental sound.
In summary, in the active noise reduction method provided in the embodiment of the present application, after the first set of filtering parameters are determined, N adapted to the current user is generated based on the first set of filtering parameters and the second set of filtering parameters 2 Group filtering parameters, and from the N 2 And a third group of filtering parameters corresponding to the target ANC noise reduction intensity is further determined in the group of filtering parameters, so that noise reduction is performed by adopting the third group of filtering parameters, and therefore, the proper ANC noise reduction intensity can be selected according to the state of the environmental noise, and the noise reduction effect is more in line with the requirements of users.
The content of the second stage described above (the process of determining a set of filter parameters suitable for a particular user) is described below from the point of view of the terminal interacting with the headset. Specifically, as shown in fig. 16, the active noise reduction method provided in the embodiment of the present application includes steps 1601 to 1604.
In step 1601, the terminal determines a first set of filtering parameters.
The first set of filtering parameters is N pre-stored by the earphone 1 One of the sets of filter parameters, N 1 The group filtering parameters are respectively used for N 1 Ambient sound reduction in leakage stateNoise, N 1 The leakage state is formed by earphone and N 1 Formed by different ear canal environments. The noise reduction effect of the earphone when the first group of filtering parameters are applied is better than that of the earphone when N is applied aiming at the same environmental noise under the current wearing state of the earphone 1 Noise reduction effect when other filter parameters in the group of filter parameters, N 1 Is a positive integer greater than or equal to 2.
In step 1602, the terminal sends first indication information to the earphone, where the first indication information is used to instruct the earphone to make noise reduction by using a first set of filtering parameters.
Step 1603, the earphone receives the first indication information from the terminal.
In this embodiment of the present application, after the earphone receives the first indication information sent by the terminal, N is stored from the earphone 1 A first set of filter parameters indicated by the first indication information is determined from the set of filter parameters.
Step 1604, the headset performs noise reduction using the first set of filtering parameters.
According to the active noise reduction method provided by the embodiment of the application, a group of filter parameters (namely the first group of filter parameters) matched with the current leakage state can be determined according to the leakage state formed by the ear canal environment of the user and the earphone when the user wears the earphone, and the environment noise is reduced based on the group of filter parameters, so that the personalized noise reduction requirement of the user can be met, and the noise reduction effect is improved.
In one implementation, the step 1601 (i.e. the terminal determines the first set of filtering parameters) may be implemented by performing a matching algorithm by the terminal, specifically including the following steps 16011a to 16011e, or steps 16012a to 16012e, or steps 16013a to 16013e, or steps 16014a to 16014d, or steps 16015a to 16015d.
Optionally, the method for determining the first set of filtering parameters by the terminal includes steps 16011a to 16011e.
In step 16011a, the terminal receives a first signal collected by an error microphone of the headset and a second signal collected by a reference microphone of the headset, and obtains a downlink signal of the headset.
Step 16011b, the terminal determines a residual signal of the error microphone based on the first signal and the second signal.
In step 16011c, the terminal determines current frequency response curve information of the secondary channel according to the residual signal and the downlink signal of the error microphone.
Step 16011d, terminal is performed from preset N 1 And determining target frequency response curve information matched with the current frequency response curve information in the frequency response curve information of each secondary channel.
Step 16011e, the terminal determines a filter parameter corresponding to the target frequency response curve information as a first set of filter parameters, where N is 1 Group filtering parameters correspond to N 1 Frequency response curve information for each secondary channel.
Optionally, the method for determining the first set of filtering parameters by the terminal includes steps 16012a to 16012e.
In step 16012a, the terminal receives a first signal collected by an error microphone of the headset and a second signal collected by a reference microphone of the headset, and obtains a downlink signal of the headset.
Step 16012b, the terminal determines a residual signal of the error microphone based on the first signal and the second signal.
In step 16012c, the terminal determines current frequency response curve information of the secondary channel according to the residual signal and the downlink signal of the error microphone.
Step 16012d, terminal is performed from preset N 1 Determining target frequency response curve information matched with the current frequency response curve information in the frequency response curve information of the secondary channels;
step 16012e, the terminal determines a filter parameter corresponding to the target frequency response curve information as a first set of filter parameters, N 1 Group filtering parameters correspond to N 1 Frequency response curve information for each secondary channel.
Optionally, the method for determining the first set of filtering parameters by the terminal includes steps 16013a to 16013e.
In step 16013a, the terminal receives a first signal collected by an error microphone of the headset and a second signal collected by a reference microphone of the headset, and obtains a downlink signal of the headset.
Step 16013b, the terminal determines a residual signal of the error microphone based on the first signal and the second signal.
In step 16013c, the terminal determines current frequency response curve information of the secondary channel according to the residual signal and the downlink signal of the error microphone.
Step 16013d, terminal is started from preset N 1 And determining target frequency response curve information matched with the current frequency response curve information in the frequency response curve information of each secondary channel.
Step 16013e, the terminal determines a filter parameter corresponding to the target frequency response curve information as a first set of filter parameters, N 1 Group filtering parameters correspond to N 1 Frequency response curve information for each secondary channel.
Optionally, the method for determining the first set of filtering parameters by the terminal comprises steps 16014a to 16014d.
Step 16014a, the terminal receives a first signal collected by an error microphone of the headset and a second signal collected by a reference microphone of the headset.
Step 16014b, the terminal determines current frequency response curve information of the primary channel according to the first signal and the second signal.
Step 16014c, terminal is performed from preset N 1 And determining target frequency response curve information matched with the current frequency response curve information in the frequency response curve information of each primary channel.
Step 16014d, the terminal determines the filter parameters corresponding to the target frequency response curve information as a first set of filter parameters, N 1 Group filtering parameters correspond to N 1 Frequency response curve information of the individual primary channels.
Optionally, the method for determining the first set of filtering parameters by the terminal includes steps 16015a to 16015d.
In step 16015a, the terminal receives a first signal collected by an error microphone of the headset and a second signal collected by a reference microphone of the headset, and acquires a downlink signal of the headset.
Step 16015b, the terminal determines current frequency response curve information of the primary channel according to the first signal and the second signal, and determines current frequency response curve information of the secondary channel according to the first signal and the downlink signal; and determining current frequency response ratio curve information.
The current frequency response ratio curve information is the ratio of the current frequency response curve information of the primary channel to the current frequency response curve information of the secondary channel.
Step 16015c, terminal is performed from preset N 1 And determining target frequency response ratio curve information matched with the current frequency response ratio curve information in the frequency response ratio curve information.
Step 16015d, the terminal determines the filter parameters corresponding to the target frequency response ratio curve information as a first set of filter parameters, N 1 Group filtering parameters correspond to N 1 And frequency response ratio curve information.
It should be understood that the active noise reduction method provided in the embodiment of the present application is applied in a scenario where the earphone is in the ANC operation mode, where it is known that the earphone is in the ANC operation mode is a trigger condition for determining the first set of filtering parameters. Specifically, the method for enabling the earphone to operate in the ANC operation mode includes the following first mode or second mode.
The first mode includes steps A1 to A3.
And A1, the terminal receives operation of a first option of a first interface of the terminal, wherein the first interface is an interface for setting the working mode of the earphone.
And A2, the terminal responds to the operation of the first option and sends a first instruction to the earphone, wherein the first instruction is used for controlling the earphone to work in an ANC working mode.
In an application scenario in the embodiment of the present application, an application (App) corresponding to an earphone is installed on a terminal, after a user opens the application and establishes a communication connection with the earphone (left earphone and/or right earphone), the user performs a corresponding operation on a first interface displayed on the terminal to control the earphone to be in different working modes, for example, a general mode or an ANC mode, and it should be understood that the general mode herein is a mode in which a noise reduction function is not opened.
Alternatively, the first operation may be a touch screen operation or a key operation, which is not limited in the embodiment of the present invention. The above touch screen operation is exemplified by a pressing operation, a long press operation, a sliding operation, a clicking operation, a floating operation (an operation by a user in the vicinity of the touch screen) of the touch screen of the terminal by the user, and the like. The key operation corresponds to a single click operation, a double click operation, a long press operation, a combination key operation, and the like of a key such as a power key, a volume key, a Home key, and the like of the terminal by a user.
The interface 1701 shown in fig. 17 is an example of the first interface described above, and the first interface includes different options for setting the operation mode of the earphone, and the user sets the operation mode of the earphone by selecting the different options. It should be appreciated that the first option described above corresponds to an ANC mode of operation. For example, the first interface 1701 includes a "general mode" option 1702 and an "ANC mode" option 1703, where the "ANC mode" option 1703 is the first option. When the user selects the "ANC mode" option 1703 in the first interface 1701, for example, the user clicks the "ANC mode" option 1703, the headset may be controlled to operate in an ANC operation mode.
And A3, receiving a first instruction by the earphone, and operating the earphone in an ANC working mode.
Alternatively, in another implementation manner, the first instruction may also be an operation instruction performed by the user on the earphone, for example, a button or a button on the earphone that opens the ANC function, and after the user wears the earphone, the user presses the button (corresponding to the first instruction) that opens the ANC function, and the earphone enters the ANC operation mode.
The above-described mode two includes steps B1 to B2.
And B1, detecting whether the earphone is in the ear.
In this embodiment of the present application, an in-ear detection technology is used to detect whether the earphone is in the ear, for example, in combination with the description of the structure of the earphone in the above embodiment, the earphone includes a proximity light sensor, and the in-ear detection technology can detect whether the earphone is in the ear according to the signal collected by the proximity light sensor.
And B2, under the condition that the earphone is detected to be in the ear, the earphone works in an ANC working mode.
In this embodiment, in an application scenario, when the earphone detects that the earphone is in the ear, the earphone may automatically turn on the ANC function, so that the earphone works in the ANC working mode. Optionally, when the earphone is detected to be in the ear, the earphone plays an in-ear alert sound, and after a preset period of time (indicating that the earphone is in the ear stably) at the end of the alert sound, the earphone operates in the ANC operation mode.
In summary, the terminal performs the step of determining the first set of filtering parameters, or the headset performs the step of obtaining the first set of filtering parameters.
Optionally, another triggering condition for determining (or acquiring) the first set of filtering parameters is: when the earphone is in the ANC working mode, the user performs auxiliary operation on the terminal or the earphone according to actual requirements, so that the terminal is triggered to determine the first group of filtering parameters or the earphone obtains the first group of filtering parameters.
In one implementation manner, in the first mode, when the ANC function is turned on, the earphone plays an ANC-turned-on alert sound, and determines a first set of filtering parameters in the process of playing the in-ear alert sound, that is, the in-ear alert sound is used as a test signal, and the user determines the first set of filtering parameters according to subjective listening experience.
In another implementation, when it is detected that the earphone is in the ear, the earphone is operated in the ANC operation mode, and at the same time, the earphone will play the in-ear alert sound, and the first set of filtering parameters is determined in the process of playing the in-ear alert sound, that is, the in-ear alert sound is used as a test signal, and the user determines the first set of filtering parameters according to subjective listening experience.
Optionally, after the terminal receives the operation of the first option on the first interface of the terminal, the active noise reduction method provided in the embodiment of the present application further includes: and displaying an ANC control list. The ANC control list includes at least one of the following options: a first control option, a second control option, or a third control option; wherein the first control option is used for triggering and determining a first group of filtering parameters, and the second control option is used for triggering and generating N 2 The set of filter parameters and the third control option is used to trigger a redetermination of the first set of filter parameters.
In one implementation, fig. 18A is a schematic view showing a display effect of the ANC control list, where the interface shown in (a) in fig. 18A is a first interface 1801, and the first option is an "ANC mode" option 1801a in the first interface. After the user clicks on the "ANC mode" option 1801a in the first interface 1801 shown in fig. 18A, the terminal displays an interface 1802 shown in fig. 18A (b). It can be seen that in interface 1802, an ANC control list 1802a is displayed below the "ANC mode" option, where the first control option in ANC control list 1802a is the "best gear match" option, the second control option is the "adapt parameters generation" option, and the third control option is the "parameters re-match" option. Thus, the user can select the ANC control mode in the ANC control list according to the requirement. Of course, the ANC control list may further include other options for setting a control manner of the ANC, which is specifically determined according to actual requirements, and the embodiment of the present application is not limited.
In another implementation, fig. 18B is a schematic diagram showing another display effect of the ANC control list, where the interface shown in (a) in fig. 18B is a first interface 1803, and the first option is an "ANC mode" option 1803a in the first interface 1803. After the user clicks the "ANC mode" option 1803a in the first interface 1803 shown in fig. 18B (a), the terminal displays the interface 1804 shown in fig. 18B (B), where the interface 1804 includes an ANC control list 1804a, and the ANC control list 1804a includes a "best gear match" option, an "adapt parameter generation" option, and a "parameter re-match" option.
In this embodiment, the step 1601 (i.e. the terminal determines the first set of filtering parameters) may include steps 1601a to 1601c.
1601a, the terminal receives an operation on a first control option in the ANC control list, and displays a first control, where the first control includes N 1 Preset positions, N 1 Corresponding N of preset positions 1 And (5) a group of filtering parameters.
Step 1601b, the terminal receives an operation on a first position in the first control, where the first position is N 1 One of the preset positions.
In this embodiment of the present application, when a set of filter parameters corresponding to the first position is applied to the earphone, the noise reduction effect is better than N 1 Filter parameters corresponding to other preset positions in the preset positions are reduced when the filter parameters are applied to the earphoneNoise effect.
In step 1601c, the terminal determines, in response to the operation on the first location, a set of filter parameters corresponding to the first location as a first set of filter parameters.
In one implementation, fig. 19A is a schematic view of a display effect of the first control, after the user selects the "ANC mode" 1703 in fig. 17, the terminal displays an interface 1901 shown in (a) in fig. 19A (i.e., (b) in fig. 18A), where the interface 1901 includes an ANC control list, and further, after the user selects a first control option in the interface 1901, such as the "best gear match" option 1901a, the terminal displays an interface 1902 shown in (b) in fig. 19A, where the first control 1902a is displayed below the ANC control list. Alternatively, the first control 1902a may be in the shape of a disk (the first control 1902a may also be referred to as a gear disk), the first control 1902a containing a gear adjustment button and N 1 The first set of filter parameters is determined by the gear, and the user then operates in the first control 1902 a.
In another implementation, fig. 19B is a schematic view of another display effect of the first control, after the user selects the "ANC mode" 1703 in fig. 17, the terminal displays an interface 1903 shown in (a) in fig. 19B (i.e., (B) in fig. 18B), where the interface 1903 includes an ANC control list, and further, after the user selects a first control option in the interface 1903, such as the "best gear match" option 1903a, the terminal displays an interface 1904 shown in (B) in fig. 19B, where the interface 1904 includes the first control 1904a. Similarly, the first control 1904a may be in a disc shape, and the first control 1904a includes a gear adjusting button and N 1 The gears, and thus the user, operate in the first control 1904a, determining a first set of filter parameters.
Optionally, after the user selects the "best gear matching" option, the earphone or the terminal executes a matching algorithm to determine a first group of filtering parameters, and presents a gear corresponding to the first group of filtering parameters in a displayed first control, and specifically, a position corresponding to a gear adjusting button in the first control is a gear corresponding to the current first group of filtering parameters. Refer to (B) in fig. 19A and (B) in fig. 19B.
Alternatively, the above N 1 The gears are distributed in a first control, which can be disc-shaped, N 1 The gear positions are arranged in the first control in a disc shape; the first control may also be bar-shaped, then N 1 The gears are arranged in the first control in a strip shape. Of course, the first control may be a control with another shape, which is not limited in the embodiment of the present application.
In this embodiment of the present application, the user slides the gear adjustment button in the first control to make the gear adjustment button traverse N 1 The gears, i.e. traversing N 1 And a preset position. For different gears, the corresponding noise reduction effects are different. If the gear adjusting button is adjusted to the first position, the user feels that the effect of the audio played by the earphone is best, and the user does not adjust the position of the gear adjusting button any more, so that the filter parameter corresponding to the position with the best noise reduction effect perceived by the user is determined as the first group of filter parameters.
In the embodiment of the application, a user operates a first position of a first control to determine a first set of filtering parameters. In combination with the display manner of fig. 19B, as shown in (a) of fig. 20, in one implementation, when the user wears the earphone to listen to audio, the above-described operation on the first position may be an operation in which the user slides the gear adjustment button 2001 to the first position and stays longer than a preset period of time (for example, 10 seconds). For example, when the user slides the gear adjustment button 2003 to the first position, the user listens to the audio currently being played through the earphone, and the user feels that the audio effect of the current audio is good (meets the requirement of the user), the user does not slide the gear adjustment button 2001 any more, and the dwell time of the gear adjustment button 2001 at the first position exceeds 10 seconds, at this time, the terminal detects this operation, and determines, in response to the operation on the first position, that the set of filter parameters corresponding to the first position is the first set of filter parameters.
In combination with the display manner of fig. 19B, as shown in (B) in fig. 20, in another implementation manner, the interface where the first control is located further includes a selection box 2002, and when the user wears the earphone to listen to audio, the operation on the first position may be an operation that after the user slides the gear adjusting button 2003 to the first position, the user selects the "ok" button in the selection box 2002. For example, when the user slides the gear adjustment button 2001 to the first position, the user listens to the audio currently played through the earphone, and the user perceives that the audio effect of the current audio is better (meets the requirement of the user), the user does not slide the gear adjustment button 2001 any more, and the user clicks the determination button in the selection box 2002 to select the current gear as the best gear, at this time, the terminal detects this operation, and determines a set of filter parameters corresponding to the first position as the first set of filter parameters in response to the operation on the first position.
Optionally, in combination with the ANC control list, the acquiring the first set of filtering parameters specifically includes step C1 to step C3.
And C1, the terminal receives the operation of the third control option in the ANC control list.
And C2, the terminal responds to the operation of the third control option and sends a second instruction to the earphone, wherein the second instruction is used for instructing the earphone to acquire the first group of filtering parameters.
It will be appreciated that the first set of filter parameters obtained from the indication of the second instruction is different from the filter parameters employed by the earpiece prior to receiving the second instruction.
In this embodiment of the present invention, in one case, after the first set of filtering parameters are determined, the earphone performs noise reduction based on the first set of filtering parameters, and subsequently, in a process of working the earphone, the user may select to re-determine a set of filtering parameters for noise reduction according to an actual situation (for example, a noise reduction effect of using the first set of filtering parameters cannot meet a requirement of the user), and at this time, may also instruct the earphone to acquire the first set of filtering parameters by sending a second instruction. In another case, the user may also select to redefine the first set of filtering parameters according to the actual requirement in other working phases of the earphone.
And (c) combining the interface shown in (B) in fig. 18A or (B) in fig. 18B, wherein a "parameter re-matching" option in the ANC control list in the interface is the third control option, and if the user clicks the "parameter re-matching" option, the terminal sends a second instruction to the earphone to instruct the earphone to acquire the first set of filtering parameters.
And C3, receiving a second instruction by the earphone, and acquiring a first group of filtering parameters by the earphone.
Optionally, in one manner, the method of obtaining the first set of filtering parameters by the earphone is that the earphone performs a matching algorithm from N 1 A first set of filter parameters is determined from the set of filter parameters. In another manner, the terminal displays an interface including a first control in response to operation of the third control option described above, thereby redefining the first set of filter parameters by operating on the first control.
Referring to fig. 21A, after the user clicks the "parameter re-match" option 2101A in the interface 2101 shown in (a) of fig. 21A, the terminal displays the interface 2102 shown in (b) of fig. 21A, in which the first control 2102a is displayed below the ANC control list, and the user operates in the first control 2102a to re-determine the first set of filtering parameters.
Referring to fig. 21B, after the user clicks the "parameter re-match" option 2103a in the interface 2103 shown in (a) of fig. 21B, the terminal displays the interface 2104 shown in (B) of fig. 21B, where the interface 2104 includes the first control 2104a, and the user performs an operation in the first control 2104a to re-determine the first set of filtering parameters.
Optionally, after the user selects the "parameter re-matching" option, the earphone or the terminal executes a matching algorithm to determine a first group of filtering parameters, and presents a gear corresponding to the first group of filtering parameters in a displayed first control, and specifically, a position corresponding to a gear adjusting button in the first control is a gear corresponding to the current first group of filtering parameters. Refer to (B) in fig. 21A and (B) in fig. 21B.
In this embodiment of the present application, details of acquiring the first set of filtering parameters by the earphone may refer to the related descriptions of the above method embodiments, which are not described herein.
Optionally, the active noise reduction method provided in the embodiment of the present application further includes steps D1 to D2.
And D1, the terminal receives the operation of the third control option in the ANC control list.
And D2, the terminal responds to the operation of the third control option, and the terminal redetermines the first group of filtering parameters.
For a detailed description of step D2, reference is made to the description of step 1601 and related content, which is not repeated here.
Optionally, in conjunction with fig. 16, as shown in fig. 22, the active noise reduction method provided in the embodiment of the present application further includes steps 16015 to 16010.
Step 1605, the headset generates N based at least on the first set of filter parameters and the second set of filter parameters 2 And (5) a group of filtering parameters.
In the embodiment of the present application, the above N 2 The filtering parameters of the second group correspond to different ANC noise reduction intensities respectively, and the filtering parameters of the second group are N pre-stored in the earphone 1 One set of filter parameters; the second set of filtering parameters is used for filtering the signal in N 1 The environmental noise is reduced in a state where the leakage degree is minimum among the leakage states.
For a detailed description of step 1605, reference is made to the description of step 903 (including step 9031) in the above embodiments, and further description is omitted here.
Optionally, in the embodiment of the present application, the user may also operate on the terminal to control the earphone to generate N 2 The active noise reduction method provided by the embodiment of the application further includes steps E1 to E3 after the first set of filter parameters is determined.
And E1, the terminal receives the operation of a second control option of the ANC control list of the terminal.
Step E2, the terminal responds to the operation of the second control option and sends a third instruction to the earphone, wherein the third instruction is used for triggering the earphone to generate N 2 And (5) a group of filtering parameters.
Exemplary, in combination with the interface shown in fig. 18A (B) or fig. 18B (B), the "fit parameter generation" option in the interface is the second control option, and if the user clicks the "fit parameter generation" option, the terminal points to the earThe machine sends a third instruction to trigger the earphone to generate N 2 And (5) a group of filtering parameters.
And E3, receiving a third instruction by the earphone.
In this embodiment, after the earphone receives the third instruction, the earphone generates N according to the first set of filtering parameters and the second set of filtering parameters 2 And (5) a group of filtering parameters. The N is 2 The set of filtering parameters correspond to different ANC noise reduction strengths (e.g., N 2 Group filtering parameters correspond to N 2 Intensity of noise reduction of personal ANC), N 2 The group filtering parameter is N adapted to the ear canal environment of the current user 2 Group filtering parameters, and earphone adopts N 2 The noise reduction strength when the group filtering parameters are used for noise reduction is sequentially enhanced.
In step 1606, the terminal determines the target ANC noise reduction strength.
In one implementation, the terminal may determine the target ANC noise reduction strength based on the state of the current ambient noise. For example, the current environment is relatively quiet, the terminal adaptively selects ANC noise reduction intensity with weaker noise reduction intensity according to the environment noise state; when the current environment is noisy, the terminal adaptively selects ANC noise reduction intensity with stronger noise reduction intensity according to the state of the environmental noise.
In another implementation, after the terminal receives an operation of the second control option of the ANC control list of the terminal, the user may interactively determine the target ANC noise reduction strength with the terminal, and the specific method includes steps 1606a to 1606c.
Step 1606a, the terminal displays a second control, where the second control includes N 2 Preset positions, N 2 Corresponding N of preset positions 2 Noise reduction intensity of seed ANC, N 2 Seed ANC noise reduction intensity corresponds to N 2 And (5) a group of filtering parameters.
Exemplary, in one implementation, referring to fig. 23A, after the user clicks the "fit parameters generation" option 2301a in the interface 2301 shown in fig. 23A, the terminal displays the interface 2302 shown in fig. 23A, in which interface 2302a (gear pad) is displayed below the ANC control list, and in which second control 2302a includes a gear adjustment button and N 2 The gear positionsThe N is 2 The gears correspond to N 2 Preset positions, and the N is 2 Corresponding N of preset positions 2 And (5) a group of filtering parameters. Note that N in the first control illustrated in (b) in fig. 23A 2 The noise reduction intensity of the colors of the gears is sequentially enhanced, N is adopted 2 The environmental noise after noise reduction is carried out on the group filtering parameters is sequentially weakened.
In another implementation, referring to fig. 23B, after the user clicks the "fit parameter generation" option 2303a in the interface 2303 shown in fig. 23B (a), the terminal displays the interface 2304 shown in fig. 23B (B), and a second control 2304a (gear disc) is included in the interface 2304, and the second control 2304a includes a gear adjustment button and N 2 A number of gears, N 2 The gears correspond to N 2 Preset positions, and the N is 2 Corresponding N of preset positions 2 And (5) a group of filtering parameters.
Step 1606b, the terminal receives an operation on a second location in the second control, the second location being N 2 One of the preset positions.
In the embodiment of the present application, the above N 2 Seed ANC noise reduction intensity corresponds to N 2 Group filter parameters, N 2 The set of filter parameters is generated from a first set of filter parameters and a second set of filter parameters. The noise reduction effect of the filtering parameter corresponding to the ANC noise reduction intensity at the second position when the filtering parameter is applied to the earphone is better than N 2 And the noise reduction effect when the filtering parameters corresponding to the ANC noise reduction intensity at other positions in the preset positions are applied to the earphone.
In step 1606c, the terminal determines, in response to the operation on the second location, an ANC noise reduction strength corresponding to the second location as the target ANC noise reduction strength.
In this embodiment, the second control is similar to the first control, and the user slides the gear adjusting button in the second control to make the gear adjusting button traverse N 2 The gears, i.e. traversing N 2 And the preset positions are used for determining the noise reduction strength of the target ANC. The process of determining the noise reduction intensity of the target ANC by operating the second position in the second control by the user and the process of determining the first position in the first control by the userThe process of determining the first set of filtering parameters is similar, and specific reference may be made to fig. 20 and the content of the foregoing embodiments, which are not repeated here.
Optionally, when the earphone or the terminal determines the target ANC noise reduction intensity according to the environmental noise state, a gear corresponding to the target ANC noise reduction intensity is presented in the second control displayed above, and specifically, a position corresponding to the gear adjusting button in the second control is a gear corresponding to the target ANC noise reduction intensity, referring to (B) in fig. 23A and (B) in fig. 23B.
In step 1607, the terminal sends second indication information to the earphone, where the second indication information is used to instruct the earphone to make noise reduction by using a third set of filtering parameters corresponding to the noise reduction strength of the target ANC.
Step 1608, the earphone receives the second indication information from the terminal.
Step 1609, the earphone reduces noise intensity from N according to the target ANC 2 A third set of filter parameters is determined from the set of filter parameters.
In this embodiment of the present application, after the earphone receives the second indication information, the earphone will N 2 The filter parameter indicated by the second indication information in the set of filter parameters is determined as a third set of filter parameters.
Step 16010, the headset performs noise reduction using a third set of filtering parameters.
Optionally, the active noise reduction method provided by the embodiment of the application may be respectively applied to an earphone corresponding to a left ear (hereinafter, abbreviated as a left earphone) and an earphone corresponding to a right ear (hereinafter, abbreviated as a right earphone), so as to implement noise reduction of the left ear and noise reduction of the right ear. Or, the same set of filtering parameters are adopted to respectively perform left ear noise reduction and right ear noise reduction, which is not limited in the embodiment of the present application.
In one case, N is generated from the first and second sets of filter parameters 2 After the set of filtering parameters, from N 2 And determining a third group of filter parameters in the group of filter parameters, denoising the earphone based on the third group of filter parameters, and subsequently, in the working process of the earphone, the user can select to redefine a group of filter parameters for denoising according to actual requirements, namely, the earphone reacquires the first group of filter parameters. Referring to FIG. 18 A or fig. 18B, the user selects the "parameter re-match" option, and the headset will have N in the headset 2 Restoring the group filtering parameters to the above N 1 Group filtering parameters, further from N 1 And re-determining the first group of filter parameters in the group of filter parameters, and carrying out noise reduction by using the first group of filter parameters. Further, optionally, new N can be regenerated based on the redetermined first and second sets of filter parameters 2 Group filter parameters and from N 2 And determining a third group of filtering parameters in the group of filtering parameters, and reducing noise by using the third group of filtering parameters.
In this embodiment, the earphone may also send information to the terminal. For example, after the earphone executes the matching algorithm to determine the first set of filtering parameters or the third set of filtering parameters, the earphone sends indication information to indicate the first set of filtering parameters or the third set of filtering parameters to the terminal, so that the terminal presents a gear corresponding to the first set of filtering parameters in the first control or presents a gear corresponding to the third set of filtering parameters in the second control (i.e. a gear corresponding to the target ANC strength) according to the indication information.
In summary, in the active noise reduction method provided in the embodiment of the present application, after the first set of filtering parameters are determined, N adapted to the current user is generated based on the first set of filtering parameters and the second set of filtering parameters 2 Group filtering parameters, and from the N 2 And a third group of filtering parameters corresponding to the target ANC noise reduction intensity is further determined in the group of filtering parameters, so that noise reduction is performed by adopting the third group of filtering parameters, and the noise reduction effect better meets the requirements of users because the users can select the proper ANC noise reduction intensity according to the state of the environmental noise.
And a third stage: abnormal noise detection and updating of filtering parameters.
Optionally, in this embodiment of the present application, after the first set of filtering parameters or the third set of filtering parameters are determined for the user, during the process that the user continues to use the earphone, the environment where the user is located may change, so that abnormal noise is generated in the ear canal of the user, which will seriously affect the listening experience of the user. Based on this, the active noise reduction method provided in the embodiment of the present application further includes detection and processing of abnormal noise.
As shown in fig. 24, the active noise reduction method provided in the embodiment of the present application further includes steps 2401 to 2404.
Step 2401, detecting whether abnormal noise exists, wherein the abnormal noise includes at least one of the following: howling noise, clipping noise, or background noise.
In this embodiment, when the user uses the earphone, the user starts the active noise reduction function of the earphone (i.e. starts the ANC function of the earphone), or switches the working mode of the earphone to the ANC working mode, so that whether at least one abnormal noise of howling noise, clipping noise or bottom noise exists can be detected in real time in the using process of the earphone, and noise reduction processing is performed.
Optionally, the above abnormal noise may further include other noise such as wind noise, and it should be noted that, the detection method of the abnormal noise is different for different noise types, which will be described in detail in the following embodiments.
Step 2402, updating filtering parameters of the earphone in case of detecting the presence of abnormal noise.
It should be appreciated that the filter parameters of the earphone may be the first set of filter parameters or the third set of filter parameters described above. When the current filter parameters of the earphone are the first group of filter parameters, the first group of filter parameters are updated, and when the current filter parameters of the earphone are the third group of filter parameters, the third group of filter parameters are updated.
It should be noted that, for different types of abnormal noise (such as howling noise, clipping noise, ground noise, and wind noise), different parameters of the filtering parameters may be updated, which will be described in detail in the following embodiments.
Step 2403, collecting sound signals by the reference microphone and the error microphone.
Step 2404, processing the sound signal collected by the reference microphone and the sound signal collected by the error microphone of the earphone based on the updated filtering parameters, to generate an inverse noise signal.
In this embodiment of the present application, the above-mentioned inverse noise signal is used to attenuate an in-ear noise signal of a user, where the in-ear noise signal may be understood as residual noise after the user wears the earphone and environmental noise is isolated by the earphone, and the signal of the residual noise is related to factors such as external environmental noise, the earphone, and the fitting degree between the earphone and the ear canal; after the earphone generates the reverse noise signal, the earphone plays the reverse noise signal, and the phase of the reverse noise signal is opposite to that of the in-ear noise signal of the user, so that the reverse noise signal can weaken the in-ear noise signal of the user, and abnormal noise in the ear is reduced.
In connection with the schematic operation of the earphone shown in fig. 25, the step 2401 of detecting abnormal noise and the step 2402 of updating the filter parameters are executed by the microprocessor of the earphone, and if abnormal noise is detected, the ANC chip executes the noise reduction process (step 2404). It should be understood that, in the embodiment of the present application, the noise reduction processing of the ANC chip includes processing of a signal of the feedforward path (i.e., a sound signal collected by the reference microphone), processing of a signal of the feedback path (i.e., a signal collected by the error microphone), and processing of a signal of the downstream compensation path (i.e., downstream audio).
According to the active noise reduction method, the earphone can detect abnormal noise, noise reduction processing is conducted on the abnormal noise, interference of the abnormal noise is weakened, stability of the earphone is improved, and listening experience of a user can be improved.
The abnormal noise detection process and the noise signal processing process are described in detail below from the viewpoints of howling noise, clipping noise, background noise, and wind noise, respectively.
As for howling noise, as shown in fig. 26, the method of detecting whether howling noise is present specifically includes steps 2601 to 2602.
Step 2601, a first signal is acquired by an error microphone of the headset.
In this embodiment of the present application, after the first signal is collected, the first signal is downsampled by using a frequency of 16KHz, and then howling noise detection is performed according to the first signal.
Step 2602, determining that howling noise exists if the energy peak of the first signal is greater than a first threshold; in the case where the energy peak of the first signal is less than or equal to the first threshold, it is determined that howling noise is not present.
The energy peak value of the first signal is an energy value corresponding to the peak frequency of the first signal.
In the embodiment of the application, after the first signal is acquired by the error microphone, a minimum mean square algorithm (least mean square, LMS) is adopted to determine the peak frequency of the first signal within a set howling detection frequency range (e.g., 500Hz-7000 Hz). If the peak frequency of the first signal is within the howling detection frequency range, calculating an energy peak value of the first signal, that is, energy corresponding to the peak frequency of the first signal by adopting a lattice-zel algorithm, so as to determine whether howling noise exists or not based on the energy peak value of the first signal.
In this embodiment, the signal of the error microphone (i.e., the first signal) is denoted as err, and the first signal is first subjected to high-pass filtering: err (r) hp =H hp * err, where H hp Err is the transfer function of the high-pass filter (determined according to the actual situation) hp Is the filtered first signal. The low frequency cut-off frequency of the high pass filter depends on the howling minimum frequency, e.g. 600Hz.
Secondly, determining the peak frequency of the first signal by adopting an LMS algorithm on the filtered first signal, and specifically enabling the coefficient error function e (n) to be minimum:
e(n)=err hp (n)+h 1 (n)*err hp (n-1)+err hp (n-2)
wherein, the liquid crystal display device comprises a liquid crystal display device,h 1 (L)=-2*cos(w m ) N is the nth sample data of the current frame, n is less than or equal to L, and L is the number of the sample data contained in the current frame.
Sequentially iterating each sample point of the current frame by using an LMS algorithm, and iterating to obtain the frequency w obtained after L sample points m I.e. the peak frequency converged for the current frame, i.e. the firstPeak frequency of the signal. It will be appreciated that keeping the peak frequency of the current frame as the initial frequency of the next frame, continuing to update the next frame may result in the peak frequency of the next frame, and so on.
If the peak frequency of the first signal is within the howling detection frequency range, calculating an energy peak value of the first signal, that is, energy corresponding to the peak frequency of the first signal by adopting a lattice-zel algorithm, so as to determine whether howling noise exists or not based on the energy peak value of the first signal.
Specifically, the peak energy of the first signal is recorded asThen +.>
s(n)=err hp (n)-h 1 (L)*s(n-1)-s(n-2)
Wherein n is the nth sample data of the current frame, n is less than or equal to L, and L is the number of the sample data contained in the current frame.
Sequentially iterating each sample point of the current frame through a Gezel algorithm to obtain s (L), s (L-1), and further calculating to obtain the peak energy of the first signal
Alternatively, as shown in fig. 27, the method of detecting whether howling noise exists specifically includes steps 2701 to 2702.
Step 2701, an inverse noise signal is acquired.
Similarly, the reverse noise signal is downsampled by adopting the frequency of 16KHz, and then howling noise detection is carried out according to the reverse noise signal.
Step 2702, determining that howling noise exists if an energy peak of the reverse noise signal is greater than a second threshold; in the case where the energy peak value of the reverse noise signal is less than or equal to the second threshold value, it is determined that howling noise is not present.
The energy peak value of the reverse noise is the energy value corresponding to the peak frequency of the reverse noise signal.
It should be appreciated that the method for determining the peak frequency and the energy peak of the inverted noise signal is similar to the method for determining the peak frequency and the energy peak of the first signal, and the detailed description of step 2602 is omitted herein.
Fig. 28 is a schematic diagram illustrating the operation principle of howling detection and noise reduction, and fig. 28 is referred to for understanding the active noise reduction method described in the present application.
In the case where the presence of howling noise is detected, the above method of updating the filter parameters specifically includes steps 24021a to 24021c.
Step 24021a, determining the type of howling noise according to the first signal collected by the error microphone and the second signal collected by the reference microphone.
Alternatively, the type of howling noise may also be determined from the inverted noise signal and the second signal. In this embodiment of the present application, the howling noise includes howling noise caused by a feedback path and howling noise caused by a feedforward path, for convenience of description, the howling noise caused by the feedback path is referred to as a first howling noise, the howling noise caused by the feedforward path is referred to as a second howling noise, and types of the howling noise include the first howling noise and the second howling noise.
In the embodiment of the present application, the peak frequency of the first signal collected by the error microphone is recorded as a first frequency, and when the ratio of the energy of the error signal of the first signal at the first frequency to the energy of the error signal of the second signal at the first frequency is smaller than a preset threshold, the type of howling noise is determined to be the first howling noise; and when the ratio of the energy of the first signal error signal at the first frequency to the energy of the second signal at the first frequency is greater than or equal to a preset threshold value, determining that the type of the howling noise is the second howling noise.
Step 24021b, when the howling noise is the first howling noise, reducing the gain of the feedback path in the filtering parameter, where the first howling noise is the howling noise caused by the feedback path.
It will be appreciated that when howling noise is caused by the feedback path, updating the filtering parameter refers to reducing the gain of the feedback path, for example, updating the gain of the feedback path to 0, or reducing the gain of the feedback path according to actual requirements, which is not limited in the embodiments of the present application.
Step 24021c, when the howling noise is the second howling noise, reducing the gain of the feedforward path in the filtering parameter, wherein the second howling noise is the howling interference caused by the feedforward path.
It will be appreciated that when howling noise is caused by the feedforward path, updating the filtering parameter refers to reducing the gain of the feedforward path, for example, updating the gain of the feedforward path to 0, or reducing the gain of the feedforward path according to actual requirements, which is not limited in the embodiments of the present application.
Alternatively, in the case where the presence of howling noise is detected, the method for updating the filtering parameters described above specifically includes step 24022.
Step 24022, reducing the gain of the feedforward path and the gain of the feedback path in the filtering parameters.
In this embodiment, in a convenient implementation manner, in the case where the existence of howling noise is detected, it is not necessary to determine whether the howling noise is caused by the feedback path or the feedforward path, but the gain of the feedforward path and the gain of the feedback path are reduced in parallel.
Alternatively, the gain of the feedforward path and the gain of the feedback path may be reduced by the same magnitude (or multiple), e.g., the gain of the feedforward path is reduced to 0.8 times the original gain, and the gain of the feedback path is also reduced to 0.8 times the original gain. Of course, the gain of the feedforward path and the gain of the feedback path may be reduced by different magnitudes (or multiples), for example, the gain of the feedforward path is reduced to 0.8 times the original gain, and the gain of the feedback path is also reduced to 0.6 times the original gain. The embodiment of the application is not limited, and is specifically determined according to actual requirements.
In one implementation, in the case where the presence of howling noise is detected, the gain of the feedforward path and the gain of the feedback path may be updated (reduced) instead of the gain of the ANTI signal (i.e., the sum of the output signal of the feedforward path and the output signal of the feedback path), for example, the gain of the ANTI signal may be updated to 0.
Based on the reduced gain of the feedforward path and/or the reduced gain of the feedback path, signals of the feedforward path (i.e. sound signals collected by the reference microphone) and/or signals of the feedback path (i.e. sound signals collected by the error microphone) are processed to generate reverse noise signals, so that howling noise in the auditory canal is reduced, interference of abnormal noise can be reduced, stability of the earphone is improved, and listening experience of a user is further improved.
As for the clip noise, as shown in fig. 29, the method of detecting whether clip noise is present specifically includes steps 2901 to 2902.
Step 2901, acquiring a first signal through an error microphone of the headset, or acquiring a second signal through a reference microphone of the headset.
Similarly, after the first signal or the second signal is collected, the first signal or the second signal is downsampled by adopting a frequency of 16 KHz.
Step 2902, determining that clipping noise exists when the number of first target frames is greater than a preset number or the number of second target frames is greater than a preset number within a preset time period; and determining that clipping noise exists in the case that the number of the first target frames is less than or equal to a preset number or the number of the second target frames is less than or equal to a preset number within a preset time period.
The first target frame is a signal frame with energy greater than a third threshold value in signal frames contained in the first signal, and the second target frame is a signal frame with energy greater than a fourth threshold value in signal frames contained in the second signal.
It should be noted that, in the embodiment of the present application, the clipping noise refers to low-frequency clipping noise, after the earphone collects the first signal or the second signal, the first signal or the second signal is subjected to low-pass filtering, and the high-frequency spurious signals in the first signal or the second signal are filtered, so that the accuracy of the first signal and the second signal is improved, and the accuracy of detecting whether the clipping noise exists is also improved.
Alternatively, the preset time period may be 100 ms, 200 mm, 500 ms, etc., and the duration of the preset time period may be adjusted according to the actual situation, which is not limited in the embodiment of the present application.
Alternatively, the first target frame may be a signal frame in which a maximum value of signals in the signal frames included in the first signal is greater than a certain preset threshold, and the second target frame may be a signal frame in which a maximum value of signals in the signal frames included in the second signal is greater than a certain preset threshold.
Fig. 30 is a schematic diagram illustrating the working principle of clipping detection and noise reduction, and the active noise reduction method described in the present application will be understood with reference to fig. 30.
In the case where the presence of clipping noise is detected, the above method for updating the filter parameters specifically includes steps 24023a to 24023b.
Step 24023a, determining an index corresponding to the current filtering parameter, where the index is an index of the current filtering parameter in the first filtering parameter set.
It should be understood that the index corresponding to the current filtering parameter refers to the index of the current filtering parameter in the preset plurality of sets of filtering parameters, and the plurality of sets of filtering parameters may be N as described above 1 Group filter parameters or N 2 Group filter parameters, N 1 The group filter parameters form a first filter parameter set, N 2 The set of filter parameters constitutes a second set of filter parameters.
Step 24023b, updating the filter parameters corresponding to the feedforward path and/or the filter parameters corresponding to the feedback path in the filter parameters by using the filter parameters corresponding to the index in the third filter parameter set.
The third filtering parameter set includes filtering parameters corresponding to a plurality of groups of feedforward paths and/or filtering parameters corresponding to a plurality of groups of feedback paths.
In the above embodiment, if the current filter parameter is the 3 rd set of filter parameters of the 9 sets of filter parameters included in the first filter parameter set, the index of the filter parameter is 3, so that the filter parameter corresponding to the feedforward path and/or the filter parameter corresponding to the feedback path in the current filter parameter is replaced by some or all of the filter parameters corresponding to the feedforward path and/or the filter parameters corresponding to the feedback path in the third set of filter parameters in the third filter parameter set.
As for the background noise, as shown in fig. 31, the method of detecting whether or not background noise is present specifically includes steps 3101 to 3103.
Step 3101, a second signal is acquired through a reference microphone of the headset.
Similarly, after the second signal is collected, the second signal is downsampled with a frequency of 16 KHz.
Step 3102, performing noise floor tracking on the second signal to obtain an environmental noise signal.
In the embodiment of the application, the second signal is used as an input of a noise floor tracking (noise floor tracking, NFT) algorithm, so as to output the sound pressure level of the environmental noise signal. For a detailed description of NFT algorithms reference is made to the prior art and will not be described in detail here.
Step 3103, determining that a background noise exists if the sound pressure level of the ambient noise signal is less than or equal to a fifth threshold; in the case where the sound pressure level of the environmental noise is greater than the fifth threshold, it is determined that there is no background noise.
It will be appreciated that the sound pressure level of the ambient noise signal is less than or equal to the fifth threshold, indicating that the environment is relatively quiet, and that the user is able to perceive the background noise when the environment is quiet, i.e., the background noise can be detected when the environment is sufficiently quiet. Therefore, in the embodiment of the present application, in the case where the sound pressure level of the environmental noise signal is less than or equal to the fifth threshold value, it is determined that there is a background noise, and it is necessary to reduce the background noise.
Fig. 32 is a schematic diagram illustrating the working principle of the noise floor detection and noise reduction process, and the active noise reduction method described in the present application is understood with reference to fig. 32.
In the case that the existence of the noise floor is detected, the method for updating the filtering parameters specifically includes step 24024.
Step 24024, reducing the gain of the feedforward path and the gain of the feedback path in the filtering parameters.
In this embodiment of the present application, the gain of the feedforward path and the gain of the feedback path have a linear relationship with the environmental noise signal, respectively, and the gain of the feedforward path and the gain of the feedback path change with a smooth change of the sound pressure level of the environmental noise signal, specifically, the smaller the sound pressure level of the environmental noise signal, the smaller the gain of the feedforward path and the gain of the feedback path. After the environmental noise signal is determined, the gain of the feedforward path and the gain of the feedback path are determined according to the linear relation between the gain of the feedforward path and the gain of the feedback path and the environmental noise signal.
As for wind noise, as shown in fig. 33, the method for detecting whether wind noise exists specifically includes steps 3301 to 3302.
In step 3301, a second signal is collected through a reference microphone of the headset, and a third signal is collected through a talk microphone of the headset.
In this embodiment of the present application, after the second signal and the third signal are collected, the second signal and the third signal are downsampled by using a frequency of 16 KHz.
Step 3302, determining that wind noise interference exists if the correlation between the second signal and the third signal is less than a sixth threshold; in the case where the correlation between the second signal and the third signal is greater than or equal to the sixth threshold, it is determined that wind noise interference is not present.
In this embodiment of the present application, fourier transforms are performed on the second signal and the third signal, and then, the correlation between the second signal and the third signal is calculated by a correlation function (an existing correlation calculation method), so as to determine whether there is wind noise based on the magnitude of the correlation. It should be appreciated that wind noise detection results in either no wind or wind.
Fig. 34 is a schematic diagram illustrating the working principle of wind noise detection and noise reduction, and the active noise reduction method described in the present application is understood with reference to fig. 34.
In the case that wind noise is detected, the method for updating the filtering parameters specifically includes steps 24025a to 24025c.
Step 24025a, analyzing the energy of the second signal to determine a level of wind noise interference.
In one implementation of the embodiments of the present application, the level of wind noise interference may include a light wind or a heavy wind.
Alternatively, two preset thresholds, for example, a first preset threshold and a second preset threshold, may be set, the first preset threshold being smaller than the second preset threshold, no wind being determined when the energy of the second signal is smaller than or equal to the first preset threshold, the level of wind noise interference being a small wind when the energy of the second signal is greater than the first preset threshold and smaller than the second preset threshold, and the level of wind noise interference being a large wind when the energy of the second signal is greater than or equal to the second preset threshold.
Step 24025b, monitoring the level of wind noise interference, and determining the corresponding wind noise control state.
After determining the wind noise interference level in step 24025a, the change condition of the wind noise interference level is monitored to determine the wind noise control state. Alternatively, the wind noise control state may include one of the following (11): the wind-free state, the wind-free wind-in small wind state, the wind-small wind-in big wind state, the wind-big wind-in small wind-in again, the wind-small wind-in wind-free state, the wind-small wind-in small wind-out state, the wind-small wind-holding state, the wind-big wind-small wind-back state or the wind-small wind-free back state.
As shown in table 1, the above 10 wind noise control states are respectively numbered so as to update the filter parameters in accordance with the wind noise control states.
TABLE 1
State numbering Status of
0 No wind state
1 No wind entering small wind state
2 Small wind and large wind entering state
3 Big wind and small wind entering state
4 Big wind enters small wind and then enters big wind
5 Small wind entering no wind state
6 Small wind entering no wind and small wind entering again
7 Keeping state of breeze
8 High wind holding state
9 Rollback state from strong wind to small wind
10 Low wind to no wind rollback state
The 11 wind noise control state described above can also be illustrated by fig. 35.
Step 24025c, updating the filter parameters corresponding to the feedforward path in the filter parameters by using the filter parameters corresponding to the noise control state in the fourth filter parameter set.
The fourth filtering parameter set comprises filtering parameters corresponding to the feedforward paths respectively corresponding to the various wind noise control states.
The filter parameters corresponding to the feedforward path may be parameters of the low-frequency shelf filter in the feedforward path, including a center frequency and a gain of the low-frequency shelf filter.
In combination with the above 11 wind noise control transitions, in the noise reduction process (may also be referred to as a wind noise control process), in order to ensure a smooth transition of wind noise control, the filtering parameters corresponding to the foregoing feedforward path change smoothly with time. For example, wind noise control is performed using one set of filter parameters during a set period of time, and wind noise control is performed using another set of filter parameters during another set period of time.
Taking the example that the filtering parameters corresponding to the previous feed-through are parameters of the low-frequency shelf filter, in conjunction with fig. 36, the embodiment of the application provides a parameter design scheme of the low-frequency shelf filter, and referring to fig. 35 and fig. 36, the filtering parameters corresponding to the 11 different wind noise control states can be determined. For example, referring to fig. 36, for a state in which a light wind becomes a heavy wind, wind noise control is performed in a manner of a smooth transition of parameters within 50 milliseconds, for example, within the 500 milliseconds, signals of the feedforward path are processed as parameters of the low-frequency shelf filter using center frequencies and gains (712 Hz, -11.2 dB), (1024 Hz, -12.4 dB), (1544 Hz, -14.4 dB), (2272 Hz, -17.2 dB), and (3000 Hz, -20 dB) in this order. For another example, for a state where a strong wind is maintained, the signal of the feed-forward path is processed with a gain of-140 dB at the full band for 30 seconds. For another example, for a windless condition, the low frequency shelf filter is updated to a pass filter.
It should be understood that, in a preset wind noise control period (for example, 500 ms), the control duration corresponding to each set of center frequency and gain may be set, which is specifically determined according to practical situations, and the embodiments of the present application are not limited.
Taking the wind noise control state determined in the step 2045b as the state 2 (the small wind and large wind state) in the table 1 as an example, 50 milliseconds (712 Hz, -11.2 dB), (1024 Hz, -12.4 dB), (1544 Hz, -14.4 dB), (2272 Hz, -17.2 dB) are taken as the filter parameters corresponding to the updated feedforward path.
Taking the case that the wind noise control state determined in the above step 2045b is the state 4 (the state of large wind entering small wind and then large wind) in the above table 1, the center frequency and gain are (712 Hz, -11.2 dB), (1024 Hz, -12.4 dB), (1544 Hz, -14.4 dB), (2272 Hz, -17.2 dB) and (1544 Hz, -14.4 dB), (1180 Hz, -13 dB), (1024 Hz, -12.4 dB), (868 Hz, -11.8 dB), (712 Hz, -11.2 dB), (556 Hz, -10.6 dB) and 500 ms, respectively, as the filter parameters corresponding to the updated feedforward path, 20 seconds, (3000 Hz, -20 dB), (2636 Hz, -18.6 dB), (2272 Hz, -17.2 dB) and (3000 Hz), (20 dB) are sequentially used. Specifically, the signals of the feedforward path are processed in the first 20 seconds by adopting (3000 Hz, -20 dB), (2636 Hz, -18.6 dB), (2272 Hz, -17.2 dB), (1908 Hz, -15.8 dB), (1544 Hz, -14.4 dB), (1180 Hz, -13 dB), (1024 Hz, -12.4 dB), (868 Hz, -11.8 dB), (712 Hz, -11.2 dB), (556 Hz and-10.6 dB) in sequence; the signals of the feed-forward path are then processed in the following 500 milliseconds, using (712 Hz, -11.2 dB), (1024 Hz, -12.4 dB), (1544 Hz, -14.4 dB), (2272 Hz, -17.2 dB), (3000 Hz, -20 dB) in sequence after the expiration of the above 20 seconds.
Similarly, filtering parameters corresponding to different wind noise control states can be determined by combining with fig. 36, which are not listed in the embodiment of the present application.
In this embodiment of the present application, the headphones include headphones corresponding to a left ear and headphones corresponding to a right ear, and in the following embodiment, the headphones corresponding to the left ear are simply referred to as left headphones, and the headphones corresponding to the right ear are referred to as right headphones). When the user uses the earphone, the user can wear one earphone (a left earphone or a right earphone) or can wear two earphones (the left earphone and the right earphone). It should be understood that the left and right earphones have similar hardware structures, each having a corresponding microphone, ANC chip, microprocessor, etc., and perform active noise reduction methods during noise reduction, respectively.
When the left ear and the right ear of the user wear the earphone respectively, because wind noise has randomness, wind noise characteristics of the left earphone and the right earphone are different, wind noise levels of the left ear and the right ear are possibly different, so that hearing of the left ear and hearing of the right ear are inconsistent, and user experience is affected. Based on this, the active noise reduction method provided in the embodiment of the present application further includes: and synchronously controlling wind noise of the left ear and the right ear of the user. Specifically, according to the steps 24025a to 24025b, the wind noise control state corresponding to the left ear and the wind noise control state corresponding to the right ear are determined respectively, and then the wind noise control state corresponding to the left ear and the wind noise control state corresponding to the right ear are synchronized, so that the filtering parameters are updated according to the synchronized wind noise control states, the left earphone performs the noise reduction process based on the filtering parameters, and the right earphone also performs the noise reduction process based on the filtering parameters.
Optionally, the method for synchronizing the wind noise control state corresponding to the left ear and the wind noise control state corresponding to the right ear specifically includes: and according to the priority of the wind noise control states, adjusting the wind noise control state with low priority to the wind noise control state with high priority in the wind noise control state corresponding to the left ear and the wind noise control state corresponding to the right ear.
In this embodiment of the present application, the left earphone and the right earphone may communicate with each other through bluetooth, detect the condition that wind noise control state changes at the left earphone and the right earphone detect wind noise control state, and the left earphone and the right earphone notify the respective wind noise control state of each other respectively, and then carry out wind noise control state synchronization according to the above-mentioned priority policy. Alternatively, in the 6 wind noise control states shown in table 2 below, the wind noise control states of the left ear and the right ear need to be synchronized, that is, when the wind noise control state corresponding to the left earphone or the right earphone is any one of table 2, the respective wind noise control states need to be sent to the other party for synchronization.
TABLE 2
State numbering Status of
1 No wind enters small wind
2 Small wind entering large wind
3 Big wind entering small wind
4 Big wind enters small wind and then big wind enters
5 Small wind entering without wind
6 Small wind enters without wind and then enters small wind
In combination with table 2, in one implementation, the priorities of the 6 wind noise control states are, in order from high to low: 2. 4, 3, 6, 1, 5. When one earphone enters a high-priority wind noise control state, the other earphone synchronously enters the wind noise control state, for example, the wind noise control state (state number) corresponding to the left earphone is 4, the left earphone sends the wind noise control state 4 to the right earphone, and if the wind noise control state corresponding to the right earphone is 1, the wind noise control state corresponding to the right earphone needs to be changed into 4, namely, the wind noise control state corresponding to the right earphone is kept synchronous.
Note that, in the wind noise control state 3 (the large wind enters the small wind) and the wind noise control state 4 (the large wind enters the small wind and then enters the large wind), the priority of the wind noise control state 3 may be the same as that of the wind noise control state 4, for example, if the left ear enters the wind noise control state 3 first and the right ear enters the wind noise control state 4 later, the priority of the wind noise control state 3 is the same as that of the wind noise control state 4, so that the left ear and the right ear keep the respective wind noise states without synchronization. Similarly, for the above-described wind noise control state 1 (no wind entering small wind) and wind noise control state 6 (small wind entering no wind entering small wind again), the priority of the wind noise control state 1 may be the same as that of the wind noise control state 6.
As can be seen from the description of the above embodiments, after an application (App) corresponding to the headset is installed on the terminal, and a user opens the application and establishes a communication connection with the headset (left headset and/or right headset), the user may perform a corresponding operation on the terminal to control the headset to operate in different operation modes, for example, to enable the headset to operate in the ANC operation mode.
Optionally, in one implementation, when the earphone is operated in the ANC operation mode, a different noise reduction mode may be further selected in the ANC operation mode. For example, the user may turn on one or more of the above-mentioned howling noise, clipping noise, base noise, or wind noise control modes according to the environmental characteristics in which the user is currently located. For example, a user is currently on a hillside with a large wind, and the user may turn on the wind noise control mode to detect wind noise and make noise reduction.
For example, in conjunction with fig. 17, after the user turns on the ANC function of the earphone, the terminal may further display a setting interface in the ANC operation mode, where the setting interface includes at least an option set by the ANC control manner and an option set by the noise reduction mode in the foregoing embodiment, with reference to interface 3701 shown in (a) in fig. 37. Alternatively, when the user selects an option set by the ANC control method, the terminal displays the interface shown in (B) in fig. 18A or (B) in fig. 18B in the above-described embodiment. Alternatively, when the user selects the option of the noise reduction mode setting, the terminal displays an interface 3702 shown in (b) of fig. 37, where the interface 3702 includes options of different noise control modes, for example, an interface 3702 includes a "howling control mode" option 3702a, a "clipping control mode" option 3702b, a "bottom noise control mode" option 3702c, and a "wind noise control mode" option 3702d, and when the user selects the "wind noise control mode" option 3702d in the interface 3702, for example, the user clicks the "wind noise control mode" option 3702d, the earphone performs wind noise detection and noise reduction processing. Of course, the user can simultaneously start one control mode or a plurality of control modes according to actual requirements.
Optionally, the active noise reduction method provided in the embodiment of the present application further includes: the terminal displays a noise detection result, wherein the noise detection result comprises at least one of the following: howling noise, clipping noise, background noise, or wind noise.
In this embodiment of the present invention, after detecting abnormal noise, the earphone sends indication information to the terminal to indicate the type of the abnormal noise, and then the terminal displays the noise detection result.
Optionally, in an implementation manner, after the ANC operation mode of the earphone is started, the terminal may further display a setting list in the ANC operation mode, where the setting list includes at least an option set by an ANC control manner and an option set by an ANC noise reduction mode in the foregoing embodiment, and may further include a view option of a noise detection result. For example, as shown in fig. 38, after the user turns on the ANC operation mode, the terminal displays an interface 3801 as shown in (a) in fig. 38, and a "noise reduction mode setting" option and a "noise detection result" option are displayed below the "ANC mode" option in the interface 3801. When the user selects the "noise detection result" option, the terminal displays an interface 3802 shown in (b) in fig. 38, and the type of noise currently detected is displayed in the interface 3802, for example, the current noise type is detected as howling noise.
Optionally, the active noise reduction method provided in the embodiment of the present application further includes: the terminal displays an index corresponding to the filtering parameter, wherein the index is an index of the current filtering parameter in a preset filtering parameter set.
In the embodiment of the present application, the index of the filtering parameter may be embodied by different gears, for example, the filtering parameter includes N 1 Each gear corresponds to different filtering parameters. Alternatively, the gear of the filtering parameter is displayed in a disc shape on the terminal, or in a bar shapeThe form display may be displayed in other forms, and the embodiments of the present application are not limited.
The earphone detects that abnormal noise exists, updates the filtering parameters on the basis of the initialized set of filtering parameters, and displays the index (i.e. the gear) of the updated filtering parameters through the display screen of the terminal, so that a user can intuitively know the current noise reduction condition (e.g. fig. 20).
Accordingly, an embodiment of the present application provides a headset, as shown in fig. 39, including an acquisition module 3901 and a processing module 3902. The obtaining module 3901 is configured to obtain a first set of filtering parameters when the earphone is in an ANC working mode; the first set of filtering parameters is N pre-stored by the earphone 1 One of the sets of filtering parameters, for example, the acquisition module 3901, is used to perform step 901 in the method embodiment described above. The processing module 3902 is configured to reduce noise using the first set of filter parameters, e.g., the processing module 3902 is configured to perform step 902 in the method embodiment described above.
Optionally, the earphone provided by the embodiment of the present application further includes a generating module 3903, a determining module 3904, a receiving module 3905, a first signal collecting module 3906, a second signal collecting module 3907, a detecting module 3908, and an updating module 3909. The generating module 3903 is configured to perform the steps 903 (including step 9031) and 1605 in the method embodiment described above. The determining module 3904 is configured to perform steps 905, 1002 to 1004, 1102 to 1105, 1202 to 1204, 1302 to 1304, 1402 to 1403, and 1609 in the above method embodiments. The receiving module 3905 is configured to perform step 1603 and step 1608 in the above embodiments. The first signal acquisition module 3906 is configured to perform steps 1001, 1101, 1201, 1301, 2403, etc. in the above method embodiments. The second signal acquisition module 3907 is configured to perform steps 1101, 1201, 1301, 2403, etc. in the above method embodiments. The detection module 3908 is configured to update the first set of filtering parameters, e.g., the detection module 3908 is configured to perform step 2401 of the method embodiments described above. The updating module 3909 is configured to perform step 2402 of the method embodiment described above.
The above respective modules may also perform other related actions in the above method embodiments, for example, the obtaining module 3901 is further configured to perform the steps 904 and 1401, and the processing module 3902 is further configured to perform the steps 906, 1604, 16010, and 2404, which are specifically referred to the description of the above embodiments and are not repeated herein.
Similarly, the embodiment of the apparatus depicted in fig. 39 is merely illustrative, e.g., the division of the above-described units (or modules), merely a logical functional division, there may be additional divisions of actual implementations, e.g., multiple units or components may be combined or may be integrated into another system, or some features may be omitted or not performed. The functional units in the embodiments of the present application may be integrated in one module, or each module may exist alone physically, or two or more units may be integrated in one module. The above-described modules in fig. 39 may be implemented in hardware or in software functional units. For example, when implemented in software, the acquisition module 3901, the processing module 3902, the generation module 3903, the determination module 3904, the detection module 3908, and the update module 3909 may be implemented as software functional modules that are generated after the program codes stored in the memory are read by the processor of the headset. The above-mentioned various modules may also be implemented by different hardware of the headset, e.g., the acquisition module 3901, the generation module 3903, the determination module 3904, the detection module 3908, and the update module 3909 are implemented by a portion of the processing resources (e.g., one or both cores of a multi-core processor) in a microprocessor (e.g., MCU 102 in fig. 1) of the headset, and the processing module 3902 is implemented by an ANC chip (e.g., ANC chip 103 in fig. 1) of the headset. Referring to fig. 1, the first signal acquisition module 3906 is implemented by an error microphone of the headset, the second signal acquisition module 3907 is implemented by a reference microphone of the headset, and the receiving module 3905 is implemented by a network interface of the headset, or the like. It is obvious that the above-mentioned functional modules may also be implemented by combining software and hardware, for example, the detecting module 3908 and the updating module 3909 are software functional modules generated after the CPU reads the program codes stored in the memory.
For further details of the implementation of the above functions by the modules comprised in the headset, reference is made to the description of the various method embodiments described above, which are not repeated here.
In this specification, each embodiment is described in a progressive manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments.
The embodiment of the application also provides a terminal, as shown in fig. 40, which includes a determining module 4001 and a transmitting module 4002. The determining module 4001 is configured to determine a first set of filter parameters; the first set of filtering parameters is N pre-stored by the earphone 1 One of the sets of filtering parameters, for example, the determining module 4001, is configured to perform step 1601 in the above method embodiment, and specifically includes steps 16011b to 16011e, 16012b to 16012e, 16013b to 16013e, 16014b to 16014d, or 16015b to 16015d. The sending module 4002 is configured to send first indication information to the headset, where the first indication information is configured to instruct the headset to perform noise reduction with the first set of filtering parameters, for example, the sending module 4002 is configured to perform step 1602 in the method embodiment described above.
Optionally, the terminal provided in the embodiment of the present application further includes a receiving module 4003, an obtaining module 4004, and a display module 4005. The receiving module 4003 is configured to perform steps 16011a, 16012a, 16013a, 16014a, 16015 b, 1606b, and the like in the above-described method embodiment. The acquisition module 4004 is configured to perform step 16011a, step 16012a, step 16013a, step 16015a, and the like in the method embodiment. The display module 4005 is configured to perform step 1601a, step 1606a, and the like in the method embodiment.
The above respective modules may also perform other related actions in the above method embodiments, for example, the determining module 4001 is further configured to perform step 1601c, step 1606c, etc., and the transmitting module is further configured to perform step 1607, which is specifically referred to the description of the above embodiments and is not repeated herein.
Similarly, the embodiment of the apparatus depicted in fig. 40 is merely illustrative, and for example, the division of the units (or modules) is merely a logical function division, and may be implemented in other manners, such as multiple units or components may be combined or integrated into another system, or some features may be omitted, or not performed. The functional units in the embodiments of the present application may be integrated in one module, or each module may exist alone physically, or two or more units may be integrated in one module. The above-described modules in fig. 40 may be implemented in hardware or in software functional units. For example, when implemented in software, the determination module 4001 and the acquisition module 4004 may be implemented as software functional modules that are generated by a processor of the terminal after reading program codes stored in a memory. The modules may also be implemented by different hardware of the terminal, for example, the determining module 4001 may be implemented by a part of processing resources in a processor of the terminal (for example, one core or two cores in a multi-core processor), or may be implemented by a programmable device such as a field-programmable gate array (field-programmable gate array, FPGA) or a coprocessor. The transmission module 4002 and the reception module 4003 are implemented by a network interface or the like of the terminal. The display module 4005 is implemented by a display screen of the terminal.
For more details on the implementation of the above functions by the modules of the above terminal, reference is made to the description of the foregoing method embodiments, which is not repeated here.
In this specification, each embodiment is described in a progressive manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments.
In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using a software program, it may be wholly or partly implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, the processes or functions in accordance with embodiments of the present application are produced in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by a wired (e.g., coaxial cable, fiber optic, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device including one or more servers, data centers, etc. that can be integrated with the available medium. The usable medium may be a magnetic medium (e.g., floppy disk, magnetic tape), an optical medium (e.g., digital video disc (digital video disc, DVD)), or a semiconductor medium (e.g., solid state disk (solid state drives, SSD)), or the like.
From the foregoing description of the embodiments, it will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of functional modules is illustrated, and in practical application, the above-described functional allocation may be implemented by different functional modules according to needs, i.e. the internal structure of the apparatus is divided into different functional modules to implement all or part of the functions described above. The specific working processes of the above-described systems, devices and units may refer to the corresponding processes in the foregoing method embodiments, which are not described herein.
In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods may be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the modules or units is merely a logical functional division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be embodied essentially or in part or all of the technical solution or in part in the form of a software product stored in a storage medium, including instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor to perform all or part of the steps of the methods described in the various embodiments of the present application. And the aforementioned storage medium includes: flash memory, removable hard disk, read-only memory, random access memory, magnetic or optical disk, and the like.
The foregoing is merely a specific embodiment of the present application, but the protection scope of the present application is not limited thereto, and any changes or substitutions within the technical scope of the present disclosure should be covered in the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (59)

1. An active noise reduction method, applied to an earphone with an active noise reduction ANC function, the method comprising:
when the headset is in an ANC mode of operation,
acquiring a first group of filtering parameters; the first set of filtering parameters is determined according to in-ear cues, ambient noise and/or subjective listening experience of the user, and the first set of filtering parameters is N pre-stored in the earphone 1 One set of filter parameters; the N is 1 The group filtering parameters are respectively used for N 1 Environmental noise reduction is carried out in the leakage state; the N is 1 The leakage state is formed by the earphone and N 1 Formed by different ear canal environments; the noise reduction effect of the earphone when the first group of filtering parameters are applied is better than that of the earphone when the N is applied aiming at the same environmental noise in the current wearing state of the earphone 1 Noise reduction effect when other filtering parameters in the group of filtering parameters; n (N) 1 Is a positive integer greater than or equal to 2;
noise reduction is performed by using the first set of filtering parameters;
generating N based at least on the first and second sets of filter parameters 2 A group filtering parameter; the N is 2 The group filtering parameters respectively correspond to different ANC noise reduction intensities; the second set of filtering parameters is N pre-stored by the earphone 1 One set of filter parameters; the second set of filtering parameters is used for filtering the data in the N 1 Performing environmental noise reduction in a state with minimum leakage degree in the leakage state;
acquiring the noise reduction intensity of the target ANC;
from the N according to target ANC noise reduction intensity 2 Determining a third set of filter parameters from the sets of filter parameters;
and denoising by using the third group of filtering parameters.
2. The method of claim 1, wherein the obtaining a first set of filter parameters comprises:
and receiving first indication information from a terminal, wherein the first indication information is used for indicating the earphone to reduce noise by using the first group of filtering parameters.
3. The method of claim 1, wherein the headset comprises an error microphone; the obtaining a first set of filtering parameters includes:
collecting a first signal through an error microphone of the earphone, and obtaining a downlink signal of the earphone;
Determining current frequency response curve information of a secondary channel according to the first signal and the downlink signal;
from preset N 1 Determining target frequency response curve information matched with the current frequency response curve information in the frequency response curve information of the secondary channels;
determining a set of filtering parameters corresponding to the target frequency response curve information as the first set of filtering parameters, wherein N is the same as N 1 Group filtering parameters correspond to N 1 Frequency response curve information for each secondary channel.
4. The method of claim 1, wherein the headset comprises an error microphone and a reference microphone; the obtaining a first set of filtering parameters includes:
collecting a first signal through an error microphone of the earphone, collecting a second signal through a reference microphone of the earphone, and obtaining a downlink signal of the earphone;
determining a residual signal of the error microphone based on the first signal and the second signal;
determining current frequency response curve information of a secondary channel according to the residual signal of the error microphone and the downlink signal;
from preset N 1 Determining target frequency response curve information matched with the current frequency response curve information in the frequency response curve information of the secondary channels;
Determining a group of filtering parameters corresponding to the target frequency response curve informationDefining the first set of filtering parameters, the N 1 Group filtering parameters correspond to N 1 Frequency response curve information for each secondary channel.
5. The method of claim 1, wherein the headset comprises an error microphone and a reference microphone; the obtaining a first set of filtering parameters includes:
collecting a first signal through an error microphone of the earphone and collecting a second signal through a reference microphone of the earphone;
determining current frequency response curve information of a primary channel according to the first signal and the second signal;
from preset N 1 Determining target frequency response curve information matched with the current frequency response curve information in the frequency response curve information of the primary channels;
determining a set of filtering parameters corresponding to the target frequency response curve information as the first set of filtering parameters, wherein N is the same as N 1 Group filtering parameters correspond to N 1 Frequency response curve information of the individual primary channels.
6. The method of claim 1, wherein the headset comprises an error microphone and a reference microphone; the obtaining a first set of filtering parameters includes:
collecting a first signal through an error microphone of the earphone, collecting a second signal through a reference microphone of the earphone, and obtaining a downlink signal of the earphone;
Determining current frequency response curve information of a primary channel according to the first signal and the second signal, and determining current frequency response curve information of a secondary channel according to the first signal and the downlink signal; determining current frequency response ratio curve information, wherein the current frequency response ratio curve information is the ratio of the current frequency response curve information of the primary channel to the current frequency response curve information of the secondary channel;
from preset N 1 Determining a target matched with the current frequency response ratio curve information in the individual frequency response ratio curve informationFrequency response ratio curve information;
determining a set of filtering parameters corresponding to the target frequency response ratio curve information as the first set of filtering parameters, wherein N is the same as N 1 Group filtering parameters correspond to N 1 And frequency response ratio curve information.
7. The method of claim 1, wherein the headset comprises an error microphone and a reference microphone; the obtaining a first set of filtering parameters includes:
determining the N 1 Frequency response difference curve information of the error microphone and the reference microphone respectively corresponding to the group filtering parameters;
the N is set to 1 N corresponding to the group filtering parameters 1 The frequency response difference curve with the minimum amplitude corresponding to the target frequency band is determined as a target frequency response difference curve, and the frequency response difference curve information of the error microphone and the reference microphone is the difference between the frequency response curve information of the error microphone and the frequency response curve information of the reference microphone;
And determining a group of filtering parameters corresponding to the target frequency response difference curve information as the first group of filtering parameters.
8. The method of claim 1, wherein N is generated based at least on the first set of filter parameters and the second set of filter parameters 2 A set of filtering parameters comprising:
interpolating the first and second sets of filter parameters to generate the N 2 And (5) a group of filtering parameters.
9. The method of claim 1, wherein the obtained target ANC noise reduction strength comprises:
and receiving second instruction information from the terminal, wherein the second instruction information is used for instructing the earphone to utilize a third group of filtering parameters corresponding to the target ANC noise reduction intensity to reduce noise.
10. The method of claim 1, wherein the obtaining the target ANC noise reduction strength comprises:
and determining the noise reduction strength of the target ANC according to the state of the current environmental noise.
11. The method of claim 1, wherein prior to acquiring the first set of filter parameters, the method further comprises:
receiving a first instruction, wherein the earphone works in an ANC working mode, and the first instruction is used for controlling the earphone to work in the ANC working mode; or alternatively, the process may be performed,
Detecting whether the earphone is in the ear;
and under the condition that the earphone is detected to be in the ear, the earphone works in an ANC working mode.
12. The method of claim 1, wherein the obtaining a first set of filter parameters comprises:
receiving a second instruction, wherein the second instruction is used for instructing the earphone to acquire the first group of filtering parameters; wherein the first set of filter parameters is different from filter parameters employed by the earpiece prior to receiving the second instruction.
13. The method of claim 1, wherein after obtaining a first set of filter parameters, generating N based at least on the first set of filter parameters and the second set of filter parameters 2 Before the set of filtering parameters, the method further comprises:
receiving a third instruction, wherein the third instruction is used for triggering the earphone to generate the N 2 And (5) a group of filtering parameters.
14. The method according to any one of claims 1 to 13, wherein,
the N is 1 The group filtering parameters are determined according to the recording signal of the secondary channel SP mode and the recording signal of the primary channel PP mode; wherein the SP mode recording signal comprises a downlink signal and a tympanic membraneA signal of a microphone and a signal of an error microphone of the earphone; the PP-mode recording signal includes a signal of a tympanic membrane microphone, a signal of an error microphone of the earphone, and a signal of a reference microphone of the earphone.
15. The method according to claim 1, wherein the method further comprises:
detecting whether an abnormal noise exists, wherein the abnormal noise comprises at least one of the following components: howling noise, clipping noise or background noise;
updating filtering parameters in case of detecting the presence of abnormal noise, wherein the filtering parameters comprise the first group of filtering parameters or the third group of filtering parameters;
collecting sound signals through a reference microphone and an error microphone of the earphone;
and processing the sound signals collected by the reference microphone and the sound signals collected by the error microphone based on the updated filtering parameters to generate reverse noise signals.
16. The method of claim 1, wherein the step of determining the position of the substrate comprises,
the headphones include a semi-open active noise reduction headphone.
17. An active noise reduction method, which is applied to a terminal that establishes a communication connection with an earphone, wherein the earphone is in an ANC operation mode, the method comprising:
determining a first set of filter parameters; the first set of filtering parameters is determined according to in-ear cues, ambient noise and/or subjective listening experience of the user, and the first set of filtering parameters is N pre-stored in the earphone 1 One set of filter parameters; the N is 1 The group filtering parameters are respectively used for N 1 Environmental noise reduction is carried out in the leakage state; the N is 1 The leakage state is formed by the earphone and N 1 Formed by different ear canal environments; wherein, the earphone aims at the same environmental noise in the current wearing state,the noise reduction effect of the earphone when the first set of filtering parameters is applied is better than that of the earphone when the N is applied 1 Noise reduction effect when other filtering parameters in the group of filtering parameters; n (N) 1 Is a positive integer greater than or equal to 2;
sending first indication information to the earphone, wherein the first indication information is used for indicating the earphone to reduce noise by using the first group of filtering parameters;
receiving an operation on a second control option in the ANC control list;
in response to the operation of the second control option, sending a third instruction to the earphone, wherein the third instruction is used for triggering the earphone to generate N 2 A set of filtering parameters, said N 2 The set of filter parameters is generated from a second set of filter parameters, the second set of filter parameters being the N 1 One set of filter parameters; the second set of filtering parameters is used for filtering the data in the N 1 Performing environmental noise reduction in a state with minimum leakage degree in the leakage state;
Displaying a second control; the second control includes N 2 Preset positions, N 2 Corresponding N of preset positions 2 Noise reduction intensity of seed ANC, N 2 Seed ANC noise reduction intensity corresponds to N 2 A group filtering parameter;
receiving an operation for a second position in the second control; the second position is the N 2 One of the preset positions, and the noise reduction effect of the filtering parameter corresponding to the ANC noise reduction intensity at the second position when the filtering parameter is applied to the earphone is better than that of the N 2 The noise reduction effect when the filtering parameters corresponding to the ANC noise reduction intensity at other positions in the preset positions are applied to the earphone;
responding to the operation of the second position, and determining the ANC noise reduction intensity corresponding to the second position as a target ANC noise reduction intensity;
and sending second indication information to the earphone, wherein the second indication information is used for indicating the earphone to reduce noise by utilizing a third group of filtering parameters corresponding to the noise reduction intensity of the target ANC.
18. The method of claim 17, wherein the determining a first set of filter parameters comprises:
receiving a first signal acquired by an error microphone of the earphone, and acquiring a downlink signal of the earphone;
determining current frequency response curve information of a secondary channel according to the first signal and the downlink signal;
From preset N 1 Determining target frequency response curve information matched with the current frequency response curve information in the frequency response curve information of the secondary channels;
determining a set of filtering parameters corresponding to the target frequency response curve information as the first set of filtering parameters, wherein N is the same as N 1 Group filtering parameters correspond to N 1 Frequency response curve information for each secondary channel.
19. The method of claim 17, wherein the determining a first set of filter parameters comprises:
receiving a first signal acquired by an error microphone of the earphone and a second signal acquired by a reference microphone of the earphone, and acquiring a downlink signal of the earphone;
determining a residual signal of the error microphone based on the first signal and the second signal;
determining current frequency response curve information of a secondary channel according to the residual signal of the error microphone and the downlink signal;
from preset N 1 Determining target frequency response curve information matched with the current frequency response curve information in the frequency response curve information of the secondary channels;
determining the filter parameters corresponding to the target frequency response curve information as the first group of filter parameters, wherein N is the same as N 1 Group filtering parameters correspond to N 1 Frequency response curve information for each secondary channel.
20. The method of claim 17, wherein the determining a first set of filter parameters comprises:
receiving a first signal acquired by an error microphone of the earphone and a second signal acquired by a reference microphone of the earphone;
determining current frequency response curve information of a primary channel according to the first signal and the second signal;
from preset N 1 Determining target frequency response curve information matched with the current frequency response curve information in the frequency response curve information of the primary channels;
determining the filter parameters corresponding to the target frequency response curve information as the first group of filter parameters, wherein N is the same as N 1 Group filtering parameters correspond to N 1 Frequency response curve information of the individual primary channels.
21. The method of claim 17, wherein the determining a first set of filter parameters comprises:
receiving a first signal acquired by an error microphone of the earphone and a second signal acquired by a reference microphone of the earphone, and acquiring a downlink signal of the earphone;
determining current frequency response curve information of a primary channel according to the first signal and the second signal, and determining current frequency response curve information of a secondary channel according to the first signal and the downlink signal; determining current frequency response ratio curve information, wherein the current frequency response ratio curve information is the ratio of the current frequency response curve information of the primary channel to the current frequency response curve information of the secondary channel;
From preset N 1 Determining target frequency response ratio curve information matched with the current frequency response ratio curve information in the individual frequency response ratio curve information;
determining the filtering parameters corresponding to the target frequency response ratio curve information as the first group of filtering parameters, wherein N is the same as N 1 Group filtering parameters correspond to N 1 And frequency response ratio curve information.
22. The method of claim 17, wherein the determining a first set of filter parameters comprises:
determining the N 1 Frequency response difference curve information of the error microphone and the reference microphone respectively corresponding to the group filtering parameters;
the N is set to 1 N corresponding to the group filtering parameters 1 The frequency response difference curve with the minimum amplitude corresponding to the target frequency band is determined as a target frequency response difference curve, and the frequency response difference curve information of the error microphone and the reference microphone is the difference between the frequency response curve information of the error microphone and the frequency response curve information of the reference microphone;
and determining the filtering parameters corresponding to the target frequency response difference curve information as the first group of filtering parameters.
23. The method according to any one of claims 17 to 22, wherein prior to said determining the first set of filter parameters, the method further comprises:
Receiving operation of a first option of a first interface of the terminal, wherein the first interface is an interface for setting a working mode of the earphone;
and responding to the operation of the first option, sending a first instruction to the earphone, wherein the first instruction is used for controlling the earphone to work in an ANC working mode.
24. The method of claim 23, wherein after receiving the operation of the first option of the first interface of the terminal, the method further comprises:
displaying an ANC control list; the ANC control list at least comprises at least one of the following options: a first control option, a second control option, or a third control option; wherein the first control option is used for triggering and determining the first group of filtering parameters, and the second control option is used for triggering and generating N 2 And a set of filter parameters, the third control option being for triggering a redetermination of the first set of filter parameters.
25. The method of claim 24, wherein the determining a first set of filter parameters comprises:
receiving an operation on a first control option in the ANC control list, and displaying a first control, wherein the first control comprises N 1 Preset positions, N 1 A plurality of preset positions corresponding to the N 1 A group filtering parameter;
receiving an operation for a first position in the first control; the first position is the N 1 One of the preset positions, and the noise reduction effect of the group of filter parameters corresponding to the first position when applied to the earphone is better than that of the N 1 The noise reduction effect when the filter parameters corresponding to other positions in the preset positions are applied to the earphone;
and in response to the operation on the first position, determining a set of filter parameters corresponding to the first position as the first set of filter parameters.
26. The method according to claim 24 or 25, characterized in that the method further comprises:
receiving an operation on a third control option in the ANC control list;
the first set of filter parameters is redetermined in response to operation of the third control option.
27. The method according to claim 24 or 25, characterized in that the method further comprises:
receiving an operation on a third control option in the ANC control list;
responsive to operation of the third control option, sending a second instruction to the headset, the second instruction for instructing the headset to acquire the first set of filter parameters; wherein the first set of filter parameters is different from filter parameters employed by the earpiece prior to receiving the second instruction.
28. An earphone, characterized in that, earphone has the active ANC function of making an uproar that falls, earphone includes acquisition module and processing module:
the acquisitionThe module is used for acquiring a first group of filtering parameters under the condition that the earphone is in an ANC working mode; the first set of filtering parameters is determined according to in-ear cues, ambient noise and/or subjective listening experience of the user, and the first set of filtering parameters is N pre-stored in the earphone 1 One set of filter parameters; the N is 1 The group filtering parameters are respectively used for N 1 Environmental noise reduction is carried out in the leakage state; the N is 1 The leakage state is formed by the earphone and N 1 Formed by different ear canal environments; the noise reduction effect of the earphone when the first group of filtering parameters are applied is better than that of the earphone when the N is applied aiming at the same environmental noise in the current wearing state of the earphone 1 Noise reduction effect when other filtering parameters in the group of filtering parameters; n (N) 1 Is a positive integer greater than or equal to 2;
the processing module is used for reducing noise by utilizing the first group of filtering parameters;
a generation module for generating N based on at least the first and second sets of filtering parameters 2 A group filtering parameter; the N is 2 The group filtering parameters respectively correspond to different ANC noise reduction intensities; the second set of filtering parameters is N pre-stored by the earphone 1 One set of filter parameters; the second set of filtering parameters is used for filtering the data in the N 1 Performing environmental noise reduction in a state with minimum leakage degree in the leakage state;
the acquisition module is also used for acquiring the noise reduction strength of the target ANC;
the determining module is used for determining the noise reduction intensity according to the target ANC from the N 2 Determining a third set of filter parameters from the sets of filter parameters;
the processing module is further configured to perform noise reduction by using the third set of filtering parameters.
29. The headset of claim 28, further comprising a receiving module;
the receiving module is configured to receive first indication information from a terminal, where the first indication information is used to instruct the earphone to perform noise reduction by using the first set of filtering parameters.
30. The headset of claim 28, further comprising a first signal acquisition module and a determination module;
the first signal acquisition module is used for acquiring a first signal through an error microphone of the earphone;
the acquisition module is further used for acquiring downlink signals of the earphone;
The determining module is further configured to determine current frequency response curve information of a secondary channel according to the first signal and the downlink signal; and from a preset N 1 Determining target frequency response curve information matched with the current frequency response curve information in the frequency response curve information of the secondary channels; and determining a set of filtering parameters corresponding to the target frequency response curve information as the first set of filtering parameters, wherein N is the same as N 1 Group filtering parameters correspond to N 1 Frequency response curve information for each secondary channel.
31. The headset of claim 28, further comprising a first signal acquisition module, a determination module, and a second signal acquisition module;
the first signal acquisition module is used for acquiring a first signal through an error microphone of the earphone;
the second signal acquisition module is used for acquiring a second signal through a reference microphone of the earphone;
the acquisition module is further used for acquiring downlink signals of the earphone;
the determining module is further configured to determine a residual signal of the error microphone based on the first signal and the second signal; determining current frequency response curve information of a secondary channel according to the residual signal of the error microphone and the downlink signal; from preset N 1 Determining target frequency response curve information matched with the current frequency response curve information in the frequency response curve information of the secondary channels; and a group of frequency response curve information corresponding to the target frequency response curve informationThe filter parameters are determined as the first set of filter parameters, the N 1 Group filtering parameters correspond to N 1 Frequency response curve information for each secondary channel.
32. The headset of claim 28, further comprising a first signal acquisition module, a determination module, and a second signal acquisition module;
the first signal acquisition module is used for acquiring a first signal through an error microphone of the earphone;
the second signal acquisition module is used for acquiring a second signal through a reference microphone of the earphone;
the determining module is further configured to determine current frequency response curve information of the primary channel according to the first signal and the second signal; and from a preset N 1 Determining target frequency response curve information matched with the current frequency response curve information in the frequency response curve information of the primary channels; and determining a set of filtering parameters corresponding to the target frequency response curve information as the first set of filtering parameters, wherein N is the same as N 1 Group filtering parameters correspond to N 1 Frequency response curve information of the individual primary channels.
33. The headset of claim 28, further comprising a first signal acquisition module, a determination module, and a second signal acquisition module;
the first signal acquisition module is used for acquiring a first signal through an error microphone of the earphone;
the second signal acquisition module is used for acquiring a second signal through a reference microphone of the earphone;
the acquisition module is further used for acquiring downlink signals of the earphone;
the determining module is further configured to determine current frequency response curve information of a primary channel according to the first signal and the second signal, and determine current frequency response curve information of a secondary channel according to the first signal and the downlink signal; and determining current frequency response ratio curve information, the currentThe frequency response ratio curve information is the ratio of the current frequency response curve information of the primary channel to the current frequency response curve information of the secondary channel; and then from preset N 1 Determining target frequency response ratio curve information matched with the current frequency response ratio curve information in the individual frequency response ratio curve information; and determining a set of filter parameters corresponding to the target frequency response ratio curve information as the first set of filter parameters, wherein N is the sum of the filter parameters of the first set of filter parameters 1 Group filtering parameters correspond to N 1 And frequency response ratio curve information.
34. The headset of claim 28, further comprising a determination module;
the determining module is further configured to determine the N 1 Frequency response difference curve information of the error microphone and the reference microphone respectively corresponding to the group filtering parameters; and let said N 1 N corresponding to the group filtering parameters 1 The frequency response difference curve with the minimum amplitude corresponding to the target frequency band is determined as a target frequency response difference curve, and the frequency response difference curve information of the error microphone and the reference microphone is the difference between the frequency response curve information of the error microphone and the frequency response curve information of the reference microphone; and determining a group of filtering parameters corresponding to the target frequency response difference curve information as the first group of filtering parameters.
35. The earphone of claim 28, wherein the earphone comprises a pair of earphone arms,
the generating module is specifically configured to interpolate the first set of filtering parameters and the second set of filtering parameters to generate the N 2 And (5) a group of filtering parameters.
36. The headset of claim 29, wherein the earphone comprises,
the receiving module is further configured to receive second indication information from the terminal, where the second indication information is used to indicate the earphone to perform noise reduction by using a third set of filtering parameters corresponding to the target ANC noise reduction intensity.
37. The headset of claim 28, further comprising a determination module;
the determining module is further configured to determine the target ANC noise reduction strength according to a state of the current environmental noise.
38. The headset of claim 29 or 36, further comprising a detection module;
the receiving module is further configured to receive a first instruction, where the earphone works in an ANC working mode, and the first instruction is used to control the earphone to work in the ANC working mode;
the detection module is used for detecting whether the earphone is in the ear or not; and under the condition that the detection module detects that the earphone is in the ear, the earphone works in an ANC working mode.
39. The headset of claim 29 or 36, further comprising a receiving module;
the receiving module is used for receiving a second instruction, and the second instruction is used for indicating the earphone to acquire the first group of filtering parameters; wherein the first set of filter parameters is different from filter parameters employed by the earpiece prior to receiving the second instruction.
40. The headset of claim 28, further comprising a receiving module;
The receiving module is further configured to receive a third instruction, where the third instruction is used to trigger the earphone to generate the N 2 And (5) a group of filtering parameters.
41. The headset of any one of claims 28 to 40,
the N is 1 The group filtering parameters are determined according to the recording signal of the secondary channel SP mode and the recording signal of the primary channel PP mode; wherein the SP mode recording signal comprises a downlink signal and a drumA signal of a membrane microphone and a signal of an error microphone of the earphone; the PP-mode recording signal includes a signal of a tympanic membrane microphone, a signal of an error microphone of the earphone, and a signal of a reference microphone of the earphone.
42. The headset of claim 28 or 36, further comprising an update module, a detection module, a first signal acquisition module, and a second signal acquisition module;
the detection module is further configured to detect whether abnormal noise exists, where the abnormal noise includes at least one of the following: howling noise, clipping noise or background noise;
the updating module is configured to update a filtering parameter when the detecting module detects that abnormal noise exists, where the filtering parameter includes the first set of filtering parameters or the third set of filtering parameters;
The first signal acquisition module is further used for acquiring sound signals through a reference microphone of the earphone;
the second signal acquisition module is further used for acquiring sound signals through an error microphone of the earphone;
the processing module is further configured to process the sound signal collected by the reference microphone and the sound signal collected by the error microphone based on the updated filtering parameter, so as to generate a reverse noise signal.
43. The terminal is characterized in that the terminal establishes communication connection with an earphone, the earphone is in an ANC working mode, and the terminal comprises a determining module and a sending module;
the determining module is used for determining a first group of filtering parameters; the first set of filtering parameters is determined according to in-ear cues, ambient noise and/or subjective listening experience of the user, and the first set of filtering parameters is N pre-stored in the earphone 1 One set of filter parameters; the N is 1 The group filtering parameters are respectively used for N 1 Environmental noise reduction is carried out in the leakage state; the N is 1 The leakage state is formed by the earphone and N 1 Formed by different ear canal environments; the noise reduction effect of the earphone when the first group of filtering parameters are applied is better than that of the earphone when the N is applied aiming at the same environmental noise in the current wearing state of the earphone 1 Noise reduction effect when other filtering parameters in the group of filtering parameters; n (N) 1 Is a positive integer greater than or equal to 2;
the sending module is used for sending first indication information to the earphone, wherein the first indication information is used for indicating the earphone to reduce noise by using the first group of filtering parameters;
the sending module is further configured to send a third instruction to the earphone, where the third instruction is used to trigger the earphone to generate N 2 A set of filtering parameters, said N 2 The set of filter parameters is generated from a second set of filter parameters, the second set of filter parameters being the N 1 One set of filter parameters; the second set of filtering parameters is used for filtering the data in the N 1 Performing environmental noise reduction in a state with minimum leakage degree in the leakage state;
the determining module is further configured to determine that an ANC noise reduction strength corresponding to a second location is a target ANC noise reduction strength, where the second location is N 2 One of the preset positions, and the noise reduction effect of the filtering parameter corresponding to the ANC noise reduction intensity at the second position when the filtering parameter is applied to the earphone is better than that of the N 2 Noise reduction effect when filtering parameters corresponding to ANC noise reduction intensity at other positions in the preset positions are applied to the earphone, wherein N is the number of the noise reduction parameters 2 Corresponding N of preset positions 2 Noise reduction intensity of seed ANC, N 2 Seed ANC noise reduction intensity corresponds to N 2 A group filtering parameter;
the sending module is further configured to send second indication information to the earphone, where the second indication information is used to instruct the earphone to perform noise reduction by using a third set of filtering parameters corresponding to the target ANC noise reduction intensity.
44. The terminal of claim 43, wherein the terminal further comprises a receiving module and an acquiring module;
the receiving module is used for receiving a first signal acquired by an error microphone of the earphone;
the acquisition module is used for acquiring the downlink signal of the earphone;
the determining module is specifically configured to determine current frequency response curve information of a secondary channel according to the first signal and the downlink signal; and from a preset N 1 Determining target frequency response curve information matched with the current frequency response curve information in the frequency response curve information of the secondary channels; and determining a set of filtering parameters corresponding to the target frequency response curve information as the first set of filtering parameters, wherein N is the same as N 1 Group filtering parameters correspond to N 1 Frequency response curve information for each secondary channel.
45. The terminal of claim 43, wherein the terminal further comprises a receiving module and an acquiring module;
The receiving module is used for receiving a first signal acquired by an error microphone of the earphone and a second signal acquired by a reference microphone of the earphone;
the acquisition module is used for acquiring the downlink signal of the earphone;
the determining module is specifically configured to determine a residual signal of the error microphone based on the first signal and the second signal; determining current frequency response curve information of a secondary channel according to the residual signal of the error microphone and the downlink signal; and from a preset N 1 Determining target frequency response curve information matched with the current frequency response curve information in the frequency response curve information of the secondary channels; and determining a filter parameter corresponding to the target frequency response curve information as the first group of filter parameters, wherein N is the same as the first group of filter parameters 1 Group filtering parameters correspond to N 1 Frequency response curve information for each secondary channel.
46. The terminal of claim 43, wherein the terminal further comprises a receiving module;
the receiving module is used for receiving a first signal acquired by an error microphone of the earphone and a second signal acquired by a reference microphone of the earphone;
the determining module is specifically configured to determine current frequency response curve information of a primary channel according to the first signal and the second signal; and from a preset N 1 Determining target frequency response curve information matched with the current frequency response curve information in the frequency response curve information of the primary channels; and determining a filter parameter corresponding to the target frequency response curve information as the first group of filter parameters, wherein N is the same as the first group of filter parameters 1 Group filtering parameters correspond to N 1 Frequency response curve information of the individual primary channels.
47. The terminal of claim 43, wherein the terminal further comprises a receiving module and an acquiring module;
the receiving module is used for receiving a first signal acquired by an error microphone of the earphone and a second signal acquired by a reference microphone of the earphone;
the acquisition module is used for acquiring the downlink signal of the earphone;
the determining module is specifically configured to determine current frequency response curve information of a primary channel according to the first signal and the second signal, and determine current frequency response curve information of a secondary channel according to the first signal and the downlink signal; determining current frequency response ratio curve information, wherein the current frequency response ratio curve information is the ratio of the current frequency response curve information of the primary channel to the current frequency response curve information of the secondary channel; and then from preset N 1 Determining target frequency response ratio curve information matched with the current frequency response ratio curve information in the individual frequency response ratio curve information; and determining the filter parameters corresponding to the target frequency response ratio curve information as the first group of filter parameters, wherein N is the sum of the filter parameters of the first group of filter parameters 1 Group filtering parameters correspond to N 1 And frequency response ratio curve information.
48. The terminal of claim 43, wherein,
the determining module is specifically configured to determine the N 1 Frequency response difference curve information of the error microphone and the reference microphone respectively corresponding to the group filtering parameters; and let said N 1 N corresponding to the group filtering parameters 1 The frequency response difference curve with the minimum amplitude corresponding to the target frequency band is determined as a target frequency response difference curve, and the frequency response difference curve information of the error microphone and the reference microphone is the difference between the frequency response curve information of the error microphone and the frequency response curve information of the reference microphone; and determining the filtering parameters corresponding to the target frequency response difference curve information as the first group of filtering parameters.
49. The terminal of any of claims 46 to 47, wherein,
the receiving module is further configured to receive an operation of a first option of a first interface of the terminal, where the first interface is an interface for setting a working mode of the earphone;
The sending module is further configured to send a first instruction to the earphone in response to the operation of the first option, where the first instruction is used to control the earphone to work in an ANC working mode.
50. The terminal of claim 49, wherein the terminal further comprises a display module;
the display module is used for displaying an ANC control list; the ANC control list at least comprises at least one of the following options: a first control option, a second control option, or a third control option; wherein the first control option is used for triggering and determining the first group of filtering parameters, and the second control option is used for triggering and generating N 2 And a set of filter parameters, the third control option being for triggering a redetermination of the first set of filter parameters.
51. The terminal of claim 50, wherein the terminal comprises,
the receiving module is further configured to receive an operation on a first control option in the ANC control list;
the display module is further configured to display a first control, where the first control includes N 1 Preset positions, N 1 A plurality of preset positions corresponding to the N 1 A group filtering parameter;
the receiving module is further used for receiving operation on a first position in the first control; the first position is the N 1 One of the preset positions, and the noise reduction effect of the group of filter parameters corresponding to the first position when applied to the earphone is better than that of the N 1 The noise reduction effect when the filter parameters corresponding to other positions in the preset positions are applied to the earphone;
the determining module is specifically configured to determine, in response to an operation on the first location, a set of filtering parameters corresponding to the first location as the first set of filtering parameters.
52. The terminal of claim 50 or 51, wherein the terminal comprises,
the receiving module is further configured to receive an operation on a third control option in the ANC control list;
the determination module is further configured to re-determine a first set of filter parameters in response to operation of the third control option.
53. The terminal of claim 50 or 51, wherein the terminal comprises,
the receiving module is further configured to receive an operation on a third control option in the ANC control list;
the sending module is further configured to send a second instruction to the earphone in response to the operation of the third control option, where the second instruction is used to instruct the earphone to obtain the first set of filtering parameters; wherein the first set of filter parameters is different from filter parameters employed by the earpiece prior to receiving the second instruction.
54. The terminal of claim 53, wherein the terminal comprises,
the receiving module is further configured to receive an operation on a second control option in the ANC control list;
and the sending module is further used for responding to the operation of the second control option and sending a third instruction to the earphone.
55. The terminal of claim 54, wherein the terminal,
the display module is also used for displaying a second control; the second control includes N 2 Preset positions, N 2 Corresponding N of preset positions 2 Noise reduction intensity of seed ANC, N 2 Seed ANC noise reduction intensity corresponds to N 2 A group filtering parameter;
the receiving module is further used for receiving an operation on a second position in the second control;
the determining module is further configured to determine, in response to an operation on the second location, an ANC noise reduction strength corresponding to the second location as a target ANC noise reduction strength.
56. A headset comprising a memory and at least one processor connected to the memory, the memory for storing instructions that, when read by the at least one processor, perform the method of any one of claims 1 to 16.
57. A computer readable storage medium comprising a computer program which, when run on a computer, performs the method of any of claims 1 to 16.
58. A terminal comprising a memory and at least one processor coupled to the memory, the memory for storing instructions that, when read by the at least one processor, perform the method of any of claims 17 to 27.
59. A computer readable storage medium comprising a computer program which, when run on a computer, performs the method of any of claims 17 to 27.
CN202011120314.7A 2020-05-14 2020-10-19 Active noise reduction method and device Active CN113676804B (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
KR1020227043382A KR20230009487A (en) 2020-05-14 2021-03-31 Active noise canceling method and apparatus
JP2022568881A JP2023525138A (en) 2020-05-14 2021-03-31 Active noise canceling method and apparatus
PCT/CN2021/084774 WO2021227695A1 (en) 2020-05-14 2021-03-31 Active noise cancellation method and apparatus
PCT/CN2021/084775 WO2021227696A1 (en) 2020-05-14 2021-03-31 Method and apparatus for active noise reduction
US17/986,549 US20230080298A1 (en) 2020-05-14 2022-11-14 Active Noise Cancellation Method and Apparatus

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN2020104076927 2020-05-14
CN202010407692 2020-05-14

Publications (2)

Publication Number Publication Date
CN113676804A CN113676804A (en) 2021-11-19
CN113676804B true CN113676804B (en) 2023-07-18

Family

ID=78537997

Family Applications (2)

Application Number Title Priority Date Filing Date
CN202011120188.5A Active CN113676803B (en) 2020-05-14 2020-10-19 Active noise reduction method and device
CN202011120314.7A Active CN113676804B (en) 2020-05-14 2020-10-19 Active noise reduction method and device

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN202011120188.5A Active CN113676803B (en) 2020-05-14 2020-10-19 Active noise reduction method and device

Country Status (1)

Country Link
CN (2) CN113676803B (en)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113920975B (en) * 2021-11-26 2023-06-09 歌尔科技有限公司 Noise reduction parameter setting method and device, earphone equipment and storage medium
CN114071304B (en) * 2021-11-29 2023-04-25 歌尔科技有限公司 Active noise reduction method and device for earphone, earphone and computer readable storage medium
CN114071324A (en) * 2021-12-21 2022-02-18 Oppo广东移动通信有限公司 Audio processing method and device and electronic equipment
CN114501288B (en) * 2022-01-25 2024-03-26 深圳市豪恩声学股份有限公司 Noise reduction performance test system and method for noise reduction earphone
WO2023160286A1 (en) * 2022-02-28 2023-08-31 荣耀终端有限公司 Noise reduction parameter adaptation method and apparatus
CN116709116A (en) * 2022-02-28 2023-09-05 北京荣耀终端有限公司 Sound signal processing method and earphone device
CN114844976B (en) * 2022-03-25 2023-03-17 东莞市天翼通讯电子有限公司 Method and system for adjusting ANC (acoustic control and noise control) depth of Bluetooth headset through mobile phone APP
CN115206278A (en) * 2022-06-08 2022-10-18 荣耀终端有限公司 Method and device for reducing noise of sound
CN117636833A (en) * 2022-08-19 2024-03-01 华为技术有限公司 Low-frequency-suppressed signal output method and limiter
CN115472145B (en) * 2022-09-08 2023-06-16 河北初光汽车部件有限公司 Active noise reduction method, device, system and storage medium
CN116439913B (en) * 2023-04-14 2024-03-15 中国人民解放军海军潜艇学院 Marine active hearing protection type earmuff and protection method thereof
CN116156385B (en) * 2023-04-19 2023-07-07 深圳市汇顶科技股份有限公司 Filtering method, filtering device, chip and earphone
CN116184968B (en) * 2023-04-24 2023-07-11 山东星峰面粉机械有限公司 Production control method and system for corn cooked powder production line
CN116405823B (en) * 2023-06-01 2023-08-29 深圳市匠心原创科技有限公司 Intelligent audio denoising enhancement method for bone conduction earphone
CN116939428B (en) * 2023-09-18 2023-12-22 歌尔股份有限公司 Headset device, wind noise suppression method, and computer-readable storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108495227A (en) * 2018-05-25 2018-09-04 会听声学科技(北京)有限公司 Active denoising method, active noise reduction system and earphone
CN110809211A (en) * 2020-01-08 2020-02-18 恒玄科技(北京)有限公司 Method for actively reducing noise of earphone, active noise reduction system and earphone
CN110996215A (en) * 2020-02-26 2020-04-10 恒玄科技(北京)有限公司 Method, device and computer readable medium for determining noise reduction parameters of earphone
CN111107461A (en) * 2019-12-13 2020-05-05 恒玄科技(北京)有限公司 Noise reduction earphone configuration method and device, intelligent terminal and noise reduction earphone

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2441835B (en) * 2007-02-07 2008-08-20 Sonaptic Ltd Ambient noise reduction system
JP4697267B2 (en) * 2008-07-01 2011-06-08 ソニー株式会社 Howling detection apparatus and howling detection method
CN103391496B (en) * 2013-07-16 2016-08-10 歌尔声学股份有限公司 It is applied to active noise and eliminates the chauvent's criterion method and apparatus of ANR earphone
US9293128B2 (en) * 2014-02-22 2016-03-22 Apple Inc. Active noise control with compensation for acoustic leak in personal listening devices
CN106601225A (en) * 2017-01-23 2017-04-26 声源科技(深圳)有限公司 Active noise reduction earphone ground noise reducing method and device
CN107393545B (en) * 2017-07-17 2020-12-08 会听声学科技(北京)有限公司 Feedback type active noise reduction system and method with flexible gain
CN107808657B (en) * 2017-11-30 2020-11-20 会听声学科技(北京)有限公司 Design system and method of active noise reduction earphone
JP2019144067A (en) * 2018-02-20 2019-08-29 株式会社グッドマン Acoustic bar amplifier
CN108566600B (en) * 2018-04-27 2021-10-08 歌尔股份有限公司 Sound production device and electronic equipment
CN108847209A (en) * 2018-06-01 2018-11-20 会听声学科技(北京)有限公司 A kind of denoising device and noise-reduction method
CN109348362B (en) * 2018-08-21 2021-01-19 恒玄科技(上海)股份有限公司 Active noise reduction system and method for eliminating bottom noise interference
CN110087159B (en) * 2019-04-03 2020-11-17 歌尔科技有限公司 Feedback noise reduction method, system, earphone and storage medium
CN110225429B (en) * 2019-06-12 2020-12-04 会听声学科技(北京)有限公司 Active noise reduction method and device and earphone
CN110430520B (en) * 2019-08-12 2021-07-13 会听声学科技(北京)有限公司 Design method and design device of feedback filter and earphone

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108495227A (en) * 2018-05-25 2018-09-04 会听声学科技(北京)有限公司 Active denoising method, active noise reduction system and earphone
CN111107461A (en) * 2019-12-13 2020-05-05 恒玄科技(北京)有限公司 Noise reduction earphone configuration method and device, intelligent terminal and noise reduction earphone
CN110809211A (en) * 2020-01-08 2020-02-18 恒玄科技(北京)有限公司 Method for actively reducing noise of earphone, active noise reduction system and earphone
CN110996215A (en) * 2020-02-26 2020-04-10 恒玄科技(北京)有限公司 Method, device and computer readable medium for determining noise reduction parameters of earphone

Also Published As

Publication number Publication date
CN113676803B (en) 2023-03-10
CN113676803A (en) 2021-11-19
CN113676804A (en) 2021-11-19

Similar Documents

Publication Publication Date Title
CN113676804B (en) Active noise reduction method and device
CN113873378B (en) Earphone noise processing method and device and earphone
CN112789883B (en) Rate control method, device and computer storage medium
US20230164475A1 (en) Mode Control Method and Apparatus, and Terminal Device
WO2021227696A1 (en) Method and apparatus for active noise reduction
CN112313929A (en) Method for automatically switching Bluetooth audio coding modes and electronic equipment
CN113496708B (en) Pickup method and device and electronic equipment
CN113132841B (en) Method for reducing earphone blocking effect and related device
CN113890936B (en) Volume adjustment method, device and storage medium
CN114157945B (en) Data processing method and related device
WO2022206825A1 (en) Method and system for adjusting volume, and electronic device
CN113438364B (en) Vibration adjustment method, electronic device, and storage medium
CN113129916B (en) Audio acquisition method, system and related device
CN114120950B (en) Human voice shielding method and electronic equipment
US20230162718A1 (en) Echo filtering method, electronic device, and computer-readable storage medium
CN113467747B (en) Volume adjusting method, electronic device and storage medium
CN114449393B (en) Sound enhancement method, earphone control method, device and earphone
CN114390406B (en) Method and device for controlling displacement of loudspeaker diaphragm
WO2024016229A1 (en) Audio processing method and electronic device
CN116233696B (en) Airflow noise suppression method, audio module, sound generating device and storage medium
CN116634350B (en) Audio processing method and device and electronic equipment
CN117528370A (en) Signal processing method and device, equipment control method and device
CN115206278A (en) Method and device for reducing noise of sound
CN117667001A (en) Volume adjusting method, electronic equipment and system
CN117714581A (en) Audio signal processing method and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant