WO2020207376A1 - 一种去噪方法及电子设备 - Google Patents

一种去噪方法及电子设备 Download PDF

Info

Publication number
WO2020207376A1
WO2020207376A1 PCT/CN2020/083488 CN2020083488W WO2020207376A1 WO 2020207376 A1 WO2020207376 A1 WO 2020207376A1 CN 2020083488 W CN2020083488 W CN 2020083488W WO 2020207376 A1 WO2020207376 A1 WO 2020207376A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
audio signal
audio
speaker
noise model
Prior art date
Application number
PCT/CN2020/083488
Other languages
English (en)
French (fr)
Inventor
袁其云
周国名
贺剑
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2020207376A1 publication Critical patent/WO2020207376A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • G06F3/162Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs

Definitions

  • This application relates to the field of terminal technology, and in particular, to a denoising method and electronic equipment.
  • some electronic devices can realize corresponding functions by collecting certain specific sounds made by users. For example, when a user walks or runs, a sound is generated due to vibration, and the electronic device can record the number of steps by collecting the sound generated by the vibration when the user walks or runs.
  • the electronic device's own speaker plays a sound, some specific sounds made by the user will be interfered by the sound played by the electronic device's own speaker, thereby affecting the realization of certain functions of the electronic device.
  • the embodiments of the present application provide a noise removal method and an electronic device, which help reduce the interference caused by the sound emitted by the speaker of the electronic device.
  • a denoising method of an embodiment of the present application includes: an electronic device acquires a first audio signal, where the first audio signal is used to indicate information collected by a collection device of the electronic device; During external playback, the electronic device processes the first audio signal according to an audio noise model to obtain a second audio signal, and the audio noise model is used to indicate the audio signal generated by the speaker during external playback; The second audio signal does not include the audio signal generated when the speaker is externally played.
  • the audio signal generated when the speaker is put on the first audio signal can be removed according to the audio noise model, thereby helping to reduce the interference caused by the sound emitted by the speaker of the electronic device.
  • the collection device is an acceleration sensor or a microphone.
  • the electronic device controls the electronic device according to an audio signal whose frequency and amplitude satisfy a preset condition in the second audio signal. This helps to improve the accuracy of controlling electronic equipment.
  • the audio signal whose frequency and amplitude satisfy the preset conditions in the second audio signal is an audio signal generated by a tooth tapping vibration. Helps improve the flexibility of controlling electronic equipment.
  • the audio noise model is obtained by the electronic device according to a third audio signal, and the third audio signal is used to indicate an audio signal output to the speaker. It is helpful to improve that the audio signal generated by the loudspeaker indicated by the audio noise model is closer to the audio signal generated by the loudspeaker collected by the collecting device.
  • the electronic device determines whether to update the audio noise model based on the second audio signal and the third audio signal. This helps to improve the reliability of the audio noise model.
  • an electronic device provided by an embodiment of the present application includes: at least one processor, a memory, a speaker, a collection device, and one or more computer programs.
  • the one or more computer programs are stored in a memory, and the one or more computer programs include instructions, and when the instructions are executed by the electronic device, the electronic device executes the following steps:
  • the first audio signal is used to indicate the information collected by the collection device; when the speaker is put outside, the first audio signal is processed according to the audio noise model to obtain the second The audio signal, the audio noise model is used to indicate the audio signal generated when the speaker is externally amplified; the second audio signal does not include the audio signal generated when the speaker is externally amplified.
  • the collection device is an acceleration sensor or a microphone.
  • the electronic device when the instruction is executed by the electronic device, the electronic device is caused to further execute the following steps:
  • the audio signal whose frequency and amplitude satisfy the preset conditions in the second audio signal is an audio signal generated by a tooth tapping vibration.
  • the audio noise model is obtained based on a third audio signal, and the third audio signal is used to indicate an audio signal output to the speaker.
  • the electronic device when the instruction is executed by the electronic device, the electronic device is caused to further execute the following steps:
  • the second audio signal and the third audio signal it is determined whether to update the audio noise model.
  • the electronic device includes a device or functional module that executes the first aspect and any possible design of the first aspect.
  • a chip provided by an embodiment of the present application is coupled with a memory in an electronic device, so that the chip invokes a computer program stored in the memory during operation to implement the first aspect of the embodiment of the present application And any possible design method provided in the first aspect.
  • a computer storage medium stores instructions.
  • the instructions run on an electronic device, the electronic device executes any one of the first aspect and the first aspect. Design method.
  • a computer program product of an embodiment of the present application when the computer program product runs on an electronic device, causes the electronic device to execute the first aspect and any one of the possible design methods of the first aspect.
  • FIG. 1 is a schematic structural diagram of an electronic device according to an embodiment of the application.
  • FIG. 2 is a schematic flowchart of a denoising method according to an embodiment of the application
  • FIG. 3 is a schematic structural diagram of another electronic device according to an embodiment of the application.
  • FIG. 4 is a schematic diagram of AR glasses according to an embodiment of the application.
  • FIG. 5 is a schematic structural diagram of another electronic device according to an embodiment of the application.
  • At least one (item) refers to one (item) or multiple (items), for example, “multiple” refers to two or more.
  • at least one of a, b, or c can represent: a, b, c, a and b, a and c, b and c, or a, b and c, where each of a, b, and c An item can be an element or a collection containing one or more elements.
  • the objects before and after the character "/" are in an "or” relationship.
  • "And/or" can mean three situations, for example, A and/or B can mean: A alone exists, A and B exist at the same time, or B exists alone, where A and B themselves can be elements or Contains a collection of one or more elements.
  • the sound in the embodiments of the present application refers to the sound wave generated by the vibration of an object, which can be transmitted through a medium (air or solid, liquid).
  • amplitude and frequency are physical quantities used to describe the properties of a sound. Specifically, amplitude is used to describe the loudness of the sound, and frequency is used to describe the pitch of the sound. Sounds with a frequency between 20 Hz and 20 kHz can be recognized by the human ear, and special sounds with a frequency between 1000 Hz and 3000 Hz are most sensitive to the human ear.
  • the electronic device in the embodiment of the present application may be a portable electronic device, such as a mobile phone, a tablet computer, a wearable device (such as an augmented reality (AR) device, etc.).
  • a portable electronic device such as a mobile phone, a tablet computer, a wearable device (such as an augmented reality (AR) device, etc.).
  • AR augmented reality
  • portable electronic devices include but are not limited to carrying Or portable electronic devices with other operating systems.
  • the above-mentioned portable electronic device may also be a laptop computer (Laptop), a desktop computer, etc.
  • FIG. 1 it is a schematic structural diagram of an electronic device according to an embodiment of the application.
  • the electronic device includes a processor 110, an audio module 120, a microphone 121, a speaker 122, a sensor 130, an internal memory 140, an external memory interface 150, and a universal serial bus (USB) interface 160 , The charging management module 170, the power management module 171, and the battery 172.
  • the electronic device may also include a mobile communication module, keys, and so on.
  • the hardware structure shown in FIG. 1 is only an example.
  • the electronic device of the embodiment of the present application may have more or fewer components than shown in the figure, may combine two or more components, or may have different component configurations.
  • the various components shown in the figure may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and/or application specific integrated circuits.
  • the processor 110 may include one or more processing units.
  • the processor 110 includes an application processor (AP) 111 and a signal processing module 112.
  • the signal processing module 112 is used to reduce the interference caused by the sound played by the speaker 122 to other collected sounds.
  • the other sound may be the sound generated by the vibration of the user's teeth tapping.
  • the signal processing module 112 can be an application specific integrated circuit (ASIC), a micro controller unit (MCU), or other processing modules, which is not limited.
  • ASIC application specific integrated circuit
  • MCU micro controller unit
  • the signal processing module 112 may be provided in the processor 110, part of the functions may also be provided in the processor 110, or may be an independent device.
  • the processor 110 may also include a modem, a baseband processor, a graphics processing unit (GPU), an image signal processor (ISP), a video codec, or a digital processing unit.
  • a modem a modem
  • a baseband processor GPU
  • ISP image signal processor
  • video codec video codec
  • a digital processing unit One or more of a signal processor (digital signal processor, DSP), etc.
  • DSP digital signal processor, DSP), etc.
  • different processing units can be independent devices or integrated in one or more processors.
  • a buffer may also be provided in the processor 110 to store instructions and data.
  • the buffer in the processor 110 may be a cache memory.
  • the buffer can be used to store instructions or data that the processor 110 has just used, recycled, or generated.
  • the processor 110 can directly call instructions or data from the memory. It helps to reduce the time for the processor 110 to obtain instructions or data, thereby improving the working efficiency of the system.
  • one or more processing units in the processor 110 may be provided with a buffer respectively.
  • a buffer may be provided in the signal processing module 112 to store corresponding data or information.
  • the internal memory 140 may be used to store one or more computer programs, and the one or more computer programs include instructions.
  • the processor 110 can execute the instructions stored in the internal memory 140 to enable the electronic device 100 to execute the denoising method in the embodiments of the present application, as well as other functional applications and data processing.
  • the internal memory 140 may include a program storage area and a data storage area.
  • the storage program area can store the operating system; the storage program area can also store one or more application programs (such as music players, contacts, etc.).
  • the data storage area can store data (such as audio files, contacts, etc.) created during the use of the electronic device 100.
  • the internal memory 140 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more disk storage devices, flash memory devices, universal flash storage (UFS), and the like.
  • the processor 110 may execute instructions stored in the internal memory 140 and/or instructions stored in the memory provided in the processor 110 to cause the electronic device to execute the instructions provided in the embodiments of the present application. Noise method, and other functional applications and data processing.
  • the external memory interface 150 may be used to connect an external memory card (for example, a Micro SD card) to expand the storage capacity of the electronic device.
  • the external memory card communicates with the processor 110 through the external memory interface 150 to realize the data storage function. For example, save images, music, videos and other files in an external memory card.
  • the antenna is used to transmit and receive electromagnetic wave signals.
  • Each antenna in an electronic device can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
  • the antenna can be used in conjunction with a tuning switch.
  • the wireless communication module 180 can provide applications on electronic devices including wireless local area networks (WLAN) (such as wireless-fidelity (Wi-Fi) networks), bluetooth (BT), and global navigation satellites.
  • WLAN wireless local area networks
  • BT wireless-fidelity
  • BT Bluetooth
  • global navigation satellites System (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.
  • the wireless communication module 180 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 180 receives electromagnetic wave signals sent by other electronic devices, and the wireless communication module 180 may send the received electromagnetic wave signals to the corresponding After the module performs demodulation and other processing, it is passed to AP111, and AP111 performs subsequent processing.
  • the electromagnetic wave signal received by the wireless communication module 180 carries audio information
  • the audio information may be the audio to be played sent by other electronic devices, or the user's voice, etc.
  • the AP 111 may use the audio module 120 and the speaker 122 thereby outputting a sound signal.
  • the electronic device can implement audio functions through the audio module 120, the microphone 121, the speaker 122, and an AP. For example, music playback, recording, etc.
  • the audio module 120 may be used to convert digital audio signals into analog audio signals for output, and also to convert analog audio signals into digital audio signals.
  • the audio module 120 can also be used to encode and decode audio signals.
  • the audio module 120 may be disposed in the processor 110, or part of the functional modules of the audio module 120 may be disposed in the processor 110. It should be noted that the audio module 120 in the embodiment of the present application may also be referred to as a codec.
  • the speaker 122 also called a "speaker" is used to convert audio signals into sound signals and play them.
  • the electronic device may listen to music through the speaker 122, or answer a hands-free call, or the like.
  • the electronic device in the embodiment of the present application may be provided with one or more speakers, and the type of the speaker provided in the electronic device is not limited.
  • the electronic device can be equipped with a bone conduction speaker and a traditional air conduction speaker.
  • the electronic device can be equipped with a bone conduction speaker.
  • the electronic device can also be equipped with a traditional air conduction speaker.
  • the audio signal output by the audio module 120 may be amplified by an amplifier and output to the speaker 122, and the speaker 122 converts the audio signal into a sound signal and plays it. This helps to improve the quality of sound playback.
  • the sound signal played by the speaker 122 may be acquired by the AP 111 from the internal memory 140 or an external memory connected to the external memory interface 150, or may be acquired by the AP 111 from the wireless communication module 180.
  • the embodiment of the present application does not limit the source of the sound signal played by the speaker 122.
  • the microphone 122 also called “microphone” or “microphone” is used to convert sound signals into electrical signals.
  • a user uses an electronic device to make a call or send a voice, the user can approach the microphone 122 through the mouth to make a sound.
  • the microphone 122 can be used to collect the user's voice, and then convert the user's voice into an electrical signal.
  • the electronic device may be provided with at least one microphone 122.
  • the electronic device may be provided with two microphones 122 to help realize the noise reduction function.
  • the sensor module 130 may include one or more sensors.
  • acceleration sensors For example, acceleration sensors, bone conduction sensors, etc.
  • an acceleration sensor G-sensor
  • G-sensor can be used to detect the magnitude of the acceleration of the electronic device in various directions (generally three axes).
  • the magnitude and direction of gravity can be detected when the electronic device is stationary. It can also be used to identify the posture of electronic devices, and is used in applications such as horizontal and vertical screen switching, pedometers, etc.
  • the acceleration sensor may also be used to collect acceleration information generated by the user's tooth tapping vibration. It is helpful for the electronic device to perform corresponding control in response to the vibration of the tooth tapping.
  • the tooth tapping vibration is generated by the user's upper and lower teeth tapping each other, it is not affected by the movement or sound of the limbs, nor is it affected by the external environment, so it helps to improve the flexibility of the user to control electronic equipment.
  • the electronic The device can also help to improve the privacy and confidentiality of the control of electronic devices by recognizing the vibration of the tooth tapping.
  • different tooth tapping vibrations can correspond to different control methods.
  • different amplitudes of tooth tapping vibration correspond to different control methods.
  • the control mode is to pause playing the audio file; when the amplitude of the tooth tapping vibration is greater than a certain threshold, the control mode is to play the audio file.
  • different frequency of tooth tapping vibration can correspond to different control methods.
  • the frequency of tooth tapping vibration is 1, the corresponding control method is answering the phone, that is, the control method corresponding to one tooth tapping is answering the phone; for another example, when the frequency of tooth tapping vibration is 2, the corresponding control method is Reject the call.
  • the frequency of tooth tapping vibration is 2, which can be understood as the vibration generated when the teeth tap twice continuously and the time interval between the two teeth tapping is less than a certain threshold.
  • the control method corresponding to the tooth tapping vibration in the embodiment of the present application may be set by the user according to his own needs, or may be set by the electronic device before leaving the factory, which is not limited.
  • the control method corresponding to the first tooth tapping vibration is to pause the speaker to play an audio file
  • the second tooth tapping vibration corresponding to the control method is to play the audio file with the next name in the audio file list
  • the third tooth tapping vibration is to increase the volume with the first step length
  • the corresponding control method for the fourth tooth tapping vibration is to decrease the volume with the second step length.
  • the first tooth vibration, the second tooth vibration, the third tooth vibration, and the fourth tooth vibration are tooth tapping vibrations of different frequencies and/or amplitudes.
  • the first step length and the second step length can be the same or different.
  • the first step length and the second step length may be set before the electronic device leaves the factory, or may be set according to user requirements.
  • the electronic device when the speaker 122 is currently playing audio file 1, and the acceleration sensor collects acceleration information generated by the second tooth tapping vibration, the electronic device will play audio file 2 in response to the second tooth tapping vibration.
  • the name is the name of the audio file next to the name of the audio file 1 in the audio file list.
  • the electronic device pauses playing audio file 1 in response to the first tooth tapping vibration.
  • the electronic device responds to the third tooth tapping vibration to first Increase the volume in steps.
  • the electronic device can control itself in response to the vibration of the tapping of the teeth.
  • the electronic device may also send control signals to other electronic devices in response to the vibration of the tapping of the teeth, thereby realizing control of the other electronic devices.
  • Bone conduction sensors can be used to obtain vibration signals.
  • the bone conduction sensor can obtain the vibration signal of the vibrating bone mass of the human voice.
  • Bone conduction sensors can also collect human pulse signals and receive heartbeat signals.
  • the application processor can analyze the heart rate information based on the heart beat signal obtained by the bone conduction sensor, and realize the heart rate detection function.
  • the processor 110 may further include one or more interfaces.
  • the USB interface 160 may also be an integrated circuit audio (inter-integrated circuit sound, I2S) interface, pulse code modulation (pulse code modulation, PCM) interface, etc.
  • I2S integrated circuit sound
  • PCM pulse code modulation
  • the processor 110 in the embodiment of the present application may be connected to different modules of the electronic device through an interface, so that the electronic device can implement different functions. For example, taking pictures, processing, etc. It should be noted that the embodiment of the present application does not limit the connection mode of the interface in the electronic device.
  • the charging management module 170 is used to receive charging input from the charger.
  • the charger can be a wireless charger or a wired charger.
  • the charging management module 170 may receive the charging input of the wired charger through the USB interface 160.
  • the charging management module 170 may receive a wireless charging input through a wireless charging coil of the electronic device. While the charging management module 170 charges the battery 172, it can also supply power to the electronic device through the power management module 171.
  • the power management module 171 is used to connect the battery 172, the charging management module 170, and the processor 110.
  • the power management module 171 receives input from the battery 172 and/or the charging management module 170, and supplies power to the processor 110, the internal memory 140, the wireless communication module 180, and the like.
  • the power management module 171 can also be used to monitor parameters such as battery capacity, battery cycle times, and battery health status (leakage, impedance).
  • the power management module 171 may also be provided in the processor 110.
  • the power management module 171 and the charging management module 1470 may also be provided in the same device.
  • FIG. 2 it is a schematic flow chart of a denoising method according to an embodiment of this application, including the following steps.
  • Step 201 The electronic device obtains a first audio signal.
  • the first audio signal is used to indicate information collected by a collection device (such as a microphone, a sensor, etc.) of the electronic device.
  • the first audio signal may be obtained by the signal processing module 112 according to acceleration information collected by the acceleration sensor, or obtained by the signal processing module 112 according to the vibration signal collected by the bone conduction sensor, or may be obtained by the signal processing module 112 according to the microphone There are no restrictions on the acquisition of the collected voice signals.
  • Step 202 The electronic device processes the first audio signal according to the audio noise model to obtain the second audio noise, and the audio noise model is used to indicate the audio signal generated when the speaker is externally put.
  • the second audio signal does not include the audio signal generated by the speaker.
  • the electronic device may process the first audio signal according to the audio noise model when the speaker is externally amplified, or it can process the first audio signal according to the audio noise model regardless of whether the speaker is externally amplified or not. An audio signal is processed.
  • the method of denoising in the embodiments of the present application can be applied to scenarios such as keyword wake-up, voice control, tooth tapping vibration control, step counting and the like.
  • keyword wake-up the electronic device can collect the user's voice with “keywords” through the microphone 121 to wake up the electronic device.
  • the keyword is " ⁇ ".
  • the speaker 122 of the electronic device when the speaker 122 of the electronic device is put outside, when the microphone collects the user's voice with "keywords", it will also collect the sound emitted by the speaker 122 when it is put outside.
  • Electronic equipment causes interference when recognizing "keywords" based on the sound collected by the microphone.
  • the microphone when the microphone collects the sound, it can first convert the sound collected by the microphone into an audio signal, and then remove the audio signal based on the audio noise model. Therefore, it is possible to reduce the interference of the sound emitted from the speaker 122 on the recognition of the "keyword" of the electronic device, which helps to improve the reliability of the recognition of the "keyword”.
  • the electronic device can collect the user’s voice with "command words” through the microphone 121.
  • the command word can be "call Huawei's phone", "pause playback”, etc., to achieve control of the electronic device Carry out the corresponding control.
  • the speaker 122 of the electronic device when the speaker 122 of the electronic device is externally placed, when the microphone 121 collects the user's voice with "command words", it will also collect the sound emitted by the speaker 122 when externally emitted, and the speaker 122 externally emits the sound. It will cause interference when the electronic device recognizes the "command word” according to the sound collected by the microphone.
  • the microphone collects the sound
  • the sound collected by the microphone can be converted into an audio signal, and then based on the audio noise model, the audio signal
  • the noise removal can reduce the interference of the sound emitted by the speaker 122 on the recognition of the "command word" of the electronic device, which helps to improve the reliability of the electronic device.
  • the electronic device can collect acceleration information generated by vibration when a person is walking or running through an acceleration sensor, so as to realize the step-counting function.
  • the acceleration sensor can also collect the acceleration information produced by the vibration of the speaker 122 when placed outside, and the speaker 122 vibrates when placed outside. The generated acceleration information will cause interference to the electronic device’s step counting according to the acceleration information collected by the acceleration sensor.
  • the acceleration information when the acceleration information is collected by the acceleration sensor, the acceleration information can be converted into an audio signal, and then based on the audio noise model, the audio The signal is denoised, so as to reduce the interference of the external vibration of the speaker 122 on the step counting of the electronic device, which helps to improve the accuracy of the step counting of the electronic device.
  • the signal processing module 112 in the electronic device processes the first audio signal according to the audio noise model to obtain the second audio signal.
  • the audio noise model in the embodiments of the present application can be understood as a pre-built audio signal, and the audio signal is used to indicate the situation of the collection device in the audio signal generated when the collection device is placed outside the speaker.
  • the audio noise model may be set before the electronic device leaves the factory, or it may be established by the electronic device according to preset rules or algorithms.
  • the audio noise model may be obtained by the electronic device according to the reference audio signal.
  • the reference audio signal can be obtained when the electronic device plays a pre-stored test audio file.
  • the electronic device may establish the audio noise model according to the audio signal output by the audio module 120 when the speaker is external.
  • the electronic device may update the audio noise model every specific time period. This helps to improve the theoretical noise generated by the loudspeaker to be more in line with the actual situation. For example, when a user uses an electronic device to play music or answer a voice call, the electronic device may periodically establish an audio noise model based on the audio signal output by the audio module 120 within a specific time period.
  • the specific duration may be pre-configured in the electronic device, or may be determined by the electronic device according to a preset rule or algorithm, such as 1s, 2s, and so on.
  • the audio noise model may include audio noise models of multiple speakers.
  • the audio noise model includes the audio noise model of the bone conduction speaker and the audio noise model of the traditional air conduction speaker.
  • the electronic device establishes an audio noise model according to the audio signal output by the audio module 120 and the first parameter.
  • the first parameter is used to indicate the magnitude of signal attenuation when transmitting from the speaker to the collection device (for example, a microphone, an acceleration sensor, etc.). This helps to improve the reliability of the established audio noise model.
  • the first parameter may be pre-configured in the electronic device, or an initial value of the first parameter may be pre-configured in the electronic device, and then the first parameter may be updated according to actual conditions.
  • the electronic The device can also determine whether to update the first parameter based on the second audio signal and the audio signal output by the audio module 120.
  • the second audio signal is an audio signal obtained by the electronic device after denoising the first audio signal according to the audio noise model. Then, if the electronic device updates the first parameter, it re-establishes the audio noise model according to the updated first parameter. This helps to further improve the reliability of the established audio noise model.
  • the first parameter can be updated to increase the signal attenuation during transmission from the speaker to the collection device (such as a microphone, acceleration sensor, etc.) indicated by the first parameter. size.
  • the electronic device 120 establishes an audio noise model according to the audio signal output by the audio module 120, the first parameter and the second parameter.
  • the first parameter is used to indicate the magnitude of signal attenuation when transmitting from the speaker to the collection device (for example, a microphone, an acceleration sensor, etc.).
  • the second parameter is used to indicate the characteristics of the signal transmission path from the speaker to the collection device. For example, the delay of the signal transmission path and the signal transmission rate.
  • the second parameter may be pre-configured in the electronic device, or may be determined according to a preset algorithm, which is not limited.
  • the audio signal can be processed according to the audio noise model, it helps to reduce the interference caused by the loudspeaker.
  • the embodiments of the present application there may be no need to adjust the volume of the loudspeaker.
  • the electronic device performs control in response to the user's tooth tapping vibration.
  • the sound generated by the speaker of the electronic device is an interference signal that prevents the electronic device from recognizing the vibration of the user’s teeth.
  • the signal processing module 112 in the embodiment of the present application can reduce the interference of the speaker. Improve the accuracy of electronic devices to recognize tooth tapping vibration.
  • FIG. 3 it is a schematic diagram of a specific structure of the signal processing module 112 in this embodiment of the application. Specifically, it includes converter, adder, trigger, buffer, discriminator, adaptive filter, path change detect, and delayer. (time delay). It should be noted that the delayer in the embodiment of the present application may also be set between the adaptive filter and the adder. In other embodiments, the signal processing module 112 further includes a preprocessing unit (Rx-preprocessing). In addition, the adder in the embodiment of the present application can also be replaced with a subtractor. It should be noted that the structure shown in FIG. 2 is only an example. The signal processor module 112 of the embodiment of the present application may have more or less components than shown in the figure, may combine two or more components, or may have different component configurations.
  • the electronic device recognizes the user's tapping sound, so as to realize the control of the electronic device.
  • the electronic device after the electronic device obtains the first audio signal, it processes the first audio signal according to the audio noise model to obtain the second audio signal, then obtains the control signal according to the second audio signal, and performs corresponding actions according to the control signal. control.
  • the audio noise model is used to indicate the audio signal generated by the speaker.
  • the acceleration sensor is used to collect acceleration information in the three-axis directions.
  • the acceleration information includes acceleration information generated by tooth tapping vibration and acceleration information generated by a loudspeaker.
  • the converter is used to convert the acceleration information collected by the acceleration sensor into a first audio signal (for example, an inter-integrated circuit sound (I2S) signal).
  • a first audio signal for example, an inter-integrated circuit sound (I2S) signal.
  • the converter When the speaker 122 plays a sound signal, the converter outputs the first audio signal to the adder, and the adder denoises the first audio signal according to the audio noise model output by the adaptive filter to obtain the second audio signal, and then The second audio signal is output to the trigger, and the trigger performs corresponding output according to the second audio signal, and buffers the corresponding output to the buffer.
  • the discriminator reads the output of the trigger from the buffer to obtain the control signal, where The control signal is used for an audio signal generated based on the sound of tapping teeth.
  • the discriminator receives the control signal, it outputs an interrupt to the AP111. After the AP111 receives the interrupt output from the discriminator, it reads the control signal from the discriminator, and then performs corresponding control according to the control signal.
  • the electronic device can also perform corresponding control on other electronic devices after reading the control signal. For example, if the control signal instructs the electronic device to stop playing by the speaker, the electronic device controls its own speaker to stop playing, or the loudspeaker of other electronic devices stops playing.
  • the AP when the AP outputs an audio signal to the audio module 120, it can control the converter to output the obtained first audio signal to the adder.
  • the converter may also output the first audio signal to the trigger.
  • the AP does not output an audio signal to the audio module 120, it can control the converter to output the obtained first audio signal to the trigger.
  • vibrations generated by people walking, running, or talking may also be collected by the acceleration sensor, which affects the electronic device's recognition of tooth tapping vibrations to obtain control signals, due to the frequency of audio signals generated by people walking or running Usually lower than 3Hz, the amplitude of the audio signal generated by human speech is 0.3m/s 2 , while the frequency of the audio signal generated by the vibration of the tooth is usually above 3Hz, and the amplitude is about 1m/s 2.
  • the trigger The corresponding output can be performed according to the frequency and amplitude of the audio signal, thereby reducing the interference of people walking, running or speaking on the audio signal generated by the tooth tapping, so that the output of the trigger is the audio generated by the tooth tapping vibration
  • the output of the signal is helpful to improve the accuracy of the discriminator to obtain the control signal according to the output of the trigger, thereby improving the accuracy of the control electronic device.
  • the audio signal when the frequency of the audio signal can trigger the above 3Hz amplitude of not less than / 2 1m s, there is a corresponding output, the audio signal is lower than the frequency or amplitude is less than 3Hz / 2 1m s, not The corresponding output.
  • the frequency of the audio signal when the frequency of the audio signal can trigger the above 3Hz amplitude of not less than / 2 1m s, 1 output, and the frequency of the audio signal amplitude is less than or less than 3Hz / 2 1m s, output 0.
  • the electronic device determines the audio noise model based on the audio signal output by the audio module 120.
  • the adaptive filter determines the audio noise model according to the audio signal output by the audio module 120.
  • the audio module 120 may receive the audio signal sent by the AP111, and then perform corresponding encoding and decoding on the audio signal, and then send the audio signal to the preprocessor.
  • the preprocessor receives the audio signal sent by the audio module, Perform corresponding pre-processing on the audio signal (such as sound effect processing, etc.), and then send it to the delayer.
  • the delayer sends the pre-processed audio signal to the adaptive filter after delaying the preset time.
  • the filter establishes an audio noise model based on the preprocessed audio signal.
  • the preset duration of the delay of the delayer may be pre-configured in the electronic device, or may be determined according to a preset algorithm. By delaying the preset time, it helps to synchronize the input of the noise generated by the loudspeaker and the sound of the tapping of the teeth.
  • the adaptive filter establishes an audio noise model based on the preprocessed audio signal, the first parameter, and the second parameter, where the first parameter is used to indicate the signal attenuation during transmission from the speaker to the acceleration sensor.
  • the second parameter is used to indicate the characteristics of the signal transmission path from the speaker to the acceleration sensor.
  • the path detector can also be used to determine whether to update the first parameter based on the audio signal output by the adder and the audio signal output by the delayer. If the first parameter is updated, the adaptive filter can be notified to rebuild the audio noise model. As another example, after the path detector updates the first parameter, it sends the updated first parameter to the adaptive filter, and the adaptive filter re-establishes the audio noise model according to the updated first parameter. This helps to improve the audio noise model to be more in line with the actual interference caused by the loudspeaker.
  • the audio signal output by the delayer and the audio signal output by the preprocessor are the same.
  • the delayer may also be arranged between the adaptive filter and the adder.
  • the audio noise output by the adder may also be output to the adaptive filter, and the adaptive filter determines whether to update the audio noise model according to the audio noise output by the adder and the audio noise output by the delayer. If the audio noise model needs to be updated, the first parameter can be obtained from the path detector. In this case, after the path detector determines to update the first parameter, it can update the first parameter without notifying the adaptive filter. If the adaptive filter detects that the audio noise model needs to be updated, it then obtains the updated first parameter from the path detector.
  • the signal processing module 112 in the embodiment of the present application may not include a preprocessor.
  • the adaptive filter and the path detector receive the audio signal output from the audio module 120.
  • the pre-processor please refer to the pre-processor. The implementation mode when the processor outputs the audio signal to the adaptive filter and the path detector will not be repeated here.
  • the electronic device in the embodiment of the present application may be AR glasses.
  • the acceleration sensor may be arranged near the bent part of the temple
  • the processor may be arranged near the temple near the lens.
  • the processor includes an AP and a signal processing module.
  • the position of the exemplary processor and the acceleration sensor on the AR glasses can be as shown in Fig. 4. Since the temples near the bent part of the temples are close to the temples of the human body, the perception of the vibration of the tapping of the teeth is more sensitive. It should be noted that FIG. 4 is only an exemplary illustration, and does not limit the positions of the acceleration sensor and the processor in the embodiment of the present application on the AR glasses.
  • the method provided in the embodiments of the present application is introduced from the perspective of an electronic device as an execution subject.
  • the electronic device may include a hardware structure and/or a software module, and realize the above functions in the form of a hardware structure, a software module, or a hardware structure plus a software module. Whether one of the above-mentioned functions is executed in a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application and design constraint conditions of the technical solution.
  • an embodiment of the present application discloses an electronic device 500.
  • the electronic device 500 may include: a collection device 501, a speaker 502, one or more processors 503, a memory 504, and one or more computer programs.
  • the one or more computer programs are stored in the aforementioned memory 504, and the one or more computer programs include instructions.
  • the processor 503 invokes the instruction, the electronic device 500 is caused to execute the noise removal method in the embodiment of the present application.
  • the processors involved in each of the foregoing embodiments may be general-purpose processors, digital signal processors (digital signal processors, DSP), application specific integrated circuits (ASICs), ready-made programmable gate arrays (field programmable gate arrays, FPGAs). ) Or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components.
  • DSP digital signal processors
  • ASICs application specific integrated circuits
  • FPGAs field programmable gate arrays
  • the general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.
  • the steps of the method disclosed in the embodiments of the present application may be directly embodied as being executed and completed by a hardware decoding processor, or executed and completed by a combination of hardware and software modules in the decoding processor.
  • the software module can be located in random access memory (RAM), flash memory, read-only memory (read-only memory, ROM), programmable read-only memory, or electrically erasable programmable memory, registers, etc. mature in the field Storage medium.
  • the storage medium is located in the memory, and the processor reads the instructions in the memory and completes the steps of the above method in combination with its hardware.
  • the disclosed system, device, and method may be implemented in other ways.
  • the device embodiments described above are only illustrative.
  • the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components can be combined or It can be integrated into another system, or some features can be ignored or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • each unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium.
  • the technical solution of this application essentially or the part that contributes to the existing technology or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including Several instructions are used to make a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor (processor) execute all or part of the steps of the methods described in the various embodiments of the present application.
  • the aforementioned storage media include: U disk, mobile hard disk, ROM, RAM, magnetic disk or optical disk and other media that can store program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Soundproofing, Sound Blocking, And Sound Damping (AREA)
  • Telephone Function (AREA)

Abstract

一种去噪方法及电子设备,涉及终端技术领域。其中该方法包括电子设备获取第一音频信号,第一音频信号用于指示电子设备的采集设备采集到的信息;当扬声器外放时,电子设备根据音频噪声模型,对第一音频信号进行处理,得到第二音频信号,音频噪声模型用于指示扬声器外放时产生的音频信号;第二音频信号不包括扬声器外放时产生的音频信号。这种技术方案有助于降低电子设备自身扬声器发出的声音造成的干扰。

Description

一种去噪方法及电子设备
本申请要求在2019年4月12日提交中国国家知识产权局、申请号为201910295436.0、发明名称为“一种去噪方法及电子设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及终端技术领域,特别涉及一种去噪方法及电子设备。
背景技术
目前,某些电子设备例如可穿戴设备可以通过采集用户发出的某些特定的声音,实现相应的功能。例如,用户当走路或跑步时,会因振动而产生声音,电子设备可以通过采集用户走路或跑步时振动产生的声音来记录步数。但是当电子设备自身扬声器播放声音时,用户发出的某些特定的声音会受到电子设备自身扬声器所播放的声音的干扰,从而影响电子设备某些功能的实现。
因此,对于如何降低电子设备自身扬声器所发播放的声音的干扰,对于电子设备某些功能的实现具有重要意义。
发明内容
本申请实施例提供一种去噪方法及电子设备,有助于降低电子设备自身扬声器发出的声音造成的干扰。
第一方面,本申请实施例的一种去噪方法,包括:电子设备获取第一音频信号,其中,所述第一音频信号用于指示所述电子设备的采集设备采集到的信息;当扬声器外放时,所述电子设备根据音频噪声模型,对所述第一音频信号进行处理,得到第二音频信号,所述音频噪声模型用于指示所述扬声器外放时产生的音频信号;所述第二音频信号不包括所述扬声器外放时产生的音频信号。
本申请实施例中由于电子设备当扬声器外放时,可以根据音频噪声模型,去除第一音频信号中扬声器外放时产生的音频信号,从而有助于降低电子设备自身扬声器发出的声音造成的干扰。
在一种可能的设计中,所述采集设备为加速度传感器、或者麦克风。
在一种可能的设计中,所述电子设备根据所述第二音频信号中频率和振幅满足预设条件的音频信号,控制所述电子设备。从而有助于提高控制电子设备的准确性。
示例的,第二音频信号中频率和振幅满足预设条件的音频信号为牙齿叩击振动产生的音频信号。有助于提高控制电子设备的灵活性。
在一种可能的设计中,所述音频噪声模型是所述电子设备根据第三音频信号得到的,所述第三音频信号用于指示输出给所述扬声器的音频信号。有助于提高音频噪声模型指示的所述扬声器外放时产生的音频信号更加贴近采集设备采集的因扬声器外放产生的音频信号。
在一种可能的设计中,所述电子设备根据所述第二音频信号和所述第三音频信号,判 断是否更新音频噪声模型。从而有助于提高音频噪声模型的可靠性。
第二方面,本申请实施例提供的一种电子设备,所述电子设备包括:至少一个处理器、存储器、扬声器、采集设备、一个或多个计算机程序。其中,所述一个或多个计算机程序被存储在存储器中,且所述一个或多个计算机程序包括指令,当所述指令被所述电子设备执行时,使得所述电子设备执行以下步骤:
获取第一音频信号,其中,所述第一音频信号用于指示所述采集设备采集到的信息;当扬声器外放时,根据音频噪声模型,对所述第一音频信号进行处理,得到第二音频信号,所述音频噪声模型用于指示所述扬声器外放时产生的音频信号;所述第二音频信号不包括所述扬声器外放时产生的音频信号。
在一种可能的设计中,所述采集设备为加速度传感器、或者麦克风。
在一种可能的设计中,当所述指令被所述电子设备执行时,使得所述电子设备还执行以下步骤:
根据所述第二音频信号中频率和振幅满足预设条件的音频信号,控制所述电子设备。
示例的,第二音频信号中频率和振幅满足预设条件的音频信号为牙齿叩击振动产生的音频信号。
在一种可能的设计中,所述音频噪声模型是根据第三音频信号得到的,所述第三音频信号用于指示输出给所述扬声器的音频信号。
在一种可能的设计中,当所述指令被所述电子设备执行时,使得所述电子设备还执行以下步骤:
根据所述第二音频信号和所述第三音频信号,判断是否更新音频噪声模型。
第三方面,本申请实施例的另一种电子设备,所述电子设备包括执行第一方面及第一方面任一可能的设计的装置或功能模块。
第四方面,本申请实施例提供的一种芯片,所述芯片与电子设备中的存储器耦合,使得所述芯片在运行时调用所述存储器中存储的计算机程序,实现本申请实施例第一方面以及第一方面提供的任一可能设计的方法。
第五方面,本申请实施例的一种计算机存储介质,该计算机存储介质存储有指令,当所述指令在电子设备上运行时,使得电子设备执行第一方面以及第一方面任意一种可能的设计的方法。
第六方面,本申请实施例的一种计算机程序产品,当所述计算机程序产品在电子设备上运行时,使得所述电子设备执行第一方面以及第一方面任意一种可能的设计的方法。
另外,第二方面至第六方面中任一种可能设计方式所带来的技术效果可参见第一方面中不同设计方式所带来的技术效果,此处不再赘述。
附图说明
图1为本申请实施例的一种电子设备的结构示意图;
图2为本申请实施例的去噪方法的流程示意图;
图3为本申请实施例的另一电子设备的结构示意图;
图4为本申请实施例的AR眼镜的示意图;
图5为本申请实施例的另一电子设备的结构示意图。
具体实施方式
本申请实施例中“至少一个(项)”是指一个(项)或者多个(项),例如,“多个”是指两个或两个以上。例如,a、b或c中的至少一项,可以表示:a,b,c,a和b,a和c,b和c,或a、b和c,其中a、b、c中的每一项可以是元素,也可以是包含一个或多个元素的集合。字符“/”前后的对象是一种“或”的关系。“和/或”可以表示三种情况,例如,A和/或B,可以表示:单独存在A,同时存在A和B,或单独存在B,其中,A、B本身可以是元素,也可以是包括一个或多个元素的集合。
应理解,本申请中涉及的“示例的”“在一些实施例中”“在另一实施例中”等用于表示作例子、例证或说明。本申请中被描述为“示例”的任何实施例或设计方案不应被解释为比其它实施例或设计方案更优选或更具优势。确切而言,使用示例的一词旨在以具体方式呈现概念。此外,需要指出的是,本申请实施例中涉及的“第一”、“第二”等词汇,仅用于区分描述的目的,而不能理解为指示或暗示相对重要性,也不能理解为指示或暗示顺序。
应理解,本申请实施例中的声音(sound)指的是物体振动产生的声波,可以通过介质(空气或固体、液体)传播。其中,振幅和频率是用于描述声音的属性的物理量,具体的,振幅用于描述声音的响度大小,频率用于描述声音的音调大小。频率在20Hz~20kHz之间的声音是可以被人耳识别的,特别的频率在1000Hz~3000Hz之间的声音对于人耳来说最为敏感。
以下介绍电子设备、和用于使用这样的电子设备的实施例。示例的,本申请实施例中的电子设备可以是便携式电子设备,诸如手机、平板电脑、可穿戴设备(如增强现实(augmented reality,AR)设备等)等。例如,AR眼镜。便携式电子设备的示例性实施例包括但不限于搭载
Figure PCTCN2020083488-appb-000001
或者其它操作系统的便携式电子设备。上述便携式电子设备也可以是膝上型计算机(Laptop)、台式机等。
示例的,如图1所示,为本申请实施例的一种电子设备的结构示意图。具体的,如图所示,电子设备包括处理器110、音频模块120、麦克风121、扬声器122、传感器130、内部存储器140、外部存储器接口150、通用串行总线(universal serial bus,USB)接口160、充电管理模块170、电源管理模块171、和电池172。在另一些实施例中,电子设备还可以包括移动通信模块、按键等。需要说明的是,图1所示的硬件结构仅是一个示例。本申请实施例的电子设备可以具有比图中所示出的更多的或者更少的部件,可以组合两个或更多的部件,或者可以具有不同的部件配置。图中所示出的各种部件可以在包括一个或多个信号处理和/或专用集成电路在内的硬件、软件、或硬件和软件的组合中实现。
其中,处理器110可以包括一个或多个处理单元。示例的,处理器110包括应用处理器(application processor,AP)111、和信号处理模块112。具体的,信号处理模块112用于降低扬声器122播放的声音对采集的其它声音所造成的干扰。例如,其它声音可以为用户牙齿叩击振动所产生的声音等。需要说明的是,信号处理模块112可以为专用集成电路(application specific integrated circuit,ASIC),也可以为微控制单元(micro controller unit,MCU),还可以为其它处理模块,对此不作限定。还需要说明的是,信号处理模块112可以设置在处理器110中,也可以部分功能设置在处理器110中,还可以是独立的器件。此外,本申请实施例中,处理器110还可以包括调制解调器、基带处理器、图形处理器(graphics processing unit,GPU)、图像信号处理器(image signal processor,ISP)、视频编解码器、或数字信号处理器(digital signal processor,DSP)等中的一个或多个。其中,不同的处理 单元可以是独立的器件,也可以集成在一个或多个处理器中。
在一些实施例中,处理器110中还可以设置缓存器,用于存储指令和数据。示例的,处理器110中的缓存器可以为高速缓冲存储器。该缓存器可以用于保存处理器110刚用过的、循环使用的、或者生成的指令或数据。处理器110可以及从该存储器中直接调用指令或数据。有助于减少处理器110获取指令或数据的时间,从而提高系统的工作效率。示例的,处理器110中的一个或多个处理单元可以分别设置缓存器,例如,信号处理模块112中可以设置缓存器来存储相应的数据或信息。
内部存储器140可以用于存储一个或多个计算机程序,该一个或多个计算机程序包括指令。处理器110可以通过运行存储在内部存储器140的指令,从而使得电子设备100执行本申请实施例的去噪方法,以及其他功能应用以及数据处理等。内部存储器140可以包括存储程序区和存储数据区。其中,存储程序区可存储操作系统;该存储程序区还可以存储一个或多个应用程序(比如音乐播放器、联系人等)等。存储数据区可存储电子设备100使用过程中所创建的数据(比如音频文件、联系人等)等。此外,内部存储器140可以包括高速随机存取存储器,还可以包括非易失性存储器,例如一个或多个磁盘存储器件、闪存器件、通用闪存存储器(universal flash storage,UFS)等。在一些实施例中,处理器110可以通过运行存储在内部存储器140的指令、和/或存储在设置于处理器110中的存储器的指令,来使得电子设备执行本申请实施例中所提供的去噪方法,以及其他功能应用及数据处理。
外部存储器接口150可以用于连接外部存储卡(例如,Micro SD卡),实现扩展电子设备的存储能力。外部存储卡通过外部存储器接口150与处理器110通信,实现数据存储功能。例如将图像、音乐、视频等文件保存在外部存储卡中。
天线用于发射和接收电磁波信号。电子设备中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。在一些实施例中,天线可以和调谐开关结合使用。
无线通信模块180可以提供应用在电子设备上的包括无线局域网(wireless local area networks,WLAN)(如无线保真(wireless-fidelity,Wi-Fi)网络)、蓝牙(bluetooth,BT)、全球导航卫星系统(global navigation satellite system,GNSS)、调频(frequency modulation,FM)、近距离无线通信技术(near field communication,NFC)、红外技术(infrared,IR)等无线通信的解决方案。无线通信模块180可以是集成至少一个通信处理模块的一个或多个器件。例如,当电子设备与其它电子设备建立无线通信(例如蓝牙、WiFi)连接时,通过无线通信模块180接收其它电子设备发送的电磁波信号,无线通信模块180可以将接收到的电磁波信号发送给相应的模块进行解调等处理后,传递给AP111,由AP111进行后续处理。示例的,当无线通信模块180接收的电磁波信号中承载有音频信息时,例如,该音频信息可以为其它电子设备发送的待播放的音频、或者用户的语音等,AP111可以通过音频模块120、扬声器122从而输出声音信号。
电子设备可以通过音频模块120、麦克风121、扬声器122以及AP等实现音频功能。例如音乐播放、录音等。其中,音频模块120可以用于将数字音频信号转换成模拟音频信号输出,也用于将模拟音频信号转换为数字音频信号。音频模块120还可以用于对音频信号编码和解码。在一些实施例中,音频模块120可以设置于处理器110中,或将音频模块120的部分功能模块设置于处理器110中。需要说明的是,本申请实施例中音频模块120又可以称之为编解码器(codec)。
扬声器122,也称“喇叭”,用于将音频信号转换为声音信号,并播放。示例的,电子设备可以通过扬声器122收听音乐、或接听免提通话等。需要说明的是,本申请实施例中的电子设备可以设置一个或多个扬声器,对电子设备中设置的扬声器的类型不作限定。例如,电子设备可以设置一个骨传导扬声器、和一个传统的空气传导扬声器。再例如,电子设备可以设置一个骨传导扬声器。又例如,电子设备也可以设置一个传统的空气传导扬声器等。另外,在一些实施例中,音频模块120输出的音频信号可以经过放大器放大后,输出给扬声器122,并由扬声器122将音频信号转换为声音信号,并播放。从而有助于提高声音播放的质量。示例的,扬声器122播放的声音信号,可以是由AP111从内部存储器140、或者与外部存储器接口150连接的外部存储器中获取的,也可以是AP111从无线通信模块180获取的。本申请实施例对扬声器122播放的声音信号的来源不作限定。
麦克风122,也称“话筒”、“传声器”,用于将声音信号转换为电信号。当用户使用电子设备拨打电话或发送语音时,用户可以通过人嘴靠近麦克风122发声,麦克风122可以用于采集用户的声音,然后,将用户的声音转换为电信号。电子设备可以设置至少一个麦克风122。例如,电子设备可以设置两个麦克风122,有助于实现降噪功能。
传感器模块130可以包括一个或多个传感器。例如,加速度传感器、骨传导传感器等。其中,加速度传感器(G-sensor)可用于检测电子设备在各个方向上(一般为三轴)加速度的大小。当电子设备静止时可检测出重力的大小及方向。还可以用于识别电子设备姿态,应用于横竖屏切换、计步器等应用。在一些实施例中,加速度传感器还可以用于采集用户的牙齿叩击振动产生的加速度信息。有助于使得电子设备可以响应于牙齿叩击振动,进行相应的控制。由于牙齿叩击振动是用户的上下牙齿相互叩击产生的,不受四肢运动或发声的影响,也不受外界环境影响,因此有助于提高用户对电子设备进行控制的灵活性,另外,电子设备通过识别牙齿叩击振动还有助于提高对电子设备控制的隐秘性和保密性。
应理解,不同的牙齿叩击振动可以对应不同的控制方式。示例的,不同幅度的牙齿叩击振动对应不同的控制方式。例如,牙齿叩击声音的幅度小于某一阈值时,控制方式为暂停播放音频文件,牙齿叩击振动的幅度大于某一阈值时,控制方式为播放音频文件。再示例的,不同频次的牙齿叩击振动的可以对应不同的控制方式。例如,牙齿叩击振动的频次为1时对应的控制方式为接听电话,即牙齿叩击1次对应的控制方式为接听电话;再例如,牙齿叩击振动的频次为2时,对应控制方式为拒接来电。其中,牙齿叩击振动的频次为2,可以理解为牙齿连续叩击两次,且两次牙齿叩击之间的时间间隔小于某一门限时的产生的振动。
需要说明的是,本申请实施例中牙齿叩击振动对应的控制方式可以是用户根据自身需求进行设置的,也可以是电子设备在出厂之前设置好的,对此不作限定。示例的,第一牙齿叩击振动对应的控制方式为暂停扬声器播放音频文件,第二牙齿叩击振动对应的控制方式为播放音频文件列表中的下一个名称的音频文件,第三牙齿叩击振动对应的控制方式为以第一步长增大音量,第四牙齿叩击振动对应的控制方式为以第二步长减小音量。需要说明的是,第一牙齿振动、第二牙齿振动、第三牙齿振动和第四牙齿振动为不同频次和/或振幅的牙齿叩击振动。第一步长和第二步长可以相同,也可以不同。示例的,第一步长和第二步长可以是电子设备出厂之前设置好的,也可以是根据用户需求设置的。
例如,扬声器122当前正在播放音频文件1时,加速度传感器采集到第二牙齿叩击振动产生的加速度信息,则电子设备响应于第二牙齿叩击振动,播放音频文件2,其中,音 频文件2的名称为音频文件列表中音频文件1的名称的下一个音频文件的名称。再例如,扬声器122当前正在播放音频文件1时,加速度传感器采集到第一牙齿叩击振动产生的加速度信息,则电子设备响应于第一牙齿叩击振动,暂停播放音频文件1。又例如,扬声器122当前播放语音通话中其它用户的语音或者播放音频文件时,加速度传感器采集到第三牙齿叩击振动产生的加速度信息,则电子设备响应于第三牙齿叩击振动,以第一步长增大音量。
示例的,电子设备可以响应于牙齿叩击振动,实现对自身的控制。又示例的,电子设备还可以响应于牙齿叩击振动,向其他电子设备发送控制信号,从而实现对其它电子设备的控制。
骨传导传感器可以用于获取振动信号。在一些实施例中,骨传导传感器可以获取人体声部振动骨块的振动信号。骨传导传感器也可以采集人体脉搏信号、接收心脏跳动信号。应用处理器可以基于骨传导传感器获取的心脏跳动信号解析心率信息,实现心率检测功能等。
在另一些实施例中,处理器110还可以包括一个或多个接口。例如,USB接口160。再例如,接口还可以为集成电路音频(inter-integrated circuit sound,I2S)接口、脉冲编码调制(pulse code modulation,PCM)接口等。可以理解的是,本申请实施例处理器110可以通过接口连接电子设备的不同模块,从而使得电子设备能够实现不同的功能。例如拍照、处理等。需要说明的是,本申请实施例对电子设备中接口的连接方式不作限定。
充电管理模块170用于从充电器接收充电输入。其中,充电器可以是无线充电器,也可以是有线充电器。在一些有线充电的实施例中,充电管理模块170可以通过USB接口160接收有线充电器的充电输入。在一些无线充电的实施例中,充电管理模块170可以通过电子设备的无线充电线圈接收无线充电输入。充电管理模块170为电池172充电的同时,还可以通过电源管理模块171为电子设备供电。
电源管理模块171用于连接电池172、充电管理模块170与处理器110。电源管理模块171接收电池172和/或充电管理模块170的输入,为处理器110、内部存储器140、无线通信模块180等供电。电源管理模块171还可以用于监测电池容量,电池循环次数,电池健康状态(漏电,阻抗)等参数。在其他一些实施例中,电源管理模块171也可以设置于处理器110中。在另一些实施例中,电源管理模块171和充电管理模块1470也可以设置于同一个器件中。
下面结合图1所示的电子设备的结构,对本申请实施例提供的去噪方法进行详细说明。
示例的,如图2所示,为本申请实施例的一种去噪方法的流程示意图,包括以下步骤。
步骤201,电子设备获取第一音频信号。其中,第一音频信号用于指示电子设备的采集设备(例如麦克风、传感器等)采集到的信息。
示例的,第一音频信号可以是信号处理模块112根据加速度传感器采集的加速度信息获取的,也可以是信号处理模块112根据骨传导传感器采集的振动信号获取的,还可以是信号处理模块112根据麦克风采集的语音信号获取的等,对此不作限定。
步骤202,电子设备根据音频噪声模型,对第一音频信号进行处理,得到第二音频噪声,音频噪声模型用于指示扬声器外放时产生的音频信号。第二音频信号不包括扬声器外放时产生的音频信号。
需要说明的是,本申请实施例中,电子设备可以当扬声器外放时,根据音频噪声模型 对第一音频信号进行处理,也可以当无论扬声器是否外放,均可以根据音频噪声模型,对第一音频信号进行处理。
本申请实施例去噪的方法可以应用于关键词唤醒、语音控制、牙齿叩击振动控制、计步等场景中。以关键词唤醒为例,在关键词唤醒场景中,电子设备可以通过麦克风121采集用户的发出的带有“关键词”的声音,来唤醒电子设备。例如,关键词为“小艺小艺”。但是当电子设备的扬声器122外放时,麦克风采集用户发出的带有“关键词”的声音时,也会采集到扬声器122外放时发出的声音,而扬声器122外放发出的声音,会对电子设备根据麦克风采集到的声音识别“关键词”时造成干扰,因而,当麦克风采集到声音时,可以先将麦克风采集到的声音转换为音频信号,然后基于音频噪声模型,对音频信号进行去噪,从而可以降低扬声器122外放发出的声音对电子设备识别“关键词”的干扰,有助于提高“关键词”识别的可靠性。
类似的,在语音控制场景中,电子设备可以通过麦克风121采集用户发出的带有“命令词”的语音,例如命令词可以为“拨打小明的电话”“暂停播放”等,来实现对电子设备进行相应的控制。但是当电子设备的扬声器122外放时,麦克风121在采集用户发出的带有“命令词”的语音时,也会采集到扬声器122外放时发出的声音,而扬声器122外放发出的声音,会对电子设备根据麦克风采集到的声音识别“命令词”时造成干扰,因而,当麦克风采集到声音时,可以先将麦克风采集到的声音转换为音频信号,然后基于音频噪声模型,对音频信号进行去噪,从而可以降低扬声器122外放发出的声音对电子设备识别“命令词”的干扰,有助于提高对电子设备的可靠性。
例如,在计步场景中,电子设备可以通过加速度传感器采集人走路或跑步时振动产生的加速度信息,从而实现计步功能。但是当电子设备的扬声器122外放时,加速度传感器在采集到人走路或跑步时振动产生的加速度信息以外,还可以采集到扬声器122外放时振动产生的加速度信息,而扬声器122外放时振动产生的加速度信息,会对电子设备根据加速度传感器采集的加速度信息计步造成干扰,因而,当加速度传感器采集到加速度信息时,可以先将加速度信息转换为音频信号,然后基于音频噪声模型,对音频信号进行去噪,从而可以降低扬声器122外放振动对电子设备计步的干扰,有助于提高电子设备计步的准确性。
上述仅为本申请实施例应用场景的示例性说明,并不对本申请实施例的应用场景进行限定,其它受扬声器外放干扰的应用场景也可以采用本申请实施例的去噪方法。
在本申请的一些实施例中,电子设备中的信号处理模块112根据音频噪声模型,对第一音频信号进行处理,得到第二音频信号。
本申请实施例中音频噪声模型可以理解为预先构建的一个音频信号,该音频信号用于指示采集设备在扬声器外放时产生的音频信号中被采集设备采集到的情况。示例的,音频噪声模型可以是电子设备出厂之前设置好的,也可以是电子设备根据预设规则或算法建立的。
例如,如果音频噪声模型为电子设备出厂之前设置的,该音频噪声模型可以是电子设备根据参考音频信号得到的。其中,参考音频信号可以为电子设备播放预先存储的测试音频文件时得到的。
再例如,如果音频噪声模型是电子设备根据预设规则或算法建立的,电子设备可以当扬声器外放时,根据音频模块120输出的音频信号,建立音频噪声模型。
例如,电子设备当音频模块120检测到有音频信号持续输出时,可以每隔特定时长更新一次音频噪声模型。从而有助于提高扬声器外放理论上产生的噪声更符合实际情况。例如,用户在使用电子设备播放音乐、或者接听语音电话的情况下,电子设备可以周期性的根据音频模块120输出的特定时长内的音频信号建立音频噪声模型。特定时长可以是预先配置在电子设备中的,也可以是电子设备根据预设规则或算法确定的,例如1s、2s等。
还需要说明的是,当电子设备设置有多个扬声器时,音频噪声模型可以包括多个扬声器的音频噪声模型。例如,电子设备上设置有骨传导扬声器和传统的空气传导扬声器时,音频噪声模型包括骨传导扬声器的音频噪声模型和传统的空气传导扬声器的音频噪声模型。
在一些实施例中,电子设备根据音频模块120输出的音频信号和第一参数,建立音频噪声模型。其中,第一参数用于指示从扬声器传输到采集设备(例如麦克风、加速度传感器等)时的信号衰减大小。从而有助于提高建立的音频噪声模型的可靠性。可以理解的是,第一参数可以预先配置在电子设备中,也可以在电子设备预先配置一个第一参数的初始值,后续根据实际情况对第一参数进行更新。
例如,当电子设备为可穿戴设备如AR眼镜时,由于不同用户的头部存在差异性,可能会导致从扬声器到采集设备时信号衰减大小也会发生变化,因此,在一些实施例中,电子设备还可以根据第二音频信号和音频模块120输出的音频信号,判断是否更新第一参数。其中,第二音频信号为电子设备根据音频噪声模型对第一音频信号去噪后得到的音频信号。然后,电子设备如果更新了第一参数,则根据更新后的第一参数,重新建立音频噪声模型。从而有助于进一步提高建立的音频噪声模型的可靠性。例如,第二音频信号中还包括部分音频模块120输出的音频信号,则可以更新第一参数,增大第一参数指示的从扬声器传输到采集设备(例如麦克风、加速度传感器等)时的信号衰减大小。
在另一些实施例中,电子设备120根据音频模块120输出的音频信号、第一参数和第二参数,建立音频噪声模型。其中,第一参数用于指示从扬声器传输到采集设备(例如麦克风、加速度传感器等)时的信号衰减大小。第二参数用于指示从扬声器到采集设备之间信号传输路径的特性。例如,信号传输路径的时延大小、信号传输速率的大小等。
可以理解的是,第二参数可以预先配置在电子设备中,也可以根据预设算法确定,对此不作限定。
上述仅为音频造型模型建立的具体实现方式的举例说明,本申请实施例还可以通过其它方式建立音频噪声模型,对此不作限定。
本申请实施例中由于可以根据音频噪声模型对音频信号进行处理,从而有助于降低扬声器外放造成的干扰。另外,需要说明的是,本申请实施例中可以无需调整扬声器外放的音量。
以通过牙齿叩击振动实现电子设备控制为例,电子设备响应于用户的牙齿叩击振动,进行控制。但是电子设备在信息采集时,自身扬声器的外放产生的声音是阻碍电子设备识别用户的牙齿叩击振动的干扰信号,而本申请实施例中的信号处理模块112可以降低扬声器外放的干扰,提高电子设备识别牙齿叩击振动的准确性。
示例的,如图3所示,为本申请实施例的信号处理模块112的一种具体结构示意图。具体包括转换器(converter)、加法器、触发器(trigger)、缓存器(buffer)、鉴别器(identificaiton)、自适应滤波器(adaptive filter)、路径检测器(path change detect)、延时器(time delay)。 需要说明的是,本申请实施例中延时器还可以设置在自适应滤波器和加法器之间。在另一些实施例中信号处理模块112还包括预处理器(Rx-preprocessing)。此外,本申请实施例中的加法器还可以替换为减法器。需要说明的是,图2所示的结构仅是一个示例。本申请实施例的信号处理器模块112可以具有比图中所示出的更多的或者更少的部件,可以组合两个或更多的部件,或者可以具有不同的部件配置。
下面结合图3所示的信号处理器模块112的结构,对电子设备识别用户的牙齿叩击声音,从而实现对电子设备的控制进行相应的说明。
在一些实施例中,电子设备获取到第一音频信号后,根据音频噪声模型对第一音频信号进行处理,得到第二音频信号,然后根据第二音频信号得到控制信号,并根据控制信号进行相应的控制。音频噪声模型用于指示扬声器外放时产生的音频信号。
示例的,加速度传感器用于采集三轴方向上的加速度信息,例如,加速度信息中包括牙齿叩击振动所产生的加速度信息和扬声器外放所产生的加速度信息。
转换器用于将加速度传感器采集的加速度信息转化为第一音频信号(例如集成电路内置音频(inter-integrated circuit sound,I2S)信号)。
当扬声器122播放声音信号时,转换器将第一音频信号输出给加法器,由加法器根据自适应滤波器输出的音频噪声模型对第一音频信号进行去噪,得到第二音频信号,然后将第二音频信号输出给触发器,触发器根据第二音频信号,进行相应的输出,并将相应的输出缓存到缓存器,鉴别器从缓存器中读取触发器的输出,得到控制信号,其中该控制信号用于基于牙齿叩击声音产生的音频信号。鉴别器当得到控制信号后,向AP111输出中断,AP111接收到鉴别器输出的中断后,从鉴别器中读取控制信号,然后根据控制信号进行相应的控制。此外,在另一些实施例中,电子设备在读取的控制信号后,还可以对其它电子设备进行相应的控制。例如,控制信号指示电子设备停止扬声器的播放,则电子设备控制自身扬声器停止播放,或者其它电子设备的扬声器停止播放等。
在一些实施例中,AP当向音频模块120输出音频信号时,可以控制转换器将得到第一音频信号输出给加法器。
在另一些实施例中,当扬声器122未播放声音信号时,转换器还可以将第一音频信号输出给触发器。示例的,AP当未向音频模块120输出音频信号时,可以控制转换器将得到第一音频信号输出给触发器。
此外,在一些实施例中,人走路、跑步或说话产生的振动也可能会被加速度传感器所采集,影响电子设备识别牙齿叩击振动得到控制信号,由于人走路或跑步所产生的音频信号的频率通常低于3Hz,人说话所产生的音频信号的振幅为0.3m/s 2,而牙齿叩击振动所产生的音频信号的频率通常在3Hz以上,振幅大约为1m/s 2,因此,触发器可以根据音频信号的频率和振幅进行相应的输出,从而可以降低人走路、跑步或人说话对牙齿叩击所产生的音频信号的干扰,使得触发器的输出是根据牙齿叩击振动所产生的音频信号的输出的,从而有助于提高鉴别器根据触发器的输出得到控制信号的准确性,进而提高控制电子设备的准确性。
例如,触发器可以当音频信号的频率在3Hz以上、振幅为不低于1m/s 2时,有相应的输出,而音频信号的频率低于3Hz或者振幅低于1m/s 2时,不进行相应的输出。再例如,例如,触发器可以当音频信号的频率在3Hz以上、振幅为不低于1m/s 2时,输出1,而音频信号的频率低于3Hz或者振幅低于1m/s 2时,输出0。
在一些实施例中,电子设备是基于音频模块120输出的音频信号确定音频噪声模型的。
示例的,自适应滤波器是根据音频模块120输出的音频信号确定音频噪声模型的。具体的,音频模块120可以接收AP111发送的音频信号,然后对音频信号进行相应的编解码等处理后,将音频信号发送给预处理器,预处理器在接收到音频模块发送的音频信号后,对音频信号进行相应的预处理(例如音效处理等),然后发送给延时器,其中延时器在延迟预设时长后,将预处理后的音频信号发送给自适应滤波器,由自适应滤波器根据预处理后的音频信号建立音频噪声模型。需要说明的是,延时器延迟的预设时长可以是预先配置在电子设备中的,也可以是根据预设算法确定的。通过延时预设时长,有助于同步扬声器外放产生的噪声与牙齿叩击声音的输入。
例如,自适应滤波器是根据预处理后的音频信号、第一参数和第二参数,建立音频噪声模型的,其中,第一参数用于指示从扬声器传输到加速度传感器时的信号衰减大小。第二参数用于指示从扬声器到加速度传感器之间信号传输路径的特性。
路径检测器还可以用于根据加法器输出的音频信号和延时器输出的音频信号,判断是否更新第一参数,如果更新第一参数,可以通知自适应滤波器重新建立音频噪声模型。又示例的,当路径检测器更新第一参数后,将更新后的第一参数发送给自适应滤波器,自适应滤波器根据更新后的第一参数,重新建立音频噪声模型。从而有助于提高音频噪声模型能够更加符合扬声器外放实际造成的干扰情况。
需要说明的是,图3所示的信号处理模块112的具体结构中,延时器输出的音频信号和预处理器输出的音频信号是相同的。在本申请实施例中延时器还可以设置在自适应滤波器和加法器之间。
在另一些实施例中,加法器输出的音频噪声还可以输出给自适应滤波器,自适应滤波器根据加法器输出的音频噪声和延时器输出的音频噪声判断是否更新音频噪声模型。如果需要更新音频噪声模型,可以从路径检测器中获取第一参数。在这种情况下,路径检测器当判断更新第一参数后,可以更新第一参数,但不通知自适应滤波器。自适应滤波器如果检测到需要更新音频噪声模型,则再从路径检测器中获取更新后第一参数。
此外,本申请实施例中信号处理模块112可以不包括预处理器,在这种情况下,自适应滤波器和路径检测器接收的是来自音频模块120输出的音频信号,具体实现方式可以参见预处理器向自适应滤波器和路径检测器输出音频信号时的实现方式,在此不再赘述。
示例的,本申请实施例的电子设备可以为AR眼镜,当电子设备为AR眼镜时,可以将加速度传感器设置在镜腿弯折部分附近,将处理器设置在靠近镜片的镜腿附近。例如,处理器包括AP和信号处理模块。示例的处理器和加速度传感器在AR眼镜上设置的位置可以如图4所示,由于镜腿弯折部分附近贴近人体的太阳穴,对牙齿叩击振动的感知更加灵敏。需要说明的是,图4仅为示例性说明,并不对本申请实施例加速度传感器和处理器在AR眼镜上的位置进行限定。
本申请中的各个实施例可以独立使用,也可以相互结合使用,以实现不同的技术效果。
上述本申请提供的实施例中,从电子设备作为执行主体的角度对本申请实施例提供的方法进行了介绍。为了实现上述本申请实施例提供的方法中的各功能,电子设备可以包括硬件结构和/或软件模块,以硬件结构、软件模块、或硬件结构加软件模块的形式来实现上述各功能。上述各功能中的某个功能以硬件结构、软件模块、还是硬件结构加软件模块的方式来执行,取决于技术方案的特定应用和设计约束条件。
如图5所示,本申请实施例公开了一种电子设备500,该电子设备500可以包括:采集设备501、扬声器502、一个或多个处理器503、存储器504和一个或多个计算机程序。其中该一个或多个计算机程序被存储在上述存储器504中,且一个或多个计算机程序包括指令。当处理器503调用所述指令时,使得电子设备500执行本申请实施例的去噪方法。
上述各个实施例中涉及处理器可以是通用处理器、数字信号处理器(digital signal processor,DSP)、专用集成电路(application specific integrated circuit,ASIC)、现成可编程门阵列(field programmable gate array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。可以实现或者执行本申请实施例中的公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。结合本申请实施例所公开的方法的步骤可以直接体现为硬件译码处理器执行完成,或者用译码处理器中的硬件及软件模块组合执行完成。软件模块可以位于随机存取存储器(random access memory,RAM)、闪存、只读存储器(read-only memory,ROM)、可编程只读存储器或者电可擦写可编程存储器、寄存器等本领域成熟的存储介质中。该存储介质位于存储器,处理器读取存储器中的指令,结合其硬件完成上述方法的步骤。
本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能。
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统、装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。
在本申请所提供的几个实施例中,应该理解到,所揭露的系统、装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。
所述功能如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)或处理器(processor)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、ROM、RAM、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到的变化或替换,都应涵 盖在本申请的保护范围之内,因此本申请的保护范围应以权利要求的保护范围为准。

Claims (9)

  1. 一种去噪方法,其特征在于,所述方法包括:
    电子设备获取第一音频信号,其中,所述第一音频信号用于指示所述电子设备的采集设备采集到的信息;
    所述电子设备当扬声器外放时,根据音频噪声模型,对所述第一音频信号进行处理,得到第二音频信号,所述音频噪声模型用于指示所述扬声器外放时产生的音频信号;所述第二音频信号不包括所述扬声器外放时产生的音频信号。
  2. 如权利要求1所述的方法,其特征在于,所述采集设备为加速度传感器、或者麦克风。
  3. 如权利要求1或2所述的方法,其特征在于,所述方法还包括:
    所述电子设备根据所述第二音频信号中频率和振幅满足预设条件的音频信号,控制所述电子设备。
  4. 如权利要求3所述的方法,其特征在于,所述第二音频信号中频率和振幅满足预设条件的音频信号为牙齿叩击振动所产生的音频信号。
  5. 如权利要求1至4任一所述的方法,其特征在于,所述音频噪声模型是所述电子设备根据第三音频信号得到的,所述第三音频信号用于指示输出给所述扬声器的音频信号。
  6. 如权利要求5所述的方法,其特征在于,所述方法还包括:
    所述电子设备根据所述第二音频信号和所述第三音频信号,判断是否更新音频噪声模型。
  7. 一种电子设备,其特征在于,所述电子设备包括:
    至少一个处理器;
    存储器;
    扬声器;
    采集设备;
    一个或多个计算机程序,所述一个或多个计算机程序被存储在所述存储器中;
    所述一个或多个计算机程序包括指令,当所述指令被所述电子设备执行时,使得所述电子设备执行如权利要求1至6任一所述的方法。
  8. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质包括指令,当所述指令在电子设备上运行时,使得所述电子设备执行如权利要求1至6任一项所述的方法。
  9. 一种芯片,其特征在于,所述芯片与电子设备中的存储器耦合,使得所述芯片在运行时调用所述存储器中存储的指令,实现如权利要求1至6任一所述的方法。
PCT/CN2020/083488 2019-04-12 2020-04-07 一种去噪方法及电子设备 WO2020207376A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910295436.0 2019-04-12
CN201910295436.0A CN110187859A (zh) 2019-04-12 2019-04-12 一种去噪方法及电子设备

Publications (1)

Publication Number Publication Date
WO2020207376A1 true WO2020207376A1 (zh) 2020-10-15

Family

ID=67714157

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/083488 WO2020207376A1 (zh) 2019-04-12 2020-04-07 一种去噪方法及电子设备

Country Status (2)

Country Link
CN (1) CN110187859A (zh)
WO (1) WO2020207376A1 (zh)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110187859A (zh) * 2019-04-12 2019-08-30 华为技术有限公司 一种去噪方法及电子设备
CN113056096A (zh) * 2019-12-29 2021-06-29 苏州匠致电子科技有限公司 基于龙芯2k的国产控制主板
CN113313136A (zh) * 2020-02-27 2021-08-27 惠州迪芬尼声学科技股份有限公司 用于电子设备的运动特征检测方法和装置以及扬声器
CN117716208A (zh) * 2022-06-20 2024-03-15 北京小米移动软件有限公司 计步方法、装置、耳机及存储介质
CN117135538B (zh) * 2023-02-21 2024-06-28 荣耀终端有限公司 扬声器驱动电路及电子设备
CN117059062B (zh) * 2023-10-12 2024-04-05 荣耀终端有限公司 一种降低噪声的方法、存储介质及电子设备

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104795066A (zh) * 2014-01-17 2015-07-22 株式会社Ntt都科摩 语音识别方法和装置
CN106569774A (zh) * 2016-11-11 2017-04-19 青岛海信移动通信技术股份有限公司 一种去除噪声的方法及终端
CN107105367A (zh) * 2017-05-24 2017-08-29 维沃移动通信有限公司 一种音频信号处理方法及终端
US20180293049A1 (en) * 2014-07-21 2018-10-11 Intel Corporation Distinguishing speech from multiple users in a computer interaction
CN108958477A (zh) * 2018-06-08 2018-12-07 张沂 交互方法、装置、电子设备及计算机可读存储介质
CN109087650A (zh) * 2018-10-24 2018-12-25 北京小米移动软件有限公司 语音唤醒方法及装置
CN110187859A (zh) * 2019-04-12 2019-08-30 华为技术有限公司 一种去噪方法及电子设备

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8787591B2 (en) * 2009-09-11 2014-07-22 Texas Instruments Incorporated Method and system for interference suppression using blind source separation
WO2015196434A1 (zh) * 2014-06-26 2015-12-30 华为技术有限公司 一种降噪方法、装置及移动终端

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104795066A (zh) * 2014-01-17 2015-07-22 株式会社Ntt都科摩 语音识别方法和装置
US20180293049A1 (en) * 2014-07-21 2018-10-11 Intel Corporation Distinguishing speech from multiple users in a computer interaction
CN106569774A (zh) * 2016-11-11 2017-04-19 青岛海信移动通信技术股份有限公司 一种去除噪声的方法及终端
CN107105367A (zh) * 2017-05-24 2017-08-29 维沃移动通信有限公司 一种音频信号处理方法及终端
CN108958477A (zh) * 2018-06-08 2018-12-07 张沂 交互方法、装置、电子设备及计算机可读存储介质
CN109087650A (zh) * 2018-10-24 2018-12-25 北京小米移动软件有限公司 语音唤醒方法及装置
CN110187859A (zh) * 2019-04-12 2019-08-30 华为技术有限公司 一种去噪方法及电子设备

Also Published As

Publication number Publication date
CN110187859A (zh) 2019-08-30

Similar Documents

Publication Publication Date Title
WO2020207376A1 (zh) 一种去噪方法及电子设备
JP7426470B2 (ja) 音声起動方法及び電子デバイス
US9620116B2 (en) Performing automated voice operations based on sensor data reflecting sound vibration conditions and motion conditions
CN108735219B (zh) 一种声音识别控制方法及装置
KR20180062270A (ko) 이어폰 오장착 검출 방법, 이를 위한 전자 장치 및 저장 매체
CN110070863A (zh) 一种语音控制方法及装置
CN112532266A (zh) 智能头盔及智能头盔的语音交互控制方法
CN112992169A (zh) 语音信号的采集方法、装置、电子设备以及存储介质
CN111696562B (zh) 语音唤醒方法、设备及存储介质
US20220303688A1 (en) Activity Detection On Devices With Multi-Modal Sensing
US11533574B2 (en) Wear detection
US20220307862A1 (en) Step counting method of earphone, earphone and non-transitory storage medium
CN116324969A (zh) 具有定位反馈的听力增强和可穿戴系统
WO2022161077A1 (zh) 语音控制方法和电子设备
WO2022199405A1 (zh) 一种语音控制方法和装置
US20220230657A1 (en) Voice control method and apparatus, chip, earphones, and system
US20230239800A1 (en) Voice Wake-Up Method, Electronic Device, Wearable Device, and System
WO2024179425A1 (zh) 语音交互方法及相关设备
CN111028838A (zh) 一种语音唤醒方法、设备及计算机可读存储介质
WO2020019844A1 (zh) 语音数据处理方法及相关产品
CN111048109A (zh) 声学特征的确定方法、装置、计算机设备及存储介质
CN110049395B (zh) 耳机控制方法及耳机设备
CN114520002A (zh) 一种处理语音的方法及电子设备
CN109144461A (zh) 发声控制方法、装置、电子装置及计算机可读介质
CN113973149A (zh) 电子设备及其器件故障检测方法和介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20787934

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20787934

Country of ref document: EP

Kind code of ref document: A1