TW202242856A - Open-back headphones - Google Patents

Abstract

The present disclosure may disclose an open-back headphone, including: a fixed structure, configured to fix the headphone at the position near the user's ears and does not block the ear channel; and a shell structure, configured to bear: a first microphone array configured to collect environmental noise; at least one speaker array; and a signal processor configured to: estimate the noise of a first space position based on the collected environmental noise, the first space position is closer to the user's ear channel than any microphone in the first microphone array; and generate denoise signal based on the noise of the first space position, so that the at least one speaker array may output a denoise wave according to the denoise signal, and the denoise wave may be used to eliminate the environmental noise transmitted to the user's ear channel.

Description

open earphones

This application relates to the field of acoustics, in particular to an open earphone.

This application claims priority to International Patent Application No. PCT/CN2021/089670 filed on April 25, 2021, the entire contents of which are incorporated herein by reference.

The headset device allows users to listen to audio content and make voice calls while ensuring the privacy of the user's interactive content, and does not disturb the surrounding people when listening. Headphone devices can generally be classified into two types: in-ear headphone devices and open-type headphone devices. The in-ear earphone device will block the user's ear during use, and the user is prone to experience blockage, foreign objects, swelling pain and the like when wearing it for a long time. The open earphone device can open the user's ear, which is beneficial to long-term wearing, but when the external noise is large, its noise reduction effect is not obvious, making the user's listening experience poor.

Therefore, it is desirable to provide an open earphone that can open both ears of the user and improve the user's listening experience.

An embodiment of the present invention provides an open earphone, comprising: a fixing structure configured to fix the earphone near the user's ear without blocking the user's ear canal; a shell structure configured to carry: a first microphone an array configured to pick up ambient noise; at least one loudspeaker array; and a signal processor configured to: estimate noise at a first spatial location based on the picked up ambient noise, the first spatial location being smaller than the Any microphone in the first microphone array is closer to the user's ear canal; and a noise reduction signal is generated based on the noise at the first spatial position, so that the at least one speaker array outputs a noise reduction signal according to the noise reduction signal waves, the noise reduction waves are used to eliminate the environmental noise transmitted to the user's ear canal.

In some embodiments, the housing structure is configured to accommodate a second microphone array configured to pick up the environmental noise and the de-noise wave, the second microphone array being at least partially distinct from the first microphone array; and the signal processor is configured to update the noise reduction signal based on sound signals picked up by the second microphone array.

In some embodiments, updating the noise reduction signal based on the sound signal picked up by the second microphone array includes: based on the sound signal picked up by the second microphone array, Estimating the sound field of the user; and adjusting parameter information of the noise reduction signal according to the sound field at the ear canal of the user.

In some embodiments, the second array of microphones includes a microphone that is closer to the user's ear canal than any microphone in the first array of microphones.

In some embodiments, the signal processor estimating the noise at the first spatial position based on the picked-up environmental noise includes: performing signal separation according to the picked-up environmental noise, and obtaining the environmental noise corresponding Parameter information of , generating the noise reduction signal based on the parameter information.

In some embodiments, the signal processor estimating noise at the first spatial location based on the picked-up environmental noise comprises: determining one or more spatial noise sources related to the picked-up environmental noise; And based on the spatial noise source, the noise of the first spatial location is estimated.

In some embodiments, determining one or more of the spatial noise sources related to the picked-up environmental noise includes: dividing the picked-up environmental noise into a plurality of sub-bands, each sub-band corresponding to a different frequency range ; and on at least one subband, determining the spatial noise source corresponding thereto.

In some embodiments, the first microphone array includes a first sub-microphone array and a second sub-microphone array, and the first sub-microphone array and the second sub-microphone array are respectively located on the left ear and the right ear of the user. where, determining the spatial noise source corresponding to the at least one sub-band includes: obtaining a user head function, the user head function reflects the reflection or absorption of the sound by the user's head; and in the at least one On the sub-band, combine the environmental noise picked up by the first sub-microphone array, the environmental noise picked up by the second sub-microphone array, and the user head function to determine the corresponding spatial noise source.

In some embodiments, the first microphone array includes a noise microphone, the at least one loudspeaker array forms at least one set of acoustic dipoles, and the noise microphone is located at an acoustic null of the dipole radiation sound field.

In some embodiments, the at least one microphone array includes a bone conduction microphone configured to pick up the voice of a user, and the signal processor estimates the first The noise of the spatial position includes: removing components associated with the signal picked up by the bone conduction microphone from the picked-up environmental noise, so as to update the environmental noise; and estimating the environmental noise based on the updated environmental noise Noise at the first spatial location.

In some embodiments, the at least one microphone array includes a bone conduction microphone and an air conduction microphone, and the signal processor controls switching states of the bone conduction microphone and the air conduction microphone based on the working state of the earphone.

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings that need to be used in the description of the embodiments. Apparently, the accompanying drawings in the following description are only some examples or embodiments of the present invention, and for those skilled in the art, the present invention can also be translated according to these drawings without making progressive efforts. The invention applies to other similar scenarios. Unless otherwise apparent from context or otherwise indicated, like reference symbols in the drawings represent like structures or operations.

It should be understood that "system", "device", "unit" and/or "module" as used herein is a method for distinguishing different elements, components, parts, parts or assemblies of different levels. However, the words may be replaced by other expressions if other words can achieve the same purpose.

As shown in the present invention and scope of patent claims, words such as "a", "an", "an" and/or "the" are not specific to the singular and may also include the plural, unless the context clearly indicates an exception. Generally speaking, the terms "comprising" and "comprising" only suggest the inclusion of clearly identified steps and elements, and these steps and elements do not constitute an exclusive list, and the method or device may also contain other steps or elements.

The flow chart is used in the present invention to illustrate the operations performed by the system according to the embodiment of the present invention. It should be understood that the preceding or following operations are not necessarily performed in the exact order. Instead, various steps may be processed in reverse order or simultaneously. At the same time, other operations can also be added to these processes, or operations of a certain step or several steps can be removed from these processes.

An open-back headset is a headphone device that opens the ear of the user. Open earphones can fix the speaker near the user's ear without blocking the user's ear canal through a fixed structure (eg, ear hook, head hook, etc.). When the user uses the open earphone, the external environment noise can also be heard by the user, which makes the user's listening experience poor. For example, in places where the external environment is noisy (for example, streets, scenic spots, etc.), when the user uses open earphones to play music, the noise of the external environment will directly enter the user's ear canal, so that the user can hear a loud noise. Ambient noise. Ambient noise will interfere with the user's listening experience. For another example, when a user wears an open earphone for a call, the microphone will not only pick up the user's own voice, but also pick up ambient noise, making the user's call experience poor.

Based on the above problems, the embodiments of this specification provide an open earphone. In some embodiments, the open earphone may include a fixed structure, a shell structure, a first microphone array, at least one loudspeaker array and a signal processor. Wherein, the fixing structure is configured to fix the open earphone near the user's ear and not block the user's ear canal. The housing structure is configured to house a first microphone array, at least one speaker array, and a signal processor. The first microphone array is configured to pick up ambient noise. The signal processor is configured to estimate noise at a first spatial position based on environmental noise picked up by the first microphone array, and generate a noise-reduced signal based on the noise at the first spatial position, where the first spatial position is larger than the first microphone array Either microphone is brought closer to the user's ear canal. It can be understood here that the microphones in the first microphone array can be distributed in different positions near the user's ear canal, and the location close to the user's ear canal can be estimated by collecting environmental noise signals from the microphones in the first microphone array. (eg, the first spatial position) of the noise. The at least one loudspeaker array is configured to output a noise reduction wave based on the noise reduction signal, and the noise reduction wave can be used to cancel ambient noise delivered to the user's ear canal. In some embodiments, the open earphone may further include a second microphone array configured to pick up environmental noise and noise reduction waves output by the at least one speaker array. In some embodiments, the signal processor may update the noise reduction signal based on the sound signal picked up by the second microphone array. For example, the signal processor can estimate the sound field at the user's ear canal based on the sound signal picked up by the second microphone array, and adjust the phase or amplitude of the noise reduction signal according to the sound field at the user's ear canal to achieve noise reduction Signal updates. In the embodiment of this specification, the noise reduction wave is used to eliminate the environmental noise at the user's ear canal through the above method, realizing the active noise reduction of the open earphone and improving the user's listening experience in the process of using the open earphone .

FIG. 1 is an exemplary block diagram of an open-back earphone provided according to some embodiments of the present invention. As shown in FIG. 1 , the open earphone 100 may include a shell structure 110, a first microphone array 130, a signal processor 140 and a speaker array 150, wherein the first microphone array 130, the signal processor 140 and the speaker array 150 are located in the shell body structure 110. The open earphone 100 can fix the earphone near the user's ear through the fixing structure 120 without blocking the user's ear canal. In some embodiments, the first microphone array 130 located at the shell structure 110 can pick up the environmental noise at the ear canal of the user, and convert the picked-up environmental noise signal into an electrical signal and send it to the signal processor 140 for further processing. signal processing. The signal processor 140 is coupled to the first microphone array 130 and the speaker array 150. The signal processor 140 receives the environmental noise signal picked up by the first microphone array 130 and performs signal processing on it to obtain parameter information of the environmental noise (for example, amplitude value information, phase information, etc.). The signal processor 140 can estimate the noise at the first spatial position of the user based on parameter information of the environmental noise (eg, amplitude information, phase information, etc.), and generate a noise reduction signal based on the noise at the first spatial position. The parameter information of the noise reduction signal corresponds to the parameter information of the environmental noise. For example, the amplitude of the noise reduction signal is approximately equal to the amplitude of the environmental noise, and the phase of the noise reduction signal is approximately opposite to that of the environmental noise. . The signal processor 140 transmits the generated noise reduction signal to the speaker array 150 . The loudspeaker array 150 can output a noise reduction wave according to the noise reduction signal generated by the signal processor 140, and the noise reduction wave can cancel out the environmental noise at the position of the user's ear canal, thereby realizing the active noise reduction of the open earphone 100 , to improve the listening experience of the user in the process of using the open earphone 100 .

The housing structure 110 may be configured to carry the first microphone array 130 , the signal processor 140 and the speaker array 150 . In some embodiments, the housing structure 110 may be a closed or semi-closed housing structure with a hollow inside, and the first microphone array 130 , the signal processor 140 and the speaker array 150 are located at the housing structure 110 . In some embodiments, the shape of the housing structure 110 may be a regular or irregular three-dimensional structure such as a cuboid, cylinder, or truncated cone. When the user wears the open earphone 100, the shell structure 110 can be located near the user's ear, for example, the shell structure 110 can be located on the peripheral side (for example, the front side or the back side) of the user's auricle, or on the On the user's ear but does not block or cover the user's ear canal. In some embodiments, the open earphone 100 may be a bone conduction earphone, and at least one side of the shell structure 110 may be in contact with the user's head skin. The acoustic driver (eg, vibrating speaker) in the bone conduction earphone converts the audio signal into mechanical vibration, which can be transmitted to the user's auditory nerve through the shell structure 110 and the user's bones. In some embodiments, the open earphone 100 may be an air conduction earphone, and at least one side of the housing structure 110 may or may not be in contact with the user's head skin. The side wall of the housing structure 110 includes at least one sound guide hole. The speaker in the air conduction earphone converts the audio signal into air conduction sound, and the air conduction sound can radiate toward the user's ear through the sound guide hole.

The first microphone array 130 may be configured to pick up environmental noise. In some embodiments, environmental noise refers to a combination of various external sounds in the environment where the user is located. In some embodiments, environmental noise may include one or more of traffic noise, industrial noise, building construction noise, social noise, and the like. In some embodiments, the traffic noise may include, but not limited to, the driving noise of motor vehicles, the honking noise, and the like. Industrial noise may include, but is not limited to, factory power machinery running noise, etc. Building construction noise may include but not limited to power machinery excavation noise, hole drilling noise, stirring noise, etc. Social and living environment noise may include, but is not limited to, mass gathering noise, entertainment publicity noise, crowd noise, household appliance noise, etc. In some embodiments, the first microphone array 130 can be arranged near the user's ear canal to pick up the environmental noise transmitted to the user's ear canal, and the first microphone array 130 can convert the picked-up environmental noise signal It is an electrical signal and transmitted to the signal processor 140 for signal processing. In some embodiments, the environmental noise may also include the voice of the user speaking. For example, when the open earphone 100 is not in a call state, the sound generated by the user's own speech can also be regarded as environmental noise, and the first microphone array 130 can pick up the user's own speech and other environmental noise, and will use The voice signal and other environmental noise generated by the speaker's speech are converted into electrical signals and transmitted to the signal processor 140 for signal processing. In some embodiments, the first microphone array 130 may be distributed at the left ear or the right ear of the user. In some embodiments, the first microphone array 130 may also be located at the left and right ears of the user. For example, the first microphone array 130 may include a first sub-microphone array and a second sub-microphone array, wherein the first sub-microphone array is located at the user's left ear, the second sub-microphone array is located at the user's right ear, and the second sub-microphone array is located at the user's right ear. The first sub-microphone array and the second sub-microphone array can enter the working state at the same time or one of them can enter the working state.

In some embodiments, the first microphone array 130 may include air conduction microphones and/or bone conduction microphones. For example, in some embodiments, first microphone array 130 may include one or more air conduction microphones. For example, when the user listens to music with the open earphone 100, the air conduction microphone can simultaneously acquire the noise of the external environment and the voice of the user when speaking, and convert it into an electrical signal as the environmental noise and transmit it to the signal processor 140. to process. In some embodiments, the first microphone array 130 may also include one or more bone conduction microphones. In some embodiments, the bone conduction microphone can be directly in contact with the user's head skin, and the vibration signal generated by the facial bones or muscles of the user can be directly transmitted to the bone conduction microphone when the user speaks, and then the bone conduction microphone converts the vibration signal into an electric current. signal, and transmit the electrical signal to the signal processor 140 for signal processing. In some embodiments, the bone conduction microphone may not be in direct contact with the human body. When the user speaks, the vibration signal generated by the facial bones or muscles may be transmitted to the shell structure 110, and then transmitted to the bone conduction microphone by the shell structure 110. A bone conduction microphone further converts the human body vibration signal into an electrical signal containing voice information. For example, when the user is in a call state, the signal processor 140 can use the sound signal collected by the air conduction microphone as environmental noise for noise reduction processing, and the sound signal collected by the bone conduction microphone as a voice signal, so as to ensure call quality. In some embodiments, according to the working principle of the microphones, the first microphone array 130 may include dynamic microphones, ribbon microphones, condenser microphones, electret microphones, electromagnetic microphones, carbon microphones, etc., or any combination thereof. In some embodiments, the array arrangement of the first microphone array 130 can be a linear array (for example, linear, curved), planar array (for example, cross-shaped, circular, circular, polygonal, mesh-shaped, etc. and/or irregular shape) or a three-dimensional array (for example, cylindrical, spherical, hemispherical, polyhedral, etc.), for the arrangement of the first microphone array 130, please refer to FIG. 8 and its related contents in this specification.

The signal processor 140 is configured to estimate the noise at the first spatial location based on the environmental noise picked up by the first microphone array 130 , and generate a noise reduction signal based on the noise at the first spatial location. The first spatial position refers to a spatial position close to the user's ear canal by a certain distance, and the first spatial position is closer to the user's ear canal than any microphone in the first microphone array 130 . The specific distance here may be a fixed distance, for example, 0.5 cm, 1 cm, 2 cm, 3 cm and so on. In some embodiments, the first spatial position is related to the distribution position and quantity of each microphone in the first microphone array 130 relative to the user's ear, by adjusting the distribution position and quantity of each microphone in the first microphone array 130 relative to the user's ear and/or the quantity can be adjusted for the first spatial position. For example, increasing the number of microphones in the first microphone array 130 can make the first spatial position closer to the user's ear canal.

The signal processor 140 may perform signal processing on the received environmental noise signal to estimate the noise at the first spatial location. In some embodiments, the signal processor 140 may be coupled to the first microphone array 130 and the speaker array 150, and the signal processor 140 may receive the environmental noise picked up by the first microphone array 130 to estimate the noise at the first spatial location. For example, signal processor 140 may determine one or more sources of spatial noise related to picked-up ambient noise. For another example, the signal processor 140 may perform orientation estimation, phase information estimation, amplitude information estimation, etc. on the spatial noise source related to the environmental noise. The signal processor 140 can generate a noise-reduced signal according to the noise estimate (eg, phase information, amplitude information) of the first spatial location. The noise reduction signal refers to a sound signal that is approximately equal in amplitude and opposite in phase to the noise at the first spatial position.

The speaker array 150 is configured to output a noise reduction wave based on the noise reduction signal, and the noise reduction wave is used to eliminate environmental noise transmitted to the user's ear canal. In some embodiments, the speaker array 150 may be disposed at the shell structure 110 , and when the user wears the open earphone 100 , the speaker array 150 may be located near the ear of the user. In some embodiments, the speaker array 150 may output a noise reduction wave based on the noise reduction signal to cancel out the environmental noise at the first spatial location. As an example only, for example, the signal processor 140 controls the speaker array 150 to output a sound signal having approximately equal amplitude and approximately opposite phase to the noise at the first spatial position to cancel the noise at the first spatial position. In some embodiments, the distance between the first spatial position and the user's ear canal is relatively small, the noise at the first spatial position can be approximately regarded as the noise transmitted to the user's ear, and the speaker array 150 is based on the noise reduction signal The outputted noise-reducing wave can cancel out the noise at the first spatial position, and it can be approximated that the environmental noise transmitted to the user's ear canal is eliminated. In some embodiments, the speaker array 150 may include electrodynamic speakers (for example, dynamic speakers), magnetic speakers, ion speakers, electrostatic speakers (or capacitive speakers), piezoelectric One or more of the speaker, etc. In some embodiments, the speaker array 150 may include air conduction speakers or bone conduction speakers according to the propagation mode of the sound output by the speakers. For example, when the speaker array 150 only includes air conduction speakers, part of the air conduction speakers in the speaker array 150 can be used to output noise reduction waves to eliminate noise, and other air conduction speakers in the speaker array 150 can be used to transmit The audio information that the user needs to hear (for example, device media audio, call remote audio). In some embodiments, the speakers in the speaker array 150 that are used to deliver the audio information that the user needs to hear to the user may also be used to output noise reduction waves. For another example, when the speaker array 150 includes a bone conduction speaker and an air conduction speaker, the air conduction speaker can be used to output noise reduction waves to eliminate noise, and the bone conduction speaker can be used to transmit the sound information that the user needs to hear to the user. Compared with air conduction speakers, bone conduction speakers transmit mechanical vibrations directly through the user's body (such as bones, skin tissue, etc.) to the user's auditory nerves. smaller. When the bone conduction speaker transmits the mechanical vibration to the user, it will cause the shell structure 110 to generate mechanical vibration. The mechanical vibration generated by the shell structure 110 acts on the air to generate air-conducted sound. In some embodiments, the shell structure 110 The resulting air-conducted sound also acts as a noise reduction wave. It should be noted that, in some embodiments, the speaker array 150 may be an independent functional device, or a part of a single device capable of implementing multiple functions. In some embodiments, the signal processor 140 may be integrated and/or formed into a single body with the speaker array 150 . In some embodiments, the speaker array 150 can be arranged in a linear array (for example, linear, curved), planar array (for example, cross-shaped, mesh-shaped, circular, circular, polygonal, etc.) and/or Irregular shape) or three-dimensional array (for example, cylindrical, spherical, hemispherical, polyhedron, etc.), this description is not limited here.

In some embodiments, the open-back earphone 100 may further include a fixing structure 120 configured to fix the open-back earphone 100 near the user's ear without blocking the user's ear canal. In some embodiments, the fixing structure 120 may include ear hooks, headbands or elastic bands, etc., so that the open earphone 100 can be better fixed near the user's ear and prevent the user from falling during use. By way of illustration only, for example, securing structure 120 may be an earhook that may be configured to be worn around the ear region. As another example, securing structure 120 may be a neck strap configured to be worn around the neck/shoulder area. In some embodiments, the earhook can be a continuous hook that can be elastically stretched to fit on the user's ear, while the earhook can also apply pressure to the user's auricle, making the open earphone 100 is firmly fixed on the user's ear or head at a specific location. In some embodiments, the earhook may be a discontinuous strip. For example, the earhook may include a rigid part and a flexible part, wherein the rigid part may be made of a rigid material (for example, plastic or metal), and the rigid part may be physically connected to the housing structure of the acoustic output device (for example, clipping, screw connection, etc.) to fix. The flexible portion may be made of elastic material (eg, cloth, composite, or/and neoprene).

It should be noted that the above descriptions with respect to FIGS. 1 and 2 are provided for illustrative purposes only, and are not intended to limit the scope of the present invention. Numerous changes and modifications may be made by those skilled in the art in light of the teachings of the present disclosure. However, these changes and modifications do not depart from the scope of the present invention. For example, one or more elements of open-back earphone 100 (eg, securing structure 120 , etc.) may be omitted. In some embodiments, an element may be replaced by another element that performs a similar function. For example, in some embodiments, the open earphone 100 may not include the fixing structure 120, and the housing structure 110 may be a housing structure having a shape suitable for a human ear, such as a ring, an ellipse, a polygon (regular or irregular) ), U-shaped, V-shaped, semi-circular, so that the shell structure 110 can hang near the user's ear. In some embodiments, an element may be split into multiple sub-elements, or multiple elements may be combined into a single element.

Fig. 2 is an exemplary schematic flowchart of an open earphone provided according to some embodiments of the present invention. As shown in Figure 2, the process 200 may include:

In step 210, environmental noise is picked up.

In some embodiments, this step may be performed by the first microphone array 130 . In some embodiments, environmental noise refers to a combination of various external sounds in the environment where the user is located. In some embodiments, environmental noise may include one or more of traffic noise, industrial noise, building construction noise, social noise, and the like. In some embodiments, the traffic noise may include, but not limited to, the driving noise of motor vehicles, the honking noise, and the like. Industrial noise may include, but is not limited to, factory power machinery running noise, etc. Building construction noise may include but not limited to power machinery excavation noise, hole drilling noise, stirring noise, etc. Social and living environment noise may include, but is not limited to, mass gathering noise, entertainment publicity noise, crowd noise, household appliance noise, etc. In some embodiments, the first microphone array 130 may be located near the user's ear canal for picking up environmental noise transmitted to the user's ear canal, and the first microphone array 130 may convert the picked-up environmental noise signal It is an electrical signal and transmitted to the signal processor 140 for signal processing. In some embodiments, the environmental noise may also include the voice of the user speaking. For example, when the open earphone 100 is not in a call state (for example, when listening to audio or watching a video), the sound generated by the user's own speech can also be regarded as environmental noise, and the first microphone array 130 can pick up the sound of the user's own speech and other environmental noises, and convert the sound signal generated by the user's speech and other environmental noises into electrical signals and transmit them to the signal processor 140 for signal processing.

In step 220, the noise of the first spatial location is estimated based on the picked-up ambient noise.

In some embodiments, this step may be performed by the signal processor 140 . The first spatial position refers to a spatial position close to the user's ear canal at a specific distance. The specific distance here can be a fixed distance, for example, 0.5 cm, 1 cm, 2 cm, 3 cm, etc., and can be adjusted adaptively according to actual application conditions. The environmental noise picked up by the first microphone array 130 may come from different azimuths and different types of spatial noise sources, so the parameter information (eg, phase information, amplitude information) corresponding to each spatial noise source is different. In some embodiments, the signal processor 140 may separate the noise at the first spatial position according to the statistical distribution and structural characteristics of different types of noise in different dimensions (for example, space domain, time domain, frequency domain, etc.) Extraction, thereby estimating different types of noises (such as different frequencies, different phases, etc.), and estimating the parameter information (such as amplitude information, phase information, etc.) corresponding to each noise. In some embodiments, the signal processor 140 may also determine the overall parameter information of the noise at the first spatial location according to the parameter information corresponding to different types of noise at the first spatial location. In some embodiments, estimating the noise of the first spatial position based on the picked-up environmental noise may further include determining one or more spatial noise sources related to the picked-up environmental noise, and estimating the noise of the first spatial position based on the spatial noise source. noise. For example, the picked-up environmental noise is divided into multiple subbands, each subband corresponds to a different frequency range, and the corresponding spatial noise source is determined on at least one subband. It should be noted that the spatial noise source estimated by the sub-band here is a virtual noise source corresponding to the real noise source outside. For details about estimating the noise of the first spatial position based on the picked-up environmental noise, reference may be made to other places in the specification of the present invention, for example, FIG. 5 to FIG. 7 and their corresponding descriptions.

The open earphone 100 does not block the user's ear canal, and cannot obtain environmental noise by installing a microphone at the ear canal. The first spatial position is the spatial area constructed by the first microphone array 130 to simulate the position of the user's ear canal , in order to more accurately estimate the environmental noise transmitted by the user's ear canal, in some embodiments, the first spatial position is closer to the user's ear canal than any microphone in the first microphone array 130 . In some embodiments, the first spatial position is related to the distribution position and quantity of each microphone in the first microphone array 130 relative to the user's ear. By adjusting the distribution position or quantity of each microphone in the first microphone array 130 relative to the user's ear The quantity can be adjusted for the first space position. For example, increasing the number of microphones in the first microphone array 130 can make the first spatial position closer to the user's ear canal. For another example, the first spatial position may be closer to the user's ear canal by reducing the distance between the microphones in the first microphone array 130 . For another example, the first spatial position may be closer to the user's ear canal by changing the arrangement of the microphones in the first microphone array 130 .

In step 230, a noise reduction signal is generated based on the noise at the first spatial location.

In some embodiments, this step may be performed by the signal processor 140 . In some embodiments, the signal processor 140 may generate the noise-reduced signal based on the parameter information (eg, amplitude information, phase information, etc.) of the noise at the first spatial position obtained in step 220 . For example, the phase of the denoised wave may be approximately opposite to the phase of the noise at the first spatial location. For another example, the phase of the noise reduction wave may be approximately opposite to the phase of the noise at the first spatial position, and the amplitude of the noise reduction signal may be approximately equal to the amplitude of the noise at the first spatial position. In some embodiments, the speaker array 150 may output a noise reduction wave based on the noise reduction signal generated by the signal processor 140, and the noise reduction wave may cancel out the noise at the first spatial position. In some embodiments, the noise at the first spatial position can be approximately regarded as the noise at the position of the user's ear canal. Therefore, the noise reduction signal and the noise at the first spatial position cancel each other, and can be approximately transmitted to the user's ear The ambient noise of the channel is eliminated. In some embodiments, the open earphone 100 can eliminate the environmental noise at the position of the user's ear canal through the method steps described in FIG. 2 , so as to realize the active noise reduction of the open earphone 100 .

It should be noted that the above description about the process 200 is only for illustration and description, and does not limit the scope of application of this specification. For those skilled in the art, various modifications and changes can be made to the process 200 under the guidance of this description. However, such modifications and changes are still within the scope of this specification. For example, steps in the process 200 may also be added, omitted or combined, for example, signal processing (for example, filtering processing, etc.) may also be performed on environmental noise.

Continuing to refer to FIG. 1 , in some embodiments, the open-back earphone 100 may further include a second microphone array 160 . The second microphone array 160 may be located inside the housing structure 110 . In some embodiments, the second microphone array 160 is at least partially distinct from the first microphone array 130 . For example, the microphones in the second microphone array 160 are different from the microphones in the first microphone array 130 in one or more of quantity, type, position, arrangement, and the like. In some embodiments, for example, the arrangement of the microphones in the first microphone array 130 may be linear, and the arrangement of the microphones in the second microphone array 160 may be circular. For another example, the microphones in the second microphone array 160 may only include air conduction microphones, and the first microphone array 130 may include air conduction microphones and bone conduction microphones. In some embodiments, the microphones in the second microphone array 160 can be any one or more microphones included in the first microphone array 130, and the microphones in the second microphone array 160 can also be independent of the microphones in the first microphone array 130. . In some embodiments, the second microphone array 160 may be configured to pick up environmental noise and the noise reduction wave output by the speaker array 150 . The ambient noise and noise reduction waves picked up by the second microphone array 160 can be transmitted to the signal processor 140 . In some embodiments, the signal processor 140 may update the noise reduction signal based on the sound signal picked up by the second microphone array 160 . For example, the signal processor 140 can adjust the parameter information of the noise reduction signal according to the parameter information (for example, frequency information, amplitude information, phase information, etc.) of the sound signal picked up by the second microphone array 160, so that the adjusted noise reduction signal The amplitude can be more consistent with the amplitude of the noise at the first spatial position, or the phase of the adjusted noise reduction signal can be more consistent with the opposite phase of the phase of the noise at the first spatial position, so that the updated noise reduction The noise wave and the noise of the first spatial position can be more comprehensively canceled. For specific content about updating the noise reduction signal based on the sound signal picked up by the second microphone array 160, reference may be made to FIG. 3 and its related descriptions in this specification.

Fig. 3 is an exemplary flow chart of updating a noise reduction signal according to some embodiments of the present invention. As shown in Figure 3, the process 300 may include:

In step 310 , based on the sound signal picked up by the second microphone array 160 , the sound field at the ear canal of the user is estimated.

In some embodiments, this step may be performed by the signal processor 140 . In some embodiments, the sound signal picked up by the second microphone array 160 includes environmental noise and the noise reduction wave output by the speaker array 150 . In some embodiments, after the environmental noise and the noise reduction wave output by the speaker array 150 are canceled, there may still be some uncancelled sound signals near the user's ear canal, and these uncancelled sound signals can be The residual environmental noise and/or the residual noise reduction wave, therefore, after the cancellation of the environmental noise and the noise reduction wave, there is still a certain amount of noise in the user's ear canal. The signal processor 140 can perform signal processing according to the sound signal picked up by the second microphone array 160 (for example, environmental noise, noise reduction wave), to obtain parameter information of the sound field at the user's ear canal, for example, frequency information, amplitude Value information and phase information, etc., so as to realize the estimation of the sound field at the user's ear canal.

In step 320, the parameter information of the noise reduction signal is adjusted according to the sound field at the ear canal of the user.

In some embodiments, step 320 may be performed by the signal processor 140 . In some embodiments, the signal processor 140 can adjust the parameter information (for example, frequency information, amplitude information and/or phase information) of the noise reduction signal according to the parameter information of the sound field at the user's ear canal obtained in step 310 ), so that the amplitude information and frequency information of the updated noise reduction signal are more consistent with the amplitude information and frequency information of the environmental noise at the user's ear canal, and the phase information of the updated noise reduction signal is more consistent with the user's ear canal The anti-phase information of the environmental noise is more consistent, so that the updated noise reduction signal can more accurately eliminate the environmental noise.

It should be noted that the above description about the process 300 is only for illustration and description, and does not limit the scope of application of this description. For those skilled in the art, various modifications and changes can be made to the process 300 under the guidance of this description. However, such modifications and changes are still within the scope of this specification. For example, the microphone array that picks up the sound field at the user's ear canal is not limited to the second microphone array, and may also include other microphone arrays, such as the third microphone array, the fourth microphone array, etc. The relevant parameter information of the sound field at the ear canal is used to estimate the sound field at the user's ear canal by means of averaging or weighting algorithm.

In some embodiments, in order to obtain the sound field at the user's ear canal more accurately, the second microphone array 160 includes a microphone that is closer to the user's ear canal than any microphone in the first microphone array 130 . In some embodiments, the sound signal picked up by the first microphone array 130 is environmental noise, and the sound signal picked up by the second microphone array 160 is the environmental noise and the noise reduction wave. In some embodiments, the signal processor 140 may estimate the sound field at the user's ear canal according to the sound signal picked up by the second microphone array 160, so as to update the noise reduction signal. The second microphone array 160 needs to monitor the sound field at the user's ear canal after the noise reduction signal and the environmental noise are cancelled. The second microphone array 160 includes a microphone closer to the user's ear canal than any microphone in the first microphone array 130 The microphone can more accurately represent the sound signal heard by the user, and the sound field of the second microphone array 160 is used to estimate the sound field to update the noise reduction signal, which can further improve the noise reduction effect and the user's sense of hearing experience.

In some embodiments, the arrangements of the first microphone array 130 and the second microphone array 160 may be the same. Here, the same arrangement manner of the first microphone array 130 and the second microphone array 160 may be understood as that the arrangement shapes of the two are approximately the same. Fig. 4A is an exemplary distribution diagram of the arrangement and positional relationship of the first microphone array and the second microphone array provided according to some embodiments of the specification of the present invention. As shown in FIG. 4A, the first microphone array 130 is arranged at the human ear in a semicircular arrangement, and the second microphone array 160 is also arranged at the human ear in a semicircular arrangement. The microphones in the second microphone array 160 are closer to the user's ear canal than any microphone in the first microphone array 130 . In some embodiments, the microphones in the first microphone array 130 may be independently configured from the microphones in the second microphone array 160 . For example, the microphones in the first microphone array 130 in FIG. 4A are arranged in a semicircular arrangement, the microphones in the second microphone array 160 are arranged in a semicircular arrangement, and the first microphone array The microphones in 130 do not overlap or cross the microphones in the second microphone array 160 . In some embodiments, the microphones in the first microphone array 130 may partially overlap or cross the microphones in the second microphone array 160 .

In some embodiments, the arrangements of the first microphone array 130 and the second microphone array 160 may be different. Fig. 4B is an exemplary distribution diagram of an arrangement manner of the first microphone array and the second microphone array provided according to some other embodiments of the specification of the present invention. As shown in FIG. 4B, the first microphone array 130 is arranged at the human ear in a semicircular arrangement, and the second microphone array 160 is arranged at the human ear in a linear arrangement. The microphones in the second microphone array 160 are closer to the user's ear canal than any microphone in the first microphone array 130 . In some embodiments, the first microphone array 130 and the second microphone array 160 may also be arranged in combination. For example, in FIG. 4B , the second microphone array 160 includes linearly arranged parts and semicircularly arranged parts, and the semicircularly arranged part in the second microphone array 160 is a component of the first microphone array 130 . It should be noted that the arrangement of the first microphone array 130 and the second microphone array 160 is not limited to the semicircular and linear shapes shown in FIGS. 4A and 4B , and the semicircular and linear shapes here are only for illustration purposes. , for the arrangement of the microphone array, please refer to FIG. 8 and related descriptions in this specification.

In some embodiments, the noise reduction signal can also be updated according to the user's manual input. For example, in some embodiments, when the user wears the open earphone 100 to play music in a relatively noisy external environment, the user's own hearing experience is not ideal, and the user can manually adjust the noise reduction signal according to his own hearing effect. Parameter information (for example, frequency information, phase information, or amplitude information) of . For another example, when a special user (for example, a hearing-impaired user or an older user) uses the open earphone 100, the hearing ability of the special user is different from that of an ordinary user. The noise reduction wave generated by 100 itself does not match the hearing ability of special people, resulting in poor hearing experience for special users. In this case, the special user can manually adjust the frequency information, phase information or amplitude information of the noise reduction signal according to his own hearing effect, so as to update the noise reduction signal to improve the hearing experience of the special user. In some embodiments, the way for the user to manually adjust the noise reduction signal may be through the keys on the open earphone 100 for manual adjustment. In some embodiments, the way for the user to manually adjust the noise reduction signal may also be to manually input and adjust through the terminal device. In some embodiments, the sound field at the user's ear canal can be displayed on the open earphone 100 or an electronic product such as a mobile phone, a tablet computer, or a computer that is communicatively connected with the open earphone 100, and the noise reduction signal suggested by the user can be fed back. The frequency information range, amplitude information range or phase information range, users can manually input the parameter information of the proposed noise reduction signal, and then fine-tune the parameter information according to their own hearing experience.

In some embodiments, the signal processor 140 estimating the noise at the first spatial position based on the picked-up environmental noise may include: performing signal separation according to the picked-up environmental noise, obtaining parameter information corresponding to the environmental noise, and based on the environmental noise The corresponding parameter information generates a noise-reduced signal. In some embodiments, the environmental noise picked up by the microphone array (eg, the first microphone array 130 and the second microphone array 160 ) may include noise, user voice, audio output from the speaker array 150 , and the like. In some embodiments, the audio output by the speaker array 150 may include remote audio, device media audio, and noise reduction waves output by the speaker array 150 . In some embodiments, the signal processor 140 can perform signal analysis on the environmental noise picked up by the microphone array, and separate various sound signals included in the environmental noise to obtain noise, user voice, noise reduction wave, A variety of single sound signals such as device media audio, call remote audio, etc. Specifically, the signal processor 140 can be based on the statistical distribution characteristics and structural characteristics of noise, user voice, noise reduction wave, device media audio, and call remote audio in different dimensions such as space, time domain, and frequency domain, Self-tuning Adjust the parameters of the filter bank, estimate the parameter information of each sound signal in the environmental noise (for example, noise, user voice, noise reduction wave, device media audio, call remote audio, etc.), and according to different parameters Information completes the signal separation process. For example, in some embodiments, the microphone array can convert the picked-up noise, the user's voice, and the noise reduction wave into corresponding first signals, second signals, and third signals, respectively. The signal processor 140 acquires the first signal, the second signal, and the third signal in terms of spatial difference (for example, signal location), time domain difference (for example, delay), and frequency domain difference (for example, amplitude, phase), and The first signal, the second signal, and the third signal are separated according to the differences in the three dimensions to obtain relatively pure first signal, second signal, and third signal. The separated first signal, second signal, and third signal respectively correspond to pure noise, user's voice, and noise-reduced wave, and the signal processor 140 completes the signal separation process. In some embodiments, the signal processor 140 can update the noise reduction wave according to the parameter information of the noise obtained from signal separation, the noise reduction wave, the device media audio, the call remote audio, etc., and the updated noise reduction wave is passed through Speaker array 150 output.

In some embodiments, the structural features of noise may include noise distribution, noise intensity, global noise intensity, noise rate, etc., or any combination thereof. In some embodiments, the noise intensity may refer to the value of the noise primitive, which reflects the magnitude of the noise in the noise primitive. Therefore, the noise distribution may reflect the probability density of noise with different noise intensities in the image. . The global noise intensity can reflect the average noise intensity or the weighted average noise intensity in the image. The noise ratio can reflect the degree of dispersion of the noise distribution. In some embodiments, the statistical distribution characteristics of noise may include but not limited to probability distribution density, power spectral density, autocorrelation function, probability density function, variance, mathematical expectation and so on. In some embodiments, the user's voice, device media audio, and audio from the remote end of the call obtained through signal separation can also be transmitted to the remote end of the call. For example, when the user wears the open earphone 100 for a voice call, the user's voice can be transmitted to the remote end of the call.

FIG. 5 is an exemplary flow chart of estimating noise at a first spatial location according to some embodiments of the present invention. As shown in Figure 5, the process 500 may include:

In step 510, one or more spatial noise sources related to the picked up ambient noise are determined.

In some embodiments, this step may be performed by the signal processor 140 . In some embodiments, the spatial noise source related to environmental noise refers to a noise source whose sound waves can be transmitted to the user's ear canal or close to the user's ear canal (eg, the first spatial position). In some embodiments, the spatial noise sources may be noise sources from different directions (eg, front, rear, etc.) of the user's body. For example, there is crowd noise noise in front of the user's body, and there is vehicle horn noise noise on the left side of the user's body. In this case, the spatial noise source is the crowd noise source in front of the user body and the noise source on the left side of the user body Vehicle horn noise source. In some embodiments, the first microphone array 130 can pick up the spatial noise in all directions of the user's body, convert the spatial noise into an electrical signal and transmit it to the signal processor 140, and the signal processor 140 can convert the spatial noise corresponding to Signal analysis is performed on the electrical signal to obtain parameter information of spatial noise in various directions (for example, orientation information, amplitude information, phase information, etc.). The signal processor 140 determines the spatial noise source in each direction according to the parameter information of the spatial noise in each direction, for example, the orientation of the spatial noise source, the phase of the spatial noise source, and the amplitude of the spatial noise source. In some embodiments, the signal processor 140 can determine the spatial noise source through a noise localization algorithm. In some embodiments, the noise localization algorithm may include one or more of beamforming, super-resolution spatial spectrum estimation, time difference of arrival, and the like. In some embodiments, the signal processor 140 may divide the picked-up environmental noise into multiple subbands according to a specific frequency bandwidth (for example, every 500 Hz is regarded as a frequency band), each subband may correspond to a different frequency range, and A spatial noise source corresponding to the subband is determined on at least one subband. Regarding the location method of the spatial noise source, reference may be made to other places in this specification, and details are not repeated here. For a detailed description of determining one or more spatial noise sources related to the picked-up environmental noise, reference may be made to FIG. 6 and its related descriptions in this specification.

In step 520, the noise at the first spatial location is estimated based on the spatial noise source.

In some embodiments, this step may be performed by the signal processor 140 . In some embodiments, the signal processor 140 can estimate each spatial noise source based on the parameter information (for example, frequency information, amplitude information, phase information, etc.) The parameter information of the noise at the first spatial position is respectively transmitted to estimate the noise at the first spatial position. For example, in some embodiments, there is a spatial noise source at the front and rear of the user's body, and the signal processor 140 can estimate that the front spatial noise source is transmitted to the second For a spatial position, the frequency information, phase information or amplitude information of the front spatial noise source. The signal processor 140 estimates the frequency information, phase information or amplitude information of the rear spatial noise source when the rear spatial noise source transmits to the first spatial position according to the frequency information, phase information or amplitude information of the rear spatial noise source. The signal processor 140 estimates the noise information at the first spatial position based on the frequency information, phase information or amplitude information of the front spatial noise source and the frequency information, phase information or amplitude information of the rear spatial noise source, thereby estimating the first spatial location noise. In some embodiments, in some embodiments, the parameter information of the spatial noise source may be extracted from the frequency response curve of the spatial noise source picked up by the microphone array through a feature extraction method. In some embodiments, methods for extracting parameter information of spatial noise sources may include but not limited to principal component analysis (Principal Components Analysis, PCA), independent component analysis (Independent Component Algorithm, ICA), linear discriminant analysis (Linear Discriminant Analysis, LDA), singular value decomposition (Singular Value Decomposition, SVD), etc.

In some embodiments, determining the one or more sources of spatial noise related to the picked up environmental noise may include localizing the one or more spatial noise sources by one or more of beamforming, super-resolution spatial spectral estimation, or time difference of arrival source. The beamforming localization method is a sound source localization method based on the controllable beamforming of the maximum output power. In some embodiments, the beamforming sound source localization method can perform weighted summation of the sound signals picked up by each microphone array element in the microphone array to form a beam, guide the beam by searching for possible locations of spatial noise sources, and modify the weights so that The output signal power of the microphone array is maximum. It should be noted that the beamforming sound source localization method can be used in both the time domain and the frequency domain. The time shift of beamforming in the time domain is equivalent to the phase delay in the frequency domain. In some embodiments, the sound source localization method of super-resolution spatial spectrum estimation can include autoregressive AR model, minimum variance spectrum estimation (MV) and eigenvalue decomposition method (for example, Music algorithm), etc., these methods can be obtained by Acquire the sound signal of the microphone array to calculate the correlation matrix of the spatial spectrum, and effectively estimate the direction of the spatial noise source. In some embodiments, the time difference of arrival sound source localization method can firstly estimate the time difference of arrival, and obtain the acoustic delay (TDOA) between array elements in the microphone array, and then use the obtained time difference of arrival, combined with the known microphone array The spatial location of the noise further locates the location of the spatial noise source.

In order to illustrate the principle of spatial noise source localization more clearly, the beamforming sound source localization method is used as an example to illustrate how the spatial noise source localization is realized. Taking the microphone array as a linear array as an example, the spatial noise source may be a far-field sound source. In this case, it is considered that the incident sound waves incident on the microphone array by the spatial noise source are parallel. In a parallel sound field, when the incident angle of the incident sound wave from the spatial noise source is perpendicular to the plane of the microphones in the microphone array (for example, the first microphone array 130 or the second microphone array 160), the incident sound waves can simultaneously reach the microphone array (for example, Each microphone in the first microphone array 130 or the second microphone array 160). In some embodiments, when the incident angle of the incident sound wave from the spatial noise source in the parallel sound field is not perpendicular to the microphone plane in the microphone array (for example, the first microphone array 130 or the second microphone array 160), the incident sound wave reaches the microphone array Each microphone in (for example, the first microphone array 130 or the second microphone array 160 ) has a delay, which may be determined by the angle of incidence. In some embodiments, for different incident angles, the intensity of the noise waveform after superimposition is different. For example, when the incident angle is 0°, the noise signal strength is weak, and when the incident angle is 45°, the noise signal strength is the strongest. When the incident angles are different, the waveform superposition intensity after the noise waveform superposition is different, which makes the microphone array have polarity, so that the polarity diagram of the microphone array can be obtained. In some embodiments, the microphone array (for example, the first microphone array 130 or the second microphone array 160) can be a directional array, and the directivity of the directional array can be realized by a time domain algorithm or a frequency domain phase delay algorithm, For example, delay, overlay, etc. In some embodiments, pointing in different directions can be achieved by controlling different delays. In some embodiments, the controllable direction of the direction array is equivalent to a spatial filter. Firstly, the noise location area is divided into grids, and then each microphone is delayed in time domain by the delay time of each grid point, and finally each microphone The time domain delay is superimposed to calculate the sound pressure of each grid, so as to obtain the relative sound pressure of each grid, and finally realize the location of the spatial noise source.

It should be noted that the above description about the process 500 is only for illustration and description, and does not limit the scope of application of this specification. For those skilled in the art, various modifications and changes can be made to the process 500 under the guidance of this description. For example, the process 500 may also include locating the spatial noise source, extracting parameter information of the spatial noise source, and the like. For another example, step 510 and step 520 may be combined into one step. However, such modifications and changes are still within the scope of this specification.

Fig. 6 is an exemplary flow chart of determining a spatial noise source according to some embodiments of the present invention. As shown in Figure 6, the process 600 may include:

In step 610, the picked-up environmental noise is divided into a plurality of sub-bands, and each sub-band corresponds to a different frequency range.

In some embodiments, this step may be performed by the signal processor 140 . In some embodiments, the frequency of the environmental noise from different directions of the user's body may be different, and the signal processor 140 may divide the environmental noise frequency band into a plurality of sub-bands when performing signal processing on the environmental noise signal, Each subband corresponds to a different frequency range. Here, the frequency range corresponding to each subband may be a preset frequency range, for example, 80 Hz-100 Hz, 100 Hz-300 Hz, 300 Hz-800 Hz, and so on. In some embodiments, each subband includes parameter information of the environmental noise of the corresponding frequency band. For example, the signal processor 140 can divide the picked-up environmental noise into four sub-bands of 80 Hz-100 Hz, 100 Hz-300 Hz, 300 Hz-800 Hz, and 800 Hz-1000 Hz, and these four sub-bands correspond to 80 Parameters of environmental noise of Hz-100 Hz, 100 Hz-300 Hz, 300 Hz-800 Hz, 800 Hz-1000 Hz.

In step 620, on at least one sub-band, the corresponding spatial noise source is determined.

In some embodiments, this step may be performed by the signal processor 140 . In some embodiments, the signal processor 140 may perform signal analysis on the subbands divided by the environmental noise, obtain the parameter information of the environmental noise corresponding to each subband, and determine the spatial noise source corresponding to each subband according to the parameter information . For example, on the subband of 300 Hz-800 Hz, the signal processor 140 can obtain the parameter information (for example, frequency information, amplitude information, phase information, etc.) of the corresponding environmental noise contained in the subband, and the signal processing The unit 140 determines the spatial noise source corresponding to the subband of 300 Hz-800 Hz according to the obtained parameter information.

It should be noted that the above description about the process 600 is only for example and description, and does not limit the scope of application of this specification. For those skilled in the art, various modifications and changes can be made to the process 600 under the guidance of this description. For example, step 610 and step 620 are combined. For another example, other steps are added in the process 600 . However, such modifications and changes are still within the scope of this specification.

Fig. 7 is another exemplary flow chart for determining a spatial noise source according to some embodiments of the present invention. As shown in FIG. 7, the process 700 may include:

In step 710, the user's head function is obtained, which reflects the reflection or absorption of the sound by the user's head.

In some embodiments, this step may be performed by the signal processor 140 . In some embodiments, the first microphone array 130 may include a first sub-microphone array and a second sub-microphone array, and the first sub-microphone array and the second sub-microphone array are respectively located at the user's left ear and right ear. In some embodiments, the first microphone array 130 may be arranged in a double-sided mode, that is, a double-sided mode arrangement in which the first sub-microphone array and the second sub-microphone array are simultaneously enabled. In some embodiments, when the first sub-microphone array is located at the position of the user's left ear, and the second sub-microphone array is located at the position of the user's right ear, when the bilateral pattern is arranged, during the transmission of the sound signal, the user's head will The sound signal is reflected or absorbed, so that the first sub-microphone array and the second sub-microphone array pick up the noise of the same environment differently. In some embodiments, the signal processor 140 may construct the user head function based on the difference between the parameter information of the environmental noise picked up by the first sub-microphone array and the parameter information of the same environmental noise picked up by the second sub-microphone array , the user head function can reflect the reflection and absorption of sound by the user's head.

In step 720 , on at least one sub-band, the ambient noise picked up by the first sub-microphone array, the ambient noise picked up by the second sub-microphone array, and the user head function are used to determine the corresponding spatial noise source.

In some embodiments, this step may be performed by the signal processor 140 . In some embodiments, when the first microphone array 130 is in bilateral mode, the amplitude information and phase information of the environmental noise signal picked up by the first sub-microphone array and the amplitude information and phase information of the environmental noise signal picked up by the second sub-microphone array There is an amplitude difference and a phase difference between the information. The signal processor 140 may, according to the environmental noise picked up by the first sub-microphone array, the environmental noise picked up by the second sub-microphone array, and the user head function obtained by the signal processor 140 in step 710, in at least one of the environmental noise Frequency point synthesis is performed on the sub-band, that is, the head function is used as prior information, and the frequency point of the environmental noise on the corresponding sub-band picked up by the first sub-microphone array is combined with the second sub-microphone on at least one sub-band of the environmental noise. The frequency points of the environmental noise on the corresponding sub-bands picked up by the array are synthesized. The parameter information contained in the sub-bands after frequency point synthesis corresponds to the parameter information of the reconstructed virtual noise source. The signal processor 140 determines the spatial noise source based on the reconstructed parameter information of the virtual sound source, and then completes the positioning of the spatial noise source.

In some embodiments, the first microphone array 130 may also be arranged in a single-sided mode. For example, only the first sub-microphone array or the second sub-microphone array is enabled. In some embodiments, the first microphone array 130 is arranged in a unilateral mode, and when the first sub-microphone array located at the user's left ear is activated, the signal processor 140 can use the user's head function as prior information, and in the environment In at least one sub-band of the noise, the frequency points of the environmental noise in the corresponding sub-band picked up by the first sub-microphone array are synthesized. The parameter information included in the sub-bands after frequency point synthesis corresponds to the reconstructed virtual noise source parameter information. The signal processor 140 determines the spatial noise source based on the reconstructed parameter information of the virtual sound source, and then completes the positioning of the spatial noise source.

In some embodiments, the first sub-microphone array can pick up the environmental noise reaching the user's left ear, and the signal processor 140 can also estimate the environmental noise reaching the user's head function based on the environmental noise parameter information. The parameter information of the patient's right ear. The signal processor 140 can locate the spatial noise source more accurately according to the estimated parameter information when the environmental noise reaches the user's right ear. In some embodiments, the unilateral mode of the first microphone array 130 may also be that only one sub-microphone array is set, regarding the spatial noise source localization process in such a unilateral mode and only enabling the first sub-microphone array (or the second The unilateral mode spatial noise source localization process of sub-microphone array) is similar, and will not be repeated here.

It should be noted that the above description about the process 700 is only for illustration and description, and does not limit the scope of application of this specification. For those skilled in the art, various modifications and changes can be made to the process 300 under the guidance of this specification. However, such modifications and changes are still within the scope of this specification.

In some embodiments, the arrangement of the first sub-microphone array or the second sub-microphone array may be an array of regular geometric shapes. Fig. 8A is a schematic diagram of an arrangement of a first sub-microphone array according to some embodiments of the present invention. As shown in FIG. 8A , the first sub-microphone array forms a linear array. In some embodiments, the arrangement of the first sub-microphone array or the second sub-microphone array can also be an array of other shapes. For example, FIG. Schematic diagram of the layout. As shown in FIG. 8B , the first sub-microphone array forms a cross-shaped array. For another example, FIG. 8C is a schematic diagram of an arrangement manner of the first sub-microphone array provided according to other embodiments of the specification of the present invention. As shown in FIG. 8C , the first sub-microphone array forms a circular array. It should be noted that the arrangement of the first sub-microphone array or the second sub-microphone array is not limited to the linear array, cross-shaped array, and circular array shown in FIG. 8A, FIG. 8B, and FIG. 8C, and may also be of other shapes. Array patterns, for example, triangular arrays, spiral arrays, planar arrays, three-dimensional arrays, etc., are not limited in this specification. It should be noted that each short solid line in FIGS. 8A to 8D can be regarded as a microphone or a group of microphones. In some embodiments, when each short solid line is a group of microphones, the number of each group of microphones can be the same or different, the types of each group of microphones can be the same or different, and the orientation of each group of microphones can be the same or different. The type, quantity, orientation and spacing can be adjusted adaptively according to actual application conditions.

In some embodiments, the arrangement of the first sub-microphone array or the second sub-microphone array may also be an array of irregular geometric shapes. For example, FIG. 8D is a schematic diagram of an arrangement manner of the first sub-microphone array provided according to other embodiments of the specification of the present invention. As shown in FIG. 8D , the first sub-microphones are arrayed in an irregular array. It should be noted that the irregular shaped array arrangement of the first sub-microphone array or the second sub-microphone array is not limited to the shape shown in FIG. Regular polygons, etc., are not limited in this specification.

In some embodiments, the microphones in the first sub-microphone array (or the second sub-microphone array) may be uniformly distributed, and the uniform distribution here refers to the first sub-microphone array (or the second sub-microphone array). The spacing between the microphones is the same. In some embodiments, the microphones in the first sub-microphone array (or the second sub-microphone array) may also be non-uniformly distributed, and the non-uniform distribution here refers to the microphones in the first sub-microphone array (or the second sub-microphone array). The spacing between the microphones varies. The distance between the microphone array elements in the sub-microphone array can be adjusted adaptively according to the actual situation, which is not limited in this specification.

Fig. 9A is a schematic diagram of the positional relationship between the first sub-microphone array and the second sub-microphone array according to some embodiments of the present invention. As shown in FIG. 9A , the first sub-microphone array 911 is located at the left ear of the user, and the first sub-microphone array 911 is approximately triangularly arranged. The second sub-microphone array 912 is located at the right ear of the user, and the second sub-microphone array 912 is also arranged in an approximately triangular shape. Symmetrical distribution. Referring to FIG. 9A , the extension line of the first sub-microphone array 911 along the array direction intersects the extension line of the second sub-microphone array 912 along the array direction to form a quadrilateral structure.

Fig. 9B is a schematic diagram of the positional relationship between the first sub-microphone array and the second sub-microphone array according to other embodiments of the present invention. As shown in FIG. 9B , the first sub-microphone array 921 is located at the user's left ear, and the first sub-microphone array 921 is arranged in a line. The second sub-microphone array 922 is located at the right ear of the user. The second sub-microphone array 922 is arranged in an approximately triangular shape. The arrangement of the second sub-microphone array 922 is different from that of the first sub-microphone array 921. Symmetrical distribution. Referring to FIG. 9B , the extension line of the first sub-microphone array 921 along the array direction intersects the extension line of the second sub-microphone array 922 along the array direction to form a triangular structure.

In some embodiments, the first sub-microphone array 921 and the second sub-microphone array 922 may form a figure-eight, a circle, or an ellipse in addition to the quadrilateral shown in FIG. 9A and the triangle shown in FIG. 9B. , rings, polygons and other regular and/or irregular shapes. The first sub-microphone array and the second sub-microphone array are distributed in a specific shape or three-dimensional space, which can obtain the environmental noise in all directions of the user in all directions, and the parameter information of the environmental noise obtained by each microphone can be used to analyze the spatial noise source Perform more precise positioning, and then more accurately simulate the noise sound field at the user's ear canal to achieve better noise reduction effects. Different arrangements of the first sub-microphone array and the second sub-microphone array have different spatial filtering performances. By way of example only, spatial filtering performance may include main lobe width, side lobe (also referred to as sidelobe) width. The main lobe width refers to the largest radiation beam of acoustic radiation. Side lobe width refers to radiation beams other than the largest radiation beam. Among them, the narrower the width of the main lobe, the higher the resolution and the better the directivity of the microphone array. The lower the side lobe height, the better the anti-interference performance of the microphone array, and the higher the side lobe height, the worse the anti-interference performance of the microphone array. For example, the width of the main lobe corresponding to the beam pattern of the cross-shaped array is narrower than that corresponding to the circular, rectangular or spiral wave pattern, that is to say, under the same number of array elements, the cross-shaped array has a smaller High spatial resolution and better directivity. From the perspective of side lobe height, the width of the side lobe corresponding to the beam pattern of the cross-shaped array is higher than that corresponding to the circular, rectangular or spiral wave array, that is to say, the anti-interference ability of the cross-shaped array is poor . The arrangement of the first sub-microphone array and the second sub-microphone array can be adaptively adjusted according to actual application conditions, which is not further limited here. It should be noted that each short solid line in FIG. 9A and FIG. 9B can be regarded as a microphone or a group of microphones. In some embodiments, when each short solid line is a group of microphones, the number of each group of microphones can be the same or different, the types of each group of microphones can be the same or different, and the orientation of each group of microphones can be the same or different. The type, quantity, orientation and spacing can be adjusted adaptively according to actual application conditions. In some embodiments, the spatial super-resolution image of environmental noise can also be formed by methods such as synthetic aperture, sparse recovery, and mutual prime array, and the spatial super-resolution image can be used to reflect the signal reflection map of environmental noise , to further improve the localization accuracy of the spatial noise source. In some embodiments, the position, spacing, opening and closing status, etc. of the microphones in the microphone array (eg, the first microphone array 130 and the second microphone array 160 ) can be adjusted based on the feedback of the positioning accuracy of the spatial noise source.

In some embodiments, the first microphone array 130 may include a noise microphone, the noise microphone in the first microphone array 130 is used to pick up the spatial noise at the user's ear canal, and the noise microphone picks up the user's ear canal When there is spatial noise at the location, the noise reduction wave output by the speaker array 150 will also be picked up, and the noise reduction wave is not expected to be picked up by the noise microphone. Therefore, the noise microphone can be disposed at the acoustic null point of the acoustic dipole formed in the speaker array 150 , so that the noise wave picked up by the noise microphone is minimized. In some embodiments, at least one speaker array 150 forms at least one set of acoustic dipoles, and the noise microphone is located at the acoustic null of the dipole radiating sound field. In some embodiments, the sound signals output by any two speakers in the speaker array 150 can be regarded as two point sound sources that radiate sound outward, and the amplitude of the radiated sound is the same, but the phase is opposite. The two loudspeakers can form an acoustic dipole or similar to an acoustic dipole, and the outwardly radiated sound has obvious directivity, forming an "8"-shaped sound radiation area. In the straight line direction where the two speakers are connected, the sound radiated from the speaker is the largest, the sound radiated in other directions is obviously reduced, and the sound radiated at the perpendicular line between the two speakers is the smallest. In some embodiments, the sound signal output by one speaker in the speaker array 150 can also be regarded as a dipole. For example, a set of sound signals with approximately opposite phases and approximately the same amplitude output from the front and back of the diaphragm of a speaker in the speaker array 150 can be regarded as two point sound sources.

In some embodiments, the environmental noise signal picked up by the microphone array (for example, the first microphone array 130 ) at the position of the acoustic null point can also be acquired through an algorithm. For example, in some embodiments, one or more microphones in the first microphone array 130 may be pre-set at the acoustic zero point position of the acoustic dipole formed by the speaker array 150 of a specific frequency band. The specific frequency band may be a frequency band that plays a key role in speech intelligibility, for example, 500 Hz-1500 Hz. In some embodiments, the signal processor 140 calculates and pre-stores the compensation parameters for a specific frequency band according to the acoustic dipole position (ie, the positions of the two loudspeakers forming the acoustic dipole) and the acoustic transfer function. The signal processor 140 can perform amplitude compensation and/or phase compensation on the environmental noise base picked up by the remaining microphones in the first microphone array 130 (that is, the microphones not set at the acoustic zero position) according to the pre-stored compensation parameters. The final environmental noise signal is equivalent to the environmental noise signal picked up by the noise microphone set at the acoustic zero position. It should be noted that the microphones in the microphone array (for example, the first microphone array 130) may not be arranged at the acoustic zero point of the acoustic dipole formed by the speaker array 150, for example, in some embodiments, the signal processor 140 may According to the statistical distribution and structural characteristics of different types of noise in different dimensions (for example, space domain, time domain, frequency domain, etc.), the noise at the first spatial position picked up by the microphone array is separated and extracted to obtain different types ( For example, noises of different frequencies, different phases, etc.) are eliminated by the signal processor to eliminate the noise-reducing waves emitted by the speaker array 150 picked up by the microphone array.

FIG. 10 is an exemplary flow chart of estimating noise at a first spatial location according to some embodiments of the present invention. As shown in Figure 10, the process 1000 may include:

In step 1010, components associated with the signal picked up by the bone conduction microphone are removed from the picked up ambient noise, so as to update the ambient noise.

In some embodiments, this step may be performed by the signal processor 140 . In some embodiments, when the microphone array (for example, the first microphone array 130 and the second microphone array 160) picks up environmental noise, the user's own voice will also be picked up by the microphone array, that is, the user's own voice Sound is also considered part of environmental noise. In this case, the noise reduction wave output by the speaker array 150 will cancel the voice of the user himself. In some embodiments, in certain scenarios, the voice of the user's own speech needs to be preserved, for example, in scenarios where the user makes a voice call or sends a voice message. In some embodiments, when the user wears the open earphone 100 to make a voice call or record voice information, the bone conduction microphone can pick up the sound signal of the user's speech by picking up the vibration signal generated by the facial bones or muscles when the user speaks, and passed to the signal processor 140. The signal processor 140 obtains the parameter information of the sound signal picked up by the bone conduction microphone, and the signal processor 140 finds and removes bone-related noise from the environmental noise picked up by the microphone array (for example, the first microphone array 130, the second microphone array 160). The sound signal component associated with the sound signal picked up by a conduction microphone. The signal processor 140 updates the ambient noise according to the parameter information of the ambient noise picked up by the remaining microphone arrays. The updated environmental noise no longer includes the voice signal of the user's own speech, that is, the voice signal of the user's own speech is retained when the user makes a voice call.

In step 1020, the noise at the first spatial location is estimated according to the updated environmental noise.

In some embodiments, this step may be performed by the signal processor 140 . In some embodiments, the signal processor 140 may estimate the noise at the first spatial location according to the updated ambient noise. For a detailed description of estimating the noise of the first spatial position according to the environmental noise, reference may be made to FIG. 2 and related descriptions in this specification, and details are not repeated here.

It should be noted that the above description about the process 1000 is only for illustration and description, and does not limit the scope of application of this description. For those skilled in the art, various modifications and changes can be made to the process 1000 under the guidance of this description. For example, it is also possible to preprocess components associated with the signal picked up by the bone conduction microphone, and transmit the signal picked up by the bone conduction microphone to the terminal device as an audio signal. However, such modifications and changes are still within the scope of this specification.

In some embodiments, at least one microphone array may include a bone conduction microphone and an air conduction microphone, and the signal processor 140 may control the on/off status of the bone conduction microphone and the air conduction microphone based on the working state of the open earphone 100 . In some embodiments, the working state of the open-style earphone 100 may refer to the use state used by the user when wearing the open-style earphone 100 . In some embodiments, the working state of the open earphone 100 may include, but not limited to, a music playing state, a voice call state, a voice sending state, and the like. In some embodiments, when the microphone array picks up environmental noise, the on/off state of the bone conduction microphone and the air conduction microphone in the microphone array can be determined according to the working state of the open earphone 100 . For example, when the user wears the open earphone 100 to play music, the on/off state of the bone conduction microphone may be in the standby state, and the on/off state of the air conduction microphone may be in the working state. For another example, when the user wears the open earphone 100 for voice transmission, the on-off state of the bone conduction microphone may be the working state, and the on-off state of the air conduction microphone may be the working state. In some embodiments, the signal processor 140 is coupled to the microphone array, and the signal processor 140 can control the switch state of the microphones (eg, bone conduction microphone, air conduction microphone) in the microphone array by sending a control signal.

In some embodiments, the working state of the open earphone 100 may include a talking state and a non-talking state. In some embodiments, when the working state of the open earphone 100 is not in a call state, the signal processor 140 may control the bone conduction microphone to be in a standby state. For example, when the open earphone 100 is not in a call state, the voice signal of the user's own speech can be regarded as environmental noise. In this case, the voice signal of the user's own speech included in the environmental noise picked up by the microphone array may not is filtered out, so that the voice signal of the user's own speech can also be canceled out by the noise reduction wave output by the speaker array 150 .

In some embodiments, when the working state of the open earphone 100 is the talking state, the signal processor 140 may control the bone conduction microphone to be in the working state. For example, when the open earphone 100 is in a call state, the voice signal of the user's own speech needs to be preserved. In this case, the signal processor 140 can send a control signal to control the bone conduction microphone to be in the working state, and the bone conduction microphone picks up the user's voice. sound signal, the signal processor 140 finds and removes the sound signal components associated with the sound signal picked up by the bone conduction microphone from the environmental noise picked up by the microphone array, so that the sound signal of the user's own speech does not differ from the sound signal output by the speaker array 150 The clutter-reducing waves cancel each other out, thus ensuring the normal communication status of the user.

In some embodiments, when the working state of the open earphone 100 is the talking state, if the sound pressure level of the ambient noise is greater than a preset threshold, the signal processor 140 may control the bone conduction microphone to keep the working state. In some embodiments, the sound pressure level of the environmental noise can reflect the intensity of the environmental noise. The preset threshold here may be a value pre-stored in the open earphone 100, for example, 50 dB, 60 dB or 70 dB and other arbitrary values. In some embodiments, when the sound pressure level of the environmental noise is greater than a preset threshold, the environmental noise will affect the user's call quality. The signal processor 140 can control the bone conduction microphone to keep working by sending a control signal. The bone conduction microphone can obtain the vibration signal of the facial muscles of the user when speaking, and basically will not pick up external environmental noise. At this time, the bone conduction microphone will pick up The vibration signal is used as the voice signal during the call, so as to ensure the normal call of the user.

In some embodiments, when the working state of the open earphone 100 is the talking state, if the sound pressure level of the ambient noise is lower than the preset threshold, the signal processor 140 can control the bone conduction microphone to switch from the working state to the standby state. In some embodiments, when the sound pressure level of the environmental noise is less than the preset threshold, the sound pressure level of the environmental noise is smaller than the sound pressure level of the sound signal generated by the user's speech, and the sound signal generated by the user's speech After being partially offset by the noise reduction wave output by the loudspeaker array 150, the remaining sound signals generated by the user's speech can still meet the call standard, which is enough to ensure the user's normal call. In this case, the signal processor 140 can control the bone conduction microphone to switch from the working state to the standby state by sending a control signal, thereby reducing signal processing complexity and power consumption of the open earphone 100 .

In some embodiments, the open-back earphone 100 may further include an adjustment module for adjusting the sound pressure level of the noise reduction wave. In some embodiments, the adjustment module may include buttons, voice assistants, gesture sensors, and the like. The user can adjust the noise reduction mode of the open earphone 100 by controlling the adjustment module. Specifically, the user can adjust (for example, amplify or reduce) the amplitude information of the noise reduction signal by controlling the adjustment module, so as to change the sound pressure level of the noise reduction wave emitted by the speaker array, thereby achieving different noise reduction effects. As an example only, in some embodiments, the noise reduction mode may include a strong noise reduction mode, a medium noise reduction mode, a weak noise reduction mode, and the like. For example, when the user wears the open-type earphone 100 indoors, the noise of the external environment is small, and the user can turn off the noise reduction mode of the open-type earphone or adjust it to a weak noise reduction mode through the adjustment module. For another example, when the user wears the open earphone 100 while walking in a public place such as the street, the user needs to maintain a certain awareness of the surrounding environment while listening to audio signals (for example, music, voice information) to cope with sudden At this time, the user can select a medium-level noise reduction mode by adjusting the module (for example, a button or a voice assistant) to preserve the surrounding noise (such as sirens, crashes, car horns, etc.). For another example, when a user is taking a subway or an airplane, the user can select a strong noise reduction mode by adjusting the module to further reduce the noise of the surrounding environment. In some embodiments, the signal processor 140 can also send prompt information to the open earphone 100 or a terminal device (such as a mobile phone, a smart watch, etc.) or adjust the noise canceling mode.

The basic concept has been described above, obviously, for those with ordinary knowledge in the technical field, the above detailed disclosure is only an example, and does not constitute a limitation to the present invention. Although not explicitly described herein, various modifications, improvements and amendments to the present invention can be made by those skilled in the art. Such modifications, improvements and corrections are suggested in the present invention, so such modifications, improvements and corrections still belong to the spirit and scope of the exemplary embodiments of the present invention.

Meanwhile, the present invention uses specific words to describe the embodiments of the present invention. For example, "one embodiment", "an embodiment", and/or "some embodiments" means a certain feature, structure or characteristic related to at least one embodiment of the present invention. Therefore, it should be emphasized and noted that two or more references to "an embodiment" or "an embodiment" or "an alternative embodiment" in different places in this specification do not necessarily refer to the same embodiment . In addition, certain features, structures or characteristics of one or more embodiments of the present invention may be properly combined.

Furthermore, it will be appreciated by those skilled in the art that various aspects of the invention may be illustrated and described in several patentable varieties or situations, including any new and useful process, machine, product or combination of matter , or any new and useful improvements to them. Correspondingly, various aspects of the present invention may be entirely executed by hardware, may be entirely executed by software (including firmware, resident software, microcode, etc.), or may be executed by a combination of hardware and software. The above hardware or software may be referred to as "data block", "module", "engine", "unit", "component" or "system". Additionally, aspects of the present invention may be embodied as a computer product comprising computer readable program code on one or more computer readable media.

A computer storage medium may contain a propagated data signal containing computer program code, for example in baseband or as part of a carrier wave. The propagated signal may have various manifestations, including electromagnetic form, optical form, etc., or a suitable combination. A computer storage medium may be any computer-readable medium, other than a computer-readable storage medium, that can communicate, broadcast, or transfer programs for use by being connected to an instruction execution system, device, or device. Program code located on computer storage media may be transmitted over any suitable medium, including radio, electric cable, fiber optic cable, RF, or the like, or any combination of the foregoing.

In addition, unless clearly stated in the scope of the patent application, the sequence of processing elements and sequences, the use of numbers and letters, or the use of other names in the present invention are not used to limit the sequence of the process and methods of the present invention. While the foregoing disclosure discusses, by way of various examples, some embodiments of the invention presently believed to be useful, it should be understood that such details are for illustrative purposes only and that the appended claims are not limited to the disclosed embodiments, but rather , the scope of the patent application is intended to cover all modifications and equal combinations that conform to the essence and scope of the embodiments of the present invention. For example, although the above-described system components can be implemented by hardware devices, they can also be implemented by only software solutions, such as installing the described system on an existing server or mobile device.

In the same way, it should be noted that in order to simplify the expression of the disclosure of the present invention and help the understanding of one or more embodiments of the invention, in the foregoing description of the embodiments of the present invention, sometimes multiple features are combined into one embodiment , drawings or descriptions thereof. However, this method of disclosure does not imply that the object of the invention requires more features than those mentioned in the claims. Indeed, embodiment features are less than all features of a single foregoing disclosed embodiment.

In some embodiments, numbers describing the quantity of components and attributes are used. It should be understood that such numbers used in the description of the embodiments use the modifiers "about", "approximately" or "substantially" in some examples. grooming. Unless otherwise stated, "about", "approximately" or "substantially" indicates that the stated figure allows for a variation of ±20%. Accordingly, in some embodiments, the numerical parameters used in the specification and claims are approximations that may vary depending upon the desired characteristics of individual embodiments. In some embodiments, numerical parameters should take into account the specified number of significant digits and adopt the general digit reservation method. Although the numerical ranges and parameters used to demonstrate the breadth of scope in some embodiments of the invention are approximations, in specific embodiments such numerical values are set as precisely as practicable.

Every patent, patent application, publication of a patent application, and other materials, such as articles, books, specifications, publications, documents, etc., cited in this case are hereby incorporated by reference in their entirety. Application history documents inconsistent with or conflicting with the content of the present invention are excluded, as well as documents (currently or later appended to this application) that limit the broadest scope of the claimed invention. It should be noted that if there is any inconsistency or conflict between the descriptions, definitions, and/or terms used in the attached materials of the application and the contents of the application, the descriptions, definitions and/or terms of the application shall be Use shall prevail.

Finally, it should be understood that the embodiments described in the present invention are only used to illustrate the principles of the embodiments of the present invention. Other modifications are also possible within the scope of the present invention. Accordingly, by way of illustration and not limitation, alternative configurations of the embodiments of the present invention may be considered consistent with the teachings of the present invention. Accordingly, the embodiments of the present invention are not limited to the embodiments of the present invention that are explicitly shown and described.

100: Open-back headphones 110: shell structure 120: fixed structure 130: the first microphone array 140: signal processor 150: speaker array 160: second microphone array 200: Process 210: step 220: step 230: step 300: Process 310: step 320: Step 500: Process 510: step 520: step 600: process 610: Step 620: Step 700: process 710: Step 720: step 911: the first sub-microphone array 912: the second sub-microphone array 921: the first sub-microphone array 922: the second sub-microphone array 1000: process 1010: step 1020: Steps

The invention will be further illustrated by way of exemplary embodiments which will be described in detail by means of the drawings. These embodiments are not limiting, and in these embodiments, the same reference numerals represent the same structure, wherein:

[ FIG. 1 ] is an exemplary block diagram of an open earphone provided according to some embodiments of the present invention;

[Fig. 2] is an exemplary schematic flow chart of an open earphone provided according to some embodiments of the present invention;

[Fig. 3] is an exemplary flow chart of updating the noise reduction signal according to some embodiments of the present invention;

[FIG. 4A] is an exemplary distribution diagram of the arrangement and positional relationship between the first microphone array and the second microphone array provided according to some embodiments of the specification of the present invention;

[FIG. 4B] is an exemplary distribution diagram of the arrangement of the first microphone array and the second microphone array provided according to other embodiments of the specification of the present invention;

[Fig. 5] is an exemplary flow chart for estimating noise at a first spatial position according to some embodiments of the present invention;

[FIG. 6] is an exemplary flow chart for determining a spatial noise source provided according to some embodiments of the specification of the present invention;

[Fig. 7] is another exemplary flow chart for determining a spatial noise source according to some embodiments of the present invention;

[Fig. 8A] is a schematic diagram of the arrangement of the first sub-microphone array provided according to some embodiments of the specification of the present invention;

[FIG. 8B] is a schematic diagram of the arrangement of the first sub-microphone array provided according to other embodiments of the specification of the present invention;

[FIG. 8C] is a schematic diagram of the arrangement of the first sub-microphone array provided according to other embodiments of the specification of the present invention;

[FIG. 8D] is a schematic diagram of the arrangement of the first sub-microphone array provided according to other embodiments of the specification of the present invention;

[FIG. 9A] is a schematic diagram of the positional relationship between the first sub-microphone array and the second sub-microphone array provided according to some embodiments of the specification of the present invention;

[Fig. 9B] is a schematic diagram of the positional relationship between the first sub-microphone array and the second sub-microphone array according to other embodiments of the present invention;

[ FIG. 10 ] is an exemplary flow chart of estimating noise at a first spatial location according to some embodiments of the present invention.

200: Process

210: step

220: step

230: step

Claims (11)

An open earphone comprising: a fixing structure configured to fix the earphone near the user's ear and not block the user's ear canal; Housing structure, configured to carry: a first microphone array configured to pick up environmental noise; at least one loudspeaker array; and A signal handler, configured as: estimating noise at a first spatial location closer to the user's ear canal than any microphone in the first microphone array based on the picked-up environmental noise; and A noise reduction signal is generated based on the noise at the first spatial position, so that the at least one speaker array outputs a noise reduction wave according to the noise reduction signal, and the noise reduction wave is used to eliminate transmission to the user's ear. The environmental noise of the road. Such as the open earphone of claim 1, wherein, The housing structure is configured to house a second microphone array configured to pick up the environmental noise and the noise reduction wave, the second microphone array being at least partially distinct from the first microphone array a microphone array; and The signal processor is configured to update the noise reduction signal based on sound signals picked up by the second microphone array. The open earphone according to claim 2, wherein updating the noise reduction signal based on the sound signal picked up by the second microphone array includes: estimating a sound field at the ear canal of the user based on the sound signal picked up by the second microphone array; and The parameter information of the noise reduction signal is adjusted according to the sound field at the ear canal of the user. The open earphone according to claim 2, wherein the second microphone array includes a microphone closer to the user's ear canal than any microphone in the first microphone array. The open earphone according to claim 1, wherein the signal processor estimating the noise at the first spatial position based on the picked-up environmental noise includes: Signal separation is performed according to the picked-up environmental noise, parameter information corresponding to the environmental noise is obtained, and the noise reduction signal is generated based on the parameter information. The open earphone according to claim 1, wherein the signal processor estimating the noise at the first spatial position based on the picked-up environmental noise includes: determining one or more spatial noise sources associated with the picked-up ambient noise; and Noise at the first spatial location is estimated based on the spatial noise sources. The open earphone according to claim 6, wherein determining one or more of the spatial noise sources related to the picked-up environmental noise comprises: dividing the picked-up environmental noise into a plurality of subbands, each subband corresponding to a different frequency range; and On at least one subband, the spatial noise source corresponding thereto is determined. The open earphone according to claim 7, wherein the first microphone array includes a first sub-microphone array and a second sub-microphone array, and the first sub-microphone array and the second sub-microphone array are respectively located at the user’s At the left ear and the right ear, determining the spatial noise source corresponding to the at least one subband comprises: Obtaining a user head function, which reflects the reflection or absorption of sound by the user's head; and On the at least one sub-band, in combination with the environmental noise picked up by the first sub-microphone array, the environmental noise picked up by the second sub-microphone array, and the user head function, determine the corresponding to the spatial noise source. The open earphone according to claim 1, wherein the first microphone array includes a noise microphone, the at least one loudspeaker array forms at least one set of acoustic dipoles, and the noise microphone is located at the side of the dipole radiation sound field Acoustic zero point. The open earphone according to claim 1, wherein the at least one microphone array includes a bone conduction microphone, the bone conduction microphone is configured to pick up the voice of the user, and the signal processor is based on the picked up environmental noise Estimating noise at the first spatial location includes: removing components associated with the signal picked up by the bone conduction microphone from the picked up ambient noise to update the ambient noise; and Estimating noise at the first spatial location according to the updated environmental noise. The open earphone according to claim 1, wherein the at least one microphone array includes a bone conduction microphone and an air conduction microphone, and the signal processor controls the power of the bone conduction microphone and the air conduction microphone based on the working state of the earphone switch status.

Images