EP4429269A1 - Aktive leckageanpassung für am körper tragbare audiovorrichtungen - Google Patents

Aktive leckageanpassung für am körper tragbare audiovorrichtungen Download PDF

Info

Publication number
EP4429269A1
EP4429269A1 EP24162617.5A EP24162617A EP4429269A1 EP 4429269 A1 EP4429269 A1 EP 4429269A1 EP 24162617 A EP24162617 A EP 24162617A EP 4429269 A1 EP4429269 A1 EP 4429269A1
Authority
EP
European Patent Office
Prior art keywords
signal
sensor
active
wearable audio
audio device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP24162617.5A
Other languages
English (en)
French (fr)
Inventor
Martin Schoerkmaier
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Bang and Olufsen AS
Original Assignee
Bang and Olufsen AS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US18/331,590 external-priority patent/US20240305923A1/en
Application filed by Bang and Olufsen AS filed Critical Bang and Olufsen AS
Publication of EP4429269A1 publication Critical patent/EP4429269A1/de
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1083—Reduction of ambient noise
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1781—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase characterised by the analysis of input or output signals, e.g. frequency range, modes, transfer functions
    • G10K11/17821—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase characterised by the analysis of input or output signals, e.g. frequency range, modes, transfer functions characterised by the analysis of the input signals only
    • G10K11/17823—Reference signals, e.g. ambient acoustic environment
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1787—General system configurations
    • G10K11/17873—General system configurations using a reference signal without an error signal, e.g. pure feedforward
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1787—General system configurations
    • G10K11/17879—General system configurations using both a reference signal and an error signal
    • G10K11/17881—General system configurations using both a reference signal and an error signal the reference signal being an acoustic signal, e.g. recorded with a microphone
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1787—General system configurations
    • G10K11/17885—General system configurations additionally using a desired external signal, e.g. pass-through audio such as music or speech
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/20—Arrangements for obtaining desired frequency or directional characteristics
    • H04R1/22—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired frequency characteristic only 
    • H04R1/28—Transducer mountings or enclosures modified by provision of mechanical or acoustic impedances, e.g. resonator, damping means
    • H04R1/2807—Enclosures comprising vibrating or resonating arrangements
    • H04R1/2815—Enclosures comprising vibrating or resonating arrangements of the bass reflex type
    • H04R1/2823—Vents, i.e. ports, e.g. shape thereof or tuning thereof with damping material
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K2210/00—Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
    • G10K2210/10—Applications
    • G10K2210/108—Communication systems, e.g. where useful sound is kept and noise is cancelled
    • G10K2210/1081—Earphones, e.g. for telephones, ear protectors or headsets
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1016—Earpieces of the intra-aural type
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1041—Mechanical or electronic switches, or control elements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2460/00—Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
    • H04R2460/01—Hearing devices using active noise cancellation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2460/00—Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
    • H04R2460/11—Aspects relating to vents, e.g. shape, orientation, acoustic properties in ear tips of hearing devices to prevent occlusion

Definitions

  • Embodiments of the present disclosure relate generally to wearable audio devices such as headphones and earphones, and more particularly to systems and methods for active leakage adaption in wearable audio devices based on activity and scene classification.
  • Electronic audio devices in particular wearable audio devices like headphones and earbuds, typically must balance various features, including whether they are small, sleek, and aesthetically pleasing, or acoustically superior.
  • a current acoustic feature that many users prefer is active noise cancellation (ANC) where outside noises are effectively "canceled", or transparency mode to render an electronic audio device acoustically “invisible” and enable normal hearing of the outside world while wearing the headset.
  • ANC active noise cancellation
  • ANC circuitry typically works by sensing and classifying background sounds in designated frequency ranges and attempting to cancel or suppress these sounds by causing the speakers to vibrate in opposition to the frequencies of the background sounds, thereby reducing or cancelling out the background sounds.
  • Such cancellation may have the unintended effect of causing sharp, sometimes painful sounds perceived by the user, which can be exacerbated by the sound of the speakers in wearable devices as, generally, the bigger the speaker is, the more proficient the speaker is at producing high quality sound pressure.
  • larger speakers conflict with the needs of wearable audio devices, where such devices focus on small, sleek design that is convenient and comfortable for users to wear.
  • a wearable audio device comprises at least one speaker; a first sensor configured to sense sound related to the at least one speaker and provide a first sensor signal; a second sensor configured to sense sound external to the wearable device and provide a second sensor signal; active noise cancellation (ANC) circuitry configured to provide at least a third signal and fourth signal, wherein the third signal is a music compensated first sensor signal and the fourth signal is an ANC signal; at least one active vent; and at least one processor configured to receive the first sensor signal, the second sensor signal, the third signal and the fourth signal to determine whether a trigger threshold is met, and if the trigger threshold is met, send a control signal to the at least one active vent to cause the at least one active vent to open or close.
  • ANC active noise cancellation
  • a method for dynamically regulating active leakage in a wearable audio device comprises providing at least one active vent near a speaker in the wearable audio device; providing at least one sensor and circuitry in the wearable audio device that are arranged to provide at least one output signal related to sound sensed related to the at least one speaker or sound sensed external to the wearable audio device; and providing at least one processor configured to control an opening or a closing of the at least one active vent based on the at least one output signal.
  • an audio device comprises at least one speaker; at least one sensor configured to sense sound related to the at least one speaker and to sense sound external to the wearable device and provide at least one sensor signal; active noise cancellation (ANC) circuitry configured to provide at least one ANC signal related to at least one of the sensed sound related to the at least one speaker or the sensed sound external to the wearable device; at least one active vent; and at least one processor configured to control an opening or a closing of the at least one active vent based on the at least one sensor signal and the at least one ANC signal.
  • ANC active noise cancellation
  • a wearable electronic audio device can include at least one speaker arranged in at least one cavity within the device, and at least one feedback microphone within or proximate the first cavity.
  • the wearable electronic audio device can further comprise at least one active vent in or on the first cavity.
  • the at least one active vent can be controlled to selectively open or close, thereby providing an additional vent path in or through the wearable electronic audio devices, which can alleviate pressure experienced in the ear of a user of the wearable electronic audio device that includes ANC or other noise cancellation features.
  • the embodiments of the present disclosure disclosed herein are aimed at providing electronic audio devices that allow for mitigation of pressure that builds against the ear drum or ear canal of the user as a result of the closed or sealed aspect design in order to enable a more comfortable user experience.
  • electronic devices disclosed herein which may generally be sensitive to vibrational pressure as a result of user movement, such as air pressure peaks in front of the user eardrum, can be relieved by the usage of dynamic vents.
  • active vents disclosed herein can be configured to only open for strong air pressure peaks.
  • increased air pressure in the ear canal due to a footstep of the user can be detected by a sensor (including a feedback microphone sensor, detailed below), trigger an active vent to relieve the increased air pressure during the footstep, and, as soon as the footfall concludes, trigger the active vent to close.
  • a sensor including a feedback microphone sensor, detailed below
  • connection means a direct electrical, mechanical, or magnetic connection between the things that are connected, without any intermediary devices.
  • coupled or “integrated” mean either a direct electrical, mechanical, or magnetic connection between the things that are connected or an indirect connection through one or more passive or active intermediary devices.
  • circuit may refer to one or more passive and/or active components that are arranged to cooperate with one another to provide a desired function.
  • in-ear devices such as in-earphones, earbuds, or headphones worn on or over at least one ear of a user
  • features disclosed herein can have applicability to other audio devices that include ANC or other features that can cause or experience pressures and can benefit from venting.
  • These devices can include hearing aids and other medical devices and tools, or other devices that are or include speakers. Accordingly, the examples depicted and discussed herein are not limiting with respect to applications of various features and embodiments of this disclosure.
  • Earphone device 100 can comprise at least one sensor 102, at least one speaker 104 generally defining a first cavity 105 and a second cavity 107, at least one active vent 106a, an ear tip 108, and at least one passive vent 110a.
  • Wearable audio devices like earphone devices 100 are often referred to as earbuds and are configured to fit partially in the ear of a user, with eartip 108 oriented towards the ear canal.
  • FIG. 1A depicts a cross-sectional view of an earphone device with at least one active vent.
  • FIG. 1B depicts an alternate embodiment of an earphone device with at least a first active vent in and a second optional active vent.
  • Sensor 102 can comprise a microphone, such as a feedback microphone or a feedforward microphone, an accelerometer, a voice pick up (VPU) sensor, an Inertial Measurement Unit (IMU) sensor, or some other type of sensor suitable to detect at least one relevant sensor modality, as will be appreciated by those having skill in the art upon considering this application in its entirety.
  • a microphone such as a feedback microphone or a feedforward microphone
  • an accelerometer such as a Bosch Sensor 102
  • VPU voice pick up
  • IMU Inertial Measurement Unit
  • at least one sensor 102 can be a microphone that is configured to detect sound.
  • Sensor 102 can be arranged on or within earphone device 100 in a variety of ways.
  • sensor 102 is located on earphone device 100 such that at least one active (sensing) surface of sensor 102 is oriented on an external surface of earphone device 100.
  • sensor 102 can function as a feedforward microphone that detects background noise external to earphone device 100.
  • Background noise can include environmental noises such as wind, mechanical noises such as airplane or vehicle engines, or general traffic, speech, externally generated music, barking or animal sounds, or other sound or noises that can disrupt or interfere with the sound produced by earphone device 100, such as speech, jaw clenches, gum chewing, and other sounds.
  • Feedforward microphone sensors can be advantageous in the context of ANC because feedforward microphone sensors can be configured to effectively sense a specific frequency range of noises and isolate the specific frequency range of noises.
  • some types of background noises may not be possible to cancel completely or effectively. This can happen if these sounds fall outside the specific frequency range. When this happens, these noises may effectively seem to a user to be amplified due to the successful reduction or cancellation of other background noise. Thus, sounds that fall outside of a designated range of canceled noises may in some cases actually be amplified from the user's experience.
  • the effectiveness of feedforward microphone sensors in ANC systems can be limited by the fit of earphone device 100 in each ear of a specific user: if an earbud is loosely fitted inside the ear canal of the user, the perception of background noise cancellation to the user may be reduced.
  • sensor 102 can be located in, on, or with an active surface towards a portion of the earphone device 100, such as towards speaker 104 or ear tip 108.
  • sensor 102 can be configured to act as a feedback microphone to sense an audio signal present in a region closer to the ear canal of the user when earphone device 100 is worn in use.
  • sensor 102 can sense sound emitted by speaker 104 (e.g., music, calls, or any other audio output).
  • sensor 102 may also be able to detect some external, background noise as well.
  • Feedback microphone sensors can more accurately capture noise perceived by the user than feedforward microphones.
  • feedback microphone sensors can be configured to sense both varying types of background noise (wind, engine, etc.) and sound generated by speaker 104.
  • the feedback microphone sensor 102 can sense a wide frequency range and therefore a wide variety of noises.
  • feedback microphone sensors are generally very effective at sensing low frequency range sounds, such as wind.
  • feedback microphone sensors are less able to sense mid to high frequency range sounds.
  • feedback microphone sensors treat sensed speaker sounds (such as incoming music desired by the user) in the same manner as background noise, desired low frequency sounds may sometimes be filtered out with feedback microphones in the context of active noise cancellation.
  • earphone device 100 can include a plurality of sensors 102, with at least one being a feedback microphone and at least another being a feedforward microphone, arranged as discussed above or in other positions and orientations on or in earphone device 100 such that feedback and feedforward functionalities can be utilized or optimized. Whether there is one or a plurality, at least one sensor 102 can provide an output signal related to sensed characteristics or other data.
  • the at least one speaker 104 is arranged to produce an output audio signal to be heard by a user wearing earphone device 100.
  • speaker 104 is controlled by processing circuitry (see, e.g., FIG. 3 ), which can include or interact with an ANC system or circuitry.
  • ANC can cause some users to perceive increased air pressure in their ears when wearing headphones or earbuds. This can be related to very low-frequency sounds being amplified by the ANC due to compromises that need to be made in the ANC filter design and perceived by the brain as a pressure differential between the inner and outer ear. Therefore, electronic devices disclosed herein (including earphone device 100) disclose ventilation systems and methods to alleviate this pressure.
  • earphone device 100 comprises at least one active vent 106a that is arranged, and can be selectively opened and closed to, reduce air pressure on the ear of a user, such as may be related to ANC or other sources.
  • active vent 106a is located between first cavity 105 and second cavity 107. The placement and orientation of active vent 106a can vary in other examples.
  • active vent 106a can be selectively controlled to open and close, thereby providing a vent path on or within earphone device 100.
  • active vent 106a comprises a micro-electronic systems (MEMS) component, electrodynamic component, or any similar moveable and controllable component that can be selectively opened and closed to function as a vent and provide a vent path while also meeting size and materials requirements within devices like earphone device 100.
  • MEMS micro-electronic systems
  • active vent 106a can open and close the vent path very quickly, such as within 1 millisecond (ms), for example less than 0.5 ms.
  • operation of active vent 106a can be carried out without being audible to the user or otherwise affecting the sound heard by the user, and in fact, the changing or relieving of pressure from the operation of active vent 106a may result in some users perceiving audio to be improved.
  • earphone device 100 comprises a second optional active vent 106b.
  • first active vent 106a is located on first cavity 105 and second active vent 106b is located on second cavity 107, with both providing vent paths from within each respective cavity to the environment outside of earphone device 100.
  • first active vent 106a and second active vent 106b can be selectively controlled in a related pattern, such as to open and close inversely to one another, sequentially to one another, at the same time, or with only one or the other opening or closing according to certain characteristics of earphone device 100 (e.g., sound sensed by sensor 102, an output audio signal provided by speaker 104).
  • Embodiments that include at least one active vent 106a, 106b can provide pressure reduction with respect to the ear of a user and may also provide some audio advantages (e.g., helping to compensate for anticipated low frequency sound losses that can result from the opening of first active vent 106a).
  • additional active vents can be included, and the placement and relative arrangement of the plurality of active vents (including first active vent 106a and second active vent 106b) can vary from the examples of the drawings.
  • Earphone device 100 also can comprise at least one passive vent 110a that can also provide some pressure relief as well as to provide ventilation, cooling, and airflow that may be necessary for the operation of speaker 104 and other components.
  • Passive vent 110a is generally located in an external surface of earphone device 100.
  • two passive vents 110a and 110b are provided, with passive vent 110a arranged with respect to first cavity 105 and passive vent 110b arranged with respect to second cavity 107.
  • Placement options for passive vents 110a, 110b may generally be limited due to size constraints of earphone device 100. Size, placement, and orientation of any or all active vents 106a, 106b and passive vents 110a, 110b is limited by the space available in earphone device 100, which must be sized to fit securely and comfortably in the ear of a user, size.
  • Active vent 106a, 106b and passive vents 110a, 110b each can comprise at least one aperture and optionally an acoustic membrane of suitable material to control the acoustic impedance of the opening.
  • Active vents 106a, 106b generally have an opening of 1 square millimeter (mm) 2 .
  • Passive vent 110a, 110b size range can be between 0.1mm 2 and 3mm 2 .
  • passive vent sizes can be larger in order to compensate for larger corresponding active vents.
  • headphone device 200 fits on the ear of a user. In another example, headphone device 200 fits over the ear of a user. Though only a single headphone device 200 is depicted, headphone device 200 can comprise one of a pair of headphone devices 200 that make up a set of headphones. Headphone device 200 also can be singular, such as may be used on some types of headsets.
  • Headphone device 200 generally comprises at least one sensor 202, at least one speaker 204, at least one active vent 206a, 206b, a first cavity 205, a second cavity 207, at least one passive vent 210a, 210b, and an ear cushion 212 that contacts or covers the ear of a user in use.
  • These components their reference numerals incremented by 100 with respect to the embodiments of FIGS. 1A and 1B (e.g., speaker 104 and speaker 204; first cavity 105 and first cavity 205) generally are similar or the same unless otherwise discussed herein. Thus, description and discussion of these components will not be repeated herein.
  • Ear cushion 212 can be made of a material or combination of materials that provide a sufficient seal around or on the ear of the user while also being comfortable, such as memory foam covered by a fabric or by leather.
  • headphone device 200 As headphone device 200 is configured to be worn on or over the ear of the user, sound may enter in, or escape from, around or through ear cushion 212 of headphone device 200.
  • vibrational pressures through natural movements of the user's body such as for example footsteps, can cause headphone device 200 to move on the head or ear of the user, or the hair or glasses of a user can affect the efficacy of the fit and seal of ear cushion 212.
  • Embodiments incorporating at least one active vent 206a, 206b therefore can provide pressure reducing features that improve the user experience.
  • System 300 is a functional depiction of various components of, e.g., in-ear earphone device 100, headphone device 200, or another wearable or other audio device, here referred to generally as device 300.
  • the various components of system 300 can control active vents 106a 206a (e.g., timing, whether a particular active vent is open or closed, how a plurality of active vents are opened and controlled relative to one another).
  • active vents 106a 206a e.g., timing, whether a particular active vent is open or closed, how a plurality of active vents are opened and controlled relative to one another.
  • reference numerals for like components and features are generally incremented by 100 (e.g., speaker 104, 204, 304; sensor(s) 102, 202, 302; etc.).
  • System 300 can be configured to receive audio input 307 that is not necessarily detected by sensors 302.
  • System 300 comprises one or more sensors 302 as discussed herein above. Though these sensor modalities are depicted for illustrative purposes in FIG. 3 , in other examples one or more can be omitted, or additional sensors can be included.
  • System 300 also includes at least one speaker 304, at least one active vent 306, an amplifier 305, an ANC system or circuitry 320 inclusive of audio input compensation, a processor 330, and memory 332.
  • ANC system or circuitry 320 is part of or implemented by processor 330.
  • Processor 330 can be any programmable device that accepts digital or analog data as input, is configured to process the input according to instructions or algorithms and provides results as outputs.
  • processor 330 can be a central processing unit (CPU), a very low latency digital signal processor (DSP), or a microcontroller or microprocessor configured to carry out the instructions of a computer program.
  • Processor 330 is therefore configured to perform at least basic arithmetical, logical, and input/output operations.
  • Memory 332 can comprise volatile or non-volatile memory as may be required by processor 330 to not only provide space to execute the instructions or algorithms, but to provide the space to store the instructions themselves.
  • volatile memory can include random access memory (RAM), dynamic random access memory (DRAM), or static random access memory (SRAM), for example.
  • non-volatile memory can include read-only memory (ROM), flash memory, ferroelectric RAM, hard disk, or optical disc storage, for example.
  • each sensor 302 can be configured to continually monitor for a respective incoming or occurring sensor modality (e.g., sound, movement, orientation). Each sensor 302 then can provide a sensor data signal to processor 330.
  • a respective incoming or occurring sensor modality e.g., sound, movement, orientation
  • processor 330 can process received sensor data signals in accordance with an associated acoustic scene and operating mode, save or retrieve related information to or from memory 332, in interaction with ANC system 320.
  • processor 330 can process received audio input 307 in accordance with an associated acoustic scene and operating mode, save or retrieve related information to or from memory 332, in interaction with ANC system 320.
  • processor 330 can provide a control signal to amplifier 305 to produce or adjust an audio output signal to be emitted via speaker 304.
  • ANC system 320 can provide selections, programming, algorithms, or information (alone or in concert with processor 330) to generate an anti-noise signal or a signal to overcome the passive attenuation of headphone/earphone (transparency mode) or sound according to the sensor data and the determined acoustic scene and operating mode.
  • Anti-noise sound can be considered a subtraction of extraneous background sound detected by sensor 302.
  • the subtracted sound is air pressure that is an inverse of the detected extraneous background sound.
  • ANC system 320 can provide an anti-noise signal to processor 330 and to amplifier 305 in order to minimize overall latency.
  • ANC system 320 can generate, or cause speaker 304 to generate, anti-noise sound based on acoustic scene classification and operating mode determined by processor 330. For example, anti-noise sound generated by ANC system 320 when device 300 is operating in transparency mode can be different from anti-noise sound generated by ANC system 320 when the disclosed electronic device is operating in active noise cancellation. Similarly, if an acoustic scene is identified as outdoors on a windy day, ANC system 320 can generate anti-noise sound differently from if the acoustic scene is a relatively quiet indoor environment.
  • processor 330 can transmit a control signal to ANC system 320 to generate anti-noise sound for a specific frequency range based in part on the identified acoustic scene.
  • processor 330 can transmit a control signal to ANC system 320 to generate anti-noise sound for a specific frequency range based in part on the identified acoustic scene.
  • processor 330 can filter sensor data based on determined operating mode and acoustic scene using a combination of filters.
  • processor 330 After processor 330 receives a processed audio signal, such as for example a music compensated feedback microphone signal, from ANC system 320, processor 330 processes the audio signal with the sensor data. If the processed data results in a frequency range or weighted loudness level above a predefined threshold (as further described below in FIG. 4 ), processor 330 transmits a trigger signal to active vent 306 to open for a duration of time based on the frequency level of the sampled data. If, however, the sampled frequency level is below a predefined threshold, processor 330 transmits a control signal to the active vent 306 to remain closed. In alternate embodiments, if the sampled frequency level is within a specified frequency range below the threshold, processor 330 transmits a control signal to the active vent 306 to be in a partially open state.
  • a predefined threshold as further described below in FIG. 4
  • speaker 304 can generate an audio output signal based on sampled and processed sensor data to provide audio output sound according to a user preference.
  • speaker 304 can generate an audio output signal based on combination of the sampled sensor data and other desired audio signals processed by processor 330 (such as the user's desired choice of music) to provide the user with an optimized listening experience.
  • processor 330 can be within or outside a housing of device 300.
  • processor 330 can operate in and on device 300, or as part of a remote user device (e.g., a smartphone, smart watch, tablet, computer, or other computing device), or in the cloud or on a remote server in wired or wireless communication with device 300.
  • a remote user device e.g., a smartphone, smart watch, tablet, computer, or other computing device
  • processor 330 can operate in and on device 300, or as part of a remote user device (e.g., a smartphone, smart watch, tablet, computer, or other computing device), or in the cloud or on a remote server in wired or wireless communication with device 300.
  • electronic devices disclosed herein include processor 330 configured to control one or more features of device 300 disclosed herein based on data from sensor 302.
  • Processor 330 and ANC system 320 can comprise one or more engines.
  • An "engine” as referred to herein can be any hardware or software that is constructed, programmed, configured, or otherwise adapted to autonomously carry out a function or set of functions.
  • Engine is herein defined as a real-world device, component, or arrangement of components implemented using hardware, such as by an application specific integrated circuit (ASIC) or field programmable gate array (FPGA), for example, or as a combination of hardware and software, such as by a microprocessor system and a set of program instructions that adapt the engine to implement the particular functionality, which (while being executed) transform the microprocessor system into a special-purpose device.
  • ASIC application specific integrated circuit
  • FPGA field programmable gate array
  • An engine can also be implemented as a combination of the two, with certain functions facilitated by hardware alone, and other functions facilitated by a combination of hardware and software.
  • an engine can be executed on the processor(s) of one or more computing platforms that are made up of hardware (e.g., one or more processors, data storage devices such as memory or drive storage, input/output facilities such as network interface devices, video devices, keyboard, mouse or touchscreen devices, etc.) that execute an operating system, system programs, and application programs, while also implementing the engine using multitasking, multithreading, distributed (e.g., cluster, peer-peer, cloud, etc.) processing where appropriate, or other such techniques.
  • hardware e.g., one or more processors, data storage devices such as memory or drive storage, input/output facilities such as network interface devices, video devices, keyboard, mouse or touchscreen devices, etc.
  • multitasking multithreading
  • distributed e.g., cluster, peer-peer, cloud, etc.
  • each engine can itself be composed of more than one sub-engine, each of which can be regarded as an engine in its own right.
  • processor 330 corresponds to defined operation, wherein operation can be determined without need for additional manual input from the user; however, it should be understood that in other contemplated embodiments, functionality can be distributed to more than one engine.
  • multiple defined functionalities may be implemented by a single engine that performs those multiple functions, possibly alongside other functions, or distributed differently among a set of engines than specifically illustrated in the examples herein.
  • Embodiments of the present disclosure can optionally implement artificial intelligence (AI) or machine learning (ML) to better process and recognize patterns related to detected sensor data.
  • Patterns in sensor data for electronic devices disclosed herein or any electronic device comprising functional equivalent of earphone device 100 or headphone device 200 can be extracted manually or automatically by machine learning approaches such as, for example, convolutional neural networks, to produce training data that can be compared to detected sensor data.
  • the ML model can be efficiently applied to supervised (labeled) detected sensor data by processor 330.
  • unlabeled (unsupervised) force data can be used although accuracy and precision of the ML model will perform comparatively worse without additional training.
  • the ML model can better recognize patterns in detected sensor data, including acceptable associated parameter levels for pressure and frequency with respect to detected sensor data.
  • the comparison process can be accomplished by computing similarity metrics using correlation or machine learning regression algorithms. This analysis can be improved during operation by inclusion of feedback loops directed to classifying sensor data parameter patterns for particular users.
  • Alternate embodiments can include analyzing gestures pertaining to electronic devices including functional equivalents of earphone device 100 and headphone device 200, such as for example an electronic device, where a "take off device" gesture is above a certain threshold. As more comparisons between received data and training data are made, feedback of the accuracy of previous comparisons can be tracked to better recognize future force data patterns.
  • ANC system 320 can be implemented using the ML model.
  • System 400 is a functional depiction of various components of system 300 and will use corresponding reference numerals for consistency.
  • System 400 comprises one or more sensors 302 as discussed herein above. Though these sensor modalities are depicted for illustrative purposes in FIG. 4 , in other examples one or more can be omitted, or additional sensors can be included. Though not exclusively sensor modalities, at least sensors 302 and output from the ANC system 320 can include acoustic scene classification output (which can relate to signals from one or more sensors, or a user setting or selection) and an operation mode setting or selection (such as ANC, transparency, voice/call, music, etc.).
  • acoustic scene classification output which can relate to signals from one or more sensors, or a user setting or selection
  • an operation mode setting or selection such as ANC, transparency, voice/call, music, etc.
  • Data collection block 432 can be implemented in whole or in part by processor 330 in examples.
  • control signals from data collection block 432 are communicated to each of a plurality of vent control block 434.
  • the vent control blocks work in a similar way like classic audio dynamic compressors- with attack time, hold time and release time parameters, threshold levels etc. The whole timing of the opening and closing process of the active vent is described here.
  • each vent when multiple active vents are used, as is depicted in the example of FIG. 4 , each vent can have its own corresponding vent control block in order to allow for greater control and flexibility over opening and closing of each vent.
  • a single vent control block can be configured to control a plurality of active vents.
  • the overarching data control block can be configured to continually collect sensor data and create a trigger signal for the vent control block(s) based on collected data. Additional speakers can also be included to compensate for lost frequency due to opening of an active vent.
  • a dynamic equalizer can boost low frequencies in the audio signal during the open phase of the active vent.
  • the filters of the active noise cancellation can be adapted to the different acoustic situation while the vent is open, hence the inclusion of audio and ANC parameter adaptation block 436.
  • FIG. 5 Another depiction of active vent circuitry is shown in FIG. 5 .
  • audio input 507 is fed through a compensation filter 504, and this signal is then combined with an amplified signal from a feedback microphone 502, where the signal sensed by feedback microphone 502 is amplified by amplifier 505a.
  • the compensation filter 504 is designed in a way that an incoming audio signal that is also played back directly through the speaker and hence also is sensed by the feedback microphone 502 is subtracted (at 508) from the microphone signal. In general terms, this indicates that the bandpass filter 510 input only gets the pure feedback microphone signal without any music signal that could disturb the combined signal.
  • This combined signal can then be bandpass filtered using bandpass filter 510 and provided to a vent control block 434. Vent control block 434 can then control the active vent 506 via a control signal through a power amplifier 505 b and a speaker.
  • ANC system 320 can be configured to provide a music compensated first sensor signal. In alternate embodiments, ANC system 320 can be configured to provide a music compensated first sensor signal and an ANC signal.
  • a system is built around a feedback microphone sensor inside the speaker front cavity or close to the ear canal, a data collection block, a vent control block, and an active vent.
  • Embodiments are generally configured to target in-ear headphones, and as such be lightweight and therefore include smaller batteries and speakers, and overall be encompassed within a slim design.
  • the design needs appear to contradict with acoustic needs of such audio devices, where big speakers can enhance low frequency performance and enhance an acoustically open design, but can also occupy greater space and therefore are required to be housed in larger audio devices, which can detract from user experience.
  • an active vent such as a MEMS device disclosed herein, can be configured to open and close based on when user starts and stops running or walking. Generally, active vents are permanently opened or closed.
  • a feedback microphone sensor with a strong embedded detection circuit and optional additional sensors, can detect footsteps in various embodiments.
  • this disclosure is directed to wearable audio devices, including in-ear audio devices and over-ear headphones. At least one, though in some embodiments a plurality, of active vents can be used.
  • the wearable audio devices can include a silicon ear piece.
  • a feedback microphone sensor can be configured to measure a sound pressure level in front of a speaker, the signal can then be transmitted to the ANC circuit for further processing.
  • Passive vents can be configured along the wearable audio device to offer pressure relief such as atmospheric pressure relief. Passive vents are often configured in parallel with the at least one active vents. Passive vents are configured to remain open and often include an acoustic membrane.
  • a music compensation circuit can be used, which can be added to the data collection block such that desired music played by user is not affected.
  • additional sensors can be added for scene classification, in addition to all of the above.
  • other sounds in addition to footsteps such as tapping, can be detected.
  • the frequency is generally low, such as below 100 Hz.
  • Additional speakers can be used for additional fine-tuning, and an active speaker can be included which can be configured to compensate for any lost frequency which happens when an active vent is opened.
  • the pressure peak can be detected by a feedback microphone sensor, followed by a bandpass filter to suppress higher and subsonic frequencies.
  • the active vent opens the front speaker cavity to release the pressure.
  • the attack, hold, and release parameters define how fast the vent opens, how long it stays open, and how fast the vent closes.
  • the active vent will only open during the impact of the foot that creates an uncomfortable pressure peak in front of the ear drum. As soon as the pressure signal at the feedback microphone drops below the threshold, the active vent closes according to hold and release times. The music signal low frequencies are only reduced for the same period where the footstep happens. This reduction may be masked by extraneous mechanical noise of the footstep. In a more complex system, low frequency reductions can be equalized out by using an adaptive equalizer (EQ).
  • EQ adaptive equalizer
  • the music playback low frequency response can be degraded by the additional opening on the front cavity of the loudspeaker.
  • a dynamic EQ can boost low frequencies in a desired music signal during the open phase of the active vent.
  • the filters of the active noise cancellation can be adapted to the different acoustic situation while the active vent is open.
  • the active vent can be located at the speaker first cavity and/or between first and second cavity. Additionally, an active vent can be located at the speaker back housing to compensate for low frequency music playback losses that the opening of the first cavity could cause.
  • the feedback microphone sensor can be analog or digital.
  • the feedback microphone sensor of the ANC system can be reused as a data source for the data collection block.
  • Other sensors can also be configured to deliver relevant information to the data collection block.
  • Alternative sensors include accelerometers, VPU sensors, IMU sensors, etc.
  • the data collection block collects sensor data or already processed data, such as for example from an acoustic scene classifier, and creates a trigger signal for the vent control block.
  • Signal processing is generally extremely efficient as the entire signal processing chain can reuse the fast DSP that is in place to also calculate ANC.
  • the overall latency from input to output should be below 1ms.
  • the vent control block controls the threshold above which the vent should actively open as well as parameters related to timing.
  • the timing parameters can be adjusted similarly to timing parameters of an audio compressor or limiter, including attack, hold and release times.
  • the active vent can be a MEMS, electrodynamic or similar vent which can vary the acoustically relevant area based on a control signal.
  • the active vent can be configured to seamlessly change the open area and react within milliseconds of a control signal change. Furthermore, the active vent should open or close without generating significant additional noise.
  • Multiple data sources can be used and can be analog or digital, sensor data from multiple sensors like microphones and accelerometers can be combined to get a reliable input for the data collection block.
  • Information on the operating mode of the wearable audio device and information on the current use case and/or environment delivered by an acoustic scene classification can be considered as input for the data collection block.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Signal Processing (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Otolaryngology (AREA)
  • Soundproofing, Sound Blocking, And Sound Damping (AREA)
EP24162617.5A 2023-03-10 2024-03-11 Aktive leckageanpassung für am körper tragbare audiovorrichtungen Pending EP4429269A1 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DKPA202300218 2023-03-10
US18/331,590 US20240305923A1 (en) 2023-03-10 2023-06-08 Active leakage adaption for wearable audio devices

Publications (1)

Publication Number Publication Date
EP4429269A1 true EP4429269A1 (de) 2024-09-11

Family

ID=90364759

Family Applications (1)

Application Number Title Priority Date Filing Date
EP24162617.5A Pending EP4429269A1 (de) 2023-03-10 2024-03-11 Aktive leckageanpassung für am körper tragbare audiovorrichtungen

Country Status (1)

Country Link
EP (1) EP4429269A1 (de)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140169579A1 (en) * 2012-12-18 2014-06-19 Apple Inc. Hybrid adaptive headphone
CN113840202A (zh) * 2021-09-23 2021-12-24 广东乐心医疗电子股份有限公司 一种降噪耳机

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140169579A1 (en) * 2012-12-18 2014-06-19 Apple Inc. Hybrid adaptive headphone
CN113840202A (zh) * 2021-09-23 2021-12-24 广东乐心医疗电子股份有限公司 一种降噪耳机

Similar Documents

Publication Publication Date Title
US11039241B2 (en) Controlling ambient sound volume
US10657950B2 (en) Headphone transparency, occlusion effect mitigation and wind noise detection
US9949048B2 (en) Controlling own-voice experience of talker with occluded ear
CN113826157B (zh) 用于耳戴式播放设备的音频系统和信号处理方法
JP5639160B2 (ja) イヤホン配置及びその動作方法
US11438711B2 (en) Hearing assist device employing dynamic processing of voice signals
US11295718B2 (en) Ambient volume control in open audio device
US10204615B2 (en) Noise-cancelling headphone
US11553286B2 (en) Wearable hearing assist device with artifact remediation
EA011361B1 (ru) Аппарат и способ усиления звука
US11457318B2 (en) Hearing device configured for audio classification comprising an active vent, and method of its operation
CN107948785B (zh) 耳机和对耳机执行自适应调整的方法
CN114268868A (zh) 具有多个参考麦克风的头戴式耳机anc和透传
US9913020B2 (en) Noise-cancelling headphone
EP4429269A1 (de) Aktive leckageanpassung für am körper tragbare audiovorrichtungen
US20240305923A1 (en) Active leakage adaption for wearable audio devices
US20230421974A1 (en) Systems and methods for own voice detection in a hearing system
CN118632161A (zh) 音频设备及动态调节音频设备中的主动泄漏的方法
US20230178063A1 (en) Audio device having aware mode auto-leveler
US20240223970A1 (en) Wearable hearing assist device with sound pressure level shifting
CN113259822B (zh) 具有至少一个听力设备的听力系统及运行听力系统的方法
US20240005902A1 (en) Headphone Speech Listening
WO2023107426A2 (en) Audio device having aware mode auto-leveler
RU2801826C1 (ru) Способы оптимизации рабочего состояния наушников с костной проводимостью

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC ME MK MT NL NO PL PT RO RS SE SI SK SM TR