EP3662465A1 - Procédé de commande d'un système audio de réduction de bruit acoustique par des tapes d'utilisateur - Google Patents

Procédé de commande d'un système audio de réduction de bruit acoustique par des tapes d'utilisateur

Info

Publication number
EP3662465A1
EP3662465A1 EP18733712.6A EP18733712A EP3662465A1 EP 3662465 A1 EP3662465 A1 EP 3662465A1 EP 18733712 A EP18733712 A EP 18733712A EP 3662465 A1 EP3662465 A1 EP 3662465A1
Authority
EP
European Patent Office
Prior art keywords
headphone
peak
current
value
time window
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP18733712.6A
Other languages
German (de)
English (en)
Other versions
EP3662465B1 (fr
Inventor
Paul Yamkovoy
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Bose Corp
Original Assignee
Bose Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US15/668,386 external-priority patent/US9930440B2/en
Priority claimed from US15/889,745 external-priority patent/US10110987B2/en
Priority claimed from US15/889,752 external-priority patent/US10091573B2/en
Application filed by Bose Corp filed Critical Bose Corp
Publication of EP3662465A1 publication Critical patent/EP3662465A1/fr
Application granted granted Critical
Publication of EP3662465B1 publication Critical patent/EP3662465B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1041—Mechanical or electronic switches, or control elements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1083—Reduction of ambient noise
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2460/00—Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
    • H04R2460/01—Hearing devices using active noise cancellation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R5/00—Stereophonic arrangements
    • H04R5/033—Headphones for stereophonic communication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R5/00—Stereophonic arrangements
    • H04R5/04—Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments

Definitions

  • This description relates generally to controlling the mode of an audio device and, more specifically, to acoustic noise reduction (ANR) headphones or headsets that can be controlled by the tap or touch of a user.
  • ANR acoustic noise reduction
  • a method for controlling an audio system includes tapping at least one of a headphone worn by a user and an ear or a head of the user to cause an acoustic pressure change in an ear canal of the user.
  • the ear canal is substantially sealed by an ANR headphone having an ANR module.
  • a current that is responsive to a pressure change in the ear canal and provided to the ANR module is sensed.
  • a peak value is determined from the sensed current and compared to a value of an adaptive threshold to determine if a tap occurred. If the tap is determined to have occurred, an updated value for the adaptive threshold is determined based on the peak value and one or more prior peak values.
  • Examples may include one or more of the following features:
  • the method may further include changing at least one of a mode of operation of the audio system and an attribute of an audio input signal in response to a determination that the tap occurred.
  • the updated value of the adaptive threshold may be determined as a product of a predetermined constant and an average of the peak value and the one or more prior peak values.
  • the value and the updated value of the adaptive threshold may be greater than an average noise level and less than an average of the peak value and the one or more prior peak values.
  • the one or more prior peak values may occur during a current user session or during a prior user session.
  • the sensing of the current provided to the ANR module may include sensing a voltage of the current sensor.
  • the updated value of the adaptive threshold may be greater than the value of the adaptive threshold if the peak value is greater than the value of the adaptive threshold.
  • the updated value of the adaptive threshold may be less than the value of the adaptive threshold if the peak value is less than the value of the adaptive threshold.
  • the headphone may include an ear cup or an earbud.
  • a headphone in accordance with another aspect, includes a microphone, an ANR module and a processor.
  • the microphone detects a pressure change in a substantially sealed cavity of the headphone wherein the cavity includes an ear canal of a wearer of the headphone.
  • the ANR module is coupled to the microphone for generating a noise cancellation signal to cancel noise detected by the microphone.
  • the processor is in communication with the microphone and the ANR module.
  • the processor is configured to sense a current provided to the ANR module, wherein the current is responsive to a pressure change in the ear canal, and to determine a peak value from the sensed current.
  • the processor is further configured to compare the peak value and a value of an adaptive threshold to determine if a tap occurred, and, if the tap is determined to have occurred, determine an updated value for the adaptive threshold based on the peak value and one or more prior peak values.
  • Examples may include one or more of the following features:
  • the processor may be further configured to change at least one of a mode of operation of the audio system and an attribute of an audio input signal in response to a determination that the tap occurred.
  • the determination of the updated value for the adaptive threshold may include determining a product of a predetermined constant and an average of the peak value and the one or more prior peak values.
  • the headphone may further include a current sensor in communication with the ANR module and the processor, and configured to provide a signal responsive to a characteristic of the current.
  • a method for controlling an audio system includes tapping at least one of a headphone worn by a user or an ear or a head of the user to cause an acoustic pressure change in an ear canal of the user.
  • the ear canal is substantially sealed by an ANR headphone having an A R module.
  • a current that is responsive to a pressure change in the ear canal and provided to the ANR module is sensed.
  • a first peak in the sensed current is determined and a determination that a dual tap occurred is made if a second peak in the sensed current is determined during a first time window initiated at the determination of the first peak.
  • Examples may include one or more of the following features:
  • the method may include changing at least one of a mode of operation of the audio system and an attribute of an audio input signal if a determination is made that a dual tap occurred.
  • the method may include, if the second peak is determined not to occur during the first time window, determining that a dual tap occurred if a third peak in the sensed current is determined during a second time window initiated at the determination of the second peak. At least one of a mode of operation of the audio system and an attribute of the audio input signal is changed if a determination is made that a dual tap occurred.
  • the first time window and the second time window may have a same duration.
  • the method may further include initiating a third time window if a determination is made that a dual tap occurred, wherein the third time window has a duration that is greater than the duration of the first time window, and determining that an invalid dual tap occurred if a third peak in the sensed current is determined during the third time window.
  • the change to the at least one of a mode of operation of the audio system and the attribute of an audio input signal may be reversed if a determination is made that an invalid dual tap occurred.
  • the sensing of the current provided to the ANR module may include sensing a voltage of a current sensor.
  • the determination that a dual tap occurred may include determining that a dual tap occurred if the second peak in the sensed current is the only peak determined after initiation of the first time window.
  • the headphone may include an ear cup or an earbud.
  • a headphone in another aspect, includes a microphone, an ANR module and a processor.
  • the microphone detects a pressure change in a substantially sealed cavity of the headphone, wherein the cavity includes an ear canal of a wearer of the headphone.
  • the ANR module is coupled to the microphone and generates a noise cancellation signal to cancel noise detected by the microphone.
  • the processor is in communication with the microphone and the ANR module.
  • the processor is configured to sense a current provided to the ANR module, wherein the current is responsive to a pressure change in the ear canal.
  • the processor is further configured to determine a first peak in the sensed current and to determine that a dual tap occurred if a second peak in the sensed current is determined during a first time window initiated at the determination of the first peak.
  • Examples may include one or more of the following features:
  • the processor may be further configured to change at least one of a mode of operation of the audio system and an attribute of an audio input signal if a determination is made that a dual tap occurred.
  • the processor may be further configured to determine that a dual tap occurred if a third peak in the sensed current is determined during a second time window initiated at the determination of the second peak if the second peak is determined not to occur during the first time window.
  • the processor may be further configured to change at least one of a mode of operation of the audio system and an attribute of the audio input signal if a determination is made that a dual tap occurred.
  • the processor may be further configured to initiate a third time window if a determination is made that a dual tap occurred, wherein the third time window has a duration that is greater than a duration of the first time window, and to determine that an invalid dual tap occurred if a third peak in the sensed current is determined during the third time window.
  • the processor may be further configured to reverse the change to the at least one of a mode of operation of the audio system and the attribute of an audio input signal if a determination is made that an invalid dual tap occurred.
  • the headphone may further include a current sensor in communication with the A R module and the processor, and configured to provide a signal responsive to a characteristic of the current.
  • FIG. 1 is a functional block diagram of an example of a circuit for an ANR audio system having tap control.
  • FIG. 2 is a functional block diagram of an example of circuitry for an ANR audio system having tap control.
  • FIG. 3 is a flowchart representation of an example of a method for controlling an ANR audio system having tap control.
  • FIG. 4 is a functional block diagram of a circuit that may be used to implement one of the signal conditioner modules and the audio and mode control module of FIGs. 1 and 2.
  • FIG. 5 is an example of voltage peaks associated with pressure pulses for taps used to control an audio system.
  • FIG. 6 is another example of voltage peaks associated with pressure pulses for taps used to control an audio system.
  • FIG. 7 is a flowchart representation of an example of a method for controlling an audio system using taps.
  • FIGS. 8A, 8B and 8C are depictions of pressure pulses associated with taps that may be used to control an audio system having tap control.
  • FIG. 9 is a flowchart representation of another example of a method for controlling an audio system using taps.
  • an ANR headphone is any headphone or headset component that can be worn in or about the ear to deliver acoustic audio signals to the user or to protect the user's hearing, provides acoustic noise reduction or cancellation and has an exposed surface that can be tapped by a user.
  • an ANR headphone can be an ear cup that is worn on or over a user's ear, has a cushion portion that extends around the periphery of the opening to the ear as an acoustic seal, and a hard outer shell.
  • ANR headphones as used herein, also include ANR earbuds that are typically at least partially inserted into the ear canal and have an exposed surface that a user can tap or allow the user to tap the ear or a nearby region of the head.
  • Taps occurring in succession during a brief time period are defined herein as a "tap event.”
  • a “tap sequence” refers to the content of the tap event, that is, the number of individual taps in the tap event.
  • the tap sequence can be a single tap or can be two or more taps within a pre-determined period.
  • a tap event may be used to change a mode of operation of headphones or other components integrated with an ANR audio system.
  • the tap event can be used to change a headphone set from audio playback mode to a telephone communications mode.
  • the tap event can be used to change a feature available in one mode that may not be available in a different mode.
  • the mapping of specific tap sequences to associated functions is defined according to the particular mode of operation of the A R audio system.
  • the tap event is interpreted in light of the current operating mode. For example, a tap sequence defined by a single tap during playback may be interpreted as an instruction to pause the current audio playback. In contrast, a single tap during telephone communications may be interpreted as an instruction to place a telephone call on hold.
  • tapping a headphone one or more times to change the volume of an audio signal during playback, to skip to a subsequent audio recording in a playlist or sequence of recordings, to pause audio playback and to pair the headphones with another device via wireless communication, for example, using Bluetooth.
  • the detection of the tapping of the external portion of an ANR headphone, the ear or the head uses existing functionality within the ANR headphone.
  • the taps are reliably detected and can be used to control features available within a particular mode of operation of the headphones and to change to a different mode.
  • noise is detected by a feedback microphone and ANR circuitry generates a compensating signal to cancel that noise.
  • Conventional ANR circuitry does not distinguish between the various sources of pressure changes detected by the feedback microphone.
  • the pressure change can be acoustic noise or can be the result of a touching of an exposed surface of the headphone, the external portion of the ear or a region of the head near to the headphone to cause an acoustic or subsonic pressure change.
  • the ANR circuitry In response to the tap, the ANR circuitry generates a compensating signal.
  • the visible portion of the ear made up of cartilage and skin, and which exists outside the head may be tapped to cause the pressure change in the sealed ear canal.
  • Certain portions of the auricle, such as the helix, tragus, or antihelix, are more easily accessible to the user and can be tapped.
  • a tap or headphone tap includes a direct touching of a headphone or any intended touching of the ear or region of the head near the ear that causes a pressure change in the sealed ear canal.
  • Tapping includes tugging, "flicking” or pulling of skin and/or cartilage of the ear or a portion of the head or skin on the head near the headphone.
  • a sealed ear canal includes a substantially sealed ear canal in which a complete seal does not exist. For example, there may be a small gap between the headphone and the ear can through which air may pass and thereby reduce the amplitude of the pressure change for a tap; however, the pressure change may be sufficient for recognizing the pressure change as a tap.
  • Examples of ANR headphones and ANR systems described herein take advantage of a difference between general acoustic noise and taps to a headphone based on a difference in the electrical current consumed by the ANR circuitry.
  • a power supply current detection circuit is used to distinguish current consumed as a result of acoustic noise from current consumed by a tap event.
  • a tap event results in high pressure within the headphone, and generally draws more current from the power supply than that used to generate an acoustic noise cancelling signal.
  • the current detection circuit senses a characteristic of the current, such as an amplitude and/or waveform or duration, that corresponds to an occurrence of a tap event
  • a signal indicative of the tap sequence for the tap event is provided to a microcontroller for interpretation.
  • the microcontroller may be part of an audio and mode control module which initiates the changes to audio features and operating mode of the ANR system.
  • the time occurring between consecutive taps in a single tap sequence can be defined to be less than a predefined duration or a tap sequence can require that all taps occur within a predefined time interval, for example, several seconds.
  • control buttons are often problematic for a user, especially when the buttons are located on a portion of the system that may be located in a pocket or on the arm of a user, or are located on a small or difficult to reach area of the headphone. For example, in the context of headsets used by pilots in aircraft, searching for buttons that are located on a peripheral or difficult to reach area may be distracting from focusing on the surroundings and the pilot's primary task.
  • FIG. 1 is a functional block diagram of an example of a circuit 10 for an ANR audio system having tap control.
  • the circuit 10 includes an ANR module 12, a current sensor 14, a signal conditioner module 16, an audio and mode control module 18 and a power supply 20.
  • the circuit 10 is configured to provide a signal to drive at least one acoustic driver
  • speaker 22 in a headphone cavity 24 and to receive a microphone signal from a microphone 26 in the headphone cavity 24.
  • the ANR module 12 includes a first input 28 that receives an audio input signal from the audio and mode control module 18 and a second input 30 that receives a supply current I s from the power supply 20.
  • the power supply can be one or more batteries, DC power provided by the audio source, or may be an electrical power converter such as a device that uses alternating current (AC) power and provides direct current (DC) power at a desired voltage level.
  • the A R module 12 includes an A R output 32 that provides an audio output signal to the speaker 22.
  • the ANR module 12 also includes various other components including an amplifier 50, feedback circuitry 52 and a summing node 54 as are known in the art.
  • the ANR module 12 can additionally use feedforward correction, allowing a combination of feedback correction and feedforward correction based, at least in part, on a microphone signal generated by the microphone 26 in response to received acoustic energy.
  • feedforward correction allowing a combination of feedback correction and feedforward correction based, at least in part, on a microphone signal generated by the microphone 26 in response to received acoustic energy.
  • an additional microphone (not shown) may be used to detect noise external to the headphone, and provide a signal cancelling that noise.
  • the feedback microphone 26 detects the residual noise in the headphone cavity 24 after the feedforward system has functioned to cancel noise detected external to the headphone.
  • the current sensor 14 has a sensor input 34 to receive a signal proportional to the supply current Is from the power supply 20 and a sensor output 36 that provides a signal responsive to a characteristic (e.g., an amplitude and/or waveform or duration) of the supply current I s .
  • the signal conditioner module 16 includes an input 38 in communication with the output 36 of the current sensor 14 and an output 40 that provides a conditioned signal to the audio and mode control module 18.
  • the conditioned signal is a logic level signal (e.g., a low or high logic value digital pulse) generated according to the signal provided at the sensor output 36.
  • the current sensor 14 includes a "sensing" resistor 56 and an amplifier 58 having differential inputs to sense a voltage across the resistor 56.
  • the audio and mode control module 18 includes an input 42 to receive a signal from an audio source 44, another input 46 to receive the conditioned signal and an output 48 in communication with the first input 28 of the ANR module 12.
  • the audio source for the headphone may be different than the audio source for a second headphone (not shown). For example, one audio source may provide a left channel audio signal and the other audio source may provide a right channel audio signal.
  • the audio and mode control module 18 is used to control a mode of operation of the ANR audio system, an attribute of the audio input signal, or both, in response to the conditioned signal. Examples of modes include, but are not limited to, music playback, telephone mode, talk through mode (e.g., temporary pass through of a detected voice), a level of desired ANR, and audio source selection. Examples of attributes of the audio input signal include, but are not limited to, volume, balance, mute, pause, forward or reverse playback, playback speed, selection of an audio source, and talk through mode.
  • the audio output signal from the ANR module 12 is received at the speaker 22 and results in production of an acoustic signal that substantially reduces or eliminates acoustic noise within the headphone cavity 24.
  • the audio output signal may also generate a desired acoustic signal (music or voice communications) within the headphone cavity 24.
  • FIG. 2 is a functional block diagram of an example of circuitry 60 that includes circuits for implementing ANR for a headphone system.
  • the circuitry 60 includes two circuits that are similar to the circuit 10 of FIG. 1.
  • Reference numbers in the figure that are followed by an "A” indicate elements associated with a circuit for one headphone (e.g., left headphone) and reference numbers followed by a "B” indicate elements associated with a circuit for the other headphone (e.g., right headphone).
  • Reference numbers lacking an "A” or "B” are generally associated with shared circuit components, though in some examples, they may be provided individually in each headphone.
  • FIG. 3 shows a flowchart representation of an example of a method 100 for controlling an ANR audio system having tap control.
  • the amplitude and/or waveform or duration of the supply current I s to each headphone is sensed (step 110) by monitoring the voltage drop across the sensing resistor 56.
  • an ear cup or earbud
  • the volume of the cavity defined by the ear cup and the user's ear canal changes due to the compliances of the cushion and user's skin.
  • the result is a change in the pressure within the ear cup and ear canal, which is sensed by the microphone 26.
  • the ANR module 12 responds by sending an electrical signal to the speaker 26 that produces an acoustic signal within the cavity intended to eliminate the pressure change caused by the tap.
  • the electrical signal provided at the output 32 of the ANR module 12 is sourced from the amplifier 50 which in turn consumes the supply current I s from the power supply 20.
  • a tap applied by a user to the headphone can be recognized as a significant variation in the amplitude and/or waveform or duration of the supply current I s .
  • the user may simply tap the headphone, ear or head a single time or may make multiple taps in rapid succession in order to change in a mode of operation of the A R system or an attribute of the audio signal received from the audio sources 44.
  • a determination is made (step 120) that a sequence of taps, including a single tap or multiple taps, has occurred.
  • the mode of operation of the ANR system or an attribute of the audio input signal is changed (step 130) in response to the taps in the sequence.
  • the steps of the method 100 are executed using the current sensor 14, signal conditioner module 16 and audio and control module 18. As each headphone has a current sensor 14 and a signal conditioner 16, either headphone or its associated ear or head region can be tapped to change the mode of operation or audio input signal attribute.
  • the simultaneous monitoring of the supply current I s for each headphone allows the determination according to step 120 to include a discrimination between a valid user tap and a different event that might otherwise be erroneously interpreted as a user tap.
  • a disturbance common to both headphones such as dropping a headphone set, disconnecting the headphone set from an audio system or the occurrence of a loud "external acoustic event" may result in a determination that both headphones have been tapped by a user. If it appears that both headphones have been tapped at nearly the same time, the audio and mode control module 18 ignores the disturbance and the mode and audio signal attributes remain unchanged.
  • FIG. 4 shows a functional block diagram of a circuit 70 that may be used to implement the signal conditioner module 16A for the left headphone (similar circuitry could be used for the right headphone) and the audio and mode control module 18.
  • the circuit 70 includes a band-pass filter (BPF) 72, which filters the signal provided by the amplifier 58 in the current sensor 14.
  • the filter may be a low-pass filter.
  • the band-pass filter 72 can have a minimum pass frequency of approximately 1 Hz and, in another example, the band-pass filter 72 (or low-pass filter) can have a maximum pass frequency of approximately 50 Hz.
  • the band-pass filter 72 has a pass frequency of approximately 10 Hz.
  • a non-zero minimum pass frequency prevents a near-DC event, such as a slow pressure application in which a headphone is slowly pressed against an object, such as a chair, from being interpreted as a tap event.
  • the filtered signal is received at a first input 74 of a comparator 76 and a reference voltage source 78 is coupled to a second input 80 of the comparator 76.
  • the reference voltage source 78 can be a voltage divider resistive network coupled to a regulated power supply.
  • a comparator output signal at the comparator output 82 is a logic value (e.g., HI) that indicates a possible tap event when the voltage at the first input 74 exceeds the "threshold voltage" applied to the second input 80 and otherwise is a complementary logic value (e.g., LO).
  • HI a logic value
  • LO complementary logic value
  • the comparator output signal indicative of a possible tap event when at a logic HI value, is applied to a clock input 98 of a monostable vibrator 96.
  • a signal of sufficient frequency and amplitude can cause excessive current through the current sensor 14 and therefore cause an affirmative signal at the comparator output 82 yet not result from a valid tap to a headphone.
  • a loud noise near a user might be sufficient to cause the comparator output signal to indicate a tap event.
  • the circuit 70 provides further components to prevent invalid events from being interpreted as valid tap events.
  • the comparator output signal is also applied to an input terminal 84 of an AND gate 86 and the comparator output signal from a counterpart comparator (e.g., right channel comparator, not shown) for the other (e.g., right) headphone channel is provided to the other input terminal 88.
  • a counterpart comparator e.g., right channel comparator, not shown
  • the AND gate 86 which is applied to an input 90 of a NOR gate 92, produces a logic value (e.g., HI) if the comparator output signals for both the left and right headphone channels are logic HI.
  • the NOR gage 92 inverts the logic HI signal to a logic LO signal that is applied to the enable input 94 of the monostable vibrator 96, thereby disabling the comparator output signal applied to the clock input 98 of the monostable vibrator 96 from appearing at the output 100.
  • a tap event e.g., a loud noise near the user
  • a voltage detector 102 is in communication with the power supply and provides a logic signal (e.g., HI) at its output 104 indicating an excessive power supply voltage, that is, that the applied voltage has transitioned from less than a threshold voltage to greater than a threshold voltage. Conversely, the logic signal at the output 104 will change to a complementary logic value (e.g., LO) when the applied voltage transitions from greater than the threshold voltage to less than the threshold voltage.
  • a logic signal e.g., HI
  • a delay module 106 receives the logic HI signal from the voltage detector 102 and holds the logic value until the expiration of a set time period (e.g., 0.5 s, though other periods of time could be used). This signal is applied to a second input 110 of the NOR gate 92 which in turn disables the monostable vibrator 96 to prevent a false indication of a tap event. In addition, there can be unwanted transients in an audio channel of the headphone.
  • a set time period e.g., 0.5 s, though other periods of time could be used.
  • An amplitude threshold module 112 receives the left channel audio signal and provides a delayed output signal at the output terminal 114 with a value corresponding to peaks in the voltage level of the audio signal.
  • a comparator 116 receives the output signal from the delay module 112 at a first input terminal 118 and a voltage from a reference voltage source 126 is applied to a second input terminal 120.
  • the reference voltage is selected to correspond to a voltage value above which the delayed output signal is considered to indicate an audio occurrence that is not a valid tap event.
  • a logic HI signal is generated at the comparator output 122 and applied to an input 124 of the NOR gate 92.
  • the NOR gate 92 applies a logic LO signal to the enable input 94 of the monostable vibrator 96 to disable the comparator output signal at the clock input 98 of the monostable vibrator 96 from appearing at the output 100.
  • the NOR gate 92 is a logic element that includes a number of inputs with each input receiving a logic signal indicative of a particular error condition.
  • the output of the logic element provides a logic signal having a first state if at least one of the error conditions exists and a second state if none of the error conditions exist.
  • the logic signal at the output is used to prevent a determination of a tap event for circumstances unrelated to a tap event.
  • the circuit 70 described above provides for determining the states of various error conditions, that is, conditions that can lead to a determination of a tap event without a user actually tapping a headphone.
  • the circuit 70 prevents such conditions from causing a change in an audio attribute or operational mode of ANR headphones or an ANR audio system.
  • the comparator 76 is implemented instead as a discriminator that uses two thresholds instead of a single threshold to determine a valid tap event.
  • the two thresholds may be selected so that the filtered signal from the bandpass filter 72 is interpreted to indicate a valid tap event if the voltage exceeds a lower threshold voltage and does not exceed the higher threshold voltage. In this way extreme amplitude events that "pass" the lower threshold voltage requirement, but are not initiated by a user tap, are prevented from being interpreted as valid tap event. By way of one example, removing a single headphone from the head of a user may result in such a high amplitude event.
  • the threshold value or values used to determine a valid tap event are constant values generally defined to be greater than a typical background noise value. Users may tap their headphone, ear or head differently from each other to cause different amplitude pressure changes. Consequently, a threshold value established for all users may not be suitable for users that tap substantially "harder” or "softer” than a typical user. For example, a user that taps "harder” than the typical user will generate greater amplitude pressure pulses. Referring to FIG. 4, the voltage pulses at the first input 74 of the comparator 76 corresponding to these harder taps have greater peak amplitudes than voltage pulses for a typical user.
  • a lesser threshold voltage may be preferable when the ear canal is repeatedly not well sealed by the headphone, for example, due to the way a user dons the headphone (e.g., obstructions due to hair).
  • FIG. 5 graphically depicts an example of the voltage at the first input 74 of the comparator 76 as a function of time for a user that implements control using hard taps.
  • voltage pulses 152, 154 and 156 corresponding to three consecutive valid tap events are shown with each tap event including only one tap.
  • Other voltage pulses 157 may be present due to mechanical disturbances in the user's environment; however, such voltage pulses 157 are typically well below the amplitude of those corresponding to valid tap events.
  • a default threshold voltage is shown by solid line 150. It should be noted that the peak voltage for each tap event is substantially greater than the default threshold voltage. The default threshold voltage value may be defined by a ratio of a typical peak voltage for a typical user to an expected noise level for the typical user.
  • an adaptive threshold (dashed line 158) is determined at a greater voltage so that the headphone is more immune to false detections by noise peaks while not sacrificing the ability to detect valid tap events.
  • FIG. 6 graphically depicts an alternative example of the voltage at the first input 74 of the comparator 76 as a function of time for a user that implements control using soft taps.
  • pressure pulses 162, 164 and 166 corresponding to three valid tap events are shown.
  • the default threshold voltage is shown by solid line 160.
  • the peak voltages for the three tap events are not substantially greater than the default threshold voltage (solid line 160).
  • An adaptive threshold (dashed line 168), which may be derived from long term averaging of the power supply current, can be determined so that valid tap events initiated by the user are more likely to be detected while not substantially degrading immunity to false detections caused by noise peaks 167.
  • FIG. 7 is a flowchart representation of an example of a method 200 for controlling an audio system.
  • the example includes tapping (step 210) an A R headphone, or the ear or head of the user, to cause an acoustic pressure change in the user's ear canal.
  • the current supplied to an ANR module of the headphone is responsive to the pressure change in the ear canal.
  • the current is sensed (step 220), for example, by monitoring the voltage of a current sensor.
  • a peak value of the sensed current is determined (step 230) and compared (step 240) to a value (e.g., a voltage value) of an adaptive threshold to determine if a valid tap event occurred.
  • the peak value may be a voltage value provided by a current sensor.
  • the adaptive threshold value is set at a predetermined initial value at the beginning of a use session when power is first applied. If the peak value is determined (step 240) to be less than the adaptive threshold value, the method 200 returns to step 210 for continued monitoring for tap events. Conversely, if it is determined (step 240) that the peak value equals or exceeds the adaptive threshold value, an updated value for the adaptive threshold is determined (step 250) based on the peak value and any prior peak values determined to correspond to tap events. For example, the updated value for the adaptive threshold value may be a product of a predetermined constant (e.g., a percentage) of an average of all peak values for tap events determined during the user session.
  • a predetermined constant e.g., a percentage
  • the updated value for the adaptive threshold may be determined according to weighting the values for more recent tap events more heavily than older tap events, according to a statistical distribution of the peak values or according to other criteria applied to the peak values to achieve an updated adaptive threshold value for robust detection of tap events.
  • the method 200 After updating the value for the adaptive threshold, the method 200 returns to step 210 to continue monitoring for tap events.
  • the determination of the peak value of the sensed supply current, the comparison of the peak value to the adaptive threshold and the determination of the updated value for the adaptive threshold, as performed in steps 220, 230 and 240, may be executed by one or more processors in communication with the microphone 24 inside the headphone cavity 24 and the A R module 12 (see FIG. 1). In one example, the processor(s) may also be shared with the audio and mode control module 18.
  • the adaptive threshold value is set to a predetermined initial value that is used at the beginning of each user session.
  • each user session results in an adaptive threshold determination that is responsive to the acoustic seal for that session.
  • the method 200 may be implemented such that the last adaptive threshold value from the prior user session is used as the initial adaptive threshold value for the new session, thereby allowing the adaptive threshold value to more rapidly converge on an appropriate value as long as the acoustic sealing of the user ear canal is substantially consistent over the user sessions.
  • the ear canal is acoustically sealed from the external environment by the headphone.
  • the peak values for the user taps will be reduced; however, the noise level is typically also reduced in a substantially proportionate manner. Consequently, adjustment of the threshold value in this instance may not provide a useful benefit.
  • a user may unintentionally cause a tap event, for example, by moving the user's hair or by adjusting eye glasses.
  • the pressure pulses generated by such activities may result in a tap event being determined ("declared").
  • Double tap controls can be used to prevent the audio system from interpreting these activities as tap events, resulting in a robust immunity to false tap event declarations.
  • a double tap event can be detected from a double-tapping of a headphone, ear or head of the user.
  • a double tap event is defined as two taps detected in a time window that starts upon detection of the first tap and ends after a fixed duration (e.g., 500 ms).
  • a single tap that is not followed by another tap during the time window of fixed duration will not be interpreted as a double tap event.
  • a tap event is not declared.
  • FIG. 8A depicts an example of two taps for a valid double tap event as determined in accordance with an example of the method 200.
  • the first tap 170 starts a time window of duration AT.
  • the second tap 172 occurs before the expiration of the time window and without any other taps present in the time window. Consequently, a double tap event is declared.
  • FIG. 8B depicts another example in which a first tap 174 starts a first time window of duration ⁇ 7 . No taps are detected during the time window therefore no double tap event is declared.
  • a second tap 176 occurring after expiration of the first time window starts a second time window of duration ⁇ 2 .
  • a third tap 178 occurs during the second time window without any additional taps during the second time window; therefore, the second and third taps 176 and 178 are interpreted as a valid double tap event.
  • FIG. 8C depicts another example in which a first tap 180 starts a time window of duration AT during which two additional taps 182 and 184 occur. Consequently, a double tap event is not declared.
  • FIG. 9 is a flowchart representation of an example of a method 300 for controlling an audio system.
  • the example includes tapping (step 310) a headphone, or the ear or head of a user, to cause an acoustic pressure change in the ear canal of the user.
  • the current supplied to the ANR module of the headphone is responsive to the pressure change in the ear canal due to the tapping.
  • the current is sensed (step 320) by monitoring the voltage of a current sensor or by other means for sensing current as is known in the art.
  • a first current peak is determined (step 330) and, in response to the determination, a time window of fixed duration is initiated.
  • a dual tap event is determined, or declared (step 350).
  • the determination of step 350 is delayed until the expiration of the fixed duration to allow for detection of at least a third peak that may occur during the time window which may prevent a declaration of a double tap event.
  • a validated double tap command is issued (step 360) and the method returns to step 320.
  • ear buds or ear cups may be powered before they are inserted into the ear canals or over the ears, respectively.
  • This situation increases the probability that during insertion and/or adjustment of the ear buds or ear cups, there may be two or more taps within a time window.
  • Such a situation may be problematic for certain uses.
  • an aviator may use an audio system which provides "talk through" capability for one headphone. The aviator may unknowingly change to talk through mode in this situation which can result in the aviator hearing unwanted nearby conversations.
  • a second window of longer duration e.g., two or more seconds
  • a second double tap event determined during the second window may be used to revert the audio system to the previous mode and to ignore all further double tap events for the remainder of the second window.
  • the application of the second, longer duration window may vary according to the awareness of the audio system to its operating mode. As described above, if a double tap event is used to initiate the talk through mode, it may be preferable to maintain a second window duration of a few seconds. Conversely, when power is initially provided to the headphones, it can be preferable to use a second window duration that is substantially greater (e.g., 30 seconds). This longer duration can accommodate the user's actions in donning the headphones and making initial positional adjustments to the headphones. In yet another example, if the audio system is configured for music playback (e.g., configured via an active Bluetooth interface), a shorter duration for the second window (e.g., 2 seconds) may be applied.
  • circuitry of Figures 1, 2 and 4 may be implemented with discrete electronics, by software code running on a digital signal processor (DSP) or any other suitable processor within or in communication with the headphone or headphones.
  • DSP digital signal processor
  • Embodiments of the systems and methods described above comprise computer components and computer-implemented steps that will be apparent to those skilled in the art.
  • the computer-implemented steps may be stored as computer-executable instructions on a computer-readable medium such as, for example, floppy disks, hard disks, optical disks, Flash ROMS, nonvolatile ROM, and RAM.
  • the computer- executable instructions may be executed on a variety of processors such as, for example, microprocessors, digital signal processors, gate arrays, etc.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Soundproofing, Sound Blocking, And Sound Damping (AREA)
  • Headphones And Earphones (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

L'invention concerne un casque d'écoute et un procédé de commande d'un système audio. Le procédé consiste à taper un casque d'écoute ou une tête d'un utilisateur pour provoquer un changement de pression acoustique dans un conduit auditif de l'utilisateur, le conduit auditif étant fermé par un casque d'écoute à réduction de bruit acoustique (ANR) ayant un module ANR. Un courant fourni au module ANR est détecté et utilisé pour déterminer si une tape ou une double tape s'est produite. Un mode de fonctionnement du système audio ou un attribut d'un signal d'entrée audio peut être modifié en réponse à la détermination d'une occurrence d'une tape ou d'une double tape.
EP18733712.6A 2017-08-03 2018-05-16 Procédé de commande d'un système audio de réduction de bruit acoustique par des tapes d'utilisateur Active EP3662465B1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US15/668,386 US9930440B2 (en) 2015-12-18 2017-08-03 Acoustic noise reduction audio system having tap control
US15/889,745 US10110987B2 (en) 2015-12-18 2018-02-06 Method of controlling an acoustic noise reduction audio system by user taps
US15/889,752 US10091573B2 (en) 2015-12-18 2018-02-06 Method of controlling an acoustic noise reduction audio system by user taps
PCT/US2018/032858 WO2019027532A1 (fr) 2017-08-03 2018-05-16 Procédé de commande d'un système audio de réduction de bruit acoustique par des tapes d'utilisateur

Publications (2)

Publication Number Publication Date
EP3662465A1 true EP3662465A1 (fr) 2020-06-10
EP3662465B1 EP3662465B1 (fr) 2021-07-07

Family

ID=65234209

Family Applications (1)

Application Number Title Priority Date Filing Date
EP18733712.6A Active EP3662465B1 (fr) 2017-08-03 2018-05-16 Procédé de commande d'un système audio de réduction de bruit acoustique par des tapes d'utilisateur

Country Status (3)

Country Link
EP (1) EP3662465B1 (fr)
CN (1) CN110998713B (fr)
WO (1) WO2019027532A1 (fr)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111010644B (zh) * 2019-12-30 2024-09-03 歌尔科技有限公司 耳机的控制方法、耳机的电路控制系统及耳机
TWI719791B (zh) * 2019-12-31 2021-02-21 緯創資通股份有限公司 觸控靈敏度的調整方法及使用此方法的行動裝置

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4997962B2 (ja) * 2006-12-27 2012-08-15 ソニー株式会社 音声出力装置、音声出力方法、音声出力処理用プログラムおよび音声出力システム
JP5716287B2 (ja) * 2010-04-07 2015-05-13 ソニー株式会社 音声信号処理装置、音声信号処理方法、プログラム
US8908877B2 (en) * 2010-12-03 2014-12-09 Cirrus Logic, Inc. Ear-coupling detection and adjustment of adaptive response in noise-canceling in personal audio devices
JP5352634B2 (ja) * 2011-07-11 2013-11-27 株式会社エヌ・ティ・ティ・ドコモ 入力装置
US9042571B2 (en) * 2011-07-19 2015-05-26 Dolby Laboratories Licensing Corporation Method and system for touch gesture detection in response to microphone output
US20140126733A1 (en) * 2012-11-02 2014-05-08 Daniel M. Gauger, Jr. User Interface for ANR Headphones with Active Hear-Through
US9743170B2 (en) * 2015-12-18 2017-08-22 Bose Corporation Acoustic noise reduction audio system having tap control

Also Published As

Publication number Publication date
CN110998713B (zh) 2023-12-26
WO2019027532A1 (fr) 2019-02-07
CN110998713A (zh) 2020-04-10
EP3662465B1 (fr) 2021-07-07

Similar Documents

Publication Publication Date Title
CN108780639B (zh) 具有轻敲控制的声学噪声降低音频系统
US9930440B2 (en) Acoustic noise reduction audio system having tap control
EP3535984B1 (fr) Détection d'une position sur/à distance de la tête d'un dispositif acoustique personnel utilisant un microphone d'oreillette
EP3586523B1 (fr) Détection de l'absence d'un écouteur intra-auriculairepar rapport à la tête
JP6096993B1 (ja) イヤホンのサウンドエフェクト補償方法、装置及びイヤホン
US9486823B2 (en) Off-ear detector for personal listening device with active noise control
CN105979415B (zh) 一种自适应调节降噪增益的降噪方法、装置及降噪耳机
EP3127348B1 (fr) Détection de casque d'écoute sur la tête à l'aide d'une mesure de signal différentiel
EP3001695B1 (fr) Ecouteurs actifs avec contrôle de l'utilisation d'énergie
EP3654895B1 (fr) Dispositif audio à gain automatique adaptatif
EP3662465B1 (fr) Procédé de commande d'un système audio de réduction de bruit acoustique par des tapes d'utilisateur
US10091573B2 (en) Method of controlling an acoustic noise reduction audio system by user taps
CN109040889B (zh) 一种反馈降噪耳机及其反馈电路
US10110987B2 (en) Method of controlling an acoustic noise reduction audio system by user taps
WO2019027533A1 (fr) Système audio de réduction du bruit acoustique avec commande tactile
US11626095B2 (en) Acoustic noise reduction audio system having tap control

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20200203

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20210222

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1409355

Country of ref document: AT

Kind code of ref document: T

Effective date: 20210715

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602018019766

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20210707

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1409355

Country of ref document: AT

Kind code of ref document: T

Effective date: 20210707

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210707

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210707

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210707

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210707

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210707

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210707

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211108

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211007

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210707

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210707

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211007

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210707

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210707

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211008

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602018019766

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210707

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210707

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210707

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210707

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210707

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210707

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210707

26N No opposition filed

Effective date: 20220408

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210707

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20220531

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220531

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210707

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220516

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220531

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220516

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220531

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230414

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210707

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210707

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20180516

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210707

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20240419

Year of fee payment: 7

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240418

Year of fee payment: 7

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20240418

Year of fee payment: 7

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210707