EP3005732B1 - Dispositif et procédé de restitution audio à sélectivité spatiale - Google Patents

Dispositif et procédé de restitution audio à sélectivité spatiale Download PDF

Info

Publication number
EP3005732B1
EP3005732B1 EP14727481.5A EP14727481A EP3005732B1 EP 3005732 B1 EP3005732 B1 EP 3005732B1 EP 14727481 A EP14727481 A EP 14727481A EP 3005732 B1 EP3005732 B1 EP 3005732B1
Authority
EP
European Patent Office
Prior art keywords
audio signal
audio
beamforming
loudspeakers
signals
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP14727481.5A
Other languages
German (de)
English (en)
Other versions
EP3005732A1 (fr
Inventor
Andreas Franck
Christoph SLADECZEK
Thomas Sporer
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fraunhofer Gesellschaft zur Forderung der Angewandten Forschung eV
Original Assignee
Fraunhofer Gesellschaft zur Forderung der Angewandten Forschung eV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fraunhofer Gesellschaft zur Forderung der Angewandten Forschung eV filed Critical Fraunhofer Gesellschaft zur Forderung der Angewandten Forschung eV
Publication of EP3005732A1 publication Critical patent/EP3005732A1/fr
Application granted granted Critical
Publication of EP3005732B1 publication Critical patent/EP3005732B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/20—Arrangements for obtaining desired frequency or directional characteristics
    • H04R1/32—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
    • H04R1/323—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only for loudspeakers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R27/00—Public address systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R5/00—Stereophonic arrangements
    • H04R5/02—Spatial or constructional arrangements of loudspeakers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2203/00—Details of circuits for transducers, loudspeakers or microphones covered by H04R3/00 but not provided for in any of its subgroups
    • H04R2203/12—Beamforming aspects for stereophonic sound reproduction with loudspeaker arrays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2227/00—Details of public address [PA] systems covered by H04R27/00 but not provided for in any of its subgroups
    • H04R2227/001—Adaptation of signal processing in PA systems in dependence of presence of noise
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2430/00—Signal processing covered by H04R, not provided for in its groups
    • H04R2430/01—Aspects of volume control, not necessarily automatic, in sound systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2430/00—Signal processing covered by H04R, not provided for in its groups
    • H04R2430/20—Processing of the output signals of the acoustic transducers of an array for obtaining a desired directivity characteristic

Definitions

  • the present invention relates to a space-selective audio reproduction, e.g. of different audio signals to different listeners or listener groups located in different locations of a room.
  • the reproduction of audio signals over several speakers, typically organized as an array, is a common practice.
  • an individual modification such as, the application of a delay and a change in amplitude, generally also described with filtering
  • the shape of the sound field radiated by a loudspeaker can be purposefully influenced, such as e.g. for the purpose of deliberately sounding certain areas.
  • beamforming This technique also allows multiple audio signals to be played back simultaneously with different directional characteristics by producing individual filtered speaker signals for all signals, which are summed up loudly before playback.
  • US 2012/0020480 A1 describes an improvement in the directional characteristic of a loudspeaker array at low frequencies goes. It is proposed to copy or amplify fundamental harmonics from low frequencies into the high frequencies, making use of the psychoacoustic phenomenon that hearing higher harmonics of a signal results in an auditory illusion of hearing the missing fundamental. Accordingly, harmonics are amplified to fundamental frequencies and the fundamental frequencies are again reduced, whereby the better directional characteristic of loudspeaker arrays in higher frequency ranges is utilized. In addition, it is suggested that the masking noise could be used to obscure signal portions of the directionally transmitted audio signal at locations where this audio signal is not supposed to be audible according to the directional broadcast.
  • EP1699259 describes an audio output device having a measuring means for measuring the levels of a plurality of input audio signals; a sound level adjusting means for adjusting the levels of the input sound signals configured to adjust the gains based on the levels measured by the measuring means and outputting a plurality of adjusted sound signals of equal magnitudes; and an array speaker unit adapted to receive a plurality of tones in accordance with the plurality of matched ones Emitting sound signals respectively outputted to different directivity characteristics by the sound level adjusting means, a first sound being directed toward a first focal point and a second sound being directed toward a second focal point different from the first focus point; wherein the measuring means is configured to divide the plurality of input audio signals into a plurality of frequency bands to measure the levels, and the audio level adjusting means is adapted to adjust and output gains so as to cause the plurality of adjusted audio signals to be equal Having magnitudes for each of the frequency bands based on the measured levels of the respective frequency bands.
  • the object of the present invention is to provide such a concept.
  • the core idea of the present invention is to have realized that a better separation of a first audio signal in a first area of a PA area of a plurality of loudspeakers can be achieved by the version of the first area resulting from the space-selective reproduction of the audio signals Calculating a masking threshold depending on the version of the audio signal to be separated from the one or more other audio signals in that area and depending on a comparison of the masking threshold with the version of the one or more other, ie interfering , Audio signals, the output of the audio signals for space-selective playback is influenced to the outputs of the plurality of speakers.
  • the calculation or estimation of the audio signals in this first area can also be illustrated as a simulation of the sound propagation in this first area and thus the element for its execution as a calculator or simulator.
  • the separation of the audio signals to the first area of the PA area already enabled by the room-selective reproduction can thus be improved by evaluating the masking threshold by calculating or simulating the versions of the audio signals resulting from the room-selective reproduction.
  • the influencing of the space-selective reproduction to avoid or reduce the "violation" of the masking threshold at the first area of the public address area can be carried out in different ways, such as by frequency-selective reduction of each interfering other audio signal in frequency ranges where the respective simulated other audio signal exceeds the masking threshold.
  • Fig. 1 shows a device for space-selective audio playback according to an embodiment. It is indicated generally by the reference numeral 10.
  • the apparatus 10 comprises an input 12 for at least a first audio signal 14 1 and a second audio signal 14 2 and an output 16 for a plurality of loudspeakers 18.
  • a beamforming processor 20 of the apparatus 10 is connected between the input 12 on the one hand and the output 16 on the other hand designed to output the first and second audio signals 14 1 and 14 2 to the speakers 18 for room-selective reproduction via the output 16.
  • the loudspeakers 18 are capable of sonicating a PA area 22, such as an area surrounded or directed by the loudspeakers at their intended speaker locations, or generally an area which is sonicated by at least one of the loudspeakers 18 ,
  • the sonication area may be a fictitious space relative to the configurations of fictitious speaker positions of the speakers 18, such as a virtual one PA area without reflective surfaces, or around a real PA area, which reflection effects, such as on walls or the like, may have.
  • "Space selective" playback of the audio signals 14 1 and 14 2 on the speakers 18 shall mean that the audio signals are not simply output in the form of superimposed copies to the loudspeakers 18, but that they are as described in the introduction to the present application , are output via the loudspeakers 18 filtered by means of, for example, speaker-specific delays and / or amplitude modifications or in general filtered by a loudspeaker-individual filtering and indeed different for the audio signals 14 1 and 14 2 , so that there is at least a first area 24 of the public address area, which differs from the second audio signal 14 2 compared to the first audio signal 14 1 is less or not at all sonicated.
  • the audio signals 14 1 and 14 2 may be present at the input 12 in any form, such as analog or digital, in separate or in m / coded form or in a parameterized downmix form, uncompressed or compressed
  • any form such as analog or digital
  • Loudspeaker-individual loudspeaker signals for the loudspeakers 18 can be output via the output 16 separately, in analog or digital, compressed or uncompressed, already amplified , only pre-reinforced or unreinforced
  • the loudspeaker signals it would be possible for the loudspeaker signals to be output in compressed form in a downmix, along with spatial cues parameters, such as in MPEG surround or SAOC encoded form.
  • the beamforming processor 20 initially processes the incoming audio signals 14 1 and 14 2 completely separate from each other to produce a set of loudspeaker signals for the loudspeakers 18 to each of them so that each loudspeaker signal for the respective audio signal has a particular one for the respective loudspeaker position of the respective one Speaker individual filtering, such as delay and / or amplitude modification experienced. Only at the end, for example, the thus obtained from the individual speaker signals loudspeaker signal sets per channel or speakers are superimposed with each other. This is also illustrated once more in the following figures.
  • the term “space selectivity” should of course also be understood broad enough to allow only "angle selectivity” in the sense that the audio signal individual processing within the beamforming processor 20 results in the audio signals 14 1 and 14 2 being emitted into different solid angle ranges as viewed from the loudspeakers 18. Such angular selectivity may be to influence the far field radiation of the loudspeaker setup be interpreted. In a small distance to the speaker setup (in relation to the size of the speaker setup, ie in the geometric near field) is also a targeted modification of the radiation in a two-dimensional area conceivable.
  • beamforming processor 20 may be fixed or optimized for space selective playback.
  • the spatial selectivity of the reproduction of the beamforming processor 20 may be constant. It may be optimized in advance to the area 24 or the areas 24 and 26, ie to the effect that in the area 24 only the first audio signal 14 1 and, if provided, in the area 26 only the second audio signal 14 2 from a listener in the respective Area is audible.
  • the optimization then defines the aforementioned delays, amplitude modifications and / or filters, such as FIR filters, for the individual channels or speakers 18, and the beamforming processor 20 may be hard-wired, for example, or fixed in software or programmable Hardware implemented to accomplish the space-selective playback via the output 16 to the speakers 18.
  • the beamforming processor is also adjustable in terms of speaker-individual processing (delay, amplitude modulation or filtering) for one or more of the audio signals 14 1 , 14 2 .
  • the beamforming processor 20 can be adjusted or influenced at the output 16 with regard to its space-selective reproduction of the audio signals 14 1 , 14 2 , as will be described in more detail below.
  • this setting can also be achieved by audio-signal-specific, frequency-selective modification / influencing of individual or all audio signals which acts on all loudspeakers / channels, as will also be described below. It is the aforementioned controllability of the beamforming processor 20 that uses the components of the apparatus 10 described below to enhance the separation of the first audio signal 14 1 in the area 24 from the other audio signal 14 2 .
  • the device 10 comprises, in addition to the components described so far, a calculator 28, a masking threshold calculator 30 and an adjuster 32.
  • the calculator 28 is also connected to the input 12 and is designed to use a propagation model for the audio signals 14 1 and 14 2, respectively to calculate the version of the respective audio signal 14 1 or 14 2 resulting from the room-selective reproduction in the first area 24, ie the version 34 1 of the audio signal 14 1 reproduced at the location 24 and also the version 34 2 of the audio signal 14 reproduced at the location 24 2 .
  • the masking threshold calculator 30 receives the socket 34 1 and is designed to calculate a masking threshold 36 as a function of this, and the adjuster 32 receives the socket 34 2 of the other audio signal and optionally also the socket 34 1 of the first audio signal 14 1 and is designed to in order to influence the output of the first and second audio signals for space selective reproduction via the output 16 to the loudspeakers 18, depending on a comparison of the masking threshold 36 with the version of the second audio signal 34 2 , by the adjuster 32 controlling the beamforming processor 20 as appropriate an arrow 38 is indicated.
  • an output of the adder 32 is connected to a control input of the beamforming processor 20.
  • Calculators 28, masking threshold calculators 30, and fitters 32 may each be implemented in software, programmable hardware, or in hardware.
  • the calculator 28 may use propagation models that are also for optimization the internal, channel / speaker-individual processing of the audio signals 14 1 , 14 2 within the beamforming processor 20 could have been used.
  • the calculator 28 calculates or estimates, for example, as will be described in more detail below, the sound events generated at the location 24 by the first audio signal 14 1 and the second audio signal 14 2 . For example, it can take account of the channel / loudspeaker-individual processing of the audio signals 14 1 , 14 2 within the beamforming processor 20 and the positions of the loudspeakers 18 and optionally further parameters, such as emission characteristics and / or orientation of the loudspeakers 18.
  • the calculator 28 calculates the sound events, for example, measured or represented in sound pressure, amplitude or the like, and possibly frequency-dependent, ie for different frequencies.
  • the calculator 28 may perform the simulation in a constant / fixed manner.
  • the consideration of the adaptation to the channel / speaker-individual processing of the processor 20 is then based on the appropriate design of the propagation model, which the calculator 28 uses to calculate the sockets 34 1 , 34 2 .
  • the propagation model can thus also take into account the parameters just mentioned.
  • the sockets 34 1 and 34 2 may in turn be output by the calculator 28 in any form, ie analog or digital, compressed or uncompressed, in the time domain or in the frequency domain or the like.
  • the Mask michmaschinesschwellenberechner 30 calculates a masking threshold depending on the version 34 1, ie the audible version of the audio signal 14 1 24 at the location As is indicated by a dotted arrow 40 which Mask michsschwellenberechner a background audio signal, in addition to the socket 34 1 (for example Noise or driving noise) for masking threshold calculation.
  • the calculation takes into account temporal and / or spectral auditory masking effects.
  • the calculated masking threshold thus indicates, depending on the frequency, how much the socket 34 1 of the audio signal 14 1 at the location 24 is able to make other audio signals inaudible to a listener at the location 24 by covering the latter.
  • the masking threshold calculator 30 may be configured to calculate the masking threshold at a frequency resolution that becomes increasingly coarse as the frequency increases, ie, as the frequency bands increase in frequency as the frequency increases, such as in a Bark frequency resolution.
  • the adjuster 32 compares the masking threshold 36 with the socket 34 2 of the second audio signal 14 2 and thus determines, for example, whether the second audio signal 14 2 is audible to a person at the location 24, ie if the second audio signal at any frequency is the masking threshold exceeds. If so, the adjuster 32 takes countermeasures and appropriately controls the beamforming processor 20. Several examples of such controls have been previously indicated. Referring to the following figures, this is illustrated once again.
  • Fig. 2 For example, in a graph plotted against the frequency f, the masking threshold 36, the bezel 34 1, and the bezel 34 2 are shown in a virtual, thickness-measuring scale.
  • a frequency range 42 in which currently the interfering audio signal 14 2 or the version 34 2 resulting at the location 24 according to the simulation exceeds the masking threshold 36, is illustrated by way of example.
  • a possible countermeasure would be that the adjuster 32 controls the beamforming processor 20 in such a way that the second audio signal 34 2 is reduced in this frequency range 42, as indicated by an arrow 44.
  • the adjuster 32 could control the beamforming processor 20 in such a way that the first audio signal 14 1 is amplified in this frequency range 42-or, if appropriate, even beyond this frequency range 42, as indicated by an arrow 46.
  • Reduction 44 and / or gain 46 are preferably made such that the amount of gain / reduction does not have abrupt jumps in time and / or frequency.
  • the extent or the form of reduction and / or amplification is smoothed, for example temporally and / or spectrally.
  • Fig. 2 explained possible measures of the adapter 32 against audibility of the version 34 2 at the location 24 in the space-selectivity sense global measures or channel / speaker-global or for all channels / speakers 18 equally acting measures. It will be shown later that the beamforming processor 20 executes, for example, the gain 46 and / or reduction 44 in advance on the respective incoming audio signal 14 1 or 14 2 and only then the channel / speaker individual processing of the equally pre-processed audio signals for the space-selective playback. Additionally or alternatively, as already indicated above, the adjuster 32 may be formed to vary the beam shaping itself depending on the aforementioned comparison with the masking threshold 36. To illustrate this, refer to Fig. 3 taken.
  • FIG. 12 shows that the beamforming processor 20 has multiple channel / speaker options or modes of individual beamforming processing of the audio signals 14 1 and 14 2 , which are indicated here by way of example at 48 1 -48 N in different modes.
  • One of these, for example the beamforming processing according to FIG. 48 1 could be, for example, an optimal spatial-selective reproduction processing, ie possibly leading in place and frequency to the best suppression of the audio signal 14 2 or 34 2 at the location 24.
  • the other modes 24 2 - 48 N may possibly lead to similarly good separations or even to equally good or even optimal according to other or differently weighted criteria.
  • all modes 48 1 - 48 N could have differences in the quality of suppression for different frequency ranges, and in this case, the adder 32 could be dependent on the comparison with the masking threshold 36 and a location of an interval 42 in which the masking threshold 36 is violated is present, change a currently selected channel / speaker-individual processing mode or change from the same to another, in Fig.
  • an arrow 50 should indicate the selection of a currently selected mode 48 1 -48 N and a double arrow 52 should change that mode currently used by the beamforming processor 20 to another depending on the aforementioned comparison with the masking threshold 36 another might be associated in the beamforming processor 20 with a speaker / channel individual fading between a loudspeaker signal received with the last and a new mode with the new mode.
  • masking threshold 30 and adjuster 32 is the device 10 of Fig. 1 thus able to improve the suppression of another audio signal 14 2 at a location 24 of the PA area of the loudspeaker setup 18 with respect to a constant, optimized beam shaping separation.
  • Various measures are possible to avoid any degradation of the audio quality of the first and / or the second audio signal at location 24 and / or location 26 by the masking threshold controlled modification.
  • the extent of gain 46 and / or reduction 44 can be limited both in terms of its absolute value, ie the strength of the gain 46 and / or magnitude of the reduction 44, but also the change of this severity in time and / or frequency. In the case of using the possibility according to Fig.
  • fading could be used to switch from one mode to the other mode.
  • a delay may be provided to make a processing delay adjustment to the processing delay caused by the series of processing in calculator 28, masking threshold calculator 30 and adjuster 32 is caused.
  • Such additional delay in the beamforming processor 20 path from processing in the path along the calculator 28, masking threshold calculator 30, and aligner 32 could also be used to facilitate the aforementioned fading transitions between different beamforming modes 48 1 -48 N.
  • Audio signals 14 1 and 14 2 can be provided. This is indicated by a dashed arrow 54 in FIG Fig. 1 indicated. The foregoing description is readily applicable to this case. Additional audio signals 54 would, for example, be treated as the audio signal 14 2 , ie as audio signals whose reproduction at location 24 should be inaudible to a listener at this location 24.
  • the above embodiment makes it possible to improve the perceived quality of a spatial-related replay by incorporating psychoacoustic effects. It exploits that an audio signal audibility of components of another, quieter signal. This effect is called masking . For example, this plays a central role in lossy audio coding.
  • masking In psychoacoustics, a distinction is made between masking in the time domain and in the frequency domain. In masking in the time domain, a loud signal, the so-called masker, masks other components that appear shortly after or within narrow limits even before this sound event. In the frequency domain masking, a component of a particular frequency masks other components of similar frequency and amplitude.
  • the threshold to which masking occurs depends on the frequency and absolute level of the marker and the distance between the frequencies of the masker and other signal.
  • the masking thresholds and thus the decision as to whether a signal component is masked are determined by psychoacoustic models. Such psychoacoustic models are used by masking threshold calculator 30.
  • FIG. 4 shows how two audio signals S 1 (t) and S 2 (t) via two beamforming filter sets 60 1 and 60 2 , a summation stage 62 and a speaker array of speakers 18 are processed so that these signals in the areas Z 1 and Z 2 , ie the audio signal S 1 (t) mainly in the area Z 1 and the audio signal S 2 (t) mainly in the area Z 2 .
  • the components 60 1 , 60 2, and 62 form a simple beamforming processor 64 that, for example, operates constantly and is optimized to perform the aforementioned separation.
  • the beamformer 60 1 beamforms the incoming audio signal S 1 (t) to produce a set of loudspeaker signals for that signal, and the same does beamformer 60 2 for the second audio signal S 2 (t). Both beamformers 60, 1.2 output their loudspeaker signal sets to the summer 62, which individually adds the same loudspeaker signals to the loudspeakers 18.
  • Fig. 5 now shows how the setup of Fig. 4 according to the embodiment of Fig. 1 can be improved.
  • the device of Fig. 5 is indicated at 10 and otherwise the reference numerals of Fig. 1 taken over to each other in their function corresponding parts to Fig. 1 display.
  • the beamforming processor 20 is of Fig. 5 opposite the starting point of Fig. 4 by way of example only by inserting a Pegelanpassers 66 in the signal path of the interfering audio signal S 2 modified here exemplarily on the input side of the beam former 60 2 , although for all channels / speakers 18 equally acting level adjustment by the level adjuster 66 would also be possible.
  • the level adjuster 66 is controlled by the adjuster 32, with reference to Figs Fig.
  • Fig. 5 also shows that it is possible to use the in Fig. 1 perform for one of the audio signals performed signal separation of other audio signals for more than one audio signal.
  • the calculator 28 simulates the respective audible version at both locations, namely locations Z1 and Z2, for both audio signals 60 S 1 and S 2 . That is why in Fig. 5 a propagation model user 1 68 shown, which applies the appropriate propagation models to the audio signal S 1 and a propagation model 68 users 2 who undertakes selbiges for the audio signal S2.
  • the masking threshold calculator 30 performs a masking threshold calculation and gives the result, ie the respective masking threshold for the location Z 1 and Z 2 , ie the masking by the signal S 1 at location Z 1 or the masking by the audio signal S 2 at location Z 2 , to the control data adaptation or the adjuster 32 further, which in each case reserves the respective disturbing listening versions, ie the audible version of the signal S 2 at location Z 1 and the audible version of the signal S 1 at location Z 2 .
  • the device is after Fig. 5 the masking thresholds of the audibility of the signal S 2 in zone Z 1 determined.
  • the signals resulting from the signals S 1 (t) and S 2 (t) in the zone Z 1 are determined, such as the magnitudes in the frequency domain.
  • a propagation model is calculated or used, which includes the transfer function of the loudspeaker array of loudspeakers 18.
  • the signals are referred to as S 1 (t, Z 1 ) and S 2 (t, Z 1 ).
  • the masking thresholds for the audibility of the signal S 2 (t, Z 1 ) are determined using the masker S 1 (t, Z 1 ).
  • Thresholds are determined in a component change values for the magnitudes of the audio signal S 1 (t) (for certain frequency ranges).
  • other psychoacoustically motivated parameters can be included, such as maximum permissible changes of the signal S 1 (t) in order to limit the effects of the adjustments by the adjuster 32 to the reproduction of S 1 (t) in Z 1 .
  • the temporal course of the magnitude change is limited in order to avoid sudden, potentially disturbing changes.
  • the parameters of this timing can also be determined by psychoacoustic parameters.
  • a level adjuster may also be inserted in the signal path of the audio signal S 1 which is controlled by the adjuster 32 based on a comparison of the masking threshold for the location Z 2 with the disturbing audio signal S 1 at the location Z 2 .
  • the matcher 32 Since the adjuster 32 knows about the result of all comparisons, ie the result of the comparison of the masking threshold in Z 2 with S 1 at location Z 2 and the result of the comparison of the masking threshold in Z 1 with S 2 at location Z 1 , the matcher is in capable of making it possible for all locations or areas Z 1/2 to reduce the influence of the respectively interfering signal, ie S 2 in Z 1 and S 1 in Z 2 , to the desired signal, ie S 2 in Z 2 and S 1 in Z 1 , to calculate. It may be that the adjuster 32 has to compromise on this, since the disturbances in the individual areas require measures that mean a deterioration in the other area or in the other areas. This trade-off could be influenced by having the matcher 32 prioritize the ranges and associated desired signals so that the negative impact of higher priority signals at their respective destination is realized by other higher priority signals than lower priority signals.
  • the number of audio signals may also be higher.
  • the signal flow of the concept or algorithm is in Fig. 5
  • the acoustic Event such as the sound pressure, the magnitude, etc.
  • This propagation model is usually a function of frequency and produces a discrete set of values, each associated with a frequency.
  • the transfer function of the beamformer 60 1 to a point such as the center of the zone Z 1
  • other models such as a weighted average of the magnitude transfer function to a bitmap in Z 1 may be used.
  • the kernel characteristic of the propagation model is that it translates an input signal S i (t) to a measure describing the magnitude of the sound incidence resulting from this signal in zone Z 1 , for each of the considered frequency bands.
  • the division of the audio frequency range into frequency bands can be done differently, but useful are psychoacoustic characteristics oriented divisions, such as Constant-Q or Bark scale.
  • the output values of the psychoacoustic model may be output at a lower frequency than the audio sample rate. This can be done, for example, by sub-sampling or by moving averaging with, for example, decimation.
  • the output values of the masking threshold calculator are in the embodiment of FIG Fig. 5 still raw control data describing a desired level change in the individual frequency bands.
  • the matched control signals of the adaptor are used in the level adjuster to frequency-level level the signal S 1 (t) before filtering with the loudspeaker-specific beamforming filters in the beamformer 60 2 .
  • the level adjuster 66 thus acts as a multi-band equalizer.
  • a function similar to a multiband compressor, or more generally multiband dynamics control, is achieved in conjunction with the timing of the adaptor, but unlike normal use, these units here use a different signal to control the gain values.
  • the signal S 2 (t) can be adaptively changed in order to reduce the interference of S 2 (t) into the zone Z 1 . This is also possible to reduce crosstalk simultaneously. This possibility exists regardless of the details of Fig. 5 of course, more generally for the example of Fig. 1 ,
  • a reference signal 40 may be additionally used for extraneous noise such as general background noise level, interior noise in automotive applications, or the like. This signal 40 can be used as an additional input to the masking threshold calculation, as described above.
  • the reference signal 40 is preferably a measured or sensible estimated value for the background noise signal in the "sound zones" 24 or 26 or Z 1 in Z 2 .
  • the above exemplary embodiments thus describe a concept for space-selective reproduction with loudspeaker arrays by psychoacoustic environmental effects or the spatial reproduction of audio signals via a plurality of loudspeakers, which can be arranged, for example, as an array.
  • loudspeakers which can be arranged, for example, as an array.
  • this has been accomplished by a combination of beamforming algorithms with a psychoacoustic model that modifies the audio signals so that the audibility of the interfering signals is reduced by the psychoacoustic masking by the useful signal.
  • aspects have been described in the context of a device, it will be understood that these aspects also constitute a description of the corresponding method, so that a block or a component of a device is also to be understood as a corresponding method step or as a feature of a method step. Similarly, aspects described in connection with or as a method step also represent a description of a corresponding block or detail or feature of a corresponding device.
  • Some or all of the method steps may be performed by a hardware device (or using a hardware device). Apparatus), such as a microprocessor, a programmable computer or an electronic circuit. For some Embodiments, some or more of the most important method steps may be performed by such an apparatus.
  • embodiments of the invention may be implemented in hardware or in software.
  • the implementation may be performed using a digital storage medium, such as a floppy disk, a DVD, a Blu-ray Disc, a CD, a ROM, a PROM, an EPROM, an EEPROM or FLASH memory, a hard disk, or other magnetic disk or optical memory are stored on the electronically readable control signals that can cooperate with a programmable computer system or cooperate such that the respective method is performed. Therefore, the digital storage medium can be computer readable.
  • some embodiments according to the invention include a data carrier having electronically readable control signals capable of interacting with a programmable computer system such that one of the methods described herein is performed.
  • embodiments of the present invention may be implemented as a computer program product having a program code, wherein the program code is operable to perform one of the methods when the computer program product runs on a computer.
  • the program code can also be stored, for example, on a machine-readable carrier.
  • inventions include the computer program for performing any of the methods described herein, wherein the computer program is stored on a machine-readable medium.
  • an embodiment of the method according to the invention is thus a computer program which has a program code for performing one of the methods described herein when the computer program runs on a computer.
  • a further embodiment of the method according to the invention is thus a data carrier (or a digital storage medium or a computer-readable medium) on which the computer program is recorded for performing any of the methods described herein.
  • a further embodiment of the method according to the invention is thus a data stream or a sequence of signals, which represent the computer program for performing one of the methods described herein.
  • the data stream or the sequence of signals may be configured, for example, to be transferred via a data communication connection, for example via the Internet.
  • Another embodiment includes a processing device, such as a computer or a programmable logic device, that is configured or adapted to perform one of the methods described herein.
  • a processing device such as a computer or a programmable logic device, that is configured or adapted to perform one of the methods described herein.
  • Another embodiment includes a computer on which the computer program is installed to perform one of the methods described herein.
  • Another embodiment according to the invention comprises a device or system adapted to transmit a computer program for performing at least one of the methods described herein to a receiver.
  • the transmission can be done for example electronically or optically.
  • the receiver may be, for example, a computer, a mobile device, a storage device or a similar device.
  • the device or system may include a file server for transmitting the computer program to the recipient.
  • a programmable logic device eg, a field programmable gate array, an FPGA
  • a field programmable gate array may cooperate with a microprocessor to perform one of the methods described herein.
  • the methods are performed by any hardware device. This may be a universal hardware such as a computer processor (CPU) or hardware specific to the process, such as an ASIC.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Otolaryngology (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Stereophonic System (AREA)
  • Obtaining Desirable Characteristics In Audible-Bandwidth Transducers (AREA)

Claims (14)

  1. Appareil de reproduction audio à sélectivité spatiale, avec
    une entrée (12) pour un premier et un deuxième signal audio (141, 142);
    une sortie (16) pour une pluralité de haut-parleurs (18);
    un processeur de formation de faisceau (20) qui est connecté entre l'entrée (12), d'une part, et la sortie (16), d'autre part, et est conçu pour sortir le premier et le deuxième signal audio (141, 142) pour reproduction à sélectivité spatiale via la sortie vers les haut-parleurs (18); et
    un calculateur (28) qui est conçu pour calculer, au moyen d'un modèle de propagation, pour le premier et le deuxième signal audio (141, 142), respectivement une version (341, 342) du signal audio respectif résultant d'une reproduction à sélectivité spatiale dans une première zone (24) d'une région de sonorisation (22) des haut-parleurs (18);
    dans lequel le processeur de formation de faisceau (20) est conçu de manière à obtenir la sortie du premier et du deuxième signal audio (141, 142) pour reproduction à sélectivité spatiale à la sortie en réalisant une formation de faisceau sur au moins le deuxième signal audio (142);
    caractérisé par le fait que dispositif comporte par ailleurs les caractéristiques suivantes:
    un calculateur de seuil de masquage (30) qui est conçu pour calculer, en fonction de la version (341) du premier signal audio (141) à l'aide d'un modèle psychoacoustique, un seuil de masquage (36); et
    un adaptateur (32) qui est conçu pour influencer, en fonction d'une comparaison entre le seuil de masquage (36) et la version (342) du deuxième signal audio (142), la sortie du premier et du deuxième signal audio (141, 142) pour reproduction à sélectivité spatiale via la sortie (16) vers les haut-parleurs (18),
    dans lequel le processeur de formation de faisceau (20) présente plusieurs modes de réalisation de la formation de faisceau qui diffèrent en ce qui concerne la qualité d'une suppression du deuxième signal audio (142) dans la première zone (24) pour des plages de fréquence différentes,
    dans lequel l'adaptateur (32) est conçu pour faire varier, en fonction de la comparaison, la formation de faisceau par un changement d'un mode utilisé actuellement à un autre mode.
  2. Dispositif selon la revendication 1, présentant par ailleurs la pluralité de haut-parleurs (18).
  3. Dispositif selon la revendication 1 ou 2, dans lequel le processeur de formation de faisceau (20) est conçu pour effectuer une formation de faisceau (602) sur le deuxième signal audio (142) pour obtenir une première pluralité de signaux de haut-parleur, et pour appliquer les signaux de haut-parleur obtenus à partir du deuxième signal audio via la sortie (16) aux haut-parleurs (18).
  4. Dispositif selon la revendication 3, dans lequel le processeur de formation de faisceau est conçu pour soumettre le premier signal audio (141) à une formation de faisceau (601) pour obtenir une deuxième pluralité de signaux de haut-parleur, et pour appliquer la deuxième pluralité de signaux de haut-parleur par superposition (62) avec la première pluralité de signaux de haut-parleur via la sortie (16) aux haut-parleurs (18).
  5. Dispositif selon la revendication 4, dans lequel le processeur de formation de faisceau (26) est conçu pour réaliser la formation de faisceau (601, 602) sur le premier et le deuxième signal audio de manière différente - pour la reproduction à sélectivité spatiale dans des zones différentes (24, 26) de la région de sonorisation (22) -, de sorte que, pour chaque zone, l'un des signaux audio représente un signal de consigne, tandis que l'autre signal audio respectif représente un signal parasite dans la zone respective.
  6. Dispositif selon la revendication 5, dans lequel
    le calculateur (28) est conçu pour calculer, au moyen du modèle de propagation pour chaque signal audio et pour chacune des différentes zones, respectivement une version du signal audio respectif résultant de la reproduction à sélectivité spatiale dans la zone respective de la région de sonorisation (22) des haut-parleurs (18),
    le calculateur de seuil de masquage (30) est conçu pour calculer, pour chaque zone de la région de sonorisation, en fonction de la version du signal audio respectif résultant de la reproduction à sélectivité spatiale dans la zone respective de la région de sonorisation (22) des haut-parleurs (18), qui représente pour la zone respective un signal de consigne, un seuil de masquage (36); et
    l'adaptateur (32) est conçu pour influencer, sur base d'une comparaison entre le seuil de masquage (36) pour chacune des zones avec la perturbation résultant de la version (342) du signal audio, qui représente, dans la zone respective, un signal d'interférence, la sortie des signaux audio pour la reproduction à sélectivité spatiale via la sortie (16) vers les haut-parleurs (18).
  7. Dispositif selon la revendication 6, dans lequel le nombre de signaux audio est supérieur à deux.
  8. Dispositif selon l'une des revendications précédentes, dans lequel le calculateur de seuil de masquage (30) est conçu pour tenir compte, lors du calcul du seuil de masquage en fonction de la version (341) du premier signal audio (141), d'un signal audio de fond.
  9. Dispositif selon l'une des revendications précédentes, dans lequel l'adaptateur (32) est conçu pour activer le processeur de formation de faisceau (20) de sorte que, dans des plages de fréquences dans lesquelles la version (342) du deuxième signal audio (142) excède le seuil de masquage, le deuxième signal audio (142) soit globalement réduit lors de la reproduction à sélectivité spatiale.
  10. Dispositif selon l'une des revendications précédentes, dans lequel l'adaptateur (32) est conçu pour activer le processeur de formation de faisceau (20) de sorte que, dans les plages de fréquences dans lesquelles la version (342) du deuxième signal audio (142) excède le seuil de masquage, le premier signal audio (141) soit globalement amplifié lors de la reproduction à sélectivité spatiale.
  11. Dispositif selon l'une des revendications précédentes, dans lequel l'adaptateur (32) est conçu pour limiter la variation de la sortie du premier et du deuxième signal audio (141, 142) en ce qui concerne l'expression absolue et/ou en ce qui concerne un taux de variation de l'expression de la variation.
  12. Dispositif selon l'une des revendications précédentes, dans lequel le calculateur est conçu pour tenir compte, lors du calcul, des effets de masquage auditif temporels et spectraux.
  13. Procédé de reproduction audio à sélectivité spatiale au moyen d'un processeur de formation de faisceau (20), connecté entre une entrée (12) pour un premier et un deuxième signal audio (141, 142) et une sortie (16) pour une pluralité de haut-parleurs (18), qui est conçu pour sortir le premier et le deuxième signal audio (141, 142) pour la reproduction à sélectivité spatiale via la sortie (16) vers les haut-parleurs (18), avec le fait de
    calculer, au moyen d'un modèle de propagation pour le premier et le deuxième signal audio (141, 142), respectivement une version (341, 342) du signal audio respectif résultant de la reproduction à sélectivité spatiale dans une première zone (24) d'une région de sonorisation (22) des haut-parleurs (18);
    dans lequel le processeur de formation de faisceau (20) est conçu pour obtenir la sortie du premier et du deuxième signal audio (141, 142) pour la reproduction à sélectivité spatiale à la sortie en réalisant une formation de faisceau sur au moins le deuxième signal audio (142);
    caractérisé par le fait de
    en fonction de la version (341) du premier signal audio (14), calculer un seuil de masquage (36) à l'aide d'un modèle psychoacoustique; et
    en fonction d'une comparaison entre le seuil de masquage (36) et la version (342) du deuxième signal audio (142), influencer la sortie du premier et du deuxième signal audio (141, 142) pour la reproduction à sélectivité spatiale via la sortie (16) vers les haut-parleurs (18),
    dans lequel le processeur de formation de faisceau (20) présente plusieurs modes de réalisation de la formation de faisceau qui diffèrent en ce qui concerne la qualité d'une suppression du deuxième signal audio (142) dans la première zone (24) pour différentes plages de fréquences,
    dans lequel le fait d'influencer comprend le fait de faire varier, en fonction de la comparaison, la formation de faisceau par un changement d'un mode utilisé actuellement à un autre mode.
  14. Programme d'ordinateur avec un code de programme pour réaliser le procédé selon la revendication 13 lorsque le programme est exécuté sur un ordinateur.
EP14727481.5A 2013-05-31 2014-05-28 Dispositif et procédé de restitution audio à sélectivité spatiale Active EP3005732B1 (fr)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
DE102013210184 2013-05-31
DE102013217367.9A DE102013217367A1 (de) 2013-05-31 2013-08-30 Vorrichtung und verfahren zur raumselektiven audiowiedergabe
PCT/EP2014/061188 WO2014191526A1 (fr) 2013-05-31 2014-05-28 Dispositif et procédé de restitution audio à sélectivité spatiale

Publications (2)

Publication Number Publication Date
EP3005732A1 EP3005732A1 (fr) 2016-04-13
EP3005732B1 true EP3005732B1 (fr) 2017-06-21

Family

ID=51899430

Family Applications (1)

Application Number Title Priority Date Filing Date
EP14727481.5A Active EP3005732B1 (fr) 2013-05-31 2014-05-28 Dispositif et procédé de restitution audio à sélectivité spatiale

Country Status (7)

Country Link
US (1) US9813804B2 (fr)
EP (1) EP3005732B1 (fr)
JP (1) JP6301453B2 (fr)
KR (1) KR101877323B1 (fr)
CN (1) CN105247892B (fr)
DE (1) DE102013217367A1 (fr)
WO (1) WO2014191526A1 (fr)

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109196581B (zh) * 2016-05-30 2023-08-22 索尼公司 局部静音声场形成设备和方法以及程序
EP3264734B1 (fr) * 2016-06-30 2022-03-02 Nokia Technologies Oy Commande des paramètres de signal audio
US10531196B2 (en) * 2017-06-02 2020-01-07 Apple Inc. Spatially ducking audio produced through a beamforming loudspeaker array
US10019981B1 (en) 2017-06-02 2018-07-10 Apple Inc. Active reverberation augmentation
US11516614B2 (en) 2018-04-13 2022-11-29 Huawei Technologies Co., Ltd. Generating sound zones using variable span filters
US11089403B1 (en) 2018-08-31 2021-08-10 Dream Incorporated Directivity control system
KR102572474B1 (ko) * 2019-01-06 2023-08-29 사일런티움 리미티드 사운드 제어 장치, 시스템 및 방법
WO2020171049A1 (fr) * 2019-02-19 2020-08-27 公立大学法人秋田県立大学 Procédé de codage de signal acoustique, procédé de décodage de signal acoustique, programme, dispositif de codage, système acoustique et dispositif de complexation
US11968268B2 (en) 2019-07-30 2024-04-23 Dolby Laboratories Licensing Corporation Coordination of audio devices
EP4005247A1 (fr) * 2019-07-30 2022-06-01 Dolby Laboratories Licensing Corporation Coordination de dispositifs audio
WO2021021707A1 (fr) * 2019-07-30 2021-02-04 Dolby Laboratories Licensing Corporation Gestion de lecture de plusieurs flux audio sur plusieurs haut-parleurs
CN114391262B (zh) 2019-07-30 2023-10-03 杜比实验室特许公司 跨具有不同回放能力的设备的动态处理
US11871184B2 (en) 2020-01-07 2024-01-09 Ramtrip Ventures, Llc Hearing improvement system
WO2021245876A1 (fr) * 2020-06-04 2021-12-09 日本電信電話株式会社 Procédé, dispositif et programme d'étalonnage de haut-parleur
KR102347626B1 (ko) 2020-07-01 2022-01-06 한국과학기술원 거리에 따른 개인화된 음장을 생성하는 방법 및 장치
EP4367906A1 (fr) * 2021-07-09 2024-05-15 Soundfocus Aps Procédé et système de haut-parleur pour traiter un signal audio d'entrée
CN114882721B (zh) * 2022-05-27 2023-05-09 中国第一汽车股份有限公司 一种车载导航信息播放方法、装置、电子设备及存储介质

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3473517B2 (ja) * 1999-09-24 2003-12-08 ヤマハ株式会社 指向性拡声装置
ATE376892T1 (de) * 1999-09-29 2007-11-15 1 Ltd Verfahren und vorrichtung zur ausrichtung von schall mit einer gruppe von emissionswandlern
JP4349123B2 (ja) * 2003-12-25 2009-10-21 ヤマハ株式会社 音声出力装置
GB0405346D0 (en) * 2004-03-08 2004-04-21 1 Ltd Method of creating a sound field
TWI475896B (zh) * 2008-09-25 2015-03-01 Dolby Lab Licensing Corp 單音相容性及揚聲器相容性之立體聲濾波器
US8218783B2 (en) 2008-12-23 2012-07-10 Bose Corporation Masking based gain control
EP2484127B1 (fr) * 2009-09-30 2020-02-12 Nokia Technologies Oy Procédé, logiciel, et appareil pour traitement de signaux audio
US8965546B2 (en) 2010-07-26 2015-02-24 Qualcomm Incorporated Systems, methods, and apparatus for enhanced acoustic imaging
KR101782050B1 (ko) * 2010-09-17 2017-09-28 삼성전자주식회사 비등간격으로 배치된 마이크로폰을 이용한 음질 향상 장치 및 방법
JP5838740B2 (ja) * 2011-11-09 2016-01-06 ソニー株式会社 音響信号処理装置と音響信号処理方法およびプログラム
US20130259254A1 (en) * 2012-03-28 2013-10-03 Qualcomm Incorporated Systems, methods, and apparatus for producing a directional sound field
US20140006017A1 (en) * 2012-06-29 2014-01-02 Qualcomm Incorporated Systems, methods, apparatus, and computer-readable media for generating obfuscated speech signal
EP3040984B1 (fr) * 2015-01-02 2022-07-13 Harman Becker Automotive Systems GmbH Agencement de zone acoustique avec suppression vocale par zone

Also Published As

Publication number Publication date
JP6301453B2 (ja) 2018-03-28
EP3005732A1 (fr) 2016-04-13
JP2016524862A (ja) 2016-08-18
KR101877323B1 (ko) 2018-08-09
CN105247892A (zh) 2016-01-13
US20160088388A1 (en) 2016-03-24
WO2014191526A1 (fr) 2014-12-04
DE102013217367A1 (de) 2014-12-04
KR20160007584A (ko) 2016-01-20
CN105247892B (zh) 2019-02-22
US9813804B2 (en) 2017-11-07

Similar Documents

Publication Publication Date Title
EP3005732B1 (fr) Dispositif et procédé de restitution audio à sélectivité spatiale
EP1977626B1 (fr) Procédé pour enregistrer et reproduire les signaux sonores d'une source sonore présentant des caractéristiques directives variables dans le temps
EP1013141B1 (fr) Procede et dispositif pour restituer un signal acoustique stereophonique
EP1972181B1 (fr) Dispositif et procédé de simulation de systèmes wfs et de compensation de propriétés wfs influençant le son
WO2014187877A2 (fr) Pupitre de mixage, générateur de signal audio, procédé et programme informatique de fourniture d'un signal audio
EP1671516A1 (fr) Procede et dispositif de production d'un canal a frequences basses
EP2754151B1 (fr) Dispositif, procédé et système électroacoustique de prolongement d'un temps de réverbération
EP3677053B1 (fr) Système de haut-parleurs pour son ambiophonique avec suppression des bruits directs non souhaités
DE102011086728B4 (de) Hörvorrichtung mit einer Einrichtung zum Verringern eines Mikrofonrauschens und Verfahren zum Verringern eines Mikrofonrauschens
WO2022218822A1 (fr) Dispositif et procédé de génération d'un premier signal de commande et d'un second signal de commande par linéarisation et/ou par extension de bande passante
DE69309679T2 (de) Stereophonische tonwiedergabevorrichtung mit mehreren lautsprechern fur jeden kanal
WO1995030323A1 (fr) Procede et dispositif pour la compensation de falsifications acoustiques
DE102015008000A1 (de) Verfahren zur Schallwiedergabe in Reflexionsumgebungen, insbesondere in Hörräumen
DE102005060036B4 (de) Verfahren und Gerät zur Audiosignalverarbeitung
DE10215775A1 (de) Verfahren zur räumlichen Darstellung von Tonquellen
DE102016121989B4 (de) Klangsystem, verfahren zur optimierung eines raumklangs und verfahren zur speicherung und/oder wiedergabe von akustischen signalen
DE102011108788A1 (de) Verfahren zur Verarbeitung eines Audiosignals, Audiowiedergabesystem und Verarbeitungseinheit zur Bearbeitung von Audiosignalen
WO2022183231A1 (fr) Procédé de production de filtres de signal audio pour signaux audios afin de produire des sources sonores virtuelles
DE102018108852B3 (de) Verfahren zur Beeinflussung einer auditiven Richtungswahrnehmung eines Hörers
EP1900250B1 (fr) Procede electro-acoustique
WO2015022578A1 (fr) Réseau 2d de transducteurs électroacoustiques pour sonorisations d'événements
WO2024099733A1 (fr) Procédé de correction dépendant de la direction de la réponse en fréquence de fronts d'ondes sonores
DE102018216604A1 (de) System zur Übertragung von Schall in den und aus dem Kopf eines Hörers unter Verwendung eines virtuellen akustischen Systems
EP2503799A1 (fr) Procédé et système de calcul de fonctions HRTF par synthèse locale virtuelle de champ sonore
DE102019004676A1 (de) Steuerbarer Richtlautsprecher

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20151112

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RIN1 Information on inventor provided before grant (corrected)

Inventor name: SPORER, THOMAS

Inventor name: FRANCK, ANDREAS

Inventor name: SLADECZEK, CHRISTOPH

DAX Request for extension of the european patent (deleted)
GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RIC1 Information provided on ipc code assigned before grant

Ipc: H04R 1/32 20060101ALI20161222BHEP

Ipc: H04R 27/00 20060101AFI20161222BHEP

INTG Intention to grant announced

Effective date: 20170110

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 903902

Country of ref document: AT

Kind code of ref document: T

Effective date: 20170715

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502014004339

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20170621

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170921

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170621

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170922

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170621

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170621

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170621

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170621

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170621

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170621

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170921

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170621

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170621

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170621

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170621

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170621

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170621

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171021

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170621

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170621

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502014004339

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170621

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 5

26N No opposition filed

Effective date: 20180322

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170621

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170621

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20180531

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170621

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180531

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180531

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180528

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180528

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180531

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170621

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170621

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170621

Ref country code: MK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170621

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20140528

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170621

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 903902

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190528

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190528

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230524

REG Reference to a national code

Ref country code: DE

Ref legal event code: R081

Ref document number: 502014004339

Country of ref document: DE

Owner name: BRANDENBURG LABS GMBH, DE

Free format text: FORMER OWNER: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V., 80686 MUENCHEN, DE

REG Reference to a national code

Ref country code: GB

Ref legal event code: 732E

Free format text: REGISTERED BETWEEN 20240104 AND 20240110

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20240516

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240514

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20240522

Year of fee payment: 11