EP1782658A1 - Vorrichtung und verfahren zum ansteuern einer mehrzahl von lautsprechern mittels eines dsp - Google Patents
Vorrichtung und verfahren zum ansteuern einer mehrzahl von lautsprechern mittels eines dspInfo
- Publication number
- EP1782658A1 EP1782658A1 EP06791532A EP06791532A EP1782658A1 EP 1782658 A1 EP1782658 A1 EP 1782658A1 EP 06791532 A EP06791532 A EP 06791532A EP 06791532 A EP06791532 A EP 06791532A EP 1782658 A1 EP1782658 A1 EP 1782658A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- directional
- source
- loudspeaker
- parameter
- speaker
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2205/00—Details of stereophonic arrangements covered by H04R5/00 but not provided for in any of its subgroups
- H04R2205/024—Positioning of loudspeaker enclosures for spatial sound reproduction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
- H04R3/12—Circuits for transducers, loudspeakers or microphones for distributing signals to two or more loudspeakers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
- H04S2420/13—Application of wave-field synthesis in stereophonic audio systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/307—Frequency adjustment, e.g. tone control
Definitions
- the present invention relates to audio engineering, and more particularly to the positioning of sound sources in systems comprising delta stereophonic systems (DSS) or field-synthesis systems, or both.
- DSS delta stereophonic systems
- Typical public address systems for supplying a relatively large environment such as in a conference room on the one hand or a concert hall in a hall or even in the open air on the other hand all suffer from the problem that due to the commonly used small number of speaker channels, a faithful reproduction of the sound sources anyway eliminated. But even if a left channel and a right channel are used in addition to the mono channel, you always have the problem of the level. So, of course, the back seats, so the seats that are far away from the stage, need to be sounded as well as the seats that are close to the stage. If z. B.
- a single monaural loudspeaker does not allow directional perception in a conference room. It only allows directional perception if the location of the loudspeaker corresponds to the direction. This is inherent in the fact that there is only one loudspeaker channel. However, even if there are two stereo channels, you can at most between the left and the right channel back and forth, so to speak panning. This may be beneficial if there is only one source. However, if there are several sources, the localization, as with two stereo channels, is only roughly possible in a small area of the auditorium. You also have a sense of direction in stereo, but only in the sweet spot. In the case of several sources, this directional impression becomes more and more blurred, especially as the number of sources increases.
- the loudspeakers are in such medium to large auditoriums that are equipped with stereo or mono Mixtures are supplied, arranged over the listeners so that they can not reproduce any direction information of the source anyway.
- so-called “support speakers” positioned near a source of sound are also used to try to re-establish the natural hearing loca- tion.
- These support speakers are normally triggered without delay, while the stereo sound is supplied via the power supply is rather delayed, so that the supporting loudspeaker is perceived first and thus according to the law of the first wavefront a localization is possible, but support loudspeakers have the problem that they are perceived as a point source, which leads on the one hand to a difference to the actual position of the sound emitter results and that, moreover, there is a risk that everything is too loud for the front spectators, while everything is too quiet for the rear viewers.
- Stutzlaut speakers usually conventional speakers are used, which in turn have the acoustic properties of a point source - as well as the supply speakers - which results in the immediate vicinity of the systems an excessive often perceived as unpleasant level.
- the aim is to create an auditory perception of source positions for public address scenarios, as they take place in the theater / drama area, whereby conventional normal sound systems, which are only designed to provide sufficient coverage of the entire audience area with loudness directional loudspeaker systems and their control should be supplemented.
- medium to large auditoriums are supplied with stereo or mono and occasionally with 5.1 surround technology.
- the speakers are located next to or above the listener, and can be right directional Play source information only for a small audience. Most listeners get a wrong directional impression.
- DSS delta stereophonic systems
- DD 242954 A3 discloses a large-area sound reinforcement system for larger rooms and areas, in which action or presentation and reception or listening rooms are directly adjacent to one another or identical. The sound is made according to the principles of running time. In particular occurring misalignments and jump effects in movements, which are particularly disturbing for important solo sound sources, are avoided by a maturity graduation is realized without limited source areas and the sound power of the sources is taken into account.
- a control device which is connected to the deceleration or amplification means, controls this analogous to the sound paths between see the source and Schallstrahlerorten. For this purpose, a position of a source is measured and used to adjust loudspeakers according to gain and delay accordingly.
- a playback scenario includes several separate speaker groups, each of which is controlled.
- Delta stereophony means that one or more directional loudspeakers are present in the vicinity of the real sound source (eg on a stage), which detect a locator in large parts of the audience area. It is an almost natural direction perception possible. These speakers are timed to the directional speaker to realize the location reference. As a result, the directional loudspeaker is always perceived first and thus localization becomes possible, and this connection is also referred to as the "law of the first wavefront". The speakers are perceived as a point source. The result is a difference to the actual position of the sound emitter, so the original source, for example, if a soloist is not directly in front of or next to the splitter speaker, but is located away from the splitter speaker.
- wave direction synthesis systems can be used to achieve a real directional reference via virtual sound sources.
- WFS Wave Field Synthesis
- WFS Huygens' principle of wave theory
- Every point that is detected by a wave is the starting point of an elementary wave that propagates in a spherical or circular manner.
- Applied to the acoustics can be simulated by a large number of speakers, which are arranged side by side (a so-called speaker array), any shape of an incoming wavefront.
- a so-called speaker array any shape of an incoming wavefront.
- the audio signals of each loudspeaker must be fed with a time delay and amplitude scaling in such a way that the radiated sound fields of the individual loudspeakers are superimposed correctly.
- the contribution to each speaker is calculated separately for each source and the resulting signals added together. If the sources to be reproduced are in a room with reflective walls, reflections must also be reproduced as additional sources via the loudspeaker array. The cost of the calculation therefore depends heavily on the number of sound sources, the reflection characteristics of the recording room and the number of speakers.
- the advantage of this technique is in particular that a natural spatial sound impression over a large area of the playback room is possible.
- the direction and distance of sound sources are reproduced very accurately.
- virtual sound sources can even be positioned between the real speaker array and the listener.
- wave field synthesis works well for environments whose properties are known, irregularities occur when the nature of the wave field changes or when wave field synthesis is based on a transient wave pattern. which does not correspond to the actual nature of the environment.
- An environmental condition can be described by the impulse response of the environment.
- the impulse response of this environment is first measured and then the compensation signal is calculated, which must be impressed on the audio signal superimposed on the loudspeaker, the reflection from this wall will be canceled, such that a listener in this environment will soundly feel that this is Wall does not exist at all.
- Decisive for an optimal compensation of the reflected wave is that the impulse response of the room is accurately determined, so that no overcompensation or undercompensation occurs.
- Wave field synthesis (WFS or sound field synthesis), as developed at the end of the 1980s at the TU Delft, represents a holographic approach to sound reproduction. The basis for this is the Kirchhoff-Helmholtz integral. This states that any sound fields within a closed volume can be generated by means of a distribution of monopole and dipole sound sources (loudspeaker arrays) on the surface of this volume. Details can be found in M.M. Boone, E.N.G. Verheijen, P.F. ToI, "Spatial Sound-Field Reproduction by Wave
- a synthesis signal for each loudspeaker of the loudspeaker array is calculated from an audio signal which emits a virtual source at a virtual position, the synthesis signals being designed in amplitude and phase such that a wave resulting from the superposition of the individual the sound wave output in the speaker array corresponds to the wave that would result from the virtual source at the virtual position. de, if this virtual source at the virtual position would be a real source with a real position.
- the computation of the synthesis signals is performed for each virtual source at each virtual location, typically resulting in one virtual source in multiple speaker synthesis signals. Seen from a loudspeaker, this loudspeaker thus receives several synthesis signals, which go back to different virtual sources. A superimposition of these sources, which is possible on the basis of the linear superposition principle, then yields the reproduction signal actually emitted by the loudspeaker.
- the sound quality of the audio playback increases with the number of speakers provided. This means that the audio quality will become better and more realistic as more speakers are present in the loudspeaker array (s).
- the final-rendered and analog-to-digital converted reproduction signals for the individual loudspeakers could be transmitted, for example via two-wire lines, from the wave field synthesis central unit to the individual loudspeakers. Although this would have the advantage that it is almost ensured that all speakers work in sync, so that here for synchronization purposes, no further action would be required.
- the wave field synthesis central unit could always be made only for a special reproduction room or for a reproduction with a fixed number of loudspeakers.
- the delta stereophony is particularly problematic, since position artifacts due to phase and level errors occur when fading between different sound sources. Furthermore, at different movement speeds of the sources, phase errors and mislocalizations occur. Moreover, the crossfading from one support loudspeaker to another support loudspeaker entails a great deal of programming, but at the same time there are problems keeping the overview of the entire audio scene, in particular if several sources are being switched back and forth by different support loudspeakers, and in particular when many support speakers, which can be controlled differently, exist.
- wave field synthesis on the one hand and delta stereophony on the other hand are actually opposing methods, while both systems can have advantages in different applications.
- the delta stereophony is much less expensive in terms of calculating the loudspeaker signals than the wave field synthesis.
- wave field synthesis arrays can not be widely used because of space requirements and the requirement for an array of closely spaced loudspeakers.
- wave field synthesis does not predetermine a fixed grid of surround loudspeakers, but instead a movement of a virtual source can take place continuously.
- a splitter speaker on the other hand, can not move. However, the motion of the splitter speaker can be generated virtually by directional glare.
- each directional area has a localization loudspeaker (or a small group of simultaneously controlled localization loudspeakers), which is controlled without or with only a slight delay, while the other loudspeakers are the directional group with the same signal, but time-delayed to generate the necessary volume, while the localization loudspeaker had delivered the well-defined localization.
- the object of the present invention is to provide a more flexible concept for driving a plurality of loudspeakers, which on the one hand ensures a good spatial localization and on the other hand a sufficient volume power supply.
- the present invention is based on the recognition that the adjoining directional areas that define the "raster" of well-locatable movement points on a stage must be removed.
- the directional areas are non-overlapping, clear ratios were thereby provided are present, the number of directional areas limited, since each directional area in addition to the Lokalisationslaut Maschinener also needed a sufficiently large number of speakers to produce in addition to the first wave front, which is generated by the Lokalisationslaut Maschinener, also a sufficient volume.
- a division of the stage space is made in overlapping directional areas, thereby creating the situation that a speaker may belong not only to a single directional area, but to a plurality of directional areas, such as at least the first directional area and the second directional area and if applicable to a third or a further fourth directional area.
- the affiliation of a loudspeaker to a directional area is experienced by the loudspeaker in that, if it belongs to a directional area, it is assigned a specific loudspeaker parameter which is determined by the directional area.
- a speaker parameter may be a delay which will be small for the localization speakers of the directional area and will be greater for the other speakers of the directional area.
- Another parameter can be a scaling or a filter curve, which can be determined by a filter parameter (equalizer parameter).
- each loudspeaker on a stage will have its own loudspeaker parameter, depending on which direction it belongs to.
- a loudspeaker may belong to several directional areas, the loudspeaker has two different values for the loudspeaker parameter. So a loudspeaker, if it belongs to directional zone A, would have a first delay DA. However, the speaker, if it belongs to the directional area B, had a different delay value DB.
- the loudspeaker parameters used to use the audio signal for this speaker and for the currently viewed audio source when the directional group A is to go into a directional group B, or when a position of a sound source is to be reproduced between the directional area position A of the directional group A and the directional area position B of the directional group B, then the loudspeaker parameters used to use the audio signal for this speaker and for the currently viewed audio source.
- the actually indissoluble contradiction namely that a loudspeaker has two different delay settings, scaling settings or filter settings, is eliminated by calculating the loudspeaker parameter values for the audio signal to be output by the loudspeaker all involved directional groups are used.
- the calculation of the audio signal depends on the distance measure, that is to say on the spatial position between the two direction group positions, wherein the distance measure will typically be a factor between zero and one is where a factor of zero determines that the speaker is at the direction group position A, while a factor of one determines that the speaker is at the direction group position B.
- true loudspeaker parameter value interpolation or blending of an audio signal based on the first loudspeaker parameter into a loudspeaker signal based on the second speaker parameter is important to be paid to whether interpolation or crossfading is used. Namely, if an interpolation is used in a very fast movement of a source, this will result in audible artifacts that will result in a rapidly rising tone or a rapidly falling tone.
- the switching is not abruptly made, ie from one sample to the next, but a transition is effected, controlled by a switching parameter within a fade-over range that will comprise a plurality of samples, based on a fade-over function, which is preferably linear, but which may also be nonlinear, eg, trigonometric.
- a graphical user interface graphically represented by way of a sound source from one directional area to another directional area.
- compensation paths are also taken into account to allow rapid changes in the path of a source, or to avoid harsh jumps from sources, as might occur in scene breaks.
- the compensation path ensures that a path of a source can not only be changed when the source is in the directional position, but also when the source is between two directional positions. This ensures that a source can turn off its programmed path between two directional positions. In other words, this is achieved in particular by the fact that the position of a source can be defined by three (adjacent) directional areas, in particular by identification of the three directional areas as well as the indication of two glare factors.
- a field field synthesis array is mounted in the sounding room, which also indicates a virtual area (eg in the middle of the array) a directional area with a directional area position represents.
- a sound source is a wave field synthesis sound source or a delta stereophonic sound source.
- a user-friendly and flexible system that allows flexible division of space into directional groups, as directional group overlaps are allowed, with loudspeakers in such an overlapping zone with regard to their loudspeaker parameters, loudspeaker parameters derived from the loudspeaker parameters belonging to the directional areas are supplied, this derivation preferably taking place by means of interpolation or cross-fading.
- a hard decision could be made, for example, when the source is closer to one directional area, to take one loudspeaker parameter and then, when the source is closer to the other directional area, to take the other loudspeaker parameter , where the then occurring hard jump for artifact reduction could be easily smoothed.
- distance-controlled fading or pitch-controlled interpolation is preferred.
- Fig. 2a is a schematic speaker parameter table for loudspeakers in the various areas
- Fig. 3a is an illustration of a linear two-way transition
- FIG. 3b is an illustration of a three-way transition
- Fig. 4 is a schematic block diagram of the apparatus for driving a plurality of loudspeakers with a DSP;
- Fig. 5 is a more detailed illustration of the means for calculating a loudspeaker signal of Fig. 4 according to a preferred embodiment;
- Fig. 6 shows a preferred implementation of a DSP for implementing delta stereophony
- Figure 7 is a schematic representation of the occurrence of a loudspeaker signal from a plurality of single loudspeaker signals originating from different audio sources;
- Fig. 8 is a schematic illustration of an apparatus for controlling a plurality of loud speakers which may be based on a graphical user interface
- Fig. 9a shows a typical scenario of the movement of a source between a first directional group A and a second directional group C;
- Fig. 9b is a schematic representation of the movement according to a compensation strategy to avoid a hard jump of a source
- Fig. 9c is a legend for Figs. 9d to 9i;
- FIG. 9d a representation of the compensation strategy "InpathDual"
- Fig. 9e is a schematic representation of the compensation strategy "InpathTriple"
- Fig. 9f is a schematic representation of the compensation strategies AdjacentA, AdjacentB, AdjacentC;
- FIG. 9g is a schematic representation of the compensation strategies OutsideM and OutsideC
- Fig. 9h is a schematic representation of a Cader compensation path
- Fig. 9i is a schematic representation of three Cader compensation strategies
- 10a shows a representation for defining the source path (default sector) and the compensation path (compensation sector);
- 10b is a schematic representation of the backward movement of a source with the cadre with a changed compensation path
- Fig. 10c is an illustration of the effect of BlendAC on the other blend factors
- Fig. 10d is a schematic diagram for calculating the blend factors and thus the weighting factors depending on BlendAC;
- Fig. IIa is an illustration of an input / output matrix for dynamic sources.
- Fig. IIb is an illustration of an input / output matrix for static sources.
- FIG. 1 shows a schematic representation of a stage rasa, which is divided into three directional areas RGA, RGB and RGC, each directional area comprising a geometric area 10a, 10b, 10c of the stage, the area boundaries not being decisive.
- the only decisive factor is whether loudspeakers are located in the different areas shown in FIG. Speakers located in the region I belong only to the directional group A in the example shown in FIG. 1, the position of the directional group A being designated IIa.
- the direction group RGA is assigned the position IIa at which preferably the loudspeaker of the direction group A is present, which according to the law of the first wavefront has a delay which is smaller than the delays of all other loudspeakers assigned to the direction group A.
- area II there are loudspeakers which are assigned only to the direction group RGB, which by definition has a direction group position IIb at which the support loudspeaker of the directional group RGB is located, which has a smaller delay than all other loudspeakers of the directional group RGB.
- a region III there are only loudspeakers associated with the directional group C, the directional group C having by definition a position 11c at which the supporting loudspeaker of the directional group RGC is arranged, which with a shorter delay than all other loudspeakers of the Direction group RGC will send.
- an area IV exists in which loudspeakers are arranged which are assigned to both the directional group RGA and the directional group RGB. Accordingly, a region V exists in which loudspeakers are arranged which are assigned to both the directional group RGA and the directional group RGC.
- each loudspeaker parameter in a stage setting is assigned by the sound engineer or by the director responsible for the sound a loudspeaker parameter or a plurality of Assigned to speaker parameters.
- These speaker parameters include a delay parameter, a scale parameter, and an EQ filter parameter.
- the delay parameter D indicates how much of an audio signal that is output from this speaker is delayed with respect to a reference value (which is valid for another speaker but does not necessarily have to be real).
- the Scale parameter indicates how much of an audio signal is amplified or attenuated by this speaker compared to a reference value.
- the EQ filter parameter specifies how the frequency response of an audio signal to be output from a speaker should look like. For example, for certain loudspeakers there may be a desire to amplify the high frequencies compared to the low frequencies, which would make sense, for example, if the loudspeaker is in the vicinity of a stage part that has a strong low-pass characteristic. On the other hand, for a loudspeaker that is in a stage area that does not have a low-pass characteristic, there may be a desire to introduce such a low-pass characteristic, in which case the EQ filter parameter would indicate a frequency response where the high frequencies are low-frequency are damped. In general, any frequency response can be set for each speaker via an EQ filter parameter.
- each speaker has two associated speaker parameter values for each speaker parameter. For example, if only the speakers in the directional group RGA are active, ie if a source is located exactly on the direction group position A (IIa), only the speakers of the directional group A will play for this audio source. In this case, to calculate the audio signal for the loudspeaker, the column of parameter values associated with the directional group RGA would be used.
- the audio signal is now calculated taking into account both parameter values and preferably taking into account the distance measure, as will be explained later.
- an interpolation or cross-fading between the parameter values Delay and Scale is made.
- the loudspeakers of the directional group RGC must also be active.
- Speakers located in region VII will then take account of the three typically different parameter values for the same loudspeaker parameter, while for region V and region VI, consideration of the loudspeaker parameter values for the directional groups A and C will take place and the same speaker will take place.
- Fig. 9a shows the case that a source is moving from the directional area A (IIa) to the directional area C (llc).
- the loudspeaker signal LsA for a loudspeaker in the directional area A is reduced further and further depending on the position of the source between A and B, ie BlendAC in FIG. 9a.
- Sl decreases linearly from 1 to 0, while at the same time the source C loudspeaker signal becomes less and less is dampened. This can be seen from the fact that S 2 increases linearly from 0 to 1.
- the cross-fading factors Si, S 2 are selected such that the sum of the two factors yields 1 at each point in time.
- Alternative transitions such as non-linear transitions, can also be used. It is preferred for all these blends that for each BlendAC value, the sum of the blending factors for the speakers concerned is equal to one.
- non-linear functions are, for example, a COS 2 function for the factor Sl, while a SIN 2 function is used for the weighting factor S2.
- Other functions are known in the art.
- FIG. 3a provides a complete fading rule for all loudspeakers in the ranges I, II, III. It should also be pointed out that the parameters assigned to a loudspeaker of the table in FIG. 2a have already been included in the audio signal AS in the upper right-hand corner of FIG. 3a from the corresponding areas.
- Fig. 3b shows, in addition to the rule case defined in Fig. 9a, where a source is on a connecting line between two directional areas, the exact location between the start and finish directional areas being described by the glare factor AC, the compen - Sationsfall, which then occurs, for example, when the path of a source is changed while moving. Then the source should be from any current position, which is located between two directional areas, these positions being tion is represented by BlendAB in Fig. 3b, are blinded to a new position. This results in the compensation path, designated 15b in FIG. 3b, while the (regular) path was originally programmed between the directional areas A and B and is referred to as the source path 15a. 3b therefore shows the case that something had changed during a movement of the source from A to B and therefore the original programming is changed to the effect that the source should now not run in the directional area B, but in the directional area C.
- Fig. 3b The equations shown in Fig. 3b indicate the three weighting factors q lf g 2 , g 3 , which provide the fading property for the loudspeakers in the directional areas A, B, C.
- the directional area-specific speaker parameters are already taken into account again.
- the audio signals AS A, AS may b, AS C of the original audio signal AS can be easily calculated by using the data stored for the corresponding speaker speaker parameters of the column 16a in FIG. 2a, and then ultimately the perform final fading weighting with the weighting factor gi.
- weights need not be split into different multiplications, but will typically take place in one and the same multiplication, and then the scale factor Sk will be multiplied by the weighting factor gi to obtain a multiplier which will eventually be multiplied by the Audio signal is multiplied to obtain the loudspeaker signal LS a .
- the same weighting gi, g 2 , g 3 is used for the overlapping areas, but to calculate the underlying audio signal AS 3 , AS b or AS C, an interpolation / mixing of the loudspeaker parameter values specified for one and the same loudspeaker is used instead of finding, as explained below.
- the driving device will be explained below with reference to FIG. 4.
- 4 shows a device for driving a plurality of loudspeakers, the loudspeakers being grouped into directional groups, a first directional group position being associated with a first directional group, a second directional group position being associated with a second directional group, at least one loudspeaker of the first and the second Associated with the loudspeaker parameter and having a first parameter value for the first directional group and having a second parameter value for the second directional group.
- the apparatus first comprises means 40 for providing a source position between two directional group positions, that is, for example, for providing a source position between the direction group position IIa and the direction group position IIb, as e.g. is specified by BlendAB in Fig. 3b.
- the device further comprises means 42 for calculating a loudspeaker signal for the at least one loudspeaker based on the first parameter value provided above a first parameter value input 42a which applies to the directional group RGA and based on a second parameter value corresponding to a second parameter value Parameter value input 42b is provided, and applies to the directional group RGB.
- the means 42 for calculating receives the audio signal via an audio signal input 43, and then the output side, the speaker signal for the considered speaker in the area IV, V, VI or VII.
- the output of device 42 at output 44 will be the actual audio signal if the speaker being viewed is active only due to a single audio source. On the other hand, when the loudspeaker is active due to several audio sources, as shown in Fig.
- a component for the loudspeaker signal of the considered loudspeaker is calculated for each source by means of a processor 71, 72 or 73 on the basis of this one audio source 70a, 70b, 70c and then finally summing the N component signals indicated in FIG. 7 in a summer 74.
- the temporal synchronization takes place via a control processor 75, which, like the DSS processors 71, 72, 73, is preferably designed as a DSP (digital signal processor).
- DSP application specific hardware
- Summer 74 performs sample-by-sample summation, while delta stereo processors 71, 72, 73 also issue sample by sample, and the audio signal is also provided sample by sample. It should be noted, however, that when processing is performed in block-by-block processing, all processing may also be performed in the frequency domain, namely when summing 74 spectra together. Of course, with each processing by means of an up / down transformation, certain processing may be performed in the frequency domain or the time domain, depending on which implementation is more favorable for the particular application. In the same way, processing can also take place in the filter bank domain, in which case a Analysis filter bank and a synthesis filter bank are needed.
- the audio signal which is assigned to an audio source, is first supplied via the audio signal input 43 to a filter mixing block 44.
- the filter blend block 44 is configured to consider all three filter parameter settings EQ1, EQ2, EQ3 when considering a speaker in region VII.
- the output of the filter blend block 44 then represents an audio signal which has been filtered in appropriate proportions, as will be described later, to some extent have influences from the filter parameter settings of all three directional regions involved.
- This audio signal at the output of the filter mix block 44 is then supplied to a delay processing stage 45.
- the delay processing stage 45 is designed to generate a delayed audio signal whose delay is now based on an interpolated delay value or, if no interpolation is possible, its signal form of the three delays D1, D2, D3 depends.
- the three delays associated with a loudspeaker for the three directional groups are provided to a delay interpolation block 46 to calculate an interpolated delay value D int , which is then fed to the delay processing block 45.
- a scaling 46 is performed, wherein the scaling 46 is performed using a total scaling factor that depends on the three scaling factors associated with the same loudspeaker due to the fact that the loudspeaker belongs to several directional groups.
- This total The gain factor is calculated in a scaling interpolation block 48.
- the scaling interpolation block 48 is also fed with the weighting factor, which describes the total fading for the directional region and has been set out in connection with FIG. 3b, as represented by an input 49, so that the scaling In block 47, the final loudspeaker signal component is output on the basis of a source for a loudspeaker, which in the exemplary embodiment shown in FIG. 5 may belong to three different directional groups.
- All the speakers of the other directional groups except for the three affected directional groups through which a source is defined do not output signals for that source, but may of course be active for other sources.
- weighting factors may be used to interpolate the delay D int or to interpolate the scale factor S as used for fading, as set forth by the equations in FIG. 5 adjacent to blocks 45 and 47, respectively is.
- FIG. 6 shows a preferred embodiment of the present invention implemented on a DSP.
- the audio signal is provided via an audio signal input 43, wherein when the audio signal is in an integer format, an integer / floating point transformation is first performed in a block 60.
- Fig. 6 shows a preferred embodiment of the filter blend block 44 in Fig. 5.
- Fig. 6 includes filters EQ1, EQ2, EQ3, where the transfer functions or impulse responses of the filters EQ1, EQ2, EQ3, respectively, of respective filter coefficients via a filter coefficient input 440 are controlled.
- the filters EQ1, EQ2, EQ3 may be digital filters that convolve an audio signal with the Perform impulse response of the corresponding filter, or there may be transformation means, wherein a weighting of spectral coefficients is performed by frequency transfer functions.
- the signals filtered with the equalizer settings in EQ1, EQ2, EQ3, all of which are based on one and the same audio signal, as shown by a distribution point 441, are then weighted in respective scaling blocks with the weighting factors gi, g 2 , g 3 then sum up the results of the weights in a summer.
- At the output of the block 44, ie at the output of the summer, is then fed to a ring buffer, which is part of the delay processing 45 of FIG. 5.
- the E-qualifier parameters EQ1, EQ2, EQ3 are not taken directly, as they are in the table shown in FIG. 2a, but preferably an interpolation of the equalizer is made. Parameter, which is done in block 442.
- Block 442 actually receives on the input side the equalizer coefficients associated with a loudspeaker, as represented by a block 443 in FIG.
- the interpolation task of the Filter Ramping block is known to perform low pass filtering of successive Equalizer coefficients to avoid artifacts due to rapidly changing Equalizer Filter parameters EQ1, EQ2, EQ3.
- the sources can thus be blinded over several directional areas, these directional areas are characterized by different settings for the equalizer. Between the various equalizer settings is dazzled, wherein, as shown in Fig. 6 in block 44, all the equalizers go through in parallel and the outputs are superimposed. It should also be noted that the weighting factors gl, g2, g3, as used in block 44 for blending the equalizer settings, are the weighting factors shown in FIG. 3b. To calculate the weighting factors, there is a weighting factor conversion block 61 that converts a position of a source into weighting factors for preferably three surrounding directional areas.
- the block 61 is preceded by a position interpolator 62, which is typically dependent on an input of a start position (POSI) and a target position (POS2) and the corresponding blending factors, which in the scenario shown in FIG Blend AB and Blend ABC are, and typically compute a current position depending on a move speed input at a current time.
- the position input takes place in a block 63.
- the position update rate is arbitrarily adjustable. For example, a new weighting factor could be calculated for each sample. However, this is not preferred. Instead, it has been found that the weighting factor update rate must be made only with a fraction of the sampling frequency, even with regard to a meaningful artifact avoidance.
- the scaling calculation which has been illustrated in FIG. 5 on the basis of blocks 47 and 48, is only partially shown in FIG.
- the calculation of the total scaling factor made in block 48 of FIG. 5 does not take place in the DSP shown in FIG. 6 but in an upstream control DSP.
- the overall scaling factor, as shown by "Scales" 64, has already been input and interpolated in a scaling / interpolation block 65 to finally perform a final scaling in a block 66a. then, as shown in a block 67a, then proceeding to the summer 74 of FIG.
- the device according to the invention allows two delay processing.
- One delay processing is the delay mix 451, while the other delay processing is the latch interpolation performed by an IIR allpass 452.
- the output of the block 44 which has been stored in the ring buffer 450 is provided in the delay mix with three different delays explained below, the delays with which the delay blocks are driven in block 451 being the non-smoothed ones Delays are those given in the table which has been explained with reference to Fig. 2a for a loudspeaker.
- This fact is also clarified by a block 66b, which indicates that the direction group delays are input here, whereas in a block 67b not the direction group delays are input, but at a time only one loudspeaker a delay, namely the interpolated one Delay value Dint generated by block 46 in FIG.
- the present with three different delays Audiosig- nal in block 451 is then respectively, as shown in Fig. 6, weighted with a weighting factor, but Ge ⁇ weighting factors now preferably not the weighting factors are generated by linear transition as it is shown in Fig. 3b. Instead, it is preferred to perform a loudness correction of the weights in a block 453 to achieve a nonlinear three-dimensional crossfade here. It turns out that then the audio quality in the delay Blend better and artifact-free, although the weighting factors gi, g 2 , g 3 could also be used to drive the scaler in the delay mixing block 451. The output signals of the scaler in the delay mixing block are then summed to obtain a delay-mix audio signal at an output 453.
- the delay processing according to the invention can also perform a delay interpolation.
- an audio signal with the (interpolated) delay which is provided via the block 67b and which has additionally been smoothed in a delay ramp block 68, is read out of the ring buffer 450 , Moreover, in the exemplary embodiment shown in FIG. 6, the same audio signal, but delayed by one sample less, is also read out.
- These two audio signals or just considered samples of the audio signals are then fed to an IIR filter for interpolation in order to obtain at an output 453b an audio signal which has been generated due to an interpolation.
- the audio signal at input 453a has little filter artifact due to the delay mix.
- the audio signal at output 453b is hardly filter artifact-free.
- this audio signal may have frequency-high shifts. If the delay is mapped from a long delay value to a short delay value, the frequency shift will be a shift to higher frequencies, while if the delay is interpolated from a short delay to a long delay, the frequency shift will shift to lower frequencies will be.
- block 65 it is further controlled whether block 457 forwards the result of the mixing or the interpolation, or in what ratio the results are mixed.
- the smoothed or filtered value from the block 68 is compared with the non-smoothed to make it dependent on which greater is the (weighted) switching in 457.
- the block diagram in Figure 6 further includes a branch for a static source that sits in a directional area and does not need to be crossfaded.
- the delay for that source is the delay assigned to the loudspeaker for that directional group.
- the delay calculation algorithm therefore switches over too slow or too fast movements.
- the same physical speaker is available in two directional areas with different level and delay settings.
- the level is blinded and the delay is interpolated by means of an Alpass filter, ie the signal is taken at the output 453b.
- this interpolation of the delay results in a pitch change of the signal which, however, is not critical in slow changes. If, on the other hand, the speed of the interpolation exceeds a certain value, such as 10 ms per second, then these pitch changes can be perceived. In the case of too high a speed, the delay is therefore no longer interpolated, but the signals with the two constant different delays are blinded, as shown in block 451.
- the switching between the two outputs 453a and 453b takes place depending on the movement of the source or, more precisely, depending on the delay value to be interpolated. If much delay has to be interpolated, the output 453a is switched through by block 457. If, on the other hand, little delay has to be interpolated in a certain period of time, the output 453b is taken.
- switching through block 457 does not take place hard.
- the block 475 is formed such that a cross-over area exists that is located around the threshold. Therefore, if the speed of the interpolation is at the threshold, block 457 is configured to compute the output side sample such that the current sample on output 453a and the current sample on output 453b are added together and the result is two is shared.
- the block 457 therefore makes a smooth transition from the output 453b to the output 453a or vice versa in a transition region around the threshold.
- This transition area can be made arbitrarily large, such that the block 457 operates almost continuously in the transition mode.
- the cross-over area can be made smaller so that block 457 will most often either turn on only output 453a or only output 453b to scaler 66a.
- the transition block 457 is further configured to perform jitter suppression via a low pass and a hysteresis of the delay change threshold. Due to the non-guaranteed run time of the control data flow between the configuration system and the DSP systems, jitter may occur in the control data, which may result in artifacts in the audio signal processing. It is therefore preferred by a Low-pass filtering the control data stream at the input of the DSP system to compensate for this jitter. This method reduces the response time of the timing. For this very large jitter fluctuations can be compensated. If, however, different threshold values are used for switching from delay interpolations to delay glare and delay glare to delay interpolation, the jitter in the control data can be avoided as an alternative to low-pass filtering without reducing the control data response time.
- the fade block 457 is further configured to perform control data manipulation in fanning delay interpolations to delay fade.
- the fade block 457 is designed to keep the delay control data constant until the complete conversion to the delay fade is completed. Only then will the delay control data be adjusted to the actual value. With the aid of this control data manipulation, it is also possible to realize fast delay changes with a short control data reaction time without audible tone changes.
- the drive system further includes a metering device 80 configured to perform digital (imaginary) metering per directional area / audio output.
- a metering device 80 configured to perform digital (imaginary) metering per directional area / audio output.
- the DSP system results in a delay and a level being calculated from the audio matrix at each maxix point, the level scaling value being represented by AmP in Figures 11a and 11b while the delay is designated by "dynamic-interval delay interpolation" or "static-source delay".
- these settings are split into directional areas and input signals are then applied to the directional areas.
- input signals can also be assigned to a directional area.
- a metering is indicated by the block 80 for the directional areas, which however is determined "virtually" from the levels of the nodal points of the matrix and the corresponding weightings.
- metering 80 can also be used to calculate the overall level of a single sound source from multiple sound sources over all directional areas that are active for that sound source. This result would result if for one input source the matrix points are summed for all outputs. In contrast, a contribution of a directional group to a switching source can be achieved by summing up the outputs of the total number of outputs belonging to the considered directional group, while disregarding the other outputs.
- the concept according to the invention provides a universal operating concept for the representation of sources independently of the reproduction system used.
- a hierarchy is used.
- the lowest hierarchical element is the individual loudspeaker.
- the middle hierarchy level is a directional area, and loudspeakers may also be present in two different directional areas.
- the top hierarchy area are directional area presets, such that for certain audio objects / applications, certain directional areas taken together may be considered as an "over-direction area" on the user interface.
- the sound source positioning system is divided into main components including a system for performing a performance, a system for configuring a performance, a DSP system for calculating delta stereophony, a DSP system for calculating field-of-field synthesis, and the like Emergency response system.
- a graphical user interface is provided. used to achieve a visual assignment of the actors to the stage or camera image.
- the system operator is presented with a two-dimensional image of the 3D space, which may be designed as shown in FIG. 1, but which may also be implemented in the manner shown in FIGS. 9a to 10b for only a small amount Number of directional groups is shown.
- the user assigns directional areas and loudspeakers from the three-dimensional space of the two-dimensional mapping via a selected symbolism. This is done by a configuration setting.
- the two-dimensional position of the directional areas on the screen is mapped to the real three-dimensional position of the loudspeakers assigned to the corresponding directional areas.
- the operator is able to reconstruct the real three-dimensional position of directional areas and to realize an arrangement of sounds in the three-dimensional space.
- the mixer can include a DSP of FIG. 6, the indirect positioning of the sound sources takes place in real three-dimensional space.
- the user is able to position the sounds in all spatial dimensions without having to change the view, that is, it is possible to position sounds in height and depth.
- Fig. 8 shows an apparatus for controlling a plurality of loud speakers, preferably using a graphical user interface, grouped into at least three directional groups, each directional group pe is assigned a direction group position.
- the apparatus first includes means 800 for receiving a source path from a first direction group position to a second direction group position and motion information for the source path.
- the apparatus of Fig. 8 further comprises means 802 for calculating a source path parameter for different times based on the motion information, the source path parameter indicating a location of an audio source on the source path.
- the inventive apparatus further comprises means 804 for receiving a path change command to define a compensation path to the third directional area.
- means 806 is provided for storing a value of the source path parameter at a location where the compensation path branches from the source path.
- a means for calculating a compensation path parameter (BlendAC), which indicates a position of the audio source on the compensation path, which is shown at 808 in FIG. Both the source path parameter computed by means 806 and the compensation path parameter computed by means 808 are fed to means 810 for calculating weighting factors for the loudspeakers of the three directional regions.
- means 810 for calculating the weighting factors are configured to operate based on the source path, the stored value of the source path parameter, and information about the compensation path, wherein information about the compensation path includes either only the new destination, ie the directional area C, or wherein the information about the compensation path additionally comprises a position of the source on the compensation path, that is to say the compensation path parameter. It should be noted that this information is the position on the compensation path is then not necessary if the compensation path is not yet taken, but the source is still on the source path.
- the compensation path parameter which indicates a position of the source on the compensation path, is not necessarily necessary if the source does not take the compensation path, but uses the compensation path to reverse on the source path back to the starting point, to some extent without a compensation path directly from the output - point to the new goal to change.
- This option is useful if the source determines that it has traveled a short distance on the source path and the advantage of taking a new compensation path is only a small advantage.
- Alternative implementations in which a compensation path is taken as an occasion to reverse and go back the source path without traversing the compensation path may be present if the compensation path were to affect areas in the audience space that should not be areas for some other reason in which a sound source is to be located.
- a compensation path according to the invention is of particular advantage in view of a system in which only complete paths between two directional zones are taken, since the time at which a source is in the new (changed) position In particular, when directional areas are located far apart, is significantly reduced. Furthermore, confusing or artificial paths of a source that would be perceived as strange are eliminated for the user. For example, if the case is considered that a source should originally move from left to right on the source path and should now go to another leftmost position that is not very far from the origin position, then the non-source Allow a compensation path to cause the Source runs almost twice over the entire stage, while according to the invention, this process is abbreviated.
- the compensation path is made possible by the fact that a position is no longer determined by two directional areas and a factor, but that a position is defined by three directional areas and two factors, such that points other than the direct connecting lines between two directional group positions are defined by a source. " can be controlled.
- the concept according to the invention allows any point in a reproduction room to be controlled by a source, as becomes immediately apparent from FIG. 3b.
- Fig. 9a shows a rule case in which a source is located on a connecting line between the start-up area IIa and the target-direction area 11c. The exact position of the source between the start and target directional regions is described by a glare factor AC.
- the directional area A is retained.
- the directional area C becomes the directional area B and the glare factor BlendAC becomes the blend area AB, and the new destination area is written in the destination area C.
- the glare factor BlendAC at the time the direction change is to take place that is to say at the time when the source is to leave the source path and swivel onto the compensation path, is stored by means 806 and for the subsequent calculation as blend used.
- the new destination area is written in direction area C.
- source movements can be programmed so that sources jump, so they can move quickly from one place to another. This is the case, for example, when scenes are skipped, when ChannelHOLD mode is deactivated, or when a source ends up in scene 1 in a different direction than in scene 2. If source jumps are switched hard, audible artifacts would result. Therefore, according to the invention, a concept for preventing hard swelling is used. For this purpose, again a compensation path is used which is selected on the basis of a specific compensation strategy. Generally, a source can be at different locations on a path.
- FIG. 9b shows a possible compensation strategy according to which a source located at a point of a compensation path (900) should be brought to a target position (902).
- Position 900 is the position a source has, for example, when a scene ends. When starting the new scene, the source should come to its initial position there, namely position 906.
- an immediate switching from 900 to 906 is dispensed with. Instead, the source first goes to its personal destination direction area, that is, to the direction area 904, and then from there to the initial direction area of the new scene, namely 906 to run.
- the source is at the point where it should have been at the start of the scene.
- the source to be compensated must still run at an increased speed on the programmed path between the directional area 906 and the directional area 908 until it has recovered its nominal position 902.
- FIGS. 9d to 9i show a representation of different compensation strategies which obey all of the notation for the directional area, the compensation path, the new ideal position of the source and the actual position of the source given in FIG. 9c.
- FIG. 9d A simple compensation strategy is shown in Fig. 9d. This is referred to as "InPathDual.”
- the target position of the source is indicated by the same directional regions A, B, C as the source position of the source
- a jump compensation device according to the invention is therefore designed to determine that the directional regions defining the start position are identical to those of FIG In this case, the strategy shown in Fig. 9d is selected, in which continue on the same source path.
- the InPath strategies are used. These have two types, namely InPathDual as shown in Fig. 9d and InPathTriple as shown in Fig. 9e.
- FIG. 9d A simple compensation strategy is shown in Fig. 9d.
- FIG. 9d A simple compensation strategy is shown in Fig. 9d.
- FIG. 9d A simple compensation strategy is shown in Fig. 9d.
- FIG. 9d A simple compensation strategy is shown in Fig. 9d.
- FIG. 9e further shows the case that the real and i-position of the source are not located between two, but between three directional regions.
- the compensation strategy shown in Fig. 9e is used.
- Figure 9e shows the case where the source is already on a compensation path and this compensation path goes back to reach a certain point on the source path.
- the position of a source is defined over a maximum of three directional areas. If ideal position and real position have exactly one common direction, then the Adjacent strategies are used, which are shown in FIG. 9f. There are three types, where the letters "A", "B” and “C” refer to the common directional area, In particular, the current compensation device determines that the real position and the new ideal position define throughputs of directional areas that are a single directional area which, in the case of AdjacentA, is the directional region A, which in the case of AdjacentB, is the directional region B, and which, in the case of AdjacentC, is the directional region C, as can be seen in Figure 9f.
- the outside strategies shown in FIG. 9g are used when the real position and the ideal position have no common directional area in common.
- OutsideC is used when the real position is very close to the position of the directional zone C.
- OutsideM is used when the real position Source between two directional areas, or if the position of the source is between three directional areas, but very close to the knee.
- each directional area may be connected to each directional area, that is, the source to travel from one directional area to another directional area must never exceed a third directional area, but from each directional area to every other directional area a programmable source path exists.
- the source is manually moved, i. with a so-called Cader.
- Cader strategies that provide different compensation paths. It is wished that the Cader strategies usually create a compensation path that connects the directional area A and the area C of the ideal position with the current position of the source. Such a compensation path can be seen in FIG. 9h.
- the newly adopted real position is the directional area C of the ideal position, and in FIG. 9h, the compensation path is formed when the directional area C of the real position is changed from the directional area 920 to the directional area 921.
- Cader strategies there are three Cader strategies shown in Figure 9i.
- the left-hand strategy in FIG. 9i is used when the target direction area C of the real position has been changed. From the trail, Cader follows the OutsideM strategy.
- Caderlnverse is used when the starting direction area A of the real position is changed.
- the resulting compensation path behaves in the same way as the compensation case in the normal case (Cader), but the calculation may differ within the DSP.
- CaderTriplestart is used when the real position of the source is between three directional areas, and a new scene is switched. In this case, a compensation path from the real position of the source to the starting direction area of the new scene must be built.
- the cader can be used to perform an animation of a source.
- the movement of the source is not controlled by a timer, but is triggered by a Cader event, which is given to the device (804) to receive a path-order command.
- the cader event is therefore the path change command.
- a special case which the source animation according to the invention provides by means of Cader is the backward movement of sources. If the position of a source corresponds to the standard case, then the source, whether with the cader or automatically on the intended path, moves with the compensation case, but the backward movement of the source is subject to a special case.
- the path of a source is divided into the source path 15a and the compensation path 15b, the default sector representing a part of the source path 15a and the compensation sector in FIG. 10a representing the compensation path.
- the default sector corresponds to the original programmed portion of the path of the source.
- the compensation sector describes the path section that deviates from the programmed movement.
- Moving the source backwards with the cader will have different effects, depending on whether the source is in the compensation sector or in the default sector. Assuming the source is in the compensation sector, moving the cadre to the left will result in a backward movement of the source. As long as the source is still in the compensation sector, everything happens as expected. But once the source leaves the compensation sector and the default sector the source happens to be in the default sector, but the compensation sector is recalculated so that when the cader is moved back to the right, the source does not go back to the default sector, but directly over the newly calculated compensation sector to the current target area. This situation is shown in Fig. 10b. By moving a source backwards and then moving a source forward again, if a default sector is shortened by the backward movement, then a changed compensation sector is calculated.
- A, B and C are the directional areas over which the position of a source is defined.
- A, B and BlendAB describe the start position of the Compensation sector.
- C and BlendAbC describe the position of the source in the compensation sector.
- BlendAC describes the location of the source on the overall path.
- Source positioning is searched for, eliminating the cumbersome entry of two values for BlendAB and BlendAbC. Instead, the source should be set directly via a BlendAC. If BlendAC is set to zero then the source should be at the beginning of the path. If BlendAC equals 1 then the source should be positioned at the end of the path. In addition, the user should not be "bothered" with compensation sectors or default sectors, but the value for BlendAC depends on whether the source is in the compensation sector or on the default sector. 10c above for BlendAC.
- BlendAB and BlendAbC behave when BlendAC is set.
- BlendAC is set to 0.5. What happens here depends on whether the source is in the compensation sector or the default sector. If the source is in the default sector, then:
- BlendAbC zero.
- BlendAbC zero
- FIG. 10d shows the determination of the parameters BlendAB and BlendAbC, depending on BlendAC, whereby a distinction is made in points 1 and 2 as to whether the source is located in the default sector or in the compensation sector, and in point 3 the values for the Default sector, while in point 4 the values for the compensation sector are calculated.
- the glare factors obtained according to Fig. 10d are then used by the means for calculating the weighting factors, as shown in Fig. 3b, to finally calculate the weighting factors g x , g 2 , g 3 , from which then again, the audio signals and interpolations etc., as described with reference to FIG. 6, can be calculated.
- the inventive concept can be combined particularly well with wave field synthesis.
- wave field synthesis loudspeaker arrays can not be placed on the stage, and instead, in order to achieve sound localization, delta stereophony must be used with directional groups, it is typically possible, at least at the sides of the listener room and at the back of the listener room Wave field synthesis arrays.
- a user does not have to worry about whether a source is now made audible by a wave field synthesis array or a direction group.
- a corresponding mixed scenario is also possible if, for example, wave field synthesis loudspeaker arrays are not possible in a certain area of the stage, because otherwise they would disturb the visual impression, while wave field synthesis loudspeaker arrays can be used in another area of the stage. Again, a combination of delta-stereophony and wave-field synthesis occurs. However, according to the invention, the user will not have to worry about how his source will be rendered since the graphical user interface also provides areas where wave field synthesis loudspeaker arrays are located as directional groups.
- the directional area mechanism for positioning is always provided, such that in a common U-serinterface the assignment of sources to wavefield synthesis or to Deltastereophonie directional sonication can take place without user intervention.
- the concept of the directional areas can be applied universally, whereby the user always positions sound sources in the same way. In other words, the user does not see if he positions a sound source in a directional area that includes a wave field synthesis array, or if he positions a sound source in a directional area that actually has a surround loudspeaker that operates on the principle of the first wavefront.
- a source movement takes place solely in that the user provides motion paths between directional areas, this user-set motion path being received by the means for receiving the source path as shown in FIG. Only on the part of the configuration system is decided by an appropriate implementation, whether a wave field synthesis source or a Deltastereophonie- source is to be prepared. In particular, this is decided by examining a property parameter of the directional area.
- Each directional area can in this case contain any number of loudspeakers and always exactly one wave field synthesis source, which is held by its virtual position at a fixed position within the loudspeaker array or with respect to the loudspeaker array and in this respect the (real) position of the support loudspeaker in one Deltastereophonic system corresponds.
- the wave field synthesis source then represents a channel of the wave field synthesis system, wherein in a wave field synthesis system, as it is known, per channel own audio object, so a separate source can be processed.
- the wave field synthesis source is characterized by corresponding wave field synthesis-specific parameters.
- the movement of the wave field synthesis source can be done in two ways, depending on the availability of the computing power.
- the fix positioned wave field synthesis sources are driven by a transition. As a source moves out of a directional area, the speakers will be muted as the speakers of the directional area into which the source is entering are increasingly attenuated.
- a new position can be interpolated, which is then actually provided as a virtual position of a wave field synthesis renderer, so that without fading and A true wave field synthesis creates a virtual position, which is of course not possible in directional zones based on delta stereophony.
- the present invention is advantageous in that free positioning of sources and assignments to the directional gates can occur, and that in particular when overlapping directional areas are present, ie when loudspeakers belong to multiple directional areas, a large number of directional areas with a high resolution Directional areas positions can be achieved.
- each loudspeaker on the stage could represent its own directional area, which has loudspeakers around it, emitting at a greater delay to meet the volume requirements.
- these (surrounding) loudspeakers suddenly become supportive speakers and will no longer be "auxiliary speakers”.
- the concept according to the invention is further distinguished by an intuitive user interface which decreases the user as much as possible, and therefore enables secure operation even by users who are not proficient in all depths of the system.
- a combination of the wave field synthesis with the delta stereophony is achieved via a common user interface, wherein in preferred embodiments dynamic filtering is achieved in swelling movements due to the equalizer parameters and switched between two blend algorithms to produce artifact generation due to the transition from one direction region to another next direction.
- dynamic filtering is achieved in swelling movements due to the equalizer parameters and switched between two blend algorithms to produce artifact generation due to the transition from one direction region to another next direction.
- it is ensured that no level dips occur during the diaphragming between the directional areas, and furthermore a dynamic glare is also provided, to reduce further artifacts.
- the provision of a compensation path allows for live application capability since there are now opportunities to intervene, for example, to respond to the tracking of sounds when an actor leaves the specified path that has been programmed.
- the present invention is particularly advantageous for sonication in theaters, musical theaters, open-air stages with usually larger auditoriums or in concert venues.
- the inventive method can be implemented in hardware or in software.
- the implementation may be on a digital storage medium, in particular a floppy disk or CD with electronically readable control signals, which may interact with a programmable computer system such that the method is performed.
- the invention thus also consists in a computer program product with a program code stored on a machine-readable carrier for carrying out the method according to the invention, when the computer program product runs on a computer.
- the invention can be realized as a computer program with a program code for carrying out the method when the computer program runs on a computer.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Stereophonic System (AREA)
- Circuit For Audible Band Transducer (AREA)
- Obtaining Desirable Characteristics In Audible-Bandwidth Transducers (AREA)
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102005033238A DE102005033238A1 (de) | 2005-07-15 | 2005-07-15 | Vorrichtung und Verfahren zum Ansteuern einer Mehrzahl von Lautsprechern mittels eines DSP |
PCT/EP2006/006569 WO2007009599A1 (de) | 2005-07-15 | 2006-07-05 | Vorrichtung und verfahren zum ansteuern einer mehrzahl von lautsprechern mittels eines dsp |
Publications (2)
Publication Number | Publication Date |
---|---|
EP1782658A1 true EP1782658A1 (de) | 2007-05-09 |
EP1782658B1 EP1782658B1 (de) | 2008-02-13 |
Family
ID=36942191
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP06791532A Not-in-force EP1782658B1 (de) | 2005-07-15 | 2006-07-05 | Vorrichtung und verfahren zum ansteuern einer mehrzahl von lautsprechern mittels eines dsp |
Country Status (7)
Country | Link |
---|---|
US (1) | US8160280B2 (de) |
EP (1) | EP1782658B1 (de) |
JP (1) | JP4745392B2 (de) |
CN (1) | CN101223819B (de) |
AT (1) | ATE386414T1 (de) |
DE (2) | DE102005033238A1 (de) |
WO (1) | WO2007009599A1 (de) |
Families Citing this family (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4107300B2 (ja) * | 2005-03-10 | 2008-06-25 | ヤマハ株式会社 | サラウンドシステム |
DE102005033239A1 (de) * | 2005-07-15 | 2007-01-25 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Vorrichtung und Verfahren zum Steuern einer Mehrzahl von Lautsprechern mittels einer graphischen Benutzerschnittstelle |
US8509454B2 (en) * | 2007-11-01 | 2013-08-13 | Nokia Corporation | Focusing on a portion of an audio scene for an audio signal |
EP2161950B1 (de) * | 2008-09-08 | 2019-01-23 | Harman Becker Gépkocsirendszer Gyártó Korlátolt Felelösségü Társaság | Konfigurierung eines Schallfeldes |
EP2438770A1 (de) * | 2009-06-03 | 2012-04-11 | Koninklijke Philips Electronics N.V. | Bestimmung von lautsprecherpositionen |
JP5439602B2 (ja) | 2009-11-04 | 2014-03-12 | フラウンホーファー−ゲゼルシャフト・ツール・フェルデルング・デル・アンゲヴァンテン・フォルシュング・アインゲトラーゲネル・フェライン | 仮想音源に関連するオーディオ信号についてスピーカ設備のスピーカの駆動係数を計算する装置および方法 |
CN102142256B (zh) * | 2010-08-06 | 2012-08-01 | 华为技术有限公司 | 淡入时间的计算方法和装置 |
KR102185941B1 (ko) | 2011-07-01 | 2020-12-03 | 돌비 레버러토리즈 라이쎈싱 코오포레이션 | 적응형 오디오 신호 생성, 코딩 및 렌더링을 위한 시스템 및 방법 |
US20130039527A1 (en) * | 2011-08-08 | 2013-02-14 | Bang & Olufsen A/S | Modular, configurable speaker and a method of operating it |
US8553722B2 (en) * | 2011-12-14 | 2013-10-08 | Symboll Technologies, Inc. | Method and apparatus for providing spatially selectable communications using deconstructed and delayed data streams |
EP2829048B1 (de) | 2012-03-23 | 2017-12-27 | Dolby Laboratories Licensing Corporation | Platzierung von tonsignalen in einer 2d oder 3d-audiokonferenz |
EP2829051B1 (de) | 2012-03-23 | 2019-07-17 | Dolby Laboratories Licensing Corporation | Platzierung von sprechern in einer 2d- oder 3d- konferenzszene |
US9445174B2 (en) * | 2012-06-14 | 2016-09-13 | Nokia Technologies Oy | Audio capture apparatus |
EP2770635A1 (de) * | 2013-02-25 | 2014-08-27 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Entzerrungsfilterkoeffizientdeterminator, Vorrichtung, Entzerrungsfilterkoeffizientprozessor, System und Verfahren |
EP2997743B1 (de) * | 2013-05-16 | 2019-07-10 | Koninklijke Philips N.V. | Audiovorrichtung und verfahren dafür |
ES2833424T3 (es) | 2014-05-13 | 2021-06-15 | Fraunhofer Ges Forschung | Aparato y método para panoramización de amplitud de atenuación de bordes |
EP3342040B1 (de) | 2015-08-24 | 2019-12-18 | Dolby Laboratories Licensing Corporation | Volumennivellierungsverarbeitung |
US11310586B2 (en) * | 2018-10-15 | 2022-04-19 | Harman International Industries, Incorporated | Nonlinear port parameters for vented box modeling of loudspeakers |
JP7456106B2 (ja) * | 2019-09-19 | 2024-03-27 | ソニーグループ株式会社 | 信号処理装置、信号処理方法および信号処理システム |
Family Cites Families (48)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE2605056C2 (de) | 1975-03-13 | 1991-11-28 | Deutsche Post Rundfunk- und Fernsehtechnisches Zentralamt, DDR 1199 Berlin | Verfahren und Anordnung zur richtungsgetreuen elektro-akustischen Schallübertragung |
DD145985A1 (de) | 1979-10-05 | 1981-01-14 | Frank Steffen | Anordnung zur oertlich veraenderli hen signalverteilung ueber eine grosslautsprecheranlage |
DD242954A3 (de) * | 1983-12-14 | 1987-02-18 | Deutsche Post Rfz | Grossraumbeschallungssystem |
US4893342A (en) * | 1987-10-15 | 1990-01-09 | Cooper Duane H | Head diffraction compensated stereo system |
DD292805A5 (de) | 1988-12-22 | 1991-08-08 | Wolfgang Ahnert | Verfahren und anordnung fuer eine oertlich sowie zeitlich veraenderliche signalverteilung ueber eine grossbeschallungsanlage, insbesondere fuer audiovisuelle veranstaltungen in auditorien, vorzugsweise kuppelfoermigen raeumen |
JP2983122B2 (ja) * | 1993-03-31 | 1999-11-29 | 株式会社河合楽器製作所 | 電子楽器 |
JPH06285258A (ja) * | 1993-03-31 | 1994-10-11 | Victor Co Of Japan Ltd | ビデオゲーム機 |
JPH0749694A (ja) * | 1993-08-04 | 1995-02-21 | Roland Corp | 残響音発生装置 |
GB9324240D0 (en) * | 1993-11-25 | 1994-01-12 | Central Research Lab Ltd | Method and apparatus for processing a bonaural pair of signals |
JP3288520B2 (ja) * | 1994-02-17 | 2002-06-04 | 松下電器産業株式会社 | 音像位置の上下方向への制御方法 |
EP0762804B1 (de) * | 1995-09-08 | 2008-11-05 | Fujitsu Limited | Dreidimensionaler akustischer Prozessor mit Anwendung von linearen prädiktiven Koeffizienten |
KR0185021B1 (ko) * | 1996-11-20 | 1999-04-15 | 한국전기통신공사 | 다채널 음향시스템의 자동 조절장치 및 그 방법 |
JP4037500B2 (ja) * | 1997-12-17 | 2008-01-23 | ローランド株式会社 | 立体音再生装置 |
GB2343347B (en) * | 1998-06-20 | 2002-12-31 | Central Research Lab Ltd | A method of synthesising an audio signal |
JP2000197198A (ja) * | 1998-12-25 | 2000-07-14 | Matsushita Electric Ind Co Ltd | 音像移動装置 |
US6507658B1 (en) * | 1999-01-27 | 2003-01-14 | Kind Of Loud Technologies, Llc | Surround sound panner |
AUPQ942400A0 (en) * | 2000-08-15 | 2000-09-07 | Lake Technology Limited | Cinema audio processing system |
US7483540B2 (en) * | 2002-03-25 | 2009-01-27 | Bose Corporation | Automatic audio system equalizing |
JP4540290B2 (ja) * | 2002-07-16 | 2010-09-08 | 株式会社アーニス・サウンド・テクノロジーズ | 入力信号を音像定位させて三次元空間を移動させる方法 |
JP4357218B2 (ja) * | 2002-09-27 | 2009-11-04 | 新日本無線株式会社 | ヘッドホン再生方法及び装置 |
KR101014404B1 (ko) * | 2002-11-15 | 2011-02-15 | 소니 주식회사 | 오디오신호의 처리방법 및 처리장치 |
US7706544B2 (en) * | 2002-11-21 | 2010-04-27 | Fraunhofer-Geselleschaft Zur Forderung Der Angewandten Forschung E.V. | Audio reproduction system and method for reproducing an audio signal |
EP2840727B1 (de) * | 2002-12-24 | 2021-03-17 | Yamaha Corporation | Bedienungstafelstruktur und Steuerverfahren und Steuervorrichtung für Mischsystem |
US7336793B2 (en) * | 2003-05-08 | 2008-02-26 | Harman International Industries, Incorporated | Loudspeaker system for virtual sound synthesis |
DE10321986B4 (de) * | 2003-05-15 | 2005-07-14 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Vorrichtung und Verfahren zum Pegel-Korrigieren in einem Wellenfeldsynthesesystem |
DE10321980B4 (de) * | 2003-05-15 | 2005-10-06 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Vorrichtung und Verfahren zum Berechnen eines diskreten Werts einer Komponente in einem Lautsprechersignal |
CN1472986A (zh) * | 2003-06-02 | 2004-02-04 | 陈健俊 | 3d8立体声扩声系统 |
DE10328335B4 (de) * | 2003-06-24 | 2005-07-21 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Wellenfeldsyntesevorrichtung und Verfahren zum Treiben eines Arrays von Lautsprechern |
JP2005080079A (ja) * | 2003-09-02 | 2005-03-24 | Sony Corp | 音声再生装置及び音声再生方法 |
JP4254502B2 (ja) * | 2003-11-21 | 2009-04-15 | ヤマハ株式会社 | アレースピーカ装置 |
DE10355146A1 (de) * | 2003-11-26 | 2005-07-07 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Vorrichtung und Verfahren zum Erzeugen eines Tieftonkanals |
CN1592492A (zh) * | 2004-03-26 | 2005-03-09 | 陈健俊 | 立体声扩声和播放(重放)系统 |
JP2006086921A (ja) * | 2004-09-17 | 2006-03-30 | Sony Corp | オーディオ信号の再生方法およびその再生装置 |
JP4625671B2 (ja) * | 2004-10-12 | 2011-02-02 | ソニー株式会社 | オーディオ信号の再生方法およびその再生装置 |
JP2006115396A (ja) * | 2004-10-18 | 2006-04-27 | Sony Corp | オーディオ信号の再生方法およびその再生装置 |
DE102004057500B3 (de) * | 2004-11-29 | 2006-06-14 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Vorrichtung und Verfahren zur Ansteuerung einer Beschallungsanlage und Beschallungsanlage |
DE102005008369A1 (de) * | 2005-02-23 | 2006-09-07 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Vorrichtung und Verfahren zum Simulieren eines Wellenfeldsynthese-Systems |
DE102005033239A1 (de) * | 2005-07-15 | 2007-01-25 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Vorrichtung und Verfahren zum Steuern einer Mehrzahl von Lautsprechern mittels einer graphischen Benutzerschnittstelle |
DE102005057406A1 (de) * | 2005-11-30 | 2007-06-06 | Valenzuela, Carlos Alberto, Dr.-Ing. | Verfahren zur Aufnahme einer Tonquelle mit zeitlich variabler Richtcharakteristik und zur Wiedergabe sowie System zur Durchführung des Verfahrens |
DE102006010212A1 (de) * | 2006-03-06 | 2007-09-20 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Vorrichtung und Verfahren zur Simulation von WFS-Systemen und Kompensation von klangbeeinflussenden WFS-Eigenschaften |
EP1858296A1 (de) * | 2006-05-17 | 2007-11-21 | SonicEmotion AG | Verfahren und System zur Erzeugung eines binauralen Eindrucks mittels Lautsprecher |
US20080298610A1 (en) * | 2007-05-30 | 2008-12-04 | Nokia Corporation | Parameter Space Re-Panning for Spatial Audio |
KR101292206B1 (ko) * | 2007-10-01 | 2013-08-01 | 삼성전자주식회사 | 어레이 스피커 시스템 및 그 구현 방법 |
US8509454B2 (en) * | 2007-11-01 | 2013-08-13 | Nokia Corporation | Focusing on a portion of an audio scene for an audio signal |
US8213637B2 (en) * | 2009-05-28 | 2012-07-03 | Dirac Research Ab | Sound field control in multiple listening regions |
US8571192B2 (en) * | 2009-06-30 | 2013-10-29 | Alcatel Lucent | Method and apparatus for improved matching of auditory space to visual space in video teleconferencing applications using window-based displays |
US20100328419A1 (en) * | 2009-06-30 | 2010-12-30 | Walter Etter | Method and apparatus for improved matching of auditory space to visual space in video viewing applications |
EP2309781A3 (de) * | 2009-09-23 | 2013-12-18 | Iosono GmbH | Vorrichtung und Verfahren zur Berechnung der Filterkoeffizienten für vordefinierte Lautsprecheranordnung |
-
2005
- 2005-07-15 DE DE102005033238A patent/DE102005033238A1/de not_active Ceased
-
2006
- 2006-07-05 US US11/995,153 patent/US8160280B2/en not_active Expired - Fee Related
- 2006-07-05 DE DE502006000344T patent/DE502006000344D1/de active Active
- 2006-07-05 JP JP2008520759A patent/JP4745392B2/ja not_active Expired - Fee Related
- 2006-07-05 AT AT06791532T patent/ATE386414T1/de active
- 2006-07-05 EP EP06791532A patent/EP1782658B1/de not_active Not-in-force
- 2006-07-05 CN CN200680025936.3A patent/CN101223819B/zh not_active Expired - Fee Related
- 2006-07-05 WO PCT/EP2006/006569 patent/WO2007009599A1/de active Application Filing
Non-Patent Citations (1)
Title |
---|
See references of WO2007009599A1 * |
Also Published As
Publication number | Publication date |
---|---|
WO2007009599A1 (de) | 2007-01-25 |
CN101223819B (zh) | 2011-08-17 |
US20080219484A1 (en) | 2008-09-11 |
DE502006000344D1 (de) | 2008-03-27 |
US8160280B2 (en) | 2012-04-17 |
EP1782658B1 (de) | 2008-02-13 |
CN101223819A (zh) | 2008-07-16 |
DE102005033238A1 (de) | 2007-01-25 |
JP4745392B2 (ja) | 2011-08-10 |
JP2009501463A (ja) | 2009-01-15 |
ATE386414T1 (de) | 2008-03-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1872620B9 (de) | Vorrichtung und verfahren zum steuern einer mehrzahl von lautsprechern mittels einer graphischen benutzerschnittstelle | |
EP1782658B1 (de) | Vorrichtung und verfahren zum ansteuern einer mehrzahl von lautsprechern mittels eines dsp | |
EP1671516B1 (de) | Vorrichtung und verfahren zum erzeugen eines tieftonkanals | |
EP1800517B1 (de) | Vorrichtung und verfahren zur ansteuerung einer beschallungsanlage und beschallungsanlage | |
DE10254404B4 (de) | Audiowiedergabesystem und Verfahren zum Wiedergeben eines Audiosignals | |
DE10328335B4 (de) | Wellenfeldsyntesevorrichtung und Verfahren zum Treiben eines Arrays von Lautsprechern | |
EP1652405B1 (de) | Vorrichtung und verfahren zum erzeugen, speichern oder bearbeiten einer audiodarstellung einer audioszene | |
EP1525776B1 (de) | Vorrichtung zum pegel-korrigieren in einem wellenfeldsynthesesystem | |
DE102006017791A1 (de) | Wiedergabegerät und Wiedergabeverfahren | |
DE102005008343A1 (de) | Vorrichtung und Verfahren zum Liefern von Daten in einem Multi-Renderer-System | |
DE102006010212A1 (de) | Vorrichtung und Verfahren zur Simulation von WFS-Systemen und Kompensation von klangbeeinflussenden WFS-Eigenschaften | |
DE10321980B4 (de) | Vorrichtung und Verfahren zum Berechnen eines diskreten Werts einer Komponente in einem Lautsprechersignal | |
DE68921899T2 (de) | Räumliches Schallwiedergabesystem. |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20070314 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL BA HR MK YU |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: ROEDER, THOMAS Inventor name: BECKINGER, MICHAEL Inventor name: MELCHIOR, FRANK Inventor name: RODIGAST, RENE Inventor name: DAUSEL, MARTIN Inventor name: STRAUSS, MICHAEL Inventor name: GATZSCHE, GABRIEL Inventor name: DEGUARA, JOACHIM Inventor name: REICHELT, KATRIN |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: GERMAN |
|
REF | Corresponds to: |
Ref document number: 502006000344 Country of ref document: DE Date of ref document: 20080327 Kind code of ref document: P |
|
RIN2 | Information on inventor provided after grant (corrected) |
Inventor name: DAUSEL, MARTIN Inventor name: BECKINGER, MICHAEL Inventor name: RODIGAST, RENE Inventor name: GATZSCHE, GABRIEL Inventor name: REICHELT, KATRIN Inventor name: DEGUARA, JOACHIM Inventor name: STRAUSS, MICHAEL Inventor name: MELCHIOR, FRANK Inventor name: ROEDER, THOMAS |
|
RIN2 | Information on inventor provided after grant (corrected) |
Inventor name: ROEDER, THOMAS Inventor name: REICHELT, KATRIN Inventor name: DAUSEL, MARTIN Inventor name: RODIGAST, RENE Inventor name: STRAUSS, MICHAEL Inventor name: GATZSCHE, GABRIEL Inventor name: DEGUARA, JOACHIM Inventor name: BECKINGER, MICHAEL Inventor name: MELCHIOR, FRANK |
|
RIN2 | Information on inventor provided after grant (corrected) |
Inventor name: RODIGAST, RENE Inventor name: MELCHIOR, FRANK Inventor name: GATZSCHE, GABRIEL Inventor name: DAUSEL, MARTIN Inventor name: DEGUARA, JOACHIM Inventor name: ROEDER, THOMAS Inventor name: STRAUSS, MICHAEL Inventor name: REICHELT, KATRIN Inventor name: BECKINGER, MICHAEL |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080613 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080213 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080524 |
|
NLV1 | Nl: lapsed or annulled due to failure to fulfill the requirements of art. 29p and 29m of the patents act | ||
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080213 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080213 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080213 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FD4D |
|
ET | Fr: translation filed | ||
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080513 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080714 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080213 Ref country code: IE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080213 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080213 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080213 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080213 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080213 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20081114 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080213 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20080731 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080213 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080513 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080213 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080213 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080814 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20080731 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20080705 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080213 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080514 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20100731 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20100731 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 11 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 12 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 13 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20200727 Year of fee payment: 15 Ref country code: GB Payment date: 20200724 Year of fee payment: 15 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: AT Payment date: 20210720 Year of fee payment: 16 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20210721 Year of fee payment: 16 |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20210705 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210705 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210731 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 502006000344 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MM01 Ref document number: 386414 Country of ref document: AT Kind code of ref document: T Effective date: 20220705 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220705 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230201 |
|
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230522 |