EP1851998B1 - Dispositif et procédé pour fournir des données dans un système a dispositifs de rendu multiples - Google Patents

Dispositif et procédé pour fournir des données dans un système a dispositifs de rendu multiples Download PDF

Info

Publication number
EP1851998B1
EP1851998B1 EP06707013A EP06707013A EP1851998B1 EP 1851998 B1 EP1851998 B1 EP 1851998B1 EP 06707013 A EP06707013 A EP 06707013A EP 06707013 A EP06707013 A EP 06707013A EP 1851998 B1 EP1851998 B1 EP 1851998B1
Authority
EP
European Patent Office
Prior art keywords
renderer
source
loudspeaker
active
loudspeakers
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP06707013A
Other languages
German (de)
English (en)
Other versions
EP1851998A1 (fr
Inventor
Katrin Reichelt
Gabriel Gatzsche
Thomas Heimrich
Kai-Uwe Sattler
Sandra Brix
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fraunhofer Gesellschaft zur Forderung der Angewandten Forschung eV
Technische Universitaet Ilmenau
Original Assignee
Fraunhofer Gesellschaft zur Forderung der Angewandten Forschung eV
Technische Universitaet Ilmenau
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fraunhofer Gesellschaft zur Forderung der Angewandten Forschung eV, Technische Universitaet Ilmenau filed Critical Fraunhofer Gesellschaft zur Forderung der Angewandten Forschung eV
Publication of EP1851998A1 publication Critical patent/EP1851998A1/fr
Application granted granted Critical
Publication of EP1851998B1 publication Critical patent/EP1851998B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/13—Application of wave-field synthesis in stereophonic audio systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S3/00—Systems employing more than two channels, e.g. quadraphonic
    • H04S3/002—Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution

Definitions

  • the present invention relates to wave-field synthesis concepts, and more particularly to efficient wave-field synthesis concept in conjunction with a multi-renderer system.
  • WFS Wave Field Synthesis
  • Applied to the acoustics can be simulated by a large number of speakers, which are arranged side by side (a so-called speaker array), any shape of an incoming wavefront.
  • a so-called speaker array any shape of an incoming wavefront.
  • the audio signals of each speaker must be fed with a time delay and amplitude scaling so that the radiated sound fields of each speaker properly overlap.
  • the contribution to each speaker is calculated separately for each source and the resulting signals added together. If the sources to be reproduced are in a room with reflective walls, reflections must also be reproduced as additional sources via the loudspeaker array. The cost of the calculation therefore depends heavily on the number of sound sources, the reflection characteristics of the recording room and the number of speakers.
  • the advantage of this technique is in particular that a natural spatial sound impression over a large area of the playback room is possible.
  • the direction and distance of sound sources are reproduced very accurately.
  • virtual sound sources can even be positioned between the real speaker array and the listener.
  • wavefield synthesis works well for environments whose characteristics are known, irregularities occur when the texture changes, or when wave field synthesis is performed based on environmental conditions that do not match the actual nature of the environment.
  • An environmental condition can be described by the impulse response of the environment.
  • the space compensation using wavefield synthesis would be to first determine the reflection of that wall to determine when a sound signal reflected from the wall will return to the loudspeaker and what amplitude this reflected sound signal will be Has. If the reflection from this wall is undesirable, then with the wave field synthesis it is possible to eliminate the reflection from this wall by impressing the loudspeaker with a signal of opposite amplitude to the reflection signal in addition to the original audio signal, so that the traveling compensating wave is the Extinguished reflection wave, thus, that the reflection from this wall in the environment being considered is eliminated. This can be done by first computing the impulse response of the environment and determining the nature and position of the wall based on the impulse response of that environment, the wall being interpreted as a source of mirrors, that is, a sound source reflecting an incident sound.
  • Wavefield synthesis (WFS or sound field synthesis), as developed at the TU Delft in the late 1980s, represents a holographic approach to sound reproduction. The basis for this is the Kirchhoff-Helmholtz integral. This states that any sound fields within a closed volume can be generated by means of a distribution of monopole and dipole sound sources (loudspeaker arrays) on the surface of this volume.
  • an audio signal that emits a virtual source at a virtual position becomes a synthesis signal for each speaker of the speaker array wherein the synthesis signals are configured in amplitude and phase such that a wave resulting from the superposition of the individual sound waves output by the speakers present in the loudspeaker array corresponds to the wave which would originate from the virtual source at the virtual position, if this virtual source at the virtual location was a real source with a real location.
  • multiple virtual sources exist at different virtual locations.
  • the computation of the synthesis signals is performed for each virtual source at each virtual location, typically resulting in one virtual source in multiple speaker synthesis signals. Seen from a loudspeaker, this loudspeaker thus receives several synthesis signals, which go back to different virtual sources. A superimposition of these sources, which is possible due to the linear superposition principle, then gives the reproduced signal actually emitted by the speaker.
  • the final-rendered and analog-to-digital converted reproduction signals for the individual loudspeakers could be transmitted, for example via two-wire lines, from the wave field synthesis central unit to the individual loudspeakers.
  • the wave field synthesis central unit could always be made only for a special reproduction room or for a reproduction with a fixed number of loudspeakers.
  • the German patent DE 10254404 B4 discloses a system as it is in Fig. 7 is shown.
  • One part is the central wave field synthesis module 10.
  • the other part is composed of individual speaker modules 12a, 12b, 12c, 12d, 12e which are connected to actual physical speakers 14a, 14b, 14c, 14d, 14e as shown in FIG Fig. 1 is shown.
  • the number of speakers 14a-14e in typical applications is in the range above 50 and typically even well above 100. If each loudspeaker is assigned its own loudspeaker module, the corresponding number of loudspeaker modules is also required. Depending on the application, however, it is preferred to address a small group of adjacent loudspeakers from a loudspeaker module.
  • a loudspeaker module connected to four loudspeakers for example, feeds the four loudspeakers with the same playback signal, or whether corresponding different synthesis signals are calculated for the four loudspeakers, so that such a loudspeaker module is actually off consists of several individual speaker modules, but which are physically combined in one unit.
  • each transmission link 16a-16e being coupled to the central wave field synthesis module and to a separate loudspeaker module.
  • a serial transmission format that provides a high data rate such as a so-called Firewire transmission format or a USB data format.
  • Data transfer rates in excess of 100 megabits per second are advantageous.
  • the data stream which is transmitted from the wave field synthesis module 10 to a loudspeaker module is thus correspondingly formatted according to the selected data format in the wave field synthesis module and provided with synchronization information which is provided in conventional serial data formats.
  • This synchronization information is extracted from the data stream by the individual loudspeaker modules and used to synchronize the individual loudspeaker modules with respect to their reproduction, that is, ultimately to the analog-to-digital conversion for obtaining the analog loudspeaker signal and the purpose of resampling.
  • the central wave-field synthesis module works as a master and all loudspeaker modules operate as clients, with the individual data streams across the different links 16a-16e all receiving the same synchronization information from the central module 10.
  • the rendering still determines the total capacity of the system. Is the central rendering unit therefore z.
  • the central rendering unit therefore z. For example, if it is able to render 32 virtual sources simultaneously, ie to compute the synthesis signals for these 32 virtual sources simultaneously, then serious capacity bottlenecks will occur if more than 32 sources are active at a time in an audio scene. This is sufficient for simple scenes. For more complex scenes, in particular with immersive sound impressions, ie when it rains and many raindrops are single sources, it is immediately obvious that the capacity with a maximum of 32 sources is no longer sufficient. A similar situation also occurs when you have a large orchestra and in fact want to process every orchestra player or at least each group of instruments as their own source in their own position. Here, 32 virtual sources can quickly become too little.
  • the object of the present invention is to provide a more efficient wave field synthesis concept.
  • the present invention is based on the finding that an efficient data processing concept for wave field synthesis is achieved by moving away from the central renderer approach and instead using a plurality of rendering units which, unlike a central rendering unit, do not now use the respective rendering units have to bear full processing load, but are controlled intelligently.
  • each renderer module in a multi-renderer system has only a limited allocated number of speakers that need to be serviced.
  • it is determined by a central data output device before rendering whether the loudspeakers associated with a renderer module are actually active for this virtual source.
  • this is already detected before the rendering, and only data is sent to the renderers that they actually need, ie the output side Have speakers that should represent the virtual source.
  • the amount of data transmission compared to the prior art is reduced because no more synthesis signals must be transmitted to speaker modules, but only a file for an audio object, from which only then decentralized the synthesis signals for each (many) speakers are derived.
  • the capacity of a system can be increased without problems that several renderer modules are used intelligently, it has been found that the provision of z.
  • two 32-source renderer modules can be implemented much less expensively and with less delay than if a 64-renderer module were developed centrally.
  • the renderer drive can be made adaptive to catch even larger transmission spikes.
  • a renderer module is not automatically addressed if at least one loudspeaker associated with that renderer module is active. Instead, a minimum threshold of active speakers is specified for a renderer, from which a renderer is first supplied with the audio file of a virtual source. This minimum number depends on the load of this renderer.
  • the data output device will only then control the already heavily loaded renderer with another virtual source, if for this further virtual source a number of loudspeakers is to be active which is above the variable minimum threshold.
  • This approach is based on introducing errors by omitting the rendering of a virtual source by a renderer, but due to the fact that this virtual source employs only a few speakers of the renderer, this introduced error is not so problematic in comparison to a situation where, if the renderer is busy with a relatively unimportant source, then a major source coming later would have to be completely rejected.
  • Fig. 1 shows an apparatus for providing data for wave field synthesis processing in a wave field synthesis system having a plurality of renderer modules connectable to outputs 20a, 20b, 20c.
  • Each renderer module has at least one speaker associated with it.
  • systems with typically more than 100 loudspeakers are used in total, so that a renderer module should be associated with at least 50 individual loudspeakers that can be attached at different positions in a display room as a loudspeaker array for the renderer module.
  • the apparatus according to the invention further comprises means for providing a plurality of audio files, indicated at 22 in FIG Fig. 1 is designated.
  • the device 22 is formed as a database for providing the audio files for virtual sources at different source positions.
  • the device according to the invention comprises a data output device 24 for selectively supplying the audio files to the renderers.
  • the data output device 24 is designed to supply the audio files to a renderer at most only if the renderer is assigned a loudspeaker which is to be active for a reproduction of a virtual position, while the data output device is also designed to be a other renderers will not deliver the audio if all speakers associated with the renderer are to be inactive to play the source.
  • a renderer may not receive an audio file even though it has a few active loudspeakers, but the number of active loudspeakers compared to the total number of active loudspeakers Speaker for this renderer is below a minimum threshold.
  • the inventive apparatus preferably further comprises a data manager 26 adapted to determine whether or not to render active a virtual source of the at least one speaker associated with a renderer. Depending on this, the data manager 26 drives the data output device 24 to distribute the audio files to the individual renderers or not. In one embodiment, the data manager 26 will effectively provide the control signal to a multiplexer in the data output device 24 such that the audio file is switched through to one or more outputs, but typically not all outputs 20a-20c.
  • the present invention is thus based on an object-oriented approach, that is to say that the individual virtual sources are understood as objects which are distinguished by an audio file and a virtual position in space and possibly by the manner of the source, So whether it should be a point source for sound waves or a source for plane waves or a source for differently shaped sources.
  • the calculation of the wave fields is very computationally intensive and tied to the capacities of the hardware used, such as sound cards and computers, in conjunction with the efficiency of the calculation algorithms. Even the best-equipped PC-based solution thus quickly reaches its limits in the calculation of wave field synthesis, when many sophisticated sound events are to be displayed simultaneously. Thus, the capacity limit of the software and hardware used dictates the limitation on the number of virtual sources in the mixdown and playback.
  • Fig. 6 shows such a limited in its known wave field synthesis concept that includes an authoring tool 60, a control renderer module 62, and an audio server 64, wherein the control renderer module is configured to provide a speaker array 66 with data for the speaker array 66 to generate a desired wavefront 68 by superimposing the single waves of the individual loudspeakers 70.
  • the authoring tool 60 allows the user to create scenes, edit and control the wave field synthesis based system.
  • a scene consists of information about the individual virtual audio sources as well as the audio data.
  • the properties of the audio sources and the references to the audio data are stored in an XML scene file.
  • the audio data itself is stored on the audio server 64 and transmitted from there to the renderer module.
  • the renderer module receives the control data from the authoring tool so that the control renderer module 62, which is centrally executed, can generate the synthesis signals for the individual loudspeakers.
  • This in Fig. 6 The concept shown in "Authoring System for Wave Field Synthesis", F. Melchior, T. Röder, S. Brix, S. Wabnik and C. Riegel, AES Convention Paper, 115th AES Assembly, October 10, 2003, New York.
  • each renderer is supplied with the same audio data, regardless of whether the renderer needs this data for playback or not because of the limited number of speakers assigned to it. Since each of the current computers is capable of calculating 32 audio sources, this is the limit for the system. On the other hand, the number of renderable sources in the overall system should be significantly increased efficiently. This is one of the essential requirements for complex applications, such as movies, scenes with immersive atmospheres, such as rain or applause or other complex audio scenes.
  • a reduction of redundant data transfer operations and data processing operations in a wave field synthesis multi-renderer system is achieved, which leads to an increase in the computing capacity or the number of simultaneously computable audio sources.
  • the audio server is extended by the data output device, which is able to determine which renderer needs which audio and metadata.
  • the data output device possibly supported by the data manager, requires a plurality of information in a preferred embodiment. This information is initially the audio data, then the source and position data of the sources, and finally the configuration of the renderers, that is, information about the connected speakers and their positions and their capacity.
  • an output schedule by the data output device with a temporal and spatial Arrangement of the audio objects generated. From the spatial arrangement, the time schedule and the renderer configuration, the data management module then calculates which source is relevant for which renderer at a particular time.
  • FIG. 5 A preferred overall concept is in Fig. 5 shown.
  • the database 22 is supplemented on the output side by the data output device 24, wherein the data output device is also referred to as a scheduler.
  • This scheduler then generates at its outputs 20a, 20b, 20c for the various renderers 50 the renderer input signals in order to power the corresponding loudspeakers of the loudspeaker arrays.
  • the scheduler 24 is still supported by a storage manager 52 in order to configure the database 22 by means of a RAID system and corresponding data organization specifications.
  • a data generator 54 On the input side is a data generator 54, which may be, for example, a sound engineer or an audio engineer who is to model or describe an audio scene in an object-oriented manner. In this case, he provides a scene description that includes corresponding output conditions 56, which are then optionally stored in the database 22 together with audio data after a transformation 58.
  • the audio data may be manipulated and updated using an insert / update tool 59.
  • FIG. 2 shows an exemplary reproduction room 50 with a reference point 52 which in a preferred embodiment of the present invention lies in the center of the playback room 50.
  • the reference point can also be arranged at any other arbitrary position of the playback room, ie z. B. in the front third or in the back third.
  • each loudspeaker array is coupled to its own renderer R1 54a, R2 54b, R3 54c and R4 54d.
  • Each renderer is connected to its loudspeaker array via a renderer loudspeaker array connection line 55a, 55b, 55c and 55d, respectively.
  • each renderer is connected to an output 20a, 20b, 20c, and 20d of the data output device 24, respectively.
  • the data output device receives on the input side, ie via its input IN, the corresponding audio files and control signals from a preferably provided data manager 26 (FIG. Fig. 1 ), which indicate whether or not a renderer should receive an audio file, ie whether speakers assigned to a renderer should be active or not.
  • the speakers of the speaker array 53a are associated with the renderer 54a, for example, but not the renderer 54d.
  • the renderer 54d has, as associated speakers, the speakers of the speaker array 53d as it is Fig. 2 is apparent.
  • the data traffic is limited.
  • the information about the virtual sources includes at least the source position and time information about the source, ie when the source starts, how long it lasts and / or when it is over.
  • further information relating to the type of virtual source is also transmitted, that is, whether the virtual source should be a point source or a source of plane waves or a source of otherwise "shaped" sound waves.
  • the renderers may also be provided with information about an acoustics of the playback room 50, information about actual properties of the loudspeakers in the loudspeaker arrays, etc. This information does not necessarily have to be transmitted over the lines 20a-20d, but may also be supplied to the renderers R1-R4 in some other way, so that they can calculate synthesis signals tailored to the reproduction room, which are then fed to the individual loudspeakers.
  • the synthesis signals computed by the individual speaker renderers are already superimposed synthesis signals when multiple virtual sources have been rendered simultaneously by a renderer since each virtual source results in a synthesis signal for a speaker of an array being, being the final speaker signal is then obtained after the superimposition of the synthesis signals of the individual virtual sources by adding the individual synthesis signals.
  • the preferred embodiment shown further includes utilization determination means 56 for, in response to a current actual renderer load or an estimated future renderer utilization, to post-process the driving of a renderer with an audio file.
  • each renderer 54a, 54b, 54c and 54d is limited.
  • each of these renderers is capable of processing a maximum of 32 audio sources, and the utilization determiner 56 determines that, e.g. B. the renderer R1 already z. For example, if 30 sources are rendered, then there is a problem that when two more virtual sources are to be rendered in addition to the other 30 sources, the capacity limit of the renderer 54a is reached.
  • the basic rule is that the renderer 54a will always receive an audio file when it is determined that at least one speaker is to be active for rendering a virtual source.
  • the case may arise that it is determined that only a small portion of the speakers in the loudspeaker array 53a are active for a virtual source, such as only 10% of all loudspeakers associated with the loudspeaker array.
  • the utilization determiner 56 would decide that this renderer is not being serviced with the audio file intended for that virtual source. This will introduce an error.
  • the error is not particularly serious since it is assumed that this virtual source is additionally rendered by adjacent arrays, probably with a much larger one for these arrays Number of speakers.
  • Fig. 3a a preferred embodiment of the data manager 26 of Fig. 1 which is configured to determine whether loudspeakers associated with an array should be active or not depending on a particular virtual position.
  • the data manager operates without complete rendering, but rather determines the active / non-active speakers and hence the active or inactive renderers without computing synthesis signals, but solely based on the source locations of the virtual sources and the position of the speakers Position of the speakers in an array-like design are already determined by the renderer identification, due to the renderer identification.
  • FIG. 3a various source positions Q1-Q9 are plotted, while in Fig. 3b in tabular form, which renderer A1-A4 is active for a certain source position Q1-Q9 (A) or is not active (NA) or z. B. is active or non-active depending on the current load.
  • the source position Q1 For example, if the source position Q1 is considered, it can be seen that this source position with respect to the observation point BP is behind the front loudspeaker array 53a. The listener at the observation point would like to experience the source at the source position Q1 in such a way that the Sound comes in a sense "from scratch". Therefore, due to the virtual source at the source position Q1, the loudspeaker arrays A2, A3, and A4 do not have to emit sound signals so that they are non-active (NA) as shown in the corresponding column in FIG Fig. 3b is drawn. Accordingly, for the other arrays, the situation is for sources Q2, Q3 and Q4.
  • NA non-active
  • the source Q5 is offset in both the x-direction and the y-direction with respect to the observation point. For this reason, both the array 53a and the array 53b are needed for the accurate reproduction of the source at the source position Q5, but not the arrays 53c and 53d.
  • the situation is for the source Q6, the source Q1 and, if there are no utilization problems, the source Q9. It is irrelevant whether, as can be seen, for example, by comparing the sources Q6 and Q5, there is a source behind an array (Q6) or in front of the array (Q5).
  • the source Q9 is located just short of the direct connection line between the reference point and the first array 53a. If the source Q9 were reproduced only by the array 53a, the observer at the reference point would experience the source Q9 on the connection line rather than just offset. This "tight offset" causes only a few loudspeakers to be active in the loudspeaker array 53b, or the loudspeakers to emit only signals of very low energy.
  • the data manager 26 will thus be configured to designate a speaker in an array as active if the source position is between the reference point and the speaker or the speaker is between the source position and the reference point.
  • the first situation is shown for the source Q5, while the second situation for the source Q1 is shown, for example.
  • Fig. 4 shows a further preferred embodiment for the determination of active or non-active speakers.
  • the source position 70 is the first source position and the source position 71 is the second source position (Q2).
  • a speaker array A1 having speakers having a main emission direction (HER), which is shown in FIG Fig. 4 shown embodiment is directed vertically away from an elongated extent of the array, as indicated by emission direction arrows 72.
  • HER main emission direction
  • a table is provided which receives on the input side a source position in a coordinate system related to the reference point and provides on the output side for each loudspeaker array an indication as to whether this loudspeaker array should be active for the current source position or not. This can be achieved by a simple and quick table lookup a very efficient and low-cost implementation of the data manager 26 and the data output device 24.
  • inventive concept will already lead to a significant improvement, if in one Play room z. B. only two speaker arrays are present, such as the two speaker arrays 53b and 53d of Fig. 2 ,
  • inventive concept is also applicable to differently shaped arrays, such as for hexagonal arrays, or for arrays that are not linear or planar, but that are curved, for example.
  • the method according to the invention can be implemented in hardware or in software.
  • the implementation may be on a digital storage medium, particularly a floppy disk or CD, with electronically readable control signals that may interact with a programmable computer system to perform the method.
  • the invention thus also consists in a computer program product with a program code stored on a machine-readable carrier for carrying out the method when the computer program product runs on a computer.
  • the invention can thus be realized as a computer program with a program code for carrying out the method when the computer program runs on a computer.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Stereophonic System (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Communication Control (AREA)

Claims (15)

  1. Dispositif pour fournir des données pour la préparation de synthèse de champ d'onde dans un système de synthèse de champ d'onde avec une pluralité de modules de rendu (53a à 53d), à chaque module de rendu étant associé un haut-parleur (70) et les haut-parleurs attribués aux modules de rendu pouvant être placés à des positions différentes dans une salle de reproduction (50), aux caractéristiques suivantes:
    un moyen (22) pour fournir une pluralité de fichiers audio, à chaque fichier audio étant associée une source virtuelle en une position de la source (Q1),
    caractérisé par un moyen de sortie de données (24) pour fournir le fichier audio à un dispositif de rendu auquel est associé un haut-parleur qui doit être actif pour la reproduction de la source virtuelle, le moyen de sortie de données (24) étant par ailleurs réalisé pour ne pas fournir le fichier audio à un autre module de rendu lorsque les haut-parleurs associés à l'autre dispositif de rendu ne doivent pas être actifs pour la reproduction de la source.
  2. Dispositif selon la revendication 1, présentant par ailleurs la caractéristique suivante:
    un gestionnaire de données (26) pour déterminer si l'au moins un haut-parleur associé à un module de rendu doit être actif ou non pour la reproduction de la source virtuelle, le gestionnaire de données (26) étant réalisé pour effectuer la détermination sur base de la position de source (Q1) et d'une position de haut-parleur ou d'une identification de dispositif de rendu.
  3. Dispositif selon la revendication 2, dans lequel la salle de reproduction (50) présente un point de référence (52), le gestionnaire de données (26) étant réalisé
    pour déterminer qu'un haut-parleur est actif lorsque la position de source (Q5) se trouve entre le point de référence (52) et haut-parleur (53a) ou lorsque le haut-parleur (53a) se trouve entre la position de source (Q1) et le point de référence (52).
  4. Dispositif selon la revendication 2, dans lequel le gestionnaire de données (26) est réalisé pour déterminer qu'un haut-parleur est actif lorsqu'un angle entre une première ligne (73) de la position de source (Q1) au point de référence (52) et une deuxième ligne du haut-parleur au point de référence (52) est compris entre 0° et 90°.
  5. Dispositif selon l'une des revendication 2 à 4, dans lequel le gestionnaire de données (26) est réalisé pour déterminer qu'un haut-parleur est non actif lorsqu'une ligne de connexion de la position de source au point de référence ne présente pas de composante de direction parallèle à la direction d'émission de son principale (72) du haut-parleur.
  6. Dispositif selon l'une des revendications précédentes, dans lequel plusieurs haut-parleurs sont associés à un module de rendu (53a à 53d) et dans lequel le moyen de sortie de données (24) est réalisé pour ne fournir des fichiers audio au dispositif de rendu que lorsqu'il est déterminé que plus de 10% des haut-parleurs associés au module de rendu sont actifs ou que les haut-parleurs associés au module de rendu fourniraient pour une source virtuelle un signal de synthèse qui est supérieur à un seuil minimum.
  7. Dispositif selon l'une des revendications 1 à 5, dans lequel plusieurs haut-parleurs sont associés à un module de rendu et dans lequel le fichier audio n'est fourni au module de rendu que lorsqu'il est déterminé qu'au moins un haut-parleur associé au dispositif de rendu est actif.
  8. Dispositif selon l'une des revendications 1 à 5, dans lequel chaque module de rendu a une capacité de traitement maximale et dans lequel le moyen de sortie de données (24) est réalisé pour ne fournir un fichier audio à un module de rendu que lorsqu'il est déterminé qu'une part minimale des haut-parleurs associés au module de rendu sont actifs, la part minimale étant variable et étant fonction de la charge du module de rendu pouvant être déterminée par un moyen de détermination de charge (56).
  9. Dispositif selon la revendication 8, dans lequel le moyen de sortie de données (24) est réalisé pour augmenter une part minimale lorsque la charge déterminée par le moyen de détermination de charge (56) augmente.
  10. Dispositif selon la revendication 8 ou 9, dans lequel le moyen de détermination de charge (56) est réalisé pour déterminer une charge actuelle ou future estimée.
  11. Dispositif selon l'une des revendications précédentes, dans lequel le moyen de sortie de données (24) présente un tableau de consultation qui est réalisé pour recevoir comme grandeur d'entrée une position de source, et qui est réalisé pour fournir comme grandeur de sortie pour les modules de rendu une information de si un module de rendu doit être actif ou non pour la position de source entrée du côté de l'entrée.
  12. Dispositif selon l'une des revendications précédentes, dans lequel le moyen de sortie de données (24) est réalisé pour fournir à un module de rendu auquel est associé un haut-parleur actif le fichier audio pour une source virtuelle, une position de source pour la source virtuelle et les informations sur le début, la fin et/ou la durée de la source virtuelle dans une scène audio.
  13. Dispositif selon l'une des revendications précédentes, dans lequel le moyen de sortie de données (24) est réalisé pour fournir à un module de rendu par ailleurs des informations sur un type de la source virtuelle, c'est-à-dire si la source virtuelle est une source ponctuelle, une source pour des ondes planes ou une source pour des ondes d'une autre forme.
  14. Procédé pour fournir des données pour la préparation de synthèse de champ d'onde dans un système de synthèse de champ d'onde avec une pluralité de modules de rendu (53a à 53d), dans lequel au moins un haut-parleur (70) est associé à chaque module de rendu et dans lequel les haut-parleurs attribués aux dispositifs de rendu peuvent être placés à des positions différentes dans une salle de reproduction (50), aux étapes suivantes consistant à:
    fournir (22) une pluralité de fichiers audio, à un fichier audio étant associée une source virtuelle à une position de source (Q1);
    caractérisé par
    fournir (24) le fichier audio à un dispositif de rendu associé à un haut-parleur devant être actif pour la reproduction de la source virtuelle, le fichier audio n'étant pas fourni à un autre module de rendu lorsque les haut-parleurs associés à l'autre dispositif de rendu ne doivent pas être actifs pour la reproduction de la source.
  15. Programme d'ordinateur avec un code de programme pour réaliser le procédé selon la revendication 14 lorsque le programme d'ordinateur est exécuté sur un ordinateur.
EP06707013A 2005-02-23 2006-02-16 Dispositif et procédé pour fournir des données dans un système a dispositifs de rendu multiples Active EP1851998B1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102005008343A DE102005008343A1 (de) 2005-02-23 2005-02-23 Vorrichtung und Verfahren zum Liefern von Daten in einem Multi-Renderer-System
PCT/EP2006/001412 WO2006089682A1 (fr) 2005-02-23 2006-02-16 Dispositif et procede pour fournir des donnees dans un systeme a dispositifs de rendu multiples

Publications (2)

Publication Number Publication Date
EP1851998A1 EP1851998A1 (fr) 2007-11-07
EP1851998B1 true EP1851998B1 (fr) 2011-05-04

Family

ID=36194016

Family Applications (1)

Application Number Title Priority Date Filing Date
EP06707013A Active EP1851998B1 (fr) 2005-02-23 2006-02-16 Dispositif et procédé pour fournir des données dans un système a dispositifs de rendu multiples

Country Status (6)

Country Link
US (1) US7962231B2 (fr)
EP (1) EP1851998B1 (fr)
CN (2) CN101129090B (fr)
AT (1) ATE508592T1 (fr)
DE (2) DE102005008343A1 (fr)
WO (1) WO2006089682A1 (fr)

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1725009B1 (fr) * 2005-05-12 2009-10-21 IPG Electronics 504 Limited Méthode pour synchroniser au moins un périphérique multimédia d'un appareil de communication portable avec un fichier audio, et appareil de communication portable correspondant
KR101542233B1 (ko) * 2008-11-04 2015-08-05 삼성전자 주식회사 화면음원 정위장치, 화면음원 정위를 위한 스피커 셋 정보 생성방법 및 정위된 화면음원 재생방법
KR101517592B1 (ko) * 2008-11-11 2015-05-04 삼성전자 주식회사 고분해능을 가진 화면음원 위치장치 및 재생방법
EP2663099B1 (fr) * 2009-11-04 2017-09-27 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Appareil et procédé pour fournir des signaux d'entraînement pour lesdits haut-parleurs sur la base d'un signal audio associé à une source virtuelle
US8612003B2 (en) 2010-03-19 2013-12-17 Cardiac Pacemakers, Inc. Feedthrough system for implantable device components
US10158958B2 (en) 2010-03-23 2018-12-18 Dolby Laboratories Licensing Corporation Techniques for localized perceptual audio
CN113490135B (zh) * 2010-03-23 2023-05-30 杜比实验室特许公司 音频再现方法和声音再现系统
KR101843834B1 (ko) 2011-07-01 2018-03-30 돌비 레버러토리즈 라이쎈싱 코오포레이션 향상된 3d 오디오 오서링과 렌더링을 위한 시스템 및 툴들
US9179236B2 (en) * 2011-07-01 2015-11-03 Dolby Laboratories Licensing Corporation System and method for adaptive audio signal generation, coding and rendering
RU2602346C2 (ru) * 2012-08-31 2016-11-20 Долби Лэборетериз Лайсенсинг Корпорейшн Рендеринг отраженного звука для объектно-ориентированной аудиоинформации
KR102160218B1 (ko) * 2013-01-15 2020-09-28 한국전자통신연구원 사운드 바를 위한 오디오 신호 처리 장치 및 방법
TWI530941B (zh) 2013-04-03 2016-04-21 杜比實驗室特許公司 用於基於物件音頻之互動成像的方法與系統
CN110265047B (zh) 2013-04-05 2021-05-18 杜比国际公司 音频信号的解码方法和解码器、介质以及编码方法
US10524165B2 (en) 2017-06-22 2019-12-31 Bank Of America Corporation Dynamic utilization of alternative resources based on token association
US10511692B2 (en) 2017-06-22 2019-12-17 Bank Of America Corporation Data transmission to a networked resource based on contextual information
US10313480B2 (en) 2017-06-22 2019-06-04 Bank Of America Corporation Data transmission between networked resources
EP3997700A1 (fr) 2019-07-09 2022-05-18 Dolby Laboratories Licensing Corporation Matriçage indépendant de la présentation de contenu audio

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07303148A (ja) 1994-05-10 1995-11-14 Nippon Telegr & Teleph Corp <Ntt> 通信会議装置
JPH10211358A (ja) 1997-01-28 1998-08-11 Sega Enterp Ltd ゲーム装置
JPH1127800A (ja) 1997-07-03 1999-01-29 Fujitsu Ltd 立体音響処理システム
JP2000267675A (ja) 1999-03-16 2000-09-29 Sega Enterp Ltd 音響信号処理装置
JP2002199500A (ja) 2000-12-25 2002-07-12 Sony Corp 仮想音像定位処理装置、仮想音像定位処理方法および記録媒体
JP2003284196A (ja) 2002-03-20 2003-10-03 Sony Corp 音像定位信号処理装置および音像定位信号処理方法
DE10215775B4 (de) 2002-04-10 2005-09-29 Institut für Rundfunktechnik GmbH Verfahren zur räumlichen Darstellung von Tonquellen
JP2004007211A (ja) 2002-05-31 2004-01-08 Victor Co Of Japan Ltd 臨場感信号の送受信システム、臨場感信号伝送装置、臨場感信号受信装置、及び臨場感信号受信用プログラム
DE60312553T2 (de) 2002-10-14 2007-11-29 Thomson Licensing Verfahren zum kodieren und dekodieren von der breite einer schallquelle in einer audioszene
AU2003269551A1 (en) 2002-10-15 2004-05-04 Electronics And Telecommunications Research Institute Method for generating and consuming 3d audio scene with extended spatiality of sound source
DE10254404B4 (de) * 2002-11-21 2004-11-18 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audiowiedergabesystem und Verfahren zum Wiedergeben eines Audiosignals
US7706544B2 (en) 2002-11-21 2010-04-27 Fraunhofer-Geselleschaft Zur Forderung Der Angewandten Forschung E.V. Audio reproduction system and method for reproducing an audio signal
AU2003298146B2 (en) 2002-12-02 2009-04-09 Interdigital Ce Patent Holdings Method for describing the composition of audio signals
JP4601905B2 (ja) 2003-02-24 2010-12-22 ソニー株式会社 デジタル信号処理装置およびデジタル信号処理方法
DE10321986B4 (de) 2003-05-15 2005-07-14 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Vorrichtung und Verfahren zum Pegel-Korrigieren in einem Wellenfeldsynthesesystem
DE10321980B4 (de) 2003-05-15 2005-10-06 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Vorrichtung und Verfahren zum Berechnen eines diskreten Werts einer Komponente in einem Lautsprechersignal
DE10328335B4 (de) * 2003-06-24 2005-07-21 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Wellenfeldsyntesevorrichtung und Verfahren zum Treiben eines Arrays von Lautsprechern
DE10344638A1 (de) 2003-08-04 2005-03-10 Fraunhofer Ges Forschung Vorrichtung und Verfahren zum Erzeugen, Speichern oder Bearbeiten einer Audiodarstellung einer Audioszene

Also Published As

Publication number Publication date
US20080019534A1 (en) 2008-01-24
DE502006009435D1 (de) 2011-06-16
ATE508592T1 (de) 2011-05-15
DE102005008343A1 (de) 2006-09-07
CN101129090B (zh) 2012-11-07
WO2006089682A1 (fr) 2006-08-31
CN102118680A (zh) 2011-07-06
US7962231B2 (en) 2011-06-14
CN101129090A (zh) 2008-02-20
EP1851998A1 (fr) 2007-11-07
CN102118680B (zh) 2015-11-25

Similar Documents

Publication Publication Date Title
EP1851998B1 (fr) Dispositif et procédé pour fournir des données dans un système a dispositifs de rendu multiples
EP1844628B1 (fr) Procede et dispositif d&#39;amorçage d&#39;une installation de moteur de rendu de synthese de front d&#39;onde avec objets audio
DE10328335B4 (de) Wellenfeldsyntesevorrichtung und Verfahren zum Treiben eines Arrays von Lautsprechern
EP1844627B1 (fr) Dispositif et procédé pour simuler un système de synthèse de champ d&#39;onde
EP1723825B1 (fr) Dispositif et procede pour reguler un dispositif de rendu de synthese de champ electromagnetique
EP1671516B1 (fr) Procede et dispositif de production d&#39;un canal a frequences basses
EP1872620B1 (fr) Dispositif et procede pour commander une pluralite de haut-parleurs au moyen d&#39;une interface graphique d&#39;utilisateur
EP1782658B1 (fr) Dispositif et procede de commande d&#39;une pluralite de haut-parleurs a l&#39;aide d&#39;un dsp
EP1525776B1 (fr) Dispositif de correction de niveau dans un systeme de synthese de champ d&#39;ondes
DE10254404B4 (de) Audiowiedergabesystem und Verfahren zum Wiedergeben eines Audiosignals
EP1800517A1 (fr) Dispositif et procede de commande d&#39;une installation de sonorisation et installation de sonorisation correspondante
EP1972181B1 (fr) Dispositif et procédé de simulation de systèmes wfs et de compensation de propriétés wfs influençant le son
EP1652405A2 (fr) Dispositif et procede de production, de mise en memoire ou de traitement d&#39;une representation audio d&#39;une scene audio
EP1789970B1 (fr) Procédé et dispositif pour mémoriser des fichiers audio
DE10321980A1 (de) Vorrichtung und Verfahren zum Berechnen eines diskreten Werts einer Komponente in einem Lautsprechersignal

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20070808

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

RIN1 Information on inventor provided before grant (corrected)

Inventor name: GATZSCHE, GABRIEL

Inventor name: HEIMRICH, THOMAS

Inventor name: BRIX, SANDRA

Inventor name: SATTLER, KAI-UWE

Inventor name: REICHELT, KATRIN

DAX Request for extension of the european patent (deleted)
GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RTI1 Title (correction)

Free format text: DEVICE AND METHOD FOR DELIVERING DATA IN A MULTI-RENDERER SYSTEM

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REF Corresponds to:

Ref document number: 502006009435

Country of ref document: DE

Date of ref document: 20110616

Kind code of ref document: P

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502006009435

Country of ref document: DE

Effective date: 20110616

REG Reference to a national code

Ref country code: NL

Ref legal event code: VDEP

Effective date: 20110504

REG Reference to a national code

Ref country code: DE

Ref legal event code: R082

Ref document number: 502006009435

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110504

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110905

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110504

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110504

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110504

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110904

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110815

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110504

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110805

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110504

REG Reference to a national code

Ref country code: IE

Ref legal event code: FD4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110504

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110504

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110504

Ref country code: IE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110504

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110504

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110504

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110504

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110504

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20120207

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110504

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502006009435

Country of ref document: DE

Effective date: 20120207

BERE Be: lapsed

Owner name: FRAUNHOFER-GESELLSCHAFT ZUR FORDERUNG DER ANGEWAN

Effective date: 20120228

Owner name: TU ILMENAU

Effective date: 20120228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120229

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120229

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120229

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120228

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 508592

Country of ref document: AT

Kind code of ref document: T

Effective date: 20120216

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120216

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110804

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110504

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120216

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060216

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 11

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 12

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 13

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230524

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240216

Year of fee payment: 19

Ref country code: GB

Payment date: 20240222

Year of fee payment: 19

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20240222

Year of fee payment: 19