EP1410685A2 - Systeme de traitement du son a canaux multiples - Google Patents

Systeme de traitement du son a canaux multiples

Info

Publication number
EP1410685A2
EP1410685A2 EP00987030A EP00987030A EP1410685A2 EP 1410685 A2 EP1410685 A2 EP 1410685A2 EP 00987030 A EP00987030 A EP 00987030A EP 00987030 A EP00987030 A EP 00987030A EP 1410685 A2 EP1410685 A2 EP 1410685A2
Authority
EP
European Patent Office
Prior art keywords
sound
processing
processing system
binaural
level
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP00987030A
Other languages
German (de)
English (en)
Inventor
Boris Weigend
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from DE19958105A external-priority patent/DE19958105A1/de
Application filed by Individual filed Critical Individual
Publication of EP1410685A2 publication Critical patent/EP1410685A2/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S3/00—Systems employing more than two channels, e.g. quadraphonic
    • H04S3/002—Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S3/00—Systems employing more than two channels, e.g. quadraphonic
    • H04S3/02—Systems employing more than two channels, e.g. quadraphonic of the matrix type, i.e. in which input signals are combined algebraically, e.g. after having been phase shifted with respect to each other

Definitions

  • 3-D audio technology can look back on a long history.
  • the aim of research and development in this area is to make the human ability of spatial hearing technically usable for various fields of application. Due to the ability of spatial, three-dimensional sound perception, humans are able to locate the position of any sound source with an accuracy of approx. 5 degrees.
  • the basis for spatial hearing is a complex coding system, which depending on its spatial position, the sound with an additional rattle provides information that can be specifically evaluated by human consciousness and provides the cognitive system with specific information about the exact position of the sound source.
  • PLATTE In 1975, PLATTE first provided the approach for error-free determination of the outer ear transfer function that flows into the head transfer function. (Arrangement for the exact reproduction of ear signals; progress in acoustics; Physik Verlag Weinheim pp. 361-363).
  • the missing acoustic context is restored by mixing the individual signals (instruments) together and the acoustic environment is created using artificially generated reverberation.
  • studio practice also deals with electrical or electronic instruments such as synthesizers, electric guitars, etc., in which electrical sound conversion by a microphone is not necessary, since such instruments already work electrically or electronically at the level of vibration generation.
  • the standard reproduction of properly prepared, spatial sound material is normally This is done using specially equalized, high-quality headphones to avoid multiplication effects of the head and outer ear transmission function when played through loudspeakers.
  • Another shortcoming of artificial head technology in the creation of sound recording signals is that an artificial head cannot be regarded as a replacement for a conventional microphone.
  • the sound engineer When recording a classic concert, the sound engineer sometimes uses several supporting microphones to emphasize the soloists in addition to the main microphones, which capture the orchestral sound as a whole.
  • the level of the individual microphone signals is regulated and mixed together in order to achieve the tonal result of the recording that is ultimately desired by the sound engineer.
  • artificial head signals cannot be mixed, as the listener would hear from different positions at the same time after mixing.
  • the generation of sound material that has been properly prepared electronically after the sound has been converted by the microphone is therefore a prerequisite for making the artificial head technology usable for use in multi-track recording technology (see GIERLICH, HW and GENUIT, K. "Structure and application of an electronic artificial head ", 13th Tonmeistertagung, Kunststoff 1984, report volume pp. 103-110).
  • Nonlinearities in the frequency and phase response of speakers have an extinction of spectral components This results in a reduction in the accuracy of location when localizing sound sources within the binaural sound material.
  • a sound signal almost never appears as a direct signal. Rather, a sound event consists of a mixture of direct sound and reflected sound in a specific ratio.
  • the broken and reflected sound strikes our hearing from different directions, whereby it is binaurally coded like direct sound.
  • Multi-speaker standards such as "Dolby Digital” have so far not been taken into account in the implementation of 3D audio processors. In the field of hi-fi and film dubbing, however, multi-speaker standards already play a major role. The combination of binaural and transaural signal processing within a multi-channel playback configuration such as "Dolby Digital" has not yet been realized.
  • multi-speaker standards offer decisive advantages over stereophony in terms of a more homogeneous sound field surrounding the listener.
  • Sound is reproduced e.g. with "Dolby-Digital" via a total of six loudspeakers, one of which is used exclusively for the reproduction of low-frequency signal components that cannot be located in their direction by the human ear.
  • sound sources analogous to the previous stereo reproduction, can be placed specifically within the loudspeaker level.
  • the arrangement of loudspeakers behind the listener enables sound sources to be placed in the rear position of the listener.
  • the aim of the invention is to create a process system for multi-track recording in recording studios, the sound result of which does not change after processing different from the everyday sound perception of humans within the natural environment.
  • the basis for the reproduction of the processed material is formed by multi-speaker standards such as "Dolby Digital” or other "Surround” standards.
  • the parameterization for transaural processing within the process system requires a listening position of the listener that is defined from the start, as well as an ideal placement of the loudspeakers.
  • the system to be patented couples a) binaural processing, b) transaural processing, and c) level adjustment within the playback channels.
  • the processing levels are dynamic Namely coupled and take place separately for each sound source to be processed (instrument, voice) in accordance with the requirements for use in multi-track recording technology.
  • a joystick which works in the three spatial levels, serves as the actuator; the spatial position of the actuator corresponds to the virtual spatial position of the respective sound source (instrument).
  • the transaural processing of sound sources of the system to be patented is only carried out if a representation of the respective instrument outside the frontal plane of the three front channels (left, center, right) is desired , e.g. the "Dolby Digital" standard already offers the possibility of a sufficiently precise placement of a sound source by means of level adjustment.
  • the strength of the transaural processing depends on the position of the actuator in relation to an image outside the front level.
  • the binaural and transaural processing takes place in accordance with the general requirements of the multi-speaker configuration of the respective multi-speaker standard depending on the position of the actuator.
  • the transaural processing takes place only if a representation of a sound outside the loudspeaker level of the respective arrangement is desired, ex- explicitly to allow top-down localization of a sound event that cannot be caused by changes in the sound level relationships within the five speakers.
  • a Doppler effect processing is provided to represent dynamic sound movement effects.
  • the effect processing enables the display of motion-related Doppler effects with a rapid dynamic positioning of a sound event in the sound mixing.
  • a sound source rapidly changing its position changes its pitch in relation to the position of the listener as it moves from point A to point B.
  • the interval of the pitch change depends on the speed of their movement. Together with the pitch, the spectral components and the volume change in relation to the relative position of the sound event to the listener.
  • the virtual position of a sound is changed by the actuation of the actuator.
  • the speed of movement of the actuator from point A to point B is decoded; the sound signal to be processed is accordingly subjected to a Doppler function in real time by the system.
  • the speed of the actuator movement determines the size of the interval A'-B ', as well as the type of spectral filtering and level control of the Doppler processing.
  • loudspeakers of different sizes are therefore linked to form a sound conversion system.
  • the electrical sound signal is divided into different frequency ranges by filtering and assigned to the different loudspeakers (multi-way principle).
  • the system to be patented includes a loudspeaker correction by a) correcting the individual frequency characteristics of the loudspeaker system and thus ensuring a linear transmission, and b) optimizing the phase behavior of the individual loudspeakers. This linearizes and thus optimizes the entire transmission path for the best possible reproduction and implementation of binaural and transaural processing.
  • a unit for generating three-dimensional Hall is also provided.
  • a sound event never occurs as isolated direct sound (free field).
  • a sound is always localized in relation to its spatial environment.
  • the reflection pattern of the sound based on refractions, diffractions and time delays due to physical obstacles plays an important role in the orientation and interpretation of a sound situation in relation to its surroundings.
  • a binaural and transaural transformation of the reflection components is therefore also required to represent natural listening environments in the context of a complete 3-D audio process system.
  • the holophonic Hall processor effects a] the generation of a virtual three-dimensional listening environment and b] the individual placement of different signal sources within this virtual space.
  • the room simulation is generated on a multi-channel basis.
  • the early reflections of a sound event within the processing are provided with different directional coefficients with regard to the reflection behavior of the virtual space and processed separately.
  • the product of reverberation processing of the individual reflection is processed using the binaural outer ear transmission function for the respective virtual sound direction.
  • the generation of the respective multichannel signal is carried out by virtual loudspeakers and microphones, the loudspeakers representing the inputs and the microphones representing the outputs of the sound within the virtual space.
  • the respective output of the virtual microphone can be assigned in the output level (matrixing) to a physical electrical output channel, which enables adaptation to different loudspeaker configurations or standards, such as "Dolby Digital".
  • a second, parallel signal processing level is used to generate an artificial diffuse sound field, which is generated by the repeated refraction and reflection of sound within a room.
  • the individual diffuse components can no longer be located by the human ear, but rather appear as a homogeneous mixture of tones (reverb tail).
  • Fig.l is a block diagram of the signal processing of a 3-D audio processor according to the prior art
  • the signal is first processed in an input stage 11.
  • the signal is subjected to a binaural processing 13 at the digital level, the monophonic signal being converted into two aurally processed signals.
  • the signal is provided with the head transmission functions (HRTF's), the type of function being preselected using a control unit.
  • HRTF's head transmission functions
  • a transaural processing 14 uses crosstalk compensation to dampen the signal components that fall from the right speaker to the left ear and from the left speaker to the right ear during stereo playback. This results in a head-related decoupling of the two channels with respect to their signal sources (loudspeakers) and their arrangement, in order to enable the binaural sound material to be reproduced via stereo loudspeakers.
  • a D / A conversion is carried out in signal output 15 in order to pass on the two transformed signals as an analog signal to a mixer or to a sound storage device.
  • a multi-channel sound processing system shown in FIG. 2, comprises two signal processing levels, a direct signal processing level 2 and a room simulation level 3, which are responsible for the sound result, as well as a special, multi-channel correction unit for loudspeakers 4.
  • An actuator 1 is provided for manually influencing the processing of the system, which works in the three spatial levels.
  • the sound material to be processed is fed to the input stages 18 and 20 of the two processing levels 2 and 3 via the play paths of a mixer.
  • a mixer stage 19 enables the input signals of the direct processing to be passed on to the room simulation level.
  • the input stages 18, 20 are multi-channel in order to enable a] independent processing in processing level 2 and thus a variable position of the individual sound signals, b] independent processing and thus a variable position of the individual sound signal at level 3 in room simulation to ensure within a virtual room, and c] a generation of different virtual rooms and room combinations, for example To allow space in space for a particular signal.
  • the system is controlled manually by a special actuating mechanism that works in three dimensions.
  • the actuating mechanism 16 When the actuating mechanism 16 is actuated, the position and the speed of the change in position are converted into control commands by a recognition unit 17.
  • the vertical arrows show the influence of the control commands on the respective signal processing groups 21, 22, 23, 24 and 32, 33, 34 and 35.
  • the Doppler processing 21 following the direct signal processing level 2 is used to represent acoustic movement effects such as find use in film sound design.
  • the Doppler processing also takes place as a function of the actuator 1, with the recognition unit 17 evaluating the speed at which the actuating mechanism is actuated when a sound signal changes position.
  • the Doppler processing 21 comprises the functions of sound diffraction and the filtering of the sound signal, the strength of the sound diffraction and the type of filter function being predetermined by the starting and end positions and the speed of the change in position of the actuating mechanism 16 of the actuator 1.
  • the direct signal processing level 2 is subjected to a binaural transformation 22 after the Doppler processing, the monophonic signal being converted into a two-channel, binaural signal according to the head transmission functions, separately for each channel.
  • the binaural processing of the signal is carried out in accordance with the specification of the actuator 1, which determines the parameters of the binaural processing by its position, in order to enable the virtual placement of a sound signal in relation to the spatial position of the adjusting mechanism 16.
  • the subsequent transaural processing 23 in contrast to the transaural processing according to the prior art, also takes place as a function of the position specification of the actuator. The position determines the degree of transaural processing.
  • the transaural processing is carried out to support the level control level 24, through which sound sources are placed within the multi-speaker level (surround level). It is activated when sound events outside this level are to be displayed, but also to decouple the binaurally transformed sound signal from the loudspeakers as a localizable sound source.
  • Room simulation level 3 is used for the virtual design of sound spaces in which the individual sound signals, which are fed to the processing through the multi-channel input stage 20 or the mixing stage 19, can each be positioned independently of one another. The signals are subjected to two different processes.
  • a processing 31 is used to electronically generate a diffuse sound field that arises from multiple refraction and reflection within a natural space (reverb tail).
  • Processing 32,33,34,35 serve to spatialize and independently select the directions of incidence of the early reflections, which depend on the position of the Mechanism 16 of the actuator 1 happens, as well as the independent positioning of the individual sound sources within the virtual space.
  • the form of processing is carried out according to the same pattern as that within the direct signal processing level 2.
  • a multi-channel speaker correction 4, 40 which is specially adapted to the processing processes of the system, is used to eliminate interference variables.
  • the speakers used for reproduction are subjected to a phase and frequency response correction to enable the best possible linear reproduction of the transformed sound material.

Abstract

L'invention concerne un système de traitement du son à canaux multiples s'utilisant en technique de studio de son et de transmission électroacoustique pour créer des environnements acoustiques virtuels-réels sur la base de normes de haut-parleurs multiples. Ce système se caractérise en ce que la représentation bien dimensionnée des événements sonores intervient, outre par traitement binaural et transaural, par une régulation du niveau des signaux, conforme aux positions sonores, dans un environnement de haut-parleurs à canaux multiples.
EP00987030A 1999-11-03 2000-10-26 Systeme de traitement du son a canaux multiples Withdrawn EP1410685A2 (fr)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
DE19952835 1999-11-03
DE19952835 1999-11-03
DE19958105 1999-12-02
DE19958105A DE19958105A1 (de) 1999-11-03 1999-12-02 Mehrkanaliges Tonbearbeitungssystem
PCT/DE2000/003786 WO2001033907A2 (fr) 1999-11-03 2000-10-26 Systeme de traitement du son a canaux multiples

Publications (1)

Publication Number Publication Date
EP1410685A2 true EP1410685A2 (fr) 2004-04-21

Family

ID=26055440

Family Applications (1)

Application Number Title Priority Date Filing Date
EP00987030A Withdrawn EP1410685A2 (fr) 1999-11-03 2000-10-26 Systeme de traitement du son a canaux multiples

Country Status (2)

Country Link
EP (1) EP1410685A2 (fr)
WO (1) WO2001033907A2 (fr)

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB9107011D0 (en) * 1991-04-04 1991-05-22 Gerzon Michael A Illusory sound distance control method
US5943427A (en) * 1995-04-21 1999-08-24 Creative Technology Ltd. Method and apparatus for three dimensional audio spatialization
GB9614078D0 (en) * 1996-07-04 1996-09-04 Central Research Lab Ltd Sound effect mechanism
JP3976360B2 (ja) * 1996-08-29 2007-09-19 富士通株式会社 立体音響処理装置
GB9726338D0 (en) * 1997-12-13 1998-02-11 Central Research Lab Ltd A method of processing an audio signal
GB2342830B (en) * 1998-10-15 2002-10-30 Central Research Lab Ltd A method of synthesising a three dimensional sound-field

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO0133907A3 *

Also Published As

Publication number Publication date
WO2001033907A2 (fr) 2001-05-10
WO2001033907A3 (fr) 2002-03-14

Similar Documents

Publication Publication Date Title
DE69726262T2 (de) Tonaufnahme- und -wiedergabesysteme
EP1652405B1 (fr) Dispositif et procede de production, de mise en memoire ou de traitement d'une representation audio d'une scene audio
DE2244162C3 (de) «system
DE4241130B4 (de) Verfahren und Vorrichtung zur Wiedergabe von vierkanaligen Tonsignalen über einen Zweikanalkopfhörer bzw. über zwei Lautsprecher
DE19950319A1 (de) Verfahren zum Synthetisieren eines dreidimensionalen Schallfeldes
EP1671516A1 (fr) Procede et dispositif de production d'un canal a frequences basses
DE19720217A1 (de) Vorrichtung und Verfahren zum automatischen Ausgleich eines Mehrkanal-Audiosystems
DE19952300A1 (de) Audioverarbeitungsgerät und Audiowiedergabeverfahren
DE102005003431B4 (de) Anordnung zum Wiedergeben von binauralen Signalen (Kunstkopfsignalen) durch mehrere Lautsprecher
EP1471770B1 (fr) Procédé de géneration d'une fonction de transfert partielle approximée
DE102021203640B4 (de) Lautsprechersystem mit einer Vorrichtung und Verfahren zum Erzeugen eines ersten Ansteuersignals und eines zweiten Ansteuersignals unter Verwendung einer Linearisierung und/oder einer Bandbreiten-Erweiterung
WO2001047319A2 (fr) Procede et installation pour enregistrer et reproduire des sons
EP0156334B1 (fr) Méthode et dispositif de simulation (tête artificielle électronique) pour la simulation des caractéristiques de transmission de l'oreille en champ libre
DE102019135690A1 (de) Verfahren und Vorrichtung zur Audiosignalverarbeitung für binaurale Virtualisierung
DE102021200555B4 (de) Mikrophon und Verfahren zum Aufzeichnen eines akustischen Signals
EP1410685A2 (fr) Systeme de traitement du son a canaux multiples
DE3512155A1 (de) Elektroakustische anordnung fuer richtungsorientiertes, raeumliches hoeren
DE19958105A1 (de) Mehrkanaliges Tonbearbeitungssystem
DE2023377C3 (de) Verfahren zur räumlichen Wiedergabe von Schallsignalen und Anordnung zu seiner Durchfuhrung
WO2007110087A1 (fr) Dispositif pour la reproduction de signaux binauraux (signaux de casque d'ecouteur) par plusieurs haut-parleurs
DE3737873C2 (de) Verwendung von Hörsprechgarnituren zur Verbesserung der Sprachverständlichkeit in störschallerfüllter Umgebung
DE19628261A1 (de) Verfahren und Vorrichtung zum elektronischen Einbetten von Richtungseinsätzen bei Zweikanal-Ton
DE2126677B1 (de) Kopfhörer zur Wiedergabe stereophoner Darbietungen
AT391389B (de) Elektroakustische anordnung zur darbietung von audiosignalen fuer das richtungsorientierte raeumliche hoeren bei binauraler wiedergabe
DE19514105A1 (de) Kopfhörer-Raumklanganpassungsschaltung

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20020927

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20080502