WO2021125599A1 - Multi-channel multi-object sound source processing device for improving communication clarity of intercom system - Google Patents

Multi-channel multi-object sound source processing device for improving communication clarity of intercom system Download PDF

Info

Publication number
WO2021125599A1
WO2021125599A1 PCT/KR2020/016770 KR2020016770W WO2021125599A1 WO 2021125599 A1 WO2021125599 A1 WO 2021125599A1 KR 2020016770 W KR2020016770 W KR 2020016770W WO 2021125599 A1 WO2021125599 A1 WO 2021125599A1
Authority
WO
WIPO (PCT)
Prior art keywords
sound source
sound
channel
processing
audio signal
Prior art date
Application number
PCT/KR2020/016770
Other languages
French (fr)
Korean (ko)
Inventor
조연수
신동선
Original Assignee
주식회사 라온에이엔씨
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주식회사 라온에이엔씨 filed Critical 주식회사 라온에이엔씨
Publication of WO2021125599A1 publication Critical patent/WO2021125599A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S3/00—Systems employing more than two channels, e.g. quadraphonic
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S3/00—Systems employing more than two channels, e.g. quadraphonic
    • H04S3/002—Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2499/00—Aspects covered by H04R or H04S not otherwise provided for in their subgroups
    • H04R2499/10—General applications
    • H04R2499/11—Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]

Definitions

  • the present invention relates to a multi-channel multi-object sound source processing apparatus in a device that simultaneously reproduces multi-channel or multi-object sound sources such as an intercom system, and more particularly, by applying the location, direction, and distance sense of the sound source to each channel or object. It is about technology that provides a sense of space.
  • the Inter Communication System an intercommunication system, is a multi-communication system that mixes and outputs each signal channel input by communication target, such as a microphone, into a stereo or mono channel. It is used to provide communication for the purpose of communication, provides communication for commands or communication between aircraft and the control station or aircraft, and is applied and utilized in various multi-channel communication fields such as internal communication of fighters and tanks.
  • danger signals are displayed and delivered to listeners for surrounding danger factors.
  • additional equipment such as radar to determine dangerous situations
  • the direction and movement of danger factors It is difficult to understand the situation, so there is a requirement to express the location and movement information of the risk factor with sound.
  • the sound image localization function used in the multi-channel multi-object sound processing apparatus is a function of modeling and processing the signal transmitted to both ears of a person so that the input audio signal is localized in a three-dimensional space to the input position.
  • the listener can feel the spatial sense of sound by listening to the stereo output audio signal to which the sound phase localization function is applied through headphones/earphones. Therefore, if a sense of space is applied to each input channel using the sound image localization function in the multi-channel multi-object sound processing device, the listener can bring the same effect as listening to the sound in the real space even in a stereo listening environment.
  • An object of the present invention is to solve a communication intelligibility problem caused by mixing and playing a multi-channel multi-object sound source at the same time, so that it is not clear what content is transmitted in which channel because the sound is mixed.
  • the location of the sound is dynamically displayed so that the direction and distance can be known when listening.
  • a multi-channel multi-object sound processing apparatus for processing and applying a sense of image localization and a sense of space to an audio signal for each input communication channel according to the present invention for the above-mentioned problem is provided, and an ambient noise reduction processing unit that generates a corrected audio signal that has been processed to reduce noise through filtering for noise according to communication conditions, and a mono or stereo sound source for each channel or object-specific audio signal processed by the noise reduction processing unit.
  • the input information for the audio signal processed and output by the multi-channel multi-object sound source determination unit and the multi-channel multi-object sound source determination unit that up-mixing and converting into a stereo sound source and output as a stereo audio signal and the listener Volume leveling and output device for the audio signal processed by the multi-channel multi-object audio effect rendering unit and the multi-channel multi-object audio effect rendering unit that localizes the sound image in a three-dimensional space and gives a sense of space by interworking the head movement information of It may include a sound source output processing unit that outputs the final output by performing an equalizer process after down-mixing according to the number of output channels.
  • the multi-channel multi-object audio effect rendering unit includes a pre-processing unit for preventing distortion of the sound source, a reverberation processing unit for creating a spatial sense of the sound source, a sound image localization unit for determining the location of the sound image, and head tracking for extracting and processing information about the user's head movement It may include an information processing unit.
  • the sound image localization unit includes an elevation pinna filter for processing the pinna effect on the position of the sound image with respect to the input left (L) and right (R) sound source signals, and is applied to the input left (L) and right (R) sound source signals.
  • an elevation pinna filter for processing the pinna effect on the position of the sound image with respect to the input left (L) and right (R) sound source signals, and is applied to the input left (L) and right (R) sound source signals.
  • the sound source output processing unit a volume normalizing unit that adjusts the volume difference between the plurality of processed sound sources output by processing the spatial and positional sense of sound image, and downmixing the plurality of sound sources whose volume is adjusted according to the number of channels of the set output device It may include a downmixing unit and an equalizer processing unit for adjusting the equalizer according to the listener or the applied device with respect to the downmixed left (L) and right (R) audio signals.
  • the multi-channel multi-object audio effect rendering unit may provide a spatial sense of location of a sound image by localizing only a few sound source signals selected in advance among a plurality of input multi-channel multi-object sound source signals.
  • the multi-channel multi-object sound processing apparatus reproduces a sound located in a three-dimensional space in real time using information transmitted from a multi-channel communication system and virtual reality, etc. Communication intelligibility can be improved by being able to clearly and spatially check what content is being conveyed.
  • FIG. 1 is an overall configuration diagram illustrating a multi-channel multi-object sound processing apparatus for improving communication clarity of an intercom system according to an embodiment of the present invention.
  • FIG. 2 is a block diagram of an audio effect rendering unit for channel separation of a multi-channel multi-object sound source in the present invention.
  • FIG. 3 is a configuration diagram of a sound image localization unit that changes the location and sense of space of the audio according to the movement of the user's head in the present invention.
  • FIG. 4 is a block diagram of a sound source output unit for outputting an audio signal subjected to audio effect rendering in the present invention.
  • the multi-channel multi-object sound processing apparatus includes an ambient noise reduction processing unit 100 , a multi-channel multi-object sound source determination unit 200 , a multi-channel multi-object audio effect rendering unit 300 , and a sound source output processing unit 400 . may include.
  • Ambient noise reduction processing unit 100 is active noise control (ANC: Active Noise Control) and active noise reduction (ANR: Active Noise Reduction) with respect to the noise generated from the communication line and the external noise of a loud sound such as an aircraft, a tram, a vehicle, etc. ) and electronic noise cancellation (ENC) to generate a corrected audio signal obtained by reducing a noise signal from an input channel or object-specific signal.
  • ANC Active Noise Control
  • ANR Active Noise Reduction
  • EEC electronic noise cancellation
  • the audio signal corrected by the ambient noise reduction processing unit 100 is output in a mono or stereo format.
  • the audio signal output from the ambient noise reduction processing unit checks the information of each audio signal in the multi-channel multi-object sound source determination unit 200 to deliver the stereo signal as it is, and in the case of a mono signal, up-mixing is converted into a stereo signal processed and output.
  • FIG. 2 is a block diagram of a multi-channel multi-object audio effect rendering unit according to an embodiment of the present invention.
  • the multi-channel multi-object audio effect rendering unit 300 converts the audio signal processed by the multi-channel multi-object sound source determiner 200 for each channel or object to match the position of the sound image of the input audio signal and the head movement of the listener. It is processed and generated as a signal to which the sense of space and position of the audio signal is applied.
  • the tone can be distinguished according to the shape of the auricle, which is called the pinna effect.
  • the signal input to the multi-channel multi-object audio effect rendering unit 300 is pre-processed to reinforce the distortion of the voice part when the sound image is localized according to the characteristics of the mutual communication system.
  • the preprocessed audio signal is processed and output by the sound image localization unit 304 so as to feel as if there is a sound source in a virtual space.
  • the sound image localization unit uses the head related transfer function.
  • the head shadow filter was developed by modeling the impulse response (HRIR: Head Related Impulse Response) curve obtained by measuring the difference in the distance between the ears and the effect of the shape of the human head according to the direction of the ear, and the elevation pinna filter and azimuth A pinna filter was developed to implement sound image localization similar to the actually measured signal.
  • HRIR Head Related Impulse Response
  • the head shaow filter processes the sound phase difference generated by the human head to recognize the sound source in the left and right directions
  • the elevation pinna filter processes the height of the sound image
  • the azimuth pinna filter processes the sound image direction angle effect.
  • Headphones or earphones cannot feel the head-on effect or the pinna effect at all, but using the above filters, a three-dimensional real sound with a sense of distance and direction can be reproduced.
  • FIG. 3 is a configuration diagram of a sound image localization unit according to an embodiment of the present invention.
  • the sound image localization unit 304 is composed of a head shadow processing unit composed of a head shadow filter and a pinna processing unit composed of an elevation pinna filter and an azimuth pinna filter. To reduce usage, the order of each filter is lowered to the 1st or 2nd order and implemented as an IIR (Infinite Impuse Response) filter, enabling real-time localization of sound images to match the changing location and distance values for each of 8 or more multi-channel multi-objects. developed to do so.
  • IIR Intelligent Impuse Response
  • the audio signal input from the multi-channel multi-object audio effect rendering unit to the image localization unit is made by converting the input signal into a coordinate signal according to the listener's head movement in the head tracking information processing unit 305, and is transmitted to the sound image localization unit.
  • the sound image localized audio signal is processed and output in conjunction with the , and a reverberation processing unit for expressing the spatial sense of the audio signal is additionally passed through.
  • the reverberation processing units 302 and 306 are located in front and behind the sound image localization unit, and if necessary, it is possible to select an audio signal to pass through some or all of the reverberation processing units located before and after the sound image localization unit.
  • FIG. 4 is a block diagram of a sound source output unit according to an embodiment of the present invention.
  • the audio signal processed and output by the multi-channel multi-object audio effect rendering unit 300 is adjusted by the volume normalizing unit 401 to adjust the volume of each sound source, and the downmixing unit 402 to match the number of output channels of the final output device.
  • the downmixed audio signal is downmixed and the outputted audio signal is subjected to equalizer adjustment according to the characteristics of the listener or the applied device through the equalizer processing unit 403 to output the final change-processed signal.
  • the type and number of channels or objects to be image localized may be selected by the user within the maximum possible number range that the system can process.
  • the multi-channel multi-object sound processing device is applied to the mutual communication system of fighters and tanks to display the danger signal as an audio signal for warning display for the surrounding danger factors.
  • the audio signal for warning display among the plurality of sound sources can be transmitted to the pilot by applying the sense of direction and distance, and only the audio signal for warning indication is sounded in conjunction with the signal input according to the pilot's head movement. It is possible to maximize the warning display effect for the danger signal by transmitting it to the pilot for the purpose of supposing.
  • the Doppler effect may be added to the audio signal for warning display of the danger element to indicate the movement direction and distance of the danger element.
  • the present invention provides an adjustable device so as to maximize the effect according to the characteristics of the input sound source and the multi-channel multi-object audio system in actual application, the present invention is It should be noted that various modifications are possible without departing from the present invention and not limited to this embodiment, and each device may be individually applied.
  • the present invention when the present invention is applied to a VR/AR playback device, it is possible to increase the immersion feeling of virtual reality by using the multi-channel multi-object sound source determination unit, the multi-channel multi-object audio effect rendering unit, and the down-mixing processing unit of the present invention. Do.
  • the present invention is a multi-communication system that mixes and outputs each signal channel input for each communication target, such as a microphone, into a stereo or mono channel. It is used to provide communication for instructions or communication between a broadcasting station studio and a control room or control room, and an aircraft and a control station Or, it provides communication for commands or communication between aircraft, and is applied and utilized in various multi-channel communication fields such as internal communication of fighters and tanks.

Abstract

The present invention provides a multi-channel multi-object sound source processing device comprising: an ambient noise reduction processing unit for performing noise-reduction processing on an input audio signal through filtering; a multi-channel multi-object sound source determination unit for determining whether the audio signal is a mono sound source or a stereo sound source, and when the audio signal is the mono sound source, performing up-mixing conversion processing of the mono sound source into the stereo sound source and outputting a stereo audio signal; a multi-channel multi-object audio effect rendering unit for associating input information and a listener's head movement information with each other so as to localize a sound image in a three-dimensional space and provide a sense of space; and a sound source output processing unit for performing down-mixing processing according to the number of output channels of a sound volume normalization and output device, performing equalizer processing, and making a final output, wherein the location, direction, and sense of distance of a sound source are applied to each channel or object, thereby providing a sense of space.

Description

인터콤시스템 통신명료도 향상을 위한 다채널다객체 음원 처리 장치Multi-channel multi-object sound processing device to improve intercom system communication intelligibility
본 발명은 인터콤시스템 등 다채널 또는 다객체 음원이 동시에 재생되는 장치에서 다채널다객체 음원 처리 장치에 관한 것으로, 더욱 상세하게는 각각의 채널 또는 객체에 대하여 음원의 위치, 방향 및 거리감을 적용하여 공간감을 제공하는 기술에 관한 것이다.The present invention relates to a multi-channel multi-object sound source processing apparatus in a device that simultaneously reproduces multi-channel or multi-object sound sources such as an intercom system, and more particularly, by applying the location, direction, and distance sense of the sound source to each channel or object. It is about technology that provides a sense of space.
상호통신시스템인 인터콤시스템(Inter Communication System: ICS)은 마이크 등 통신 대상별로 입력된 각 신호 채널을 스테레오 또는 모노 채널로 믹싱하여 출력하는 다중통신 시스템으로 방송국 스튜디오와 조정실 또는 조정실 상호간의 지령이나 연락을 위한 통신을 제공하는데 사용되고, 항공기와 관제국 또는 항공기들 상호간의 지령이나 연락을 위한 통신을 제공하며, 전투기, 전차의 내부통신 등 다양한 다채널 통신분야에 적용되어 활용되고 있다. The Inter Communication System (ICS), an intercommunication system, is a multi-communication system that mixes and outputs each signal channel input by communication target, such as a microphone, into a stereo or mono channel. It is used to provide communication for the purpose of communication, provides communication for commands or communication between aircraft and the control station or aircraft, and is applied and utilized in various multi-channel communication fields such as internal communication of fighters and tanks.
그러나 종래의 상호통신시스템에서는 입력되는 다채널의 음원이 단순믹싱되어 출력됨으로써 음성 명료도와 상황판단 인지율이 감소되는 문제점이 있다.However, in the conventional mutual communication system, there is a problem in that the input multi-channel sound source is simply mixed and output, so that the voice intelligibility and the situation judgment recognition rate are reduced.
또한, 전투기, 전차의 상호통신시스템의 경우 주변의 위험요소에 대해 위험신호를 소리로 표시하여 청취자에게 전달하고 있으나, 위험상황 판단을 위해서는 레이더 등 부가 장비를 이용하기 전에는 위험요소에 대한 방향 및 이동여부에 대한 상황파악이 어려워 소리로 위험요소에 대한 위치 및 이동정보를 표현하는 것에 대한 요구사항이 있다.In addition, in the case of the mutual communication system of fighters and tanks, danger signals are displayed and delivered to listeners for surrounding danger factors. However, before using additional equipment such as radar to determine dangerous situations, the direction and movement of danger factors It is difficult to understand the situation, so there is a requirement to express the location and movement information of the risk factor with sound.
다채널다객체 음원 처리 장치에서 사용하는 음상정위 기능은 입력 오디오 신호를 입력된 위치로 3차원 공간상에 정위되도록 사람의 양귀에 전달되는 신호를 모델링하여 프로세싱하는 기능이다. 청취자는 음상정위 기능을 적용한 스테레오 출력 오디오 신호를 헤드폰/이어폰을 통해 청취함으로써 소리의 공간감을 느낄 수 있다. 따라서 다채널다객체 음원 처리 장치에서 음상정위 기능을 이용하여 입력된 채널별로 공간감을 적용시키면 청취자는 스테레오 청취 환경에서도 실제공간에서 소리를 청취하는 것과 같은 효과를 가져올 수 있다.The sound image localization function used in the multi-channel multi-object sound processing apparatus is a function of modeling and processing the signal transmitted to both ears of a person so that the input audio signal is localized in a three-dimensional space to the input position. The listener can feel the spatial sense of sound by listening to the stereo output audio signal to which the sound phase localization function is applied through headphones/earphones. Therefore, if a sense of space is applied to each input channel using the sound image localization function in the multi-channel multi-object sound processing device, the listener can bring the same effect as listening to the sound in the real space even in a stereo listening environment.
본 발명은 다채널다객체 음원이 동시에 믹싱되어 재생됨으로써 소리가 혼합되어 어떤 채널에서 어떠한 내용이 전달되는지 확인이 불분명해져서 발생되는 통신 명료도 저하 문제를 해결하고자 한다.An object of the present invention is to solve a communication intelligibility problem caused by mixing and playing a multi-channel multi-object sound source at the same time, so that it is not clear what content is transmitted in which channel because the sound is mixed.
또한, 움직이는 물체(위험 신호 등)를 오디오로 표시할 때 방향과 거리 등을 청취 시 알 수 있도록 동적으로 소리의 위치를 표시하고자 한다.In addition, when displaying a moving object (danger signal, etc.) with audio, the location of the sound is dynamically displayed so that the direction and distance can be known when listening.
상기의 해결하고자 하는 과제를 위한 본 발명에 따른 입력된 통신 채널별 오디오 신호에 대해 음상정위감 및 공간감을 처리 적용하기 위한 다채널다객체 음원 처리장치는, 입력된 채널 또는 객체별 오디오 신호에서 주변 잡음 및 통신상황에 따른 잡음에 대해 필터링을 통해 잡음을 저감 처리한 수정 오디오 신호를 생성하는 주변 노이즈 저감 처리부, 노이즈 저감 처리부에서 처리된 각 채널 또는 객체별 오디오 신호에 대해 모노음원 또는 스테레오 음원을 판단하여 모노음원의 경우 스테레오 음원으로 업믹싱(up mixing) 변환 처리하여 스테레오 오디오 신호로 출력하는 다채널다객체 음원 판단부, 다채널다객체 음원 판단부에서 처리 출력된 오디오신호에 대해 입력된 정보와 청취자의 머리 움직임 정보를 상호 연동하여 3차원 공간상에 음상을 정위하고 공간감을 부여하는 다채널다객체 오디오 효과 랜더링부 및 다채널다객체 오디오 효과 랜더링부에서 처리된 오디오 신호에 대해 음량 평준화 및 출력장치의 출력 채널수에 맞춰 다운 믹싱처리한 후 이퀄라이저 처리하여 최종 출력하는 음원출력 처리부를 포함할 수 있다.A multi-channel multi-object sound processing apparatus for processing and applying a sense of image localization and a sense of space to an audio signal for each input communication channel according to the present invention for the above-mentioned problem is provided, and an ambient noise reduction processing unit that generates a corrected audio signal that has been processed to reduce noise through filtering for noise according to communication conditions, and a mono or stereo sound source for each channel or object-specific audio signal processed by the noise reduction processing unit. In the case of a mono sound source, the input information for the audio signal processed and output by the multi-channel multi-object sound source determination unit and the multi-channel multi-object sound source determination unit that up-mixing and converting into a stereo sound source and output as a stereo audio signal and the listener Volume leveling and output device for the audio signal processed by the multi-channel multi-object audio effect rendering unit and the multi-channel multi-object audio effect rendering unit that localizes the sound image in a three-dimensional space and gives a sense of space by interworking the head movement information of It may include a sound source output processing unit that outputs the final output by performing an equalizer process after down-mixing according to the number of output channels.
상기 다채널다객체 오디오 효과 랜더링부는, 음원의 왜곡을 방지하기 위한 전처리부, 음원의 공간감을 만들어주는 잔향처리부, 음상의 위치를 정하는 음상정위부 및 사용자의 머리 움직임 정보를 추출하여 처리하는 헤드트레킹정보 처리부를 포함할 수 있다.The multi-channel multi-object audio effect rendering unit includes a pre-processing unit for preventing distortion of the sound source, a reverberation processing unit for creating a spatial sense of the sound source, a sound image localization unit for determining the location of the sound image, and head tracking for extracting and processing information about the user's head movement It may include an information processing unit.
상기 음상정위부는, 입력된 좌(L), 우(R) 음원신호에 대하여 음상의 높낮이 위치에 대한 pinna 효과를 처리하기 위한 elevation pinna filter, 입력된 좌(L), 우(R) 음원신호에 대하여 음상의 방향각 위치에 대한 pinna효과를 처리하기 위한 azimuth pinna filter 및 elevation pinna filter와 azimuth pinna filter에서 출력된 좌(L), 우(R) 신호에 대하여 사람의 머리 형상에 따른 효과를 처리하기 위한 head shadow filter를 포함할 수 있다.The sound image localization unit includes an elevation pinna filter for processing the pinna effect on the position of the sound image with respect to the input left (L) and right (R) sound source signals, and is applied to the input left (L) and right (R) sound source signals. To process the effect according to the shape of the human head on the left (L) and right (R) signals output from the azimuth pinna filter and elevation pinna filter and the azimuth pinna filter to process the pinna effect on the direction angle position of the sound image It may include a head shadow filter for
상기 음원 출력 처리부는, 음상의 공간감, 위치감이 처리되어 출력된 여러 개의 처리된 음원들의 음량차이를 조정하는 음량 노멀라이징부, 음량 조정된 여러 개의 음원들을 설정된 출력 장치의 채널 수에 맞춰 다운믹싱하는 다운믹싱부 및 다운믹싱된 좌(L), 우(R) 오디오 신호에 대해서 청취자 또는 적용 기기에 맞춰 이퀄라이저 조정하는 이퀄라이저 처리부를 포함할 수 있다.The sound source output processing unit, a volume normalizing unit that adjusts the volume difference between the plurality of processed sound sources output by processing the spatial and positional sense of sound image, and downmixing the plurality of sound sources whose volume is adjusted according to the number of channels of the set output device It may include a downmixing unit and an equalizer processing unit for adjusting the equalizer according to the listener or the applied device with respect to the downmixed left (L) and right (R) audio signals.
상기 다채널다객체 오디오 효과 랜더링부는, 입력된 복수개의 다채널다객체 음원신호 중에서 사전에 선택된 소수의 음원신호만 음상정위하여 음상의 위치공간감을 제공할 수 있다.The multi-channel multi-object audio effect rendering unit may provide a spatial sense of location of a sound image by localizing only a few sound source signals selected in advance among a plurality of input multi-channel multi-object sound source signals.
본 발명에 따른 다채널다객체 음원 처리 장치는 상호통신시스템 뿐 아니라 다채널로 통신하는 시스템과 가상현실 등에서 전달되는 정보를 이용하여 실시간으로 3차원공간상에 위치된 소리를 재생하여, 어떤 채널에서 어떠한 내용이 전달되는지 공간감 있고 분명하게 확인할 수 있어 통신 명료도를 향상시킬 수 있다.The multi-channel multi-object sound processing apparatus according to the present invention reproduces a sound located in a three-dimensional space in real time using information transmitted from a multi-channel communication system and virtual reality, etc. Communication intelligibility can be improved by being able to clearly and spatially check what content is being conveyed.
또한, 음원의 이동경로가 입력될 경우, 청취자의 머리 움직임과 연동하여 3차원 공간상에서 위치가 이동되는 소리를 실시간으로 재생하여, 어떤 채널에서 어떠한 내용이 전달되는지 공간감 있고 분명하게 확인할 수 있어 통신 명료도를 향상시킬 수 있다.In addition, when the movement path of the sound source is input, the sound that moves in the three-dimensional space is reproduced in real time in conjunction with the listener's head movement, so that it is possible to clearly and spatially check what content is delivered in which channel, so communication clarity is also improved. can improve
도 1은 본 발명의 실시예에 따른 인터콤시스템 통신명료도 향상을 위한 다채널다객체 음원 처리 장치를 도시하는 전체적인 구성도이다.1 is an overall configuration diagram illustrating a multi-channel multi-object sound processing apparatus for improving communication clarity of an intercom system according to an embodiment of the present invention.
도 2는 본 발명에서 다채널다객체 음원의 채널분리를 위한 오디오 효과 랜더링부의 구성도이다.2 is a block diagram of an audio effect rendering unit for channel separation of a multi-channel multi-object sound source in the present invention.
도 3은 본 발명에서 사용자의 머리 움직임에 따라 오디오의 위치, 공간감을 변화시키는 음상정위부의 구성도이다.3 is a configuration diagram of a sound image localization unit that changes the location and sense of space of the audio according to the movement of the user's head in the present invention.
도 4는 본 발명에서 오디오 효과 랜더링 처리된 오디오 신호의 출력을 위한 음원 출력부의 구성도이다.4 is a block diagram of a sound source output unit for outputting an audio signal subjected to audio effect rendering in the present invention.
도 1은 본 발명의 실시예에 따른 다채널다객체 음원 처리 장치를 나타낸 블록도이다. 도 1을 참조하면 다채널다객체 음원 처리 장치는 주변 노이즈 저감처리부(100), 다채널다객체 음원 판단부(200), 다채널다객체 오디오 효과 랜더링부(300), 음원출력 처리부(400)를 포함할 수 있다.1 is a block diagram illustrating an apparatus for processing a multi-channel multi-object sound source according to an embodiment of the present invention. Referring to FIG. 1 , the multi-channel multi-object sound processing apparatus includes an ambient noise reduction processing unit 100 , a multi-channel multi-object sound source determination unit 200 , a multi-channel multi-object audio effect rendering unit 300 , and a sound source output processing unit 400 . may include.
주변 노이즈 저감 처리부(100)는 항공기, 전차, 차량 등의 큰 소리의 외부 발생 소음과 통신 회선에서 발생하는 노이즈에 대하여 능동소음제어(ANC: Active Noise Control) 및 능동소음감소(ANR: Active Noise Reduction), 전자소음 제거(ENC: Electronic Noise Cancelling)을 이용하여 입력된 채널 또는 객체별 신호에서 노이즈 신호를 저감 처리한 수정 오디오 신호를 생성한다.Ambient noise reduction processing unit 100 is active noise control (ANC: Active Noise Control) and active noise reduction (ANR: Active Noise Reduction) with respect to the noise generated from the communication line and the external noise of a loud sound such as an aircraft, a tram, a vehicle, etc. ) and electronic noise cancellation (ENC) to generate a corrected audio signal obtained by reducing a noise signal from an input channel or object-specific signal.
주변 노이즈 저감 처리부(100)에서 수정 처리된 오디오 신호는 모노 또는 스테레오 포맷으로 출력된다. 음원의 위상을 정위하기 위해서는 해당 음원이 스테레오로 처리가 되어야 한다. 따라서 주변 노이즈 저감 처리부에서 출력된 오디오 신호는 다채널다객체 음원 판단부(200)에서 각 오디오 신호의 정보를 확인하여 스테레오 신호는 그대로 전달하고 모노 신호의 경우 스테레오 신호로 업믹싱(up mixing) 변환 처리하여 출력한다.The audio signal corrected by the ambient noise reduction processing unit 100 is output in a mono or stereo format. In order to localize the phase of the sound source, the sound source must be processed in stereo. Therefore, the audio signal output from the ambient noise reduction processing unit checks the information of each audio signal in the multi-channel multi-object sound source determination unit 200 to deliver the stereo signal as it is, and in the case of a mono signal, up-mixing is converted into a stereo signal processed and output.
도 2는 본 발명의 실시예에 따른 다채널다객체 오디오 효과 랜더링부의 구성도이다.2 is a block diagram of a multi-channel multi-object audio effect rendering unit according to an embodiment of the present invention.
다채널다객체 오디오 효과 랜더링부(300)에서는 다채널다객체 음원 판단부(200)에서 처리된 오디오 신호를 채널 또는 객체별로 변환 처리하여 입력되는 오디오 신호의 음상의 위치 및 청취자의 머리 움직임에 맞춰 오디오 신호의 공간감 및 위치감이 적용된 신호로 처리 생성한다.The multi-channel multi-object audio effect rendering unit 300 converts the audio signal processed by the multi-channel multi-object sound source determiner 200 for each channel or object to match the position of the sound image of the input audio signal and the head movement of the listener. It is processed and generated as a signal to which the sense of space and position of the audio signal is applied.
일반적으로 얼굴 정면에서 들려오는 소리는 양쪽 귀에 전달되는 음압차가 거의 없지만, 측방에서 들려오는 소리는 좌우가 약 1/1000초 차이가 발생하는 두영효과(head shadow effect)가 있어 음원의 방향을 인지할 수 있다.In general, sound from the front of the face has little difference in sound pressure transmitted to both ears, but the sound from the side has a head shadow effect that causes a difference of about 1/1000 second between the left and right sides, making it difficult to recognize the direction of the sound source. can
두영효과로 음원의 방향 등을 구분하지 못할 경우에는 귀바퀴의 생김새에 따라 음색을 구분할 수 있는데 이를 귓바퀴효과(pinna effect)라 한다.If the direction of the sound source cannot be distinguished by the head-on effect, the tone can be distinguished according to the shape of the auricle, which is called the pinna effect.
다채널다객체 오디오 효과 랜더링부(300)로 입력된 신호는 상호통신시스템의 특성에 맞춰 음상 정위시 목소리 부분이 왜곡되는 것을 보강하기 위한 전처리를 진행한다. 전처리된 오디오 신호는 가상의 공간에 음원이 있는 것처럼 느껴지도록 음상정위부(304)에서 처리되어 출력된다. 음상정위부에서는 기존에 머리 전달 함수(HRTF : Head Related Transfer Function)를 이용해 구현하는 경우 연산량과 메모리 사용량이 과다하여 고성능의 하드웨어가 아니면 실시간 처리가 어려운 것을 해결하기 위하여 본 발명에서는 두영효과을 이용하여 소리의 방향에 따라 귀의 거리차와 사람의 머리 형상에 따른 영향을 측정하여 얻어낸 임펄스응답(HRIR: Head Related Impulse Response) 곡선을 모델링하여 head shadow filter를 개발하고, 귓바퀴 효과를 적용하여 elevation pinna filter 및 azimuth pinna filter를 개발하여 실제로 측정된 신호와 유사하게 음상 정위가 구현되도록 개발하였다.The signal input to the multi-channel multi-object audio effect rendering unit 300 is pre-processed to reinforce the distortion of the voice part when the sound image is localized according to the characteristics of the mutual communication system. The preprocessed audio signal is processed and output by the sound image localization unit 304 so as to feel as if there is a sound source in a virtual space. In the present invention, in order to solve the problem that real-time processing is difficult without high-performance hardware due to excessive computation and memory usage when implemented using a head related transfer function (HRTF), in the present invention, the sound image localization unit uses the head related transfer function. The head shadow filter was developed by modeling the impulse response (HRIR: Head Related Impulse Response) curve obtained by measuring the difference in the distance between the ears and the effect of the shape of the human head according to the direction of the ear, and the elevation pinna filter and azimuth A pinna filter was developed to implement sound image localization similar to the actually measured signal.
head shaow filter는 사람의 머리에 의하여 발생하는 음상차를 처리하여 좌우 방향으로의 음원을 인지하고, elevation pinna filter는 음상의 높낮이를 처리하고, azimuth pinna filter는 음상의 방향각 효과를 처리한다.The head shaow filter processes the sound phase difference generated by the human head to recognize the sound source in the left and right directions, the elevation pinna filter processes the height of the sound image, and the azimuth pinna filter processes the sound image direction angle effect.
헤드폰이나 이어폰으로는 두영효과나 귓바퀴효과를 전혀 느낄 수 없으나 상기 필터들을 사용하면 거리감과 방향감 있는 3차원적인 실제 소리를 재생할 수 있다.Headphones or earphones cannot feel the head-on effect or the pinna effect at all, but using the above filters, a three-dimensional real sound with a sense of distance and direction can be reproduced.
도 3은 본 발명의 실시예에 따른 음상정위부의 구성도이다.3 is a configuration diagram of a sound image localization unit according to an embodiment of the present invention.
음상정위부(304)는 head shadow filter로 구성된 head shadow 처리부와 elevation pinna filter 및 azimuth pinna filter로 구성된 pinna 처리부로 구성되며, 개발된 기술의 적용 분야를 휴대기기 등으로 확장할 수 있도록 최대한 연산량과 메모리 사용량을 줄이기 위해 각 필터의 차수를 1차 또는 2차로 낮추어 IIR (Infinite Impuse Response) 필터로 구현하여 8개 이상의 다채널다객체 각각에 대해 변화하는 위치, 거리값에 맞도록 실시간으로 음상 정위가 가능하도록 개발하였다.The sound image localization unit 304 is composed of a head shadow processing unit composed of a head shadow filter and a pinna processing unit composed of an elevation pinna filter and an azimuth pinna filter. To reduce usage, the order of each filter is lowered to the 1st or 2nd order and implemented as an IIR (Infinite Impuse Response) filter, enabling real-time localization of sound images to match the changing location and distance values for each of 8 or more multi-channel multi-objects. developed to do so.
다채널다객체 오디오 효과 랜더링부에서 음상정위부로 입력된 오디오 신호는 head tracking 정보처리부(305)에서 청취자의 머리 움직임에 따라 입력된 신호를 좌표신호로 변환 처리하여 만들어져 음상정위부로 전달되는 신호와 연동하여 음상 정위된 오디오 신호를 처리 출력하며, 오디오 신호의 공간감을 표현하기 위한 잔향처리부를 추가로 거치게 된다. The audio signal input from the multi-channel multi-object audio effect rendering unit to the image localization unit is made by converting the input signal into a coordinate signal according to the listener's head movement in the head tracking information processing unit 305, and is transmitted to the sound image localization unit. The sound image localized audio signal is processed and output in conjunction with the , and a reverberation processing unit for expressing the spatial sense of the audio signal is additionally passed through.
잔향처리부(302, 306)는 음상정위부의 앞과 뒤에 위치하며, 필요에 따라 오디오신호가 음상정위부의 앞과 뒤에 위치한 잔향처리부의 일부 또는 전부를 거치도록 선택할 수 있다.The reverberation processing units 302 and 306 are located in front and behind the sound image localization unit, and if necessary, it is possible to select an audio signal to pass through some or all of the reverberation processing units located before and after the sound image localization unit.
도 4는 본 발명의 실시예에 따른 음원 출력부의 구성도이다.4 is a block diagram of a sound source output unit according to an embodiment of the present invention.
다채널다객체 오디오 효과 랜더링부(300)에서 처리되어 출력된 오디오 신호는 음량 노멀라이징부(401)에서 각각의 음원의 음량이 조정되고 다운믹싱부(402)에서 최종 출력장치의 출력 채널수에 맞춰 다운믹싱(down mixing) 되며, 다운믹싱되어 출력된 오디오 신호는 이퀄라이저 처리부(403)를 통하여 청취자 또는 적용 기기의 특성에 맞춰 이퀄라이저(equalizer)조정이 되어 최종 변화 처리된 신호가 출력된다.The audio signal processed and output by the multi-channel multi-object audio effect rendering unit 300 is adjusted by the volume normalizing unit 401 to adjust the volume of each sound source, and the downmixing unit 402 to match the number of output channels of the final output device. The downmixed audio signal is downmixed and the outputted audio signal is subjected to equalizer adjustment according to the characteristics of the listener or the applied device through the equalizer processing unit 403 to output the final change-processed signal.
본 발명의 실시예에 따른 다채널다객체 음원 처리 장치에서 음상정위되는 채널 또는 객체의 종류와 개수를 시스템에서 처리 가능한 최대 가능 갯수 범위 내에서 사용자가 선택할 수 있다.In the multi-channel multi-object sound processing apparatus according to an embodiment of the present invention, the type and number of channels or objects to be image localized may be selected by the user within the maximum possible number range that the system can process.
본 발명의 실시예에 따른 다채널다객체 입력 오디오 시스템에서 다채널다객체 음원 처리 장치를 전투기, 전차의 상호통신시스템에 적용하여 주변의 위험요소에 대해 위험신호를 경고표시용 오디오 신호로 표시하여 조종사에게 전달하는 경우, 복수 개의 음원 중에서 경고표시용 오디오신호만 방향과 거리감을 적용하여 음상정위하여 조종사에게 전달할 수 있으며, 조종사의 머리 움직임에 따라 입력된 신호와 연동하여 경고표시용 오디오 신호만 음상정위하여 조종사에게 전달하여 위험신호에 대한 경고표시효과를 극대화시킬 수 있다.In the multi-channel multi-object input audio system according to the embodiment of the present invention, the multi-channel multi-object sound processing device is applied to the mutual communication system of fighters and tanks to display the danger signal as an audio signal for warning display for the surrounding danger factors. In the case of delivery to the pilot, only the audio signal for warning display among the plurality of sound sources can be transmitted to the pilot by applying the sense of direction and distance, and only the audio signal for warning indication is sounded in conjunction with the signal input according to the pilot's head movement. It is possible to maximize the warning display effect for the danger signal by transmitting it to the pilot for the purpose of supposing.
또한, 위험요소에 대한 경고표시용 오디오 신호에 대하여 위험요소의 움직임 방향과 거리를 나타내기 위하여 도플러효과를 추가할 수 있다.In addition, the Doppler effect may be added to the audio signal for warning display of the danger element to indicate the movement direction and distance of the danger element.
이상에서 본 발명의 하나의 실시예를 설명하였으나, 본 발명은 실제 적용 시 입력 음원 및 다채널다객체 오디오 시스템의 특징에 따라 효과를 극대화 시킬 수 있도록 조정 가능한 장치를 제공하고 있기 때문에, 본 발명은 이 실시예에 한정되는 것이 아니라 본 발명에 벗어나지 않는 범위 내에서 다양한 변형이 가능하며 각각의 장치들은 개별로도 적용이 가능하다는 점을 유의해야 한다.Although one embodiment of the present invention has been described above, since the present invention provides an adjustable device so as to maximize the effect according to the characteristics of the input sound source and the multi-channel multi-object audio system in actual application, the present invention is It should be noted that various modifications are possible without departing from the present invention and not limited to this embodiment, and each device may be individually applied.
예를 들어 본 발명을 VR/AR 재생장치에 적용할 경우 본 발명의 다채널다객체 음원 판단부와 다채널다객체 오디오 효과 랜더링부 및 다운 믹싱 처리부를 이용하여 가상현실의 몰입감을 증가시키는 것이 가능하다.For example, when the present invention is applied to a VR/AR playback device, it is possible to increase the immersion feeling of virtual reality by using the multi-channel multi-object sound source determination unit, the multi-channel multi-object audio effect rendering unit, and the down-mixing processing unit of the present invention. Do.
본 발명은 마이크 등 통신 대상별로 입력된 각 신호 채널을 스테레오 또는 모노 채널로 믹싱하여 출력하는 다중통신 시스템으로 방송국 스튜디오와 조정실 또는 조정실 상호간의 지령이나 연락을 위한 통신을 제공하는데 사용되고, 항공기와 관제국 또는 항공기들 상호간의 지령이나 연락을 위한 통신을 제공하며, 전투기, 전차의 내부통신 등 다양한 다채널 통신분야에 적용되어 활용되고 있다.The present invention is a multi-communication system that mixes and outputs each signal channel input for each communication target, such as a microphone, into a stereo or mono channel. It is used to provide communication for instructions or communication between a broadcasting station studio and a control room or control room, and an aircraft and a control station Or, it provides communication for commands or communication between aircraft, and is applied and utilized in various multi-channel communication fields such as internal communication of fighters and tanks.

Claims (5)

  1. 입력된 통신 채널별 오디오 신호에 대해 음상정위감 및 공간감을 처리 적용하기 위한 다채널다객체 음원 처리장치에 있어서,In the multi-channel multi-object sound processing apparatus for processing and applying a sound image localization and spatial sense to an audio signal for each input communication channel,
    입력된 채널 또는 객체별 오디오 신호에서 주변 잡음 및 통신상황에 따른 잡음에 대해 필터링을 통해 잡음을 저감 처리한 수정 오디오 신호를 생성하는 주변 노이즈 저감 처리부(100); an ambient noise reduction processing unit 100 for generating a corrected audio signal obtained by reducing noise through filtering on ambient noise and noise according to communication conditions in an input channel or object-specific audio signal;
    상기 노이즈 저감 처리부에서 처리된 각 채널 또는 객체별 오디오 신호에 대해 모노음원 또는 스테레오 음원을 판단하여 모노음원의 경우 스테레오 음원으로 업믹싱(up mixing) 변환 처리하여 스테레오 오디오 신호로 출력하는 다채널다객체 음원 판단부(200);Multi-channel multi-object that determines a mono sound source or a stereo sound source for each channel or object-specific audio signal processed by the noise reduction processing unit, up-mixes the mono sound source into a stereo sound source, and outputs a stereo audio signal sound source determination unit 200;
    상기 다채널다객체 음원 판단부에서 처리 출력된 오디오 신호에 대해 입력된 정보와 청취자의 머리 움직임 정보를 상호 연동하여 3차원 공간상에 음상을 정위하고 공간감을 부여하는 다채널다객체 오디오 효과 랜더링부(300) 및A multi-channel multi-object audio effect rendering unit that localizes a sound image in a three-dimensional space and gives a sense of space by linking the information input to the audio signal processed and output by the multi-channel multi-object sound source determination unit and the listener's head movement information (300) and
    상기 다채널다객체 오디오 효과 랜더링부에서 처리된 오디오 신호에 대해 음량 평준화 및 출력장치의 출력 채널수에 맞춰 다운 믹싱처리한 후 이퀄라이저 처리하여 최종 출력하는 음원출력 처리부(400)를 포함하는 것을 특징으로 하는 다채널다객체 음원 처리장치.The audio signal processed by the multi-channel multi-object audio effect rendering unit is subjected to volume leveling and down-mixing processing according to the number of output channels of the output device, followed by equalizer processing to finally output the sound source output processing unit 400 characterized by comprising: Multi-channel multi-object sound processing device.
  2. 제1 항에 있어서, According to claim 1,
    상기 다채널다객체 오디오 효과 랜더링부(300)는,The multi-channel multi-object audio effect rendering unit 300,
    음원의 왜곡을 방지하기 위한 전처리부(301);a preprocessor 301 for preventing distortion of the sound source;
    음원의 공간감을 만들어주는 잔향처리부(302, 306);reverberation processing units 302 and 306 for creating a sense of space of the sound source;
    음상의 위치를 정하는 음상정위부(304) 및A sound image localization unit 304 that determines the position of the sound image, and
    사용자의 머리 움직임 정보를 추출하여 처리하는 헤드트레킹정보 처리부(305)를 포함하는 것을 특징으로 하는 음상의 위치공간감을 제공하는 다채널다객체 음원 처리장치.A multi-channel multi-object sound processing device that provides a sense of location and space in the sound image, characterized in that it comprises a head tracking information processing unit 305 that extracts and processes the user's head movement information.
  3. 제2 항에 있어서, 3. The method of claim 2,
    상기 음상정위부(304)는,The sound image localization unit 304,
    입력된 좌(L), 우(R) 음원신호에 대하여 음상의 높낮이 위치에 대한 pinna 효과를 처리하기 위한 elevation pinna filter;elevation pinna filter for processing the pinna effect on the height position of the sound image with respect to the input left (L) and right (R) sound source signals;
    입력된 좌(L), 우(R) 음원신호에 대하여 음상의 방향각 위치에 대한 pinna효과를 처리하기 위한 azimuth pinna filter 및An azimuth pinna filter and an azimuth pinna filter for processing the pinna effect on the directional angle position of the sound image for the input left (L) and right (R) sound source signals.
    상기 elevation pinna filter와 azimuth pinna filter에서 출력된 좌(L), 우(R) 신호에 대하여 사람의 머리 형상에 따른 효과를 처리하기 위한 head shadow filter를 포함하는 것을 특징으로 하는 다채널다객체 음원 처리장치.Multi-channel multi-object sound processing comprising a head shadow filter for processing the effect according to the shape of a human head with respect to the left (L) and right (R) signals output from the elevation pinna filter and the azimuth pinna filter Device.
  4. 제1 항에 있어서, According to claim 1,
    상기 음원 출력 처리부(400)는,The sound source output processing unit 400,
    음상의 공간감, 위치감이 처리되어 출력된 여러 개의 처리된 음원들의 음량차이를 조정하는 음량 노멀라이징부(401);a volume normalizing unit 401 for adjusting a difference in volume between a plurality of processed sound sources output by processing a sense of space and a sense of position of the sound image;
    음량 조정된 여러 개의 음원들을 설정된 출력 장치의 채널 수에 맞춰 다운믹싱하는 다운믹싱부(402) 및a downmixing unit 402 for downmixing several sound sources whose volume has been adjusted according to the number of channels of the set output device; and
    다운믹싱된 좌(L), 우(R) 오디오 신호에 대해서 청취자 또는 적용 기기에 맞춰 이퀄라이저 조정하는 이퀄라이저 처리부(403)를 포함하는 것을 특징으로 하는 다채널다객체 음원 처리장치.Multi-channel multi-object sound processing apparatus, characterized in that it comprises an equalizer processing unit (403) for adjusting the equalizer for the downmixed left (L), right (R) audio signal according to the listener or the applied device.
  5. 제1 항에 있어서, According to claim 1,
    상기 다채널다객체 오디오 효과 랜더링부(300)는,The multi-channel multi-object audio effect rendering unit 300,
    입력된 복수개의 다채널다객체 음원신호 중에서 사전에 선택된 소수의 음원신호만 음상정위하여 음상의 위치공간감을 제공하는 것을 특징으로 하는 다채널다객체 음원 처리장치.A multi-channel multi-object sound processing apparatus, characterized in that the sound image localizes only a small number of pre-selected sound source signals among a plurality of input multi-channel multi-object sound source signals to provide a sense of location and space in the sound image.
PCT/KR2020/016770 2019-12-17 2020-11-25 Multi-channel multi-object sound source processing device for improving communication clarity of intercom system WO2021125599A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020190168503A KR102283964B1 (en) 2019-12-17 2019-12-17 Multi-channel/multi-object sound source processing apparatus
KR10-2019-0168503 2019-12-17

Publications (1)

Publication Number Publication Date
WO2021125599A1 true WO2021125599A1 (en) 2021-06-24

Family

ID=76478437

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2020/016770 WO2021125599A1 (en) 2019-12-17 2020-11-25 Multi-channel multi-object sound source processing device for improving communication clarity of intercom system

Country Status (2)

Country Link
KR (1) KR102283964B1 (en)
WO (1) WO2021125599A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102559015B1 (en) * 2021-10-26 2023-07-24 주식회사 라온에이엔씨 Actual Feeling sound processing system to improve immersion in performances and videos
KR102420977B1 (en) 2021-12-22 2022-07-15 한화시스템 주식회사 Encryption processing unit for inter-operation of radio, encryption unit and intercom, and intercommunication system and method using the same

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH1042399A (en) * 1996-02-13 1998-02-13 Sextant Avionique Voice space system and individualizing method for executing it
KR20040037437A (en) * 2002-10-28 2004-05-07 한국전자통신연구원 Object-based three dimensional audio system and control method
KR20160061977A (en) * 2013-07-22 2016-06-01 프라운호퍼 게젤샤프트 쭈르 푀르데룽 데어 안겐반텐 포르슝 에. 베. Method and signal processing unit for mapping a plurality of input channels of an input channel configuration to output channels of an output channel configuration
JP2018509864A (en) * 2015-02-12 2018-04-05 ドルビー ラボラトリーズ ライセンシング コーポレイション Reverberation generation for headphone virtualization
KR20190076506A (en) * 2017-12-22 2019-07-02 한국항공우주산업 주식회사 Stereo sound apparatus for aircraft and output method thereof

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101501133B1 (en) 2013-02-26 2015-03-11 한국항공우주산업 주식회사 Dynamic Stall Warning Display Device for the Helicopter Mission Computer and Controlling Method for the Same

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH1042399A (en) * 1996-02-13 1998-02-13 Sextant Avionique Voice space system and individualizing method for executing it
KR20040037437A (en) * 2002-10-28 2004-05-07 한국전자통신연구원 Object-based three dimensional audio system and control method
KR20160061977A (en) * 2013-07-22 2016-06-01 프라운호퍼 게젤샤프트 쭈르 푀르데룽 데어 안겐반텐 포르슝 에. 베. Method and signal processing unit for mapping a plurality of input channels of an input channel configuration to output channels of an output channel configuration
JP2018509864A (en) * 2015-02-12 2018-04-05 ドルビー ラボラトリーズ ライセンシング コーポレイション Reverberation generation for headphone virtualization
KR20190076506A (en) * 2017-12-22 2019-07-02 한국항공우주산업 주식회사 Stereo sound apparatus for aircraft and output method thereof

Also Published As

Publication number Publication date
KR20210077169A (en) 2021-06-25
KR102283964B1 (en) 2021-07-30

Similar Documents

Publication Publication Date Title
US20220116723A1 (en) Filter selection for delivering spatial audio
US9578440B2 (en) Method for controlling a speaker array to provide spatialized, localized, and binaural virtual surround sound
US6839438B1 (en) Positional audio rendering
US9674629B2 (en) Multichannel sound reproduction method and device
EP2503800B1 (en) Spatially constant surround sound
US20040252849A1 (en) Microphone array for preserving soundfield perceptual cues
KR20170106063A (en) A method and an apparatus for processing an audio signal
WO2021125599A1 (en) Multi-channel multi-object sound source processing device for improving communication clarity of intercom system
CN102256192A (en) Individualization of sound signals
JP2008543144A (en) Acoustic signal apparatus, system, and method
JPH10174200A (en) Sound image localizing method and device
WO2020151837A1 (en) Method and apparatus for processing a stereo signal
KR20190083863A (en) A method and an apparatus for processing an audio signal
US20210243544A1 (en) Surround Sound Location Virtualization
WO2008135049A1 (en) Spatial sound reproduction system with loudspeakers
US20230300552A1 (en) Systems and methods for providing augmented audio
CN111327980A (en) Hearing device providing virtual sound
CN112740326A (en) Apparatus, method and computer program for controlling band-limited audio objects
CN113301294B (en) Call control method and device and intelligent terminal
JPH07264700A (en) Sound image localization device
WO2017211448A1 (en) Method for generating a two-channel signal from a single-channel signal of a sound source
US11924619B2 (en) Rendering binaural audio over multiple near field transducers
US11968517B2 (en) Systems and methods for providing augmented audio
US20240022855A1 (en) Stereo enhancement system and stereo enhancement method
JP2635684B2 (en) Stereo audio transmission system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20901470

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20901470

Country of ref document: EP

Kind code of ref document: A1