KR101038574B1 - 3D Audio localization method and device and the recording media storing the program performing the said method - Google Patents

Abstract

The present invention relates to a three-dimensional audio sound image positioning method and apparatus, and a recording medium on which a program for implementing the method is recorded. More specifically, the present invention relates to a panning frequency region and a non-bumping frequency region with different panning methods. The present invention relates to a three-dimensional audio sound image positioning method and apparatus capable of realizing more accurate image positioning, and a recording medium on which a program for implementing the method is recorded.

Three-dimensional image positioning processing method according to an embodiment of the present invention includes a bumping frequency extraction step of extracting a bumping frequency band in which bumping (bumping) occurs from the frequency domain signal of the sound source signal; And inter-channel time difference (ICTD) and inter-level level difference (i.e., phase modulation values for reproducing interaural time difference (ITD) so as to perform a sound phase alignment for signals in the bumping frequency band). And a vector base complex amplitude panning (VBCAP) step of calculating an inter channel level difference (ICLD), which is a magnitude modulation value for reproducing interaural level difference (ILD).

In addition, the three-dimensional sound image processing apparatus according to an embodiment of the present invention includes a frequency extraction unit for extracting the bumping frequency band and the bumping frequency band except the bumping frequency band where bumping occurs from the frequency domain signal of the sound source signal, respectively; Inter channel time difference (ICTD), which is a phase modulation value, and inter channel level, which is a magnitude modulation value, for a signal in the bumping frequency band so as to perform sound phase alignment with respect to the sound source signal. a panning calculation unit for calculating a difference (ICLD) and calculating a vector base amplitude panning (VBAP) value, which is a magnitude modulation value, for a signal of a non-bumping frequency band; For the signals in the bumping frequency band, the level difference value (ICLD) and the inter-channel time delay value (ICTD) are applied to each of the signals input to the plurality of speakers so that sound phase alignment is applied to the signals of the non-bumping frequency band. For example, the panning value applying unit may be configured to apply a magnitude panning value to each of the signals input to the plurality of speakers so that sound image alignment is performed.

Acoustic Stereotactic Position, Head Transfer Function, Intuition Time Delay Difference, Intuition Level Difference

Description

3D audio localization method and device and recording medium on which program implementing the method is recorded {3D Audio localization method and device and the recording media storing the program performing the said method}

The present invention relates to a three-dimensional audio sound image positioning method and apparatus, and a recording medium on which a program for implementing the method is recorded. More specifically, the present invention relates to a panning frequency region and a non-bumping frequency region with different panning methods. The present invention relates to a three-dimensional audio sound image positioning method and apparatus capable of realizing more accurate image positioning, and a recording medium on which a program for implementing the method is recorded.

Audio visual technology is rapidly converging on integrated media technology. The study of audio visual technology has recently increased rapidly. The development of multimedia has provided new applications and research topics in the field of audio and sound, and the main research topics are virtual reality and virtual acoustic environment.

Accurate three-dimensional image positioning of virtual sound sources is one of the key research areas in audio visual technology. The purpose of such a three-dimensional audio system is to reproduce the intended sound around the listener's ear.

The Vector Base Amplitude Panning (VBAP) method, which is generally used for three-dimensional image positioning, transfers the same sound source from the listener to two or more equally spaced speakers at an appropriate size. to be. At this point, the listener recognizes the auditory object at an arbitrary point. The recognized auditory object is called a virtual source or a phantom source.

In more detail, assuming that two or more speakers are located in different directions at equal intervals from the listener, the vector-based size panning (VBAP) method allows the signal input to each speaker to be xi (t ) = gi * x (t), i = 1, 2, ..., N

Where xi (t) is the signal input to the i-th speaker at time t, x (t) is the sound signal of the same magnitude at time t, gi is the magnitude gain according to the channel of each speaker, and N is The number of speakers.

When the signal xi (t) input to each of these speakers is amplified through the speaker and reaches the listener's ear, the signals are combined at the listener's ear and form a new signal. The properties of these signals define the perceived phonetic position, which is called the summative phonetic position.

On the other hand, according to the conventional stereotactic method and apparatus using a vector-based VBAP method, due to bumping in a specific frequency band, the desired interaural time difference (ITD) in the listener's ear. There was a problem in that it did not produce Interaural level difference (ILD) information.

For example, when two speakers 10 and 20 are symmetrically placed on both sides in the front horizontal plane direction of the listener as shown in FIG. 1, and the unfolded angle θ ₀ is 60 degrees, a frequency band around 1700 Hz There is a problem in that the in-ear time delay difference (ITD) and the in-ear level difference (ILD) do not produce proper information due to severe bumping, so that the listener does not recognize the angle θ _T which is the angle of the virtual sound source 30 in detail. .

When the frequency band of the sound source signal is 1700 Hz, the wavelength becomes approximately 190 mm. And, in the stereo listening environment, the difference in transmission path length between one speaker and both ears is 80-100 mm. In this frequency domain, the sound source signal arriving from the speaker 20 on the other side in the left ear direction of the listener has a time delay of about half a cycle when compared with the sound source signal arriving from the one side speaker 10. This is because the cancellation of the signal occurring at this time causes bumps in the ear level difference (ILD) and also bumps the ear time delay (ITD).

The present invention calculates a sound source signal in the bumping frequency region and the non-bumping frequency region by using a different panning method and applies the same to the input signal of the speaker to realize the 3D sound image alignment, thereby realizing more accurate 3D sound image alignment. It is an object of the present invention to provide a recording medium in which a three-dimensional audio image positioning method and apparatus and a program for implementing the method are recorded.

Other objects and advantages of the present invention can be understood by the following description, and will be more clearly understood by the embodiments of the present invention. Also, it will be readily appreciated that the objects and advantages of the present invention may be realized by the means and combinations thereof indicated in the claims.

The three-dimensional image positioning processing method according to an embodiment of the present invention includes a bumping frequency extraction step of extracting a bumping frequency band where bumping occurs from the frequency domain signal of the sound source signal; And inter-channel time difference (ICTD) and inter-level level difference (i.e., phase modulation values for reproducing interaural time difference (ITD) so as to perform a sound phase alignment for signals in the bumping frequency band). And a vector base complex amplitude panning (VBCAP) step of calculating an interchannel level difference (ICLD), which is a magnitude modulation value for reproducing interaural level difference (ILD).

In addition, the three-dimensional sound image processing method includes applying a bumping frequency panning value to apply the level difference between the channel (ICLD) and the inter-channel time delay value (ICTD) to each of the signals input to the plurality of speakers; It may further include.

Here, in the step of applying the bumping frequency panning value, when there are two speakers, the magnitude of each signal input to the two speakers is an ICLD value and a 1-ICLD value, and a time delay is required for sound image positioning among the plurality of speakers. The signal input to the speaker can be multiplied by the ICTD value.

Here, the bumping frequency band may be 1.1KHz to 2.6KHz.

In addition, the bumping frequency band may be N multiples of 1.5KHz to 1.9KHz.

In addition, a (θ, m, k), which is a level difference value ICLD between channels, may be expressed by the following equation.

[Equation]

는 스피커의 페이즈 응답 값,

,

는 청취자의 양쪽 귀에서 원하는 각도 θ에 해당하는 머리 전달 함수(Head related transfer function; HRTF)이다.Where the subscript R is the listener's right ear, L is the listener's left ear, θ is the angle between the listener's front and the speaker, k is the critical band index, m is the time index, and A (k) Is the size correction value of the preset speaker,

Is the speaker's phase response value,

,

Is a Head related transfer function (HRTF) corresponding to the desired angle θ at both ears of the listener.

In addition, b ^{*, which} is an inter-channel time delay value ICTD, may be expressed by the following equation.

[Equation]

형태로 곱해진다.Here, when the inter-channel time delay value (ICTD) is multiplied by the input signal of the speaker requiring the time delay,

Multiply by form

The 3D sound image processing method may further include a Fourier analysis step of converting the sound source signal from the signal in the time domain to the signal in the frequency domain.

Here, the signal in the frequency domain includes a bumping frequency band and a non-bumping frequency band excluding the bumping frequency band, and the 3D sound image processing method extracts a non-bumping frequency band for extracting the non-bumping frequency band from the frequency region signal of the sound source signal. And a vector base amplitude panning (VBAP) step of calculating a vector based magnitude panning value so that sound image positioning is performed on a signal of a non-bumping frequency band; And applying a non-bumping frequency panning value to apply the magnitude panning value of the signal of the non-bumping frequency band to each of the signals input to the plurality of speakers.

Here, the three-dimensional sound image processing method may further include a summing step of summing the signal of the frequency band to which the bumping frequency panning value is applied and the signal of the frequency band to which the non-bumping frequency panning value is applied.

In addition, the three-dimensional sound image processing apparatus according to an embodiment of the present invention includes a frequency extraction unit for extracting the bumping frequency band and the bumping frequency band except the bumping frequency band where bumping occurs from the frequency domain signal of the sound source signal, respectively; Inter-channel time difference (ICTD), which is a phase modulation value, and inter-channel level difference, which is a magnitude modulation value, for a signal in the bumping frequency band in order to perform sound phase alignment with respect to the sound source signal. a panning calculation unit for calculating a difference (ICLD) and calculating a vector base amplitude panning (VBAP) value, which is a magnitude modulation value, for a signal of a non-bumping frequency band; For the signals in the bumping frequency band, the level difference value (ICLD) and the inter-channel time delay value (ICTD) are applied to each of the signals input to the plurality of speakers so that sound phase alignment is applied to the signals of the non-bumping frequency band. For example, the panning value applying unit may be configured to apply the magnitude panning value to each of the signals inputted to the plurality of speakers so that the sound image alignment is performed.

Here, the 3D sound image processing apparatus may further include a Fourier analysis unit for converting a sound source signal from a signal in the time domain to a signal in the frequency domain.

Here, the 3D sound image processing apparatus may further include an adder configured to add a signal of a frequency band to which the bumping frequency panning value is applied and a signal of a frequency band to which the non-bumping frequency panning value is applied.

Here, the frequency extractor may include a bumping frequency extractor extracting a bumping frequency band and a non-bumping frequency extractor extracting a non-bumping frequency band.

Here, the bumping frequency band may be 1.1KHz to 2.6KHz.

Here, the bumping frequency band may be N multiples of 1.5KHz to 1.9KHz.

Here, the panning calculation unit includes a vector base complex amplitude panning (VBCAP) unit and a magnitude base panning calculation unit (VBCAP) unit, and the complex panning calculation unit (VBCAP) unit performs a sound phase positioning on a signal of a bumping frequency band. Inter channel time difference (ICTD) and interaural level difference (ILD) for reproducing interaural time difference (ITD) An inter-channel level difference (ICLD) is calculated, and a magnitude panning calculation (VBAP) unit can calculate a vector-based magnitude panning value so that sound phase alignment is performed for a signal in an unbumped frequency band. have.

The panning value applying unit may include a bumping frequency panning value applying unit and a non-bumping frequency panning value applying unit. The non-bumping frequency panning value applying unit may apply a magnitude panning value for a signal in the non-bumping frequency band so that the sound phase is applied to each of the signals input to the plurality of speakers. have.

Also, when the plurality of speakers have two speakers, the bumping panning value applying unit has an ICLD value and a 1-ICLD value for each of the signals inputted to the two speakers. The input signal can be multiplied by the ICTD value.

In addition, the computer-readable recording medium according to an example of the present invention includes a recording medium on which a program for implementing the method is recorded.

3D audio image positioning method and apparatus according to the present invention, and a recording medium on which a program for implementing such a method is recorded, uses a vector-based complex size panning method (VBCAP) for a sound source signal in a bumping frequency domain, and uses a non-bumping frequency. For the sound source signal in the region, a panning value is obtained by using a vector-based magnitude panning method (VBAP), and applied to the input signal of the speaker, respectively, to further improve and achieve accurate sound positioning.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

First, in adding reference numerals to the components of each drawing, it should be noted that the same reference numerals are assigned to the same components as much as possible, even if shown on different drawings. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. In addition, the following will describe a preferred embodiment of the present invention, but the technical idea of the present invention is not limited thereto and may be variously modified and modified by those skilled in the art.

2A and 2B are diagrams for explaining an example of the three-dimensional sound image processing apparatus according to the present invention.

As shown in FIG. 2A, the three-dimensional sound image processing apparatus for positioning a generation position of a specific sound source signal felt by a listener at a virtual position includes a Fourier analyzer 100, a frequency extractor 200, and a panning calculator 300. ), A panning value applying unit 400 and a summing unit 500 may be included.

The Fourier analyzer 100 converts a sound source signal from a signal in the time domain to a signal in the frequency domain. In this case, when the sound source signal is converted from the time domain to the frequency domain, it can be converted into a predetermined time unit. For example, it can be converted into a frame unit of the sound source signal, and one frame is divided into several time domains. You can also convert to the frequency domain for each time domain.

As described above, when the sound source signal in the time domain is converted into the sound source signal in the frequency domain, the sound source signal in the frequency domain includes the non-bumping frequency bands except for the bumping frequency bands f1 to f2 and f1 to f2 as shown in FIG. 2B. .

Here, the bumping frequency band will be described in more detail. In the case where only the vector-based magnitude panning (VBAP) method is used to implement the sound localization, the desired interaural time difference (ITD) in the listener's ear in a specific frequency band is desired. Because it does not properly generate the interaural level difference (ILD) information and does not realize the desired sound location, such a specific frequency band is called a bumping frequency band.

Such a bumping frequency band may be different depending on the angle between the listener and the arranged speakers with respect to the listener and the distance between the listener and the arranged speakers.

Thus, such a bumping frequency band may be almost absent when the angle between the listener and the speakers is narrow, for example, when the placed speakers are placed toward the listener's left ear, but the arranged speakers may not appear. The bumping frequency bands appear more clearly if they are symmetrically arranged at appropriate angles on both sides of the.

Such a bumping frequency band is generally formed between 1.1KHz and 2.6KHz when two stereo speakers are arranged and the speakers to be arranged symmetrically to the left and right of the listener. In a typical stereo listening environment with an angle of 60 degrees, bumping frequencies occur around 1.7 KHz.

The frequency extractor 200 extracts the bumping frequency band where bumping occurs and the non-bumping frequency band except for the bumping frequency band from the frequency domain signal of the sound source signal.

This is to apply the panning method differently according to each frequency characteristic in order to realize proper image positioning by separating the signals of the bumping frequency band and the signals of the non-being frequency band, respectively.

The frequency extractor 200 may include a bumping frequency extractor 210 extracting a bumping frequency band and a non-bumping frequency extractor 220 extracting a non-bumping frequency band.

As such, the bumping frequency band extracted by the bumping frequency extractor 210 may be 1.1 KHz or more and 2.6 KHz or less.

This means that the interaural time difference (ITD) of the panned virtual source is consistent in the low frequency band below 1100 Hz when only the vector-based magnitude panning (VBAP) method is used to implement the sound phase. The interaural level difference (ILD) information is almost identical to the intermittent time delay difference (ITD) information at low frequencies.

However, in the frequency band between 1100 Hz and 2600 Hz, signal deviation in the frequency band where bumping occurs (1100 Hz to 2600 Hz) distracts the direction of the virtual source, causing the listener to perceive the direction of the sound source in the wrong direction as a whole. All of the level difference (ILD) and the time delay difference (ITD) information may be out of the interaural time difference angle (ITDA), thereby preventing accurate sound positioning.

Accordingly, in the bumping frequency region, a panning value is calculated by a vector base complex amplitude panning (VBCAP) method, which will be described later, to implement more accurate sound localization.

In addition, the bumping frequency band extracted by the bumping frequency extractor 210 may be N multiples of 1.5KHz to 1.9KHz.

This is because in a typical stereo listening environment where the angle of the speaker is approximately 60 degrees left and right with respect to the listener, the band of the bumping frequency is formed at an N multiple of approximately 1.5KHz to 1.9KHz.

The panning calculator 300 performs an interphase time delay value (ICTD), which is a phase modulation value, and an interchannel level, which is a phase modulation value, for a signal of a bumping frequency band so that sound image positioning is performed on the sound source signal. It calculates a difference value (ICLD) and calculates a vector base amplitude panning (VBAP) value, which is a magnitude modulation value, for a signal in a non-bumping frequency band.

In more detail, the panning calculator 300 may include a vector base complex amplitude panning (VBCAP) unit 310 and a vector base amplitude panning (VBAP) unit 320.

Here, the complex panning calculation (VBCAP) unit 310 is a phase delay between channels, which is a phase modulation value for reproducing the interaural time difference (ITD) in order to perform a sound phase alignment for a signal of a bumping frequency band. An interchannel level difference (ICLD), which is a magnitude modulation value for reproducing a value (Interchannel time difference (ICTD) and an interaural level difference (ILD), is calculated.

Here, a (θ, m, k), which is a level difference value ICLD between channels, may be expressed by Equation 1 below.

는 스피커의 페이즈 응답 값, 아래첨자 R은 청취자의 오른쪽 귀, L은 청취자의 왼쪽 귀이고,

,

는 양쪽 귀에서 원하는 각도 θ에 해당하는 머리 전달 함수(Head related transfer function; HRTF)이다. Where θ is the angle between the front of the listener and the speaker, k is the critical band index, m is the time index, and A (k) is the preset size correction value of the speaker,

Is the phase response value of the speaker, subscript R is the listener's right ear, L is the listener's left ear,

,

Is a head related transfer function (HRTF) corresponding to the desired angle θ at both ears.

Here, a head-related transfer function (HRTF) is a frequency axis representing a sound transmission characteristic of a sound source signal from a sound source at a specific position in a free sound field to an ear canal of a human ear. It means the transfer function of and includes linear distortion by the human head, auricle and upper body.

In addition, A (k) may be changed according to an angle and a distance formed by a position of a speaker disposed with the listener as a preset size correction value of the speaker.

In addition, b *, which is an interchannel time delay value ICTD, may be expressed by Equation 2 below.

형태로 곱해진다.Here, when the inter-channel time delay value (ICTD) is multiplied by the input signal of the speaker requiring the time delay,

Multiply by form

In addition, the magnitude panning calculation (VBAP) unit 320 calculates a vector-based magnitude panning value, which is a gain value of the speaker, to perform sound phase alignment with respect to a signal of a non-bumping frequency band.

The calculation of the vector-based magnitude panning (VBAP) value may be expressed as Equation 3 when there are two speakers.

Where g1 and g2 are gain values to be delivered to each speaker, θ _T is the angle between the front of the listener and the virtual sound source, and θ ₀ is the angle between the front of the listener and the symmetrical speaker (see FIG. 1).

The panning value application unit 400 applies a level difference value ICLD and an interchannel time delay value ICTD to signals of bumping frequency bands so that sound phase alignment is performed on each of the signals input to the plurality of speakers. For signals in the non-bumping frequency band, the magnitude panning value is applied to the sound phase alignment to each of the signals input to the plurality of speakers.

More specifically, the panning value applying unit 400 may include a bumping frequency panning value applying unit 410 and a non-bumping frequency panning value applying unit 420.

Here, the bumping frequency panning value applying unit 410 may apply the level difference value ICLD and the inter-channel time delay value ICTD to the sound phase alignment for each of the signals input to the plurality of speakers.

For example, when the bumping frequency panning value applying unit 410 has two speakers, the magnitude of each signal input to the two speakers is an ICLD value and a 1-ICLD value, and the time for sound localization among the plurality of speakers is increased. The complex panning calculation value of the bumping frequency may be applied to the signal input to the speaker requiring the delay by multiplying the ICTD value.

An example of an equation in which the complex panning calculation value is applied to each speaker may be expressed as in Equation 4.

Here, Y _L (θ, m, k) is a signal to which the complex panning calculation value input to the listener's left speaker is applied, and Y _R (θ, m, k) is the complex panning calculation value input to the listener's right speaker. This is the applied signal.

As such, when the complex panning calculation value is applied to each speaker, the signal input to the ear of the hearing ear may be expressed as in Equation 5.

Here, X _L (θ, m, k) is a sound source signal input to the listener's left ear, and X _R (θ, m, k) is a sound source signal input to the listener's right ear.

In this way, the sound source signal input to one side of the listener is a value obtained by multiplying the input sound source signal of the speaker disposed on the other side of the listener by a preset amplitude correction value of the speaker and a phase modulation value for the ear delay time (ICTD). It is expressed as the sum of the input source signal of the speaker disposed on one side of the listener to solve the bumping problem due to the phase difference of the source signal.

In addition, the non-bumping frequency panning value applying unit 420 functions to apply a magnitude panning value for a signal of the non-bumping frequency band so that sound phase alignment is performed on each of the signals input to the plurality of speakers. Such a non-bumping frequency panning value applying unit 420 applies a panning value to each of the signals input to the plurality of speakers, so that a stereotype is generally performed in the frequency domain. Vector base amplitude panning (VBAP) ) Is the same as the method to apply each speaker input signal.

The adder 500 functions to add a signal in a frequency band to which a bumping frequency panning value is applied and a signal in a frequency band to which a non-bumping frequency panning value is applied.

After that, it is possible to implement accurate image positioning by a commonly used three-dimensional image positioning method.

The 3D sound image processing apparatus according to the present invention solves the problem of bumping in a specific frequency band, which is a problem in the method of implementing sound image alignment by adjusting only the size of a conventional speaker. As a result, vector-based size panning for the non-bumping frequency band ( Vector Base Amplitude Panning (VBAP) method, and Vector Base Complex Amplitude Panning (VBCAP) to multiply the inter-channel time delay (ICTD) and the inter-channel level difference (ICLD) only for the bumping frequency band. This can be solved by using the method.

Meanwhile, the above-described embodiments of the present invention can be written in a program that can be executed in a computer, and can be implemented in a general-purpose digital computer that operates a program using a computer-readable recording medium. Computer-readable recording media include magnetic storage media (e.g., ROM, floppy disks, hard disks, magnetic tape, etc.), optical reading media (e.g., CD-ROM, DVD, optical data storage devices, etc.); Storage media such as carrier waves (eg, transmission over the Internet).

The above description is merely illustrative of the technical idea of the present invention, and various modifications, changes, and substitutions may be made by those skilled in the art without departing from the essential characteristics of the present invention. will be. Accordingly, the embodiments disclosed in the present invention and the accompanying drawings are not intended to limit the technical spirit of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by the embodiments and the accompanying drawings. . The protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the equivalent scope should be interpreted as being included in the scope of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a view for explaining a problem of sound localization using a conventional vector-based magnitude panning (VBAP) method.

2A and 2B are diagrams for explaining an example of the three-dimensional sound image processing apparatus according to the present invention.

<Description of reference numerals for the main parts of the drawings>

100: Fourier analysis unit 200: Frequency extraction unit

300: panning calculation unit 400: panning value applying unit

500: summing

Claims (23)

A Fourier analysis step of converting the input sound source signal from the signal in the time domain to the signal in the frequency domain; The frequency extractor is configured to generate a bumping frequency band in which bumping occurs that prevents an interaural time difference (ITD) and interaural level difference (ILD) information from the frequency domain signal of the sound source signal. Extracting a bumping frequency; And An inter-channel time difference (ICTD) and an inter-channel time delay value (ICTD), which is a phase modulation value for reproducing an interaural time difference (ITD), so that a panning calculation unit performs sound phase alignment with respect to the signal of the bumping frequency band. A vector base complex amplitude panning (VBCAP) step of calculating an inter channel level difference (ICLD), which is a magnitude modulation value for reproducing an interaural level difference (ILD); 3D sound image positioning processing method comprising a. The method of claim 1, The three-dimensional image positioning processing method A bumping frequency panning value applying step of the panning value applying unit applying the level difference value ICLD and the inter-channel time delay value ICTD to each of the signals input to a plurality of speakers so that sound phase alignment is performed; 3D sound image stereotactic processing method further comprising. The method of claim 2, Applying the bumping frequency panning value is If the plurality of speakers are two, The magnitude of each signal inputted to the two speakers by the panning value applying unit is an ICLD value and a 1-ICLD value, and a signal input to a speaker requiring a time delay for sound image positioning among the plurality of speakers is multiplied by an ICTD value. that 3D sound image stereotactic processing method characterized in that. The method of claim 1, The bumping frequency band is 1.1KHz ~ 2.6KHz three-dimensional sound image processing method characterized in that. The method of claim 1, And the bumping frequency band is N multiples of 1.5 KHz to 1.9 KHz. The method of claim 1, A (θ, m, k), which is the level difference value ICLD between the channels, is represented by the following equation.

Where subscript R is the listener's right ear, L is the listener's left ear, θ is the angle between the listener's front and the speaker, k is the critical band index, m is the time index, A (k) is the size correction value of the preset speaker,

Is the speaker's phase response value,

,

Is a head related transfer function (HRTF) corresponding to a desired angle θ at both ears of the listener. The method of claim 1, B ^* , the inter-channel time delay value (ICTD), is represented by the following equation

Where the inter-channel time delay value (ICTD) is multiplied by the input signal of the speaker requiring the time delay,

A three-dimensional sound image processing method characterized in that the multiplication in the form. delete The method of claim 2, The signal in the frequency domain includes a non-bumping frequency band except for the bumping frequency band and the bumping frequency band, The three-dimensional image positioning processing method A non-bumping frequency extracting step of extracting, by the frequency extracting unit, a non-bumping frequency band from a frequency domain signal of the sound source signal; A vector base amplitude panning (VBAP) step of calculating, by the panning calculator, a vector-based magnitude panning value in order to perform a sound image positioning on the signal of the non-bumping frequency band; And A non-bumping frequency panning value applying step of applying, by the panning value applying unit, a magnitude panning value for the signal of the non-bumping frequency band so that sound phase alignment is performed on each of the signals input to a plurality of speakers; 3D sound image stereotactic processing method further comprising. The method of claim 9, The three-dimensional image positioning processing method A summing step of adding a signal of a frequency band to which the bumping frequency panning value is applied and a signal of a frequency band to which the non-bumping frequency panning value is applied; 3D sound image stereotactic processing method further comprising. A Fourier analysis unit converting the input sound source signal into a signal in the frequency domain from a signal in the time domain; A frequency extractor for extracting a bumping frequency band where bumping occurs and a non-bumping frequency band except for the bumping frequency band from the frequency domain signal of the sound source signal, respectively; And The inter-channel time difference (ICTD), which is a phase modulation value, and the inter-channel level difference value, which is a magnitude modulation value, for the signals of the bumping frequency band in order to perform sound phase alignment with respect to the sound source signal. a panning calculator for calculating a level difference (ICLD) and calculating a vector base amplitude panning (VBAP) value that is a magnitude modulation value for the signal in the non-bumping frequency band; 3D sound image processing apparatus comprising a. delete The method of claim 11, The three-dimensional sound image processing apparatus An adder configured to add a signal of a frequency band to which the bumping frequency panning value is applied and a signal of a frequency band to which the non-bumping frequency panning value is applied; Three-dimensional sound image processing apparatus further comprises a. The method of claim 11, And the frequency extracting unit comprises a bumping frequency extracting unit extracting the bumping frequency band and a non-bumping frequency extracting unit extracting the non-bumping frequency band. The method of claim 14, The bumping frequency band is 1.1KHz ~ 2.6KHz three-dimensional sound image processing device, characterized in that. The method of claim 14, The bumping frequency band is a three-dimensional sound image processing device, characterized in that N multiples of 1.5KHz ~ 1.9KHz. The method of claim 11, The panning calculator includes a vector base complex amplitude panning (VBCAP) unit and a vector base amplitude panning (VBAP) unit. The complex panning calculation unit (VBCAP) is an inter-channel time difference that is a phase modulation value for reproducing an interaural time difference (ITD) so that sound phase positioning is performed on the signal of the bumping frequency band. Calculate interchannel level difference (ICLD), which is a magnitude modulation value for reproducing ICTD and interaural level difference (ILD), The magnitude panning calculation (VBAP) unit calculates a vector-based magnitude panning value such that sound phase alignment is performed on a signal of the non-bumping frequency band. Three-dimensional sound image processing apparatus, characterized in that. The method of claim 17, A (θ, m, k), which is the level difference value ICLD between the channels, is represented by the following equation.

Where subscript R is the listener's right ear, L is the listener's left ear, θ is the angle between the listener's front and the speaker, k is the critical band index, m is the time index, A (k) is the size correction value of the preset speaker,

Is the speaker's phase response value,

,

Is a head related transfer function (HRTF) corresponding to a desired angle θ at both ears. The method of claim 17, B ^* , the inter-channel time delay value (ICTD), is represented by the following equation

Where the inter-channel time delay value (ICTD) is multiplied by the input signal of the speaker requiring the time delay,

3D sound image processing apparatus characterized in that the multiplication in the form. The method of claim 11, A panning value applying unit for applying the magnitude panning value to each of the signals input to the plurality of speakers with respect to the signal of the non-bumping frequency band; Three-dimensional sound image processing apparatus further comprises a. The method of claim 20, The panning value applying unit includes a bumping frequency panning value applying unit and a non-bumping frequency panning value applying unit. The bumping frequency panning value applying unit applies the level difference value ICLD and the time delay value ICTD between the channels so that sound phase is placed on each of the signals input to the plurality of speakers. The non-bumping frequency panning value applying unit applies a magnitude panning value for the signal in the non-bumping frequency band so that sound phase alignment is performed on each of the signals input to the plurality of speakers. Three-dimensional sound image processing device characterized in that. The method of claim 21, The bumping panning value applying unit If the plurality of speakers are two, The magnitude of each signal input to the two speakers is an ICLD value and a 1-ICLD value, and the signal input to the speaker that requires a time delay for sound image positioning among the plurality of speakers is multiplied by the ICTD value. Three-dimensional sound image processing device characterized in that. In a computer-readable recording medium, A recording medium on which a program for implementing the method according to any one of claims 1 to 10 is recorded.

Images