JPH07230283A - Sound image localization device - Google Patents

Abstract

PURPOSE:To realize the movement of a sound image so as to give more realistic feeling compared with conventional one by outputting acoustic signals in which elements other than volume element among elements specifying a sound are varied in accordance variables with a sound image position as the variable. CONSTITUTION:MIDI data transmitted from a sequencer are inputted to a sound image localization device 10 through a MIDI interface 15. A MIDI sound source 16 and a sound image localization means 17 are connected to the device 10 and the inputted MIDI data are inputted to the source 16. In the source 16, acoustic signals of a prescribed tone color and a pitch are generated based on the MIDI data. The signals are inputted to the means 17, sound image localization is added, inputted to an acoustic device 30, a sound image is localized at a prescribed sound image position in a space and sounded to the space as acoustic of the prescribed tone color and pitch.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a sound image localization device for providing an input sound signal with a sound image localized at a predetermined sound image position.

[0002]

2. Description of the Related Art A sound image localization device that localizes a sound image in a predetermined direction centered on a listener in a three-dimensional space is known (see, for example, Japanese Patent Application Laid-Open No. 4-30700), and a sound image localization that localizes only in this direction is known. A sound image localization device that localizes not only the direction but also the distance by combining the device with a sound reflected from the floor has been considered (for example, Japanese Patent Application No. 4-18).
0931).

Further, it is considered that not only the sound image is localized at a stopped position in space but also the sound image is temporally moved (see, for example, Japanese Patent Application No. 5-156700).

[0004]

By the way, when a sound source moves, a relatively high frequency sound can be heard when the sound source approaches, and a relatively low frequency sound can be heard when the sound source moves away. , The so-called Doppler effect occurs. Also, due to the acoustic transfer characteristics of air as an acoustic medium, low frequency sound propagates far, and high frequency sound is severely attenuated by the propagation distance.
For example, when you hear the sound of a jet plane nearby, you can hear a relatively high frequency sound of "Kean" generated by the rotation of the turboprop, and when the jet plane leaves, the sound of "Keen" is replaced with a relatively low frequency. ”
There is a phenomenon in which the timbre changes depending on the distance to the sound source, such as when you hear a "go" sound.

However, the conventional sound image localization device basically determines the direction of the sound image or the position of the sound image, and even when the sound image is moved, the static position of the sound image is merely momentarily changed. Although the sound image is certainly moved by only changing it, there is a problem that the sound image is not realistic enough when the sound image is moved at a high speed or the sound image is moved largely.

In view of the above circumstances, it is an object of the present invention to provide a sound image localization apparatus that realizes more realistic movement of a sound image as compared with the conventional one.

[0007]

The sound image localization apparatus of the present invention which achieves the above object is as follows: (1) An input acoustic signal is localized at a predetermined sound image position in space, which sequentially moves in time. Sound image localization means for imparting a sound image (2) An acoustic signal in which at least one element other than the sound volume among the elements defining sound is changed according to the variable, with the sound image position or a value derived from the sound image position as a variable It is characterized in that it is provided with a sound adjusting means for outputting.

Here, the "value derived from the sound image position" is not limited to a value calculated by a specific calculation method. For example, the distance between the sound image position and the listening position, the sound image, etc. The moving speed of the position (size and direction), the magnitude of the component of the moving speed in the direction toward the listening position, the moving acceleration of the sound image position, the component of the moving acceleration in the direction toward the listening position, or any of these It means a combination of two or three or more.

In the above sound image localization apparatus of the present invention, the sound adjusting means of (2) may change the input sound signal by a change of an element defining sound. The sound adjusting means of 1) may generate the sound signal in which the element defining the sound is changed. Here, the sound adjusting means may output a sound signal whose pitch changes according to the variable.
In this case, the change in pitch according to the above variable may be a change in pitch simulating the Doppler effect accompanying the movement of the sound image.

Further, the sound adjusting means may output a sound signal having a tone color changed according to the variable. In this case, the change in tone color according to the above variable is a change in tone color that simulates the acoustic transfer characteristics of the acoustic medium (for example, air or water, or a virtual acoustic medium) between the sound image position and the listening position. Good. When the acoustic adjustment means outputs an acoustic signal with a changed tone color, the acoustic adjustment means includes an acoustic generation unit that generates a plurality of acoustic signals representing respective sounds having different tone colors, and the acoustic generation unit. The plurality of acoustic signals may be switched in accordance with the above variables, or may be combined with a timbre converter that outputs the weighted additions with weights according to the above variables.

[0011]

According to the sound image localization apparatus of the present invention, the sound adjusting means of the above (2), that is, the sound image position or a value derived from the sound image position, for example, the distance between the sound image position and the listening position, the time of the distance. The sound adjustment means is provided which outputs a sound signal in which at least one element other than the sound volume, for example, the pitch (pitch) or the timbre is changed according to the variable by using the dynamic change as a variable. Therefore, for example, the Doppler effect is applied along with the movement of the sound image, or the timbre is changed along with the movement of the sound image, so that the movement of the sound image is realized more realistically than in the past.

[0012]

EXAMPLES Examples of the present invention will be described below.
Here, first, the Doppler effect, the emphasis for impressing the Doppler effect more strongly in hearing, and the general pitch change function that extends the Doppler effect will be described.
Next, a change in tone color will be described, and then a specific example will be described.

Assume that the listener is at the origin of the three-dimensional coordinate system, and the sound image position before movement in the three-dimensional space is (x ₀ , y ₀ ,
z ₀ ), the sound image position after a unit time elapses is (x ₁ , y ₁ , z
₁ ), assuming that the original frequency of the sound image is f ₀ , the frequency f ₁ of the sound heard by the listener is f ₁ = f ₀ · C / [C− {√ (x ₀ ² + y ₀ ² due to the Doppler effect. ^{_{+ z 0 2) -√ (x}} 1 2 + y 1 2 + z 1 2)} ] where C is the sound velocity (if the medium is air about 331m / sec) ... (1) .

When moving the sound image, it is preferable to use the following equation instead of directly using the equation (1). f ₁ = α · f ₀ · C / [C− {√ (x ₀ ² + y ₀ ² + z ₀ ² ) −√ (x ₁ ² + y ₁ ² + z ₁ ² )}] (2) f ₁ = f ₀ C / [C−β · {√ (x ₀ ² + y ₀ ² + z ₀ ² ) −√ (x ₁ ² + y ₁ ² + z ₁ ² )}] (3) f ₁ = α · f ₀ · C / [C−β · {√ (x ₀ ² + y ₀ ² + z ₀ ² ) −√ (x ₁ ² + y ₁ ² + z ₁ ² )}] (4) where α and β represent coefficients.

Here, the expression (2) means that the change in frequency associated with the movement of the sound image is emphasized by α times (when α> 1), and the expression (3) expresses the moving speed of the sound image by β. Double emphasis (when β> 1) is meant, and expression (4) means that both of them are emphasized. However, α and β are not limited to values of 1.0 or more.
Set β <0 so that when the sound approaches, the frequency shifts to the lower side, and when the sound moves away, the frequency shifts to the higher side, giving a special acoustic effect that does not exist in the actual space. May be.

When each of the above equations is further expanded to a general equation and an arbitrary function is F, f ₁ = f ₀ · F (x ₀ , y ₀ , z ₀ , x ₁ , y ₁ , z ₁ ) A special effect according to (5) may be added to the acoustic signal. However, in the following, an embodiment that achieves the effect according to the equation (4) will be described. Next, a change in tone color will be described.

FIG. 1 is a diagram for explaining switching between two sounds having different timbres. Each tone tn1, tn
2 indicates a high-pitched sound having a relatively high frequency of “Kein” and a low-pitched sound having a frequency of “go” in the above-described jet aircraft example, respectively, and (V / | V |) on the horizontal axis. -V of L represents the moving speed of the sound image, and L represents the distance between the sound image and the listener. Therefore, the horizontal axis indicates that the sound image is farther from the listener as it moves away from the origin 0 (the position of the listener) to the left and right, and the right side of the origin 0 indicates that the sound image approaches the listener. 0
The left side of indicates that the sound image is moving away from the listener. That is, FIG. 1 shows that when the distance between the listener and the sound image is within the range of ₀ to P ₀ and the sound image is moving in the direction of approaching the listener, the tone color of “keen” of tn1. In other cases, the sound signal is switched to the sound signal of the tone color "go" of tn2.

FIG. 2 is another diagram for explaining switching between two sounds having different timbres. In the example shown here, the two tone colors tn1 and tn2 are not simply switched, but the mixing ratio of the two tone colors tn1 and tn2 is sequentially changed as the sound image approaches or the sound image moves away. There is no abrupt switching of, and it is possible to give a more realistic feeling.

An example of a sound image localization device that applies the Doppler effect and changes the tone color will be described below. FIG. 3 is a block diagram showing the configuration of the sound image localization apparatus of one embodiment of the present invention. This sound image localization device 10 has a CP
The U11 is installed, and various programs stored in the ROM 12 are input to the CPU 11 via the bus 13 and executed by using the RAM 14 as a work area. A MIDI interface 15 is connected to the sound image localization device. As will be described later, in this embodiment, a sequencer is connected to the sound image localization device 10 via the MIDI interface 15 and transmitted from the sequencer. MIDI data is input to the sound image localization apparatus 10 via the MIDI interface 15. Further, the MIDI image generated by the sound image localization device 10 or the MIDI data input from the sequencer is passed through the MIDI interface 15 to generate the sound image localization device 1.
It can also be sent to an external device connected to 0.

Further, the sound image localization device 10 has a MID
The I sound source 16 and the sound image localization means 17 are connected,
M input via MIDI interface 15
IDI data or MIDI data generated inside the sound image localization apparatus 10 is input to a MIDI sound source,
The MIDI sound source generates an acoustic signal of a predetermined tone color and pitch based on the input MIDI data. This acoustic signal is input to the sound image localization means 17 to which the sound image localization is applied, and is input to the acoustic device 30 which is connected to the sound image localization device 10 and includes an amplifier, a speaker, and the like, and is placed at a predetermined sound image position in space. When the sound image is localized,
It is emitted to the space as pitch sound.

Further, the sound image localization apparatus 10 has a CR
A T display 18, a keyboard 19 and a mouse 20 are provided. FIG. 4 is a functional block diagram of the sound image localization apparatus 10 shown in FIG. A sequencer 40 and a sound device 30 are connected to the sound image localization device 10. From the sequencer 40, note numbers, M and M are stored as MIDI data.
The IDI clock and music data are input. As described above, the acoustic signal generated by the MIDI sound source 16 and the sound image localized by the sound image localization means 17 is input to the acoustic device 30, and the acoustic device 30 emits the acoustic signal to the space.

The sound image localization device 10 is provided with a position / speed setting means 101. This position setting means 101
Stores a plurality of parameter groups each including a start point position, an end point position of a sound image, a moving speed of the sound image, and the like. Each set is associated with a note number.
The parameter group is stored in the RAM 14 shown in FIG.

When the note number is input from the sequencer 40, the parameter group corresponding to the note number is read from the position / speed setting means 101 to the position / speed setting storage means 102, and then in the position / speed calculating means 103.
It sequentially changes in time according to the MIDI clock input from the sequencer 40. Each sound image position is calculated and input as sound image localization information to the sound image localization means 17 and the effect calculation means 104. The effect calculation means 104 obtains the pitch change information and the tone color change information for instructing the change of the pitch tone color of the music, based on the inputted sound image localization information, and inputs them to the MIDI sound source 16. MIDI sound source 16
The music data transmitted from the sequencer 40 is also input to the MIDI sound source 16, and the MIDI sound source 16 uses the pitch change information and the tone color change information for the pitch, based on the music data.
An acoustic signal representing a musical piece whose tone color has been changed is generated. This acoustic signal is input to the sound image localization means 17.
In the sound image localization means 17, the MIDI sound source 16 is generated based on the sound image localization information sent from the position / velocity calculation means 103.
A sound image localization is added to the sound signal input from the sound source, the sound image localization is sent to the sound device 30 as a stereo sound signal, and the sound signal is emitted to the space as sound.

FIG. 5 shows the CRT display 1 shown in FIG.
9 is a diagram showing a parameter detection screen displayed in FIG. However, the alphabets A to U in this figure are symbols for specifying each region for the sake of convenience of the following description,
It is not displayed on the actual parameter setting screen. Also,
Start written in the vicinity of the areas A, B, C, ...
Symbols such as _X, start_Y, start_Z, ... Represent internal register names, and each area A, B, C ,.
Numerical values or flags input in correspondence with, etc. are stored, and these symbols are not displayed on the actual parameter setting screen.

The "initial position" is for designating the initial position of the movement of the sound image, and the mouse 20 (see FIG. 3) is operated to move the mouse pointer to any one of the areas A, B and C. When the mouse is clicked, the area is highlighted, and by inputting a numerical value with the keyboard 19, each coordinate position of x, y, z of the initial position is set. The “end position” is for designating the end position of the movement of the sound image, and each coordinate position of x, y, and z is designated.

The "moving speed" is for designating each moving amount in the x, y and z directions per clock. The "interval count" specifies how many clocks the sound image position is updated. Since there is "2" in the area J here, the sound image position is updated every two clocks.

The "starting note number" is for specifying the note number for specifying the parameter group specified on this screen. The "medium" represents a sound image propagation medium in the acoustic space to be simulated, and in the present embodiment, air or water is designated. This designation is performed by moving the mouse pointer to the area L or the area M and pressing the click button of the mouse.

The "pitch change" designates whether or not the pitch of the sound is changed in accordance with the movement of the sound image. In this embodiment, the formula (4) described above is adopted, and the pitch change is performed. When performing, the values of the coefficients α and β are also designated. “Tone color change” is for designating whether or not the tone color of the sound is changed in accordance with the movement of the sound image.
Two tones corresponding to (A) and FIG. 1 (B), respectively, and the P ₀ point shown in FIG. 1 are designated as the “change distance”,
As a result, the tone color switching process described with reference to FIG. 1 is performed.

After the designation of each area A to T or the substitution of numerical values is completed as described above, by moving the mouse pointer to the area U and clicking the mouse, the information of the screen is taken in. Hereinafter, a program executed by the CPU 11 shown in FIG. 3 for realizing the functions shown in FIG. 4 will be described. Note that the acoustic signal generation processing in the MIDI sound source 16 and the sound image localization processing in the sound image localization means 17 are known techniques, and their specific configurations are not the subject of the present invention, and therefore, the MIDI sound source 16 here. The detailed description of the acoustic signal generation processing and the sound image localization processing performed by the sound image localization means 17 will be omitted.

FIG. 6 is a flow chart of the main routine that starts execution when the sound source of the sound image localization device 10 is turned on. In the following description of each flowchart, for simplification, each register itself and the numerical value or flag stored in the register may not be distinguished from each other, and the same symbol may be used for them. When the power is turned on, an interval timer for mouse monitoring is first activated (step 6_1), and thereafter, the operation state of the mouse is monitored at predetermined time intervals.

Next, in step 6_2, each parameter is initialized. Details of this step 6_2 will be described later. After that, whether the mouse moved, whether the mouse was clicked, whether a value was entered from the keyboard,
It is cyclically repeatedly determined whether MIDI data has been input and whether the running flag runningFlag is on (steps 6_3 to 6_7). Here, the running flag runningFlag is turned on in response to the note number designating one of the plurality of parameter groups stored in the position / velocity detecting means 101 from the sequencer 40 (see FIG. 4) (' 1 '), and is turned off (' 0 ') when the sound image is moved to the sound image movement end position included in the parameter group designated by the note number.

In each of the steps 6_3 to 6_7, when it is determined that the mouse has moved, the mouse has been clicked, a value has been input from the keyboard, MIDI data has been input, and the running flag runningFlag is on, Proceeding to each step 6_8 to 6_12, each processing described later is performed. FIG. 7 shows step 6_ of FIG.
6 is a flowchart of a subroutine for initializing each parameter in 2.

In step 7_1, the registers and flags corresponding to the areas A to T of the screen shown in FIG. 5 are initialized, and in step 7_2, the current time, that is, the register curre for storing the current count value of the MIDI clock.
ntCounter and its current counter cu
A register cu that stores the count value that is one ahead in order to determine whether the currentCounter has been updated
rrent is cleared to 0.

Further, in step 7_3, other parameters are initialized, and in step 7_4, an initial screen as shown in FIG. 5 is displayed except that the numerical value display is different. Of the various registers described in each of the flowcharts described later but not explicitly shown in FIG. 7, the registers that need to be initialized are properly initialized in step 7_3.

FIG. 8 is a flow chart of the subroutine of step 6_8 of FIG. 6 which is activated in response to the movement of the mouse. In step 8_1, the mouse movement amount dm
x, dmy is obtained, and in step 6_9, a new position is obtained by adding each movement amount to the original position mx, my of the mouse, and the mouse pointer is moved to the new position on the screen. The display is moved.

9 and 10 show step 6_9 in FIG.
5 is a flowchart of a subroutine that is activated when the mouse is clicked. In this subroutine, in steps 9_1 to 9_5, the mouse pointer is clicked in each area L, M, N, Q, and U among the areas A to U shown in FIG. It is determined whether or not the mouse pointer has been moved to the other area AK, O, P, R in step 9_6.
It is determined whether the mouse pointer is in any of the areas to T, and when the mouse is clicked in a state where the mouse pointer is not in any of the areas A to U, the routine is exited without doing anything. On the other hand, when the mouse pointer is clicked in any one of the areas A to U, which area A to U
The following processes are performed depending on whether or not the button is clicked in the state.

When it is determined in step 9_1 that the mouse pointer is clicked while the mouse pointer is in the area L, the process proceeds to step 9_7, the sound velocity 331 (m / sec) in the air is stored in the register medium, and step 9_8
Then, an X mark indicating that air is selected as the medium is displayed in the region L, and at the same time, the X mark in the region M that is contradictively designated with the region L is deleted, and this routine is exited. .

When it is determined in step 9_2 that the mouse pointer is clicked in the area M,
In step 9_10, the sound velocity 1540 (m / sec) in the water is stored in the register medium, and step 9
In _11, the X mark in the region L is deleted, and the X mark indicating that water is selected as the medium is displayed in the region M, and the routine exits.

In step 9_3, when it is determined that the mouse pointer is clicked in the area N,
Proceeding to step 9_12, pitch change flag ptFlag
Is determined to be "0" or "1", and when ptFlag = 0, it is changed to ptFlag = 1, and an X mark indicating that pitch change is designated is displayed in the area N (step 9_13). , 9_14), exit this routine. On the other hand, if it is determined in step 9_12 that ptFlag = 1, then ptFlag = 0 is set, and the area N
The cross mark is erased (steps 9_15 and 9_16), and this routine is exited. That is, the region N repeats on and off each time it is clicked.

When it is determined in step 9_4 that the mouse pointer is clicked in the area Q,
Proceeding to step 9_17, the tone color change flag tnFlag
Is determined to be "0" or "1", and if tnFlag = 0, it is changed to tnFlag = 1, and an X mark indicating that the tone color change is instructed is displayed in the area Q (step 9_
18, 9_19), exit this routine. On the other hand, if it is determined in step 9_17 that tnFlag = 1,
The value of tnFlag = 0 is changed to erase the x mark displayed in the area Q (steps 9_19 and 9_20). That is,
Similarly to the area N, the area Q is repeatedly turned on and off each time it is clicked.

When it is determined in step 9_5 that the mouse pointer is clicked in the area U,
Proceeding to step 9_21, the parameters designated so far, that is, the parameters once stored in the registers shown in FIG. 5, are stored as a parameter group in the position / speed setting means 101 shown in FIG. 3, and the routine exits. still,
A plurality of parameter groups described with reference to the screen shown in FIG. 5 can be set in advance by designating different note numbers.

In step 9_6, the mouse pointer is moved to the area L, M, N, Q, which is determined in steps 9_1 to 9_5.
If it is determined that the user has clicked in any of the areas A to K, O, P, and R to T other than U, step 9_2
In step 2, the area other than the currently designated area is displayed in the normal display, and it is determined in step 9_23 whether the currently designated area has already been highlighted. If it is already highlighted, exit this routine. When the normal display is performed, the process proceeds to step 9_24 to reversely display the area and exit this routine. Areas AK, O,
P and R to T are areas in which numerical values should be input, and by specifying the area with the mouse, the area is highlighted. In the subroutine of FIG. 11 described below, the numerical value is entered in the highlighted area. To be done.

FIG. 11 is a flowchart of the subroutine of step 6_10 of FIG. 6 which is executed when a value is input from the keyboard. In step 11_1,
It is determined whether or not there is a highlighted area. If there is no highlighted area, this routine is skipped and if there is a highlighted area, step 11 is executed.
Proceed to _2. At step 11_2, whether or not the numerical value input from the keyboard is within the setting range of the highlighted area, that is, the numerical value input from the keyboard is the maximum value and the minimum value of the numerical values input to the area. It is determined whether or not it is between. If it is outside the setting range, this routine is left as it is, and if it is within the setting range, step 11_3
Then, the routine exits this routine after the value is set to the parameter corresponding to the area.

FIG. 12 is a flowchart of the subroutine executed in step 6_10 of FIG. 6 in response to the input of MIDI data from the sequencer 40 (see FIG. 4). Steps 12_1, 12_2, 12_
In 3, the input MIDI data is
It is determined whether or not it is a MIDI clock, whether or not it is tone color data for instructing a tone color change, and whether or not it is note data indicating a note number. The input MIDI data is
In step 12_4, the data is also output to the outside via the MIDI interface 15 shown in FIG.

In step 12_1, the input M
If it is determined that the IDI data is the MIDI clock, the process proceeds to step 12_5 and the register subCount
ter and counter are incremented and the process proceeds to step 12_4. The register subCounter is
This register is related to the interval count interval shown in FIG. 5, and is a register for determining whether or not the timing for updating the sound image localization position has been reached.
As described above, the inter is a register that stores the next time for updating the current time.

In step 12_2, the input M
If it is determined that the IDI data is tone color data, the process proceeds to step 12_6 and the register c indicating the tone color of the sound being generated.
The tone color number is input to currentTn, and this routine is exited. When it is determined in step 12_3 that the input MIDI data is note data,
Proceeding to step 12_7, the input note data and the note data of any one of the plurality of parameter groups stored in the position / speed setting means 101 shown in FIG. 4 (see area K in FIG. 5). It is determined whether or not they match, and if they do not match, step 12_
4, the parameter group of the corresponding note number is transferred to each register when any of them matches (step 12_8). In addition, steps 12_3 and 12 here
The processing of _7 and 12_8 is the position / speed setting storage means 1 of FIG.
It corresponds to 02.

In step 12_9, the running flag runningFlag indicating that the sound image is moving is set to "1", the register counter is "0", the register subCounter is "1", and subCount.
SubCo one clock before to detect the update of r
A register subCount that holds the value of unter
rOld is initialized to '1'.

Also, initial values start_X, start are stored in registers px, py, pz indicating the current sound image localization position.
t_Y and start_Z are stored. Step 12_
In 10, the tone color change flag tnFlag is "0" or "1".
Is determined, and if tnFlag = 0, step 12_
13 and if tnFlag = 1, step 12
Proceed to _11. In step 12_11, the MIDI sound source 16 (see FIGS. 3 and 4) is output with data instructing to change the tone color of the currently sounding tone to tn1 (see area R in FIG. 5). In step 12_12, tn1 is input to the register currentTn. In step 12_13, an instruction is output to the sound image localization means 17 (see FIGS. 3 and 4) so that the sound image is localized at the coordinates (px, py, pz). In step 12_4, as described above, the input MIDI data is output as it is to the outside.

FIG. 13 is a running flag running indicating that the sound image moving process is being performed in step 6_12 of FIG.
9 is a flowchart of a subroutine that is executed when Flag is on ('1'). In step 13_1, s
It is checked whether ubCounter = subCounterOld. subCounter is MI
The register is incremented in step 12_5 of FIG. 12 in response to the input of the DI clock. s
If ubCounter = subCounterOld, it means that a new MIDI clock is not input, and the routine exits without doing anything. subCo
If unter ≠ subCounterOld, the process proceeds to step 13_2, and the current subCounter is input to subCounterOld. Step 13_
In 3, the subCount updated in step 13_2
It is determined whether terOld and interval (see area J in FIG. 5) are equal. subCount
erOld ≠ interval means that it is not currently the timing to update the sound image localization position, and this routine is exited only by updating to subCounterOld in step 13_2. subCounterOld
If ≠ interval, it means that it is time to update the sound image localization position. In this case, step 13_4
Proceed to the following processing.

In step 13_4, the subCount
Both erOld and subCounter are initialized to 0, and in step 13_5, the initial value start of the sound image is started.
_X, start_Y, start_Z (see areas A, B, and C in FIG. 5), moving speed delta_X of the sound image,
delta_Y, delta_Z (areas D, E in FIG. 5,
F)), a register counter that counts the number of MIDI clocks from the start of sound image movement (initialized to 0 in step 12_9 of FIG. 12, and step 12_5 of FIG.
Incremented with), the following equation px1 = start_X + delta_X · count
er py1 = start_Y + delta_Y · count
er pz1 = start_Z + delta_Z · count
The localization position of the sound image is obtained using er.

In steps 13_6, 13_7 and 13_8, the next sound image localization position (px
1, px2, px3), the current sound image localization position (px, py, pz) is the sound image movement end position (en).
d_X, end_Y, end_Z) (region G in FIG. 5,
It is determined whether or not the sound image movement end position (end_X, end_Y, end_) has already been reached.
If the sound image has moved to Z), step 13_9
Running flag runningF indicating that the sound image is moving
The flag is cleared to "0", and this routine is exited. The current sound image localization position (px, py, pz) is still at the sound image movement end position (end_X, end_Y, end_).
Z), the process proceeds to step 13_10 to perform the later-described sound image processing (see FIG. 14), and step 13_1
In step 1, an instruction is output to the sound image localization means 17 (see FIGS. 3 and 4) so that the sound image is localized at the new sound image localization position (px1, py1, pz1) obtained in step 13_5. At step 13_12, the current sound image localization position (p
x, py, pz) are updated.

FIG. 14 is a flowchart of the sound image processing subroutine executed in step 13_10 of FIG. In steps 14_1 and 14_2, the pitch change flag ptFlag and the tone color change flag tnFla, respectively.
It is determined whether or not g is "1". When ptFlag = 1, the process proceeds to step 14_3 to perform the pitch changing process, and when tnFlag = 1, the process proceeds to step 14_4 to perform the tone color changing process.

FIG. 15 is a flowchart of the pitch changing processing subroutine executed in step 14_3 of FIG. In step 15_1, the listening position (origin) and the current sound image localization position (px, py, p
z) and the distance between the listening position (origin) and the newly updated sound image localization position (px1, py1, pz1) are obtained as the velocity V in the direction toward the listening position. To be

V = √ (px1 ² + py1 ² , pz1 ² )
−√ (px ² + py ² , pz ² ) In step 15_2, the sound velocity medium in the medium,
Using the coefficients alpha and beta and the velocity V obtained by the above equation, the calculation corresponding to the above equation (4), that is, pf = f ₁ / f ₀ (see equation (4)) = medium · alpha / ( medium-V ・ b
eta) is performed, and in step 15_3, the MIDI sound source 16 (see FIGS. 3 and 4) is instructed to change the pitch of the currently sounding note to pf times.

FIG. 16 is a flowchart of the tone color changing processing subroutine executed in step 14_4 of FIG. In step 16_1, the listening position (origin) and the newly updated sound image localization positions (px1, py1, pz).
The distance L to 1) is obtained, and in step 16_2, the moving speed of the sound source in the direction toward the listening position is obtained.
Then, in step 16_3, the sound image distance L is tnDis
stance (see area T in FIG. 5; corresponding to point P _{0 in} FIG. 1) is determined, and if distant, it proceeds to step 16_6 and the tone color tn2 is stored in the work register work.
(Refer to area S in FIG. 5; corresponding to the tone color in FIG. 1B) is input, and the process proceeds to step 16_7. Step 16_3
If it is determined that the sound image distance L is shorter than tnDistance, then it is determined in step 16_4 whether the velocity V is positive or negative. If the speed V is negative, step 16_
Proceeding to step 6, tn2 is input to work. If the speed V is positive, the process proceeds to step 16_5 and tn1 is set in the work.
(Refer to region R in FIG. 5; corresponding to the tone color in FIG. 1A) is input, and the process proceeds to step 16_7.

In step 16_7, it is judged whether or not the tone color currentTn of the tone currently being generated is a work tone color. This is the tone color of the note that is currently sounding.
When tTn and the tone color work to be changed are the same, this is a measure for not outputting a useless tone color change instruction. If the tone color currentTn of the tone currently being produced is different from the tone color work to be changed, step 16
In step _8, the MIDI sound source 16 (see FIGS. 3 and 4) is instructed to change the tone color of the sound being produced to work, and in step 16_9, the current tone color curr is output.
The work is input to entTn.

In the above embodiment, as described above, the pitch and tone color of the sound being produced are changed as the sound image moves. FIG. 17 is a flowchart of a tone color change processing subroutine that can be adopted in place of the tone color change processing subroutine of FIG. This tone color change processing subroutine realizes weighted addition (crossfade) of the two tone colors shown in FIG. 2. When the tone color change processing subroutine of FIG. 17 is adopted, the screen shown in FIG. It is necessary to partially change the parameter input processing routine, etc. referring to the screen or the screen, but these are self-explanatory, and the screen itself and the parameter input processing routine are not the essence of the present invention. , Figure 1
Only the tone color change processing subroutine shown in 7 will be described.

Step 17_ of the subroutine shown in FIG.
In 1 and 17_2, the distance L of the sound image localization position and the moving speed V are obtained as in steps 16_1 and 16_2 of the subroutine of FIG. 16, respectively. At step 17_4, x = (V / | V |) L, that is, the horizontal axis of FIG. 2 is obtained. As mentioned above, FIG.
The horizontal axis of indicates that the sound image localization position is further away from the listening position as the position is further away from the origin 0, and the right side of the origin 0 indicates V ≧ 0, that is, the sound image approaches the listening position, and the left side is V
<0, that is, the sound image is moving away from the listening position.

In steps 17_4, 17_5, and 17_6, p1 is calculated from x obtained in step 17_3, respectively.
≤ x, p2 ≤ x <p1, p3 ≤ x <p2 (p1, p2
p3 represents each point shown in FIG. 2) is determined. p1 ≦ x, p2 ≦ x <p1, p3 ≦ x <p2,
In each case of x <p3, steps 17_7 and 17 are performed.
_8, 17_9, 17_10, the magnification y1 of the tone color tn1 is y1 = 0, y1 = (p1-x) /
(P1-p2), y1 = (x-p3) / (p2-p
3), y1 = 0.

Next, steps 17_11, 17_12, 1
In 7_13, similarly to steps 17_4 to 17_6, p1 ≦ x, p2 ≦ x <p1, p3 ≦ x <, respectively.
p2 is determined and p1 ≦ x, p2 ≦ x <p1, p3 ≦ x
In each case of <p2, x <p3, each step 17_
14, 17_15, 17_16, 17_17, the magnification y2 of the tone color tn2 is y2 = 1, y2 =, respectively.
(X-p2) / (p1-p2), y2 = (p2-x) /
(P2-p3), y2 = 1.

In steps 17_18 and 17_19, MI
An instruction is output toward the DI sound source 16 (see FIGS. 3 and 4) to multiply the sound volumes of the tone colors tn1 and tn2 by y1 and y2, respectively. In this way, a crossfade of the two timbres is realized, and a more realistic sensation is produced as the sound image moves. FIG. 18 is a functional block diagram of another embodiment of the sound image localization apparatus, which is an alternative to FIG. In the sound image localization apparatus 10 shown in FIG. 4, the start point and the end point of the sound image localization position and the moving speed of the sound image are input and stored in the sound image localization apparatus (position speed setting means 101), and read out as necessary, The position-velocity calculation means 103 calculates the sound image localization position that moves in sequence, and the sound image localization device 10 'shown in FIG.
Then, all the parameter setting information such as the sound image localization position information, the pitch changing parameter, the tone color switching parameter, etc. which are sequentially moved are sequentially input from the sequencer 40.

The sound image localization information input from the sequencer 40 is input to the sound image localization means 17, and the sound image localization means 17 imparts the sound image localization to the acoustic signal sent from the MIDI sound source 16 based on the sound image localization information. To be done. Further, the parameter setting information input from the sequencer 40 is input to the effect calculation means 104, pitch conversion information and tone color change information are obtained, and then input to the MIDI sound source 16. MI
Music data is also input to the DI sound source 16 from the sequencer 40, and the MIDI sound source 16 generates an acoustic signal representing a music piece whose pitch and tone color are changed based on the music data and by the pitch change information and the tone color change information.

A program executed by the CPU 11 shown in FIG. 3 for realizing the functional blocks shown in FIG. 18 will be described below. FIG. 19 is a flowchart of a mail routine that is started when the power is turned on. Step 19
In _1, each parameter is initialized. This initialization routine will be described later.

At step 19_2, the interval timer is started, and thereafter, the interval timer interrupt routine shown in FIG. 23 is repeatedly started at predetermined time intervals. In step 19_3, it is determined whether or not the data is transmitted from the sequencer 40, and the process waits until the data is transmitted.

When data is transmitted from the sequencer 40, the process proceeds to step 19_4 and thereafter, and each step 19_4
4, 19_5, 19_6, it is determined whether or not the input data is the information of the x direction, the y direction, and the z direction, respectively, and when it is the information of the x direction, the y direction, and the z direction, Each step 19_7, 19_8,
In 19_9, the data values are set in px1, py1, and pz1 and the process returns to step 19_3.

If the input data is neither the x direction, the y direction nor the z direction information, the process proceeds to step 19_10 to determine whether the input data is the parameter setting information, If it is not the parameter setting information, the data is ignored and step 1
Return to 9_3. If it is the parameter setting information, the process proceeds to step 19_11, the parameter setting subroutine described later is executed, and then the process returns to step 19_3.

FIG. 20 is a flow chart of the parameter initialization subroutine executed in step 19_1 of FIG. In this subroutine, each parameter is initialized. Since the meaning of each parameter has been described in the above-described embodiment, the duplicated description will be omitted here. Figure 21
FIG. 22 is a flowchart of a parameter setting subroutine executed in step 19 — 11 of FIG. 19, and FIG. 22 is a diagram showing a data structure of MIDI data sent as parameter setting information.

Each value'F0 ',' 41 ', shown in FIG.
Each of “di”, ... Is 8-bit information (substantially 7 bits excluding the most significant bit), and is “F0 4” at the head.
1'indicates that this MIDI data is exclusive data, the next'di 'indicates the ID number of each device, and the next'mi' indicates the ID number of each model. The next '12' indicates to set data using this MIDI data, and the next '00 00 0
0'indicates the front end address of valid data to be set, and since it is '00 00 00'in this case, it indicates that the valid data immediately starts from the next'mm '.

The next "mm" represents the speed of sound in the medium medium. Furthermore, the next'a1 a2 a3 ',' b1
b2 and b3 ′ represent coefficients alpha and beta, respectively, and alpha = a1 · 64 + a2 + a3 / 128 where the sign of the sixth bit of a1 is added.

Beta = b1 · 64 + b2 + b3 / 128 However, the code of the sixth bit of b1 is added. It is represented by. This is the 6th bit counting from the lower bits of a1 and b1 (the least significant bit is the 0th bit)
Represents a sign bit, and therefore a1 and b1 have a numerically valid number of bits of 6 bits. Also, a3, b
3 represents a numerical value below the decimal point. Therefore, the above equation is used.

The following "pf", "tf", "t1", and "t2" of the MIDI data of FIG. 22 are the pitch change flag pfFlag and the tone color change flag tnFl, respectively.
ag, tone color tn1 and tone color tn2 represent tone color numbers to be set and stored in respective registers. The next "sum" is for checking, and "F7" is the end of data.

In this way, the parameter setting information sent from the sequencer 40 (M of the structure shown in FIG. 22)
Each parameter is set based on (IDI data). FIG. 23 is a flowchart of a timer interrupt routine started by the interval timer at predetermined time intervals. At steps 23_1, 23_2 and 23_3, the current sound image localization position (px, py, pz) and the sequencer 4 are selected.
Sound image localization position (px1, py1,
pz1) are equal or different, and if they are equal, the process ends without doing anything, and if they are different, step 23_4
1 to perform pitch change processing and tone color change processing accompanying the movement of the sound image.
Since the description has been made with reference to FIGS. 4 to 16, redundant description will be omitted here. In step 23_5, the current sound image localization position (px, py, pz) is updated to the newly changed sound image localization position.

[0073]

As described above, according to the present invention,
As the sound image moves, the pitch, tone color, etc. are changed to realize more realistic sound image movement. Further, it is possible to add a special effect that does not actually exist along with the movement of the sound image.

[Brief description of drawings]

FIG. 1 is a diagram for explaining switching between two sounds having different timbres.

FIG. 2 is another diagram for explaining switching between two sounds having different timbres.

FIG. 3 is a block diagram showing a configuration of a sound image localization apparatus according to an embodiment of the present invention.

4 is a functional block diagram of the sound image localization apparatus shown in FIG.

5 is a diagram showing a parameter setting screen displayed on the CRT display shown in FIG.

FIG. 6 is a flowchart of a main routine.

FIG. 7 is a flowchart of a subroutine for initializing each parameter.

FIG. 8 is a flowchart of a subroutine that is activated in response to movement of a mouse.

FIG. 9 is a flowchart of a subroutine that is activated when a mouse is clicked.

FIG. 10 is a flowchart of a subroutine that is activated when a mouse is clicked.

FIG. 11 is a flowchart of a subroutine that is executed when a value is input from the keyboard.

FIG. 12 is a flowchart of a subroutine that is executed in response to MIDI data input from the sequencer 40.

FIG. 13 is a running flag r indicating that a sound image moving process is in progress.
9 is a flowchart of a subroutine that is executed when the unningFlag is on ('1').

FIG. 14 is a flowchart of a subroutine of sound image processing.

FIG. 15 is a flowchart of a pitch change processing subroutine.

FIG. 16 is a flowchart of a tone color change processing subroutine.

FIG. 17 is a flowchart of a timbre change processing subroutine that can be adopted instead of the timbre change processing subroutine of FIG.

FIG. 18 is a functional configuration diagram of another embodiment of the sound image localization apparatus.

FIG. 19 is a flowchart of a main routine that is started when the power is turned on.

FIG. 20 is a flowchart of a parameter initialization subroutine.

FIG. 21 is a flowchart of a parameter setting subroutine.

FIG. 22: MI sent as parameter setting information
It is a figure which shows the data structure of DI data.

FIG. 23 is a flowchart of a timer interrupt routine started by the interval timer at predetermined time intervals.

[Explanation of symbols]

 10, 10 'Sound image localization device 11 CPU 16 MIDI sound source 17 Sound image localization means

Claims (8)

[Claims] 1. A sound image localization means for providing an input acoustic signal with a sound image localized at a predetermined sound image position which sequentially moves in space, and the sound image position or derived from the sound image position. A sound image localization device, comprising: a sound adjusting unit that outputs a sound signal in which at least one element other than the sound volume among the elements defining the sound with a value as a variable is changed according to the variable. 2. The sound image localization apparatus according to claim 1, wherein the sound adjusting means gives a change of the at least one element to an input sound signal. 3. The acoustic adjustment means comprises the at least one
The sound image localization apparatus according to claim 1, wherein the two elements generate a changed acoustic signal. 4. The sound image localization apparatus according to claim 1, wherein the sound adjusting unit outputs a sound signal whose pitch changes according to the variable. 5. The sound image localization apparatus according to claim 4, wherein the change in pitch according to the variable is a change in pitch simulating the Doppler effect accompanying the movement of the sound image. 6. The sound image localization apparatus according to claim 1, wherein the sound adjusting unit outputs a sound signal having a tone color changed according to the variable. 7. The sound image localization according to claim 6, wherein the change of the tone color according to the variable is a change of the tone color simulating the acoustic transfer characteristic of the acoustic medium between the sound image position and the listening position. apparatus. 8. The sound adjusting unit generates a plurality of sound signals representing respective sounds having different tone colors, and a plurality of sound signals generated by the sound generating unit according to the variables. And a tone color conversion unit for performing weighted addition with a weight corresponding to the variable for output.