JP2006287833A - Data processing method, data processing apparatus, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a data processing method, a data processing apparatus, and a program capable of realizing sharp sound image localization with a small computation complexity, when simulating acoustic characteristics in an acoustic space 102, wherein a sounding point 104 for emitting sound and a sound-receiving point 106 for receiving sound are arranged. <P>SOLUTION: The data processing apparatus calculates a plurality of sound ray routes 112-1, 114-1 that are the sound routes from the sounding point 104 to the sound receiving point 106, while being reflected properly in the inside of the acoustic space 102 and obtains incident angles θR1, θR2 at where the sound ray route is made to coincide with a front direction 106a of the sound-receiving point 106. The data processing apparatus obtains angles at which speakers 52C, 52L, 52R, 52SR, 52SL of the 5.1 surround system are arranged in a listening room around the front direction 106a of the sound-receiving point 106 as a center and the sound signal of each sound ray route is distributed to channels, with respect to any two loudspeakers. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a data processing method, a data processing apparatus, and a program suitable for use in creating an audio source to be played back in a surround system.

  For example, it is assumed that a sound generation point for generating some sound and a sound reception point for receiving this sound are placed in a certain acoustic space such as a rectangular parallelepiped room. The sound receiving point is a human or a microphone. In this case, the sound radiated from the sound generation point reaches the sound receiving point after being reflected by each part in the acoustic space. As described above, Patent Documents 1 and 2 disclose apparatuses that simulate the propagation of sound until reaching the sound receiving point on a computer and reproduce it on a 4-channel stereo. For example, in FIG. 1A, the speakers 52L, 52R, 52SR, and 52SL are arranged at positions that form four vertices of a square with the listener as the center. Here, assuming that the position of the listener is the sound receiving point 106, a virtual sounding point 104 is assumed in the center direction of the speakers 52L and 52R, and the sound pressure of the direct sound reaching the sound receiving point 106 from this sounding point 104 is P. And According to the technique of Patent Document 1, the sound that gives the sound pressure of “P / 2” to the sound receiving point 106 is emitted from the left and right speakers 52L and 52R, thereby directly from the virtual sounding point 104. Sound can be simulated. In the figure, the reflected sound is omitted.

  Further, Patent Document 2 discloses a technique for changing the level of a 4-channel stereo audio signal in accordance with “the direction of the sound receiving point”. For example, if the sound receiving point is “human”, the sound pressure actually felt is different between the case where the sound pressure P is heard from the front and the case where the sound is heard from the back. Therefore, the level of the sound signal is varied using the direction of the sound receiving point as a parameter. Further, Patent Document 2 discloses a technique in which sounding points and sound receiving points are arranged at arbitrary positions in an acoustic space, and sounding points are automatically moved along a predetermined route. Patent Document 3 discloses a technique in which a user can arbitrarily set a trajectory along which a sounding point moves, and reproduce a state in which the sounding point moves on this trajectory on a 4-channel stereo.

  Further, Patent Document 4 discloses a technique for rotating a sound field reproduced by a multi-channel playback device at an arbitrary angle. This is realized by mixing each signal of multiple channels with a mixing ratio corresponding to the rotation angle. For example, in FIG. 1B, assuming that audio signals S_L, S_R, S_SR, and S_SL constituting a 4-channel stereo are given, audio signals that realize a sound field that is rotated “45 °” in the right direction are shown. Assume that sound is emitted from the speakers 52L, 52R, 52SR, and 52SL. In such a case, adjacent ones of the original audio signals S_L, S_R, S_SR, and S_SL are mixed at a ratio of “½”, and the result is mixed with the audio signals S_L ′, S_R ′, S_SR ′, and S_SL. The sound may be emitted from the speakers 52L, 52R, 52SR, and 52SL.

JP 2004-212797 A Japanese Patent Laid-Open No. 2004-312109 US Pat. No. 5,636,283 JP 2003-271135 A

  In the techniques of Patent Documents 1 and 2 described above, the direction of the sound receiving point 106 is used to determine the level of the sound that should reach the sound receiving point 106, but in order to determine the localization between the speakers. Is not used. That is, the direction of the sound receiving point 106 is limited to the direction assumed in advance. Therefore, in order to set the localization between the speakers in accordance with the direction of the sound receiving point 106, the technique of Patent Document 4 is used in combination. For example, in FIG. 1A, it is assumed that the sound receiving point 106 is a human and the face is rotated “45 °” in the left direction. At this time, it is considered to simulate the sound reaching the sound receiving point 106 with respect to the listener in the listening room. Assuming that the listener in the listening room is facing the front, this sound field can be simulated by rotating the entire sound field to the right by “45 °”. In this case, the sound image of the sound generation point 104 must be in the direction of the speaker 52R as viewed from the listener.

  Therefore, when the sound field is rotated using the technique of Patent Document 4, the sound pressure from each speaker is as follows. That is, S_L ′ = P / 4 in the speaker 52L, S_R ′ = P / 2 in the speaker 52R, and S_SR ′ = P / 4 in the speaker 52SR. According to such a result, the center of the sound image coincides with the direction of the speaker 52R and the sum of the sound pressures also coincides with “P”, but the sound simulating the sounding point 104 is dispersed from the “3” speakers. Therefore, there is a problem that the sound image is blurred.

In addition, rotating a sound field using the technique of Patent Document 4 after generating a multi-channel signal using the techniques of Patent Documents 1 and 2 has a problem that the calculation becomes complicated.
The present invention has been made in view of the above-described circumstances, and an object thereof is to provide a data processing method, a data processing apparatus, and a program capable of realizing sharp sound image localization with a small amount of calculation.

In order to solve the above problems, the present invention is characterized by having the following configuration. The parentheses are examples.
In the data processing method according to claim 1, an acoustic space (102) in which a sounding point (104) that emits a sound and a sound receiving point (106) that receives a sound emitted from the sounding point (104) are arranged. ) In the data processing method for simulating the acoustic characteristics, a sound receiving point direction setting process (operation on the sound receiving point direction image 212a) for setting the direction of the sound receiving point (106) in the acoustic space (102); A sound ray path calculation process (SP112, SP114) for calculating a plurality of sound ray paths that are sound paths from the sounding point (104) to the sound receiving point (106), and the sound receiving point (106). Based on the incident angle calculation process (SP114) for calculating the incident angle (θR) of each sound ray path incident on the sound receiving point (106) with reference to the direction, and at least 3 based on the incident angle (θR) Channel Corresponding to the above multi-channel audio signal, a distribution rate determination process (SP118) for determining a distribution rate (FIG. 4) of the audio signal related to each sound ray path, and according to the determined distribution rate, And a distribution process (62, 64, 66) for distributing the audio signal relating to each sound ray path to each channel of the multi-channel audio signal.
Furthermore, in the configuration according to claim 2, in the data processing method according to claim 1, the multi-channel audio signal includes at least first to third audio signals (S_R, S_C, S_L). Yes, the distribution ratio (FIG. 4) indicates that the first and second audio signals (S_R, S_C) when the incident angle (θR) is in the first range (330 ° ≦ θR ≦ 360 °). The sound signal related to the sound ray path is distributed so that the total of the distribution ratio with respect to the second is adjacent to the first range (330 ° ≦ θR ≦ 360 °). Is within the range (0 ° ≦ θR ≦ 30 °), the audio signal related to the sound ray path so that the total of the distribution ratios for the second and third audio signals (S_C, S_L) is 100%. And the incident angle (θR) is a boundary between the first and second ranges. Characterized in that it is configured to dispense rate increases for the closer to (0 °) a second audio signal (S_C).
Furthermore, in the configuration according to claim 3, in the data processing method according to claim 1, the delay for delaying the sound signal related to each sound ray path based on the distance of each sound ray path. Step (60) and an attenuation process in which attenuation processing is performed on the sound signal related to each sound ray path so that the sound signal related to each sound ray path attenuates as the distance of each sound ray path becomes longer (step 60). 62, 64, 66, SP118).
Furthermore, in the configuration according to claim 4, in the data processing method according to claim 1, an acoustic space image (204) representing the acoustic space (102) and a pronunciation point image representing the pronunciation point (104). (210), a sound reception point image (212) representing the sound reception point (106), and a speaker image (214) representing a plurality of speakers arranged in a predetermined arrangement relationship with respect to the front direction. A display process (SP78, SP90, SP94) for displaying the sound receiving point (106) around the sound receiving point image (212) with the direction of the sound receiving point (106) in the front direction. It is displayed as.
The data processing apparatus according to claim 5 is characterized in that the data processing method according to any one of claims 1 to 4 is executed.
According to a sixth aspect of the present invention, there is provided a program for causing a processing device (42, 10) to execute the data processing method according to any one of the first to fourth aspects.

  Thus, according to the present invention, the distribution ratio of the audio signal related to each sound ray path is determined based on the incident angle at which each sound ray path enters the sound receiving point, and the sound signal related to each sound ray path is determined. Is distributed to each channel of the multi-channel audio signal according to the distribution ratio, so that a sharp sound image localization can be realized with a small amount of calculation.

1． Summary of Examples
1.1. Relationship between Positions of Various Elements and Sounds In FIG. 2, it is assumed that a sound generation point 104 and a sound reception point 106 are placed in a rectangular parallelepiped acoustic space 102. First, sound directly reaches the sound receiving point 106 from the sounding point 104 along the sound ray path (sound propagation path) 110. Further, the primary reflected sound (sound that is reflected only once on the wall surface of the acoustic space 102) arrives along the sound ray path 112-1. The total number of sound ray paths of the primary reflected sound is “6”, that is, the same as the number of wall surfaces forming the rectangular acoustic space 102, and there are “5” in addition to the sound ray path 112-1. ).

  Further, the secondary reflected sound reaches along the sound ray path 114-1. The total number of sound ray paths of the secondary reflected sound is “18”, and there are “17” other than the sound ray path 114-1 (not shown). The method for obtaining the number of secondary reflected sounds is described in detail in Patent Document 1 above. In reality, there are third and subsequent reflections, but these are ignored. Each time the reflected sound is reflected “1” times on the wall, it attenuates and undergoes a change in frequency characteristics (filtering process). Here, when the wall surface of the acoustic space 102 is a mirror, it is possible to draw mirror images 116-1 and 118-1 of the pronunciation point 104 reflected in the mirror.

  These mirror images are separated from the sound receiving point 106 by the same length as the solid sound ray path, and have the same angle with respect to the sound receiving point 106 as each sound ray path is incident on the sound receiving point 106. ing. The number of mirror images is equal to the number of sound ray paths related to the reflected sound. In this embodiment, directivity characteristics are imparted to the sounding point 104 and the sound receiving point 106. Therefore, in FIG. 2, the front directions of both are indicated by arrows 104a and 106a. An example of both directivity characteristics 104b and 106b is shown in FIG. Here, the angle at which each sound ray path is radiated from the sound generation point 104 is a radiation angle θG with respect to the front direction 104a of the sound generation point 104, and the angle at which the sound ray path is incident on the sound reception point 106 Is the incident angle θR with reference to the front direction 106 a of the sound receiving point 106. In FIG. 3, the radiation angles and the incident angles of the sound ray paths 112-1 and 114-1 are shown as θG1, θG2, and θR1, θR2, respectively.

Here, the audio signal reaching the sound receiving point 106 from each sound ray path is an audio signal obtained by performing the following attenuation and filtering processing on the audio signal generated by the sound generation point 104.
(1) Attenuation process for multiplying the attenuation coefficient Zlen inversely proportional to the square of the sound ray path length (2) Filtering process for multiplying the filtering characteristic Zref on the reflecting surface by the number of reflections (3) Directivity characteristic 104b and radiation angle θG Attenuation process for multiplying attenuation coefficient ZG based on (4) Attenuation process for multiplying attenuation coefficient ZR based on directivity characteristic 106b and incident angle θR

  The sound signal of each sound ray path obtained as described above is assigned to a reproduction channel. Here, a 5.1 surround system is assumed as the playback system. In the reproduction system, on the circumference of a radius “2.5” m centering on the listener, the center speaker 52C is located in front of the listener, the left and right speakers 52L and 52R are located at left and right “30 °” positions, and the left and right “120” are located. It is assumed that the left and right surround speakers 52SL and 52SR are respectively disposed at the position “°”. The positions of these speakers are shown by broken lines in FIG. In addition, in the 5.1 surround system, “subwoofer” is also provided, but this is not shown because it is not related to localization.

  The audio signals of the channels supplied to the speakers 52C, 52L, 52R, 52SR, and 52SL are respectively S_C, S_L, S_R, S_SR, and S_SL, and the ratio when the audio signals of the sound ray paths are distributed to these channels is shown. As shown in FIG. In FIG. 4, distribution characteristics 54C, 54L, 54R, 54SR, and 54SL are functions of the incident angle θR, and the sound signals of the sound ray path are distributed to the sound signals S_C, S_L, S_R, S_SR, and S_SL, respectively. This is the distribution rate. In each of the illustrated sections A to E, only the “2” channel has a distribution rate exceeding “0%” at the same time, and the total distribution rate of both channels is “100%”. In addition, at the boundary between the sections A to E, the distribution rate of only “1” channel is “100%”, and the distribution rates of other channels are “0%”.

  Thus, according to the present embodiment, the sound signal of each sound ray path is distributed to the sound signals S_C, S_L, S_R, S_SR, and S_SL so that the listener can hear sound from the direction of the incident angle θR. The generated multi-channel audio signal is generated as an audio signal suitable for the direction of the sound receiving point 106. Therefore, it is not necessary to further rotate the sound field of the multi-channel audio signal, and a sharp sound image localization can be realized with a small amount of calculation.

1.2. User Interface In this embodiment, the distribution of the audio signal to the “5” channel constituting the surround system described above is executed on the digital mixer, but the acoustic space 102, sound generation point 104, sound reception point 106, etc. The setting is executed on the screen of the personal computer. Therefore, the user interface on the setting screen of the personal computer will be described.

  First, an example of the setting screen is shown in FIG. In the figure, reference numeral 206 denotes a section line, which is formed by continuously arranging broken-line square frames vertically and horizontally. In the illustrated example, one frame corresponds to “1 m × 1 m” in the acoustic space 102. An acoustic space outline 204 represents a side wall surface of an assumed rectangular parallelepiped acoustic space. A zoom fader 202 sets the zoom amount of the display screen. Here, the zoom amount corresponds to the number of frames in the horizontal direction of the section line 206, and is “20” in the illustrated example. The position of each side wall surface constituting the acoustic space outline 204 and the operation position of the zoom fader 202 can be appropriately moved by dragging them with the mouse.

  Next, 210 is a sounding point image inside the acoustic space outline 204 and displays the position of the sounding point 104. A sounding point direction image 210a displays the front direction of the sounding point 104. A sound receiving point image 212 displays the position of the sound receiving point 106. A sound receiving point direction image 212 a displays the front direction of the sound receiving point 106. Reference numeral 214 denotes a speaker image, which is formed by arranging the images of the speakers 52C, 52L, 52R, 52SR, and 52SL on a circle having a radius of “2.5 m” with the sound receiving point image 212 as the center. As in the case of 2, a 5.1 surround system speaker arrangement is assumed as a reproduction system. Furthermore, the speaker image 214 is configured such that the image of the center speaker 52C is positioned in the direction of the sound receiving point direction image 212a. The arrangement of the speaker image 214 with respect to the sound receiving point image 212 and the sound receiving point direction image 212a is always maintained even after the position and direction of the sound receiving point 106 are changed.

  The positions of the sound generation point image 210 and the sound receiving point image 212 can be freely changed inside the acoustic space outline 204 by dragging and dropping with the mouse. When the sounding point image 210 or the sound receiving point image 212 is moved, the sounding point direction image 210a or the sound receiving point direction image 212a is moved in conjunction with these. Also, the direction of the sound generation point direction image 210a and the sound receiving point direction image 212a can be freely set by the user by dragging and dropping with the mouse. However, the direction images 210a and 212a can move only on the circumference of a predetermined radius centering on the sounding point image 210 and the sound receiving point image 212, respectively. The directions indicated by the direction images 210a and 212a are as follows: Each of the sound generation point image 210 and the sound receiving point image 212 is only in the radiation direction.

  Next, FIG. 6 shows a state in which the sound receiving point image 212 is moved slightly to the left on the setting screen and the sound receiving point direction image 212a is rotated slightly to the right. Since the speaker image 214 is automatically determined based on the position of the sound receiving point image 212, the direction of the sound receiving point direction image 212a, and the zoom amount of the zoom fader 202, the sound receiving point image 212 as shown in the figure. And follow the sound receiving point direction image 212a to rotate.

  Here, the pronunciation point image 210 and the pronunciation point direction image 210a can be similarly changed in position and direction by dragging and dropping the mouse. However, a certain “trajectory” is set in advance for the pronunciation point image 210, It is possible to automatically move on the orbit. Reference numeral 220 denotes a moving trajectory line, which displays a trajectory along which the pronunciation point image 210 moves. Reference numerals 222, 224, and 226 denote trajectory point images, which are points for specifying the moving trajectory line 220. That is, the moving trajectory line 220 is determined by a line (straight line or curve) connecting the trajectory point images 222, 224, and 226 to each other, and the positions of the trajectory point images 222, 224, and 226 are also determined by dragging and dropping the mouse. It can be set arbitrarily.

  Next, FIG. 7 shows a setting screen when the zoom amount is changed to “30” by operating the zoom fader 202 on the setting screen of FIG. In this figure, the section lines 206 are denser than those in FIG. 6, and it can be seen that the area of the area displayed on the setting screen is increased. However, in the setting screen of FIG. 7, the size and position of the acoustic space outline 204, the sounding point image 210, the sound receiving point image 212, the trajectory point images 222, 224, 226, and the moving trajectory line 220 are displayed on the screen. Is not changed compared to that of FIG. However, since the speaker image 214 is drawn on the circumference of the section line 206 with the radius “2.5 m”, the speaker image 214 is displayed smaller than that of FIG.

  Further, FIG. 8 shows a setting screen when the zoom amount is changed to “10” by operating the zoom fader 202 on the screen of FIG. 6 or FIG. In this figure, the section lines 206 are wider than those in FIG. 6, and it can be seen that the area of the area displayed on the setting screen is reduced. Also on this setting screen, the size and position of the acoustic space outline 204, the sounding point image 210, the sound receiving point image 212, the trajectory point images 222, 224, 226, and the moving trajectory line 220 are displayed on the screen in FIG. Not changed compared to the ones. However, the speaker image 214 is enlarged as compared with that in FIG.

  In other words, the zoom fader 202 in this embodiment does not simply change the display state (scale) of the setting screen, but the relative positional relationship of each element arranged in the acoustic space to be simulated. While holding, the size of the entire acoustic space is enlarged or reduced. Since the display state of the section line 206 and the speaker image 214 is changed by the operation of the zoom fader 202, the user can change the acoustic space when compared with the assumed listening room size (approximately 5 m × 5 m). Intuitively understand the size and position of each element

  Here, the sounding point image 210, the sounding point direction image 210a, the sound receiving point image 212, the sound receiving point direction image 212a, and the trajectory point images 222, 224, and 226 are arbitrarily set by the user by operating the mouse. Since these are possible elements, these will be referred to as “operation elements”. The user can set an operation element to a “selected state” by clicking any operation element with the mouse. When an operation element that is in a normal state is clicked with the mouse, all the operation elements that have already been selected become unselected, and only one operation element that is newly clicked is selected.

  Further, when the shift key of the keyboard of the personal computer is kept pressed, a plurality of operation elements can be set to the selected state. In addition, when one shift operation element is clicked with the mouse while the shift key is continuously pressed, the one operation element is deselected. In such a case, the selection / non-selection state of other operation elements is maintained as it is. However, the sounding point direction image 210a and the sound receiving point direction image 212a can be selected only by themselves, and cannot be selected together with other operation elements.

  Therefore, in the following drawings, the operation elements set in the selected state are displayed by double circles. In the example shown in FIG. 8, the pronunciation point image 210, the trajectory point image 224, and the trajectory point image 226 are set to the selected state. When multiple operation elements are in the selected state, if you perform a drag-and-drop operation on any of the selected operation elements, the relative positional relationship of all the selected operation elements is maintained. However, the positions of these operation elements on the screen are changed in conjunction with each other.

  Next, when one or more operation elements are selected, when the ctrl key is pressed on the keyboard, a “straight auxiliary line” is displayed on the screen for each selected operation element. . FIG. 9 shows a screen in which the ctrl key is pressed on the screen shown in FIG. 8 and a linear auxiliary line is displayed. The straight auxiliary line is a straight line connecting a certain “base point” and each operation element in a selected state. Here, the “base point” is the sound receiving point image 212 when the sound receiving point image 212 is in a non-selected state, and the sound space contour line 204 when the sound receiving point image 212 is in a selected state. Central. In the example of FIG. 9, since the sound receiving point image 212 is in a non-selected state, the sound receiving point image 212 becomes a base point, and straight lines are connected as straight lines connecting the sound receiving point image 212 and the operation elements 210, 224, and 226, respectively. Mold auxiliary lines 232, 234, 236 are drawn.

  When the linear auxiliary line is drawn in this way, each operation element in the selected state can move only on the corresponding linear auxiliary line. That is, when a certain operation element is dragged and dropped with the mouse, the coordinates of a point on the linear auxiliary line located closest to the drop position are obtained, and the operation element is moved to the obtained point. In addition, when multiple operation elements are selected and a linear auxiliary line is displayed, if any selected operation element is moved by a drag-and-drop operation, the expansion / contraction rate of the distance between the base point and the operation element The other selected elements are moved by a distance that realizes the expansion / contraction ratio.

  For example, on the scale of the section line 206 in FIG. 9, the distances from the base point (sound receiving point image 212) of the pronunciation point image 210, the orbit point image 224, and the orbit point image 226 are “7 m” and “2.5 m, respectively. And “5.5 m”. It is assumed that the pronunciation point image 210 is moved to a distance of “9 m” from the base point by dragging and dropping in this state. In such a case, since the expansion / contraction ratio of the pronunciation point image 210 is “9/7”, the orbit point image 224 is about “3.2 m” from the base point, and the orbit point image 226 is about “6.4 m” from the base point. In this way, they move on the straight auxiliary lines 234 and 236, respectively. In this case, when only a part of the “3” trajectory point images 222, 224, and 226 is moved, the shape of the moving trajectory line 220 is naturally changed following this. Become.

  Next, FIG. 10 shows display contents when the selection of the trajectory point image 224 is canceled with respect to the state of FIG. 9 and the sound receiving point image 212 is selected. When the sound receiving point image 212 is selected, as shown in the figure, the center point 240 of the acoustic space outline 204 becomes the base point, and straight lines connecting the base point and the selected operation elements 212, 210, and 226, respectively. As shown, linear auxiliary lines 242, 244 and 246 are drawn. Except that the base point is changed in this way, and the linear auxiliary line is changed accordingly, the operation method of each operation element is the same as in FIG.

  Next, when one or more operation elements are in the selected state, when the alt key is pressed on the keyboard, a “circular auxiliary line” is displayed on the screen for each selected operation element. . FIG. 11 shows a screen on which the alt key is pressed and a circular auxiliary line is displayed on the screen shown in FIG. The circular auxiliary line is a circle or an arc that passes through each selected operation element with a certain “base point” as the center. The “base point” here is the sound receiving point image 212 when the sound receiving point image 212 is in the non-selected state, as in the case of the linear auxiliary line, and the sound receiving point image 212 is in the selected state. Is the center of the acoustic space outline 204. In the example of FIG. 11, since the sound receiving point image 212 is in a non-selected state, the sound receiving point image 212 becomes the base point, and the circular auxiliary is defined as a circle that passes through the operation elements 224, 226, and 210 centering on this base point. Lines 252, 254 and 256 are drawn.

  When the circular auxiliary line is drawn in this way, each operation element in the selected state can move only on the corresponding circular auxiliary line. That is, when a certain operation element is dragged and dropped with the mouse, the coordinates of a point on the circular auxiliary line positioned immediately near the drop position are obtained, and the operation element is moved to the obtained point. In addition, when a plurality of operation elements are selected and a circular auxiliary line is displayed, when any selected operation element is moved by a drag and drop operation, the rotation angle viewed from the base point is obtained, The other selected elements are moved so as to rotate by the same rotation angle on the corresponding circular auxiliary lines.

  Next, FIG. 12 shows display contents when the selection of the trajectory point image 224 is canceled with respect to the state of FIG. 11 and the sound receiving point image 212 is selected. When the sound receiving point image 212 is selected, as shown in the figure, the center point 240 of the acoustic space outline 204 becomes the base point, and the selected operation elements 226, 210, 212 are centered on this base point. Circular auxiliary lines 262, 264 and 266 are drawn as circles passing through each. Except that the base point is changed and the circular auxiliary line is changed accordingly, the operation method of each operation element is the same as in the case of FIG.

2． Hardware Configuration of Embodiment Next, the hardware configuration of the voice editing system of one embodiment of the present invention will be described with reference to FIG. The audio editing system includes a multitrack recorder 51 that records / reproduces audio signals or control signals, a digital mixer 1 that mixes audio signals, a personal computer 30 that sets the mixing state, and edited audio. It comprises an amplifier 50 and a speaker system 52 for reproducing signals.

  In the digital mixer 1, reference numeral 4 denotes an electric fader group, which adjusts the signal level of each input / output channel based on a user operation. Furthermore, the electric fader group 4 is configured such that when an operation command is supplied via the bus line 12, the operation position is automatically set. Reference numeral 2 denotes a switch group, which includes various switches and LED keys, and the blinking state of the LED built in the LED key is set via the bus line 12. Reference numeral 6 denotes a rotary knob group for setting the left and right volume balance of each input / output channel.

  A waveform I / O unit 8 inputs and outputs analog audio signals or digital audio signals. In the present embodiment, for example, if an audio signal radiated from the sound generation point 104 is recorded on any track of the multitrack recorder 51, this audio signal is input via the waveform I / O unit 8. become. The audio signals composing the 5.1 surround system synthesized in the digital mixer 1 are supplied to the multitrack recorder 51 via the waveform I / O unit 8 and recorded there. Further, each audio signal constituting the 5.1 surround system is converted into an analog signal in the waveform I / O unit 8 and emitted through the amplifier 50 and the speaker system 52.

  Next, reference numeral 10 denotes a signal processing unit, which is constituted by a group of DSPs (digital signal processors). The signal processing unit 10 performs mixing processing and effect processing on the digital audio signal supplied via the waveform I / O unit 8 and outputs the result to the waveform I / O unit 8. A large display 14 displays various information to the user. Reference numeral 15 denotes an input device, which includes various operators on the operation panel, a keyboard, a mouse, and the like, and performs a cursor movement on the large display 14 and an on / off operation of buttons displayed on the large display 14. Reference numeral 16 denotes a control I / O unit which inputs / outputs various control signals to / from the personal computer 30 or the like. Reference numeral 18 denotes a CPU that controls each unit via the bus line 12 based on a control program stored in the flash memory 20. A RAM 22 is used as a work memory for the CPU 18.

  Next, 32 in the personal computer 30 is a hard disk that stores an operating system, various application programs, and the like. Reference numeral 34 denotes a display that displays various types of information to the user. Reference numeral 36 denotes an input device, which includes a keyboard for inputting characters and a mouse. Reference numeral 40 denotes an input / output interface for inputting / outputting various control signals to / from the control I / O unit 16 of the digital mixer 1. A CPU 42 controls other components in the personal computer 30 via the bus 38. A ROM 44 stores an initial program loader and the like. A RAM 46 is used as a work memory for the CPU 42.

3． Operation of the embodiment
3.1. Algorithm of Digital Mixer 1 As described above, in the digital mixer 1, when an audio signal radiated from the sound generation point 104 is input from the multitrack recorder 51, this signal is set as an input audio signal Si based on this. The 5 ”channel audio signals S_C, S_L, S_R, S_SR, and S_SL are generated in the signal processing unit 10. The contents of the mixing algorithm executed in the signal processing unit 10 will be described with reference to FIG.

  In FIG. 14, 60 is a delay unit that delays the input audio signal Si in units of sampling periods. The delayed input audio signal Si is output from an arbitrary position (tap position) with a sampling period as a unit up to a predetermined maximum delay time. A PAN control unit 62 includes “5” multipliers 74-1 to 74-5 as shown in FIG. These multipliers multiply the signals at the designated tap positions of the delay unit 60 by designated “5” types of attenuation factors, respectively, and output the resulting “5” channel signals.

  More specifically, the tap position for the PAN control unit 62 is a position corresponding to the direct sound delay time TD0 (speech propagation time with respect to the length of the sound ray path 110 of the direct sound in FIG. 2). Further, as described above with reference to FIG. 2, the direct sound is caused by the attenuation coefficient Zlen that is inversely proportional to the square of the ray path length, the attenuation coefficient ZG based on the radiation angle θG, and the attenuation coefficient ZR based on the incident angle θR. It will be attenuated. Accordingly, the attenuation rate set in the multipliers 74-1 to 74-5 is equal to the result obtained by multiplying “Zlen · ZG · ZR” by the distribution rate (see FIG. 4) based on the incident angle θR.

  Here, the signal processing in the signal processing unit 10 is actually executed by the DSP. According to the present embodiment, the number of channels whose distribution rate based on the incident angle θR exceeds “0%” is “2” channels at the maximum, and therefore, only the “2” channels need be calculated. After all, in the signal processing unit 10, the PAN control unit 62 needs to perform multiplication only “2” times.

  Next, 64 is a matrix mixer, and a circuit similar to the PAN control unit 62 is provided with the number of sound ray paths n of primary reflected sound, that is, “6” systems, and is configured to mix audio signals for each system. . More specifically, as shown in FIG. 14 (c), “5” multipliers 70-1-k to 70-5-k (k is 0 to 5) for each system, and these multipliers. The matrix mixer 64 is composed of adders 72-1-k to 72-5-k (k is 1 to 5) that mix the multiplication results of each channel.

  The audio signal of each system supplied to the matrix mixer 64 is an audio signal output from the tap position of the delay unit 60 corresponding to the delay time of the primary reflected sound. Here, the primary reflected sound is attenuated by the attenuation coefficients Zlen, ZG, ZR in the same manner as the direct sound. Further, the primary reflected sound is subjected to filtering on the reflection surface of the acoustic space 102, but such processing is executed in the subsequent filter unit 69. Accordingly, the attenuation rate set in the multipliers 70-1-k to 70-5-k is distributed based on the incident angle θR with respect to “Zlen · ZG · ZR” as in the case of the direct sound. The value multiplied by the rate. As in the case of the direct sound, the signal processing unit 10 only needs to execute multiplication “2” times for each sound ray path.

  Next, reference numeral 66 denotes a matrix mixer for secondary reflected sound, which is configured in the same manner as the matrix mixer 64 for primary reflected sound. However, since the number of sound ray paths n of the secondary reflected sound is “18”, the number of multipliers and adders in the matrix mixer 66 is also set in accordance with the number of sound ray paths n. The audio signal of each system supplied to the matrix mixer 66 is an audio signal output from the tap position of the delay unit 60 corresponding to the delay time of the secondary reflected sound. Similarly to the case of the primary reflected sound, in the matrix mixer 66, the attenuation rate set in each multiplier is a value obtained by multiplying “Zlen · ZG · ZR” by the distribution rate based on the incident angle θR. is there.

  Next, reference numeral 68 denotes a filter unit, which applies a filtering process on the reflection surface of the acoustic space 102 to the “5” channel audio signal output from the matrix mixer 66. Reference numeral 65 denotes an adder group that adds each output signal of the filter unit 68 and the output signal of the corresponding channel of the matrix mixer 64. Reference numeral 69 denotes a filter unit having the same characteristics as the filter unit 68, and performs a filtering process on each output signal of the adder group 65. Reference numeral 63 denotes an adder group, which adds each output signal of the filter unit 69 and the output signal of the corresponding channel of the PAN control unit 62, and outputs the result as audio signals S_C, S_L, S_R, S_SR, S_SL. . These audio signals S_C, S_L, S_R, S_SR, and S_SL are recorded on the multitrack recorder 51 via the waveform I / O unit 8 as described above.

3.2. Processing of personal computer 30
3.2.1. Operation element click event (Figure 15)
Next, the operation in the personal computer 30 will be described. When a predetermined operation is performed on the input device 36 of the personal computer 30, a setting screen as shown in FIGS. 5 to 12 is displayed on the display 34. When any operation element is clicked with the mouse on the setting screen, a mouse click routine shown in FIG. 15 is started.

  When the process proceeds to step SP22 in FIG. 15, it is determined whether or not the clicked operation element is any one of the direction images 210a and 212a. If "YES" is determined here, the process proceeds to step SP28, and selection of all operation elements that have not been clicked is cancelled. Next, when the process proceeds to step SP29, the selected / unselected state of the clicked operation element is reversed. Therefore, each of the direction images 210a and 212a can be selected only by itself, and when one of the direction images 210a and 212a is clicked, the selected / non-selected state is inverted each time the button is clicked. become.

  If an operation element other than the direction images 210a and 212a is clicked, the process proceeds to step SP24 to determine whether or not the shift key is pressed on the keyboard of the input device 36. If "NO" is determined here, the process proceeds to step SP28, and the same process as in the case of the direction images 210a and 212a described above is executed. That is, when the shift key is not pressed, each operation element can be selected alone, all the operation elements that are not clicked are set to a non-selected state, and each clicked operation element is clicked. The selected / unselected state is inverted.

  On the other hand, if the shift key is pressed and an operation element other than the direction images 210a and 212a is clicked, “YES” is determined in step SP24, and the process proceeds to step SP26. Here, if any of the direction images 210a and 212a is in a selected state, the selected state is canceled. Next, when the process proceeds to step SP29, the selected / unselected state of the clicked operation element is reversed. That is, when the operation element has been selected so far, it is set to a non-selected state, and when it is not selected, it is set to a selected state. In this case, since the state of the operation element that has not been clicked is not changed except for the direction image, if the operation element that is not selected is clicked “1” times while the shift key is pressed, these operation elements Are all set to the selected state.

3.2.2. Zoom operation event Next, when the zoom fader 202 is dragged and dropped with the mouse, a zoom operation event routine shown in FIG. 16 is started. When the processing proceeds to step SP2 in the figure, the distance from the sound receiving point image 212 to each speaker constituting the speaker image 214 on the setting screen according to the changed zoom amount (position where the zoom fader 202 is dropped). (The number of dots on the display 34) is calculated. That is, since the speaker image is assumed to be on the circumference of the radius “2.5 m” with the sound receiving point 106 as the center in the acoustic space 102, the speaker image 214 is reduced in scale according to the changed zoom amount. Is calculated. Next, when the process proceeds to step SP4, the size of each speaker constituting the speaker image 214 is calculated according to the changed zoom amount. Accordingly, when the user operates the zoom fader 202 to zoom in, the radius of the speaker image 214 and the size of each displayed speaker increase, and when zoomed out, the radius of the speaker image 214 and the size of each displayed speaker appear. Becomes smaller.

  Next, when the process proceeds to step SP6, the section line 206 is displayed again according to the changed zoom amount, and the speaker image 214 is displayed at the calculated distance and size. Next, when the processing proceeds to step SP8, the size of the acoustic space 102 (see FIG. 2) to be simulated and the positions of the sound generation point 104 and the sound receiving point 106 are changed to reflect the zoom amount change result. . That is, the size of the acoustic space 102 and the positions of the sound generation point 104 and the sound receiving point 106 are recalculated according to the zoom amount so that the position on the screen of each operation element displayed on the screen does not change. Is done.

  Thus, as described above with reference to FIGS. 6 to 8, when the zoom amount is changed, the position between the elements in the acoustic space 102 varies, but the position on the setting screen is not changed. Next, when the process proceeds to step SP10, a sound field calculation subroutine shown in FIG. Although details will be described later, based on the state in the acoustic space 102, the tap position in the delay unit 60 and the attenuation rate of each multiplier in the PAN control unit 62 and the matrix mixers 64 and 66 are set.

3.2.3. ctrl Key Event Processing Next, when a ctrl key on event occurs on the keyboard of the input device 36, a ctrl key on event routine shown in FIG. 17A is started. In the figure, when the process proceeds to step SP32, it is determined whether or not there is an operation element selected in the setting screen. If “NO” is determined here, the routine is immediately terminated. On the other hand, if "YES" is determined, the process proceeds to step SP34 to determine whether or not the sound receiving point image 212 is included in the selected operation element. If "YES" is determined here, the process proceeds to step SP36, and the center point 240 of the acoustic space outline 204 is set as a base point as described in FIG. On the other hand, if “NO” is determined in step SP36, the sound receiving point image 212 is set as the base point as described in FIG. Next, when the process proceeds to step SP40, a linear auxiliary line connecting each operation element in the selected state and the base point is displayed on the setting screen.

  When the ctrl key off event occurs, the ctrl key off event routine shown in FIG. 17B is started. In the figure, when the process proceeds to step SP45, all the linear auxiliary lines on the setting screen are deleted, and the process of this routine ends.

3.2.4. alt Key Event Processing When an alt key on event occurs on the keyboard, an alt key on event routine shown in FIG. In the figure, when the process proceeds to step SP52, it is determined whether or not there is an operation element selected in the setting screen. If “NO” is determined here, the routine is immediately terminated. On the other hand, if "YES" is determined, the process proceeds to step SP54 to determine whether or not the sound receiving point image 212 is included in the selected operation element. If “YES” is determined here, the process proceeds to step SP56, and as described in FIG. 12, the center point 240 of the acoustic space outline 204 is set as a base point. On the other hand, if “NO” is determined in step SP56, the sound receiving point image 212 is set as the base point as described in FIG. Next, when the process proceeds to step SP60, a circular auxiliary line that is a circle or an arc passing through each operation element in the selected state with this base point as the center is displayed on the setting screen.

  When an alt key off event occurs, an alt key off event routine shown in FIG. 18B is started. In the figure, when the process proceeds to step SP65, all the circular auxiliary lines on the setting screen are deleted, and the process of this routine ends.

3.2.5. Element move processing
(1) When a linear auxiliary line is displayed When any operation element in the selected state is dragged and dropped with the mouse, an element movement event routine shown in FIG. 19 is started. In FIG. 19, when the process proceeds to step SP72, an operation element that has been dragged and dropped is selected as a processing target. Next, when the process proceeds to step SP74, it is determined whether or not a linear auxiliary line is displayed. If "YES" is determined here, the process proceeds to step SP76, and the movement distance on the linear auxiliary line is calculated from the coordinates before and after the operation of the operation element dragged and dropped. Next, when the process proceeds to step SP78, the display content on the setting screen is changed so that the operation element to be processed moves the linear auxiliary line by the movement distance.

  Next, when the process proceeds to step SP80, the position and direction of the operation element in the acoustic space 102 are calculated based on the changed state of the setting screen. Next, when the process proceeds to step SP82, it is determined whether or not there remains an operation element that has not yet been moved in the acoustic space 102 (step SP80) among the selected operation elements. If “YES” is determined here, the process proceeds to step SP84, and one operation element among the remaining elements is selected as a processing target, and the processes of steps SP74 to SP80 are repeated. When such processing is completed for all operation elements in the selected state, “NO” is determined in step SP82, and the processing proceeds to step SP86. Here, a sound field calculation subroutine (FIG. 21A) to be described later is called, and the tap position in the delay unit 60 and the attenuation rate of each multiplier in the PAN control unit 62 and the matrix mixers 64 and 66 are set. The

(2) When a circular auxiliary line is displayed When a circular auxiliary line is displayed on the setting screen, steps SP88 and SP90 are executed instead of steps SP76 and SP78. First, in step SP88, the rotation angle on the circular auxiliary line is calculated from the coordinates before and after the operation of the operation element that has been dragged and dropped. Next, when the process proceeds to step SP90, the display content on the setting screen is changed so that the operation element to be processed moves on the circular auxiliary line corresponding to the rotation angle. Processes other than those described above are the same as when the straight auxiliary line is displayed.

(3) When no auxiliary line is displayed If no auxiliary line is displayed on the setting screen, steps SP92 and SP94 are executed instead of steps SP76 and SP78. First, in step SP92, the movement distance in the vertical and horizontal directions of the screen is calculated from the coordinates before and after the operation of the operation element that has been dragged and dropped. Next, when the process proceeds to step SP94, the display content on the setting screen is changed so that the operation element to be processed moves by the calculated movement distance along the vertical and horizontal directions of the screen. Processes other than those described above are the same as when the straight auxiliary line is displayed. When the position of the sound receiving point image 212 is changed or the direction of the sound receiving point direction image 212a is changed in step SP78, SP90 or SP94, the position or direction of the speaker image 214 is changed accordingly. Be changed.

3.2.6. Automatic Driving Process When the user performs a predetermined operation on the keyboard of the input device 36, an automatic driving routine shown in FIG. 20 is started. In the figure, when the process proceeds to step SP102, the pronunciation point image 210 is automatically moved to the start position of the moving trajectory line 220, that is, the position of the trajectory point image 222. Next, when the process proceeds to step SP104, it is determined whether or not a predetermined stop operation has been performed on the keyboard. If “YES” is determined here, the processing of this routine is immediately terminated.

  On the other hand, if “NO” is determined in step SP104, the process proceeds to step SP106, and the position and direction of the pronunciation point image 210 in the acoustic space 102 are calculated. Next, when the processing proceeds to step SP107, a sound field calculation subroutine (FIG. 21A) described later is called, and the tap position in the delay unit 60 and each multiplication in the PAN control unit 62 and the matrix mixers 64 and 66 are called. Is set. Next, when the process proceeds to step SP108, the position of the sounding point image 210 is changed so that the sounding point image 210 moves on the moving trajectory line 220 by a predetermined distance. The moving direction of the sounding point image 210 on the moving trajectory line 220 is set to a direction in which the sounding point image 210 repeatedly passes in the order of the orbital point images 222, 224, 226, 222,. Thereafter, the processes of steps SP106 to SP108 are repeated until the stop operation is performed.

3.2.7. Next, the sound field calculation subroutine called in steps SP10, SP86 and SP107 will be described. First, when the pronunciation point image 210 or the sound receiving point image 212 is moved or when the zoom amount is changed, the routine of FIG. 21A is called. When the processing proceeds to step SP112 in FIG. 21A, the positions of “6” primary mirror images and “18” secondary mirror images are calculated from the coordinates of the sound generation point 104 in the acoustic space 102. Next, when the process proceeds to step SP114, the length and the radiation angle θG for each sound ray path of “1” direct sound, “6” primary reflected sound, and “18” secondary reflected sound. And the incident angle θR.

  Next, when the process proceeds to step SP116, a delay time until the sound reaches the sound receiving point 106 via each sound ray path is calculated based on the length of each sound ray path, and the PAN control unit 62, The tap position of each input signal of the matrix mixers 64 and 66 is set to a position corresponding to the delay time. Next, when the process proceeds to step SP118, each sound ray path is determined by the attenuation coefficient Zlen inversely proportional to the square of the sound ray path length, the attenuation coefficient ZG based on the radiation angle θG, and the attenuation coefficient ZR based on the incident angle θR. Is obtained. (Zlen · ZG · ZR) The result obtained by multiplying this attenuation factor by the distribution factor (see FIG. 4) based on the incident angle θR is set as the attenuation factor in each multiplier in the PAN control unit 62 and the matrix mixers 64 and 66.

  If only the direction of the sounding point 104 changes, the routine of FIG. 21 (b) is called. If there is a change in the direction of the sounding point 104, the radiation angle θG in each sound ray path is changed, so that the attenuation coefficient ZG based on this is also changed. As a result, the attenuation rate (Zlen, ZG, ZR) of each ray path is recalculated based on the changed attenuation coefficient ZG, and the distribution rate based on the incident angle θR with respect to the recalculated attenuation rate (FIG. 4). ) Is set as an attenuation factor in each multiplier in the PAN control unit 62 and the matrix mixers 64 and 66.

  Further, when only the direction of the sound receiving point 106 changes, the routine of FIG. 21 (c) is called. If the direction of the sound receiving point 106 is changed, the incident angle θR in each sound ray path is changed, so that the attenuation coefficient ZR based on this is also changed. As a result, the attenuation rate (Zlen · ZG · ZR) of each sound ray path is recalculated based on the changed attenuation coefficient ZR. Furthermore, if the incident angle θR changes, the distribution rate (FIG. 4) also changes. Therefore, the newly calculated attenuation factor (Zlen, ZG, ZR) of each ray path and the newly calculated distribution Based on the rate, the attenuation rate set for each multiplier in the PAN control unit 62 and the matrix mixers 64 and 66 is determined. However, in FIG. 21 (b) or (c), there is no change in the length of each sound ray path, so there is no need to recalculate the tap position of the delay unit 60.

Four. Modifications The present invention is not limited to the above-described embodiments, and various modifications can be made as follows, for example.
(1) In the above embodiment, various data processing is executed by a program operating on the personal computer 30 and the signal processing unit 10, but only this program is stored in a recording medium such as a CD-ROM or a flexible disk and distributed. Alternatively, it can be distributed through a transmission line.

(2) In the above embodiment, the tap position of the delay unit 60 and the attenuation rate of each multiplier in the PAN control unit 62 and the matrix mixers 64 and 66 are determined by the personal computer 30, and the actual signal processing is performed in the digital mixer 1. However, it goes without saying that the processing executed in the personal computer 30 may be executed by the CPU 18 in the digital mixer 1.

(3) In the above embodiment, the parameters obtained by the personal computer 30 (such as the tap position of the delay unit 60 and the attenuation rate of each multiplier in the PAN control unit 62 and the matrix mixers 64 and 66) are used as the signal processing unit 10. For example, the obtained parameters are stored in one of the tracks of the multitrack recorder 51, and the contents of the track are read out later to obtain the audio signals S_C, S_L, S_R, S_SR, S_SL. May be synthesized.

It is operation | movement explanatory drawing of the conventional audio editing system. It is operation | movement explanatory drawing which shows the principle of the audio editing system of one Example of this invention. It is a figure which shows an example of the directivity characteristic of the sounding point 104 and the sound receiving point. It is a distribution characteristic figure of an audio signal in one example. 6 is a diagram illustrating an example of a setting screen displayed on a display 34. FIG. It is a figure which shows the other example of a setting screen. It is a figure which shows the other example of a setting screen. It is a figure which shows the other example of a setting screen. It is a figure which shows the other example of a setting screen. It is a figure which shows the other example of a setting screen. It is a figure which shows the other example of a setting screen. It is a figure which shows the other example of a setting screen. It is a hardware block diagram of the audio editing system of one Example. 3 is a block diagram of an algorithm of processing executed by a signal processing unit 10. FIG. It is a flowchart of a mouse click routine. It is a flowchart of a zoom operation event routine. It is a flowchart of a ctrl key event routine. It is a flowchart of an alt key event routine. It is a flowchart of an element movement event routine. It is a flowchart of an automatic drive routine. It is a flowchart of various sound field calculation subroutines.

Explanation of symbols

  1: Digital mixer, 2: Switch group, 4: Electric fader group, 6: Rotary knob group, 8: Waveform I / O unit, 10: Signal processing unit, 12: Bus line, 14: Large display, 15: Input Device: 16: Control I / O unit, 18: CPU, 20: Flash memory, 22: RAM, 30: Personal computer, 32: Hard disk, 34: Display, 36: Input device, 38: Bus, 40: I / O interface 42: CPU, 44: ROM, 46: RAM, 50: amplifier, 51: multitrack recorder, 52: speaker system, 52C to 52SL: speaker, 54C to 54SL: distribution characteristics, 60: delay unit, 62: PAN control Part, 63, 65: adder group, 64, 66: matrix mixer, 68, 69: filter part, 70-1-k to 70-5-k: Calculator, 72-1-k to 72-5-k: adder, 74-1 to 74-5: multiplier, 102: acoustic space, 104: sounding point, 106: sound receiving point, 104b, 106b: directivity 110: sound ray path, 112-1: sound ray path, 114-1: sound ray path, 116-1, 118-1: mirror image, 202: zoom fader, 204: acoustic space contour line, 206: section 210: Sound generation point image, 210a: Sound reception point image, 212: Sound reception point image, 212a: Sound reception point direction image, 214: Speaker image, 220: Moving trajectory line, 240: Center point, 222, 224 226: Orbit point image, 232 to 246: linear auxiliary line, 252 to 266: circular auxiliary line.

Claims (6)

In a data processing method for simulating the acoustic characteristics of an acoustic space where sounding points that emit sound and sound receiving points that receive sound emitted from the sounding points are arranged,
A sound receiving point direction setting process for setting the direction of the sound receiving point in the acoustic space;
A sound ray path calculation process for calculating a plurality of sound ray paths that are sound paths from the sounding point toward the sound receiving point;
An incident angle calculating process for calculating an incident angle at which each sound ray path is incident on the sound receiving point with reference to the direction of the sound receiving point;
A distribution ratio determining step of determining a distribution ratio of the audio signal related to each sound ray path in accordance with the multi-channel audio signal of at least three channels based on the incident angle;
A data processing method comprising: distributing a sound signal related to each sound ray path to each channel of the multi-channel sound signal in accordance with the determined distribution rate.   The multi-channel audio signal includes at least first to third audio signals, and the distribution ratio is relative to the first and second audio signals when the incident angle is in the first range. When the sound signal related to the sound ray path is distributed so that the total distribution ratio becomes 100%, and the incident angle is in a second range adjacent to the first range, the second and third The sound signal related to the sound ray path is distributed so that the total of the distribution ratio for the sound signal of 100% becomes 100%, and the second angle becomes closer to the boundary value of the first and second ranges. 2. The data processing method according to claim 1, wherein a distribution ratio for the audio signal is set to be high. A delay process for delaying the sound signal associated with each sound ray path based on the distance of each sound ray path;
An attenuation process for performing an attenuation process on the sound signal related to each sound ray path so that the sound signal related to each sound ray path attenuates as the distance of each sound ray path becomes longer The data processing method according to claim 1. An acoustic space image representing the acoustic space, a sounding point image representing the sounding point, a sound receiving point image representing the sound receiving point, and a plurality of speakers arranged in a predetermined arrangement relationship with respect to the front direction. A display step of displaying a speaker image on a display, wherein the speaker image is displayed around the sound receiving point image with the direction of the sound receiving point as the front direction. Item 2. A data processing method according to Item 1.   A data processing apparatus that executes the data processing method according to claim 1.   A program for causing a processing device to execute the data processing method according to claim 1.

Images