JP4457308B2 - Parameter generation method, parameter generation apparatus and program - Google Patents

Description

  The present invention relates to a parameter generation method, a parameter generation apparatus, and a program suitable for use in creating an audio source to be played back in a surround system.

  For example, it is assumed that a sound generation point for generating some sound and a sound reception point for receiving this sound are placed in a certain acoustic space such as a rectangular parallelepiped room. The sound receiving point is a human or a microphone. In this case, the sound radiated from the sound generation point reaches the sound receiving point after being reflected by each part in the acoustic space. As described above, Patent Documents 1 and 2 disclose apparatuses that simulate the propagation of sound until reaching the sound receiving point on a computer and reproduce it on a 4-channel stereo. For example, in FIG. 1A, the speakers 52L, 52R, 52SR, and 52SL are arranged at positions that form four vertices of a square with the listener as the center. Here, assuming that the position of the listener is the sound receiving point 106, a virtual sounding point 104 is assumed in the center direction of the speakers 52L and 52R, and the sound pressure of the direct sound that reaches the sound receiving point 106 from this sounding point 104 is P. And According to the technique of Patent Document 1, the sound that gives the sound pressure of “P / 2” to the sound receiving point 106 is emitted from the left and right speakers 52L and 52R, thereby directly from the virtual sounding point 104. Sound can be simulated. In the figure, the reflected sound is omitted.

  Further, Patent Document 2 discloses a technique for changing the level of a 4-channel stereo audio signal in accordance with “the direction of the sound receiving point”. For example, if the sound receiving point is “human”, the sound pressure actually felt is different between the case where the sound pressure P is heard from the front and the case where the sound is heard from the back. Therefore, the level of the sound signal is varied using the direction of the sound receiving point as a parameter. Further, Patent Document 2 discloses a technique in which sounding points and sound receiving points are arranged at arbitrary positions in an acoustic space, and sounding points are automatically moved along a predetermined route. Patent Document 3 discloses a technique in which a user can arbitrarily set a trajectory along which a sounding point moves, and reproduce a state in which the sounding point moves on this trajectory on a 4-channel stereo.

  Further, Patent Document 4 discloses a technique for rotating a sound field reproduced by a multi-channel playback device at an arbitrary angle. This is realized by mixing each signal of multiple channels with a mixing ratio corresponding to the rotation angle. For example, in FIG. 1B, assuming that audio signals S_L, S_R, S_SR, and S_SL constituting a 4-channel stereo are given, audio signals that realize a sound field that is rotated “45 °” in the right direction are shown. Assume that sound is emitted from the speakers 52L, 52R, 52SR, and 52SL. In such a case, the adjacent audio signals S_L, S_R, S_SR, and S_SL are mixed at a ratio of “½”, and the result is the audio signals S_L ′, S_R ′, S_SR ′, S_SL. The sound may be emitted from the speakers 52L, 52R, 52SR, and 52SL.

JP 2004-212797 A Japanese Patent Laid-Open No. 2004-312109 US Pat. No. 5,636,283 JP 2003-271135 A

Incidentally, it may be necessary to simultaneously move a plurality of elements such as the sound generation point 104 and the sound receiving point 106 in the acoustic space in a certain relationship. However, according to the techniques of Patent Documents 2 and 3, etc., in such a case, the sounding point 104 and the sound receiving point 106 must be moved individually, and the operation is extremely complicated.
The present invention has been made in view of the above-described circumstances, and an object thereof is to provide a parameter generation method, a parameter generation device, and a program that can simultaneously change the arrangement of various elements in an acoustic space with a simple operation.

In order to solve the above problems, the present invention is characterized by having the following configuration. The parentheses are examples.
In the parameter generating device according to claim 1, the sound in which an element including a sounding point (104) that emits a sound and a sound receiving point (106) that receives a sound emitted from the sounding point (104) is arranged. In order to simulate the acoustic characteristics of the space (102), the sound signal (Si) output from the sounding point (104) is processed to synthesize the sound signal received at the sound receiving point (106). Parameter generating device for generating the parameters (the tap position of the delay unit 60 and the attenuation rate of each multiplier in the PAN control unit 62 and the matrix mixers 64 and 66), and the sounding point image representing the sounding point (104) (210) and an operation element including at least a sound receiving point image (212) representing the sound receiving point (106), and an acoustic space image (204) representing the acoustic space (102). Display means for displaying on a ray, selection means (SP29) for selecting a plurality of operation elements among the operation elements as selection operation elements according to a user's operation, and a movement mode of each selection operation element on the display Restricting the movement of each selection operation element only along a straight line connecting the predetermined base point and each selection operation element (movable only along an auxiliary line) movement mode limiting means (ctrl key) When a movement instruction for any one of the selection operation elements is received, the movement states for all the selection operation elements (extension / contraction of the movement distance on the auxiliary line) are determined based on the contents of the movement instruction and the restricted movement mode. And a moving state determination means for determining an expansion / contraction ratio of the distance between the base point and the selection operation element before and after the selection operation element moves along the straight line. (SP76, SP88, SP92), auxiliary line display means (SP78, SP90, SP94) for displaying a linear auxiliary line on the display along the straight line, and on the display based on the determined movement state Display position changing means for changing the display position of the selection operation element, and position changing means (SP80) in the acoustic space for resetting the position in the acoustic space (102) based on the determined moving state; Parameter generating means (SP112 to SP132) for generating the parameter based on the result changed in the acoustic space position changing means (SP80).
In the parameter generation device according to claim 2, elements including a sounding point (104) that emits a sound and a sound receiving point (106) that receives a sound emitted from the sounding point (104) are arranged. In order to simulate the acoustic characteristics of the acoustic space (102), the sound signal (Si) output from the sounding point (104) is processed to synthesize the sound signal received at the sound receiving point (106). A parameter generating device for generating parameters (such as the tap position of the delay unit 60 and the attenuation rate of each multiplier in the matrix mixers 64 and 66) for generating the sounding point (104) An operation element including at least a point image (210) and a sound receiving point image (212) representing the sound receiving point (106), and an acoustic space image (204) representing the acoustic space (102) are deselected. Display means for displaying on the display, selection means (SP29) for selecting a plurality of operation elements among the operation elements as selection operation elements in accordance with a user's operation, and the movement mode of each selection operation element on the display A movement mode restriction means (alt key) for restricting movement of each selection operation element only along a circumference passing through each selection operation element with a predetermined base point as a center, and any of the selections When a movement instruction for the operation element is received, based on the content of the movement instruction and the restricted movement mode, the movement state for all the selection operation elements is set, and each selection operation is performed along each circumference. Movement state determining means (SP76, SP88, SP92) for determining a rotation angle at which the element rotates, and auxiliary for displaying a circular auxiliary line on the display along the circumference Display means, display position changing means (SP78, SP90, SP94) for changing the display position of the selection operation element on the display based on the determined movement state, and the display based on the determined movement state An acoustic space position changing means (SP80) for resetting the position of the element in the acoustic space, and a parameter generating means (SP112) for generating the parameter based on the result changed by the acoustic space position changing means (SP80). To SP132) .
In the parameter generating device according to claim 3, elements including a sounding point (104) that emits a sound and a sound receiving point (106) that receives a sound emitted from the sounding point (104) are arranged. In order to simulate the acoustic characteristics of the acoustic space (102), the sound signal (Si) output from the sounding point (104) is processed to synthesize the sound signal received at the sound receiving point (106). A parameter generating device for generating parameters (such as the tap position of the delay unit 60 and the attenuation rate of each multiplier in the matrix mixers 64 and 66) for generating the sounding point (104) An operation element including at least a point image (210) and a sound receiving point image (212) representing the sound receiving point (106), and an acoustic space image (204) representing the acoustic space (102) are deselected. A display means for displaying on the display, a selection means (SP29) for selecting a plurality of operation elements among the operation elements as selection operation elements in accordance with a user operation, and a first or second restriction operation (ctrl key or The means for detecting that the alt key has been pressed, and the movement mode of each of the selection operation elements, when the first limiting operation (pressing the ctrl key) has been performed, are predetermined on the display. When the second restriction operation (pressing the alt key) is performed, the selection operation element is limited to be movable only along a straight line connecting the base point of the selection operation element and the selection operation element. Movement mode restriction means (ctrl key and alt key) for restricting movement of each selection operation element only along a circumference passing through each selection operation element with the base point as the center, Selection operation element When the movement instruction is received, based on the content of the movement instruction and the restricted movement mode, the movement state for all of the selection operation elements, and when the first restriction operation is performed, While determining the expansion / contraction ratio of the distance between the base point and each selection operation element before and after each selection operation element moves along each straight line, when the second restriction operation is performed, When the movement state determining means (SP76, SP88, SP92) for determining the rotation angle at which each of the selection operation elements rotates along the circumference and the first limiting operation (pressing the ctrl key) are performed, While the linear auxiliary line (232 to 246) is displayed on the display along the straight line, when the second limiting operation (pressing the alt key) is performed, the circular auxiliary line along the circumference is displayed. (252-266) Auxiliary line display means (SP60) for displaying on the display, and display position changing means (SP78, SP90, SP94) for changing the display position of the selected operation element on the display based on the determined movement state Based on the result of the change in the acoustic space position changing means (SP80), the position changing means (SP80) in the acoustic space for resetting the position of the element in the acoustic space based on the determined moving state. Parameter generating means (SP112 to SP132) for generating the parameter .
Furthermore, in the configuration according to claim 4, in the parameter generation device according to any one of claims 1 to 3 , it is determined whether or not the sound receiving point image (212) is included in the selection operation element. a determination unit, the condition that the judgment result is affirmative in the decision means, the first base point selecting means for selecting a center point (240) of the acoustic space image (204) as said base point (SP36 , SP56) and second base point selection means (SP38, SP58) for selecting the sound receiving point image (212) as the base point on the condition that the determination result in the determination means is negative. It is characterized by having.
According to another aspect of the program of the present invention, the computer simulates the acoustic characteristics of an acoustic space in which elements including a sounding point that emits a sound and a sound receiving point that receives a sound emitted from the sounding point are arranged. A program for functioning as a parameter generating device that generates a parameter for synthesizing the audio signal received at the sound receiving point by processing the audio signal output from the sound generation point, Display means for displaying an operation element including at least a sounding point image representing the sounding point and a sound receiving point image representing the sound receiving point, and an acoustic space image representing the acoustic space on a display; Selection means for selecting a plurality of operation elements among the operation elements as selection operation elements in accordance with a user operation, and a movement mode of each selection operation element in the display A movement mode restriction means for restricting movement of each selection operation element only along a straight line connecting a predetermined base point on each of the selection operation elements and a movement instruction to any of the selection operation elements Is received, based on the content of the movement instruction and the limited movement mode, the movement state for all the selection operation elements before and after the selection operation elements move along the straight lines. A moving state determining means for determining an expansion / contraction ratio of a distance between the base point and each of the selection operation elements, an auxiliary line display means for displaying a linear auxiliary line on the display along the straight line, and the determination Display position changing means for changing the display position of the selection operation element on the display based on the moved state, and the position of the element in the acoustic space based on the determined movement state An acoustic space position changing means for resetting, and characterized in that to function as a parameter generating unit that generates the parameters based on the modified results in the acoustic space position changing means.
According to another aspect of the program of the present invention, the computer simulates the acoustic characteristics of an acoustic space in which elements including a sounding point that emits a sound and a sound receiving point that receives a sound emitted from the sounding point are arranged. A program for functioning as a parameter generating device that generates a parameter for synthesizing the audio signal received at the sound receiving point by processing the audio signal output from the sound generation point, Display means for displaying an operation element including at least a sounding point image representing the sounding point and a sound receiving point image representing the sound receiving point, and an acoustic space image representing the acoustic space on a display; Selection means for selecting a plurality of operation elements among the operation elements as selection operation elements in accordance with a user operation, and a movement mode of each selection operation element in the display A movement mode restriction means for restricting movement of each selection operation element only along a circumference passing through each of the selection operation elements centered on a predetermined base point on a, and any one of the selection operation elements When the movement instruction is received, the movement state for all the selection operation elements is based on the content of the movement instruction and the restricted movement mode, and each selection operation element is moved along each circumference. A moving state determining means for determining a rotation angle for rotation; an auxiliary line displaying means for displaying a circular auxiliary line on the display along the circumference; and on the display based on the determined moving state. Display position changing means for changing the display position of the selected operation element, position changing means in acoustic space for resetting the position of the element in the acoustic space based on the determined movement state, and the sound Characterized in that it is intended to function as a parameter generating unit that generates the parameter based on a result of altered in position changing means in between.
According to another aspect of the program of the present invention, the computer simulates the acoustic characteristics of an acoustic space in which elements including a sounding point that emits a sound and a sound receiving point that receives a sound emitted from the sounding point are arranged. A program for functioning as a parameter generating device that generates a parameter for synthesizing the audio signal received at the sound receiving point by processing the audio signal output from the sound generation point, Display means for displaying an operation element including at least a sounding point image representing the sounding point and a sound receiving point image representing the sound receiving point, and an acoustic space image representing the acoustic space on a display; A selection unit that selects a plurality of operation elements among the operation elements as selection operation elements according to a user operation, and that the first or second restriction operation has been performed. A straight line connecting a predetermined base point on the display and each selection operation element when the first restriction operation (pressing the ctrl key) is performed. The selection operation element is limited to be movable only along the line, and when the second restriction operation (the alt key is pressed) is performed, the selection operation element passes through the selection operation element with the base point as the center. When the movement mode restriction means for restricting movement of each selection operation element only along the circumference to be performed and the movement instruction for any of the selection operation elements are received, the content of the movement instruction is limited. Based on the movement mode, when each of the selection operation elements is in a movement state, and the first restriction operation (depressing the ctrl key) is performed, the selection operation elements along the straight lines Before and after moving In the meantime, the expansion / contraction ratio of the distance between the base point and each selection operation element is determined (SP76). On the other hand, when the second limit operation (pressing the alt key) is performed, along the circumference A movement state determination means that determines a rotation angle at which each of the selection operation elements rotates (SP88), and when the first limiting operation (the ctrl key is pressed) is performed, a linear auxiliary line ( 232 to 246) are displayed on the display, and when the second restriction operation (the alt key is pressed), circular auxiliary lines (252 to 266) are displayed on the display along the circumference. Auxiliary line display means (SP40, SP60) to be displayed on the display, display position changing means for changing the display position of the selected operation element on the display based on the determined movement state, and the determined movement state Based on the above An acoustic space position changing means for resetting the position of an element in the acoustic space, and a parameter generating means for generating the parameter based on the result changed in the acoustic space position changing means It is characterized by being .
Furthermore, in the configuration according to claim 8, in the program according to any one of claims 5 to 7, the computer is further configured to determine whether or not the sound receiving point image is included in the selection operation element. A determination means for determining, a first base point selection means for selecting a central point of the acoustic space image as the base point on the condition that the determination result in the determination means is positive, and a determination result in the determination means Is a second base point selection unit that selects the sound receiving point image as the base point, on the condition that is negative.

  Thus, according to the present invention, when a movement instruction for any selection operation element is received, the movement state for all selection operation elements is determined based on the content of the movement instruction and the restricted movement mode. Therefore, the arrangement of various elements in the acoustic space can be changed simultaneously with a simple operation.

1． Summary of Examples
1.1. 2. Relationship between Positions of Various Elements and Sounds In FIG. 2, it is assumed that a sound generation point 104 and a sound reception point 106 are placed in a rectangular parallelepiped acoustic space 102. First, sound directly reaches the sound receiving point 106 from the sounding point 104 along the sound ray path (sound propagation path) 110. Further, the primary reflected sound (sound that is reflected only once on the wall surface of the acoustic space 102) arrives along the sound ray path 112-1. The total number of sound ray paths of the primary reflected sound is “6”, that is, the same as the number of wall surfaces forming the rectangular acoustic space 102, and there are “5” in addition to the sound ray path 112-1. ).

  Further, the secondary reflected sound reaches along the sound ray path 114-1. The total number of sound ray paths of the secondary reflected sound is “18”, and there are “17” other than the sound ray path 114-1 (not shown). The method for obtaining the number of secondary reflected sounds is described in detail in Patent Document 1 above. In reality, there are third and subsequent reflections, but these are ignored. Each time the reflected sound is reflected “1” times on the wall, it attenuates and undergoes a change in frequency characteristics (filtering process). Here, when the wall surface of the acoustic space 102 is a mirror, it is possible to draw mirror images 116-1 and 118-1 of the pronunciation point 104 reflected in the mirror.

  These mirror images are separated from the sound receiving point 106 by the same length as the solid sound ray path, and have the same angle with respect to the sound receiving point 106 as each sound ray path is incident on the sound receiving point 106. ing. The number of mirror images is equal to the number of sound ray paths related to the reflected sound. In this embodiment, directivity characteristics are imparted to the sounding point 104 and the sound receiving point 106. Therefore, in FIG. 2, the front directions of both are indicated by arrows 104a and 106a. An example of both directivity characteristics 104b and 106b is shown in FIG. Here, the angle at which each sound ray path is radiated from the sound generation point 104 is defined as a radiation angle θG with respect to the front direction 104a of the sound generation point 104, and the angle at which the sound ray path is incident on the sound reception point 106. Is the incident angle θR with reference to the front direction 106 a of the sound receiving point 106. In FIG. 3, the radiation angle and the incident angle of the sound ray paths 112-1 and 114-1 are shown as θG1, θG2, and θR1, θR2, respectively.

Here, the audio signal reaching the sound receiving point 106 from each sound ray path is an audio signal obtained by performing the following attenuation and filtering processing on the audio signal generated by the sound generation point 104.
(1) Attenuation process for multiplying the attenuation coefficient Zlen inversely proportional to the square of the sound ray path length (2) Filtering process for multiplying the filtering characteristic Zref on the reflecting surface by the number of reflections (3) Directivity characteristic 104b and radiation angle θG Attenuation process for multiplying attenuation coefficient ZG based on (4) Attenuation process for multiplying attenuation coefficient ZR based on directivity characteristic 106b and incident angle θR

  The sound signal of each sound ray path obtained as described above is assigned to a reproduction channel. Here, a 5.1 surround system is assumed as the playback system. In the reproduction system, on the circumference of the radius “2.5” m centering on the listener, the center speaker 52C is located in front of the listener, the left and right speakers 52L and 52R are located at the left and right “30 °” positions, and the left and right “120” are located. It is assumed that the left and right surround speakers 52SL and 52SR are respectively disposed at the position “°”. The positions of these speakers are shown by broken lines in FIG. In addition, in the 5.1 surround system, “subwoofer” is also provided, but this is not shown because it is not related to localization.

  The audio signals of the channels supplied to the speakers 52C, 52L, 52R, 52SR, and 52SL are respectively S_C, S_L, S_R, S_SR, and S_SL, and the ratio when the audio signals of the sound ray paths are distributed to these channels is shown. As shown in FIG. In FIG. 4, distribution characteristics 54C, 54L, 54R, 54SR, and 54SL are functions of the incident angle θR, and the sound signals of the sound ray path are distributed to the sound signals S_C, S_L, S_R, S_SR, and S_SL, respectively. This is the distribution rate. In each of the illustrated sections A to E, only the “2” channel has a distribution rate exceeding “0%” at the same time, and the total distribution rate of both channels is “100%”. In addition, at the boundary between the sections A to E, the distribution rate of only “1” channel is “100%”, and the distribution rates of other channels are “0%”.

  Thus, according to the present embodiment, the sound signal of each sound ray path is distributed to the sound signals S_C, S_L, S_R, S_SR, and S_SL so that the listener can hear sound from the direction of the incident angle θR. The generated multi-channel audio signal is generated as an audio signal suitable for the direction of the sound receiving point 106. Therefore, it is not necessary to further rotate the sound field of the multi-channel audio signal, and a sharp sound image localization can be realized with a small amount of calculation.

1.2. User Interface In this embodiment, the distribution of the audio signal to the “5” channel constituting the surround system described above is executed on the digital mixer, but the acoustic space 102, sound generation point 104, sound reception point 106, etc. The setting is executed on the screen of the personal computer. Therefore, the user interface on the setting screen of the personal computer will be described.

  First, an example of the setting screen is shown in FIG. In the figure, reference numeral 206 denotes a section line, which is formed by continuously arranging broken-line square frames vertically and horizontally. In the illustrated example, one frame corresponds to “1 m × 1 m” in the acoustic space 102. An acoustic space outline 204 represents a side wall surface of an assumed rectangular parallelepiped acoustic space. A zoom fader 202 sets the zoom amount of the display screen. Here, the zoom amount corresponds to the number of frames in the horizontal direction of the section line 206, and is “20” in the illustrated example. The position of each side wall surface constituting the acoustic space outline 204 and the operation position of the zoom fader 202 can be appropriately moved by dragging them with the mouse.

  Next, 210 is a sounding point image inside the acoustic space outline 204 and displays the position of the sounding point 104. A sounding point direction image 210a displays the front direction of the sounding point 104. A sound receiving point image 212 displays the position of the sound receiving point 106. A sound receiving point direction image 212 a displays the front direction of the sound receiving point 106. Reference numeral 214 denotes a speaker image, which is formed by arranging the images of the speakers 52C, 52L, 52R, 52SR, and 52SL on a circle having a radius of “2.5 m” with the sound receiving point image 212 as the center. As in the case of 2, a 5.1 surround system speaker arrangement is assumed as a reproduction system. Furthermore, the speaker image 214 is configured such that the image of the center speaker 52C is positioned in the direction of the sound receiving point direction image 212a. The arrangement of the speaker image 214 with respect to the sound receiving point image 212 and the sound receiving point direction image 212a is always maintained even after the position and direction of the sound receiving point 106 are changed.

  The positions of the sound generation point image 210 and the sound receiving point image 212 can be freely changed inside the acoustic space outline 204 by dragging and dropping with the mouse. When the sounding point image 210 or the sound receiving point image 212 is moved, the sounding point direction image 210a or the sound receiving point direction image 212a is moved in conjunction with these. Also, the direction of the sound generation point direction image 210a and the sound receiving point direction image 212a can be freely set by the user by dragging and dropping with the mouse. However, the direction images 210a and 212a can move only on the circumference of a predetermined radius centering on the sounding point image 210 and the sound receiving point image 212, respectively. The directions indicated by the direction images 210a and 212a are as follows: Each of the sound generation point image 210 and the sound receiving point image 212 is only in the radiation direction.

  Next, FIG. 6 shows a state in which the sound receiving point image 212 is moved slightly to the left on the setting screen and the sound receiving point direction image 212a is rotated slightly to the right. Since the speaker image 214 is automatically determined based on the position of the sound receiving point image 212, the direction of the sound receiving point direction image 212a, and the zoom amount of the zoom fader 202, the sound receiving point image 212 as shown in the figure. And follow the sound receiving point direction image 212a to rotate.

  Here, the pronunciation point image 210 and the pronunciation point direction image 210a can be similarly changed in position and direction by dragging and dropping the mouse. However, a certain “trajectory” is set in advance for the pronunciation point image 210, It is possible to automatically move on the orbit. Reference numeral 220 denotes a moving trajectory line, which displays a trajectory along which the pronunciation point image 210 moves. Reference numerals 222, 224, and 226 denote trajectory point images, which are points for specifying the moving trajectory line 220. That is, the moving trajectory line 220 is determined by a line (straight line or curve) connecting the trajectory point images 222, 224, and 226 to each other, and the positions of the trajectory point images 222, 224, and 226 are also determined by dragging and dropping the mouse. It can be set arbitrarily.

  Next, FIG. 7 shows a setting screen when the zoom amount is changed to “30” by operating the zoom fader 202 on the setting screen of FIG. In this figure, the section lines 206 are denser than those in FIG. 6, and it can be seen that the area of the area displayed on the setting screen is increased. However, in the setting screen of FIG. 7, the size and position of the acoustic space outline 204, the sounding point image 210, the sound receiving point image 212, the trajectory point images 222, 224, 226, and the moving trajectory line 220 are displayed on the screen. Is not changed compared to that of FIG. However, since the speaker image 214 is drawn on the circumference of the section line 206 with the radius “2.5 m”, the speaker image 214 is displayed smaller than that of FIG.

  Further, FIG. 8 shows a setting screen when the zoom amount is changed to “10” by operating the zoom fader 202 on the screen of FIG. 6 or FIG. In this figure, the section lines 206 are wider than those in FIG. 6, and it can be seen that the area of the area displayed on the setting screen is reduced. Also on this setting screen, the size and position of the acoustic space outline 204, the sounding point image 210, the sound receiving point image 212, the trajectory point images 222, 224, 226, and the moving trajectory line 220 are displayed on the screen in FIG. Not changed compared to the ones. However, the speaker image 214 is enlarged as compared with that in FIG.

  In other words, the zoom fader 202 in this embodiment does not simply change the display state (scale) of the setting screen, but the relative positional relationship of each element arranged in the acoustic space to be simulated. While holding, the size of the entire acoustic space is enlarged or reduced. Since the display state of the section line 206 and the speaker image 214 is changed by the operation of the zoom fader 202, the user can change the acoustic space when compared with the assumed listening room size (approximately 5 m × 5 m). Intuitively understand the size and position of each element

  Here, the sounding point image 210, the sounding point direction image 210a, the sound receiving point image 212, the sound receiving point direction image 212a, and the trajectory point images 222, 224, and 226 are arbitrarily set by the user by operating the mouse. Since these are possible elements, these will be referred to as “operation elements”. The user can set an operation element to a “selected state” by clicking any operation element with the mouse. When an operation element that is in a normal state is clicked with the mouse, all the operation elements that have already been selected become unselected, and only one operation element that is newly clicked is selected.

  Further, when the shift key of the keyboard of the personal computer is kept pressed, a plurality of operation elements can be set to the selected state. In addition, when one shift operation element is clicked with the mouse while the shift key is continuously pressed, the one operation element is deselected. In such a case, the selection / non-selection state of other operation elements is maintained as it is. However, the sounding point direction image 210a and the sound receiving point direction image 212a can be selected only by themselves, and cannot be selected together with other operation elements.

  Therefore, in the following drawings, the operation elements set in the selected state are displayed by double circles. In the example shown in FIG. 8, the pronunciation point image 210, the trajectory point image 224, and the trajectory point image 226 are set to the selected state. When multiple operation elements are in the selected state, if you perform a drag-and-drop operation on any of the selected operation elements, the relative positional relationship of all the selected operation elements is maintained. However, the positions of these operation elements on the screen are changed in conjunction with each other.

  Next, when one or more operation elements are selected, when the ctrl key is pressed on the keyboard, a “straight auxiliary line” is displayed on the screen for each selected operation element. . FIG. 9 shows a screen in which the ctrl key is pressed on the screen shown in FIG. 8 and a linear auxiliary line is displayed. The straight auxiliary line is a straight line connecting a certain “base point” and each operation element in a selected state. Here, the “base point” is the sound receiving point image 212 when the sound receiving point image 212 is in a non-selected state, and the sound space contour line 204 when the sound receiving point image 212 is in a selected state. Central. In the example of FIG. 9, since the sound receiving point image 212 is in a non-selected state, the sound receiving point image 212 is the base point, and straight lines connecting the sound receiving point image 212 and the operation elements 210, 224 and 226 as straight lines. Mold auxiliary lines 232, 234, 236 are drawn.

  When the linear auxiliary line is drawn in this way, each operation element in the selected state can move only on the corresponding linear auxiliary line. That is, when a certain operation element is dragged and dropped with the mouse, the coordinates of a point on the linear auxiliary line located closest to the drop position are obtained, and the operation element is moved to the obtained point. In addition, when multiple operation elements are selected and a linear auxiliary line is displayed, if any selected operation element is moved by a drag-and-drop operation, the expansion / contraction rate of the distance between the base point and the operation element The other selected elements are moved by a distance that realizes the expansion / contraction ratio.

  For example, on the scale of the section line 206 in FIG. 9, the distances from the base point (sound receiving point image 212) of the pronunciation point image 210, the orbit point image 224, and the orbit point image 226 are “7 m” and “2.5 m, respectively. And “5.5 m”. It is assumed that the pronunciation point image 210 is moved to a distance of “9 m” from the base point by dragging and dropping in this state. In such a case, since the expansion / contraction ratio of the pronunciation point image 210 is “9/7”, the orbit point image 224 is about “3.2 m” from the base point, and the orbit point image 226 is about “6.4 m” from the base point. In this way, they move on the straight auxiliary lines 234 and 236, respectively. In this case, when only a part of the “3” trajectory point images 222, 224, 226 is moved, the shape of the moving trajectory line 220 is naturally changed following this. Become.

  Next, FIG. 10 shows display contents when the selection of the trajectory point image 224 is canceled with respect to the state of FIG. 9 and the sound receiving point image 212 is selected. When the sound receiving point image 212 is selected, as shown in the figure, the center point 240 of the acoustic space outline 204 becomes the base point, and straight lines connecting the base point and the selected operation elements 212, 210, and 226, respectively. As shown, straight auxiliary lines 242, 244 and 246 are drawn. Except that the base point is changed in this way and the linear auxiliary line is changed accordingly, the operation method of each operation element is the same as that in FIG.

  Next, when one or more operation elements are in the selected state, when the alt key is pressed on the keyboard, a “circular auxiliary line” is displayed on the screen for each selected operation element. . FIG. 11 shows a screen on which the alt key is pressed and a circular auxiliary line is displayed on the screen shown in FIG. The circular auxiliary line is a circle or an arc that passes through each selected operation element with a certain “base point” as the center. The “base point” here is the sound receiving point image 212 when the sound receiving point image 212 is in the non-selected state, as in the case of the linear auxiliary line, and the sound receiving point image 212 is in the selected state. Is the center of the acoustic space outline 204. In the example of FIG. 11, since the sound receiving point image 212 is in a non-selected state, the sound receiving point image 212 becomes the base point, and the circular auxiliary is defined as a circle that passes through the operation elements 224, 226, and 210 centering on this base point. Lines 252, 254 and 256 are drawn.

  When the circular auxiliary line is drawn in this way, each operation element in the selected state can move only on the corresponding circular auxiliary line. That is, when an operation element is dragged and dropped with the mouse, the coordinates of a point on the circular auxiliary line located immediately near the drop position are obtained, and the operation element is moved to the obtained point. In addition, when a plurality of operation elements are selected and a circular auxiliary line is displayed, when any selected operation element is moved by a drag and drop operation, the rotation angle viewed from the base point is obtained, The other selected elements are moved so as to rotate by the same rotation angle on the corresponding circular auxiliary lines.

  Next, FIG. 12 shows display contents when the selection of the trajectory point image 224 is canceled with respect to the state of FIG. 11 and the sound receiving point image 212 is selected. When the sound receiving point image 212 is selected, as shown in the figure, the center point 240 of the acoustic space outline 204 becomes the base point, and the selected operation elements 226, 210, 212 are centered on this base point. Circular auxiliary lines 262, 264 and 266 are drawn as circles passing through each. Except that the base point is changed and the circular auxiliary line is changed accordingly, the operation method of each operation element is the same as in the case of FIG.

2． Hardware Configuration of Embodiment Next, the hardware configuration of the voice editing system of one embodiment of the present invention will be described with reference to FIG. The audio editing system includes a multitrack recorder 51 that records / reproduces audio signals or control signals, a digital mixer 1 that mixes audio signals, a personal computer 30 that sets the mixing state, and edited audio. It comprises an amplifier 50 and a speaker system 52 for reproducing signals.

  In the digital mixer 1, reference numeral 4 denotes an electric fader group, which adjusts the signal level of each input / output channel based on a user operation. Furthermore, the electric fader group 4 is configured such that when an operation command is supplied via the bus line 12, the operation position is automatically set. Reference numeral 2 denotes a switch group, which includes various switches and LED keys, and the blinking state of the LED built in the LED key is set via the bus line 12. Reference numeral 6 denotes a rotary knob group for setting the left and right volume balance of each input / output channel.

  A waveform I / O unit 8 inputs and outputs analog audio signals or digital audio signals. In the present embodiment, for example, if an audio signal radiated from the sound generation point 104 is recorded on any track of the multitrack recorder 51, this audio signal is input via the waveform I / O unit 8. become. The audio signals composing the 5.1 surround system synthesized in the digital mixer 1 are supplied to the multitrack recorder 51 via the waveform I / O unit 8 and recorded there. Further, each audio signal constituting the 5.1 surround system is converted into an analog signal in the waveform I / O unit 8 and emitted through the amplifier 50 and the speaker system 52.

  Next, reference numeral 10 denotes a signal processing unit, which is constituted by a group of DSPs (digital signal processors). The signal processing unit 10 performs mixing processing and effect processing on the digital audio signal supplied via the waveform I / O unit 8 and outputs the result to the waveform I / O unit 8. A large display 14 displays various information to the user. Reference numeral 15 denotes an input device, which includes various operators on the operation panel, a keyboard, a mouse, and the like, and performs a cursor movement on the large display 14 and an on / off operation of buttons displayed on the large display 14. Reference numeral 16 denotes a control I / O unit which inputs / outputs various control signals to / from the personal computer 30 or the like. Reference numeral 18 denotes a CPU that controls each unit via the bus line 12 based on a control program stored in the flash memory 20. A RAM 22 is used as a work memory for the CPU 18.

  Next, 32 in the personal computer 30 is a hard disk that stores an operating system, various application programs, and the like. Reference numeral 34 denotes a display that displays various types of information to the user. Reference numeral 36 denotes an input device, which includes a keyboard for inputting characters and a mouse. Reference numeral 40 denotes an input / output interface for inputting / outputting various control signals to / from the control I / O unit 16 of the digital mixer 1. A CPU 42 controls other components in the personal computer 30 via the bus 38. A ROM 44 stores an initial program loader and the like. A RAM 46 is used as a work memory for the CPU 42.

3． Operation of the embodiment
3.1. Algorithm of Digital Mixer 1 As described above, in the digital mixer 1, when an audio signal radiated from the sound generation point 104 is input from the multitrack recorder 51, this signal is set as an input audio signal Si based on this. The 5 ”channel audio signals S_C, S_L, S_R, S_SR, and S_SL are generated in the signal processing unit 10. The contents of the mixing algorithm executed in the signal processing unit 10 will be described with reference to FIG.

  In FIG. 14, 60 is a delay unit that delays the input audio signal Si in units of sampling periods. The delayed input audio signal Si is output from an arbitrary position (tap position) with a sampling period as a unit up to a predetermined maximum delay time. A PAN control unit 62 includes “5” multipliers 74-1 to 74-5 as shown in FIG. These multipliers multiply the signals at the designated tap positions of the delay unit 60 by designated “5” types of attenuation factors, respectively, and output the resulting “5” channel signals.

  More specifically, the tap position for the PAN control unit 62 is a position corresponding to the direct sound delay time TD0 (speech propagation time with respect to the length of the sound ray path 110 of the direct sound in FIG. 2). Further, as described above with reference to FIG. 2, the direct sound is caused by the attenuation coefficient Zlen that is inversely proportional to the square of the ray path length, the attenuation coefficient ZG based on the radiation angle θG, and the attenuation coefficient ZR based on the incident angle θR. It will be attenuated. Accordingly, the attenuation rate set in the multipliers 74-1 to 74-5 is equal to the result obtained by multiplying “Zlen · ZG · ZR” by the distribution rate (see FIG. 4) based on the incident angle θR.

  Here, the signal processing in the signal processing unit 10 is actually executed by the DSP. According to the present embodiment, since the number of channels whose distribution rate based on the incident angle θR exceeds “0%” is “2” channels at the maximum, the calculation only needs to be performed for these “2” channels. After all, in the signal processing unit 10, the PAN control unit 62 needs to perform multiplication only “2” times.

  Next, 64 is a matrix mixer, and a circuit similar to the PAN control unit 62 is provided with the number of sound ray paths n of primary reflected sound, that is, “6” systems, and is configured to mix audio signals for each system. . More specifically, as shown in FIG. 14 (c), “5” multipliers 70-1-k to 70-5-k (k is 0 to 5) for each system, and these multipliers. The matrix mixer 64 is composed of adders 72-1-k to 72-5-k (k is 1 to 5) that mix the multiplication results of each channel.

  The audio signal of each system supplied to the matrix mixer 64 is an audio signal output from the tap position of the delay unit 60 corresponding to the delay time of the primary reflected sound. Here, the primary reflected sound is attenuated by the attenuation coefficients Zlen, ZG, ZR in the same manner as the direct sound. Further, the primary reflected sound is subjected to filtering on the reflection surface of the acoustic space 102, but such processing is executed in the subsequent filter unit 69. Accordingly, the attenuation rate set in the multipliers 70-1-k to 70-5-k is distributed based on the incident angle θR with respect to “Zlen · ZG · ZR” as in the case of the direct sound. The value multiplied by the rate. As in the case of the direct sound, the signal processing unit 10 only needs to execute multiplication “2” times for each sound ray path.

  Next, reference numeral 66 denotes a matrix mixer for secondary reflected sound, which is configured in the same manner as the matrix mixer 64 for primary reflected sound. However, since the number of sound ray paths n of the secondary reflected sound is “18”, the number of multipliers and adders in the matrix mixer 66 is also set in accordance with the number of sound ray paths n. The audio signal of each system supplied to the matrix mixer 66 is an audio signal output from the tap position of the delay unit 60 corresponding to the delay time of the secondary reflected sound. Similarly to the case of the primary reflected sound, in the matrix mixer 66, the attenuation rate set in each multiplier is a value obtained by multiplying “Zlen · ZG · ZR” by the distribution rate based on the incident angle θR. is there.

  Next, reference numeral 68 denotes a filter unit, which applies a filtering process on the reflection surface of the acoustic space 102 to the “5” channel audio signal output from the matrix mixer 66. Reference numeral 65 denotes an adder group that adds each output signal of the filter unit 68 and the output signal of the corresponding channel of the matrix mixer 64. Reference numeral 69 denotes a filter unit having the same characteristics as the filter unit 68, and performs a filtering process on each output signal of the adder group 65. Reference numeral 63 denotes an adder group, which adds each output signal of the filter unit 69 and the output signal of the corresponding channel of the PAN control unit 62, and outputs the result as audio signals S_C, S_L, S_R, S_SR, S_SL. . These audio signals S_C, S_L, S_R, S_SR, and S_SL are recorded on the multitrack recorder 51 via the waveform I / O unit 8 as described above.

3.2. Processing of personal computer 30
3.2.1. Operation element click event (Figure 15)
Next, the operation in the personal computer 30 will be described. When a predetermined operation is performed on the input device 36 of the personal computer 30, a setting screen as shown in FIGS. 5 to 12 is displayed on the display 34. When any operation element is clicked with the mouse on the setting screen, a mouse click routine shown in FIG. 15 is started.

  When the process proceeds to step SP22 in FIG. 15, it is determined whether or not the clicked operation element is any one of the direction images 210a and 212a. If "YES" is determined here, the process proceeds to step SP28, and selection of all operation elements that have not been clicked is cancelled. Next, when the process proceeds to step SP29, the selected / unselected state of the clicked operation element is reversed. Therefore, each of the direction images 210a and 212a can be selected only by itself, and when one of the direction images 210a and 212a is clicked, the selected / non-selected state is inverted each time the button is clicked. become.

  If an operation element other than the direction images 210a and 212a is clicked, the process proceeds to step SP24 to determine whether or not the shift key is pressed on the keyboard of the input device 36. If "NO" is determined here, the process proceeds to step SP28, and the same process as in the case of the direction images 210a and 212a described above is executed. That is, when the shift key is not pressed, each operation element can be selected alone, all the operation elements that are not clicked are set to a non-selected state, and each clicked operation element is clicked. The selected / unselected state is inverted.

  On the other hand, if the shift key is pressed and an operation element other than the direction images 210a and 212a is clicked, “YES” is determined in step SP24, and the process proceeds to step SP26. Here, if any of the direction images 210a and 212a is in a selected state, the selected state is canceled. Next, when the process proceeds to step SP29, the selected / unselected state of the clicked operation element is reversed. That is, when the operation element has been selected so far, it is set to a non-selected state, and when it is not selected, it is set to a selected state. In this case, since the state of the operation element that has not been clicked is not changed except for the direction image, if the operation element that is not selected is clicked “1” times while the shift key is pressed, these operation elements Are all set to the selected state.

3.2.2. Zoom operation event Next, when the zoom fader 202 is dragged and dropped with the mouse, a zoom operation event routine shown in FIG. 16 is started. When the processing proceeds to step SP2 in the figure, the distance from the sound receiving point image 212 to each speaker constituting the speaker image 214 on the setting screen according to the changed zoom amount (position where the zoom fader 202 is dropped). (The number of dots on the display 34) is calculated. That is, since the speaker image is assumed to be on the circumference of the radius “2.5 m” with the sound receiving point 106 as the center in the acoustic space 102, the speaker image 214 is reduced in scale according to the changed zoom amount. Is calculated. Next, when the process proceeds to step SP4, the size of each speaker constituting the speaker image 214 is calculated according to the changed zoom amount. Accordingly, when the user operates the zoom fader 202 to zoom in, the radius of the speaker image 214 and the size of each displayed speaker increase, and when zoomed out, the radius of the speaker image 214 and the size of each displayed speaker appear. Becomes smaller.

  Next, when the process proceeds to step SP6, the section line 206 is displayed again according to the changed zoom amount, and the speaker image 214 is displayed at the calculated distance and size. Next, when the processing proceeds to step SP8, the size of the acoustic space 102 (see FIG. 2) to be simulated and the positions of the sound generation point 104 and the sound receiving point 106 are changed to reflect the zoom amount change result. . That is, the size of the acoustic space 102 and the positions of the sound generation point 104 and the sound receiving point 106 are recalculated according to the zoom amount so that the position on the screen of each operation element displayed on the screen does not change. Is done.

  Thus, as described above with reference to FIGS. 6 to 8, when the zoom amount is changed, the position between the elements in the acoustic space 102 varies, but the position on the setting screen is not changed. Next, when the process proceeds to step SP10, a sound field calculation subroutine shown in FIG. Although details will be described later, based on the state in the acoustic space 102, the tap position in the delay unit 60 and the attenuation rate of each multiplier in the PAN control unit 62 and the matrix mixers 64 and 66 are set.

3.2.3. ctrl Key Event Processing Next, when a ctrl key on event occurs on the keyboard of the input device 36, a ctrl key on event routine shown in FIG. 17A is started. In the figure, when the process proceeds to step SP32, it is determined whether or not there is an operation element selected in the setting screen. If “NO” is determined here, the routine is immediately terminated. On the other hand, if "YES" is determined, the process proceeds to step SP34 to determine whether or not the sound receiving point image 212 is included in the selected operation element. If "YES" is determined here, the process proceeds to step SP36, and the center point 240 of the acoustic space outline 204 is set as a base point as described in FIG. On the other hand, if “NO” is determined in step SP36, the sound receiving point image 212 is set as the base point as described in FIG. Next, when the process proceeds to step SP40, a linear auxiliary line connecting each operation element in the selected state and the base point is displayed on the setting screen.

  When the ctrl key off event occurs, the ctrl key off event routine shown in FIG. 17B is started. In the figure, when the process proceeds to step SP45, all the linear auxiliary lines on the setting screen are deleted, and the process of this routine ends.

3.2.4. alt Key Event Processing When an alt key on event occurs on the keyboard, an alt key on event routine shown in FIG. In the figure, when the process proceeds to step SP52, it is determined whether or not there is an operation element selected in the setting screen. If “NO” is determined here, the routine is immediately terminated. On the other hand, if "YES" is determined, the process proceeds to step SP54 to determine whether or not the sound receiving point image 212 is included in the selected operation element. If “YES” is determined here, the process proceeds to step SP56, and as described in FIG. 12, the center point 240 of the acoustic space outline 204 is set as a base point. On the other hand, if “NO” is determined in step SP56, the sound receiving point image 212 is set as the base point as described in FIG. Next, when the process proceeds to step SP60, a circular auxiliary line that is a circle or an arc passing through each operation element in the selected state with this base point as the center is displayed on the setting screen.

  When an alt key off event occurs, an alt key off event routine shown in FIG. 18B is started. In the figure, when the process proceeds to step SP65, all the circular auxiliary lines on the setting screen are deleted, and the process of this routine ends.

3.2.5. Element move processing
(1) When a linear auxiliary line is displayed When any operation element in the selected state is dragged and dropped with the mouse, an element movement event routine shown in FIG. 19 is started. In FIG. 19, when the process proceeds to step SP72, an operation element that has been dragged and dropped is selected as a processing target. Next, when the process proceeds to step SP74, it is determined whether or not a linear auxiliary line is displayed. If "YES" is determined here, the process proceeds to step SP76, and the movement distance on the linear auxiliary line is calculated from the coordinates before and after the operation of the operation element dragged and dropped. Next, when the process proceeds to step SP78, the display content on the setting screen is changed so that the operation element to be processed moves the linear auxiliary line by the movement distance.

  Next, when the process proceeds to step SP80, the position and direction of the operation element in the acoustic space 102 are calculated based on the changed state of the setting screen. Next, when the process proceeds to step SP82, it is determined whether or not there remains an operation element that has not yet been moved in the acoustic space 102 (step SP80) among the selected operation elements. If “YES” is determined here, the process proceeds to step SP84, and one operation element among the remaining elements is selected as a processing target, and the processes of steps SP74 to SP80 are repeated. When such processing is completed for all operation elements in the selected state, “NO” is determined in step SP82, and the processing proceeds to step SP86. Here, a sound field calculation subroutine (FIG. 21A) to be described later is called, and the tap position in the delay unit 60 and the attenuation rate of each multiplier in the PAN control unit 62 and the matrix mixers 64 and 66 are set. The

(2) When a circular auxiliary line is displayed When a circular auxiliary line is displayed on the setting screen, steps SP88 and SP90 are executed instead of steps SP76 and SP78. First, in step SP88, the rotation angle on the circular auxiliary line is calculated from the coordinates before and after the operation of the operation element that has been dragged and dropped. Next, when the process proceeds to step SP90, the display content on the setting screen is changed so that the operation element to be processed moves on the circular auxiliary line corresponding to the rotation angle. Processes other than those described above are the same as when the straight auxiliary line is displayed.

(3) When no auxiliary line is displayed If no auxiliary line is displayed on the setting screen, steps SP92 and SP94 are executed instead of steps SP76 and SP78. First, in step SP92, the movement distance in the vertical and horizontal directions of the screen is calculated from the coordinates before and after the operation of the operation element that has been dragged and dropped. Next, when the process proceeds to step SP94, the display content on the setting screen is changed so that the operation element to be processed moves by the calculated movement distance along the vertical and horizontal directions of the screen. Processes other than those described above are the same as when the straight auxiliary line is displayed. When the position of the sound receiving point image 212 is changed or the direction of the sound receiving point direction image 212a is changed in step SP78, SP90 or SP94, the position or direction of the speaker image 214 is changed accordingly. Be changed.

3.2.6. Automatic Driving Process When the user performs a predetermined operation on the keyboard of the input device 36, an automatic driving routine shown in FIG. 20 is started. In the figure, when the process proceeds to step SP102, the pronunciation point image 210 is automatically moved to the start position of the moving trajectory line 220, that is, the position of the trajectory point image 222. Next, when the process proceeds to step SP104, it is determined whether or not a predetermined stop operation has been performed on the keyboard. If “YES” is determined here, the processing of this routine is immediately terminated.

  On the other hand, if “NO” is determined in step SP104, the process proceeds to step SP106, and the position and direction of the pronunciation point image 210 in the acoustic space 102 are calculated. Next, when the processing proceeds to step SP107, a sound field calculation subroutine (FIG. 21A) described later is called, and the tap position in the delay unit 60 and each multiplication in the PAN control unit 62 and the matrix mixers 64 and 66 are called. Is set. Next, when the process proceeds to step SP108, the position of the sounding point image 210 is changed so that the sounding point image 210 moves on the moving trajectory line 220 by a predetermined distance. The moving direction of the sounding point image 210 on the moving trajectory line 220 is set to a direction in which the sounding point image 210 repeatedly passes in the order of the orbital point images 222, 224, 226, 222,. Thereafter, the processes of steps SP106 to SP108 are repeated until the stop operation is performed.

3.2.7. Next, the sound field calculation subroutine called in steps SP10, SP86 and SP107 will be described. First, when the sounding point image 210 or the sound receiving point image 212 is moved, or when the zoom amount is changed, the routine of FIG. 21A is called. When the processing proceeds to step SP112 in FIG. 21A, the positions of “6” primary mirror images and “18” secondary mirror images are calculated from the coordinates of the sound generation point 104 in the acoustic space 102. Next, when the process proceeds to step SP114, the length and the emission angle θG for each sound ray path of “1” direct sound, “6” primary reflected sound, and “18” secondary reflected sound. And the incident angle θR.

  Next, when the process proceeds to step SP116, a delay time until the sound reaches the sound receiving point 106 via each sound ray path is calculated based on the length of each sound ray path, and the PAN control unit 62, The tap position of each input signal of the matrix mixers 64 and 66 is set to a position corresponding to the delay time. Next, when the process proceeds to step SP118, each sound ray path is determined by the attenuation coefficient Zlen inversely proportional to the square of the sound ray path length, the attenuation coefficient ZG based on the radiation angle θG, and the attenuation coefficient ZR based on the incident angle θR. Is obtained. (Zlen · ZG · ZR) The result obtained by multiplying this attenuation factor by the distribution factor (see FIG. 4) based on the incident angle θR is set as the attenuation factor in each multiplier in the PAN control unit 62 and the matrix mixers 64 and 66.

  If only the direction of the sounding point 104 changes, the routine of FIG. 21 (b) is called. If there is a change in the direction of the sounding point 104, the radiation angle θG in each sound ray path is changed, so that the attenuation coefficient ZG based on this is also changed. As a result, the attenuation rate (Zlen, ZG, ZR) of each ray path is recalculated based on the changed attenuation coefficient ZG, and the distribution rate based on the incident angle θR with respect to the recalculated attenuation rate (FIG. 4). ) Is set as an attenuation factor in each multiplier in the PAN control unit 62 and the matrix mixers 64 and 66.

  If only the direction of the sound receiving point 106 changes, the routine of FIG. 21 (c) is called. If the direction of the sound receiving point 106 is changed, the incident angle θR in each sound ray path is changed, so that the attenuation coefficient ZR based on this is also changed. Thereby, the attenuation rate (Zlen · ZG · ZR) of each sound ray path is recalculated based on the changed attenuation coefficient ZR. Furthermore, if the incident angle θR changes, the distribution rate (FIG. 4) also changes. Therefore, the newly calculated attenuation factor (Zlen, ZG, ZR) of each sound ray path and the newly calculated distribution are obtained. Based on the rate, the attenuation rate set for each multiplier in the PAN control unit 62 and the matrix mixers 64 and 66 is determined. However, in FIG. 21 (b) or (c), the length of each sound ray path itself is not changed, and therefore it is not necessary to recalculate the tap position of the delay unit 60.

Four. Modifications The present invention is not limited to the above-described embodiments, and various modifications can be made as follows, for example.
(1) In the above embodiment, various data processing is executed by a program operating on the personal computer 30 and the signal processing unit 10, but only this program is stored in a recording medium such as a CD-ROM or a flexible disk and distributed. Alternatively, it can be distributed through a transmission line.

(2) In the above embodiment, the tap position of the delay unit 60 and the attenuation rate of each multiplier in the PAN control unit 62 and the matrix mixers 64 and 66 are determined by the personal computer 30, and the actual signal processing is performed in the digital mixer 1. However, it goes without saying that the processing executed in the personal computer 30 may be executed by the CPU 18 in the digital mixer 1.

(3) In the above embodiment, the parameters obtained by the personal computer 30 (such as the tap position of the delay unit 60 and the attenuation rate of each multiplier in the PAN control unit 62 and the matrix mixers 64 and 66) are used as the signal processing unit 10. For example, the obtained parameters are stored in one of the tracks of the multitrack recorder 51, and the contents of the track are read out later to obtain the audio signals S_C, S_L, S_R, S_SR, S_SL. May be synthesized.

It is operation | movement explanatory drawing of the conventional audio editing system. It is operation | movement explanatory drawing which shows the principle of the audio editing system of one Example of this invention. It is a figure which shows an example of the directivity characteristic of the sounding point 104 and the sound receiving point. It is a distribution characteristic figure of an audio signal in one example. 6 is a diagram illustrating an example of a setting screen displayed on a display 34. FIG. It is a figure which shows the other example of a setting screen. It is a figure which shows the other example of a setting screen. It is a figure which shows the other example of a setting screen. It is a figure which shows the other example of a setting screen. It is a figure which shows the other example of a setting screen. It is a figure which shows the other example of a setting screen. It is a figure which shows the other example of a setting screen. It is a hardware block diagram of the audio editing system of one Example. 3 is a block diagram of an algorithm of processing executed by a signal processing unit 10. FIG. It is a flowchart of a mouse click routine. It is a flowchart of a zoom operation event routine. It is a flowchart of a ctrl key event routine. It is a flowchart of an alt key event routine. It is a flowchart of an element movement event routine. It is a flowchart of an automatic drive routine. It is a flowchart of various sound field calculation subroutines.

Explanation of symbols

  1: Digital mixer, 2: Switch group, 4: Electric fader group, 6: Rotary knob group, 8: Waveform I / O unit, 10: Signal processing unit, 12: Bus line, 14: Large display, 15: Input Device: 16: Control I / O unit, 18: CPU, 20: Flash memory, 22: RAM, 30: Personal computer, 32: Hard disk, 34: Display, 36: Input device, 38: Bus, 40: I / O interface 42: CPU, 44: ROM, 46: RAM, 50: amplifier, 51: multitrack recorder, 52: speaker system, 52C to 52SL: speaker, 54C to 54SL: distribution characteristics, 60: delay unit, 62: PAN control Part, 63, 65: adder group, 64, 66: matrix mixer, 68, 69: filter part, 70-1-k to 70-5-k: Calculator, 72-1-k to 72-5-k: adder, 74-1 to 74-5: multiplier, 102: acoustic space, 104: sounding point, 106: sound receiving point, 104b, 106b: directivity 110: sound ray path, 112-1: sound ray path, 114-1: sound ray path, 116-1, 118-1: mirror image, 202: zoom fader, 204: acoustic space contour line, 206: section 210: Sound generation point image, 210a: Sound reception point image, 212: Sound reception point image, 212a: Sound reception point direction image, 214: Speaker image, 220: Moving trajectory line, 240: Center point, 222, 224 226: Orbit point image, 232 to 246: linear auxiliary line, 252 to 266: circular auxiliary line.

Claims (8)

In order to simulate the acoustic characteristics of an acoustic space where elements including a sounding point that emits a sound and a sound receiving point that receives the sound emitted from the sounding point are arranged, the sound signal output from the sounding point is processed. A parameter generating device for generating a parameter for synthesizing a voice signal received at the sound receiving point,
An operating element including at least a sounding point image representing the sounding point and a sound receiving point image representing the sound receiving point, and a display means for displaying an acoustic space image representing the acoustic space on a display;
A selection means for selecting a plurality of operation elements among the operation elements as selection operation elements according to a user operation;
A movement mode limiting means for limiting the movement mode of each selection operation element so as to enable movement of each selection operation element only along a straight line connecting a predetermined base point on the display and each selection operation element ;
When a movement instruction for any one of the selection operation elements is received, the movement state for all of the selection operation elements is based on the content of the movement instruction and the limited movement mode, and is along each straight line. A moving state determination means for determining an expansion / contraction ratio of the distance between the base point and the selection operation element before and after each selection operation element moves ;
Auxiliary line display means for displaying a linear auxiliary line on the display along the straight line;
Display position changing means for changing the display position of the selection operation element on the display based on the determined movement state;
Acoustic space position changing means for resetting the position in the acoustic space based on the determined moving state;
Parameter generating apparatus characterized by having a parameter generating unit that generates the parameter based on the result of the changed in the acoustic space position changing means. In order to simulate the acoustic characteristics of an acoustic space where elements including a sounding point that emits a sound and a sound receiving point that receives the sound emitted from the sounding point are arranged, the sound signal output from the sounding point is processed. A parameter generating device for generating a parameter for synthesizing a voice signal received at the sound receiving point,
An operating element including at least a sounding point image representing the sounding point and a sound receiving point image representing the sound receiving point, and a display means for displaying an acoustic space image representing the acoustic space on a display;
A selection means for selecting a plurality of operation elements among the operation elements as selection operation elements according to a user operation;
Movement mode restriction that restricts the movement mode of each selection operation element so as to enable movement of each selection operation element only along a circle that passes through each selection operation element with a predetermined base point on the display as a center. Means,
When a movement instruction for any one of the selection operation elements is received, the movement state for all the selection operation elements is based on the content of the movement instruction and the limited movement mode, and each of the selection operation elements is along the circumference. Moving state determining means for determining a rotation angle at which each of the selection operation elements rotates,
An auxiliary line display means for displaying a circular auxiliary line on the display along the circumference;
Display position changing means for changing the display position of the selection operation element on the display based on the determined movement state;
Acoustic space position changing means for resetting the position of the element in the acoustic space based on the determined moving state;
Parameter generating means for generating the parameter based on the result changed by the position changing means in the acoustic space;
A parameter generation device characterized by comprising : In order to simulate the acoustic characteristics of an acoustic space where elements including a sounding point that emits a sound and a sound receiving point that receives the sound emitted from the sounding point are arranged, the sound signal output from the sounding point is processed. A parameter generating device for generating a parameter for synthesizing a voice signal received at the sound receiving point,
An operating element including at least a sounding point image representing the sounding point and a sound receiving point image representing the sound receiving point, and a display means for displaying an acoustic space image representing the acoustic space on a display;
A selection means for selecting a plurality of operation elements among the operation elements as selection operation elements according to a user operation;
Means for detecting that the first or second limiting operation has been performed;
When the first restriction operation is performed, the movement mode of each selection operation element is determined only along a straight line connecting a predetermined base point on the display and each selection operation element. When the second restriction operation is performed, the selection operation elements can be moved only along the circumference passing through the selection operation elements centered on the base point when the second restriction operation is performed. A movement mode limiting means for limiting the leveling,
When a movement instruction for any one of the selection operation elements is received, based on the content of the movement instruction and the restricted movement mode, the movement state for all the selection operation elements is the first restriction operation. Is determined, the stretch rate of the distance between the base point and each selection operation element before and after each selection operation element moves along each straight line is determined, while the second limiting operation is performed A movement state determination means for determining a rotation angle at which each of the selection operation elements rotates along each of the circumferences when performed;
When the first limiting operation is performed, a linear auxiliary line is displayed on the display along the straight line, whereas when the second limiting operation is performed, a circular shape is formed along the circumference. An auxiliary line display means for displaying an auxiliary line on the display;
Display position changing means for changing the display position of the selection operation element on the display based on the determined movement state;
Acoustic space position changing means for resetting the position of the element in the acoustic space based on the determined moving state;
And a parameter generation unit configured to generate the parameter based on a result of the change in the acoustic space position changing unit . Determination means for determining whether or not the sound receiving point image is included in the selection operation element;
First base point selection means for selecting a central point of the acoustic space image as the base point on the condition that the determination result in the determination means is positive;
The condition that the determination result is negative in the judgment means, any of claims 1 to 3, characterized in that it further comprises a second base point selecting means for selecting the sound receiving point image as the base point The parameter generation device according to claim 1 . The sound output from the sound generation point in order to simulate the acoustic characteristics of the acoustic space in which the computer includes the sound generation point that emits the sound and the sound receiving point that receives the sound generated from the sound generation point. A program for functioning as a parameter generating device for processing a signal and generating a parameter for synthesizing a voice signal received at the sound receiving point,
The computer,
An operating element including at least a sounding point image representing the sounding point and a sound receiving point image representing the sound receiving point, and a display means for displaying an acoustic space image representing the acoustic space on a display;
A selection means for selecting a plurality of operation elements among the operation elements as selection operation elements according to a user operation;
A movement mode limiting means for limiting the movement mode of each selection operation element so as to enable movement of each selection operation element only along a straight line connecting a predetermined base point on the display and each selection operation element;
When a movement instruction for any one of the selection operation elements is received, the movement state for all of the selection operation elements is based on the content of the movement instruction and the limited movement mode, and is along each straight line. A moving state determining means for determining an expansion / contraction ratio of the distance between the base point and each of the selection operation elements before and after each of the selection operation elements moves;
Auxiliary line display means for displaying a linear auxiliary line on the display along the straight line;
Display position changing means for changing the display position of the selection operation element on the display based on the determined movement state;
Acoustic space position changing means for resetting the position of the element in the acoustic space based on the determined moving state;
Parameter generating means for generating the parameter based on the result changed in the acoustic space position changing means;
Program to function as. The sound output from the sound generation point in order to simulate the acoustic characteristics of the acoustic space in which the computer includes the sound generation point that emits the sound and the sound receiving point that receives the sound generated from the sound generation point. A program for functioning as a parameter generating device for processing a signal and generating a parameter for synthesizing a voice signal received at the sound receiving point,
The computer,
An operating element including at least a sounding point image representing the sounding point and a sound receiving point image representing the sound receiving point, and a display means for displaying an acoustic space image representing the acoustic space on a display;
A selection means for selecting a plurality of operation elements among the operation elements as selection operation elements according to a user operation;
Movement mode restriction that restricts the movement mode of each selection operation element so as to enable movement of each selection operation element only along a circle that passes through each selection operation element with a predetermined base point on the display as a center. Means,
When a movement instruction for any one of the selection operation elements is received, the movement state for all the selection operation elements is based on the content of the movement instruction and the limited movement mode, and each of the selection operation elements is along the circumference. Moving state determining means for determining a rotation angle at which each of the selection operation elements rotates,
An auxiliary line display means for displaying a circular auxiliary line on the display along the circumference;
Display position changing means for changing the display position of the selection operation element on the display based on the determined movement state;
Acoustic space position changing means for resetting the position of the element in the acoustic space based on the determined moving state;
Parameter generating means for generating the parameter based on the result changed in the acoustic space position changing means;
Program to function as. The sound output from the sound generation point in order to simulate the acoustic characteristics of the acoustic space in which the computer includes the sound generation point that emits the sound and the sound receiving point that receives the sound generated from the sound generation point. A program for processing a signal to function as a parameter generation device for generating a parameter for synthesizing a voice signal received at the sound receiving point,
The computer,
An operating element including at least a sounding point image representing the sounding point and a sound receiving point image representing the sound receiving point, and a display means for displaying an acoustic space image representing the acoustic space on a display;
A selection means for selecting a plurality of operation elements among the operation elements as selection operation elements according to a user operation;
Means for detecting that the first or second limiting operation has been performed;
When the first restriction operation is performed, the movement mode of each selection operation element is determined only along a straight line connecting a predetermined base point on the display and each selection operation element. When the second restriction operation is performed, the selection operation elements can be moved only along the circumference passing through the selection operation elements centered on the base point when the second restriction operation is performed. A movement mode limiting means for limiting the leveling,
When a movement instruction for any one of the selection operation elements is received, based on the content of the movement instruction and the restricted movement mode, the movement state for all the selection operation elements is the first restriction operation. Is determined, the stretch rate of the distance between the base point and each selection operation element before and after each selection operation element moves along each straight line is determined, while the second limiting operation is performed A movement state determination means for determining a rotation angle at which each of the selection operation elements rotates along each of the circumferences when performed;
When the first limiting operation is performed, a linear auxiliary line is displayed on the display along the straight line, whereas when the second limiting operation is performed, a circular shape is formed along the circumference. An auxiliary line display means for displaying an auxiliary line on the display;
Display position changing means for changing the display position of the selection operation element on the display based on the determined movement state;
Acoustic space position changing means for resetting the position of the element in the acoustic space based on the determined moving state;
Parameter generating means for generating the parameter based on the result changed in the acoustic space position changing means;
Program to function as . The computer further
Determination means for determining whether or not the sound receiving point image is included in the selection operation element;
First base point selection means for selecting a central point of the acoustic space image as the base point on the condition that the determination result in the determination means is positive;
A second base point selection unit that selects the sound receiving point image as the base point on the condition that the determination result in the determination unit is negative;
A program according to any one of claims 5 to 7 for functioning as:

Images