JP2020031303A - Voice generating program and voice generating apparatus in virtual space - Google Patents

Abstract

To facilitate reflection of a developer's intention when generating voice in a virtual space.SOLUTION: A computer is configured to function as: sound source means for outputting voice data mapped with a sound source of a virtual space; voice processing means having a plurality of signal processing means capable of processing voice data and connecting the signal processing means solely or hierarchically to process voice data; and output destination determination means for determining an output destination on the basis of output destination determination information of determining the signal processing means which is an output destination of the sound source means from a positional relationship between the sound source and a virtual sound receiving point.SELECTED DRAWING: Figure 5

Description

  The present invention relates to a sound generation program and a sound generation device in a virtual space.

  Recent game programs provide users with rich virtual experiences by trying more accurate sound expression while using three-dimensional moving images (see, for example, Patent Document 1). In the example of Patent Literature 1, in order to perform more accurate acoustic expression, an acoustic signal is generated by arranging an object in a virtual three-dimensional space and performing an acoustic simulation.

JP 2000-267675 A

  However, in the method of generating an acoustic signal based on a simulation as in Patent Document 1, there is no room for reflecting a program developer's intention, for example, to emphasize, weaken, or eliminate some sound.

  Therefore, an object of the present invention is to make it possible to easily reflect the intention of a developer when generating sound in a virtual space.

  According to a first aspect of the present invention, a computer includes a sound source unit that outputs sound data corresponding to a sound source in a virtual space, and a plurality of signal processing units capable of processing sound data. Sound processing means for processing the sound data by connecting the sound data, and the output based on output destination determination information for determining signal processing means to be an output destination of the sound source means from a positional relationship between the sound source and a virtual sound receiving point. A sound generation program in a virtual space characterized by functioning as an output destination determining means for determining a destination.

  Further, in the first invention, the signal processing unit may include a sound image localization unit that performs sound image localization on the processed audio data.

  Further, in the above invention, the volume of the sound data output by the sound source means is set based on a parameter that determines a change in sound that reaches the sound receiving point from the sound source and reaches the sound receiving point linearly through the object between the two. The computer may function as first adjusting means for adjusting.

  Further, in the invention, the volume of the audio data output by the signal processing unit is adjusted based on a parameter that determines a change in sound that reaches the sound receiving point from the sound source by diffracting an object between the two. The computer may function as second adjusting means.

  Further, in the invention, an object indicating a wall having a door is arranged between the sound source and the sound receiving point, and from the sound source to the sound receiving point, passing through an opening of the door. The computer may function as third adjusting means for adjusting the volume of the audio data output by the signal processing means based on a parameter that determines a change in the sound that arrives.

  According to a second aspect of the present invention, there is provided a voice generating apparatus including: a storage unit that stores a voice generating program in the virtual space; and a control unit that executes the voice generating program.

  ADVANTAGE OF THE INVENTION According to this invention, when producing | generating audio | voice in a virtual space, the intention of a developer can be reflected easily.

FIG. 2 is a block diagram illustrating a configuration of the game device of the present embodiment. FIG. 3 is a block diagram illustrating a configuration example of a sound source unit. It is a block diagram which shows the structure of a bus typically. A part of a building object provided in the virtual space is represented in a plane. 5 is an example of a hierarchical structure of a bus for expressing a sound propagation path in the object of FIG. 4. It is a table used to determine the destination of audio data. FIG. 4 is a diagram illustrating a function of adjusting the volume and the like of a first adjusting unit. FIG. 9 is a diagram illustrating an adjustment function of a third adjustment unit such as a volume. It is a figure explaining the adjustment function, such as a sound volume of 4th adjustment means. It is an example of a characteristic curve for determining a volume value and a cutoff frequency. 7 is an example of a characteristic curve for determining a sound volume value and a cutoff frequency based on an angle formed between a sound source and an aperture and the like. It is another example of the hierarchical structure of a bus. 13 is an example of output destination determination information corresponding to the hierarchical structure of FIG.

[Embodiment]
Hereinafter, a speech generation program and a speech generation device according to an embodiment of the present invention will be described with reference to the drawings. The sound generation program in the virtual space according to the present invention is implemented as a game program. Further, the sound generation device is realized as a game device.

  The game program described in the present embodiment is executed on a game device such as a personal computer, a PlayStation (registered trademark), an XBox (registered trademark), and a PlayStation Vita (registered trademark).

  In a game according to this game program, a player character is activated in a three-dimensional virtual game space (hereinafter, referred to as a virtual space VS) in response to an operation of each user, or a group of players is formed to perform various actions. Or let them do it. More specifically, this game is a competitive action game in which a player character attacks and defeats an enemy character.

<Configuration of game device>
The game device 5 executes a predetermined game based on a user operation. FIG. 1 is a block diagram illustrating a configuration of the game device 5 of the present embodiment. The game device 5 has a display 61, a speaker 62, and a controller 63 externally connected or built in. In the game device 5, for example, the game proceeds based on the installed game program and game data. The game devices 5 can also perform data communication with each other using a communication network (not shown) or a short-range wireless communication device (not shown).

  The game device 5 includes a network interface 51, a graphic processing unit 52, an audio processing unit 53, an operation unit 54, a storage unit 55, and a control unit 56. The network interface 51, the graphic processing unit 52, the audio processing unit 53, the operation unit 54, and the storage unit 55 are electrically connected to a control unit 56 via a bus 59.

  The network interface 51 is communicably connected to the communication network in order to transmit and receive various data to and from the game device 5 and an external server device (not shown).

  The graphic processing unit 52 draws a game image including a player character and various objects related to the virtual space in a moving image format according to the game image information output from the control unit 56. The graphic processing unit 52 is connected to the display 61, and the game image drawn in the moving image format is displayed on the display 61 as a game screen.

  Under this game program, when constructing a game image, the graphic processing unit 52 sets a virtual camera (hereinafter, virtual camera VC) in a virtual space as a user's viewpoint. The graphic processing unit 52 configures a 3D (three-dimensional) video (moving image) and displays the video on the display 61 as if the virtual camera VC had taken a picture in a virtual space.

  The audio processing unit 53 reproduces and synthesizes digital game sound in accordance with an instruction from the control unit 56. The audio processing unit 53 is connected to the speaker 62, and the reproduced and synthesized game sound is output from the speaker 62 after being converted into an analog signal.

  The operation unit 54 is connected to the controller 63 and transmits and receives data related to operation input to and from the controller 63. For example, the user inputs an operation signal to the game device 5 by operating an operation element (not shown) such as a button provided on the controller 63.

  The storage unit 55 includes an HDD, a RAM, a ROM, and the like. The storage unit 55 can store a game program and game data. The storage unit 55 also stores other account information and the like received from the other game devices 5.

  The control unit 56 is configured by a microcomputer including a CPU and a semiconductor memory, and controls the operation of the game device 5 itself. For example, the control unit 56 operates the graphic processing unit 52 and the audio processing unit 53 by executing the game program.

  In addition, the control unit 56 and the audio processing unit 53 cooperate to perform an acoustic expression. Hereinafter, the functions of the control unit 56 and the audio processing unit 53 will be described in detail.

<Functional configuration of audio processing unit 53>
As described above, the audio processing unit 53 reproduces and synthesizes game sound. In this specification, the game sound is a sound that flows from the speaker 62 during the game, and includes, for example, BGM (Back Ground Music) and a sound effect that flows in response to a user operation. In addition, the sound of water drops falling from the ceiling in the puddles in the cave, the sound of the wind going from the entrance to the exit in the cave, the noise of crowds in the town (the voice of passers-by, the sound of cars passing by, etc.), forests and grasslands Environmental sounds such as the sound of a blowing wind are also examples of game sounds.

  Further, in this game program, an object (hereinafter, referred to as a sound source object) that is handled as a sound source (that is, a virtual sound source) exists in the virtual space VS. Examples of the sound source object include a player character, an enemy character (such as a monster) appearing in a game, a character appearing as a friend of the player character, an item (eg, a weapon) possessed by the player character, and a virtual space VS. Examples include machines and equipment.

  The audio processing unit 53 includes so-called middleware that has a function of reproducing and synthesizing game sound. By executing the middleware, the audio processing unit 53 functions as a sound source unit 531 and a signal processing unit 532 (hereinafter, also referred to as a bus).

  The sound source 531 is a function realized by middleware, and outputs sound data corresponding to the sound source object. In the middleware of the audio processing unit 53, a plurality of sound source units 531 can be provided corresponding to the sound source objects. FIG. 2 is a block diagram showing a configuration example of the sound source 531. The sound source 531 includes a first effector 531a, a volume controller 531b, and a second effector 531c.

  The first effector 531a can perform, for example, a process of adding a reverberation (Reverb) effect, a filter process (for example, a process using a low-pass filter), or the like, to the input audio data. Further, the sound volume adjustment section 531b adjusts the sound volume.

  The second effector 531c can perform filter processing (here, processing using a low-pass filter) and volume adjustment on the input audio data. The control section 56 controls the volume value and the cutoff frequency of the low-pass filter in the second effector 531c.

  The sound source 531 is provided with a plurality of output systems. The sound source 531 can output audio data to a plurality of buses using these output systems. In these output systems, it is possible to individually adjust the volume (hereinafter referred to as “send volume” for convenience of description).

  The signal processing unit 532 (bus) is a function realized by middleware and adds processing to audio data. At the time of the processing, the signal processing means 532 also performs sound image localization as necessary. Therefore, a position in the virtual space VS may be associated with the signal processing unit 532. Hereinafter, associating the position in the virtual space VS with the signal processing unit 532 may be expressed as "the signal processing unit 532 (bus) has a position".

  In the middleware of the audio processing unit 53, a plurality of signal processing units 532 can be provided. In the audio processing unit 53, the signal processing means 532 can be used alone, or by connecting the signal processing means 532 hierarchically, the signal processed by any one of the signal processing means 532 can be processed by another signal processing means. The means 532 can also receive and further process the signal. In this game program, the connection between the signal processing means 532 is determined by the structure of the object in the virtual space.

  The audio data generated by each signal processing unit 532 is finally sent to a signal processing system called a master bus (hereinafter, referred to as a master bus MB). The master bus MB performs synthesis and volume adjustment of the sent audio data.

  Then, the audio processing unit 53 converts the signal processed by the master bus MB into an analog signal and outputs the analog signal to the speaker 62. Thereby, the game sound is output (reproduced) from the speaker 62.

  FIG. 3 is a block diagram schematically illustrating a configuration of the signal processing unit 532. Each of the signal processing units 532 has the same configuration. Each signal processing unit 532 includes a first sound image localization unit 532a, a bus effector 532b, a bass volume adjustment unit 532c, a propagation effector 532d, and a second sound image localization unit 532e as modules for processing audio data.

  The first sound image localization means 532a performs sound image localization of the input audio data. Specifically, when the input audio data is a monaural signal, the first sound image localization unit 532a determines the output destination channel and outputs the channel to the next bus effector 532b as the audio data of the channel. If the sound data is not a monaural signal, the first sound image localization means 532a outputs the sound data to the next bus effector 532b as it is.

  The bus effector 532b performs a process such as a process of adding a reverberation (Reverb) effect to the given audio data, and a process of filtering (here, a process using a low-pass filter). The bus volume adjusting unit 532c adjusts the volume of the output of the bus effector 532b.

  When the signal processing unit 532 (bus) has a position, the propagation effector 532d processes audio data whose volume has been adjusted by the bus volume adjusting unit 532c. In this example, the processing performed by the propagation effector 532d is volume adjustment and processing using a low-pass filter. The volume value and the cutoff frequency of the low-pass filter in the propagation effector 532d are controlled by the control unit 56.

  The second sound image localization unit 532e performs sound image localization on the audio data output by the propagation effector 532d. Here, when the signal processing means 532 does not have a position, the output of the propagation effector 532d is output as it is. If the signal processing unit 532 has a position, the sound signal is once down-mixed to monaural, and then the sound image is localized according to the position of the signal processing unit 532.

  At the time of the sound image localization, the audio processing unit 53 defines a virtual sound receiving point (hereinafter, referred to as a virtual microphone L) in the virtual space VS, and collects the sound emitted from the sound source object as if the virtual microphone L. The sound is output to the speaker 62 in an acoustic expression as if it had sounded. That is, the virtual microphone L is a virtual listener, and is a reference point for sound image localization in the middleware of the audio processing unit 53.

  In the present embodiment, the virtual microphone L is set at the same position as the virtual camera VC. Since the user plays the game as if he were at the position of the virtual camera VC, a sound with a sense of reality is reproduced for the user. Note that the position of the virtual camera VC is set near the player character. Therefore, the position of the player character and the position of the virtual microphone L may be considered to be substantially the same.

  In this game program, the bus is allocated in accordance with the propagation path of the audio data in the virtual space VS in order for the audio processing unit 53 to perform an acoustic expression as if the sound was collected by the virtual microphone L. This distribution is determined according to the configuration of the virtual space VS (the structure and arrangement of the objects). Hereinafter, this distribution will be described using a specific example.

-Example of bus distribution-
In this game program, the distribution of buses is set for each area (for example, a building) where sound expression is desired. FIG. 4 is a plan view showing a part of a building object provided in the virtual space.

  This building has three rooms (regions) R0, R1, and R2, as shown in FIG. There is a door D01 between the room R0 and the room R1. Similarly, there is a door D12 between the room R1 and the room R2. These doors D01 and D12 are both open. When these doors D01 and D12 are open, it can be seen that an opening is formed in the wall.

  A player character stands in the room R0 (not shown). A virtual microphone L (sound receiving point) is set near the position where the player character stands. In the room R0, there is also a sound source object S0 that is a virtual sound source. Here, the sound source object S0 is an enemy character (for example, a monster).

  A sound such as a roar is emitted from the sound source object S0 toward the player character (virtual microphone L). Similarly, the sound source object S1 exists in the room R1, and the sound source object S2 exists in the room R2. Hereinafter, the sound source corresponding to the sound source object S0 is referred to as a sound source S0 (the same applies to other sound source objects hereinafter).

  For example, in order to express a sound transmitted from the sound source S0 to the virtual microphone L, a bus may be assigned to the room R0. When a sound source also exists in another room, a bus may be arranged in each room where the sound source exists.

FIG. 4 shows the positions of buses (referred to as buses S _{R0 — 0} and S _{R1 — 0} ) arranged in the rooms R1 and R2, respectively. That is, those buses have a location. In this example, the buses S _{R0 — 0} and S _{R1 — 0} are arranged near the doors in order to express the sound leaking from the openings of the doors D01 and D12. If these buses S _{R0 — 0} and S _{R1 — 0} are _assigned as sound sources of the sound leaking from the opening, the sound image of the sound leaking from the opening can be localized at the position of the opening. In FIG. 4, solid lines and broken lines indicate the propagation paths of sound from each bus.

In the example of FIG. 4, the sound from the sound source S2 reaches the room R0 through the rooms R2 and R1. That is, the propagation path of the sound from the sound source S2 extends over a plurality of regions. In order to express that the sound propagation path passes through a plurality of regions, the bass may have a hierarchical structure. FIG. 5 illustrates a hierarchical structure of a bus for expressing a sound propagation path in the object (building) in FIG. In this example, a bus for the room R0, a bus for the room R1 (bus S _{R0_0} ), and a bus for the room R2 (bus S _{R1_0} ) are connected in series in this order upstream of the master bus MB.

  Note that S0 to S2 in FIG. 5 are audio data corresponding to the sound sources S0, S1, and S2. In FIG. 5, a solid line extending from each audio data to the bus indicates an output destination of the audio data. This output destination is dynamically determined as appropriate according to the positional relationship between the sound source object and the virtual microphone L. The control unit 56 determines the output destination.

<Functional configuration of control unit>
The control unit 56 functions as the output destination determining unit 565, the first adjusting unit 561, the second adjusting unit 562, the third adjusting unit 563, and the fourth adjusting unit 564 by executing the game program.

  The output destination determining unit 565 determines to which of the hierarchically structured buses (signal processing unit 532) the audio data is to be sent. In this example, the output destination determining unit 565 uses data corresponding to the table in FIG. 6 to determine the output destination of the audio data. The table in FIG. 6 indicates the output destination of the audio data for a set of information on the sound source (for example, the room where the sound source is located) and the position of the virtual microphone L (the sound receiving point) (the room where the sound receiving point is located). This is a part of a correspondence table (hereinafter, referred to as output destination determination information).

During execution of the game program, the output destination determining means 565 uses the table to sequentially determine the output destination of the audio data according to the movement of the sound source and the sound receiving point. For example, when the virtual microphone L (sound receiving point) is in the room R0, the output destination determining unit 565 determines to transmit the audio data of the sound source S0 in the room R0 to the bus for the room R0 (see FIG. 5). Similarly, the output destination determining unit 565 determines to transmit the audio data of the sound source S1 in the room R1 to the bus for the room R1 (that is, the bus S _{R0 — 0} ).

  The first adjusting unit 561 linearly transmits an object (for example, a wall) between the sound source and the virtual microphone L and linearly reaches the virtual microphone L from the sound source (hereinafter, referred to as a direct sound). ) And adjust the frequency spectrum. At that time, the first adjusting unit 561 controls the second effector 531c of the sound source unit 531.

  More specifically, the first adjusting unit 561 calculates a new volume value and a cutoff frequency of the low-pass filter from the parameter rf (where 0 ≦ rf ≦ 1) calculated from the following equation (1), and calculates the magnitude of rf Adjust the volume and frequency spectrum according to.

  In Expression (1), dr is the propagation path length of the direct sound, and is the linear distance between the sound source S and the virtual microphone L. FIG. 7 shows a direct sound propagation path by a solid line. As shown by a broken line in FIG. 7, sounds reaching the virtual microphone L from the sound source S1 include sounds reaching the virtual microphone L while diffracting an object (such as a wall) between the sound source S1 and the virtual microphone L. (Hereinafter referred to as diffraction sound).

D _f0 in FIG. 7 is a propagation path length of the diffracted sound in the room R1, d _f1 is a propagation path length of the diffracted sound of diffracted sound in the room R0. Therefore, Shigumadf on the right-hand side of Equation (1) is the total propagation path length of the diffracted sound _{(Σdf = d f0 + d f1} ), molecules of the second term of the right side in Equation (1) is of the direct sound and diffracted sound Path difference.

  Tf in Expression (1) is a threshold value that can be set by a developer (hereinafter, referred to as a sound designer) responsible for sound expression when developing a game program. By setting the threshold value Tf as appropriate by the sound designer, it is possible to adjust how the direct sound is heard. For example, the volume of the direct sound increases as the threshold value Tf increases.

  When rf is obtained from Expression (1), the volume value and the cutoff frequency are adjusted by the first adjusting unit 561. In the example of FIG. 7, the first adjusting unit 561 adjusts the volume value and the cutoff frequency of the second effector 531c of the sound source 531 corresponding to the sound source S in the room R1. That is, the parameter rf is a parameter that determines a change in sound that reaches the sound receiving point from the sound source and reaches the sound receiving point linearly through the object between them.

  At this time, the sound volume is controlled to be larger as rf is larger, and the cutoff frequency is adjusted to be higher. For example, when the virtual microphone L is near the door D01, there is almost no path difference, so that rf is almost 1. Therefore, the volume value of the second effector 531c (the volume value of the direct sound) is adjusted to the highest level that can be set. Further, the low-pass filter of the second effector 531c is invalidated.

  Further, as the virtual microphone L moves deeper into the room R0 (upward in FIG. 7), the path difference gradually increases, and rf gradually decreases. When the path difference exceeds the threshold value Tf, rf becomes zero, and the volume value of the second effector 531c is adjusted to the lowest level that can be set. Further, the cut-off frequency of the low-pass filter of the second effector is set to a settable minimum value. As a result of such control of the volume value and the like, the direct sound is expressed as completely shielded.

The second adjusting unit 562 adjusts the volume (attenuation) of the diffracted sound. Specifically, the second adjusting unit 562 adjusts the volume of the audio data in the process of being sent from the sound source unit 531 to the signal processing unit 532. More specifically, the second adjustment unit 562 adjusts the volume of the diffracted sound by adjusting the send volume in the process of sending the audio data to the bus (the bus S _{R0 — 0 in} FIG. 7) provided in the opening. .

  At this time, the second adjusting unit 562 obtains a new volume value for the send volume adjustment using the parameter r0 (where 0 ≦ r0 ≦ 1) calculated from the following equation (2). That is, the parameter r0 is a parameter that determines the change in the diffracted sound that reaches the sound receiving point from the sound source by diffracting the object between them.

  Rf in equation (2) is calculated by equation (1). As can be seen from equation (2), r0 decreases as rf increases and increases as rf decreases. That is, by setting Tf by the sound designer, the volume balance between the direct sound and the diffracted sound can be adjusted.

Here, when the audio data is sent to a bus having a position such as the bus S _{R0_0} for R1, the second effector 531c of the sound source 531 is disabled. This is because the sound arriving at the opening (the opening of the door D01) from the sound source S1 does not pass through the wall, and it is not necessary to adjust the frequency spectrum and the like.

  The third adjustment unit 563 adjusts the volume and frequency spectrum in consideration of the influence of the door on the sound when the sound is diffracted through the opening of the door and transmitted to another space (for example, another room). FIG. 8 is a diagram for explaining the adjusting function of the third adjusting unit 563. In the present embodiment, the influence of the door on the sound is expressed by adjusting the volume and frequency spectrum of the direct sound transmitted to the virtual microphone L through the door and the diffracted sound transmitted to the virtual microphone L by diffracting the door. I do.

  First, the direct sound transmitted through the door can be considered in the same manner as the transmission through the wall. That is, for the direct sound transmitted through the door, the volume and the like may be adjusted using the above-described equation (1). Here, the sound volume value and the cut-off frequency are determined so as to pass through the vicinity of the hinge (S ') of the door.

  When the parameter rf is determined from Expression (1), the third adjusting unit 563 generates a sound from the sound source S to the opening of the door (referred to as S ′) ′. Are instructed to the second effector 531c included in the parameter value using the parameter rf.

  On the other hand, with respect to the diffracted sound diffracting the door, the attenuation amount and the like may be determined on the assumption that the sound goes around from the end (S ″) of the door. More specifically, the third adjusting unit 563 obtains a new volume value and a new cutoff frequency from the parameter rd (where 0 ≦ rd ≦ 1) calculated from the following equation (3). The parameter rd is a parameter that determines a change in sound that reaches the sound receiving point from the sound source through the opening of the door.

  This equation (3) indicates that the larger the door opening (φd), the higher the volume and the higher the cutoff frequency. Td in Expression (3) is a threshold that can be set by the sound designer. By appropriately setting the threshold value Td by the sound designer, the degree of influence of the door on the sound can be adjusted. For example, when φd exceeds the threshold value Td, the volume value and the cutoff frequency are set assuming that the door is fully opened.

  When the volume value and the cutoff frequency are determined for the generation of the diffracted sound, the third adjusting unit 563 generates the sound from the opening S ′ to the virtual microphone L by using the propagation effector of the bus corresponding to the room R1. For 532d, a volume value and a cutoff frequency are instructed using the parameter rd.

The fourth adjustment unit 564 adjusts the volume and frequency spectrum of the audio data according to the distance between the sound source and the virtual microphone L and the direction of the path connecting the two. FIG. 9 is a diagram illustrating the adjustment function of the fourth adjustment unit 564. The fourth adjusting unit 564 sets the shortest path (path length = d _sd + d _dl ) from the sound source S to the virtual microphone L through the opening of the door as a sound propagation path, and the attenuation and frequency spectrum change in this propagation path. Is added to the audio data.

  Specifically, the fourth adjusting unit 564 sends a sound volume value to the second effector 531c of the sound source unit 531 corresponding to the sound source S in order to represent the sound from the sound source S to the door opening S ′. And the cutoff frequency of the low-pass filter. Further, in expressing the sound from the opening S ′ to the virtual microphone L, the fourth adjusting unit 564 sets the volume value and the cutoff frequency of the low-pass filter to the propagation effector 532d of the bus corresponding to the room R1. To instruct.

  The fourth adjusting means 564 uses a characteristic curve shown in FIG. 10 at the time of control. In FIG. 10, the horizontal axis indicates the path length, and the vertical axis indicates the attenuation of the sound volume value on the left side, and the cutoff frequency of the low-pass filter on the right side. In FIG. 10, the solid line corresponds to the scale on the left (amount of attenuation), and the broken line corresponds to the scale on the right (cutoff frequency).

The fourth adjusting unit 564 also uses the characteristic curve shown in FIG. 11 for control. The characteristic curve in FIG. 11 indicates that the angle (φs) between the line connecting the sound source S and the opening (opening S ′) forms a wall, and the line connecting the virtual microphone L and the opening (opening S ′) forms the wall. This adjusts the degree of influence of the angle (φ _L ) between the line and the line on sound attenuation and frequency spectrum change.

11, the horizontal axis represents the angle (φs, φ _L), the vertical axis represents the attenuation of the left volume value, a cut-off frequency of the right low-pass filter. Also in FIG. 11, the solid line corresponds to the left scale (attenuation amount), and the broken line corresponds to the right scale (cutoff frequency). In this game program, any of the characteristic curves shown in FIGS. 10 and 11 can be freely set by the sound designer. That is, the item can be designed by the sound designer.

Then, the fourth adjusting unit 564 obtains a volume value and a cutoff frequency in the propagation path from the sound source S to the opening S ′ using the angle (φs) and the characteristic curve of FIG. 11, and obtains the angle (φ _L ) Using the characteristic curve of FIG. 11, the volume value and the cutoff frequency in the propagation path from the opening S ′ to the virtual microphone L are obtained.

  In summary, the present invention provides a computer (game device 5) having a plurality of sound source means for outputting sound data corresponding to a sound source in a virtual space, and a plurality of signal processing means capable of processing sound data. Audio processing means for processing the audio data by connecting processing means alone or hierarchically, and an output destination for determining a signal processing means to be an output destination of the sound source means from a positional relationship between the sound source and a virtual sound receiving point A sound generation program in a virtual space, which functions as an output destination determining unit that determines the output destination based on determination information.

<Effect of this embodiment>
As described above, in the present embodiment, the buses are hierarchically connected according to the structure of the object (such as a building) in the virtual space, and the sound designer uses the output destination determination information to output the audio data ( Bus) can be set freely. In addition, the sound designer can adjust the balance between the direct sound and the diffracted sound and adjust the degree of influence of the door opening, material, and the like on the sound propagation by adjusting the threshold Tf and the threshold Td. Further, the attenuation according to the distance and direction between the sound source and the sound receiving point can be controlled.

  That is, according to the present embodiment, the intention of the developer can be easily reflected when generating the sound in the virtual space.

[Modification of Embodiment]
The output destination determination information described in the above embodiment is an example, and the content of the output destination determination information can be appropriately set by a sound designer. For example, it is assumed that the sound designer considers that the sound of the sound source S2 in the room R2 shown in FIG. 4 does not require a very detailed expression.

  In that case, it is conceivable to configure a hierarchical structure of the bus as shown in FIG. In this example, a bus corresponding to the room R2 is not provided. The audio data of the sound source S2 in the room R2 is input to the bus for the room R1.

  FIG. 13 illustrates output destination determination information corresponding to the hierarchical structure in FIG. This output destination determination information is provided with a volume column, and the volume of the sound source S2 is reduced. This is because, if the sound of the sound source S2 in the room R2 is input to the bus for the room R1 at the same volume, the user hears the sound of the sound source S2 as a sound larger than expected and is unnatural.

[Other Embodiments]
Note that the first adjustment unit 561 and the third adjustment unit 563 may be configured to attenuate the audio data according to the material of the wall or the door. For example, when a material (for example, wood, glass, or iron) is set for a wall or a door, this can be realized by making it possible to search a table for a volume amount and a cutoff frequency corresponding to the material. . This table is an item that can be arbitrarily set by the sound designer. That is, the sound change according to the material of the wall or the door is also an item that the sound designer can design.

  Also, the configurations of the second effector 531c and the propagation effector 532d are examples, and it is possible to implement still another effect function or omit some of the functions.

  Further, the application of the processing of the third adjusting unit 563 is not limited to the door portion. For example, when the object has a “window”, the present invention can be applied to the window. In short, the process in the third adjusting unit 563 is a process applicable to a place where the opening degree of the opening changes.

  A low-pass filter may be applied to the audio data sent from the sound source 531 to the signal processing unit 532 together with the send volume.

  Also, the function sharing between the audio processing unit 53 and the control unit 56 is an example. What was executed by the middleware of the audio processing unit 53 may be executed by the control unit 56, or vice versa.

  Further, the game program may be implemented as a game program for a so-called online game. When the game program is for an online game, the processing performed by the audio processing unit 53 and the control unit 56 may be performed on the server side instead of the audio processing unit 53 and the control unit 56, or the server side and the client (game device 5) side May be shared.

  Even when these other embodiments are adopted, the operation and effect of the present invention are exhibited. Further, the present embodiment, other embodiments, and other embodiments can be appropriately combined with each other.

  Further, the present invention can be used in fields other than games. For example, the present invention can be applied to a program for simulating a virtual space or used for creating sound effects of a movie.

5 Game device (voice generation device)
53 audio processing unit (audio processing means)
55 storage unit 56 control unit 531 sound source means 532 bus (signal processing means)
532e Second sound image localization means (sound image localization means)
561 first adjusting means 562 second adjusting means 563 third adjusting means 565 output destination determining means

Claims (6)

Computer
Sound source means for outputting audio data corresponding to a sound source in a virtual space;
Voice processing means for processing the voice data by connecting a plurality of signal processing means capable of processing voice data and connecting the signal processing means alone or hierarchically;
An output destination determining unit that determines the output destination based on output destination determination information that determines a signal processing unit that is an output destination of the sound source unit from a positional relationship between the sound source and a virtual sound receiving point,
A sound generation program in a virtual space characterized by functioning as a function. In claim 1,
A sound generation program in a virtual space, wherein the signal processing means includes a sound image localization means for performing sound image localization on processed sound data. In claim 1 or claim 2,
First adjusting means for adjusting the volume of audio data output by the sound source means based on a parameter that determines a change in sound that reaches the sound receiving point from the sound source and reaches the sound receiving point linearly through the object between them; A sound generation program in a virtual space, which causes the computer to function as a computer. In any one of claims 1 to 3,
The second adjusting means for adjusting the volume of audio data output by the signal processing means based on a parameter for determining a change in sound reaching the sound receiving point from the sound source by diffracting an object between the two. A sound generation program in a virtual space, which causes a computer to function. In any one of claims 1 to 4,
An object indicating a wall having a door is arranged between the sound source and the sound receiving point,
A third adjusting unit that adjusts a volume of audio data output by the signal processing unit based on a parameter that determines a change in sound reaching the sound receiving point from the sound source through the opening of the door. A sound generation program in a virtual space, characterized by causing a computer to function. A storage unit storing a sound generation program in the virtual space according to any one of claims 1 to 5,
A control unit that executes the voice generation program;
A speech generation device comprising:

Images