JP7348505B2 - Audio playback program and audio playback device - Google Patents

Description

The present invention relates to an audio playback program and an audio playback device.

Some game programs generate sound effects (for example, contact sounds) when a character in a virtual space comes into contact with an object such as grass or a tree (see, for example, Patent Document 1). In the example of Patent Document 1, one object is specified as a target object according to the distance between a character and a plurality of objects. In the example of Patent Document 1, a predetermined reaction (such as generation of a contact sound) is performed on the assumption that the target object and the character have come into contact.

Japanese Patent Application Publication No. 2018-201786

In the example of the above-mentioned patent document, the presence or absence of pronunciation is controlled based on the distance. Although this control provides the user with a sense of realism, there is a need to further improve the sense of realism.

SUMMARY OF THE INVENTION Therefore, an object of the present invention is to enable an audio reproduction program and an audio reproduction device to reproduce audio with a more realistic feeling.

A first invention includes a computer that generates a reproduction means for reproducing sound as a sound in a virtual space by adding a predetermined sound effect, and a first parameter for controlling the sound effect applied by the reproduction means. The virtual space is divided into a plurality of areas, and each area has a second parameter including at least one of temperature, humidity, and weather set for the area. A virtual sound source that emits the sound is arranged in the virtual space, and the playback control means controls the playback control means based on the second parameter that is associated with the area in which the sound source exists. This is an audio playback program characterized by generating one parameter.

In the first invention, the first parameter may be a parameter that determines at least one of a volume and a reverberation characteristic.

In the invention, the reproduction control means determines a distance between a virtual sound receiving point where the sound is heard and the sound source, and uses the second parameter to increase or decrease the value of the determined distance. The correction may be performed, and the reproduction control means may generate the first parameter based on the corrected distance.

In the invention, a virtual time may be set in the virtual space, and the reproduction control means may correct the second parameter according to the time.

In the invention, a static object whose position is fixed is placed in the virtual space, and the playback control means is configured to control the connection between a virtual sound receiving point where the sound is heard and the static object. The second parameter may be corrected depending on the distance.

In the invention, a dynamic object whose position changes is arranged in the virtual space, and the playback control means may correct the second parameter according to the movement of the dynamic object. .

A second aspect of the invention is an audio playback device comprising: a storage unit that stores any of the audio playback programs described above; and a control unit that executes the audio playback program.

According to the present invention, it is possible to reproduce audio with a more realistic feeling.

FIG. 1 is a block diagram showing the configuration of a game device according to the present embodiment. A distance-volume characteristic curve is illustrated. A graph shows an example of a function representing the rate of temperature change over a day.

[Embodiment]
DESCRIPTION OF THE PREFERRED EMBODIMENTS An audio playback program and an audio playback device according to embodiments of the present invention will be described below with reference to the drawings. The audio playback program of the present invention is implemented as a game program. The audio playback device is realized as a game device.

The game program described in this embodiment is executed on a game device such as a personal computer, PlayStation (registered trademark), XBox (registered trademark), or PlayStation Vita (registered trademark).

In a game based on this game program, the player characters can be operated in a three-dimensional virtual game space (hereinafter simply referred to as virtual space) in response to user operations, and the player characters can form groups and perform various actions. Let me do it.

In the virtual space, there are objects that can independently execute actions (hereinafter referred to as dynamic objects). A dynamic object operates, for example, by AI (Artificial Intelligence) or performs a predetermined routine operation. Examples of dynamic objects in this game include monsters that fight against the player character.

In the virtual space, there are also objects whose positions are fixed (hereinafter referred to as static objects). Examples of static objects include bonfires and torches.

<Configuration of game device>
The game device 5 executes a predetermined game based on a user's operation. FIG. 1 is a block diagram showing the configuration of a game device 5 of this embodiment. A display 61, a speaker 62, and a controller 63 are externally connected or built into the game device 5. In the game device 5, the game progresses based on the installed game program and game data, for example. Note that the game devices 5 can also perform data communication with each other using a communication network (not shown) or a short-range wireless communication device (not shown).

The game device 5 includes a network interface 51, a graphic processing section 52, an audio processing section 53, an operation section 54, a storage section 55, and a control section 56. The network interface 51, the graphic processing section 52, the audio processing section 53, the operation section 54, and the storage section 55 are electrically connected to the control section 56 via a bus 59.

The network interface 51 is communicably connected to the communication network in order to transmit and receive various data with, for example, the game device 5 and an external server device (not shown).

The graphic processing unit 52 draws a game image including a player character and various objects related to the game space in a moving image format according to the game image information output from the control unit 56. The graphic processing unit 52 is connected to a display 61, and a game image drawn in a moving image format is displayed on the display 61 as a game screen.

The audio processing unit 53 reproduces and synthesizes digital game audio according to instructions from the control unit 56. The audio processing unit 53 is connected to a speaker 62, and the reproduced and synthesized game sound is output from the speaker 62.

The operation unit 54 is connected to the controller 63 and transmits and receives data related to operation inputs to and from the controller 63. For example, the user inputs an operation signal to the game device 5 by operating an operator (not shown) such as a button provided on the controller 63.

The storage unit 55 is composed of an HDD, RAM, ROM, and the like. The storage unit 55 can store game programs and game data. The storage unit 55 also stores other account information received from other game devices 5.

The control unit 56 is composed of a microcomputer including a CPU and a semiconductor memory, and controls the operation of the game device 5. For example, the control unit 56 operates the graphic processing unit 52, the audio processing unit 53, etc. by executing the game program.

<Functional configuration of audio processing unit>
The audio processing unit 53 reproduces game audio (hereinafter sometimes simply referred to as audio). The audio processing unit 53 performs sound image localization during audio reproduction. In order to perform sound image localization, the audio processing unit 53 sets a virtual sound receiving point (hereinafter referred to as virtual microphone L) where audio is heard in the virtual space. In this example, the virtual microphone L is set near the player character. The virtual microphone L moves as the player character moves.

In this game, an acoustic presentation is performed so that the sound appears to be emitted from a sound source (virtual sound source) existing in a virtual space. The audio processing unit 53 outputs the sound emitted from a virtual sound source (such as an object) to the speaker 62 in an acoustic representation as if the sound was collected by the virtual microphone L. That is, the virtual microphone L is a virtual listener and is a reference point for sound image localization by the audio processing unit 53.

The audio processing unit 53 executes so-called middleware that controls audio playback and synthesis functions. The audio processing unit 53 functions as a playback unit 531 by executing middleware. The reproduction means 531 has a function of reproducing audio as sound in a virtual space.

In this game, sounds such as music (BGM), sound effects, and environmental sounds suitable for each scene are output according to the actions of each character and the position of each character in the virtual space. Digital data such as sound effects and environmental sounds are stored in the storage unit 55 as game data.

For example, the reproduction means 531 reproduces a contact sound when it can be considered that the player character has contacted some object (for example, grass in a grassy area). Specifically, when the distance between the player character and the object closest to the player character is less than or equal to a predetermined threshold, the reproduction means 531 assumes that the two have come into contact and reproduces a sound effect such as a contact sound.

The reproduction means 531 applies sound effects such as volume adjustment and reverb (addition of reverberant sound) to the audio according to the positional relationship between the virtual sound receiving point (virtual microphone L) and the virtual sound source (dynamic object, etc.). It is attached. The reproduction means 531 determines what kind of sound effect is to be applied according to a first parameter (described later) given from a reproduction control means 561 (described later).

<Functional configuration of control unit>
The control unit 56 functions as a playback control means 561 by executing the game program. The reproduction control means 561 generates a parameter (hereinafter referred to as a first parameter) for determining the sound effect added by the reproduction means 531. The first parameter includes information for determining at least one of the volume and the reverberation characteristics.

The reproduction control means 561 grasps the situation in the virtual space and reflects the situation in the generation of the first parameter. In explaining the first parameter generation procedure, the configuration of the virtual space of this game program will be explained in detail.

The virtual space is divided into multiple stages. The stages are set with geographical features such as forests, wastelands, and plateaus. Each stage is divided into multiple areas. Each area has characteristics such as a battle area and a campsite.

For example, the battle area is an area where a battle between the player character and another character takes place. The campsite is an area where the player character and the like recover their physical strength and replenish their energy. Each area has dynamic objects and static objects.

Virtual space incorporates the concept of time (time). In virtual space, the situation changes, such as changing from day to night. Temperature, humidity, and weather are set for each area of the virtual space. In some areas, at least one of temperature, humidity, and weather changes over time.

A mesh is arranged in the virtual space to define a surface on which an object such as a player character can move. This mesh is not displayed on the display 61. Mesh is also used for route searching to determine the route for non-player characters (objects that can independently execute actions). Predetermined information is associated with the nodes (hereinafter referred to as feature points) that make up the mesh. The feature points are also not displayed on the display 61.

The information associated with each feature point is hereinafter referred to as feature point information. The feature point information includes coordinate values of the feature point and information specifying the area to which the feature point belongs. The feature point information is also used to determine contact between the player character and an object closest to the player character (see the <Functional Configuration of Audio Processing Unit> section).

The feature point information includes a second parameter. The second parameter includes information on temperature (temperature information Ta), information on humidity (humidity Ha), and information on weather, which are set in the area to which the feature point belongs. The temperature information Ta includes information on the daytime temperature (maximum temperature) and information on the nighttime temperature (minimum temperature).

In this game program, all feature points within the same area have the same value of temperature information Ta. Similarly, all feature points within the same area have the same humidity Ha value.

The reproduction control means 561 generates the first parameter based on the second parameter. Specifically, the reproduction control means 561 performs the following processing.

(1) The playback control means 561 specifies the area where the player character exists. Specifically, the playback control means 561 identifies the area by searching for the feature point closest to the player character (hereinafter referred to as the nearest neighbor point). The reproduction control means 561 reads the feature point information of any feature point (for example, the nearest point) within the specified area and obtains the second parameter.

(2) The reproduction control means 561 determines the sound velocity Vt (unit: m/s) based on the temperature information Ta and the humidity Ha obtained from the second parameter. The reproduction control means 561 uses the following equation (1) to calculate the sound velocity Vt.

Vt=331.5+0.6t+0.15h...Formula (1)
t in equation (1) is the temperature (hereinafter referred to as corrected temperature Tc) determined based on the temperature information Ta. h is a value obtained by correcting the humidity Ha (hereinafter referred to as corrected humidity Hc). How to obtain the corrected temperature Tc and the corrected humidity Hc will be described later. The sound velocity Vt can be used to determine the time for the sound from the sound source to reach the virtual microphone L, the frequency characteristics of the sound, and the like.

(3) The reproduction control means 561 calculates a value that corrects the distance between the virtual microphone L and the virtual sound source (hereinafter referred to as correction distance Dc). The reproduction control means 561 uses the following equation (2) to calculate the correction distance Dc.

Corrected distance Dc=D-(reference temperature-corrected temperature Tc)×p...Formula (2)
In equation (2), D is the distance between the virtual microphone L and the virtual sound source. The reference temperature (°C) is a constant assumed to be the daytime temperature. For example, it is conceivable to adopt the temperature at 2:00 p.m., which is considered to be the highest temperature, as the reference temperature (° C.). p is a positive coefficient. The value of p may be arbitrarily determined by the developer of the game program.

In equation (2), when the corrected air temperature Tc decreases, the corrected distance Dc decreases. For example, at night, when the temperature is lower than during the day, the correction distance Dc becomes smaller than during the day.

(4) The reproduction control means 561 obtains the first parameter based on the correction distance Dc. For example, the reproduction control means 561 determines the volume according to the correction distance Dc.

The reproduction control means 561 uses a distance-volume characteristic curve that defines the relationship between distance and volume to determine the volume. FIG. 2 illustrates a distance-volume characteristic curve. In the distance-volume characteristic curve, the horizontal axis is distance and the vertical axis is volume. In this game program, the distance-volume characteristic curve is implemented as a function.

As can be seen from FIG. 2, the reproduction control means 561 controls the volume to decrease as the distance increases. In other words, the reproduction control means 561 reproduces the distance attenuation based on the corrected distance Dc.

The reproduction control means 561 determines the reverberation characteristics (for example, reverberation time) of the sound according to the humidity. This game program is implemented with a function that indicates the relationship between humidity and sound reverberation time (hereinafter referred to as humidity-reverberation time function).

Experience has shown that the higher the humidity, the harder the sound will resonate. In this game program, the humidity-reverberation time function is determined so that the higher the humidity, the shorter the reverberation time. The reproduction control means 561 determines the reverberation characteristics (for example, reverberation time) at the corrected humidity Hc based on the humidity-reverberation time function.

(5) Once the volume and reverberation time are determined, the reproduction control means 561 sends them to the reproduction means 531 as the first parameters.

<Determination of corrected temperature Tc>
The regeneration control means 561 determines the corrected temperature Tc in consideration of the following factors.

(Element 1) Time zone (0-24:00)
(Element 2) Weather in the area (good weather/bad weather, etc.)
(Element 3) Static object state (presence or absence of flames such as torches and bonfires)
(Element 4) Movement of a dynamic object (such as the movement of a monster spitting out a fireball).

Element 1 is used to reflect temperature changes depending on time of day on audio reproduction. This game program converts the temperature change over the course of a day into a function. FIG. 3 shows a graph of an example of a function representing the rate of temperature change over a day.

In the graph of FIG. 3, the vertical axis is the temperature. The temperatures shown on this vertical axis are merely exemplary. The horizontal axis of the graph in FIG. 3 is time. In the example of FIG. 3, the 24 hours are divided into three periods: 6:00 to 14:00, 14:00 to 22:00, and 22:00 to 6:00. In the example of FIG. 3, the temperature (annual average) is approximated by a straight line for each section. These straight lines have different rates of change (slopes).

If the temperature change rate is approximated by a straight line, the temperature at the current time (temperature Tt) can be determined from the ratio of daytime temperature to nighttime temperature. The daytime temperature and the nighttime temperature can be obtained from the temperature information Ta.

Element 2 is used to reflect temperature changes due to weather in audio playback. The reproduction control means 561 adds an offset value depending on the weather to the temperature Tt (see element 1). The offset value may be determined arbitrarily. Here, as an example of the offset value, −3° C. is used for bad weather, and 0° C. is used for good weather.

Element 3 is used to reflect temperature changes caused by a predetermined static object in audio playback. In virtual space, there are static objects that take on states that change the surrounding temperature. Examples of static objects that can change the ambient temperature include static objects that emit heat, such as torches and bonfires.

If the distance between the static object that can change the ambient temperature and the player character is within a predetermined range, the playback control means 561 adds an offset value corresponding to the distance between the two to the temperature Tt. The reproduction control means 561 selects a smaller offset value as the distance increases.

Element 4 is used to reflect temperature changes caused by a predetermined dynamic object in audio playback. In virtual space, there are dynamic objects that perform actions that change the surrounding temperature. An example of an action that changes the surrounding temperature is the action of a monster that spits out fireballs.

When the distance between the dynamic object that emits heat and the player character is within a predetermined range, the reproduction control means 561 adds a predetermined offset value to the temperature Tt. The reproduction control means 561 gradually returns the offset value to zero after a predetermined period of time (for example, 5 seconds) has elapsed. The offset value is returned to zero because changes in temperature caused by dynamic objects are considered to be temporary. Note that this offset value may be arbitrarily determined. The "predetermined range" may also be arbitrarily determined.

<Determination of corrected humidity Hc>
The reproduction control means 561 determines the corrected humidity Hc in consideration of the humidity Ha (second parameter) defined in the area and element 2 (weather). In this embodiment, the reproduction control means 561 generates the corrected humidity Hc by adding an offset value depending on the weather to the humidity Ha. Here, as an example of the offset value, +10% for bad weather and 0% for good weather are listed.

<Operation example>
For example, assume that a monster in the same area as the player character makes a barking motion during the day. In order to reproduce the monster's barking voice, the reproduction control means 561 searches for the nearest feature point (nearest neighbor point) to the player character.

The regeneration control means 561 determines the corrected temperature Tc based on the second parameter corresponding to the nearest point. The regeneration control means 561 calculates the corrected distance Dc based on the corrected temperature Tc. Further, the reproduction control means 561 determines the corrected humidity Hc based on the second parameter and the like.

The reproduction control means 561 determines the volume (distance attenuation) based on the corrected distance Dc. The reproduction control means 561 determines the reverberation characteristics based on the corrected humidity Hc. The reproduction control means 561 sends information defining the speed of sound, volume, and reverberation characteristics to the reproduction means 531 as first parameters.

The reproduction means 531 reproduces the audio based on the first parameter received from the reproduction control means 561. As a result, sound is output from the speaker 62 with acoustic effects depending on the conditions (temperature, humidity, weather, etc.) of the area (virtual space).

Further, assume that a monster in the same area as the player character performs a barking action at night when the temperature is lower than during the day. In this case, the corrected distance Dc has a smaller value than the daytime corrected distance Dc.

Therefore, the reproduction control means 561 sets the volume (first parameter) to be higher than the daytime volume. As a result, the reproduction means 531 reproduces the monster's barking voice at a louder volume than during the daytime. In other words, this game program reproduces the phenomenon that sounds can be heard far away at night.

To summarize the above, the present invention provides a computer with a reproduction means (audio processing section 53) that reproduces audio as sound in a virtual space with a predetermined sound effect, and a reproduction means that controls the sound effects added by the reproduction means. The virtual space is divided into a plurality of areas, and each area has a temperature set in the area, A second parameter including at least one of humidity and weather is associated, a virtual sound source that emits the sound is arranged in the virtual space, and the playback control means controls the area in which the sound source is present. The audio playback program is characterized in that the first parameter is generated based on the second parameter associated with the first parameter.

<Effects of this embodiment>
In this embodiment, audio is played back with sound effects that correspond to the temperature and humidity set in the area (virtual space). For example, in this embodiment, it is possible to reproduce the phenomenon that sounds can be heard far away at night. According to this embodiment, it is possible to reproduce audio with a more realistic feeling.

[Other embodiments]
Note that it is not necessary to use all of temperature, humidity, and weather to generate the first parameter. Only some of the temperature, humidity, and weather may be used to generate the first parameter. On the other hand, it is also possible to generate the first parameter using elements other than these.

A plurality of types of second parameters (temperature, humidity, weather, etc.) having different values may be set in one area. For example, a possible application would be to make the temperature and humidity different between feature points near a pond and feature points located far away from the pond, even within the same area. If the value of the second parameter differs depending on the feature point as described above, it is preferable to reproduce the audio using the feature point information set for the feature point closest to the player character.

The environmental sound to be played may be switched depending on the second parameter. This makes it possible, for example, to change the type of animal singing depending on the temperature.

Offset values based on static objects may change depending on time. For example, torches may turn on and off depending on the time of day. If the torch is extinguished, it is possible to set the offset value to zero.

Offset values for static objects may be included in the feature point information. By doing so, it is not necessary to calculate the offset value during execution of the game program. In other words, even if a plurality of static objects exist, it is possible to suppress an increase in processing load.

The offset value may be defined for each stage or for each area.

The parameter used to correct the distance D is not limited to the temperature (corrected temperature Tc). Other parameters (for example, corrected humidity Hc) may also be used.

The humidity (corrected humidity Hc) may be changed depending on the time.

Parameters that are changed depending on the state of a static object are not limited to temperature. For example, humidity may be changed depending on the state of a static object.

Parameters that are changed according to the motion of the dynamic object are not limited to temperature. For example, humidity may be changed depending on the movement of a dynamic object.

Regarding the weather, the influence of snow may be considered. For example, in snowy conditions, it may be possible to increase the attenuation of the sound.

The second parameter does not necessarily need to be included in the feature point information. It may be implemented as separate data. As an example, it may be implemented as a searchable list using area information (for example, a number assigned to an area) as a key.

The audio reproduction program may be applied to other than game programs. For example, it can be applied to programs and devices that add sound effects to movies, animations, etc.

The game program may be implemented as a so-called online game game program. If the game program is for an online game, the processing performed by the control unit 56, audio processing unit 53, etc. may be performed on the server side instead, or the server side and the client (game device 5) side may perform the processing performed by the control unit 56, audio processing unit 53, etc. You may share it with

Even when these other embodiments are adopted, the effects of the present invention can be exerted. Moreover, it is also possible to combine this embodiment with other embodiments, or with other embodiments, as appropriate.

5 Game device (audio playback device)
53 Audio processing section 56 Control section 531 Reproduction means 561 Reproduction control means

Claims (6)

computer,
a reproduction means for reproducing audio as sound in a virtual space with predetermined sound effects;
a reproduction control means for generating a first parameter for controlling a sound effect applied by the reproduction means;
and make it work,
The virtual space is divided into a plurality of areas,
Each area is associated with a second parameter including at least one of temperature, humidity, and weather set for the area,
A virtual sound source that emits the sound is arranged in the virtual space,
The reproduction control means generates the first parameter based on a second parameter associated with an area where the sound source exists,
The reproduction control means determines a distance between a virtual sound receiving point where the sound is heard and the sound source, and uses the second parameter to perform correction to increase or decrease the value of the determined distance;
The audio reproduction program, wherein the reproduction control means generates the first parameter based on the corrected distance . computer,
a reproduction means for reproducing audio as sound in a virtual space with predetermined sound effects;
a reproduction control means for generating a first parameter for controlling a sound effect applied by the reproduction means;
and make it work,
The virtual space is divided into a plurality of areas,
Each area is associated with a second parameter including at least one of temperature, humidity, and weather set for the area,
A virtual sound source that emits the sound is arranged in the virtual space,
The reproduction control means generates the first parameter based on a second parameter associated with an area where the sound source exists,
A static object whose position is fixed is arranged in the virtual space,
The audio reproduction program, wherein the reproduction control means corrects the second parameter according to a distance between a virtual sound receiving point where the sound is heard and the static object. In claim 1 or claim 2 ,
The audio reproduction program, wherein the first parameter is a parameter that determines at least one of a volume and a reverberation characteristic. In any one of claims 1 to 3 ,
A virtual time is set in the virtual space,
The audio reproduction program, wherein the reproduction control means corrects the second parameter according to the time. In any one of claims 1 to 4 ,
A dynamic object whose position changes is arranged in the virtual space,
The audio reproduction program, wherein the reproduction control means corrects the second parameter according to the motion of the dynamic object. A storage unit storing the audio reproduction program according to any one of claims 1 to 5 ;
a control unit that executes the audio playback program;
An audio playback device comprising:

Images