JP2012249031A - Game device, game processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a game device and a game processing method capable of exerting sound localization control in a virtual space where a virtual listening point and a virtual sounder are disposed, and to provide a program for realizing the device and the method on a computer.SOLUTION: In a game device 200, an expansion rate calculation unit 203 obtains an expansion rate c of an original sound generated by a virtual sounder on the basis of environment information stored in a storage unit 201. Left and right sample values and the expansion rate c of the original sound are used to obtain an output sound through a simple formula by an intermediate calculation unit 204, a left calculation unit 205, a right calculation unit 206, and an output calculation unit 207.

Description

  The present invention relates to a game apparatus, a game processing method, and a program for realizing them in a computer, which can easily perform sound image localization control in a virtual space where virtual listening points and virtual sounding bodies are arranged.

  2. Description of the Related Art Conventionally, a game sound output device that can output a game sound emitted from a virtual sounding body arranged in a virtual space more easily is proposed (see Patent Document 1).

JP 2008-245984 A

  On the other hand, sound image localization control in a virtual space requires waveform processing such as shifting the phase of an input signal, and requires complicated calculation and a large memory area. In a game device that has a limited memory capacity and requires quick response to a player's operation, a process adapted to the characteristics of the game device is desired.

  SUMMARY OF THE INVENTION The present invention solves the above-described problems. A game device, a game processing method, and a game processing method that can easily perform sound image localization control in a virtual space where a virtual listening point and a virtual sounding body are arranged. An object of the present invention is to provide a program realized on a computer.

In order to achieve the above object, a game device according to a first aspect of the present invention includes a storage unit, a reception unit, an expansion ratio calculation unit, an intermediate calculation unit, a left calculation unit, a right calculation unit, an output calculation unit, and an audio output unit. And comprising.
Here, the storage unit stores the virtual listening point and the environment information of the virtual space where the virtual sounding body is arranged, and the receiving unit is obtained when listening to the virtual sound emitted by the virtual sounding body under a predetermined listening condition. Accepts input of left sample value L0 (t) and right sample value R0 (t) (-M≤L0 (t) ≤M, -M≤R0 (t) ≤M) at time t The extension ratio calculation unit calculates the received original speech extension ratio c (0 ≦ c ≦ 2) from the environment information stored in the storage unit.

  That is, in the virtual space of the game, the virtual listening environment, for example, the virtual space environment information such as the position where the player character is placed and the size of the virtual space where the virtual sound generator is placed are stored. .

  The accepting unit accepts the left sample value and the right sample value at a certain time of the original sound that is assumed to be obtained by listening to the virtual sound generated by the virtual sound generator under a predetermined listening condition.

That is, the sound pressure characteristic of the original sound, which is an analog signal, is sampled (sampled), changed to a numerical signal (digital), and received as a left sample value and a right sample value. The sampling is digitized by measuring the sample values of the left and right original speech at predetermined time intervals (t).
Note that an upper limit value (M) and a lower limit value (−M) are set for the right sample value and the left sample value in order to eliminate noise.

  The expansion ratio calculation unit calculates an expansion ratio according to the environment information stored in the storage unit, for example, the size of the virtual space.

The intermediate calculation unit receives the left sample value L1 (t) of the first intermediate sound from the received left sample value L0 (t) and right sample value R0 (t) of the received original sound and the calculated expansion ratio c. And the right sample value R1 (t),
L1 (t) = [(1 + c) × L0 (t) + (1-c) × R0 (t)] / 2;
R1 (t) = ((1-c) x L0 (t) + (1 + c) x R0 (t)) / 2
Calculated by
The left calculation unit compares the left sample value L1 (t) of the first intermediate sound with the upper limit value M and the lower limit value -M, and determines the left sample value L2 (t) of the second intermediate sound and the left of the third intermediate sound. Sample value L3 (t)
L2 (t) = L1 (t), L3 (t) = 0 (-M ≦ L1 (t) ≦ M);
L2 (t) = M, L3 (t) = L1 (t) -M (M <L1 (t));
L2 (t) = -M, L3 (t) = L1 (t) + M (L1 (t) <-M)
Calculated by
The right calculation unit compares the right sample value R1 (t) of the first intermediate voice with the upper limit value M and the lower limit value -M, and compares the right sample value R2 (t) of the second intermediate voice and the third intermediate voice value. The right sample value R3 (t)
R2 (t) = R1 (t), R3 (t) = 0 (-M ≦ R1 (t) ≦ M);
R2 (t) = M, R3 (t) = R1 (t) -M (M <R1 (t));
R2 (t) = -M, R3 (t) = R1 (t) + M (R1 (t) <-M)
Calculate according to

  That is, the intermediate calculation unit performs a calculation for extending each sample value to the right sample value and the left sample value of the original speech using an extension ratio according to the environment information.

  The right calculation unit and the left calculation unit calculate the difference between the right sample value and the left sample value exceeding the upper limit value (M) and the lower limit value (−M) as the left sample value and the right sample value of the third intermediate speech. I do.

The output calculation unit outputs the left sample value L4 (t) and the right sample value R4 (t) of the output speech,
L4 (t) = L2 (t)-R3 (t);
R4 (t) = R2 (t)-L3 (t)
The sound output unit outputs the left sample value L4 (t) and the right sample value L4 (t) of the output sound as stereo sound.

  That is, the output calculation unit dephases the left sample value and the right sample value of the second intermediate sound corrected by the expansion ratio with the third intermediate sound obtained as a difference between the upper limit value and the lower limit value, The left / right balance is adjusted, and the sound is output from the speaker by the sound output unit.

  In the game device, the environment information includes the size of the virtual sounding body, and the expansion ratio c increases as the size of the virtual sounding body increases.

  That is, as the size of the virtual sounding body increases, the expansion ratio c increases, the degree of reverberation increases, and it sounds as if a larger sound is being output.

  In a game device, a plurality of virtual sound generators are arranged in a virtual space, and the original sound is sound that is assumed to be obtained when listening to virtual sound generated by all of the plurality of virtual sound generators under predetermined listening conditions. In addition, the environment information includes the size of a region where a plurality of sounding bodies are arranged, and the expansion ratio c increases as the size of the region increases.

  That is, when a plurality of sound generators are arranged, the larger the area where the sound generators are arranged, the greater the degree of sound spread, and the plurality of sound generators sounding apart. I can hear you.

  In the game device, the environment information includes the size of the room including the virtual listening point and the virtual sounding body, and the expansion ratio c increases as the size of the room decreases.

  That is, the smaller the size of the room, the greater the expansion ratio, the greater the degree of reverberation, and the sound of being heard in a small room.

  A game processing method according to another aspect of the present invention is a game processing method executed in a game device, the game device including a storage unit, a reception unit, an expansion ratio calculation unit, an intermediate calculation unit, a left calculation unit, It has a right calculation unit, an output calculation unit, a voice output unit, and includes a storage step, a reception step, an expansion ratio calculation step, an intermediate calculation step, a left calculation step, a right calculation step, an output calculation step, and a voice output step. Configure as follows.

  That is, in the storing step, the virtual listening point and the environment information of the virtual space where the virtual sounding body is arranged are stored.

  In the reception process, the left sample value L0 (t) and the right sample value R0 (t) (-) at the time t of the original sound assumed to be obtained when the virtual sound emitted by the virtual sound generator is listened to under a predetermined listening condition. M≤L0 (t) ≤M, -M≤R0 (t) ≤M) are accepted.

  In the expansion ratio calculation step, the received original speech expansion ratio c (0 ≦ c ≦ 2) is calculated from the environment information stored in the storage unit.

In the intermediate calculation step, the left sample value L1 (t) of the first intermediate sound is calculated from the received left sample value L0 (t) and right sample value R0 (t) of the original sound and the calculated expansion ratio c. And the right sample value R1 (t),
L1 (t) = [(1 + c) × L0 (t) + (1-c) × R0 (t)] / 2;
R1 (t) = ((1-c) x L0 (t) + (1 + c) x R0 (t)) / 2
Calculate according to

In the left calculation step, the left sample value L1 (t) of the first intermediate voice is compared with the upper limit value M and the lower limit value -M, and the left sample value L2 (t) of the second intermediate voice and the left of the third intermediate voice are compared. Sample value L3 (t)
L2 (t) = L1 (t), L3 (t) = 0 (-M ≦ L1 (t) ≦ M);
L2 (t) = M, L3 (t) = L1 (t) -M (M <L1 (t));
L2 (t) = -M, L3 (t) = L1 (t) + M (L1 (t) <-M)
Calculate according to

In the right calculation step, the right sample value R1 (t) of the first intermediate voice is compared with the upper limit value M and the lower limit value -M, and the right sample value R2 (t) of the second intermediate voice and the third intermediate voice value are compared. The right sample value R3 (t)
R2 (t) = R1 (t), R3 (t) = 0 (-M ≦ R1 (t) ≦ M);
R2 (t) = M, R3 (t) = R1 (t) -M (M <R1 (t));
R2 (t) = -M, R3 (t) = R1 (t) + M (R1 (t) <-M)
Calculate according to

In the output calculation process, the left sample value L4 (t) and the right sample value R4 (t) of the output speech are
L4 (t) = L2 (t)-R3 (t);
R4 (t) = R2 (t)-L3 (t)
Calculate according to

  In the sound output process, the left sample value L4 (t) and the right sample value L4 (t) of the output sound are output as stereo sound.

  A program according to another aspect of the present invention is a program that causes a computer to function as a game device. The game device includes a storage unit, a reception unit, an expansion ratio calculation unit, an intermediate calculation unit, a left calculation unit, and a right calculation unit. An output calculation unit and a voice output unit.

  Here, the storage unit stores the virtual listening point and the environment information of the virtual space where the virtual sounding body is arranged, and the receiving unit is obtained when listening to the virtual sound emitted by the virtual sounding device under a predetermined listening condition. Accepts input of left sample value L0 (t) and right sample value R0 (t) (-M≤L0 (t) ≤M, -M≤R0 (t) ≤M) at time t The extension ratio calculation unit calculates the received original speech extension ratio c (0 ≦ c ≦ 2) from the environment information stored in the storage unit.

The intermediate calculation unit receives the left sample value L1 (t) of the first intermediate sound from the received left sample value L0 (t) and right sample value R0 (t) of the received original sound and the calculated expansion ratio c. And the right sample value R1 (t),
L1 (t) = [(1 + c) × L0 (t) + (1-c) × R0 (t)] / 2;
R1 (t) = ((1-c) x L0 (t) + (1 + c) x R0 (t)) / 2
Calculate according to

The left calculation unit compares the left sample value L1 (t) of the first intermediate sound with the upper limit value M and the lower limit value -M, and determines the left sample value L2 (t) of the second intermediate sound and the left of the third intermediate sound. Sample value L3 (t)
L2 (t) = L1 (t), L3 (t) = 0 (-M ≦ L1 (t) ≦ M);
L2 (t) = M, L3 (t) = L1 (t) -M (M <L1 (t));
L2 (t) = -M, L3 (t) = L1 (t) + M (L1 (t) <-M)
The right calculation unit compares the right sample value R1 (t) of the first intermediate voice with the upper limit value M and the lower limit value -M, and compares the right sample value R2 (t) of the second intermediate voice and the second value. 3 The right sample value R3 (t) of the intermediate speech,
R2 (t) = R1 (t), R3 (t) = 0 (-M ≦ R1 (t) ≦ M);
R2 (t) = M, R3 (t) = R1 (t) -M (M <R1 (t));
R2 (t) = -M, R3 (t) = R1 (t) + M (R1 (t) <-M)
Calculate according to

The output calculation unit outputs the left sample value L4 (t) and the right sample value R4 (t) of the output speech,
L4 (t) = L2 (t)-R3 (t);
R4 (t) = R2 (t)-L3 (t)
The sound output unit outputs the left sample value L4 (t) and the right sample value L4 (t) of the output sound as stereo sound.

The program of the present invention can be recorded on a computer-readable information storage medium such as a compact disk, flexible disk, hard disk, magneto-optical disk, digital video disk, magnetic tape, and semiconductor memory.
The above program can be distributed and sold via a computer communication network independently of the computer on which the program is executed. The information storage medium can be distributed and sold independently from the computer.

  According to the present invention, it is possible to provide a game device, a game processing method, and a program for realizing these in a computer that can easily perform sound image localization control in a virtual space where a virtual listening point and a virtual sounding body are arranged. Can do.

It is a mimetic diagram showing the outline composition of the typical information device with which the game device concerning the embodiment of the present invention is realized. It is explanatory drawing which shows schematic structure of the game device which concerns on one of embodiment of this invention. It is the graph which showed the change of the analog waveform of an original sound along time passage. It is a graph which shows the sampling value which sampled the analog waveform of the original sound for every fixed time along time passage. It is a figure which shows the relationship between the expansion ratio c and environmental information. It is a figure which shows the relationship between the expansion ratio c and the magnitude | size of a sounding body. It is a figure which shows the relationship between the expansion ratio c and the width of the area | region where the some virtual sounding body is arrange | positioned. It is a figure which shows typically the example from which the area of the area | region where the several virtual sounding body is arrange | positioned differs. It is a figure which shows the relationship between the expansion ratio c, the virtual listening point, and the room surrounding a virtual sounding body. It is a figure which shows typically the example from which the magnitude | size of the room surrounding a virtual sounding body differs. It is a flowchart which shows the flow of the audio | voice output process in the game device which concerns on embodiment of this invention. It is a circuit diagram showing a circuit configuration for outputting a first intermediate audio signal L1 from original sound signals L0, R0. It is a circuit diagram showing a circuit configuration for outputting a second intermediate audio signal L2 and a third intermediate audio signal L3 from a first intermediate audio signal L1. It is a circuit diagram showing a circuit configuration for outputting a first intermediate audio signal R1 from original sound signals L0, R0. It is a circuit diagram showing a circuit configuration for outputting a second intermediate audio signal R2 and a third intermediate audio signal R3 from a first intermediate audio signal R1. It is a circuit diagram showing a circuit configuration for outputting output audio signals L4 and R4 from second intermediate audio signals L2 and R2 and third intermediate audio signals L3 and R3. It is the figure which showed the conceptual diagram at the time of outputting stereo audio | voice using this embodiment.

  FIG. 1 is a schematic diagram showing a schematic configuration of a typical information processing apparatus 100 in which a game apparatus according to an embodiment of the present invention is realized. Hereinafter, a description will be given with reference to FIG.

  The information processing apparatus 100 includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, an interface 104, a controller 105, an external memory 106, a DVD-ROM ( A digital versatile disk-read only memory (107) drive 107, an image processing unit 108, an audio processing unit 109, and a NIC (Network Interface Card) 110 are provided.

  A DVD-ROM storing a game program and data is loaded into the DVD-ROM drive 107 and the information processing apparatus 100 is turned on to execute the program, thereby realizing the game apparatus of the present embodiment. The

  The CPU 101 controls the overall operation of the information processing apparatus 100 and is connected to each component to exchange control signals and data. Further, the CPU 101 uses arithmetic operations such as addition / subtraction / multiplication / division, logical sum, logical product, etc. using an ALU (Arithmetic Logic Unit) (not shown) for a storage area called a register (not shown) that can be accessed at high speed. , Logic operations such as logical negation, bit operations such as bit sum, bit product, bit inversion, bit shift, and bit rotation can be performed. In addition, the CPU 101 itself is configured so that saturation operations such as addition / subtraction / multiplication / division for multimedia processing, vector operations such as trigonometric functions, etc. can be performed at a high speed, and those provided with a coprocessor. There is.

  The ROM 102 records an IPL (Initial Program Loader) that is executed immediately after the power is turned on, and when this is executed, the program recorded on the DVD-ROM is read to the RAM 103 and the execution by the CPU 101 is started. Is done. The ROM 102 stores an operating system program and various data necessary for operation control of the entire information processing apparatus 100.

  The RAM 103 is for temporarily storing data and programs, and holds programs and data read from the DVD-ROM and other data necessary for game progress and chat communication. Further, the CPU 101 provides a variable area in the RAM 103 and performs an operation by directly operating the ALU on the value stored in the variable, or temporarily stores the value stored in the RAM 103 in the register. Perform operations such as performing operations on registers and writing back the operation results to memory.

  The controller 105 connected via the interface 104 receives an operation input performed by the player when executing a game such as a dance game or a soccer game. A plurality of controllers 105 may be connected to the interface 104.

  The external memory 106 detachably connected via the interface 104 stores data indicating game play status (past results, etc.), data indicating game progress, and log of game chat communication using the network ( Data) is stored in a rewritable manner. The player can appropriately record these data in the external memory 106 by performing an operation input via the controller 105.

  Here, chat means that information is sent in real time so that there is no time difference between when one of the players emits information and when the information is presented to the other, as if the players meet and talk directly. It is a mechanism that can communicate. For example, a character is input with a keyboard or the like from a player and displayed on the other party's monitor, whereby a chat with characters (character chat) is performed. In addition, for example, a voice chat (voice chat) is performed by collecting the voice uttered by the player with a microphone and outputting the voice from the speaker of the other party.

  A DVD-ROM mounted on the DVD-ROM drive 107 stores a program for realizing the game and image data and sound data associated with the game. Under the control of the CPU 101, the DVD-ROM drive 107 performs a reading process on the DVD-ROM loaded therein, reads out necessary programs and data, and these are temporarily stored in the RAM 103 or the like.

  The image processing unit 108 processes the data read from the DVD-ROM by the CPU 101 or an image arithmetic processor (not shown) included in the image processing unit 108, and then processes the processed data on a frame memory ( (Not shown). The image information recorded in the frame memory is converted into a video signal at a predetermined synchronization timing and output to a monitor (not shown) connected to the image processing unit 108. Thereby, various image displays are possible.

  The image calculation processor can execute a two-dimensional image overlay calculation, a transmission calculation such as α blending, and various saturation calculations at high speed.

  Also, polygon information arranged in the virtual three-dimensional space and added with various texture information is rendered by the Z buffer method, and the polygon arranged in the virtual three-dimensional space from the predetermined viewpoint position is determined in the direction of the predetermined line of sight It is also possible to perform high-speed execution of operations for obtaining rendered images.

  Further, the CPU 101 and the image arithmetic processor operate in a coordinated manner, so that a character string can be drawn as a two-dimensional image in a frame memory or drawn on the surface of each polygon according to font information that defines the character shape. is there.

  Further, by preparing information such as game images in a DVD-ROM and expanding the information in a frame memory, the state of the game can be displayed on the screen.

  The audio processing unit 109 converts audio data read from the DVD-ROM into an analog audio signal, and outputs the analog audio signal from a speaker (not shown) connected thereto. Further, under the control of the CPU 101, sound effects and music data to be generated during the progress of the game are generated, and sound corresponding to this is output from the speaker.

  When the audio data recorded on the DVD-ROM is MIDI data, the audio processing unit 109 refers to the sound source data included in the audio data and converts the MIDI data into PCM data. If the compressed audio data is in ADPCM (Adaptive Differential Pulse Code Modulation) format or Ogg Vorbis format, it is expanded and converted to PCM data. The PCM data can be output by performing D / A (Digital / Analog) conversion at a timing corresponding to the sampling frequency and outputting it to a speaker.

  The NIC 110 is used to connect the information processing apparatus 100 to a computer communication network (not shown) such as the Internet, and is based on the 10BASE-T / 100BASE-T standard used when configuring a LAN (Local Area Network). To connect to the Internet using an analog modem, ISDN (Integrated Services Digital Network) modem, ADSL (Asymmetric Digital Subscriber Line) modem, cable television line A cable modem or the like and an interface (not shown) that mediates between these and the CPU 101 are configured.

  In addition, the information processing apparatus 100 uses a large-capacity external storage device such as a hard disk so as to perform the same function as the ROM 102, the RAM 103, the external memory 106, the DVD-ROM attached to the DVD-ROM drive 107, and the like. You may comprise.

  The information processing apparatus 100 described above corresponds to a so-called home video game apparatus, but the present invention is applied to various computers such as a mobile phone, a mobile game device, a karaoke apparatus, and a general business computer. It is possible to realize.

  For example, a general computer, like the information processing apparatus 100, includes a CPU, RAM, ROM, DVD-ROM drive, and NIC, and includes an image processing unit having simpler functions than the information processing apparatus 100. In addition to having a hard disk as an external storage device, a flexible disk, a magneto-optical disk, a magnetic tape, and the like can be used. Further, not the controller 105 but a keyboard or a mouse is used as an input device.

  FIG. 2 is an explanatory diagram showing a schematic configuration of a game device according to one embodiment of the present invention. Hereinafter, a description will be given with reference to FIG.

  The game device 200 includes a storage unit 201, a reception unit 202, an expansion ratio calculation unit 203, an intermediate calculation unit 204, a left calculation unit 205, a right calculation unit 206, an output calculation unit 207, and an audio output unit 208.

The storage unit 201 stores the virtual listening point position and environment information of the virtual space where the virtual sounding body is arranged.
Here, the environment information of the virtual space is the size of the virtual sound generator, the size of the room surrounding the virtual listening point and the virtual sound generator, and when there are multiple virtual sound generators, a plurality of virtual sound generators are arranged. The size of the area that is being used.
In the game apparatus, the position of the virtual listening point is the position of the virtual space where the player or the player's character is arranged, and the virtual sound generator is an object that emits sound such as an enemy character or a weapon.
The size of the sounding body is, for example, the size of the character. Generally, the larger the size of the character, the larger the size of the sound to be generated.

The case where there are a plurality of virtual sound generators corresponds to a case where a plurality of characters appear in the game and a case where there are a plurality of sounding objects. The area where a plurality of sound generators are arranged is an area including an area where a plurality of characters are arranged, and the larger the area, the wider the sound can be heard.
The size of the room is, for example, the size of the virtual space in which the character is placed, and the reverberant sound increases as the room becomes smaller.

The CPU 101 reads audio data stored in a DVD-ROM device or the like, and stores the virtual listening position and environment information in the storage unit 201.
Note that the storage unit 201 corresponds to the ROM 102.

The reception unit 202 obtains the left sample value L0 (t) and the right sample value R0 (t) at the time t of the original sound that is assumed to be obtained when the virtual sound emitted by the virtual sound generator is listened to under a predetermined listening condition. Accept.
That is, values obtained by sampling and sampling data obtained by converting analog information, which is the original sound heard at the virtual listening point at time t, into digital information are set as a left sample value L0 (t) and a right sample value R0 (t). Accept.

As shown in FIG. 3, the original sound heard under a predetermined listening condition can be understood as a waveform of a sound pressure that changes continuously. This is sampled (sampled) at regular time intervals and shown as a graph, as shown in FIG. The number of samplings per second is defined as the sampling frequency.
In the embodiment of the present invention, the left sample value at a certain time t is L0 (t), the right sample value is R0 (t), and in FIG. 4, the value of the left sample value L0 is expressed as time (t) elapses. For the sake of convenience.
The M value shown here includes + M and -M, and indicates the maximum value and the minimum value to be sampled, respectively.
The right sample value R0 (t) is also sampled by the same method.

The expansion ratio calculation unit 203 calculates the received original speech expansion ratio c from the environment information stored in the storage unit 201.
As shown in FIG. 5, there is a certain relationship between the environmental information and the expansion ratio.
That is, as the size of the virtual sounding body increases, the c value increases. As the area where a plurality of sounding bodies are arranged increases, the c value increases, and the size of the room where the sounding body is placed decreases. , C value increases.
The c value is set between 0 and 2, with 0 being monaural, 1 being the original sound, and 2 being the value spread as much as possible to the left and right.

When a game sound is generated, it is necessary to recognize in which direction the sounding object is based on the listening position (player). In order to determine the position of the sounding body, generally, a sound image localization process is performed. That is, when the enemy character is in front of the player character, it is necessary to acquire the positions of the player character and the enemy character in the virtual space and to generate sound from the position where the sound image is localized in that direction.
In addition, effect processing, for example, delay processing, is performed when the reverberation sound varies depending on the size of the space or the size of the character.
These processes are dealt with by controlling the phase of the waveform, and the processing amount is large and processing time is also required.
In this embodiment, the general processing of sound image localization is not performed, but the expansion ratio is calculated from the environment information of the virtual space such as the character size, and the sound image localization processing is simply performed.

The expansion ratio c is calculated from the environment information stored in the storage unit 201.
FIG. 6 is a table showing the correspondence between the size of the sounding body, which is one of the environmental information, and the c value.
The size of the sounding body is set as sounding body X <sounding body Y <sounding body Z <sounding body W.
Therefore, the c value for sound generator X is 0.4, the c value for sound generator Y is 0.6, the c value for sound generator Z is 1.0, and the c value for sound generator W is c. Calculated as 1.5.
The c value can be calculated using an expression proportional to the size of the sounding body, or any other calculation expression can be used.
In the same space, as the size of the sounding body increases, the c value increases, so that the sound is output with a spread. Therefore, the user sounds as if it is being output with a large echo.

FIG. 7 is a diagram showing the relationship between the width of a region where a plurality of virtual sound generators are arranged and the c value when a plurality of virtual sound generators are arranged in the virtual space.
As shown in the figure, the c value is 0.5 when the area is small, the c value is 1.0 when the area is medium, and the c value is 1.0 when the area is large. The value is calculated as 1.5.
For the value of the expansion ratio c, an arbitrary calculation method is adopted that increases with the size of the area in consideration of the nature of the environment information and the relationship with the game content.

Here, the region where a plurality of virtual sound generators are arranged refers to a region including all of the plurality of virtual sound generators arranged. As such a region, for example, the following modes can be adopted.
(A) The smallest rectangular parallelepiped including all sounding bodies. Typically, each side of the rectangular parallelepiped is set parallel to the coordinate axis of the global coordinate system set in advance in the virtual space.
(B) The smallest sphere containing all sounding bodies. A known algorithm for obtaining the minimum sphere from the position of each sounding body can be used.
(C) The smallest convex polyhedron including all sounding bodies. Also known as a convex hull, a known algorithm for obtaining a convex hull from the position of each sounding body can be used.
(D) A minimum sphere centered on the center of gravity of all sounding bodies. The center of gravity can be obtained from the average position of the sounding body. The radius of the sphere may be the maximum of the distances from the center of gravity to each sounding body.
(E) A region obtained by enlarging each of the regions (a) to (d) by a predetermined thickness.

FIG. 8 shows an example in which a plurality of virtual sound generators are arranged in a virtual space.
In FIG. 8A, five virtual sound generators 802 are arranged in the virtual space 801. The concept of convex hull can be used as a method for determining an area (hereinafter referred to as “area A”) in which a plurality of virtual sound generators are arranged. The convex hull is a minimum polygon including a plurality of points, and can be obtained by a geometric algorithm.
In this figure, the area A obtained using the concept of a convex hull is the smallest polygon including the five virtual sounding bodies 801 and is an area surrounded by a dotted line 803.

In FIG. 8B as well, five virtual sound generators 805 are arranged in the virtual space 804. As in the case of FIG. 8A, a convex hull region is obtained by a geometric algorithm in order to determine a region (hereinafter referred to as “region B”) in which a plurality of virtual sound generators are arranged.
In this figure, a region B obtained using the concept of a convex hull is a minimum polygon including the virtual sound generator 805 and is a region surrounded by a dotted line 806.
The method of obtaining the region is not limited to using the concept of a convex hull, and other methods can be used as long as a region including all of a plurality of virtual sound generators is obtained.

As is clear from both figures, the region B is wider than the region A, and the c value of the region B is set larger than the c value of the region A as shown in FIG.
The calculation is performed using a calculation formula that increases in proportion to the size of the region, or any other calculation formula.
By using the c value obtained in this way, the sound generated in the virtual space of FIG. 8B is output more widely than the sound generated in the virtual space of FIG. It will be.

FIG. 9 is a diagram showing the correspondence between the size of the room surrounding the virtual listening point and the virtual sounding body, which is one of the environment information, and the c value. The c values corresponding to room A, room B, room C, room D, and room E are calculated.
That is, the sizes of the rooms A to E are set such that space E <space D <space C <space B <space A.
When the room A is set, the c value is 0.6, when the room B is set, the c value is 0.8, when the room C is set, the c value is 1.0, and the room D is When it is set, the c value is calculated as 1.2, and when the room E is set, the c value is calculated as 1.4.
As a method for calculating the expansion ratio from the size of the room, an inversely proportional expression may be used, or any other calculation expression may be used.

FIG. 10 shows an example of the size of the room including the virtual sound generator and the virtual sound generator.
FIG. 10A shows a room 1001 including a virtual sound generator 1002, and FIG. 10B shows a room 1004 including a virtual sound generator 1003. It is assumed that the virtual listening point is at the same position as the virtual sounding body.
Since the room 1001 is smaller than the room 1004, the sound generated by the virtual sound generator 1003 collides with the wall and the sound that the virtual sound generator 1002 collides with the wall returns to the virtual listening point. It is earlier than the time until.
Therefore, the room 1001 sounds louder than the room 1004.

In order to output such a reverberant sound, it is necessary to obtain the c value so that the reverberant sound is larger as the room is smaller.
That is, as shown in FIG. 5, calculation is performed so that the c value is set to be larger as the size of the room in which the virtual sound generator is placed is smaller.

The intermediate calculation unit 204 receives the original audio signals L0 and R0 and outputs the first intermediate audio signals L1 and R1.
Specifically, based on the left sample value L0 (t), the right sample value R0 (t), and the calculated c value, the left sample value L1 (t) and the right sample value R1 ( t) is obtained based on the following equations (1a) and (1b).
L1 (t) = [(1 + c) x L0 (t) + (1-c) x R0 (t)] / 2 (1a)
R1 (t) = [(1-c) × L0 (t) + (1 + c) × R0 (t)] / 2 (1b)

The left calculator 205 outputs the second intermediate audio signal L2 and the third intermediate audio signal L3 from the first intermediate audio signal L1.
Specifically, the left sample value L (1) of the first intermediate sound is compared with the upper limit value M and the lower limit value −M, and the left sample value L2 (t) of the second intermediate sound and the left of the third intermediate sound are compared. The sample value L3 (t) is obtained based on the following equations (2a) (2b) (2c).
L2 (t) = L1 (t), L3 (t) = 0 (-M≤L1 (t) ≤M) ... (2a)
L2 (t) = M, L3 (t) = L1 (t) -M (M <L1 (t)) (2b)
L2 (t) = -M, L3 (t) = L1 (t) + M (L1 (t) <-M) (2c)

The right calculation unit 206 outputs the second intermediate audio signal R2 and the third intermediate audio signal R3 from the first intermediate audio signal R1.
Specifically, the right sample value R1 (t) of the first intermediate sound is compared with the upper limit value M and the lower limit value -M, and the right sample value R2 (t) of the second intermediate sound and the third intermediate sound value are compared. The right sample value R3 (t) is obtained from the following equations (3a) (3b) (3c).
R2 (t) = R1 (t), R3 (t) = 0 (-M ≦ R1 (t) ≦ M) ・ ・ (3a)
R2 (t) = M, R3 (t) = R1 (t) -M (M <R1 (t)) (3b)
R2 (t) = -M, R3 (t) = R1 (t) + M (R1 (t) <-M) (3c)

The output calculation unit 207 outputs output audio signals L4 and R4 from the second intermediate audio signals L2 and R2 and the third intermediate audio signals L3 and R3.
Specifically, the left sample value L4 (t) and the right sample value R4 (t) of the output speech are obtained from the following equations (4a) and (4b).
L4 (t) = L2 (t)-R3 (t) ・ ・ (4a)
R4 (t) = R2 (t)-L3 (t) ・ ・ (4b)

  The CPU 101 functions as a reception unit 202, an expansion ratio calculation unit 203, an intermediate calculation unit 204, a left calculation unit 205, a right calculation unit, and an output calculation unit 207.

The audio output unit 208 analogizes the left sample value L4 (t) and the right sample value L4 (t) as output audio signals L4 and R4, and outputs stereo audio from the speaker.
Note that the audio processing unit 109 functions as the audio output unit 208.

  The flow of audio output processing in the game device having the above-described configuration will be described using the flowchart shown in FIG.

  When the sound output process is started, the reception unit 202 receives the left sample value L0 (t) and the right sample value R0 (t) at time t of the original sound (step S1101). Each sample value is set with an upper limit value M and a lower limit value −M, and is accepted within the range, that is, in the range of −M ≦ L0 (t) ≦ M and −M ≦ R0 (t) ≦ M.

  Then, from the environment information stored in the storage unit 201, the expansion ratio c (0 ≦ c ≦ 2) of the original voice received by the expansion ratio calculation unit 203 is calculated (step S1102).

  From the left sample value L0 (t) and right sample value R0 (t) of the original voice and the calculated expansion ratio c, the intermediate calculation unit 204 calculates the left sample value L1 (t) and right of the first intermediate voice. The sample value R1 (t) is calculated (step S1103).

The left calculation unit 205 compares the left sample value L1 (t) of the first intermediate sound with the upper limit value M and the lower limit value -M, and the left sample value L2 (t) of the second intermediate sound and the left value of the third intermediate sound The sample value L3 (t) is calculated (step S1104).
This calculation leaves a sample value having an excessive amplitude value as a difference.

The right calculation unit 206 compares the right sample value R1 (t) of the first intermediate voice with the upper limit value M and the lower limit value −M, and compares the right sample value R2 (t) of the second intermediate voice and the third intermediate voice value. The right sample value R3 (t) is calculated (step S1105).
Similar to step S904, a sample value having an excessive amplitude value is left as a difference.

Then, the output calculation unit 207 calculates the left sample value L4 (t) and the right sample value R4 (t) of the output speech (step S1106).
The left sample value L4 (t) and the right sample value R4 (t) are third difference values of excessive amplitude values from the left sample value L2 (t) and the right sample value R2 (t) of the second intermediate voice. It is obtained by subtracting the left sample value L3 (t) and the right sample value R3 (t) of the intermediate speech.

  The sound output unit 208 outputs the left sample value L4 (t) and the right sample value L4 (t) of the output sound from the speaker as stereo sound (step S1107).

Thereafter, it is determined whether or not the t value has ended (step S1108). If the t value has ended (YES; step S1108), the audio output processing ends.
If the t value has not ended (NO; step S1108), the t value stored in the RAM 103 or the like is updated to t + 1, and the same processing is started again. The processing step waits until data of the next t value comes.
The audio output process is repeated until t = 0, 1, 2,..., The t value of the RAM 103 or the like is updated, and the t value reaches the final value.
The final value can be determined as the time when the sound produced by the virtual sounding body determined in advance by the game data is completed. Therefore, the process ends when the t value reaches a predetermined constant value. Further, when the game is terminated halfway due to the user's will, for example, when the game is interrupted, the t value when the will display is accepted is the final value.

  As described above, the audio output process according to this embodiment can be performed simply by updating the t value with a simple calculation formula including the expansion ratio c. Accordingly, the processing speed is increased, and the processing can proceed without causing inconvenience due to time delay.

  Next, the flow of circuit signals in this embodiment will be described with reference to the circuit diagrams showing the circuit configurations of FIGS.

The sound output from the right speaker is processed according to the circuit configuration shown in FIGS.
That is, the received original audio signal L0 and the expansion ratio c calculated by the expansion ratio calculation unit 203 are input to the multiplication adder 1201, and (1 + c) × L0 is calculated.
Also, the original audio signal R0 and the expansion ratio c are input to the multiplication adder 1202, and (1−c) × R0 is calculated. Then, each calculation result is added by an adder 1203.
Further, the result of the above addition is multiplied by 1/2 by a multiplier 1204 to output an intermediate audio signal L1.

As shown in FIG. 13, the intermediate audio signal L <b> 1 output by the above-described circuit and the upper limit value or the lower limit value M are input to comparators 1301, 1302, and 1303.
If the comparator 1301 satisfies the condition of M <L1, the results L2 = M and L3 = L1-M are output.
If the comparator 1302 satisfies the condition −M ≦ L1 ≦ M, the result L2 = L1, L3 = 0 is output.
If the comparator 1303 satisfies the condition of L1 <−M, the result of L2 = −M and L3 = L1 + M is output.

  The results of the comparators 1301, 1302, and 1303 are added by the adder 1304, and the finally obtained results are output as the second intermediate audio signal L2 and the third intermediate audio signal L3.

Similarly, the sound output from the left speaker is processed by the circuit configuration shown in FIGS.
That is, the received original audio signal L0 and the expansion ratio c calculated by the expansion ratio calculation unit 203 are input to the multiplication adder 1401, and (1-c) × L0 is calculated.
The original audio signal R0 and the expansion ratio c are input to the multiplication adder 1402, and (1 + c) × R0 is calculated. Each calculation result is added by an adder 1403.
Further, the multiplier 1404 multiplies 1/2 and outputs an intermediate audio signal R1.

As shown in FIG. 15, the intermediate audio signal R1 calculated by the above circuit and the upper limit value or the lower limit value M are input to the comparators 1501, 1502, 1503.
If the comparator 1501 satisfies the condition of M <L1, the results L2 = M and L3 = L1-M are output.
If the comparator 1502 satisfies the condition of −M ≦ L1 ≦ M, the result L2 = L1, L3 = 0 is output.
If the comparator 1503 satisfies the condition of L1 <−M, the result of L2 = −M and L3 = L1 + M is output.

  The results of the comparators 1501, 1502, and 1503 are added by the adder 1504, and the finally obtained results are output as the second intermediate audio signal R2 and the third intermediate audio signal R3.

Further, as in the circuit configuration shown in FIG. 16, the second intermediate audio signals L2 and R2 and the third intermediate audio signals L3 and R3 obtained by the above-described circuit configuration are input to the subtracters 1601 and 1602. Output audio signals L4 and R4 are output.
The output audio signals L4 and R4 are converted from a digital signal to an analog signal via a D / A converter and output as sound from a speaker.

FIG. 17 shows a conceptual diagram when stereo sound is output using this embodiment.
The original audio signals L0 and R0 input to the game apparatus 200 reach the right speaker 1702 and the left speaker 1703 through the audio processing in this embodiment, and are output as audio signals L4 and R4.

  The range in which the sound of the user 1701 can be heard can be shown as a range of a sound field as indicated by a dotted line in FIG. The inner sound field 1 (1705) indicates a case where the c value is small, and the outer sound field 2 (1704) indicates a case where the c value is large.

  When the c value is small, as shown by the sound field 1 (1705), the sound environment is expressed when the room is large, when the sounding body is small, or when the area where a plurality of sounding bodies are placed is narrow. be able to.

  When the c value is large, as shown by the sound field 2 (1704), the sound environment is expressed when the room is small, the sound generator is large, or the area where a plurality of sound generators are placed is wide. can do.

  The present invention has an object of calculating the expansion ratio c according to the environment information and performing a simple process as shown in the above embodiment. The environmental information is environmental information related to the game environment such as the size of the sounding body and the size of the room, and it is assumed that the expansion ratio c is constant for each sounding body. there were.

  The present invention can also be applied to a case where the c value is continuously changed in environmental information in which the sounding body moves.

For example, by continuously changing the expansion ratio c, it is possible to change the sound from the sounding body so that it is gradually lateralized from the front. At this time, the user hears the sound moving sideways from the front as the c value changes continuously.
Such a continuously changing expansion ratio c can also be applied to the game specification. For example, it is used for operating the input device when the sound gradually moves sideways from the front and is heard sideways. Can do.

  As described above, it is possible to provide a game apparatus, a game processing method, and a program for realizing these in a computer that can easily perform sound image localization control in a virtual space where a virtual listening point and a virtual sounding body are arranged. Can do.

100 Information processing apparatus 101 CPU
102 ROM
103 RAM
104 Interface 105 Controller 106 External Memory 107 DVD-ROM Drive 108 Image Processing Unit 109 Audio Processing Unit 110 NIC
200 game device 201 storage unit 202 reception unit 203 expansion ratio calculation unit 204 intermediate calculation unit 205 left calculation unit 206 right calculation unit 207 output calculation unit 208 audio output unit 801 virtual space 802 virtual sound generator 803 region A
804 Virtual space 805 Virtual sound generator 806 area B
1001 Virtual space 1002 Virtual sound generator 1003 Virtual sound generator 1004 Virtual space 1201 Multiplier adder 1202 Multiplier adder 1203 Adder 1204 Multiplier 1301 Comparator 1302 Comparator 1303 Comparator 1304 Multiplier 1401 Multiplier adder 1402 Multiplier adder 1403 Addition 1404 Multiplier 1501 Comparator 1502 Comparator 1503 Comparator 1504 Adder 1601 Subtractor 1602 Subtractor 1701 User 1702 Speaker 1703 Speaker 1704 Sound field 2
1705 Sound field 1

Claims (6)

A storage unit for storing virtual listening points and environment information of a virtual space in which a virtual sound generator is arranged;
The left sample value L0 (t) and the right sample value R0 (t) (-M ≦ L0) at the time t of the original sound assumed to be obtained when the virtual sound emitted by the virtual sound generator is listened to under a predetermined listening condition (t) ≦ M, -M ≦ R0 (t) ≦ M) receiving unit for receiving input,
An expansion ratio calculation unit that calculates the received original voice expansion ratio c (0 ≦ c ≦ 2) from the environment information stored in the storage unit;
From the received left sample value L0 (t) and right sample value R0 (t) of the original speech and the calculated expansion ratio c, the left sample value L1 (t) and right sample of the first intermediate speech The value R1 (t)
L1 (t) = [(1 + c) × L0 (t) + (1-c) × R0 (t)] / 2;
R1 (t) = ((1-c) x L0 (t) + (1 + c) x R0 (t)) / 2
An intermediate calculation unit to calculate by
The left sample value L2 (t) of the second intermediate speech and the left sample value of the third intermediate speech are compared by comparing the left sample value L1 (t) of the first intermediate speech with the upper limit value M and the lower limit value -M. L3 (t)
L2 (t) = L1 (t), L3 (t) = 0 (-M ≦ L1 (t) ≦ M);
L2 (t) = M, L3 (t) = L1 (t) -M (M <L1 (t));
L2 (t) = -M, L3 (t) = L1 (t) + M (L1 (t) <-M)
Left calculation part, calculated by
The right sample value R1 (t) of the first intermediate voice is compared with the upper limit value M and the lower limit value -M, and the right sample value R2 (t) of the second intermediate voice and the third intermediate voice value are compared. The right sample value R3 (t)
R2 (t) = R1 (t), R3 (t) = 0 (-M ≦ R1 (t) ≦ M);
R2 (t) = M, R3 (t) = R1 (t) -M (M <R1 (t));
R2 (t) = -M, R3 (t) = R1 (t) + M (R1 (t) <-M)
Right calculation part, calculated by
Output sample left sample value L4 (t) and right sample value R4 (t),
L4 (t) = L2 (t)-R3 (t);
R4 (t) = R2 (t)-L3 (t)
Output calculation unit to calculate by
A game apparatus comprising: an audio output unit that outputs stereo output of the left sample value L4 (t) and the right sample value L4 (t) of the output audio. The game device according to claim 1,
The environment information includes the size of the virtual sounding body,
When the size of the virtual sounding body increases, the expansion ratio c increases. The game device according to claim 1,
A plurality of the virtual sounding bodies are arranged in the virtual space,
The original sound is a sound that is assumed to be obtained when listening to virtual sound generated by all of the plurality of virtual sounding bodies under the predetermined listening condition,
The environment information includes a width of an area where the plurality of virtual sounding bodies are arranged,
The game device is characterized in that the expansion ratio c increases as the area increases. The game device according to claim 1,
The environmental information includes the size of the room surrounding the virtual listening point and the virtual sounding body,
The game device, wherein the expansion ratio c increases as the size of the room decreases. A game processing method executed on a game device,
The game device includes a storage unit, a reception unit, an expansion ratio calculation unit, an intermediate calculation unit, a left calculation unit, a right calculation unit, an output calculation unit, and an audio output unit.
A storage step in which the storage unit stores environment information of a virtual space in which a virtual listening point and a virtual sounding body are arranged;
The left sample value L0 (t) and the right sample value R0 (t) at the time t of the original sound assumed to be obtained when the reception unit listens to the virtual sound emitted by the virtual sound generator under a predetermined listening condition. -M ≦ L0 (t) ≦ M, -M ≦ R0 (t) ≦ M)
An expansion ratio calculation unit calculates an expansion ratio c (0 ≦ c ≦ 2) of the received original voice from the environment information stored in the storage unit,
The intermediate calculation unit calculates the left sample value L1 (1) of the first intermediate voice from the received left sample value L0 (t) and right sample value R0 (t) of the received original voice and the calculated expansion ratio c. t) and the right sample value R1 (t),
L1 (t) = [(1 + c) × L0 (t) + (1-c) × R0 (t)] / 2;
R1 (t) = ((1-c) x L0 (t) + (1 + c) x R0 (t)) / 2
An intermediate calculation process to calculate according to
The left calculation unit compares the left sample value L1 (t) of the first intermediate sound with the upper limit value M and the lower limit value -M, and determines the left sample value L2 (t) of the second intermediate sound and the third intermediate value. The left sample value L3 (t) of the voice is
L2 (t) = L1 (t), L3 (t) = 0 (-M ≦ L1 (t) ≦ M);
L2 (t) = M, L3 (t) = L1 (t) -M (M <L1 (t));
L2 (t) = -M, L3 (t) = L1 (t) + M (L1 (t) <-M)
The left calculation process to calculate by,
The right calculation unit compares the right sample value R1 (t) of the first intermediate voice with the upper limit value M and the lower limit value -M, and compares the right sample value R2 (t) of the second intermediate voice and the The right sample value R3 (t) of the third intermediate voice is
R2 (t) = R1 (t), R3 (t) = 0 (-M ≦ R1 (t) ≦ M);
R2 (t) = M, R3 (t) = R1 (t) -M (M <R1 (t));
R2 (t) = -M, R3 (t) = R1 (t) + M (R1 (t) <-M)
The right calculation process to calculate according to
The output calculation unit outputs the left sample value L4 (t) and the right sample value R4 (t) of the output speech,
L4 (t) = L2 (t)-R3 (t);
R4 (t) = R2 (t)-L3 (t)
An output calculation process to calculate according to
The audio output unit outputs a left sample value L4 (t) and a right sample value L4 (t) of the output audio, and outputs a stereo sound,
A game processing method comprising: A program for causing a computer to function as a game device, the program storing the computer in which virtual listening points and environment information of a virtual space in which a virtual sounding body is arranged are stored,
The left sample value L0 (t) and the right sample value R0 (t) (-M ≦ L0) at the time t of the original sound assumed to be obtained when the virtual sound emitted by the virtual sound generator is listened to under a predetermined listening condition (t) ≦ M, -M ≦ R0 (t) ≦ M) receiving unit for receiving input,
An expansion ratio calculation unit that calculates the received original voice expansion ratio c (0 ≦ c ≦ 2) from the environment information stored in the storage unit;
From the received left sample value L0 (t) and right sample value R0 (t) of the original speech and the calculated expansion ratio c, the left sample value L1 (t) and right sample of the first intermediate speech The value R1 (t)
L1 (t) = [(1 + c) × L0 (t) + (1-c) × R0 (t)] / 2;
R1 (t) = ((1-c) x L0 (t) + (1 + c) x R0 (t)) / 2
An intermediate calculation unit to calculate by
The left sample value L2 (t) of the second intermediate speech and the left sample value of the third intermediate speech are compared by comparing the left sample value L1 (t) of the first intermediate speech with the upper limit value M and the lower limit value -M. L3 (t)
L2 (t) = L1 (t), L3 (t) = 0 (-M ≦ L1 (t) ≦ M);
L2 (t) = M, L3 (t) = L1 (t) -M (M <L1 (t));
L2 (t) = -M, L3 (t) = L1 (t) + M (L1 (t) <-M)
Left calculation part, calculated by
The right sample value R1 (t) of the first intermediate voice is compared with the upper limit value M and the lower limit value -M, and the right sample value R2 (t) of the second intermediate voice and the third intermediate voice value are compared. The right sample value R3 (t)
R2 (t) = R1 (t), R3 (t) = 0 (-M ≦ R1 (t) ≦ M);
R2 (t) = M, R3 (t) = R1 (t) -M (M <R1 (t));
R2 (t) = -M, R3 (t) = R1 (t) + M (R1 (t) <-M)
Right calculation part, calculated by
Output sample left sample value L4 (t) and right sample value R4 (t),
L4 (t) = L2 (t)-R3 (t);
R4 (t) = R2 (t)-L3 (t)
Output calculation unit to calculate by
The left sample value L4 (t) and the right sample value L4 (t) of the output sound, a sound output unit for outputting stereo sound,
A program characterized by functioning as

Images