JP3617839B2 - GAME SOUND CONTROL PROGRAM, GAME SOUND CONTROL METHOD, AND GAME DEVICE - Google Patents

Description

  The present invention relates to a game sound control program, a game sound control method, and a game apparatus, and in particular, includes, for example, an operation means for inputting operation information by a player, and the game is advanced in accordance with the operation of the operation means. The present invention relates to a game sound control program, a game sound control method, and a game apparatus that display a game screen including an object and generate a sound related to the game screen.

  Generally, in a game developed in a virtual three-dimensional space, for example, when a torch or the like is displayed, a character (player character) operated by the player approaches a sound object that generates sound, such as a torch. Then, the process of increasing the torsion noise is performed. At this time, if a plurality of torches exist around the player character, the sound source is sounded by the number of torches to reproduce the torches burning sound. However, when the number of pronunciations of the sound source exceeds the maximum number of simultaneous pronunciations, priorities are assigned, for example, tones are not emitted for torches located far away, thereby saving the number of pronunciations of the sound source.

  Also, in such a game, if the torch is in front of the screen diagonally to the right, increasing the right volume of the sound source and lowering the left volume will make the sound of the torch sound heard from the diagonally right front. I was processing. Furthermore, if it is possible to process the surround component, it is possible to process the sound as if the sound of a torch is sounding from behind the player or surrounded by the sound.

An example of the prior art is disclosed in Patent Document 1. In the sound reproduction device disclosed in Patent Document 1, all the sound objects arranged by a rotation axis obtained by rotating the axis extending in front of the listener's face at a predetermined angle with the position of the listener's head as the origin. The sound of one or a plurality of sound objects included in one group is generated by only one sound generation of the sound source by dividing into several groups.
Japanese Unexamined Patent Publication No. 2000-13900 (pages 5 to 6, FIGS. 1 to 6)

  However, as in the former case, in order to save sound sources by assigning priorities, sounds that are desired as the atmosphere of the sound field (virtual three-dimensional space), such as environmental sounds, are erased. In other words, there was a problem that the realism of the game disappeared. Also, when there were torches on the left and right, if only the sound of the right torches were turned off, there was a sense of incongruity that only the left torches made a burning sound against the left and right torches.

  In the latter case, in order to determine the direction for grouping, it is necessary to obtain the angle with respect to the position where the sound is collected for all the objects that generate the sound. Therefore, the calculation processing is enormous and the processing load is large. There is a problem that a delay occurs in the original game processing.

  SUMMARY OF THE INVENTION Therefore, a main object of the present invention is to provide a novel storage medium storing a game sound control program, a game sound control method, and a game apparatus.

  Another object of the present invention is to provide a storage medium storing a game sound control program, a game sound control method, and a game apparatus that can efficiently use a sound source.

According to the first aspect of the present invention, there is provided a computer of a game apparatus comprising operating means, object storage means, image display control means, speakers, waveform data storage means, sound generation position data storage means, sound output control means, and microphone data storage means. A game sound control program to be executed.

The operation means inputs operation information by the player. The object storage means stores objects constituting the game image. The image display control means displays a game image including at least two objects based on operation information by the player input by the operation means. Speaker provided two left right, and outputs the sound. The waveform data storage means is a sound object in which at least two objects constituting the game image generate sound, and stores at least one type of waveform data corresponding to the sound generated by the sound object. The sound generation position data storage means stores sound generation position data indicating the sound generation position for each sound object. Sound output control means, in accordance with an output indication of at least sound, reads the waveform data to generate sound data, output from the speaker the generated sound data as sound. The microphone data storage means stores microphone data including at least sound collection position data indicating a position where sound is collected during the game and sound collection direction data indicating a sound collection direction.

The game sound control program includes a volume data calculation step, a localization calculation step, a volume component division step, an object classification step , a sound output data generation step, and a sound output instruction step .

In the sound volume data calculating step, for each sound object, the distance between the sound object and the sound collection position is calculated from the sound generation position data and the sound collection position data, and the sound volume generated by the sound object based on the calculated distance is calculated. Calculate the data. The localization calculation step calculates localization data for each sound object based on the sound collection direction data and the sound generation position data. The volume component dividing step divides the volume data of each sound object into a right volume component and a left volume component of the sound output from the speaker based on the localization data calculated by the localization calculation step. The object classification step classifies all sound objects into objects that generate the same sound. The sound output data generation step extracts the maximum right volume component and the maximum left volume component from the right volume component and the left volume component divided by the volume component division step for the object that generates the same sound, and the object The sound output control means generates data for outputting sound from the speaker based on the waveform data and the maximum right volume component and maximum left volume component . The output instruction step gives the sound output control means the sound output instruction and the data generated by the sound output data generation step.

According to the first aspect of the present invention, the game device (12: reference number corresponding to the embodiment; hereinafter the same) is connected to operation means (16, 22) for inputting operation information by the player. Based on the operation information, a game image (80) including at least two objects is displayed by the image display control means (36, S11). The objects (82, 84, 88) constituting the game image (80) are stored in the object storage means (40). For example, at least two objects constituting the game image (80) are sound objects (84, 88) that generate sound, and at least one type of waveform data corresponding to the sound generated by the sound object (84, 88). Is stored in the waveform data storage means (54). The sound of the sound object is output from the left and right speakers (34a, 34a). Further, sound generation position data (722b, 726b, 730b) indicating a sound generation position for each sound object (84, 88) is stored in the sound generation position data storage means (40). Furthermore, microphone data including at least sound collection position data (74a) indicating a position for collecting sound during the game and sound collection direction data (74b) indicating the sound collection direction for collecting sound is stored in the microphone data storage means 74. Remembered. The game sound control program is executed by the processor of the game apparatus having such a configuration. Specifically, the sound volume data calculating step (36, S31) is performed for each sound object (84, 88) from the sound generation position data (722b, 726b, 730b) and the microphone data. The distance between the sound object and the sound collection position is calculated from the data, and the volume data is calculated based on the distance. A localization calculation step (36, S33) calculates localization data for each sound object based on the sound collection direction data and the sound generation position data. Then, the volume component dividing step (36, S43) outputs the volume data calculated by the volume data calculation step (36, S31) from the speakers (34a, 34a) based on the localization data calculated by the localization calculation step. Is divided into a right volume component and a left volume component . The object classification step (36, S39) classifies all sound objects (84, 88) into objects that generate the same sound. When the objects are classified, the sound output data generation step (36, S51) includes the right volume component and the left volume component divided by the volume component dividing step (36, S43) for the object that generates the same sound. The maximum right volume component and the maximum left volume component are extracted, and based on the waveform data of the object and the maximum right volume component and the maximum left volume component , the sound output control means (52) uses the speakers (34a, 34a). ) To generate data for outputting sound. The output instruction step (36, S53) gives the sound output instruction and the data generated in the sound output data generation step (36, S51) to the sound output control means (52). Accordingly, since the sound output control means (52) outputs sound from the speakers (34a, 34a ) based on the generated data, the sounds generated by the classified objects are combined into one speaker (34a). , 34a) .

  According to the first aspect of the invention, the sound of the same type of sound object is output by only one sound generation of the sound source, so that the sound source can be used efficiently.

The invention according to claim 2 is dependent on claim 1, and the sound output data generation step uses the maximum right volume component and the maximum left volume component as they are as the right volume component and left volume component of the output sound.

According to the invention of claim 2, sound output data generating step (36, S51) is the extracted maximum right volume components and maximum left volume components, as, right volume component and left volume component of the sound to be output Therefore, the sound generated by the classified sound object can be output with only one sound generation of the sound source.

According to a third aspect of the present invention, there is provided a game sound control program to be executed by a processor of a game device comprising an operation means, an object storage means, an image display control means, a waveform data storage means, a sound generation position data storage means, and a microphone data storage means. It is.
The operation means inputs operation information by the player. The object storage means stores objects constituting the game image. The image display control means displays a game image including at least two objects based on the operation information. Two left and right speakers are provided to output sound. The waveform data storage means is a sound object in which at least two objects constituting the game image generate sound, and stores at least one type of waveform data corresponding to the sound generated by the sound object. The sound generation position data storage means stores sound generation position data indicating the sound generation position for each sound object. The sound output control means reads waveform data according to at least a sound output instruction, generates sound data, and outputs the generated sound data as sound from a speaker. The microphone data storage means stores microphone data including at least sound collection position data indicating a position where sound is collected during the game and sound collection direction data indicating a sound collection direction.
The sound control program includes a volume data calculation step, a localization calculation step, a volume component division step, an object classification step, a sound output data generation step, and a sound output instruction step.
In the sound volume data calculating step, for each sound object, the distance between the sound object and the sound collection position is calculated from the sound generation position data and the sound collection position data, and the sound volume generated by the sound object based on the calculated distance is calculated. Calculate the data. The localization calculation step calculates localization data for each sound object based on the sound collection direction data and the sound generation position data. The volume component dividing step divides the volume data of each sound object into a right volume component, a left volume component, and a surround volume component of the sound output from the speaker based on the localization data calculated by the localization calculation step. The object classification step classifies all sound objects into objects that generate the same sound. The sound output data generation step includes a maximum right volume component, a maximum left volume component, and a maximum volume among the right volume component, the left volume component, and the surround volume component divided by the volume component division step for objects that generate the same sound. Based on the waveform data of the object and the maximum right volume component, maximum left volume component and maximum surround volume component, the sound output control means extracts data for outputting sound from the speaker. Generate. The output instruction step gives the sound output control means the sound output instruction and the data generated by the sound output data generation step.

According to the third aspect of the present invention, the volume component dividing step (36, S43) performs the volume of the sound generated by the sound object from the sound generation position data (722b, 726b, 730b) and the sound collection direction data (74b). The data is divided into a right volume component, a left volume component and a surround volume component of the sound output from the speakers (34a, 34a) . Therefore, in the sound output data generation step (36, S51), the maximum of the right volume component, the left volume component, and the surround volume component divided by the volume component dividing step (36, S43) is calculated for the objects that generate the same sound. The right volume component, maximum left volume component, and maximum surround volume component are extracted, and the sound output is based on the waveform data of the object and the maximum right volume component, maximum left volume component, and maximum surround volume component. The control means (52) can generate data for outputting sound from the speakers (34a, 34a).

The invention of claim 4 is dependent on claim 3, and the sound generation position data is represented by position data of a sound object represented by one coordinate data and rail data defined by at least two coordinate data. It includes the position data of the sound object with rail data, and for the sound object with rail data, calculates the coordinate data of the position closest to the sound collection position data on the line connecting the coordinates representing the rail data. The proximity coordinate calculation step and the volume data calculation step calculate the volume data of the sound object from the coordinate data calculated by the proximity coordinate calculation step and the sound collection position data when calculating the volume data of the sound object having rail data. In the volume component dividing step, the proximity coordinate calculating step From the coordinate data and satellite position data calculated by the right volume component of the sound output from the speaker, to divide the volume data to each of the left volume components and surround sound components.

According to the invention of claim 4, the sound generation position data includes the position data of a sound object at a point represented by one coordinate data and the position data of a sound object having rail data defined by at least two coordinate data. Including a proximity coordinate calculation step for calculating coordinate data of a position that is on a line connecting the coordinates representing the rail data and that is closest to the sound collection position data, for a sound object having rail data, The calculation step calculates the volume data of the sound object from the coordinate data calculated by the proximity coordinate calculation step and the sound collection position data when calculating the volume data of the sound object having rail data, and the volume component division step The coordinate data calculated by the proximity coordinate calculation step And a data and satellite position data, the right volume component of the sound output from the speaker, to divide the volume data to each of the left volume components and surround sound components.

Specifically, the sound generation position data (722b, 726b, 730b) is represented by the position data (722b, 726b) of the sound object represented by one coordinate data and rail data defined by at least two coordinate data. Position data (730b) of the rail data sound object to be played. The proximity coordinate calculation step (36, S63) calculates the coordinate data of the position closest to the sound collection position data (74a) on the line segment representing the rail data for the sound object (88) having the rail data. . In the sound volume data calculating step (36, S31), when calculating sound volume data of a sound object having rail data, the sound object is calculated from the coordinate data calculated by the proximity coordinate calculating step (36, S63) and the microphone data. The volume data of (88) is calculated. That is, on the line segment of the rail data, the sound object sound is assumed to be present at the position closest to the sound collection position data (74a), and the sound volume data of the sound is calculated to reduce the number of sounds of the sound source. doing. Therefore, in the volume component dividing step (36, S43), when dividing the volume data of the sound object (88) having rail data into components, the coordinate data calculated by the proximity coordinate calculating step (36, S63) and the sound collection are obtained. The direction data (74b) is divided into a right volume component, a left volume component and a surround volume component of the sound output from the speakers (34a, 34a) . In other words, the rail data defined by at least two coordinate data is regarded as the sound of the sound object and the number of sound generations of the sound source is reduced, so that it is handled in the same way as when there are multiple sound objects represented by one coordinate data. Can do.

According to a fifth aspect of the present invention, there is provided a computer of a game apparatus comprising operating means, object storage means, image display control means, speakers, waveform data storage means, sound generation position data storage means, sound output control means, and microphone data storage means. A game sound control method to be executed.

The operation means inputs operation information by the player. The object storage means stores objects constituting the game image. The image display control means displays a game image including at least two objects based on operation information by the player input by the operation means. Speaker outputs sound, are left right two provided. The waveform data storage means is a sound object in which at least two objects constituting the game image generate sound, and stores at least one type of waveform data corresponding to the sound generated by the sound object. The sound generation position data storage means stores sound generation position data indicating the sound generation position for each sound object. The sound output control means reads waveform data according to at least a sound output instruction, generates sound data, and outputs the generated sound data as sound from a speaker. The microphone data storage means stores microphone data including at least sound collection position data indicating the position at which sound is collected during the game and sound collection direction data indicating the sound collection direction in which sound is collected.

In the game sound control method, (a) for each sound object, the distance between the sound object and the sound collection position is calculated from the sound generation position data and the sound collection position data, and the sound object is generated based on the calculated distance. Calculate sound volume data, (b) calculate localization data for each sound object based on the sound collection direction data and sound generation position data, and (c) based on the localization data calculated in step (b) The volume data of each sound object is divided into the right volume component and the left volume component of the sound output from the speaker , (d) all sound objects are classified into objects that generate the same sound, and (e) Of the right volume component and left volume component divided in step (c) for objects that generate the same sound, the largest right volume component and Extracting the maximum left volume components, based on the waveform data and the maximum of the right volume components and the maximum of the left volume component of the object, the sound output control means generates data for outputting the sound from the speaker, and (f) A sound output instruction and the data generated in step (e) are given to the sound output control means.

The invention of claim 9 is provided with operation means for inputting operation information by the player, and the game is advanced according to the operation of the operation means to display a game screen including at least two objects and to output a sound. from left to right two speakers it is configured game device to generate a sound associated with the game screen. This game apparatus includes waveform data storage means, sound generation position data storage means, sound output control means, microphone data storage means, volume data calculation means, localization calculation means, volume component division means, object classification means, sound output data generation means , And output instruction means.

In the invention of claim 5 and claim 9 as well, as in the invention of claim 1, since the number of sound generation of the sound source can be reduced, the sound source can be used efficiently.

  According to the present invention, since the sound generation sources are grouped into one for the same type of sound object, the sound source can be used efficiently.

  In addition, according to the present invention, when the sound sources are combined into one, it is possible to combine them without a sense of incongruity, so that it is possible to make the player feel uncomfortable or unnatural while using the sound source efficiently. Absent.

  The above object, other objects, features and advantages of the present invention will become more apparent from the following detailed description of embodiments with reference to the drawings.

  Referring to FIG. 1, the video game system 10 of this embodiment includes a video game apparatus 12. The video game apparatus 12 includes a substantially cubic housing 14 and includes an optical disk drive 16 at the upper end of the housing 14. An optical disk 18 which is an example of an information storage medium storing a game program or the like is mounted on the optical disk drive 16. A plurality of (four in the embodiment) connectors 20 are provided on the front surface of the housing 14. These connectors 20 are for connecting the controller 22 to the video game apparatus 12 by a cable 24. In this embodiment, a maximum of four controllers 22 can be connected to the video game apparatus 12.

  The controller 22 includes operation means (control) 26 on its upper surface, lower surface, or side surface. The operation means 26 includes, for example, two analog joysticks, one cross key, a plurality of button switches, and the like. One analog joystick is used to input the moving direction and / or moving speed or moving amount of the player character (moving image character that the player can operate with the controller 22) according to the tilt amount and direction of the stick. Other analog joysticks control the movement of the virtual camera according to the tilt direction. The cross switch is used to instruct the moving direction of the player character instead of the analog joystick. The button switch is used for instructing the action of the player character, switching the viewpoint of the virtual camera of the three-dimensional image, and adjusting the moving speed of the player character. The button switch is further used to control menu selection and pointer or cursor movement, for example.

  Below the connector 20 on the front surface of the housing 14 of the video game apparatus 12, at least one (two in this embodiment) memory slot 28 is provided. A memory card 30 is inserted into the memory slot 28. The memory card 30 loads and temporarily stores a game program or the like read from the optical disc 18, or saves (saves) game data (for example, game results) of a game played using the game system 10. It is used for storing.

  The rear surface of the housing 14 of the video game apparatus 12 includes an AV cable connector (not shown), and a monitor 34 is connected to the video video game apparatus 12 through the AV cable 32 via the connector. The monitor 34 is typically a color television receiver, and the AV cable 32 inputs a video signal from the video game apparatus 12 to a video input terminal of the color television, and an audio signal is input to the audio input terminal. . Therefore, for example, a game image of a three-dimensional (3D) video game is displayed on the screen of the color television (monitor) 34, and stereo game sounds such as game music and sound effects from the left and right speakers 34a, or two speakers. When a surround effect can be produced, game sound including surround sound is output.

  In this game system 10, in order for a user or game player to play a game (or other application), the user first turns on the game device 12 and then the user plays a video game (or other game that he / she wishes to play). An appropriate optical disk 18 storing the application) is selected, and the optical disk 18 is loaded into the disk drive 16 of the game apparatus 12. In response, the game device 12 starts to execute a video game or other application based on the software stored on the optical disc 18. The user operates the controller 22 to give input to the game apparatus 12. For example, a game or other application is started by operating any of the operation means 26. By moving the other operation means 26, the moving image character (player character) can be moved in different directions, or the user's viewpoint (camera position) in the three-dimensional (3D) game world can be changed.

  FIG. 2 is a block diagram showing an electrical configuration of the video game system 10 of FIG. 1 embodiment. The video game apparatus 12 includes a central processing unit (hereinafter referred to as “CPU”) 36. The CPU 36 is also called a computer or a processor, and is responsible for overall control of the video game apparatus 12. The CPU 36 or the computer functions as a game processor, and a memory controller 38 is connected to the CPU 36 via a bus. The memory controller 38 mainly controls writing and reading of the main memory 40 coupled via the bus under the control of the CPU 36. A GPU (Graphics Processing Unit) 42 is connected to the memory controller 38.

  The GPU 42 forms part of the drawing means, and is constituted by, for example, a single chip ASIC. The GPU 42 receives a graphics command (graphics command) from the CPU 36 via the memory controller 38, and the geometry unit 44 and the rendering according to the command. A unit 46 generates a three-dimensional (3D) game image. In other words, the geometry unit 44 rotates and moves various characters and objects (consisting of a plurality of polygons. The polygon is a polygonal plane defined by at least three vertex coordinates) in a three-dimensional coordinate system. , Perform coordinate calculation processing such as deformation. The rendering unit 46 performs image generation processing such as pasting a texture (Texture: pattern image) on each polygon of various objects. Therefore, 3D image data to be displayed on the game screen is created by the GPU 42, and the image data (texture data) is drawn (stored) in the frame buffer 48.

  Note that data (primitives, polygons, textures, etc.) necessary for the GPU 42 to execute the drawing command is obtained by the GPU 42 accessing the main memory 40 via the memory controller 38.

  The frame buffer 48 is a memory for drawing (accumulating) image data for one frame of the raster scan monitor 34, for example, and is rewritten frame by frame by the GPU. A video I / F 58 described later reads data from the frame buffer 48 via the memory controller 38, whereby a 3D game image is displayed on the screen of the monitor 34.

  The Z buffer 50 has a storage capacity corresponding to the number of pixels (storage position or address) corresponding to the frame buffer 48 × the number of bits of depth data per pixel, and corresponds to each storage position of the frame buffer 48. Dot depth information or depth data (Z value) is stored.

  Note that both the frame buffer 48 and the Z buffer 50 may be configured using part of the main memory 40.

  The memory controller 38 is also connected to the ARAM 54 via a DSP (Digital Signal Processor) 52. Therefore, the memory controller 38 controls writing and / or reading of not only the main memory 40 but also the ARAM 54 as a sub memory.

  The DSP 52 functions as a sound processor, and accesses the sound data (see FIG. 3) stored in the main memory 40 or accesses the sound waveform data (see FIG. 6) written in the ARAM 54 to play the game. Audio data corresponding to the necessary sound, voice or music is generated. For example, in this embodiment, the DSP 52 generates audio data corresponding to sounds generated by sound objects such as “torches” and “rivers”, which will be described in detail later, using sound waveform data.

  The memory controller 38 is further connected to each interface (I / F) 56, 58, 60, 62 and 64 by a bus. The controller I / F 56 is an interface for the controller 22, and sends an operation signal or data of the operation means 26 of the controller 22 to the CPU 36 through the memory controller 38. The video I / F 58 accesses the frame buffer 48, reads out image data created by the GPU 42, and sends an image signal or image data (digital RGB pixel value) to the monitor 34 via the AV cable 32 (FIG. 1).

  The external memory I / F 60 connects the memory card 30 (FIG. 1) inserted in the front surface of the game apparatus 12 to the memory controller 38. Thereby, the CPU 36 can write data to the memory card 30 or read data from the memory card 30 via the memory controller 38. The audio I / F 62 sends the audio data supplied from the DSP 52 through the memory controller 38 or the audio stream read from the optical disc 18 to the speaker 34a of the monitor 34 as an audio signal (audio signal) corresponding to the audio data.

  In the case of stereo sound, at least one speaker 34a is provided on each of the left and right speakers. In addition, by performing the surround processing, it is possible to let the sound be heard as if the sound is generated from the rear even with only the two left and right speakers.

  Then, the disk I / F 64 connects the disk drive 16 to the memory controller 38, and thus the CPU 36 controls the disk drive 16. Program data, texture data, and the like read from the optical disk 18 by the disk drive 16 are written into the main memory 40 under the control of the CPU 36.

  FIG. 3 is a memory map of the main memory 40. The main memory 40 includes a program area 70, an object data storage area 72, a microphone data storage area 74, and a sound output control data storage area 76. In the program storage area 70, the game program read from the optical disk 18 is stored once or partially and sequentially. In this embodiment, the game program includes a game main processing program 70a, an image processing program 70b, a sound control processing program 70c, and the like.

  In the object data storage area 72, for example, data about non-player objects such as object A (torches 1) data 72a, object B (torches 2) data 72b and object C (river 1) data 72c are read from the optical disc 18. Issued and loaded. Although not shown, game character data such as player character object data and enemy character object data and game world (map) data are also loaded into the storage area 72.

  Each object data such as the object A data 72a, the object B data 72b, and the object C data 72c is formed by polygons.

  The main memory 40 may be loaded with data such as each character and object from the optical disc 18 as necessary.

  In the microphone data storage area 74, coordinate data (sound collection position data) 74a indicating the position (sound collection position) in the game world of the virtual microphone 86 (see FIG. 8) provided together with the virtual camera, and corresponding to the position in advance. Sound collection direction data 74b indicating the sound collection direction of the determined virtual microphone 86 is read from the optical disc 18 and loaded.

  The sound output control data storage area 76 stores sound data such as sound A data 760 and sound B data 762. However, these sound data are data calculated by a sound control process described later. In this embodiment, the sound A data 760 is sound data for “torches” and includes localization data 760a and volume data 760b. In this embodiment, the sound B data 762 is sound data for “river”, and includes localization data 762a and volume data 762b. The localization data is data indicating the direction in which an object (torches or rivers) in the game world generates sound, and the volume data is data indicating the volume of sounds generated by the objects (torches or rivers).

  Although illustration is omitted, the sound output control data storage area 76 is loaded and written with data such as sound, music and voice necessary for the game.

  Further, as shown in FIG. 4, the sound control processing program 70c includes a volume data calculation program 700, a localization calculation program 702, an object classification program 704, a volume data component calculation program 706, a maximum volume component data extraction program 708, and rail data proximity. A coordinate calculation program 710 is included. However, these programs are not executed separately, but are executed along a series of flows as described later (see FIGS. 14 and 15).

  Further, the object A data 72a to the object C data 72c are configured as shown in FIG. The object A data 72a includes image display data 720 for displaying the object A (torches 1) on the monitor 34, and sound data 722 for outputting sounds generated by the objects A (torches 1) from the speakers 34a. .

  The sound data 722 includes sound designation data 722a, coordinate data 722b, volume data 722c, and sound priority data 722d. The sound designation data 722a is index data for designating (selecting) sound waveform data to be used from a plurality of sound waveform data (see FIG. 6) stored in the ARAM 54 when outputting the sound generated by the object A. It is. The coordinate data 722b indicates the position in the game world where the object A exists, and is represented by three-dimensional coordinates in this embodiment.

  However, the object A is a torch, and such a torch is arranged at a predetermined position in the game world. Therefore, in this case, the coordinate data indicates the position of the sound of the sound object.

  The volume data 722c is data indicating the volume of the sound generated by the object A. The sound priority data 722d includes a plurality of objects (sound objects) in the game world displayed on one screen of the monitor 34, and the number of sound sources that can be used, that is, the maximum simultaneous sound that the DSP 52 can use. When the number is exceeded, the sound object is compared with other sound objects to determine whether or not to generate sound. In other words, when the number of pronunciations of the sound source is insufficient, the sound of the sound object with a low priority is not emitted.

  The object B data 72b includes image display data 724 and sound data 726. Since the object B (torches 2) is the same type of object data as the objects A (torches 1), the image display data 724 and the sound data 726 are the same as described above. However, since object B is arranged at a different position in the game world from object A, the contents of coordinate data 726b, volume data 726c, and sound priority data 726d of sound data 726 differ accordingly.

  The sound designation data 726a is the same data as the sound designation data 722a because the object A and the object B are the same type of sound object.

  The object C data 72c includes image display data 728 for displaying the object C (river 1) on the monitor 34 and sound data 730 for outputting the sound generated by the object C (river 1) from the speaker 34a. . Similarly to the objects A and B, the sound data 730 includes sound designation data 730a, coordinate data 730b, volume data 730c, and sound priority data 730d. The contents of each data are substantially the same as the data for the object A and the object B, but the object C is “river” and the sound waveform data used is different from that of the torches, so the contents of the sound designation data 730a are different. . Further, since the sound of a plurality of sound objects is provided along the river flow in the object C, a plurality of coordinates are described in the coordinate data 730b. That is, rail data defined by at least two or more coordinate data is stored. The volume data 730 stores volume data corresponding to each rail (see FIG. 12) determined by the rail data.

  The sound wave data as described above is loaded and written from the optical disk 18 to the sound wave data storage area, in this embodiment, the ARAM 54 as a sub memory. As shown in FIG. 6, for example, the ARAM 54 stores sound waveform A data 54 a for torches burning sound, sound waveform B data 54 b for river flowing sounds, sound waveform C data 54 c for wave sounds, and the like. Is done. Although illustration is omitted, sound waveform data for other sound objects is also stored. The DSP 52 accesses any one or two or more of the sound waveform data 54a, 54b, 54c,... Under the instruction of the CPU 36, and generates audio data of the sound generated by the sound object. The generated audio data is converted into an audio signal by the audio I / F 62 and then output to the speaker 34a.

  In FIG. 7, when the game screen 80 is displayed on the monitor 34 and the game screen 80 is displayed, the sound object sound (sound of torches) output from the left and right speakers 34 a and the surround speakers is displayed. Is schematically shown. However, the example shown in FIG. 7 shows a case where sound is output using three torches as sound objects. The player or user is located in front of the game screen 80 (monitor 34) and surrounded by the left and right speakers 34a and the surround speakers.

  On the game screen 80, the player object 82 is arranged on the lower side of the center of the screen and stands to face the player. A torch 84a is arranged behind the player object 82, a torch 84b is arranged diagonally to the left of the player object 82, and a torch 84c is arranged diagonally to the right of the player object 82. Further, considering only the depth direction of the game screen 80, the torches 84a are arranged in the foreground, the torches 84b are arranged next, and the torches 84c are arranged in the back. Further, considering only the horizontal direction (width direction) of the game screen 80, a torch 84 a is arranged on the right side of the game screen 80, a torch 84 b is arranged on the left side of the game screen 80, and a torch 84 c is arranged at the approximate center of the game screen 80. Is placed.

  Such a game screen 80 is generated and drawn (displayed) on the monitor 34 based on a video (image) photographed by a virtual camera provided so as to be movable in the game world. As shown in FIG. 8, in the game world, the player object 82, the torches 84a to 84c, and the virtual microphone 86 each have a positional relationship represented by three-dimensional coordinates. This is determined by the coordinate data (FIG. 5) included in the object data described above. For example, the player object 82 exists at a position indicated by three-dimensional coordinates (xp, yp, zp). In addition, the torches 84a, torches 84b, and torches 84c exist at positions indicated by three-dimensional coordinates (x1, y1, z1), (x2, y2, z2) and (x3, y3, z3), respectively. Furthermore, the virtual microphone 86 exists at a position indicated by three-dimensional coordinates (xm, ym, zm).

  For convenience of drawing, the virtual camera is not shown, but in this embodiment, it exists at the same position as the virtual microphone 86.

  As described above, the game screen 80 displays the video (image) captured by the virtual camera on the monitor 34. By converting the world coordinate system of the game world into three-dimensional camera coordinates, the virtual camera is captured. An image about the direction is displayed.

  That is, as shown in FIG. 9, the shooting direction of the virtual camera, that is, the sound collection direction of the virtual microphone 86 is determined on a line connecting the player character 82 and the virtual microphone 86, and the line is determined as the Z ′ axis. However, the sound collection direction of the virtual microphone 86 is determined by the sound collection direction data 74b stored corresponding to the coordinate data 74a stored in the microphone data storage area 74 as described above. Further, an axis obtained by rotating the Z ′ axis 90 degrees clockwise around the position of the virtual microphone 86 is determined as the X ′ axis. Next, as shown in FIG. 10, the coordinate conversion is performed so that the position of the virtual microphone 86 becomes the origin position (0, 0, 0) and the Z ′ axis and the X ′ axis overlap the Z axis and the X axis, respectively. Done. Specifically, after the virtual microphone 86 shown in FIG. 9 is translated to the origin position, the virtual camera is centered on the origin so that the Z ′ axis and the X ′ axis overlap with the Z axis and the X axis, respectively. Rotate the game world shot in In this way, the game image 80 as shown in FIG. 7 is displayed on the monitor 34.

  When the game screen 80 as shown in FIG. 7 is displayed, the sound generated by the game BGM or sound object (the sound of burning torches) is output from the left and right speakers 34a and the surround speakers. However, in FIG. 7, for the sake of simple explanation, only the volume of the sound of burning torches is schematically shown, and the volume of the sound other than the sound generated by the sound object such as BGM is omitted.

  Here, when the loudness of the sound output from the speaker 34 is expressed in three levels of large, medium, and small, for the burning sound of the torches 84a, the volume of the right speaker 34a is large and the volume of the left speaker 34a is large. Is medium, and the volume of the surround speakers is low. Regarding the burning sound of the torches 84b, the volume of the right speaker 34a is low, and the volume of the left speaker 34a and the volume of the surround speaker are medium. Further, regarding the burning sound of the torches 84c, the volume of the right speaker 34a and the volume of the left speaker 34a are low, and the volume of the surround speaker is high.

  Therefore, as shown in FIG. 7, the sound of burning torches 84a is output so that it can be heard at a high volume between the right speaker 34a and the surround speakers. The sound of burning torches 84b is output so that it can be heard at a medium volume between the left speaker 34a and the surround speakers. Furthermore, the burning sound of the torches 84c is output so that it can be heard at a small volume at the approximate center of the left and right speakers 34a.

  In FIG. 1, surround speakers are omitted, but surround speakers may be provided separately, and virtual surround speakers are provided by adjusting the volume and localization of the left and right speakers 34a. You may do it. In the latter case, the configuration and method disclosed in Japanese Patent Laid-Open No. 2000-93579 can be employed.

  As described above, when sound is output from the sound source corresponding to each of the sound objects displayed on the game screen 80, the origin after being converted into the three-dimensional camera coordinates as shown in FIG. As the center, the sound collection direction is determined by the rotation angle from the Z axis, and the volume of the sound to be output (the sound when each sound object is played) is determined by the distance between the origin and the sound object. However, since it is necessary for the game apparatus 12 to play sounds (music) such as BGM and sound effects during the game, when there are a large number of sound objects on the game screen 80, the number of pronunciations of usable sound sources That is, the maximum number of simultaneous sounds that the DSP 52 can use is exceeded.

  In such a case, for example, it may be possible to determine a sound object that does not output sound according to the priority order data (see FIG. 5). However, when torches are present on the left and right as shown in FIG. It is uncomfortable that the torches are not output. Also, even if the sound is not important, it may not be output, and the sense of reality of the game may be lost.

  Therefore, in this embodiment, when there are a plurality of sound objects of the same type on the game screen 80, the sound source is output with only one pronunciation, thereby saving the sound source to be used. In other words, the sound source is used efficiently.

  Specifically, for all sound objects existing on the game screen 80, the distance from the origin position and the sound generation direction (angle formed with the Z axis), that is, the localization, are determined based on the respective coordinates (three-dimensional coordinates). , And are calculated according to the equations 1 and 2, respectively. However, as will be described later, the sound volume (data) is calculated using the distance from the origin. However, when obtaining the sound volume, the Y-axis component can be ignored. The distance is calculated based on the components.

[Equation 1]
Distance DP = √ {(XP) 2 + (ZP) 2}
However, P = 1, 2, 3,..., M,.

[Equation 2]
Generation direction (localization) θ = sin −1 (| XP | / DP)
= Cos-1 (| ZP | / DP)
However, | · | means an absolute value, XP and ZP are numerical values included in the coordinates of the sound object, and DP is a distance obtained by Equation 1.

  Next, the sound volume (data) VP to be sounded for the sound object is calculated according to Equation 3 based on the distance calculated using Equation 1.

[Equation 3]
Volume VP = (1− (DP / VD)) × Vo
However, DP is a distance obtained by Equation 1, VD is a distance at which sound cannot be heard, and Vo is an initial value of sound volume (data) of the sound object. Here, VD is a value determined in advance by the programmer or developer of the game. Vo is an initial value of the volume determined in advance by the volume data 722c, volume data 726c, volume data 730c, and the like shown in FIG.

In this way, localization data and sound volume data for sounding each sound object are calculated. Subsequently, the sound objects are classified for each sound object that generates the same sound. Also, from the volume data and localization data calculated for each sound object, each component of the volume of the sound output from the speaker 34a, in this embodiment, L (left volume component), R (right volume component) and surround (hereinafter referred to as the volume) , Referred to as “SR”). Next, the maximum value is selected for each of the L, R, and SR components from the sound objects that generate the same sound. Subsequently, the selected The L, the maximum value of R and SR components, processes the volume and localization of the sound output by the DSP 52. Then, the sound based on the processed volume and localization Ru is output from the speaker 34a, 34b.

  That is, in the example shown in FIG. 10, it can be considered that a virtual torch obtained by combining the torches 84a, torches 84b, and torches 84c is obtained and a sound of burning the virtual torches is output. In this way, even when a virtual torch is obtained, since the sound of the torch burns is a sound that is output to give the game a sense of realism, the player or the user may feel a little uncomfortable. Absent.

  In the above-described example, the case where there are a plurality of sounds of one sound object has been described. However, there are some sound objects such as rivers and waves that include a plurality of point sound sources. Such a sound object can also be considered to have a plurality of sound objects (sound sources) of the same type.

  For example, when a game screen 80 as shown in FIG. 11 is displayed, the world coordinate system of the game world is converted into camera coordinates in the same manner as described with reference to FIGS. On the game screen 80, a player object 82 and a sound object 88 such as “river” are displayed.

  Also, as shown in FIG. 12, in the sound object 88 such as “river”, the position of the sound of the sound object is represented by so-called rail data. As can be seen from FIG. 12, a plurality of rails 92, 94, 96, 98, 100, 102, and 104 indicated by straight lines (segments) or broken lines (curves connecting a plurality of segments) are formed on both sides of the river. Each of the rails 92 to 104 is set as a sound object that generates a sound from any point on a straight line (line segment) connecting the coordinates indicated by the coordinate data. For example, the position where the virtual microphone 86 exists (sound collecting position) and the proximity point of the rail, that is, the point on the rail and the point having the shortest distance from the coordinate (point) of the virtual microphone 86 is determined as the position of the sound object. The sound volume of the sound object is calculated according to the distance between the sound object and the virtual microphone 86.

  However, as described above, when the maximum number of simultaneous pronunciations that can be used is exceeded, the sound of the sound object that does not sound according to the priority order is determined, so the sound is lost, and therefore, the sense of reality disappears, I feel uncomfortable.

  For this reason, a virtual sound object is obtained in the same manner as the sound of a sound object such as a torch, and the sound is output with only one pronunciation in the sound source.

  First, in order to determine the position of the sound object of a point, as described above, a proximity point with the virtual microphone 86 is obtained for each of the rails 92 to 104. Specifically, it is determined for each of the rails 92 to 104 whether or not there is a straight line orthogonal to the rail and passing through the origin. When such a straight line exists, one position is determined at a point (point on the rail) where the straight line and the rail are orthogonal to each other. That is, one sound object is defined. However, when the rail is configured by a curve in which two or more line segments are connected, such as the rails 94, 98, 102, and 104, the origin of the positions of the sound objects existing on one rail. Whether or not there is a straight line as described above is obtained only for the line segment including the position of the sound object with the shortest distance to the sound object. On the other hand, if there is no straight line that is orthogonal to the line segment and passes through the origin, the distance between the coordinates indicated by the coordinate data as the rail data and the origin is calculated, and the point (coordinate) with the shortest distance is the sound. The position of the object is determined.

  In FIG. 12, for easy understanding, the position of the selected sound object is marked with a white triangle.

  Also, the distance can be calculated easily from the coordinates of the origin and the coordinates indicated by the coordinate data as rail data, as in the case of Expression 1.

  However, since it is cumbersome to execute processing such as calculating a straight line that is orthogonal to each rail and passes through the origin, the coordinate data as the rail data indicates the same as when there is no such straight line. Of the coordinates (points), the position of the sound object may be determined at the coordinate (point) having the shortest distance from the coordinates (point) of the virtual microphone 86. In such a case, since only the distance between the coordinates (points) indicated by the coordinate data as rail data and the coordinates (points) of the virtual microphone 86 is calculated, the processing load can be reduced.

  In this way, when a sound object is selected from each of the rails 92 to 104, volume data for sounding the sound object is calculated for each of the selected sound objects according to Equation 3 using the calculated distance. In addition, the localization data is calculated according to Equation 2 using the three-dimensional coordinates of the position of the selected sound object and the calculated distance. Next, L, R, and SR components for the sound position of each sound object are calculated from the calculated volume data and localization data, and the maximum values of L, R, and SR are selected from the calculated results. Subsequently, the volume and localization are calculated from the maximum values of the selected L, R and SR components. That is, the position of the sound of the virtual sound object for the sound object such as “river”, the volume and localization of the sound output using the sound source are determined. Then, a sound is output from the sound source based on the determined volume and localization.

  The operation as described above is processed by the CPU 36 shown in FIG. 2 according to the flowcharts shown in FIGS. When the optical disk 18 is loaded into the disk drive 16 of the game apparatus 12, as shown in FIG. 13, the CPU 36 starts a game process, and in step S1, a program (game main processing program, image processing program and sound control) is read from the optical disk 18. Processing program etc.) and data (object data, microphone data etc.) are loaded into the main memory 40. In the subsequent step S3, sound waveform data necessary for the game is loaded into the ARAM 54.

  In step S5, it is determined whether there is an input. That is, it is determined whether there is an input from the controller 22. If “NO” in the step S5, that is, if there is no input from the controller 22, the process proceeds to a step S11 as it is, and an object drawing process, strictly, an enemy character drawing process or the like is executed. On the other hand, if “YES” in the step S5, that is, if there is an input from the controller 22, an action process of the player character is executed in accordance with the controller input in a step S7. When the player or the user changes the position of the player character 82 on the game screen 82 as shown in FIG. 7, the analog joystick (or 3D joystick) of the operation means 26 (FIG. 1) of the controller 22 is used. Manipulate. Therefore, in this step S7, the CPU 36 receives, for example, the joystick tilt direction and tilt amount data from the controller I / F 56, and changes the position of the player character 82 in the world coordinate system based on the data.

  In subsequent step S9, camera processing (microphone processing) is executed. That is, the position of the virtual camera (virtual microphone 86) in the world coordinate system is updated according to the position of the player character updated in step S7. In step S11, an object drawing process is executed. That is, the CPU 36 converts the position (three-dimensional position) of the above-described player character or sound object into a three-dimensional camera coordinate system having the virtual camera, that is, the virtual microphone 86 as the reference position (origin position). Then, the three-dimensional camera coordinate system is converted into a two-dimensional shadow plane coordinate system, and texture designation and clipping (clipping: clipping of the invisible world) are also executed. Thereafter, the game image is generated by the game image generation process, and the game screen is displayed on the monitor 34 (FIG. 1). That is, the CPU 36 gives a command to the video I / F 58, and the video I / F 58 accesses the frame buffer 48 (FIG. 2) accordingly. Accordingly, image data to be displayed on the monitor 34 is read from the frame buffer 48, and a game image (game screen) is displayed.

  In this embodiment, a detailed description of the game image generation process is omitted.

  In the subsequent step S13, a sound control process which will be described in detail later is executed. Next, in step S15, other game processes are executed. Other game processing includes backup (save) processing of game data generated by the progress of the game. For example, game data is written in a work area (not shown) of the main memory 40 as the game progresses, and the game data is updated sequentially. Then, when backup processing is executed in accordance with a player or user instruction or a predetermined event, game data written in the work area of the main memory 40 is stored in the memory card 30 via the external memory I / F 60. (FIG. 2).

  In step S17, it is determined whether or not the game is over. If “NO” in the step S17, that is, if the game is not ended, the process returns to the step S5 as it is. On the other hand, if “YES” in the step S17, that is, if the game is ended, the game process is ended as it is.

  As shown in FIG. 14, when the sound control process is started, the CPU 36 acquires the coordinate data of the object in step S21. That is, the coordinate data about the sound object displayed on the game screen 80 is acquired from the object data storage area 72 (FIGS. 3 and 5) of the main memory 40. Next, in step S23, as described with reference to FIGS. 9 and 10, coordinate conversion is performed using the position of the virtual microphone 86 as the origin. However, as described above, since the same coordinate transformation is performed in the object drawing process of step S11, the result may be used.

  In a succeeding step S25, it is determined whether or not the coordinate data of the sound object is rail data. That is, it is determined whether or not a plurality of coordinate data is described in the object data stored in the object data storage area 72. However, a label indicating whether the sound object position data or the rail data is different may be attached to each object so that the label can be discriminated.

  If “NO” in the step S25, that is, if it is not rail data, the process proceeds to the step S29 as it is, but if “YES”, that is, if it is rail data, a rail data process described later is executed in a step S27. To step S29.

  In step S29, the coordinate data of the first object is searched. However, the CPU 36 arbitrarily determines the order of objects to be searched. In the subsequent step S31, the distance is obtained from the coordinate data of the object according to Equation 1, and the sound volume data of the sound that sounds the object is calculated according to Equation 3 using the distance. Next, in step S33, the sound generation direction is calculated according to Equation 2 using the coordinate data of the object and the distance obtained in Equation 1. That is, localization data is calculated. In step S35, it is determined whether or not the calculation processing of the volume data and the localization data has been completed for all objects.

  If “NO” in the step S35, that is, if the calculation processing of the volume data and the localization data is not finished for all the objects, the coordinate data of the next object is searched in the step S37, and then the process returns to the step S31. . On the other hand, if “YES” in the step S35, that is, if the calculation processing of the sound volume data and the localization data is finished for all the objects, the objects are classified in step S39 shown in FIG. The object to be materialized (to combine the pronunciation in the sound source into one) is specified. That is, when there are a plurality of sound objects such as torches, or when there is a sound object such as a river, in step S39, the objects for which the sound sources are to be combined are specified.

  In the subsequent step S41, the volume data and localization data calculated in S31 and S33 are acquired for the first object included in the identified object classification. However, the CPU 36 arbitrarily determines the order of objects to be acquired. In subsequent step S43, L, R, and SR components are calculated using the acquired volume data and localization data. Next, in step S45, it is determined whether all the objects to be unified have been completed. That is, it is determined whether the L, R, and SR components have been calculated for all objects included in the object classification specified in step S39.

  If “NO” in the step S45, that is, if the calculation of the L, R, and SR components for all the objects has not been completed, the next object is searched in the step S47, and the process returns to the step S43. On the other hand, if “YES” in the step S45, that is, if the calculation of the L, R, and SR components for all the objects is finished, the respective L, R, and SR components for all the objects calculated in the step S49 are determined. Select the maximum value.

In subsequent step S51, the DSP 52 processes the volume and localization of the sound output from the speakers 34a and 34b from the maximum values of the selected L, R, and SR components. In other words, one virtual sound object is specified and the volume and localization of the sound object are processed . In step S53, sound (sound) is output from the speakers 34a and 34b based on the volume data and localization data processed in step S51. That is, the CPU 36 gives a sound output control instruction to the DSP 52, calculates the L, R, and SR components from the volume data and the localization data, and gives the calculation result to the DSP 52. In response to this, the DSP 52 reads out the corresponding sound waveform data from the ARAM 54, and generates sound data according to the calculation results of the L, R, and SR components. Then, the DSP 52 gives the generated sound data to the audio I / F 62. Therefore, the sound signal converted into the analog signal is output from the speaker 34a.

  However, when there are a plurality of types of objects to be unified, the processes of steps S41 to S53 are repeated according to the number of objects.

  The volume data and the localization data calculated once are associated with the three-dimensional coordinates of the virtual camera (virtual microphone 86) in the game world, and as described with reference to FIG. 3, the sound output control of the main memory 40 is performed. It is stored in the data storage area 76. For example, the writing process to the main memory 40 may be executed in the other game process of step S15 shown in FIG. Therefore, when the virtual microphone 86 is present at the same position after the next time, a plurality of sound objects of the same type are referred to by referring to the main memory 40 without executing the sound control processing shown in FIGS. Alternatively, it is possible to easily output a sound for a sound object that requires pronunciation of a plurality of sound sources by using only one sound source.

  Further, in this embodiment, since sounds generated by a plurality of sound objects of the same type are output with one sound source, after obtaining the maximum values of the L, R, and SR components, the sound volume is obtained using them. Data and localization data are calculated, but the acquired maximum value may be given (transferred) to the DSP 52 as it is. Even in this case, sounds generated by a plurality of sound objects of the same type can be combined into one, so that the number of sound generations of the sound source to be used can be reduced.

  As shown in FIG. 16, when the rail data processing is started, an object coordinate list is acquired in step S61. That is, a plurality of three-dimensional coordinate data is acquired. In step S63, the coordinates of the point where the distance from each rail is the smallest, that is, the point closest to the origin is calculated. That is, replace each rail with a sound object.

  In the above game process, the sound control process is executed when the position of the player character is updated. For example, by operating a button switch among the operation means 26 of the controller 22, for example, 3 Even when the viewpoint of a virtual camera of a three-dimensional image is switched, sound control processing may be executed through camera processing (microphone processing) and object drawing processing.

  According to this embodiment, the sound of a plurality of objects of the same type is output with one pronunciation of the sound source, so that the sound source can be saved. That is, the sound source can be used efficiently. Moreover, since the sound source is not deleted according to the priority order, the realism of the game is not reduced.

  In this embodiment, when a plurality of sound objects of the same type exist, they are grouped together so that the sound source in the sound source becomes one, and the sound source is saved. However, the sound source is saved. Even in such a case, when the number of sound generations of the usable sound source is exceeded, the sound of the sound object that is not output is determined according to the priority order data (see FIG. 5) included in the sound object data. . However, as described above, the priority order of the sound objects in which the sound sources of the sound sources are combined into one is set high, and the sound is always output.

  In this embodiment, when there are sound objects that emit the same type of sound regardless of the number of sound generations of the sound source, they are combined into one, but the number of sound objects exceeds a certain number. Only in the case of the same sound, the same type of sound may be combined into one pronunciation in the sound source.

  Furthermore, in this embodiment, only the video game apparatus as shown in FIG. 1 has been described, but the sound generated by the sound object displayed on the monitor is generated by a sound processor such as a DSP using sound waveform data. Needless to say, the present invention can be applied to other game apparatuses, portable game machines, DVD players, and the like.

  Furthermore, in this embodiment, the case where only the left and right speakers or further surround speakers are provided has been described. However, two speakers may be provided to output sound in at least two directions, and four or more speakers are provided. You may make it provide. Further, when calculating the volume data component, it is desirable to calculate according to the number of speakers as shown in the above-described embodiment.

  Further, in this embodiment, only the torches, rivers, and waves have been described as sound objects, but the sound objects need not be limited to these.

It is an illustration figure which shows an example of the game system of this invention. FIG. 2 is a block diagram showing an electrical configuration of the video game apparatus shown in FIG. 1 embodiment. FIG. 3 is an illustrative view showing a memory map of a main memory shown in FIG. 2. It is an illustration figure which shows the structure of the sound control program shown in FIG. FIG. 4 is an illustrative view showing data stored in an object data storage area shown in FIG. 3. It is an illustration figure which shows the sound waveform data of the sound object memorize | stored in ARAM shown in FIG. FIG. 2 is an illustrative view schematically showing an example of a game screen displayed on a monitor in the game system of FIG. 1 embodiment and the volume of a sound object output from a speaker for the game screen. It is an illustration figure which shows the three-dimensional coordinate (camera coordinate) of the game world corresponding to the game screen shown in FIG. It is an illustration figure which shows the three-dimensional coordinate (camera coordinate) of the game world corresponding to the game screen shown in FIG. FIG. 8 is an illustrative view showing converted three-dimensional coordinates obtained by converting the three-dimensional coordinates of the game world shown in FIG. 7 into drawing coordinates. It is an illustration figure which shows another example of the game screen displayed on a monitor in the game system of FIG. 1 Example. It is an illustration figure which shows the sound source of the sound object displayed on the game screen shown in FIG. It is a flowchart which shows an example of the game process of CPU shown in FIG. It is a flowchart which shows a part of sound control process of CPU shown in FIG. It is a flowchart which shows a part of other sound control process of CPU shown in FIG. It is a flowchart which shows the rail data processing of CPU shown in FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Game system 12 ... Game device 18 ... Optical disk 22 ... Controller 34 ... Monitor 34a ... Speaker 36 ... CPU
38 ... Memory controller 40 ... Main memory 42 ... GPU
54 ... ARAM
62 ... Audio I / F

Claims (12)

Operation means for inputting operation information by the player;
Object storage means for storing objects constituting a game image;
Image display control means for displaying a game image including at least two objects based on the operation information;
And it outputs the sound, left right two speakers,
Waveform data storage means for storing at least one type of waveform data corresponding to the sound generated by the sound object, wherein the at least two objects constituting the game image are sound objects that generate sound;
Sound generation position data storage means for storing sound generation position data indicating a sound generation position for each sound object;
At least a sound output control means for reading out the waveform data in accordance with a sound output instruction, generating sound data, and outputting the generated sound data from the speaker as sound; and at least a position for collecting sound during the game A game sound control program for a game device comprising microphone data storage means for storing microphone data including sound collection position data and sound collection direction data indicating a sound collection direction for collecting sound,
In the game device processor,
For each sound object, a distance between the sound object and the sound collection position is calculated from the sound generation position data and the sound collection position data, and volume data of sound generated by the sound object based on the calculated distance is obtained. Volume data calculation step to calculate,
A localization calculation step of calculating localization data for each of the sound objects based on the sound collection direction data and the sound generation position data;
A volume component dividing step for dividing the volume data of each sound object into a right volume component and a left volume component of the sound output from the speaker , based on the localization data calculated by the localization calculation step;
An object classification step for classifying all the sound objects into objects that generate the same sound;
Wherein the object to generate the same sound of the sound volume component said split by split step right volume component and the left volume component, extracts the maximum right volume components and maximum left volume component, the waveform data of the object Based on the maximum right volume component and the maximum left volume component , the sound output control unit generates data for outputting sound from the speaker, and the sound output control unit. A game sound control program for executing an output instruction step for giving a sound output instruction and the data generated by the sound output data generation step. The game sound control program according to claim 1, wherein the sound output data generation step uses the maximum right volume component and the maximum left volume component as they are as the right volume component and left volume component of the sound to be output. Operation means for inputting operation information by the player;
Object storage means for storing objects constituting a game image;
Image display control means for displaying a game image including at least two objects based on the operation information;
Two speakers, left and right, that output sound,
Waveform data storage means for storing at least one type of waveform data corresponding to the sound generated by the sound object, wherein the at least two objects constituting the game image are sound objects that generate sound;
Sound generation position data storage means for storing sound generation position data indicating a sound generation position for each sound object;
Sound output control means for reading out the waveform data according to at least a sound output instruction, generating sound data, and outputting the generated sound data as sound from the speaker; and
Game sound control program for game device comprising microphone data storage means storing microphone data including at least sound collection position data indicating a position where sound is collected during a game and sound collection direction data indicating a sound collection direction. Because
In the game device processor,
For each sound object, a distance between the sound object and the sound collection position is calculated from the sound generation position data and the sound collection position data, and volume data of sound generated by the sound object based on the calculated distance is obtained. Volume data calculation step to calculate,
A localization calculation step of calculating localization data for each of the sound objects based on the sound collection direction data and the sound generation position data;
A volume component dividing step of dividing the volume data of each sound object into a right volume component, a left volume component and a surround volume component of the sound output from the speaker, based on the localization data calculated by the localization calculation step;
An object classification step for classifying all the sound objects into objects that generate the same sound;
Of the right volume component, the left volume component, and the surround volume component divided by the volume component dividing step for the object that generates the same sound, the maximum right volume component, the maximum left volume component, and the maximum surround volume among the right volume component, the left volume component, and the surround volume component. The sound output control means outputs a sound from the speaker based on the waveform data of the object and the maximum right volume component, the maximum left volume component, and the maximum surround volume component. Sound output data generation step for generating the data of, and
A game sound control program for causing the sound output control means to execute an output instruction step for giving a sound output instruction and data generated by the sound output data generation step . The sound generation position data includes sound object position data represented by one coordinate data and position data of a sound object having rail data represented by rail data defined by at least two coordinate data.
For the sound object having the rail data, a proximity coordinate calculating step for calculating coordinate data on a line connecting the coordinates representing the rail data and closest to the sound collection position data;
The volume data calculation step calculates volume data of the sound object from the coordinate data calculated by the proximity coordinate calculation step and the sound collection position data when calculating volume data of the sound object having the rail data. ,
The volume component dividing step includes volume data for each of a right volume component , a left volume component, and a surround volume component of the sound output from the speaker from the coordinate data calculated by the proximity coordinate calculation step and the sound collection position data. The game sound control program according to claim 3, wherein the game sound control program is divided. Operation means for inputting operation information by the player;
Object storage means for storing objects constituting a game image;
Image display control means for displaying a game image including at least two objects based on the operation information;
And it outputs the sound, left right two speakers,
Waveform data storage means for storing at least one type of waveform data corresponding to the sound generated by the sound object, wherein the at least two objects constituting the game image are sound objects that generate sound;
Sound generation position data storage means for storing sound generation position data indicating a sound generation position for each sound object;
At least a sound output control means for reading out the waveform data in accordance with a sound output instruction, generating sound data, and outputting the generated sound data from the speaker as sound; and at least a position for collecting sound during the game A game sound control method for a game apparatus comprising microphone data storage means for storing microphone data including sound collection position data and sound collection direction data indicating a sound collection direction for collecting sound,
(a) For each sound object, a distance between the sound object and the sound collection position is calculated from the sound generation position data and the sound collection position data, and the sound object generated by each sound object is calculated based on the calculated distance. Calculate the volume data,
(b) calculating localization data for each of the sound objects based on the sound collection direction data and the sound generation position data;
(c) Based on the localization data calculated in step (b), the volume data of each sound object is divided into a right volume component and a left volume component of the sound output from the speaker ,
(d) classify all the sound objects as objects that generate the same sound;
(e) above for the object that generates the same sound of the right volume component and the left volume component divided the in step (c), to extract the maximum of the right volume components and maximum left volume component, the waveform of the object Based on the data and the maximum right volume component and the maximum left volume component , the sound output control means generates data for outputting sound from the speaker; and
(f) A game sound control method in which a sound output instruction and the data generated in the step (e) are given to the sound output control means. 6. The step (e) includes a step (e-1) of using the maximum right volume component and the maximum left volume component as they are as a right volume component and a left volume component of an output sound. Game sound control method. Operation means for inputting operation information by the player;
Object storage means for storing objects constituting a game image;
Image display control means for displaying a game image including at least two objects based on the operation information;
Two speakers, left and right, that output sound,
Waveform data storage means for storing at least one type of waveform data corresponding to the sound generated by the sound object, wherein the at least two objects constituting the game image are sound objects that generate sound;
Sound generation position data storage means for storing sound generation position data indicating a sound generation position for each sound object;
Sound output control means for reading out the waveform data according to at least a sound output instruction, generating sound data, and outputting the generated sound data as sound from the speaker; and
A game sound control method for a game apparatus comprising microphone data storage means storing at least sound collection position data indicating a position for collecting sound during a game and microphone data including sound collection direction data indicating a sound collection direction for collecting sound. There,
(a) For each sound object, a distance between the sound object and the sound collection position is calculated from the sound generation position data and the sound collection position data, and the sound object generated by each sound object is calculated based on the calculated distance. Calculate the volume data,
(b) calculating localization data for each of the sound objects based on the sound collection direction data and the sound generation position data;
(c) Based on the localization data calculated in the step (b), the volume data of each sound object is divided into a right volume component, a left volume component and a surround volume component of the sound output from the speaker,
(d) classify all the sound objects as objects that generate the same sound;
(e) Among the right volume component, the left volume component and the surround volume component divided in step (c) for the object that generates the same sound, the maximum right volume component, the maximum left volume component, and the maximum The surround sound volume component is extracted, and the sound output control means outputs sound from the speaker based on the waveform data of the object and the maximum right volume component, the maximum left volume component, and the maximum surround volume component. Data to generate, and
(f) A game sound control method in which a sound output instruction and the data generated in the step (e) are given to the sound output control means . The sound generation position data includes rail sound source position data having rail data, represented by point sound source position data represented by one coordinate data and rail data defined by at least two coordinate data,
(g) For the sound object having the rail data, further comprising the step of calculating coordinate data of a position on a line connecting the coordinates representing the rail data and closest to the sound collection position data;
When calculating the volume data of the sound object having the rail data, the step (a) calculates the volume data of the sound object from the coordinate data calculated in the step (g) and the sound collection position data. ,
The step (c) includes volume data for each of a right volume component , a left volume component and a surround volume component of the sound output from the speaker from the coordinate data calculated in the step (g) and the sound collection position data. The game sound control method according to claim 7, wherein the game sound is divided. An operation means for inputting operation information by the player, so the game to progress in accordance with the operation of the operating means, at least two objects and displays a game screen including a left right two speakers you outputting sound A game device configured to generate sound related to the game screen,
Waveform data storage means for storing at least one type of waveform data corresponding to the sound generated by the sound object, wherein the at least two objects are sound objects that generate sound;
Sound generation position data storage means for storing sound generation position data indicating a sound generation position for each sound object;
Sound output control means for reading out the waveform data according to at least a sound output instruction, generating sound data, and outputting the generated sound data as sound from the speaker;
Microphone data storage means storing microphone data including at least sound collection position data indicating a position where sound is collected during the game and sound collection direction data indicating a sound collection direction for collecting sound;
For each sound object, a distance between the sound object and the sound collection position is calculated from the sound generation position data and the sound collection position data, and volume data of sound generated by the sound object based on the calculated distance is obtained. Volume data calculation means for calculating,
Localization calculation means for calculating localization data for each of the sound objects based on the sound collection direction data and the sound generation position data;
Volume component dividing means for dividing the volume data of each sound object into a right volume component and a left volume component of the sound output from the speaker , based on the localization data calculated by the localization calculation means;
Object classification means for classifying all the sound objects into objects that generate the same sound;
Wherein the object to generate the same sound of the right volume component and the left volume component divided by the volume component dividing means extracts the maximum right volume components and maximum left volume component, the waveform data of the object Based on the maximum right volume component and the maximum left volume component , the sound output data generation means for generating data for the sound output control means to output sound from the speaker, and the sound output control means A game apparatus comprising output instruction means for giving a sound output instruction and data generated by the sound output data generation means. The game apparatus according to claim 9, wherein the sound output data generation unit directly uses the maximum right volume component and the maximum left volume component as a right volume component and a left volume component of a sound to be output. An operation means for inputting operation information by the player is provided. The game is advanced in accordance with the operation of the operation means, and a game screen including at least two objects is displayed. A game device configured to generate a sound related to a game screen,
Waveform data storage means for storing at least one type of waveform data corresponding to the sound generated by the sound object, wherein the at least two objects are sound objects that generate sound;
Sound generation position data storage means for storing sound generation position data indicating a sound generation position for each sound object;
Sound output control means for reading out the waveform data according to at least a sound output instruction, generating sound data, and outputting the generated sound data as sound from the speaker;
Microphone data storage means storing microphone data including at least sound collection position data indicating a position where sound is collected during the game and sound collection direction data indicating a sound collection direction for collecting sound;
For each sound object, a distance between the sound object and the sound collection position is calculated from the sound generation position data and the sound collection position data, and volume data of sound generated by the sound object based on the calculated distance is obtained. Volume data calculation means for calculating,
Localization calculation means for calculating localization data for each of the sound objects based on the sound collection direction data and the sound generation position data;
Volume component dividing means for dividing the volume data of each sound object into a right volume component, a left volume component and a surround volume component of the sound output from the speaker, based on the localization data calculated by the localization calculation means;
Object classification means for classifying all the sound objects into objects that generate the same sound;
Among the right volume component, the left volume component, and the surround volume component divided by the volume component dividing unit for the object that generates the same sound, the maximum right volume component, the maximum left volume component, and the maximum surround volume are divided. Component for extracting the sound from the speaker based on the waveform data of the object and the maximum right volume component, the maximum left volume component, and the maximum surround volume component. Sound output data generating means for generating data, and
A game apparatus comprising: output instruction means for giving a sound output instruction and data generated by the sound output data generating means to the sound output control means . The sound generation position data includes sound object position data represented by one coordinate data and position data of a sound object having rail data defined by at least two coordinate data,
For the sound object having the rail data, the coordinate data of the position on the line connecting the coordinates representing the rail data and closest to the sound collection position data stored in the microphone data storage means is calculated. A proximity coordinate calculating means for
The sound volume data calculating means calculates sound volume data of the sound object from the coordinate data calculated by the proximity coordinate calculating means and the sound collection position data when calculating sound volume data of the sound object having the rail data. ,
The volume component dividing unit is configured to generate volume data for each of a right volume component , a left volume component, and a surround volume component of a sound output from the speaker, from the coordinate data calculated by the proximity coordinate calculation unit and the sound collection direction data. The game device according to claim 11, wherein the game device is divided.

Images