JP2007229241A - Program, information storage medium, and game system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a program, an information storage medium and a game system by which environmental sound in an object space can be generated as environmental sound of a small load and high reality. <P>SOLUTION: The game system comprises: an object space setting part 111 for setting a group of sound sources for generating prescribed environmental sound in the object space; a virtual camera control part 113 which controls at least one of the position and direction of a virtual camera in the object space; and an environmental sound information calculation part 140 which calculates information for changing the position of each sound source based on the control information of the virtual camera. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a program for generating environmental sound in an object space, an information storage medium, and a game system.

  Conventionally, sound data heard by a player character from a single sound source has been reproduced in a virtual game space.

  As such a method, there are conventional methods described in Patent Document 1 and Patent Document 2.

  In the technique described in Patent Document 1, for example, sounds generated when a player character moves in a plurality of areas existing in a game space, such as a stone pavement in which gravel is spread, a stone pavement in which gravel is scattered, and a stone pavement without gravel, By reproducing a plurality of sound data by mixing, it was reproduced as a highly realistic game sound.

Further, in the conventional method described in Patent Document 2, when the player character and the sound source are close to each other in the virtual game space, a high sound and a low sound are clearly heard, and vice versa. A game sound generation method is used to solve the problem of difficulty in hearing sounds.
JP 2005-4628 A JP 2005-46270 A

  However, none of these conventional methods reproduces the game sound from a single sound source, and does not reproduce the environmental sound that spreads as a so-called predetermined area.

  In addition, conventionally, there has been no environmental sound reproduction method for reproducing such environmental sounds with high reality.

  The present invention has been made in view of such problems, and an object of the present invention is to provide a program, an information storage medium, and an information storage medium that can generate environmental sounds in an object space as environmental sounds with low load and high reality. To provide a game system.

(1) The game system of the present invention
An object space setting unit for setting a sound source group for generating a given environmental sound in the object space;
A virtual camera control unit that controls at least one of the position and orientation of the virtual camera in the object space;
An environmental sound information calculation unit that calculates information for changing the position of each sound source with respect to the control point based on the control point information associated with the sound source group and the control information of the virtual camera. Features.

  The present invention also relates to a program that causes a computer to function as each of the above-described units. The present invention also relates to an information storage medium that is readable by a computer and stores (records) a program that causes the computer to function as each of the above-described units.

  Here, the “given environmental sound” is an ambient environmental sound that can be heard in the object space, for example, an environmental sound that can be heard from a space having a predetermined spread. Examples of such environmental sounds include environmental sounds that can be heard from an area having a predetermined two-dimensional or three-dimensional spread over the sea, river, forest, or the like.

  The sound source group is a plurality of sound sources that are spaced apart from each other with reference to a control point, and from these sound sources, a given environmental sound, for example, a sea sound, a wave sound, a river flowing sound, Generates sounds of forests swaying in the wind. These sound sources may be arranged in the object space for each environmental sound.

  According to the present invention, an image obtained by viewing the object space with the virtual camera is displayed on the display. In accordance with this, information for changing the position of each sound source relative to the control point is calculated based on the control point information and the virtual camera control information. Based on the calculated information, the sound source group can be moved in the object space.

  As a result, it is possible to generate a wide-ranging environmental sound having a direction according to the position and orientation of the virtual camera. Therefore, the environment sound heard by the character looking in the same direction as the virtual camera in the object space can be reproduced more realistically.

  In particular, the present invention can clearly determine the direction of the environmental sound that can be heard in the object space by controlling the position of each sound source with respect to the control point, and also controls the arrangement of each sound source with respect to the control point in the sound source group. By doing so, the environmental sound that can be heard at the position and direction of the virtual camera can be generated as a natural environment sound having a spread.

  As described above, according to the present invention, a sound source generated from an environmental sound generation area having a two-dimensional and three-dimensional spread in the object space is used based on the position and orientation of the virtual camera. Can be played in real as well as in real space.

  Here, the plurality of sound sources constituting the sound source group may be any one that employs two or more sound sources, and each sound source has a plurality of sound sources as one with reference to the control point in the local coordinate system unique to each sound source. What is necessary is just to arrange | position in two dimensions or multidimensional.

  In the present invention, the generated environmental sound may be reproduced using two or more speakers. Thereby, the environmental sound in the object space can be reproduced realistically using a plurality of speakers.

(2) In the game system, program and information storage medium of the present invention,
The environmental sound information calculation unit is
Information for changing the position corresponding to the control point in the object space may be calculated based on the control information of the virtual camera.

  According to the present invention, a control point can be treated as a representative point of a sound source group (for example, the origin of a local coordinate system), and the sound source group can be moved in the object space according to control information of the virtual camera. For example, a movement vector when the control point is virtually moved in the object space according to the movement of the virtual camera is obtained, and the position after movement of each sound source is determined based on the obtained movement vector and the position coordinates of each sound source. Coordinates can be obtained.

  Therefore, the position of each sound source can be changed according to the control information of the virtual camera with a light processing load.

(3) In the game system, program and information storage medium according to the present invention,
The environmental sound information calculation unit is
Information for changing a position corresponding to the control point in the object space may be calculated in an area included in an environmental sound generation area that is an area for generating the environmental sound in the object space. Good.

  According to the present invention, since the calculation is performed so that the virtual position of the control point changes within an area narrower than the environmental sound generation area such as the sea or river, each sound source is controlled according to the control information of the virtual camera. Even if the position of the sound source is changed, the position of each sound source after the change can be kept within the range of the environmental sound generation area.

(4) In the game system, program and information storage medium according to the present invention,
The environmental sound information calculation unit is
When the position of the sound source changed based on the calculated information is outside the environmental sound generation area that is an area in the object space where the environmental sound is generated, the position of the sound source is corrected within the environmental sound generation area. It may be configured to calculate correction information for this purpose.

  According to the present invention, the position of the sound source obtained according to the control information of the virtual camera is corrected so as to be within the environmental sound generation area. For example, when the position of the sound source of the wave sound becomes a position that is not the sea, the position is corrected to be the sea position. Therefore, the association between the environmental sound and the environmental sound generation area can be maintained.

(5) In the game system, program and information storage medium according to the present invention,
The environmental sound information calculation unit is
When the position of the virtual camera approaches the environmental sound generation area, information for changing a position corresponding to a control point in the object space so as to approach the position of the virtual camera may be calculated.

  According to the present invention, when the virtual camera moves into the environmental sound generation area, for example, the position of the virtual camera may coincide with the position of the control point.

  As a result, even if the number of sound source groups set in the environmental sound generation area is reduced, if the virtual camera approaches the environmental sound generation area, a natural environmental sound is generated by bringing the sound source group closer to the virtual camera. be able to.

(6) In the game system, program and information storage medium according to the present invention,
The environmental sound information calculation unit is
When there is an obstacle between a position corresponding to a control point in the object space and the sound source, correction information for correcting the position of the sound source may be calculated.

  Thereby, the inconvenience that the sound of the sound source is heard from a direction that should not be heard due to an obstacle can be prevented.

(7) In the game system, program and information storage medium according to the present invention,
The sound source group is configured such that the control point and a pair of sound sources form a straight line,
The environmental sound information calculation unit is
The rotation amount around the control point of the pair of sound sources may be obtained so that the line-of-sight direction of the virtual camera and a straight line connecting the pair of sound sources are orthogonal to each other.

  According to the present invention, it is possible to reduce the number of sound sources and greatly reduce the load of environmental sound generation while keeping the sound heard in a wide and natural way.

  In addition, by controlling the placement of the pair of sound sources with respect to the control point so that the direction of the virtual camera and the straight line connecting the pair of left and right sound sources are orthogonal, the environmental sound is The environmental sound from the generation area can be generated as a natural sound with a simple control and spread.

  In particular, according to the present invention, by controlling the arrangement of the pair of sound sources with respect to the control point, it can be easily controlled so that the pair of left and right sound sources are positioned in the direction of the environmental sound generation area from the virtual camera, Further, by controlling the length from the control point to each sound source, it is possible to control the sound source so as to avoid an obstacle, for example.

(8) In the game system, program and information storage medium according to the present invention,
The environmental sound information calculation unit is
The sound volume output from each sound source is set based on the distance of each sound source to the virtual camera, and the sound source of each sound source is determined based on the viewing direction of the virtual camera and the direction connecting the virtual camera and each sound source. Output distribution may be performed.

  According to the present invention, the volume of each sound source can be set to a natural volume corresponding to the distance between the sound source and the virtual camera. The output distribution of each sound source can be set to a natural distribution ratio according to the positional relationship between each sound source and the virtual camera.

(9) In the game system, program and information storage medium according to the present invention,
The tone colors of the sound sources may be set to different tone colors.

  According to the present invention, it is possible to express natural and highly random environmental sound without the timbres of the sound sources constituting the sound source group interfering with each other.

(10) In the game system, program, and information storage medium according to the present invention,
A plurality of environmental sounds generated in the object space are prepared,
The object space setting unit
A sound source group corresponding to the environmental sound may be set in the object space.

  According to the present invention, since a sound source group corresponding to a plurality of environmental sounds is set in the object space, a more natural and highly random environmental sound can be expressed.

(11) In the game system, program and information storage medium according to the present invention,
An object space setting unit for setting a sound source group for generating a given environmental sound in the object space;
A virtual camera control unit that controls at least one of the position and orientation of the virtual camera in the object space;
You may make it function a computer as an environmental sound information calculating part which calculates the information for changing the position of each said sound source based on the control information of the said virtual camera.

  Hereinafter, this embodiment will be described. In addition, this Embodiment demonstrated below does not unduly limit the content of this invention described in the claim. In addition, all the configurations described in the present embodiment are not necessarily essential configuration requirements of the present invention.

1. Configuration FIG. 1 shows an example of a functional block diagram of the game system of the present embodiment. Note that the game system of the present embodiment may have a configuration in which some of the components (each unit) in FIG. 1 are omitted.

  The operation unit 160 is used to input operation performed by the player as data. For example, the operation unit 160 is used to input operation data of a player object (player character operated by the player), and functions thereof are lever, button, steering. , A microphone, a touch panel display, or a housing.

  The storage unit 170 is a work area such as the processing unit 100 and the communication unit 196, and functions as a main storage unit 171, a frame buffer 173, a transmission buffer 174, a relay buffer 176, and is realized by a RAM (VRAM) or the like. it can.

  The information storage medium 180 (computer-readable medium) stores programs, data, and the like, and functions as an optical disk (CD, DVD), magneto-optical disk (MO), magnetic disk, hard disk, and magnetic tape. Alternatively, it can be realized by a memory (ROM). The processing unit 100 performs various processes according to the present embodiment based on a program (data) stored in the information storage medium 180. That is, the information storage medium 180 stores a program for causing a computer to function as each unit of the present embodiment (a program for causing a computer to execute processing of each unit).

  Part or all of the information stored in the information storage medium 180 is transferred to the storage unit 170 as necessary. The information stored in the information storage medium 180 includes program code, image data, sound data, object data, texture data, table data, list data, and processing of the present invention for performing the processing of the present invention. Information and information to be processed in accordance with the instruction.

  The display unit 190 outputs an image generated according to the present embodiment, and its function can be realized by a CRT, LCD, touch panel display, HMD (head mounted display), or the like.

  The sound output unit 192 outputs the sound generated by the present embodiment, and its function can be realized by a speaker, headphones, or the like.

  In the present embodiment, the sound output unit 192 is formed as a stereo reproduction type speaker or headphone, and may be, for example, a left and right two-channel speaker, or a multi-channel type in which three or more speakers are combined. You may form as a sound output production | generation part.

  The portable information storage device 194 stores player personal data, game save data, and the like. Examples of the portable information storage device 194 include a memory card and a portable game device.

  The communication unit 196 performs various types of control for performing wireless and wired communication with the outside (for example, a host device or other image generation system), and functions as hardware such as various processors or communication ASICs. Or by a program.

  Note that a program (data) for causing a computer to function as each unit of this embodiment is transferred from the information storage medium of the host device (server) to the information storage medium 180 (or storage unit 170) via the network and communication unit 196. You may distribute. Use of the information storage medium of such a host device (server) can also be included in the scope of the present invention.

  The processing unit 100 (processor) performs processing such as game processing, image generation processing, or sound generation processing based on operation data and programs from the operation unit 160.

  Here, the game process includes a process for starting a game when a game start condition is satisfied, a process for advancing the game, a process for sending and receiving bottle mail, a process for placing objects such as characters and maps, and displaying objects. There are a process, a process for calculating a game result, a process for ending a game when a game end condition is satisfied, and the like.

  The processing unit 100 performs various processes using the main storage unit 171 in the storage unit 170 as a work area. The function of the processing unit 100 can be realized by hardware such as various processors (CPU, DSP, etc.), ASIC (gate array, etc.), and programs.

  The processing unit 100 includes an object space setting unit 111, a movement / motion control unit 112, a virtual camera control unit 113, an image generation unit 120, a sound generation unit 130, and an environmental sound information calculation unit 140.

  The object space setting unit 111 includes various objects (polygons, free-form surfaces, subdivision surfaces, etc.) representing display objects such as characters, buildings, stadiums, cars, trees, pillars, walls, and maps (terrain). (Object) is set in the object space. In other words, the position and rotation angle of the object in the world coordinate system (synonymous with direction and direction) are determined, and the rotation angle (rotation angle around the X, Y, and Z axes) is determined at that position (X, Y, Z). Arrange objects.

  The object space setting unit 111 sets a sound source group for generating a given environmental sound in the object space. In the present embodiment, the sound source 50 shown in FIG. 7 is arranged in association with the environmental sound generation area 22 in the object space.

  The movement / motion control unit 112 performs a movement / motion calculation (movement / motion simulation) of an object (such as a character, a car, or an airplane). That is, based on operation data input by the player through the operation unit 160, a program (movement / motion algorithm), various data (motion data), etc., the model object is moved in the object space, or the object is moved (motion, motion, etc.). Animation). Specifically, a simulation process for sequentially obtaining object movement information (position, rotation angle, speed, or acceleration) and motion information (part object position or rotation angle) every frame (1/60 second). Do. A frame is a unit of time for performing object movement / motion processing (simulation processing) and image generation processing.

  The virtual camera control unit 113 performs a virtual camera (viewpoint) control process for generating an image that can be seen from a given (arbitrary) viewpoint in the object space. Specifically, a process for controlling the position (X, Y, Z) or the rotation angle (rotation angle about the X, Y, Z axes) of the virtual camera (process for controlling the viewpoint position and the line-of-sight direction) is performed.

  For example, when an object (eg, character, ball, car) is photographed from behind using a virtual camera, the virtual camera position or rotation angle (virtual camera orientation) is set so that the virtual camera follows changes in the position or rotation of the object. ) To control.

  The image generation unit 120 performs drawing processing based on the results of various processing (game processing) performed by the processing unit 100, thereby generating an image, for example, from a given viewpoint (virtual camera) in the object space. A visible image is generated and output to the display unit 190.

  Specifically, in accordance with the result of the arithmetic processing performed by the processing unit 100, for example, various geometric processing (three-dimensional arithmetic) such as coordinate transformation, clipping processing, perspective transformation, or light source calculation, or an object (model) after the geometric processing. Then, various image processing such as drawing processing for drawing in the frame buffer 173 is performed to generate an image that can be seen from the virtual camera (viewpoint) in the object space, and output to the display unit 190.

  The sound generation unit 130 performs sound processing based on the results of various processes performed by the processing unit 100, generates a game sound such as BGM, sound effect, or sound, and outputs the game sound to the sound output unit 192. In particular, a sound is generated when a sound generated from the position of the sound source set in the object space is heard at the position of the virtual camera.

  The environmental sound information calculation unit 140 calculates information for changing the position of each sound source constituting the sound source group set in the object space based on the control information of the virtual camera. Specifically, the movement vector of the sound source is obtained according to the movement of the virtual camera. In the present embodiment, information for changing the position of each sound source relative to the control point may be calculated based on the information on the control point with which the sound source group is associated and the control information of the virtual camera.

  In addition, the environmental sound information calculation unit 140 calculates information for changing the position corresponding to the control point in the object space based on the control information of the virtual camera. In this case, information for changing the position corresponding to the control point in the object space in the area included in the environmental sound generation area may be calculated.

  The environmental sound information calculation unit 140 also provides correction information for correcting the position of the sound source within the environmental sound generation area when the position of the sound source changed based on the calculated information is outside the environmental sound generation area. Calculate.

  In addition, the environmental sound information calculation unit 140 calculates information for changing the position corresponding to the control point in the object space so as to be close to the position of the virtual camera when the position of the virtual camera is close to the environmental sound generation area. .

  In addition, when there is an obstacle between a position corresponding to a control point in the object space and a sound source, the environmental sound information calculation unit 140 calculates correction information for correcting the position of the sound source.

  In addition, the environmental sound information calculation unit 140 obtains a rotation amount around the control point of the pair of sound sources so that the line-of-sight direction of the virtual camera and a straight line connecting the pair of sound sources are orthogonal to each other.

  And based on the information calculated | required as mentioned above and the position of the sound source before a position change, the position of the sound source changed according to the control information of a virtual camera is calculated | required. Then, the object space setting unit 111 sets the sound source at the changed position.

  In addition, the environmental sound information calculation unit 140 sets the sound volume output from each sound source based on the distance from each sound source to the virtual camera, and sets the line-of-sight direction of the virtual camera and the direction connecting the virtual camera and each sound source. Based on the output distribution of each sound source. For example, by setting the maximum volume as a reference for the sound source and setting it to output a volume that is attenuated according to the distance between the sound source and the virtual camera, the volume increases as the virtual camera approaches the sound source. Can be. Then, output distribution of each sound source assigned to a plurality of channels can be performed according to the angle formed by the viewing direction of the virtual camera and the direction connecting the virtual camera and each sound source. For example, the output distribution ratio can be increased as the angle formed by the viewing direction of the virtual camera and the direction connecting the virtual camera and the sound source is narrower. In this case, the inner product of the line-of-sight vector of the virtual camera and the unit vector in the direction connecting the virtual camera and the sound source may be obtained for each sound source, and distribution may be performed using each inner product directly or indirectly. Good.

  Specifically, when the sound source group includes two sound sources, a left sound source and a right sound source, and the sound output unit 192 includes left and right two-channel speakers, the visual line direction of the virtual camera, and the virtual camera The narrower the angle formed by the direction connecting the left sound source and the left sound source, the higher the distribution ratio of the left sound source output in the left channel, and the lower the right sound source output distribution ratio. For example, if θ is an angle formed by the viewing direction of the virtual camera and the direction connecting the virtual camera and the left sound source, the distribution ratio of the left sound source and the right sound source in the left channel is represented as left sound source: right sound source = Cos θ: ( 1-Cosθ).

  Note that the game system of the present embodiment may be a system dedicated to the single player mode that can be played by only one player, or not only such a single player mode but also a multiplayer mode in which a plurality of players can play. The system may also be provided. Further, when a plurality of players play, game images and game sounds to be provided to the plurality of players may be generated using one terminal, or connected via a network (transmission line, communication line) or the like. Alternatively, it may be generated using a plurality of terminals (game machine, mobile phone).

  Note that all of the basics of the processing unit 100 may be realized by hardware, or all of them may be realized by a program. Alternatively, it may be realized by both hardware and a program.

2. Conventional Method Contrast with the Present Invention First, a conventional method compared with the principle of environmental sound generation in an object space to which the present invention is applied will be described.

2-1. Conventional Method for Generating Game Sound from Single Sound Source in Object Space FIG. 2 shows an example of a game screen of a three-dimensional game space constituting the object space. It exists as a sound source. The animal 20 is a single sound source when viewed from the player 10, and sound generation from the animal 20 that can be heard by the player 10 is performed as follows.

i: Sound generation request
ii: Calculate the relative coordinates from the virtual camera to the animal that is the sound source
iii: Determine the output sound source of the left and right speakers according to the calculation result
iv: Output sound from left and right speakers

  With the above-described sound generation processing, in the case of the object space shown in FIG. 2, a sound output result “slightly to the right, slightly smaller” is obtained.

  When the relative coordinates change from the virtual camera to the animal 20 as the sound source while the animal 20 is sounding, the relative movement between the virtual camera and the animal 20 is expressed by voice by repeating the above ii to iv. When the sound source can be regarded as a single point as described above, monaural (one channel) audio data is generally used.

2-2. Conventional method of generating environmental sound assuming waves as sound sources Waves are natural sounds that are evenly generated from a certain environmental sound generation area called the sea. FIG. 3 shows a game screen when the sea exists as the environmental sound generation area 22 in the object space.

  If the sound source is treated as a single source in the same way as an animal with respect to a wave expressed as an environmental sound generation area having a certain spread in this screen display, the virtual camera will move along the beach. When this occurs, the relative position from the virtual camera to the sound source changes the display position of the environment sound generation area 22 such as a wave and the sound source position, resulting in unnatural environmental sound reproduction.

  A method of reproducing environmental sound from an environmental sound generation area having a certain area by an infinite number of single points is also conceivable, but considers the number of sound sources that are generated at the same time and the hardware performance to calculate this. Then it is not realistic.

  Furthermore, as shown in FIG. 4, when the virtual camera and the sound source (when waving) are facing each other, even if the sound source of the wave is assigned as a single point to the environmental sound generation area 22 (that is, monaural assigned to a single point). (1-channel audio file)), the output contents from the left and right speakers are the same, and the natural sound spread in the left-right direction cannot be expressed.

  As a method for solving such a problem, a general stereo (2-channel) audio file is used to obtain a sense of breadth, and at the same time, coordinates are calculated only for the distance in the opposite direction (output audio from the left and right speakers depending on perspective) To increase or decrease the sound volume evenly).

  However, even in this case, coordinates are calculated only for the distance in the opposite direction, so even when the camera is not directly facing the sound source, the output volume from the left and right speakers is equalized, which is also an unnatural environment sound reproduction It becomes.

  Even if the coordinate calculation method is switched from 2 channels (representation of a certain area) to 1 channel (representation of a single point) when the relative distance from the virtual camera to the sound source is a constant value, The speaker output volume changes abruptly, leaving unnaturalness.

3. FIG. 6 shows an example of a three-dimensional game space configured as an object space. Here, 22 is the sea as an environmental sound generation area, and 24 represents a sandy beach.

3-1. Purpose Environmental sounds that are difficult to handle as a general point sound source because they sound in a wide range, such as river water sounds and wave sounds,
B: Directivity (direction of sound source, distance) is felt at a distance from the sound source,
B: As you get closer to the sound source, the sound spreads to the left and right while leaving the directivity,
C: The sound spread becomes maximum at the position of the sound source.
It is an object of the present embodiment to reproduce the change in how the sound is heard in the object space without a sense of incongruity.

3-2. Characteristics A sound source group according to the present embodiment is arranged in a three-dimensional object space.

  In FIG. 6, reference numeral 26 denotes a movement path of the virtual camera 40. Reference numeral 28 denotes an example of a route along which the sound source group 50 to which the present invention is applied moves in the environmental sound generation area 22 following the virtual camera 40.

  The sound source group 50 according to the present embodiment can move freely within a limited environmental sound generation area such as “in the sea” or “in the river”, and always has the shortest distance from the virtual camera 40. Such a positional relationship is maintained.

  When entering the environmental sound generation area 22, both become the same coordinates and become “stick”.

3-3. FIG. 7 shows an example of a sound source group 50 used in the present embodiment.

  The sound source group 50 is configured by arranging a plurality of sound sources for generating a given environmental sound in association with the control point 52, and may be configured to include at least two or more sound sources. .

  In the present embodiment, as shown in FIG. 7, a virtual sound source object is assumed in which left and right sound sources 56R and 56L are arranged at the tips of virtual arms 54R and 54L extending from the control point 52 to the left and right. To do. As an object of this virtual sound source, the function of the sound source group 50 can be easily understood by imagining a structure in which arms 54R and 54L extending in the horizontal direction around the control point 52 freely rotate freely.

  The virtual arms 54R and 54L are configured such that the length thereof is expanded and contracted according to the surrounding conditions, and the relative positional relationship between the control point 52 and the sound sources 56R and 56L is changed, and the virtual arms 54R and 54L are further controlled by the control points. The angle formed through 52 (that is, the angle in the horizontal plane) can be varied according to the surrounding conditions. Furthermore, the sound source 56R is a sound source on the right side from the virtual camera, the sound source 56L is a sound source on the left side from the virtual camera, and the distance calculation between the virtual camera and each of these sound sources 56R and 56L is a normal arrangement sound source. The same method is used.

  The movement of the sound source group 50 is performed with reference to the control point 52 which is the center of the adjustment here.

  The sound source group 50 according to the present invention is not limited to this, and three or more sound sources may be arranged in a three-dimensional manner in association with the control point 52.

  The control point 52, each sound source 56R, 56L, and the like constituting the sound source group 50 are specified in a planar or three-dimensional arrangement using a local coordinate system, and the arrangement of the sound sources 56R, 56L with respect to the control point 52 is also controlled. Done.

3-4. Control of Sound Source Group 50 Next, environmental sound generation control for the sound source group 50 of the present embodiment configured as shown in FIG. 7 will be described. Specific examples are shown in FIGS. 8A, 8B, and 8C.

  Here, it is assumed that the sound source group 50 generates and outputs a sea wave sound as an environmental sound, and can freely move in the sea area, which is the environmental sound generation area 22. On the other hand, movement control is performed so as to maintain a positional relationship that is always the shortest distance.

  When the position of the sound source group 50 is set and controlled so as to maintain such a relationship, the straight line connecting the pair of left and right sound sources 56R and 56L of the sound source group 50 with respect to the line-of-sight direction 42 of the virtual camera 40 next. Are arranged so as to be orthogonal to each other, the arrangement of the sound sources 56R and 56L with respect to the control point 52 is controlled.

  By performing the above environmental sound generation control on the sound source group 50, the directivity (the direction and distance of the sound source) of the environmental sound can be sensed when the virtual camera 40 is far from the sound source group 50, and further the virtual camera As the sound source group 50 approaches the sound source group 50, it is possible to generate a clear environmental sound in which the right and left spread of the environmental sound increases while leaving directivity.

  When the virtual camera 40 moves into the environmental sound generation area 22, the sound source group 50 moves toward the virtual camera 40 while maintaining the above rules, and finally maintains a positional relationship in which both overlap. Then, when the virtual camera 40 and the sound source group 50 overlap in the environmental sound generation area 22, the environmental sound is generated so that the directivity of the environmental sound is lost, and the environmental sound having a spread in the environmental sound generation area 22 is generated. Can generate a situation that can be heard.

  In particular, by adopting the above configuration, as shown in FIG. 6, for example, when the virtual camera 40 moves along the movement path 26, the sound source group 50 moves in the environmental sound generation area 22 along the movement path 28. As described above, it is possible to generate an environment sound having a position and a spread according to the position and orientation of the virtual camera 40 as described above.

3-5. The relationship between the sound source group 50 and the final output volume from the pair of left and right speakers as the sound output unit 192 The final output volume actually output from the pair of left and right speakers is from the virtual camera 40 in the object space. Calculation is made based on the angle and distance to the pair of left and right sound sources 56R, 56L constituting the sound source group 50 (the front and rear direction is an absolute value).

  Here, it is assumed that the line-of-sight direction 42 of the virtual camera 40 is the 12 o'clock direction, the 3 o'clock direction is an angle 0, and the angle is counterclockwise. At this time, the sound source located at an angle of 0 degrees is output as audio only from the right speaker, the sound source positioned at an angle of 90 degrees and 270 degrees is output as an equal sound from the left and right speakers, and the sound source positioned at 180 degrees is output from the left speaker. The sound is output only from the speaker.

  Furthermore, the output volume from the speaker is controlled so that the volume decreases as the distance between the virtual camera 40 and each sound source 56R, 56L increases.

  9A to 9C show an example in which pond A and pond B exist as environmental sound generation areas, and sound source groups 50A and 50B associated with these ponds A and B exist. In addition to this, it is assumed that sound source groups 50C and 50D representing other timbres exist in FIG.

  9A to 9C show a state in which the virtual camera 40 slightly enters the pond B area. In an actual environment, it can be considered that the water sound of the pond originates from the entire surface of the pond. This is not reproduced with an infinite number of point sound sources (1 channel × n). In the present embodiment, the above-described sound source group 50 is used to change the coordinates according to the orientation of the virtual camera 40, and the environmental sound is naturally reproduced. It is possible to reproduce.

  In FIG. 9A, a sound source group 50 having the same width as the diameter of the pond A is arranged at the center of the pond A.

  Here, the rotation angle of the numerical sound source groups 50 </ b> A to 50 </ b> D is set so that the line connecting the sound sources 56 </ b> R and 56 </ b> L at both ends is orthogonal to the line-of-sight direction 42 of the virtual camera 40.

  At this time, assuming that the left sound source 56L of the sound source group 50B in the pond B has an angle of 120 degrees and a distance of 60 m, and the right sound source 56R has an angle of 85 degrees and a distance of 55 m, the sound source is localized, that is, the final output volume from the left and right speakers. As described above, is calculated based on these angles and distances.

  As shown in FIG. 9B, when the virtual camera 40 is slightly turned to the right from this state, the lines connecting the left and right sound sources 56R and 56L are also generated in the sound source groups 50A to 50D. The direction is controlled so as to be orthogonal to the line-of-sight direction 42. At this time, the left sound source 56L of the sound source group 50B has an angle of 150 degrees and a distance of 70 m, and the right sound source 56R has an angle of 110 degrees and a distance of 45 m, and the localization of the sound source, that is, the final output sound volume from the left and right speakers is calculated from these values.

  Further, as shown in FIG. 9C, when the virtual camera 40 turns to the right, the lines connecting the left and right sound sources 56R and 56L of the sound source groups 50A to 50D are also orthogonal to the line-of-sight direction 42 of the virtual camera 40. Thus, the sound source group 50 is rotationally controlled.

  In this way, by controlling the direction of the sound source group 50 in accordance with the direction of the virtual camera 40, the free movement of the virtual camera 40 is generated from the entire surface of the pond without using countless point sound sources. The environmental sound (water sound) can be reproduced.

  Moreover, the following effects can be obtained by this method.

  B: The width of the localization (optimal output volume from the left and right speakers) increases as the distance from the pond increases, and a sense of breadth and perspective that decreases as the distance increases can be expressed.

  B: It is possible to express the sense of expanse, perspective, and localization of the environmental sound when the pond is not directly facing (the pond is diagonally forward and behind the camera).

  C: It is possible to express the sense of spaciousness and localization of the environmental sound when entering the pond (the camera is between the right sound source 56R and the left sound source 56L).

  D: It is possible to express a sense of spread of environmental sound when standing at the center of the pond (a state in which the position of the virtual camera and the position of the sound source group 50 overlap).

3-6. Control point movable area 23 of the sound source group 50
In the environmental sound generation area 22 having a certain size or more such as sea, swamp, and lake, when the virtual camera 40 moves into the environmental sound generation area 22 as shown in FIG. As described above, the virtual camera 40 moves toward the virtual camera 40 and the two overlap each other.

  However, for example, when the environmental sound generation area 22 is like the sea, when a situation occurs in which the virtual camera 40 and the sound source group 50 overlap each other at the time of the wave, the sound of the waves is heard in the middle of the sea. It becomes a feeling like this, and a sense of incongruity occurs as an environmental sound at the beach.

  In order to prevent the occurrence of such a situation, in the present embodiment, the control point movable area 23 of the sound source group 50 is set in association with the environmental sound generation area 22 as shown in FIG.

  Specifically, the control point movable area 23 is set inside the environmental sound generation area 22.

  By doing so, for example, even when the virtual camera 40 located on the land moves to the position 40 'inside the sea ripening which is the environmental sound generation area 22, it moves to the control point movable area 23. As long as the sound source group 50 is not approached, the sound source group 50 approaches the virtual camera 40 ', but the two do not overlap.

  Therefore, in the virtual camera 40 ', the environmental sound of the waves can be heard from the direction of the sea, and it is possible to generate the environmental sound without a sense of incongruity.

  Such a control point movable area 23 is preferably set in an area that is one or two steps away from the wave of the environmental sound generation area 22.

3-7. Arrangement of Sound Sources 56R and 56L with respect to Control Point 52 of Sound Source Group 50 The control point 52 of the sound source group 50 moves within the control point movable area 23 with respect to the virtual camera 40 so as to always have the shortest distance.

  For example, in the state shown in FIG. 11A, the sound source group 50 of the wave sound moves to a position that is the shortest distance from the virtual camera 40 in the control point movable area. At this time, if the virtual arms 54R and 54L of the sound source group 50 are long and the left and right sound sources 56R and 56L protrude outside the environmental sound generation area 22 that is the sea, the waves from different directions from the environmental sound generation area 22 are generated. Occurrence of a situation where sound can be heard is also expected.

  For this reason, in this embodiment, as shown in FIG. 11A, when the sound sources 56R and 56L of the sound source group 50 are located outside the environmental sound generation area 22, as shown in FIG. As shown in B), a process of controlling the arrangement of the sound sources 56R and 56L with respect to the control point 52 is performed so that the sound sources 56R and 56L are located in the environmental sound generation area 22.

  Thereby, the environmental sound of the wave sound can be generated from the direction of the environmental sound generation area 22 with a predetermined spread, and it is possible to generate the environmental sound without any sense of incongruity from such a viewpoint.

3-8. Expansion and contraction of virtual arm of sound source group 50 As shown in FIG. 12, it is assumed that the virtual camera 40 and the environmental sound generation area 22 are located. In this case, the position in the object space of the control point 52 of the sound source group 50 that generates the environmental sound, for example, the sound of the waves, in the environmental sound generation area 22 moves in the movable area 23 and is the shortest distance from the camera 40. Is located.

  At this time, assuming that a mountain object 60 serving as an obstacle exists between the sound source group 50, for example, the right sound source 56R 'and the control point 52, the wave sound environment is maintained at the position of the virtual camera 40 as it is. It cannot be generated so that it can be heard well.

  In this case, in the present embodiment, when it is determined that there is no obstacle between the sound source 56 and the control point 52 and it is determined that the mountain object 60 that is an obstacle exists. The sound source 56R is moved to a position that avoids the mountain object 60 that is an obstacle.

  Thereby, even when the obstacle 60 exists between the sound source and the virtual camera, it becomes possible to generate the environmental sound from the environmental sound generation area 22 satisfactorily.

3-9. Audio output from left and right two-channel speakers FIG. 13 shows a specific example in the case where, for example, wave sound is output from left and right two-channel speakers.

  Four sound sources are secured for the right channel x2 and the left channel x2. As for the timbre of the environmental sound data, three environmental sound data for the right sound source 56R (right wave 1, wave 2, wave 3) and three patterns of environmental sound data for the left sound source 56L (for each environmental sound generation area) Left wave 1, wave 2, and wave 3) are prepared, and environmental sound data for the right sound source 56R and environmental sound data for the left sound source 56L are randomly selected and output. In this embodiment, each pattern is configured as a single file that is keyed off in 5 seconds after key-on.

  And the timing which outputs each environmental sound data is set as the interval of 5 second +/- 2 second in this Embodiment. Thereby, the sound of the wave can be generated as the environmental sound from the two left and right channels while producing a fluctuation effect. In the example of FIG. 13, the output timing of the environmental sound data for the left sound source 56L and the environmental sound data for the right sound source 56R is the same, but the output timing may be shifted between the left and right channels. By adopting such a configuration, the wave sound can be made more random, and a realistic wave sound close to a natural wave sound can be reproduced.

  At this time, the localization of the sound sources output from the right speaker and the left speaker for each of the sound sources 56R and 56L of the sound source group 50 (the final output volume from the left and right speakers) is the same as that of each sound source 56 as described above. It is calculated from the angle and distance from the camera 40.

  FIG. 14 is an example in the case of outputting river sounds from a pair of left and right speakers. In this case, two sound sources are secured for the right channel × 1 and the left channel × 1. Here, the sound of the river is formed as a loop file and continues to be output until it is keyed off from the program.

4). Processing of this embodiment Next, a detailed processing example of this embodiment will be described with reference to the flowchart shown in FIG. In this example, the movement calculation of the sound source group 50 is performed so that the control point 52 of the sound source group 50 moves on a predetermined movement route.

  First, when an environmental sound reproduction command is generated in the game space (step S10), information on the movement path of the sound source group 50 in the environmental sound generation area 22 is acquired (step S12).

  Then, the sound source group 50 for generating the corresponding environmental sound is arranged in the movable area 23 (step S14), and then the movement route in which the distance from the virtual camera 40 is the shortest in the movable area 23. The coordinates of the upper point are acquired (step S16), and the control point 52 of the sound source group 50 is moved toward this coordinate (steps S18 and S20).

  Next, the orientation of the virtual camera 40 is acquired (step S22), and the orientation of the sound source group 50 is such that the straight line connecting the pair of left and right sound sources 56R and 56L of the sound source group 50 is orthogonal to the line-of-sight direction 42 of the virtual camera 40. Is controlled (step S24).

  That is, for example, as shown in FIG. 8, the sound source group 50 moves to a position that is the shortest distance from the virtual camera 40 and connects the sound sources 56 </ b> R and 56 </ b> L of the sound source group 50 to the line-of-sight direction 42 of the virtual camera 40. The direction of the sound source group 50 is controlled so that the straight lines are orthogonal.

  When the virtual camera 40 is located within the control point movable area 23 of the environmental sound generation area 22, the virtual camera 40 and the sound source group 50 are controlled so that their coordinate positions overlap.

  Next, in step S26, the coordinates of the pair of sound sources 56R and 56L of the sound source group 50 are acquired, and the coordinate positions are in the situation shown in FIG. 11A described above, or as indicated by 56R 'in FIG. It is determined whether or not the position where the obstacle 60 exists is present, and it is determined whether or not correction of this coordinate position is necessary from such a determination result.

  If it is determined that correction is necessary, the coordinate position of the corresponding sound source is corrected so as to eliminate the problems shown in FIGS. 11 and 12 (step S30).

  Next, the distance and angle from the virtual camera 40 to each of the sound sources 56R and 56L are acquired (step S32), thereby calculating the output volume to the left and right speakers (step S34), and the corresponding environmental sound from these left and right speakers. Is output (step S36).

  Such a series of processes shown in steps S16 to S36 is repeated until it is determined in step S38 that the reproduction is finished.

  As a result, in the object space, the environmental sound generated from the environmental sound generation area can be reproduced as a wide natural sound and enjoy a game.

5). Modifications The present invention is not limited to the above-described embodiment, and various modifications can be made within the scope of the gist of the present invention.

  For example, in the above-described embodiment, the sound source group has been described as an example in which a pair of left and right sound sources are arranged with respect to the control point. However, the present invention is not limited to this, and three or more sound sources are arranged. It can also be applied to.

  In the above embodiment, the sound source having one control point has been described as an example. However, the present invention is not limited to this. For example, as shown in FIG. 15, a group of sound sources is formed by connecting a plurality of joints. It is also possible to adopt. In this case, for example, each joint may be used as the control point 52 of the sound source group 50, and a pair of left and right sound sources 56R and 56L may be arranged on both sides of the control point 52 in the same manner as the sound source group shown in FIG. When such an articulated sound source group 50 is employed, the sound source is arranged in the environmental sound generation area 22 where, for example, a river sound is generated, and the virtual camera 40 moves along the movement path 26. The sound source group 50 also moves within the movable area 23 so that the distance from the virtual camera 40 is the shortest distance.

  At this time, the control points used for controlling the non-uniform sound source group 50 may be determined by using representative control points from among the plurality of control points 52-1 to 52-5. You may obtain | require and use the average coordinate of a position.

  At this time, the direction of the pair of left and right sound sources 56R and 56L arranged at both ends of each of the control points 52-1 to 52-5 is controlled so that the straight line connecting them is perpendicular to the line-of-sight direction of the virtual camera 40. Needless to say.

6). Hardware Configuration FIG. 17 shows an example of a hardware configuration capable of realizing this embodiment. The main processor 900 operates based on a program stored in a DVD 982 (information storage medium, which may be a CD), a program downloaded via the communication interface 990, a program stored in the ROM 950, or the like. Perform processing, sound processing, etc. The coprocessor 902 assists the processing of the main processor 900, and executes matrix operation (vector operation) at high speed. For example, when a matrix calculation process is required for a physical simulation for moving or moving an object, a program operating on the main processor 900 instructs (requests) the process to the coprocessor 902.

  The geometry processor 904 performs geometry processing such as coordinate conversion, perspective conversion, light source calculation, and curved surface generation based on an instruction from a program operating on the main processor 900, and executes matrix calculation at high speed. The data decompression processor 906 performs decoding processing of the compressed image data and sound data and accelerates the decoding processing of the main processor 900. Thereby, a moving image compressed by the MPEG method or the like can be displayed on the opening screen or the game screen.

  The drawing processor 910 executes drawing (rendering) processing of an object composed of primitive surfaces such as polygons and curved surfaces. When drawing an object, the main processor 900 uses the DMA controller 970 to pass the drawing data (vertex data and other parameters) to the drawing processor 910 and, if necessary, the texture to the texture storage unit 924. Forward. Then, the drawing processor 910 draws the object in the frame buffer 922 while performing hidden surface removal using a Z buffer or the like based on the drawing data and texture. The drawing processor 910 also performs α blending (translucent processing), depth cueing, mip mapping, fog processing, bilinear filtering, trilinear filtering, anti-aliasing, shading processing, and the like.

  The sound processor 930 includes a multi-channel ADPCM sound source and the like, generates game sounds such as BGM, sound effects, and sounds, and outputs them through the speaker 932. Data from the game controller 942 and the memory card 944 is input via the serial interface 940.

  The ROM 950 stores system programs and the like. In the case of an arcade game system, the ROM 950 functions as an information storage medium, and various programs are stored in the ROM 950. A hard disk may be used instead of the ROM 950. The RAM 960 is a work area for various processors. The DMA controller 970 controls DMA transfer between the processor and the memory. The DVD drive 980 (may be a CD drive) accesses a DVD 982 (may be a CD) in which programs, image data, sound data, and the like are stored. The communication interface 990 performs data transfer with the outside via a network (communication line, high-speed serial bus).

  Note that the processing of each unit (each unit) of the present embodiment may be realized entirely by hardware, or by a program stored in an information storage medium or a program distributed via a communication interface. May be. Alternatively, it may be realized by both hardware and a program.

  When the processing of each part of the present embodiment is realized by both hardware and a program, a program for causing the hardware (computer) to function as each part of the present embodiment is stored in the information storage medium. The More specifically, the program instructs the processors 902, 904, 906, 910, and 930, which are hardware, and passes data if necessary. Each processor 902, 904, 906, 910, 930 realizes the processing of each unit of the present invention based on the instruction and the passed data.

  The present invention is not limited to the one described in the above embodiment, and various modifications can be made.

  Moreover, it is not limited to what was demonstrated in this Embodiment, The method equivalent to these is also contained in the scope of the present invention.

  The present invention can also be applied to various games (such as fighting games, shooting games, robot fighting games, sports games, competitive games, role playing games, music playing games, dance games, etc.).

It is a functional block diagram of this Embodiment. It is explanatory drawing of the method using the conventional single sound source. It is explanatory drawing of the production | generation method of the conventional environmental sound. It is explanatory drawing of the production | generation method of the conventional environmental sound. It is explanatory drawing of the production | generation method of the conventional environmental sound. It is explanatory drawing of object space. It is explanatory drawing of a sound source group. It is explanatory drawing of the control method of a sound source group. It is explanatory drawing of the control method of a sound source group. It is explanatory drawing of the movable area of a sound source group. It is explanatory drawing of the process which correct | amends the sound source position of a sound source group. It is explanatory drawing of the process which correct | amends the sound source position of a sound source group. It is explanatory drawing in the case of outputting the produced | generated environmental sound. It is explanatory drawing in the case of outputting the produced | generated environmental sound. It is a flowchart figure which shows an example of the process of this Embodiment. It is explanatory drawing of the modification of this invention. It is explanatory drawing of a hardware structure.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Processing part 110 Game calculation part 111 Object space setting part 113 Virtual camera control part 120 Image generation part 130 Sound generation part 140 Environmental sound information calculation part

Claims (13)

An object space setting unit for setting a sound source group for generating a given environmental sound in the object space;
A virtual camera control unit that controls at least one of the position and orientation of the virtual camera in the object space;
Based on the control point information associated with the sound source group and the control information of the virtual camera, the computer functions as an environmental sound information calculation unit that calculates information for changing the position of each sound source with respect to the control point. A program characterized by that. In claim 1,
The environmental sound information calculation unit is
A program for calculating information for changing a position corresponding to the control point in the object space based on the control information of the virtual camera. In claim 2,
The environmental sound information calculation unit is
A program for calculating information for changing a position corresponding to the control point in the object space within an area included in an environmental sound generation area that is an area for generating the environmental sound in the object space. . In any one of Claims 1-3,
The environmental sound information calculation unit is
When the position of the sound source changed based on the calculated information is outside the environmental sound generation area that is an area for generating the environmental sound in the object space, the position of the sound source is corrected within the environmental sound generation area. A program characterized in that it calculates correction information for the purpose. In claim 4,
The environmental sound information calculation unit is
A program for calculating information for changing a position corresponding to a control point in the object space so as to approach the position of the virtual camera when the position of the virtual camera approaches the environmental sound generation area . In any one of Claims 1-5,
The environmental sound information calculation unit is
A program for calculating correction information for correcting a position of a sound source when an obstacle exists between a position corresponding to a control point in the object space and the sound source. In any one of Claims 1-6,
The sound source group is configured such that the control point and a pair of sound sources form a straight line,
The environmental sound information calculation unit is
A program for obtaining a rotation amount around the control point of the pair of sound sources so that a line-of-sight direction of the virtual camera and a straight line connecting the pair of sound sources are orthogonal to each other. In claim 7,
The environmental sound information calculation unit is
The sound volume output from each sound source is set based on the distance of each sound source to the virtual camera, and the sound source of each sound source is determined based on the viewing direction of the virtual camera and the direction connecting the virtual camera and each sound source. A program characterized by output distribution. In any one of Claims 1-8,
A program characterized in that the timbres of the sound sources are set to different timbres. In any one of Claims 1-9,
A plurality of environmental sounds generated in the object space are prepared,
The object space setting unit
A program for setting a sound source group corresponding to the environmental sound in an object space. An object space setting unit for setting a sound source group for generating a given environmental sound in the object space;
A virtual camera control unit that controls at least one of the position and orientation of the virtual camera in the object space;
A program that causes a computer to function as an environmental sound information calculation unit that calculates information for changing the position of each sound source based on control information of the virtual camera.   A computer-readable information storage medium storing the program according to claim 1. An object space setting unit for setting a sound source group for generating a given environmental sound in the object space;
A virtual camera control unit that controls at least one of the position and orientation of the virtual camera in the object space;
A game system comprising: an environmental sound information calculation unit that calculates information for changing the position of each sound source based on control information of the virtual camera.