JP2007289713A - Virtual three dimensional sound image formation apparatus, its method, and medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a virtual three dimensional sound image formation apparatus based on new conception which positively uses a sound for the development of a game. <P>SOLUTION: The virtual three dimensional sound image formation apparatus comprises an object information storage means 202 which memorizes physical information on a virtual object arranged in a virtual three-dimensional space and information on the material of the virtual object, an operating means 2 for controlling movement of a character and a sound marker within the virtual space for executing the emission direction of a sound source object of the character and sound emission control of the sound source object and the sound marker, a sound source storage means 203 which memorizes information about each sound source, two or more sound conversion means 204 which convert an acoustic signal into an audible sound, and a sound image processing means 205 which gives to the sound conversion means after variable controlling the sound information on the sound source object and the sound marker according to the location of the virtual space of the sound source object and the sound marker, information on the virtual object within the virtual three-dimensional space, and information about the material of the virtual object and forming an audible acoustic signal in the predetermined location and direction within the three-dimensional space. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a three-dimensional sound image generation apparatus, method and medium thereof, and more particularly to a virtual three-dimensional sound image generation apparatus method and medium for developing a game with a focus on a player's hearing.

  As this type of virtual three-dimensional sound image generation device, an object storage unit that stores three-dimensional object information, a sound source storage unit that stores sound source information, information on objects such as walls stored in these storage units, A central processing unit that forms an acoustic signal for generating information that reaches the player's position as the sound source information and the game progress, and a speaker that converts the acoustic signal formed by the central processing unit into an audible sound A device including a display means for displaying a game image and an operation panel for moving a character displayed on the display means is known (for example, Japanese Patent Laid-Open No. 4-316168).

According to such a virtual three-dimensional sound image generating device, various sound effects are heard in a state where the user exists at the position and direction in which the character on the display means is moved on the operation panel. Can get a sense of virtual reality.
JP-A-4-316168

  However, the above-described conventional virtual three-dimensional sound image generation device simply reproduces the sound at the position and orientation that would be heard in the relative positional relationship between the character and the other object. Although virtual reality can be gained more than conventional game devices, sound is only a tool for making game development effective like other conventional game devices. It was not the idea of developing a game.

  An object of the present invention is to provide a virtual three-dimensional sound image generation device based on a novel idea that uses sound actively for game development, a method thereof, and a medium.

  An object of the present invention is to provide a virtual three-dimensional sound image generating apparatus, a method thereof, and a medium that allow a player to develop a game from a change in information of sound by arbitrarily moving a sound source.

  In order to achieve the above object, a virtual three-dimensional sound image generation device according to the present invention is a virtual three-dimensional sound image generation device that forms a sound image in a virtual space, and a physical object of a virtual object arranged in the virtual three-dimensional space. Object information storage means for storing information and information related to the material of the virtual object, operation means for controlling the movement of the player character in the space of the virtual object arranged in the virtual space and controlling the firing direction and sound generation of the sound source object, Sound source storage means for storing information related to the sound source of the sound source object, a plurality of sound conversion means for converting the acoustic signal into audible sound, a position of the character sound source object in the space by the virtual object, in a virtual three-dimensional space According to information on the arranged virtual object and information on the material of the virtual object, the character's acoustic object is displayed. And a sound image processing means that is formed into an acoustic signal that allows the sound information to be heard at a predetermined position and orientation in the three-dimensional space and is applied to the acoustic conversion means. It is what.

  In order to achieve the above object, a virtual three-dimensional sound image generation device according to the present invention is a virtual three-dimensional sound image generation device that forms a sound image in a virtual space, and a physical object of a virtual object arranged in the virtual three-dimensional space. Object information storage means for storing information and information on the material of the virtual object, operation means for controlling movement of the sound marker in the space by the virtual object arranged in the virtual space, and sound generation control, and a sound source of the sound marker A sound source storage means for storing information, a plurality of acoustic conversion means for converting the acoustic signal into an audible sound, a position of the sound marker in a space by a virtual object, information on a virtual object arranged in a virtual three-dimensional space, and The acoustic information of the sound marker is variably controlled according to information on the material of the virtual object constituting the structure, and a predetermined position in the three-dimensional space and It is characterized in that a sound image processing means for sound is formed in the acoustic signal to be able to listen given to the acoustic transducer means in the gas.

  In order to achieve the above object, a virtual three-dimensional sound image generation device according to the present invention is a virtual three-dimensional sound image generation device that forms a sound image in a virtual space, and a physical object of a virtual object arranged in the virtual three-dimensional space. Object information storage means for storing information and information related to the material of the virtual object, movement control of the player character and sound marker in the space of the virtual object arranged in the virtual space, and the firing direction of the sound source object, or the sound source object and Operation means for controlling sound marker sound generation, sound source storage means for storing information relating to the sound source object of the character and the sound marker, a plurality of sound conversion means for converting the acoustic signal into an audible sound, and the sound source of the character Relative position in space by virtual object of object and sound marker, placed in virtual 3D space The acoustic information of the sound source object and / or the sound marker of the character is variably controlled in accordance with the information on the virtual object and the information on the material of the virtual object constituting the structure, and a predetermined position in the three-dimensional space. And a sound image processing means which is formed into an acoustic signal that allows the sound to be heard in the direction and is given to the acoustic conversion means.

  In the present invention, when the sound image processing means determines that the sound marker has moved in the space of the virtual object and collided with the virtual object according to the operation command from the operation means, the sound image processing means performs sound according to the material information of the object. Means for changing acoustic information belonging to the marker is provided.

  In the present invention, the sound image processing means includes means for forming the moving state of the character in the space by the virtual object into acoustic information in a state in which the sound has moved.

  In the present invention, the acoustic conversion means is capable of reproducing a three-dimensional sound.

  In order to achieve the above object, a virtual three-dimensional sound image generation method according to the present invention is a virtual three-dimensional sound image generation method for forming a sound image in a virtual space, and is arranged in a virtual space based on an operation command from an operation means. The player character is controlled to move in the space by the virtual object, and the sound source object's launch direction and sound generation are controlled, and the position of the sound source object of the character in the virtual object is placed in the virtual three-dimensional space. The acoustic information of the character is variably controlled according to information on the virtual object and information on the material of the virtual object, and the sound can be heard at a predetermined position and orientation in the three-dimensional space. It is what.

  In order to achieve the above object, a virtual three-dimensional sound image generation method according to the present invention is a virtual three-dimensional sound image generation method for forming a sound image in a virtual space, and is arranged in a virtual space based on an operation command from an operation means. The player character is controlled to move in the space by the virtual object, and the sound source object's launch direction and sound generation are controlled, and the position of the sound source object of the character in the virtual object is placed in the virtual three-dimensional space. The acoustic information of the character is variably controlled according to information on the virtual object and information on the material of the virtual object, and the sound can be heard at a predetermined position and orientation in the three-dimensional space. It is what.

  In order to achieve the above object, a virtual three-dimensional sound image generation method according to the present invention is a virtual three-dimensional sound image generation method for forming a sound image in a virtual space, and is arranged in a virtual space based on an operation command from an operation means. The placement of the sound marker in the space of the virtual object, the sound control of the sound marker, the position of the sound marker in the space by the virtual object, and the information on the virtual object placed in the virtual three-dimensional space The sound marker acoustic information is variably controlled in accordance with information on the material of the virtual object, and the sound can be heard at a predetermined position and orientation in the three-dimensional space. .

  In order to achieve the above object, a virtual three-dimensional sound image generation method according to the present invention is a virtual three-dimensional sound image generation method for forming a sound image in a virtual space, and is arranged in a virtual space based on an operation command from an operation means. The player character and the sound marker are controlled to move in the space by the virtual object and the sound source object is emitted or the sound source object and the sound marker are controlled to be sounded. The acoustic information of the sound source object and / or the sound marker of the character is variably controlled according to the position, information on the virtual object arranged in the virtual three-dimensional space and information on the material of the virtual object constituting the structure, and It is characterized in that sound can be heard at a predetermined position and orientation in a three-dimensional space. It is.

  The present invention is characterized in that it is a medium recording a program that causes a computer to function as the processing unit and the data device.

  Here, the medium is a medium in which information (for example, a game program) is stored by some physical means, and a predetermined function, for example, the execution of a game program is performed on an information processing apparatus such as a game apparatus. It can be done.

  For example, CD-R, game cartridge, floppy (registered trademark) disk, magnetic tape, magneto-optical disk, CD-ROM, DVD-ROM, DVD-RAM, ROM cartridge, battery backup RAM, flash memory, nonvolatile cartridge, etc. including.

  The medium also includes a communication medium such as a wired communication medium such as a telephone line and an optical cable, and a wireless communication medium. The Internet is also included in the communication medium here.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

〔Constitution〕
FIG. 1 is a block diagram showing an outline of a game device to which a virtual three-dimensional sound image generating device according to an embodiment of the present invention is applied. In FIG. 1, the game device includes a processing device main body 1, an operation device 2, a display 3, and a plurality of speakers 4 and 4.

  The processing apparatus main body 1 includes a CPU block 10 that controls the entire apparatus, a video block 11 that controls display of a game screen, a sound block 12 that generates sound effects, a subsystem 13 that reads out a CD-ROM 5, and the like. It is configured.

  The CPU block 10 includes an SCU (System Control Unit) 100, a main CPU 101, a RAM 102, a ROM 103, a sub CPU 104, a CPU bus 105, and the like.

  The main CPU 101 controls the entire apparatus. The main CPU 101 has an arithmetic function similar to that of a DSP (Digital Signal Processor) inside, and can execute application software at high speed. The RAM 102 is used as a work area for the main CPU 101. In the ROM 103, an initial program for initialization processing and the like are written. The SCU 100 smoothly performs data input / output between the main CPU 101, the VDP 120, 130, the DSP 140, the CPU 141, and the like by controlling the buses 105, 106, and 107. Further, the SCU 100 includes a DMA controller therein, and can transfer sprite data during the game to the VRAM in the video block 11. Thereby, application software such as a game can be executed at high speed.

  The sub CPU 104 is called SMPC (System Manager & Peripheral Control) and has a function of collecting via the operation device (peripheral) 2 in response to a request from the main CPU 101. Based on the operation (peripheral) data received from the sub CPU 104, the main CPU 101 performs processing such as moving a character on the game screen, for example. The sub CPU 104 has a function of automatically recognizing the type of peripheral connected to the connector 6 and collecting peripheral data and the like according to a communication method corresponding to the type of peripheral.

  The video block 11 includes a VDP (Video Display Processor) 120 for drawing a character or the like made of polygon data of a video game, and a VDP 130 for drawing a background screen, combining polygon image data and a background image, clipping processing, and the like. Yes. The VDP 120 is connected to the VRAM 121 and the frame buffers 122 and 123. Polygon drawing data representing a video game machine character is sent from the main CPU 101 to the VDP 120 via the SCU 100 and written to the VRAM 121. The drawing data written in the VRAM 121 is drawn in the drawing frame buffer 122 or 123 in a format of 16 or 8 bits / pixel, for example. The drawn data in the frame buffer 122 or 123 is sent to the VDP 130. Information for controlling drawing is provided from the main CPU 101 to the VDP 120 via the SCU 100. Then, the VDP 120 executes drawing processing according to this instruction.

  The VDP 130 is connected to the VRAM 131, and image data output from the VDP 130 is output to the encoder 160 via the memory 132. The encoder 160 generates a video signal by adding a synchronization signal or the like to the image data and outputs the video signal to the display 3. Thereby, a game screen is displayed on the display 3.

  The sound block 12 includes a DSP 140 that performs speech synthesis in accordance with the PCM method or the FM method, and a CPU 141 that controls the DSP 140 and the like. The audio data generated by the DSP 140 is converted into a multi-channel analog acoustic signal by the D / A converter 170 and then amplified by the power amplification circuits 6 and 6 and output to the plurality of speakers 4 and 4, respectively.

  The sub-system 13 has functions for reading application software supplied in the form of the CD-ROM 5, reproducing video data and audio data, and the like.

[Function block]
FIG. 2 is a block diagram showing the virtual three-dimensional sound image generating apparatus. In FIG. 2, the virtual three-dimensional sound image generating apparatus 201 includes an object information storage unit 202 that stores physical information of a virtual object arranged in the virtual three-dimensional space and information on the material of the virtual object, and a virtual space. Operating means 2 for controlling the movement of the character's sound source object, the sound source object's sound source object, and the sound marker's pronunciation control, and the character and the sound source object. Sound source storage means 203 for storing information related to each sound source, a plurality of sound conversion means 204 for converting the sound signal into audible sound, and an object placed in the virtual space of the sound source object and / or sound marker of the character Position in space, information on virtual objects placed in virtual three-dimensional space, and virtual objects The acoustic information of the sound source object or the sound marker of the character is variably controlled according to the information on the material of the character, and the acoustic signal is formed into an acoustic signal that allows the sound to be heard at a predetermined position and orientation in the three-dimensional space. It comprises sound image processing means 205 given to the conversion means 204.

  The acoustic conversion means 204 includes a plurality of speakers 4 and 4, power amplification circuits 6 and 6 that drive the plurality of speakers 4 and 4 by amplifying the output signal from the D / A converter 170, and these It comprises a D / A converter 170 for supplying acoustic signals to the power amplifier circuits 6 and 6, respectively.

  Here, the sound image processing means 205 is realized as follows. That is, the main CPU 101 first develops a program stored in the CD-ROM 5 in the RAM 102. The main CPU 101 executes the program developed in the RAM 102 and controls the operations of the video block 11 and the sound block 12 while taking in and processing the operation data from the operation device 2, thereby obtaining the sound image processing means 205. Is realized. The physical information of the virtual object arranged in the virtual three-dimensional space and the information related to the material of the virtual object are stored in the object information storage area in the RAM 102. Similarly, information related to the sound source of the character and the sound source object is also stored in the sound source storage area in the RAM 102. When all information cannot be stored in the RAM 102, data up to a predetermined scene of the scene in the game development may be extracted from the CD-ROM 5 and developed in a desired area of the RAM 102.

[Game Overview]
FIG. 6 is a configuration diagram illustrating an example of a space configured by objects arranged in a virtual space used in a game. In this figure, a plan view of the building 250 is shown. The game is intended to reach the player character 410 from the start point 251 to the goal point 252 of the building 250.

  The configuration of the building 250 will be described. The building 250 is surrounded by outer walls 253, 254, 255, and 256. In addition, rooms 261, 262, 263, and 264 are provided inside the building 250. The room 261 is configured by surrounding a predetermined area with wall surfaces 271, 272, 273, and 274. The room 262 is configured by surrounding a predetermined area with wall surfaces 274, 275,. The room 263 is configured by surrounding a predetermined area with wall surfaces 282, 283, 284, and 285. The room 264 is configured by surrounding a predetermined area with wall surfaces 285, 286, 287, 285.

  A door 290 is attached to the wall surface 274 of the room 261, so that it can only go to and from the room 262. The room 262 is provided with a door 291 on the wall surface 277, and can be moved between the hallway 303 and the room 262. The room 263 is provided with a door 292 on the wall surface 284 and a door 293 on the wall surface 285, and the door 292 moves between the hallway 301 and the room 263, and the door 293 moves between the room 263 and the room 264. Can do. In the room 264, a door 294 is provided on the wall surface 287, and the door 294 can go between the hallway 305 and the room 264.

  The hallway 301 is connected to the hallways 302, 303, 304, and 305. The hallway 306 is connected to the hallways 302, 304, and 305.

  For example, an enemy character 420 may be disposed near the corridors 301 and 305.

  The space configured by arranging virtual objects such as walls and doors in the virtual space as described above is in a situation where the field of view is dark and indistinguishable as if the field of view is muddy. Therefore, the game screen is hardly displayed on the display 5.

  By the way, the medium packed in the space composed of virtual objects in this game has an amazing acoustic propagation capability, and has the condition that the acoustic propagation speed is extremely slow. In this space, the player character 410 has a sound source object 411 that can emit directional sound waves in the front, rear, left, and right directions. Further, the player character 410 has a plurality of types of sound markers 412, 412,... So that the sound marker 412 can be thrown or placed. In addition, it is assumed that the sound emitted from the sound source object 411 and the sound marker 412 is modulated according to the properties of the object.

  The player aims at reaching the goal point 252 from the start point 251 in the space by operating the operation device 2 to move the character. On the way, the enemy character 420 may appear. Since the attack may have another mate, it is assumed that the opponent is confirmed with sound waves.

  When the sound wave emitted from the means capable of emitting this sound wave is reflected, it can be seen that some object exists in the direction in which the reflected sound returns, and no object exists in the direction in which the reflected sound does not return. Further, by sensing the intensity of the reflected sound, the distance between the player character 410 and the object can be assumed. For example, if a sound wave is emitted to the upper side of the corridor 301 in the figure, there is no reflected sound, and therefore no object is present. On the other hand, if it is launched toward the wall surface 272, the reflected sound can be heard immediately and the reflected sound is loud, so that it can be determined that there is an object in the immediate vicinity.

  The sound marker 412 can emit various sounds such as continuous sounds and pulse sounds. Some of the sound markers 412 generate special sounds. Further, the player character 410 can operate the sound marker 412. Further, the player character 410 can control the on / off of the sound of the sound marker 412. In practice, this can be instructed by the player operating the operation device 2. In addition, the sound marker 412 can be dropped at various points in order to prevent the same place from being passed many times or to avoid falling into a dead end.

  Then, when the player character 410 stands at the start point 251, for example, an image image 500 of a corridor as shown in FIG. 7 is displayed on the display 5, and a situation in which the player character 410 has to enter a dark corridor is given. Then, when the player enters the player character, the player character is advanced toward the goal point 252 while confirming the state of the sound in a situation where an image is hardly displayed on the display 5.

  In the object information storage means 202, arrangement (three-dimensional) data of the outer walls 253 to 256, wall surfaces 271 to 282, doors 290 to 294, arrangement (three-dimensional) data (not shown) of the floor, ceiling, etc. Data on members 253 to 256, 271-282, 290 to 294, floor and ceiling materials, data on corridors 301 to 306, arrangement (three-dimensional) data of enemy characters 420, and the like are stored. The sound source storage unit 203 stores data relating to the sound of the player character 410 and the sound source object.

[Sound image processing operation by sound source object of player character]
Next, the sound image processing operation by the sound source object possessed by the player character in the embodiment will be described with reference to FIGS. 1 to 3, 6, and 7. FIG. Here, FIG. 3 is a flowchart for explaining the sound image processing by the sound source object possessed by the player character.

  The sound image processing is advanced on the assumption that the player character 410 is in the virtual three-dimensional space of the orthogonal coordinate system (X, Y, Z). A point where the player character 410 stands is a local point, and these local points are X0, Y0 and Z0.

  Then, when the player thinks that the player character 410 has investigated what is in a certain direction from the point where the player character 410 is standing, the player emits sound waves from the sound source object 411 held by the player character 410 in the direction to be investigated.

As a result, the main CPU 101 executes the flowchart shown in FIG. For example, assume that a sound wave is emitted in the X-axis direction. In order to reduce the burden on the main CPU 101, the progress of the sound wave is processed on the assumption that the predetermined region D advances on the X axis in accordance with the traveling speed of the sound wave in the X axis direction. This region D is expressed as, for example, {Y ² + Z ² = K ² }, and is processed as a disk having a radius K moves at a speed at which sound waves travel in the space.

  First, the main CPU 101 changes the value of the X axis in accordance with the traveling speed in order to advance the region D according to the traveling speed of the sound wave (S301). As already explained, although the medium packed in the space has a tremendous acoustic propagation capability and the acoustic propagation speed is extremely slow, the attenuation of the acoustic amplitude is dependent on the distance. Proportional.

  The main CPU 101 changes the value of the X axis under the above conditions and moves the region D in an equivalent manner to the traveling speed of the sound wave by arranging the region D at the coordinate position where the sound wave reaches after a predetermined time. Then, the object information storage unit 202 of the RAM 102 is searched based on the coordinate position, and it is determined whether there is an object at the coordinate position (S302). When determining that there is no object at the coordinate position of the area D (S302; NO), the main CPU 101 determines whether the sound wave has reached the reachable limit distance (S303). Here, the “arrival limit distance” means a distance in which the sound wave cannot reach the position of the player character 410 even if the sound wave amplitude is gradually attenuated and reflected while the sound wave travels in the medium. .

  Here, when the main CPU 101 determines that the area D has not reached the reach limit distance (S303; YES), the main CPU 101 determines whether attenuation processing has already been performed (S304). When determining that the attenuation process is not performed (S304; NO), the main CPU 101 gives a command to the sound block 12 to extinguish the sound wave emitted from the sound source object 411 while attenuating (S305). As a result, a sound image is reproduced from the speakers 4 and 4 in a state in which sound waves are emitted from the sound source object 411 at hand of the player character 410, for example, a state in which the sound disappears immediately after the emission sound is heard. Then, the main CPU 101 proceeds to the process again at step S301.

  Then, the main CPU 101 changes the value of the X axis in accordance with the traveling speed of the sound wave, that is, the value of the X axis so as to be the distance on the X axis where the sound wave reaches after a certain time (S301). Thereby, the region D has moved to a position advanced on the X axis from the previous position. The main CPU 101 searches the object information storage unit 202 of the RAM 102 based on the coordinate position of the area D, and determines whether there is an object at the coordinate position (S302). When determining that there is no object at the coordinate position of the area D (S302; NO), the main CPU 101 determines again whether the area D has reached the reach limit distance (S303). When the main CPU 101 determines that the area D has not reached this reachable limit distance (S303; NO), it is determined whether attenuation processing has already been performed (S304). Since the main CPU 101 determines that this process has already been executed (S304; YES), the main CPU 101 shifts the process to step S301 again.

  The main CPU 101 repeats the processing of steps S301 to S304 or S305.

  Here, when the main CPU 101 repeatedly executes steps S301 to S304 and the main CPU 101 determines that the region D (sound wave) has reached the reach limit distance (S303; YES), the process exits this process. At this time, since the player does not know the attenuation characteristic of the sound wave amplitude at first, in order to notify the player that the sound wave has reached the reachable limit distance, a command is issued to the video block 11 and blinked on the sound source object 411, for example. Alternatively, a special sound may be emitted by giving a command to the sound block 12. By doing so, the player can grasp the sense of the reach limit distance by the sound wave, and can use that sense in the next stage.

  On the other hand, the main CPU 101 repeatedly executes the processing of steps S301 to S304, the main CPU 101 searches the object information storage unit 202 of the RAM 102 based on the coordinate position, and sets the coordinate position of the region D to the coordinate position. When it is determined that there is an object (S302; YES), data relating to the property of the object is extracted from the object information storage unit 202 of the RAM 102 (S306). Then, the main CPU 101 determines whether or not the property of the object is reflected from the data (S307). If it is not reflected (S307; NO), the main CPU 101 proceeds to the determination of the reachable limit distance in step 303. . This is because, in the case of an object that does not reflect sound waves, the sound waves are transmitted or attenuated within the object, and can be handled in the same manner as when there is no object at all.

  When the main CPU 101 determines that the object is a reflection object based on the data (S307; YES), the distance between the sound source object 411 and the object is calculated (S308). Then, the main CPU 101 forms a command for reflecting the reflected sound from the object based on the calculation result and outputting the sound wave in an attenuation state based on the reciprocating distance (S309).

  When the main CPU 101 determines that the object is a modeled object such as a wall from the data on the properties of the object (S310; YES), the main CPU 101 outputs the sound quality emitted from the sound source object 411 together with the instruction in step 309. To the sound block 12. As a result, after a certain period of time has elapsed since the launch, a reflected sound of exactly the same sound quality is heard from the direction of the sound wave emitted from the sound source object 411, and the amplitude of the sound wave is reduced according to the distance. A sound image is given to the player. As a result, the player has a wall in the direction of the player character 410 toward the sound source object 411, and the distance to the wall corresponds to the time when the reflected sound is heard after the sound wave is emitted from the sound source object 411. Understand that they are half the distance away.

  On the other hand, when the main CPU 101 determines that the object is not a shaped object such as a wall from the data regarding the property of the object (S310; YES), the main CPU 101 checks a registration area in which data regarding the object that has appeared in the past is registered. When the data relating to the property of the object is matched with the data in the registration area and it is determined that they are not the same (S312; NO), a command for changing the sound quality from the sound quality that has come out so far is formed. At the same time, it is supplied to the sound block 12 (S313). As a result, after a certain period of time has elapsed since the launch, the reflected sound is heard from the direction of the sound wave emitted from the sound source object 411, and the sound quality that has never been heard is output. The sound image with the amplitude of the sound wave decreased according to the distance is given to the player. Thus, the player can determine that the object is an unconfirmed object from the sound quality. Then, the main CPU 101 stores the property data of the object in the registration area (S314), and exits this process. Note that the processing in step S314 is for forming reflected sound in the same state when an object having the same property appears in the subsequent processing.

  Further, when the main CPU 101 determines that the object is not a shaped object such as a wall from the data relating to the property of the object (S310; YES), the main CPU 101 checks a registration area in which data relating to the object that has appeared in the past is registered, When the data relating to the property of the object and the data in the registered area are matched and it is determined that they are the same (S312; YES), a command for generating sound of the sound quality output previously is generated together with the command in step 309. It supplies to the block 12 (S315). As a result, after a certain time has passed since the launch, the reflected sound is heard from the direction of the sound wave emitted from the sound source object 411, and the sound quality that has been heard in the past is output. The sound image with the amplitude of the sound wave decreased according to the distance is given to the player.

  In the above description, the example in which the region D moves on the X axis has been described, but of course, any coordinate in the X, Y, Z orthogonal coordinate system can be handled as moving.

  In this way, sound waves are emitted from the sound source object 411 possessed by the player character 410, the situation inside the building 250 of the player character 410 is examined without reflection of sound waves, and the inside of the building 250 is checked at the start point 251. To the goal point 252.

[First sound image processing operation by sound marker]
Next, the sound image processing operation by the sound marker in the embodiment will be described with reference to FIGS. 1, 2, 4, 6 and 7. Here, FIG. 4 is a flowchart for explaining the first sound image processing by the sound marker.

  In the first sound image processing by this sound marker, the sound marker 412 is placed at a predetermined position, and the sound image changes depending on the positional relationship between the sound marker 412 and the player character 410, whereby the player character 410 is placed. Is a sound image process for making it possible to determine Specifically, when the player character 410 moves, “the sound is attenuated”, “the sound is amplified”, “the position is changed without changing the loudness”, or “the sound is heard rapidly. This is sound image processing for forming a sound image for determining what state the player character 410 is in when a sound image such as “becomes difficult” is obtained.

  That is, when the player operates the controller device 2 to move the player character 410 and the main CPU 101 forms a sound image that “sound is attenuated” and commands the sound block 12, the sound is attenuated to the player. A sound image of the state will be given. Therefore, the player determines that the player character 410 is away from the sound marker 412 from this sound image.

  Further, when the main CPU 101 forms a sound image “amplifies sound” and instructs the sound block 12 while moving the player character 410, the player is given a sound image in a state where the sound is amplified. . Therefore, the player determines that the player character 410 is approaching the sound marker 412 from this sound image.

  Further, when the main CPU 101 forms a sound image “the sound volume does not change and the localization changes” when the player character 410 is moved, the sound volume is changed for the player. Therefore, a sound image in which the localization is changed is given. Therefore, the player determines that the player character 410 is moving in parallel with the sound marker 412 from this sound image.

  In addition, when the main CPU 101 forms a sound image that makes sound difficult to hear when the player character 410 is moved and commands the sound block 12, the sound is difficult to hear for the player. A sound image will be given. Accordingly, the player determines from this sound image that there is an obstacle between the player character 410 and the sound marker 412.

  The operation for forming such a sound image will be described with reference to the flowchart of FIG. This premise is that the sound marker 412 is arranged at a predetermined location. Then, the player character 410 is moved by operating the controller device 2. First, the main CPU 101 captures the position of the sound marker 412 (S401). Next, the main CPU 101 captures the position of the player character 410 (S402). Based on the position data of the sound marker 412 and the player character 410, the main CPU 101 searches the object information storage unit 202 of the RAM 102 to determine whether there is an object between the sound marker 412 and the player character 410 (S403). ). Here, when the main CPU 101 determines that there is an object between the sound marker 412 and the player character 410 (S403; YES), the main CPU 101 takes in the data of the property of the object from the object information storage means 202 (S404). Here, the main CPU 101 determines whether or not the object reflects sound based on the object property data (S405). Here, when the main CPU 101 determines that the object is a reflecting object (S405; YES), a process for making it difficult to hear the sound is executed (S406), and the process is exited. That is, by performing steps S401 to S406, a sound image that makes it difficult to hear sound suddenly is formed.

  On the other hand, when the main CPU 101 determines that the object is not reflected (S405; NO), the main CPU 101 sets “1” to the flag F (S407), and calculates the distance between the player character 410 and the sound marker 412 (S407). S408). Next, the main CPU 101 takes out the distance between the player character 410 and the sound marker 412 that has been obtained and stored last time (S409). Then, the main CPU 101 compares the current distance between the player character 410 and the sound marker 412 with the previous distance (S410).

  When the main CPU 101 determines that the distance between the player character 410 and the sound marker 412 is decreasing (S410; decrease), the main CPU 101 determines whether “1” is set in the flag F (S411). . In this case, since the flag F is set to “1” (S411; YES), the main CPU 101 sets an attenuation coefficient according to the property of the object (S412), and the sound is attenuated at a certain amount according to the property of the object. The amplitude of the sound wave is attenuated by the coefficient (S414). Then, the main CPU 101 determines whether or not the reach limit distance has been reached (S415). When the reach limit distance is not reached (S415; NO), the main CPU 101 takes in the data of the position of the player character 410 again (S402). In this way, the processing of steps S401 to S405 and S407 to S415 is performed to give a command to the sound block 12, so that the sound wave reduction state passing through the sound transmitting object is reproduced from the speakers 4 and 4. Therefore, the player is provided with a sound image in which the magnitude of the sound wave is suddenly reduced by the normal distance.

  On the other hand, when the main CPU 101 determines that the distance between the player character 410 and the sound marker 412 has increased (S410; increase), the main CPU 101 determines whether "1" is set in the flag F ( S416). In this case, since “1” is set in the flag F (S416; YES), the main CPU 101 sets an attenuation coefficient according to the property of the object (S417), and the sound is attenuated at a certain amount according to the property of the object. The amplitude of the sound wave is increased based on the coefficient (S418). Then, the main CPU 101 determines whether or not the player character 410 has reached the object (S419). When it matches with the object (S419; matches with the object), the process of further increasing the sound wave is performed (S420), and the process returns to step S402.

  Further, when the main CPU 101 determines that the distance between the player character 410 and the sound marker 412 has not changed (S410; no change), the main CPU 101 determines whether “1” is set in the flag F. (S421). In this case, since the flag F is set to “1” (S421; YES), the main CPU 101 does not change the sound wave level in a state where the sound wave is attenuated by the attenuation coefficient corresponding to the property of the object (S422). In step S423, the localization is changed. As a result, the player character 410 moves at a certain distance from the sound marker 412.

  In the above operation, there is an object between the player character 410 and the sound marker 412, and when the sound wave is an object that completely reflects, processing for greatly reducing or blocking the sound wave is performed, or when the object is a sound wave transmitting object. When the player character 410 is approaching the sound marker 412, the sound wave amplitude is increased in a state where the sound wave amplitude is attenuated to a predetermined level, or when the player character 410 is moved away from the sound marker 412, the sound wave is less than the normal attenuation state. A sound image that reduces the amplitude of the sound wave in a large attenuation state is formed.

  When the main CPU 101 determines that there is no object between the player character 410 and the sound marker 412 (S403; NO), the processing of steps S408 and S409 is executed and compared (S410).

  When the main CPU 101 determines that the distance between the player character 410 and the sound marker 412 is decreasing (S410; decrease), the main CPU 101 determines whether “1” is set in the flag F (S411). . In this case, since there is no object, the flag F is set to “0” (S411; NO), so the amplitude of the sound wave is attenuated by the spatial attenuation coefficient (S414). Then, the main CPU 101 determines whether or not the reach limit distance has been reached (S415). When the reach limit distance is not reached (S415; NO), the main CPU 101 takes in the data of the position of the player character 410 again (S402). As described above, the process of steps S401 to S403, S408 to S410, S412, S414, and S415, and giving a command to the sound block 12, the situation where the sound is reduced by the attenuation coefficient of only the space is from the speakers 4 and 4. It is reproduced. Therefore, a sound image in which the magnitude of the sound wave is reduced by the normal distance is provided to the player. As a result, a sound image in a state where the player character 410 gradually moves away from the sound marker 412 is provided.

  On the other hand, when the main CPU 101 determines that the distance between the player character 410 and the sound marker 412 has increased (S410; increase), the main CPU 101 determines whether "1" is set in the flag F ( S416). In this case, since there is no object, “0” is set in the flag F (S416; NO), and the amplitude of the sound wave is increased according to the attenuation coefficient of the space (S418). Then, the main CPU 101 determines whether or not the positions of the player character 410 and the sound marker 412 match (S419). When the positions of the player character 410 and the sound marker 412 do not match (S419; NO), the main CPU 101 returns to the process of taking in the data of the position of the player character 410 again (S402). In this manner, the process of steps S401 to S403, S408 to S410, S416, S418, and S419 is performed to give a sound block 12 a command, and the situation in which the sound gradually increases in the space is reproduced from the speakers 4 and 4. The Therefore, a sound image in which the magnitude of the sound wave is reduced by the normal distance is provided to the player. As a result, a sound image in a situation where the player character 410 is approaching the sound marker 412 is provided.

  Further, when the main CPU 101 determines that the distance between the player character 410 and the sound marker 412 has not changed (S410; no change), the main CPU 101 determines whether “1” is set in the flag F. (S421). In this case, since “0” is set in the flag F (S421; NO), the localization is changed without changing the sound wave level (S423). As a result, the player character 410 moves at a certain distance from the sound marker 412.

  In the above operation, when there is no object between the player character 410 and the sound marker 412 and the player character 410 is approaching the sound marker 412, the amplitude of the sound wave is gradually increased, or the player character 410 is moved from the sound marker 412. When moving away, a sound image is formed so that the amplitude of the sound wave gradually decreases. When the positions of the player character 410 and the sound marker 412 match, the player character 410 picks up the sound marker 412.

  When the main CPU 101 determines that the reach limit distance has been reached (S415; YES), the sound wave is completely attenuated (S101), and the process is exited.

  In this embodiment, the sound marker 412 is arranged at a predetermined position by placing the sound marker 412 at a predetermined position in this way, or by throwing the sound marker 412. The situation of the player character 410 can be determined based on the state of the sound wave.

  FIG. 5 is a flowchart for explaining the first sound image processing of the sound marker. In the flowchart of FIG. 5, for example, when there is an object that emits a sound wave from the sound marker 412 or a sound wave similar to the sound marker 412, it is determined whether the sound marker 412 is another object. Process.

  First, when the player character 410 is moved within the building 250 in the virtual space, when a sound wave from the sound marker 412 or another sound source is heard, the sound marker 412 already placed by himself or other It is necessary to determine whether it is a sound source.

  Therefore, the player places the sound marker 412 near the transmission source at the coordinate position. For example, throw a sound marker 412 near the source.

  The main CPU 101 always determines whether or not the sound marker 412 is arranged (S501 to S501; NO). Here, when the sound marker 412 is arranged in the vicinity of the coordinate position (S501; YES), the main CPU 101 captures data of the transmission source (S102). When the main CPU 101 determines that the sound marker 412 has already been placed based on the data (S503; YES), the main CPU 101 sets the sound block 12 to give a command that does not cause the sonic wave (S504). As a result, sound waves with no resounding are generated from the speakers 4 and 4, and the player can know that the sound marker 412 is already placed.

  On the other hand, when the main CPU 101 determines that it is not the sound marker 412 based on the data (S503; NO), the main CPU 101 sets the sound block 12 as a command for generating a sound wave (S505). As a result, a sound wave with resounding is generated from the speakers 4 and 4, and the player can determine that the sound is emitted from a different object (for example, an enemy object).

  In this way, it is possible to determine whether the sound marker 412 has already been placed in relation to the sound from the transmission source or another object.

  Therefore, according to the above-described embodiment, the game can be enjoyed based on the sound image provided to the player.

  As described above, according to the present invention, a player can freely operate a sound source and enjoy a game that does not depend on vision based on reflection of sound waves from the sound source and changes in sound quality.

  Further, according to the present invention, the sound is heard at a predetermined position and orientation in the three-dimensional space based on the operation from the operation device, and the sound based on the object can be heard. The physical position in the space and the contents of the object can be determined, and a new game environment that does not depend on video can be provided.

It is a block diagram showing the outline | summary of the game device to which the virtual three-dimensional sound image generation device which concerns on embodiment of this invention was applied. It is a block diagram which shows the said virtual three-dimensional sound image production | generation apparatus in the embodiment. It is a flowchart for demonstrating the sound image process by the sound source object which the player character has in the embodiment. It is a flowchart for demonstrating the 1st sound image process by the sound marker in the embodiment. It is a flowchart for demonstrating the 1st sound image process of the sound marker in the embodiment. It is a block diagram which shows the example of the space comprised by the object arrange | positioned in the virtual space used in the game in the embodiment. It is explanatory drawing which shows the example of the structure comprised with the object arrange | positioned in the virtual space used in the embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Processing apparatus main body 2 Operating device 3 Display 4 Speaker 5 CD-ROM
10 CPU block 11 Video block 12 Sound block 13 Subsystem 100 SCU (System Control Unit)
101 Main CPU
102 RAM
103 ROM
104 Sub CPU
105 CPU bus 106, 107 Bus 120, 130 VDP
121 VRAM
122, 123 Frame buffer 131 VRAM
132 Memory 140 DSP
141 CPU
160 Encoder 201 Virtual three-dimensional sound image generating apparatus 202 Object information storage means 203 Sound source storage means 204 Acoustic conversion means 205 Sound image processing means

Claims (3)

In a virtual three-dimensional sound image generation device that forms a sound image in a virtual space,
Object information storage means for storing physical information of a virtual object arranged in a virtual three-dimensional space and information on the material of the virtual object;
Operation means capable of controlling movement of a player character while controlling movement of a player character in a space by a virtual object arranged in the virtual space,
Sound source storage means for storing information relating to the sound source of the sound source object;
A plurality of acoustic conversion means for converting the acoustic signal into an audible sound;
The sound information of the character's sound object is variably controlled in accordance with the position of the sound source object of the character in the space of the virtual object, the information of the virtual object arranged in the virtual three-dimensional space, and the information on the material of the virtual object. A sound image processing means that is formed into an acoustic signal that enables sound to be heard at a predetermined position and orientation in the three-dimensional space and is given to the acoustic conversion means;
A virtual three-dimensional sound image generating device comprising: In a virtual three-dimensional sound image generation method for forming a sound image in a virtual space,
Based on the operation command from the operation means, the player character is moved and controlled in the space by the virtual object arranged in the virtual space, and the firing direction and sound generation control of the sound source object are controlled,
The acoustic information of the character is variably controlled according to the position of the sound source object of the character in the space by the virtual object, the information of the virtual object arranged in the virtual three-dimensional space, and the information on the material of the virtual object, And a method of generating a virtual three-dimensional sound image, wherein sound can be heard at a predetermined position and orientation in the three-dimensional space.   A medium in which a program for causing a computer to function as the virtual three-dimensional sound source generating device according to claim 1 is recorded.

Images