JPH11249653A - Video game device having sound inputting and sound generating functions and information storage medium storing game program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To optionally input a sound by using a controller and to use music in relation with the advancement of a game by selecting a musical scale corresponding to a pushbutton, converting the selected scale into a sound signal and changing the display state of video data in relation with generated music. SOLUTION: In order to input an optional sound or scale by using a controller 40 for a video game machine or play music by the input of sounds, a switch 47A is used as a button for selecting a scale. A switch 47B is used for returning a music play mode to a game mode, a switch 47R is used for raising a selected scale by a half tone, a switch 47Z is used for increasing volume, and a switch 47C is used for selecting a scale similarly to the switch 47A. The functions of these switches 47A to 47Z are defined as optional functions by a game program. Thus sounds can be optionally inputted or music can be played by using the game controller 40 and the sounds or the music can be related to the advancement of a game.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video game apparatus having a sound (or music) input and a sound generation function and an information storage medium storing a video game program, and more particularly to inputting a sound by using, for example, a controller for a video game machine. The present invention relates to a video game device having a sound input and sound generation function for utilizing a music performance based on a player's input to change the progress of a game and an information storage medium storing a game program.

[0002]

2. Description of the Related Art Conventional video games include, for example, game software "Mario Paint" sold by the present applicant.
Displaying the staff notation on the screen, operating the operating device, and entering symbols to designate notes or timbres (hereinafter, collectively referred to as "notes") on the staff, and inputting the sound to be generated. there were. There has also been an electronic musical instrument (keyboard instrument) having a keyboard including a key switch corresponding to a scale. Further, in a conventional video game, for example, when a specific switch for instructing an operation such as missile launch, jump, or punch is pressed, a sound effect (missile launch sound, jump or punch, etc.) corresponding to the operation is simply performed based on a program. , Or BGM music is generated in accordance with a change in the game screen.

[0003]

A conventional video game having a sound generation function changes the progress of the game or influences the progress of the game based on a sound or music generated by an operation of a player. Was not. Further, there is no conventional video game (including a game for a dedicated game machine or a game for a personal computer) capable of generating a sound or playing music corresponding to a switch. Moreover, if the technique of the keyboard electronic musical instrument is applied to the video game machine as it is, a number of key switches corresponding to the scale of the required range is required, and the controller becomes large and the operability is deteriorated. That is, even if the technology of a keyboard electronic musical instrument is applied to a video game machine as it is, it is difficult to input a sound with a small number of switches, and a complicated change in sound cannot be made.

[0004] Therefore, a main object of the present invention is to provide a sound input and a music player that can freely input sound and play music using a game machine controller and use the music in association with the progress of the game. An object of the present invention is to provide a video game device having a sound generating function and an information storage medium storing a game program. Another object of the present invention is
An object of the present invention is to provide a video game apparatus having a sound input and sound generation function and an information storage medium storing a game program, which can generate sounds or music of a scale that cannot be represented by only a limited number of switches. Another object of the present invention is to provide a video game apparatus having a sound input and a sound generation function and an information storage medium storing a game program, which can generate sounds or music of a complex scale with a simple configuration. It is. .

[0005]

FIG. 1 is a block diagram showing the principle of a video game apparatus having a sound input and sound generation function according to the present invention. Next, the principle of the first invention of the present application will be described with reference to FIG.

According to a first aspect of the present invention, there is provided a video game apparatus having a sound input and sound generation function, wherein the operation means is operated by a player to instruct the operation of a player object, and the operation means performs processing based on a program and performs processing based on a program. Image processing means for changing a display image in accordance with an operation and supplying image data for display to the display device, comprising: a player object image data generating means; a non-player object image data generating means; ,
Push button detection means, frequency generation means, writing means,
It comprises a reading means, an audio signal generating means, and a display image changing means. The frequency generation means in the block diagram includes frequency data generation means and temporary storage means. The player object image data generating means is constituted by a data holding means such as a memory included in the external storage means and an image processing means. The player object (e.g., an operating state is changed by operating the operating means by the player). Data for displaying an image of a hero character or the like is generated. The non-player object image data generating means is constituted by a data holding means such as a memory included in the external storage means and an image processing means, and is an object other than the player object (for example, a background screen, Data for displaying an image of a non-player object such as a stationary object or an enemy object is generated. The push button detecting means 18 includes an operating means 40
Among the plurality of push button switches included in the, to detect the type of the pressed push button switch,
For example, in response to an input of a key code for each push button, a pressed key is detected by referring to a table for each key code. The scale selecting means selects a scale corresponding to the push button detected by the push button detecting means. The frequency data generating means directly generates frequency data corresponding to the scale selected by the scale selecting means based on the type of the push button switch detected by the push button detecting means. The writing means sequentially writes the plurality of frequency data generated by the frequency data generating means to the temporary storage means at a constant cycle. The reading means sequentially reads a plurality of frequency data stored in the frequency data temporary storage means. The audio signal generating means converts the frequency data read by the reading means into an audio signal having a frequency corresponding to the frequency data and generates the audio signal. The display image changing means is achieved by the cooperation of the image processing means and the display data generating means. Specifically, the display image changing means relates to the music generated by the audio signal generating means and generates the player object image data. The display state of at least one of the player object generated by the means and the non-player object generated by the non-player object image data generating means is changed, and each changed object is displayed on a display means 31 such as a CRT. Thereby, the image for the game can be changed based on the sound or music input using the game machine controller.

As specific examples of the change of the display state, a method of changing the display state of the non-player object, a method of changing the display state of the player object, and a method of changing the display state of the both are combined. The change in the display state of the non-player object may be caused by changing the background screen on which the player object exists to a scene (location,
Stage), or change to a momentary movement (a so-called warp) to a scene where the game is further advanced. As a change in the display state of the player object, a method of changing an image of a part of the player object so that the player wears the item when an item such as a weapon, armor, or helmet is acquired can be considered. With this, the display state of at least one of the player object and the non-player object can be changed based on the music input by the player, so that it is possible to further enhance the fun of the game which has not existed in the past.

According to a tenth aspect of the present invention, there is provided an information storage medium storing a game program according to the second aspect of the invention, wherein the same functions as those of the video game apparatus according to the first aspect are realized by a program (software) instead of a hardware circuit. An operation means having a plurality of push-button switches for instructing the operation of the player object operated by the player (40 in FIG. 4 if the correspondence with the embodiment is shown), and processing based on a program are performed. Processing means for changing a display image in accordance with the operation of the operation means and supplying image data for display to the display device (11 and 12 in FIG. 3)
And temporary storage means (158 in FIG. 7) for temporarily storing data related to the processing, and audio processing means (FIGS. 11, 12, and 24) for generating an audio signal by performing processing based on a program. The present invention is applied to a video game device (10) including the same. The information storage medium (ROM 21 in FIG. 5) includes a player object image data storage section (22f), a non-player object image data storage section (22g), a push button detection program storage section (22b), and a scale selection program storage section. (22h), a frequency data generation program storage unit (22h), and a write program storage unit (2
2a), a readout program storage section (22a), an audio signal generation program storage section (22h), and a display image change program storage section (22a, 22d, 22e, etc.). The player object image data storage unit stores data for displaying an image of the player object, and generates player object data by reading the data. The non-player object image data storage unit stores data for displaying an image of an object (a non-player object) other than the player object, and generates non-player object data by reading the data. The push button detection program storage unit
A program for detecting the type of the pressed push button switch among the plurality of push button switches is stored. The scale selection program storage selects a scale corresponding to the push button detected by the push button detection program. The program in the frequency data generation program storage section directly generates frequency data corresponding to the scale selected by the scale selection program, based on the type of the push button switch detected by the push button detection program. The writing program storage unit stores a program for sequentially writing a plurality of frequency data generated by the frequency data generating unit to the temporary storage unit at a constant cycle. The readout program storage section stores a program for sequentially reading out a plurality of frequency data stored in the temporary storage means. The audio signal generation program storage unit stores a program for generating an audio signal of a frequency corresponding to the frequency data based on the plurality of frequency data read by the processing based on the read program. The display image change program storage unit includes a player object read from the player object image data storage unit and a non-player object read from the non-player object image data storage unit in association with music generated by the processing of the audio signal generation program. A program for changing a display image for changing at least one of the display states is stored.

[0009]

According to the present invention, it is possible to realize a sound generating apparatus capable of generating a sound (or music) of a scale that cannot be represented by a limited and small number of switches. In addition, it is possible to generate sounds or music of a complicated scale with a simple configuration. Also, by changing the vibrato depth value by operating the joystick, a rich sound or music can be generated with a small number of switches. Further, it is possible to realize a video game device in which the player can freely input sound or play music using the game machine controller, and can associate the sound or music with the progress of the game. That is, not only the sound is generated simply by pressing the button, but also the pitch can be finely adjusted by operating the joystick, so that it is possible to generate free and various sounds or music.

[0010]

Next, specific embodiments of a video game apparatus (or video game system) having a sound input and sound generation function according to the present invention, and an information storage medium storing a game program applied to the video game apparatus. Will be described. In the following embodiments, a case where the information storage medium is applied to a video game device will be described. However, it is pointed out in advance that the technical idea of the present invention can be applied to an information processing device such as a personal computer and an electronic musical instrument. . Also, a case will be described in which a controller for a video game machine is used as the operation unit. However, any configuration may be used as long as it has a plurality of switches and an analog operation input unit.

FIG. 2 is an external view showing the configuration of a video game apparatus according to one embodiment of the present invention. The video game device (or video game system) is a video game machine body 10
A ROM cartridge 20 as an example of an external storage unit;
It is configured to include a CRT display 30 as an example of a display device connected to the video game machine body 10 and a controller 40 as an example of operation means (or operation input means).
The RAM cartridge 50 (or the vibration cartridge 50A) is detachably mounted on the controller 40 as needed.

The controller 40 is configured by providing a plurality of switches or buttons on a housing 41 having a shape that can be gripped with both hands or one hand. Specifically, the controller 4
Reference numeral 0 denotes handles 41L, 41C, and 41R provided at the lower portions of the left, right, and center of the housing 41, and the upper surface thereof is used as an operation area. In the operation area, an analog joystick (hereinafter abbreviated as "joystick") 45 capable of inputting an analog direction is provided at the lower center, and a cross-shaped digital direction switch (hereinafter referred to as "cross switch") 46 is provided on the left side. A plurality of button switches 47A to 47C are provided on the right side. The joystick 45 is used for instructing or inputting a moving direction and / or a moving speed (or a moving amount) of the player object according to a tilt amount and a direction of the stick. Also, when playing music by inputting a sound or inputting a sound, the joystick 45 indicates a frequency change amount for changing a frequency of the input scale, or sounds when a vibrato is applied to the sound. By designating a depth value representing the depth of the sound, it is used to variously change the frequency of the generated sound. The cross switch 46 is used in place of or in combination with the joystick 45 to digitally indicate the moving direction of the player object.

The plurality of button switches 47 include switches 47A and 47B for instructing the operation of the player object in a normal game mode, a switch 47C used for switching a viewpoint of an image viewed from a camera, a start switch 47S, Operation switch 47L provided on the upper left side surface of housing 41, operation switch 47R provided on the upper right side surface of housing 41, and handle 4
1C includes a switch 47Z provided on the back side. The switch 47C has four button switches 47C at the top, bottom, left and right.
u, 47Cd, 47Cl, and 47Cr are arranged, and are also used for control (for example, acceleration and deceleration) of a moving speed and the like in a shooting or an action game as an application other than a camera viewpoint switching.

A video game machine controller 40
The switch 47A is used as a button for selecting a scale (for example, a button for generating a sound of "R") in order to input an arbitrary sound or a scale by using, or to play music by inputting a sound. . The switch 47B is used to return from a mode for playing music to a normal game mode. The switch 47R is used to raise the selected scale by a semitone. The switch 47Z is used to increase the volume (for example, 1.4 times). Switch 47C (a plurality of switches 47Cu, 47Cl, 47C)
r, 47Cd) are used as buttons for selecting a musical scale, similarly to the switch 47A. In the following embodiment, the switch 47Cd is “F”, the switch Cr is “A”, the switch Cl is “S”, and the switch Cu is “L” (switch 4).
7A is used as a button for designating each sound of "L" which is one octave higher than "L". The functions of these switches 47A to 47Z are defined as arbitrary functions by the game program.

FIG. 3 is a block diagram of a video game system according to one embodiment of the present invention. The video game machine 10 includes a central processing unit (hereinafter abbreviated as “CPU”) 1
1 and a coprocessor (reality coprocessor: hereinafter abbreviated as “RCP”) 12. RCP12
Has a bus control circuit 121 for controlling the bus,
An image processing unit (reality signal processor; hereinafter abbreviated as "RSP") 122 for performing polygon coordinate transformation, shading processing, and the like; polygon data can be rasterized into an image to be displayed and stored in a frame memory An image processing unit (reality display processor; hereinafter abbreviated as “RDP”) 123 for converting into a data format (dot data) is included. The RCP 12 is connected to a cartridge connector 13 for detachably mounting the ROM cartridge 20, a disk drive connector 14 for detachably mounting the disk drive 26, and the RAM 15. The RCP 12 is connected to an audio signal generation circuit 16 for outputting an audio signal processed by the CPU 11 and an image signal generation circuit 17 for outputting an image signal. Further, the RCP 12 is connected to a controller control circuit 18 for serially transferring operation data of one or more controllers 40A to 40D and / or data of the expansion RAM cartridge 50.

Bus control circuit 121 included in RCP 12
Converts a command given as a parallel signal from the CPU 11 via a bus from parallel to serial, and supplies the command to the controller control circuit 18 as a serial signal. Further, the bus control circuit 121 includes the controller control circuit 18.
Converts the serial signal input from to a parallel signal,
This is given to the CPU 11 via the bus. Controller 40A
The data indicating the operation state read from -40D is C
It is processed by the PU 11 or temporarily stored in the RAM 15. In other words, the RAM 15 includes a storage area for temporarily storing data processed by the CPU 11, and is used to smoothly read or write data via the bus control circuit 121.

A connector 195 provided on the rear surface of the video game machine 10 is connected to an output section of the audio signal generation circuit 16. A connector 196 provided on the rear surface of the video game machine 10 is connected to an output section of the image signal generation circuit 17. An audio generator 32 such as a television speaker is detachably connected to the connector 195. Connector 196
, A display 31 such as a television receiver or a CRT is detachably connected.

Controller controllers (hereinafter abbreviated as “connectors”) 191 to 194 provided on the front of the video game machine 10 are connected to the controller control circuit 18. Controllers 40A to 40D are detachably connected to connectors 191 to 194 via connection jacks. As described above, by connecting the controllers 40A to 40D to the connectors 191 to 194, the controllers 40A to 40D are electrically connected to the video game machine 10, and transmission / reception or transfer of data between the controllers is enabled.

FIG. 4 is a detailed circuit diagram of the controller 40 and the RAM cartridge 50. The joystick 45 and each switch 4 are provided in the housing of the controller 40.
Various circuits such as an operation signal processing circuit 44 are incorporated in order to detect operation states such as 6, 47 and transfer the detected data to the controller control circuit 18. The operation signal processing circuit 44 includes a reception circuit 441, a control circuit 442, a switch signal detection circuit 443, a counter circuit 444, a joyport control circuit 446, a reset circuit 447, and a NOR gate 448. The receiving circuit 441 converts a control signal transmitted from the controller control circuit 18 or a serial signal such as data to be written to the RAM cartridge 50 into a parallel signal and supplies the parallel signal to the control circuit 442. The control circuit 442 includes:
When the control signal transmitted from the controller control circuit 18 is a reset signal for the X and Y coordinates of the joystick 45, a reset signal is generated and the X-axis counter 444X and the Y-axis counter 444X in the counter 444 via the NOR gate 448. The count value of the counter 444Y is reset (forced to 0).

The joystick 45 includes a photo-interrupt for the X-axis and a photo-interrupt for the Y-axis in order to separate the tilt direction of the lever into the X-axis direction and the Y-axis direction and generate a pulse number proportional to the tilt amount. Each pulse signal is converted to a counter 444
X and the counter 444Y. Counter 444X
Counts the number of pulses generated according to the amount of tilt when the joystick 45 is tilted in the X-axis direction. When the joystick 45 is tilted in the Y-axis direction, the counter 444Y counts the number of pulses generated according to the amount of tilt. Therefore, the moving direction and the coordinate position of the player object (an object operated by the player, for example, a hero character or a cursor) are determined by the combined vector of the X axis and the Y axis determined by the count values of the counters 444X and 444Y. Note that the counter 444X and the counter 444Y
A reset signal provided from a reset signal generation circuit 447 when the power is turned on, or a switch signal detection circuit 443 when the player presses two predetermined switches simultaneously.
The count value is also reset by the reset signal given by

The switch signal detection circuit 443 responds to a switch state output command given from the control circuit 442 at a constant period (for example, at 1/60 second intervals which is a television frame period), and the cross switch 46 and the switch 47A. A signal that changes depending on the pressed state of .about.47Z is read and given to the control circuit 442. Control circuit 442
Supplies the operation state data of each of the switches 47A to 47Z and the count values of the counters 444X and 444Y to the transmission circuit 445 in a predetermined data format in response to an operation state data read command signal from the controller control circuit 18. The transmission circuit 445 converts the parallel signal output from the control circuit 442 into a serial signal,
And to the controller control circuit 18 via the signal line 42. The port control circuit 446 is connected to the control circuit 442 via an address bus and a data bus. When the RAM cartridge 50 is connected to the port connector 449, the port control circuit 446 controls input / output (or transmission / reception) of data in accordance with a command from the CPU 11.

The ROM cartridge 20 has an external ROM 2
1 is mounted on a board, and the board is housed in a housing. The external ROM 21 stores image data and program data for image processing of a game and the like, and also stores audio data such as music, sound effects, and messages as necessary.

FIG. 5 is a memory map schematically showing the memory space of the external ROM 21. FIG.
3 is a memory map showing a part of the memory space (image data area 24) in detail. The external ROM 21 includes a plurality of storage areas (hereinafter, when a data type name is added before a “storage area”, the area is abbreviated as “area”), for example, as shown in FIG.
As shown in the figure, the program area 22, the character code area 2
3, including an image data area 24 and a sound memory area 25, in which various programs are fixedly stored in advance.

The program area 22 stores programs necessary for performing image processing such as a game (see FIGS. 8 to 1 described later).
2, a program for realizing the functions of the flowcharts shown in FIGS. 18 to 20, and FIGS. 22 to 24), game data corresponding to the game content, and the like. Specifically, the program area 22 includes storage areas 22 a to 22 for fixedly storing an operation program of the CPU 11 in advance.
i. The main program area 22a stores a processing program of a main routine such as a game shown in FIG. The control pad data (operation state) determination program area 22b stores a program for processing data indicating the operation state of the controller 40 and the like. In the write program area 22c, the frame memory and the Z to be written by the CPU 11 to the RCP 12 are written.
A program for writing to the buffer is stored. For example, in the writing program area 22c, color data is stored in the frame memory area of the RAM 15 as image data based on texture data of a plurality of moving objects or background objects to be displayed on one background screen (15 in FIG. 7).
2) and a program for writing depth data into the Z buffer area (153 shown in FIG. 7) are stored. The moving object control program area 22d stores a control program for causing the CPU 11 to act on the RCP 12 to change the position of the moving object in the three-dimensional space. The camera control program area 22e stores a camera control program for controlling a position and a direction in a three-dimensional space of a moving object or a background object including a player object. Player object program area 22
A program (see FIG. 9) for controlling display of an object operated by the player is stored in f.
The CPU 11 stores the RCP1 in the background program area 22g.
2, a background creation program (FIG. 1) for creating a three-dimensional background screen (such as a still screen or a course screen).
0) is stored. Voice processing program area 22h
Stores a program for generating a sound effect, music, or voice message (see FIG. 24). In the game over processing program area 22i, a program for processing when the game is over, for example, detection of the game over state and processing for saving backup data of the game state up to that time when the game over is reached are stored. .

The character code area 23 is an area for storing a plurality of types of character codes, for example, storing dot data of a plurality of types of characters corresponding to the codes. The character code data stored in the character code area 23 is used to display a description to a player during the progress of the game. For example, a message (or a text message) indicating an appropriate operation method at an appropriate timing in accordance with the surrounding environment (for example, location, type of obstacle, type of enemy object) where the player object is located or the situation where the player object is placed is provided. Used to display lines).

The image data area 24 includes storage areas 24a to 24b as shown in FIG. Image data area 24
Stores image data such as coordinate data of a plurality of polygons and texture data for each object of a background object and / or a moving object, and fixedly displays or moves and displays these objects at predetermined positions. And a display control program for causing it to be stored. For example, a program for displaying a player object is stored in the storage area 24a. The storage area 24b stores a background object program for displaying a plurality of background (or still) objects 1 to n1.

The sound memory area 25 stores, for each scene, sound data such as dialogues, sound effects, game music, and the like for outputting a message suitable for the scene by voice.

The external storage device can be used in place of or in addition to the ROM cartridge 20.
Various storage media such as a CD-ROM and a magnetic disk may be used. In this case, various data for a game (including program data and data for displaying images) is read from an optical or magnetic disk-like storage medium such as a CD-ROM or a magnetic disk, or written as necessary. For this purpose, a disk drive (recording / reproducing device) 26 is provided. The disk drive 26 reads data stored on a magnetic disk or an optical disk in which the same program data as the ROM 21 is magnetically or optically stored, and transfers the data to the RAM 15.

FIG. 7 is a memory map schematically showing the memory space of the RAM 15. The RAM 15 includes various storage areas 150 to 159. For example, in the RAM 15,
The display list area 150, the program area 151, and 1
A frame memory (or image buffer memory) area 152 for temporarily storing image data for frames, a Z buffer area 153 for storing depth data for each dot in the frame memory area, an image data area 154, and a sound memory area 155. , An operation state data of the control pad, a working (working) memory area 157, a voice list area 158, and a register / flag area 159. Each storage area 151-
159 indicates that the CPU 11
Alternatively, it is a memory space that can be directly accessed by the RCP 12, and is allocated to an arbitrary capacity (or memory space) depending on a game to be used. Also, the program area 15
1, image data area 154, sound memory area 155
Is a part of data of a game program of all stages (or scenes, fields) of one game stored in the storage areas 22, 24, 25 of the ROM 21, for example, in an action or role playing game, When a game program required for one stage or field (course in a racing game) is transferred,
The corresponding data is temporarily stored. As described above, if a part of various program data necessary for a certain scene is stored in each of the storage areas 151, 154, and 155,
It is possible to increase the efficiency of the CPU 11 and to increase the image processing speed, as compared with the case where the CPU 11 directly reads out the data from the ROM 21 and processes it whenever necessary.

Specifically, the frame memory area 152
Has a storage capacity corresponding to the number of pixels (pixels or dots) of the display 30 × the number of bits of color data per pixel, and stores color data for each dot corresponding to the pixel of the display 30. The frame memory area 152
Three-dimensional coordinates for displaying one or more objects of a stationary object and / or a moving object to be displayed on one background screen stored in the image data area 154 in the image processing mode as a set of a plurality of polygons Based on the data, the color data for each dot of the object viewed from the viewpoint position is temporarily stored, and the moving objects such as the player object, the fellow object, the enemy object, and the boss object stored in the image data area 154 in the display mode. Background (or still)
When displaying various objects such as objects, color data for each dot is temporarily stored. Note that moving objects such as enemy objects and boss objects, and background (or still) objects are objects that cannot be moved or changed by the player operating the controller 40, and are collectively referred to as “non-players”. It is sometimes called an "object."

The Z buffer area 153 is used for the display 3
It has a storage capacity equivalent to the number of 0 pixels (pixels or dots) × the number of bits of depth data per pixel, and stores depth data for each dot corresponding to each pixel of the display 30. The Z-buffer area 153 is used to display a portion of an object that is visible from the viewpoint position based on three-dimensional coordinate data for displaying one or more objects of a stationary object and / or a moving object in an aggregate of a plurality of polygons in the image processing mode. The depth data is temporarily stored for each dot, and the depth data for each dot of each moving and / or still object in the display mode is temporarily stored.

The image data area 154 stores coordinate data and texture data of polygons composed of a plurality of aggregates for each stationary and / or moving object for game display stored in the ROM 21. Then, data for at least one stage or field is transferred from the ROM 21 prior to the image processing operation.

The sound memory area 155 is stored in the ROM 21
A part of the voice data (line, music, sound effect data) stored in the storage area is transferred, and the frequency data of the voice data generated from the voice generator 32 is temporarily stored. Further, a sound or scale data input by the player is also stored. The audio list area 158 stores audio data for creating a sound generated by the speaker.

The control pad data (operation state data) area 156 temporarily stores operation state data indicating the operation state read from the controller 40. The work memory area 157 temporarily stores data such as parameters while the CPU 11 is executing the program.

The register / flag area 159 includes a plurality of register areas 159R and a plurality of flag areas 159F. The register area 159R includes a register (song data register) R1 for storing scale data of a music piece, a register (sound number register) R2 for storing the order of sounds, and a register for storing scale data input by the player (input scale). Register) R3, a register (sound matching register) R4 for storing the result of comparing the scales, and a register (background object number register) R5 for storing the number of background objects. The flag area 159F is
This is an area for storing a flag for knowing a state in which the game is in progress, and includes, for example, a sound collation flag F1, a game over flag F2 for identifying the presence or absence of detection of a condition that has reached a game over, and the like.

FIG. 8 is a flowchart of a main routine of the video game system according to one embodiment of the present invention. Next, referring to the detailed (or subroutine) flowchart of each operation shown in FIG. 9 to FIG. 12, FIG. 18 to FIG. 20, and FIG. The operation will be described.

When the power is turned on, when starting,
When the video game machine 10 is set to a predetermined initial state,
The CPU 11 transfers the start-up program of the game programs stored in the program area of the ROM 21 to the program area 151 of the RAM 15 and sets each parameter to an initial value. Execute.

The main routine process is a process performed by the CPU 11 every frame (1/60 second).
That is, the CPU 11 executes Step 1 (shown with “S” in the drawing), Steps 2 to 1 until one stage (or a field or a course) is cleared.
After performing the operation 1, the operations of Steps 2 to 11 are repeated. However, steps 7 and 8 are the RCP12
Processed by If the game is over without succeeding in clearing the stage, the CPU 11 performs a game over process in step 12. If the stage is successfully cleared, the process returns from step 11 to step 1.

More specifically, in step 1, a predetermined game initialization (ie, game start processing) is performed. If the game can be started from any position of a plurality of stages or courses as necessary, a stage or course selection screen is displayed. Immediately after the start, the game of the stage 1 is performed, so that the game start processing of the stage is performed. For example, the register area 159R and the flag area 159F are cleared, and various data necessary for playing the game of stage 1 (the selected stage or course is also possible) are read from the ROM 21 and stored in the storage areas 151 to 151 of the RAM 15. 155.

In step 2, controller processing is performed. This processing is performed by detecting whether any of the joystick 45, the cross switch 46, and the switches 47A to 47Z has been operated, reading detection data (controller data) of the operation state, and writing the read controller data. Done.

In step 3, a process for displaying the player object is performed. This processing is basically processing for changing the direction and shape based on the operation state of the joystick 45 operated by the player and the presence or absence of an attack from an enemy, and will be described later with reference to FIG. For example, the display control of the player object is performed in the storage area 22.
Based on the program transferred from f, the polygon data of the player object transferred from the storage area 24a, and the operation state of the joystick 45, the coordinate position, shape, and the like of the changed polygon data are calculated.
At each address of the storage area 154 corresponding to a plurality of triangular faces composed of a plurality of polygons obtained as a result, color data is written such that a pattern or colored paper specified by the texture data is pasted.

In step 4, the background (or still,
Operation) Processing for displaying an object is performed. In this process, the display position and the shape of the background object are obtained by calculation based on the program partially transferred from the storage area 22g and the polygon data of the background object transferred from the storage area 24.
0 will be described later.

In step 5, sound processing is performed.
This sound processing is processing for sounding music input (played) by the player operating the controller 40, and specifically includes processing shown in FIGS. 11 and 12 described later. Further, as a subroutine during the sound processing, an automatic performance processing shown in FIG. 18, a free performance processing shown in FIG. 19, a recording processing shown in FIG. 22, and the like are included.

In step 6, camera processing is performed. For example, coordinate calculation of the angle at which each object is viewed is performed so that the line of sight or the field of view when viewed through the viewfinder of the camera is at the angle specified by the player.

In step 7, the RSP 122 performs a drawing process. That is, under the control of the CPU 11, the RCP 12 determines whether the moving object and the stationary object Image data conversion processing (coordinate conversion processing and frame memory drawing processing) for the display processing. Specifically, each address of the storage area 154 corresponding to the surface of each triangle constituted by a plurality of polygons for each of a plurality of moving objects and still objects is specified by texture data determined for each object. Color data is written to paste a color or the like. For details of the drawing process,
This will be described later with reference to FIG.

In step 8, voice processing is performed based on voice data such as messages, music, and sound effects. The details of the audio processing will be described later with reference to FIG.

In step 9, the RCP 12 reads out the image data stored in the frame memory area 152 based on the result of the drawing processing in step 7, thereby recognizing a player object, a moving object, a still object, an enemy object, and the like. It is displayed on the display screen 31.

In step 10, the RCP 12 reads out the audio data obtained by the audio processing in step 8 to output sounds such as music, sound effects, and conversation.

In step 11, it is determined (clear detection) whether or not the stage or field has been cleared. If the game is not cleared, it is determined in step 11 whether or not the game is over. If not, the process returns to step 2 and the operations in steps 2 to 11 are repeated until the condition for the game over is detected. Then, when it is detected that the number of mistakes permitted to the player reaches a predetermined number, or that a game over condition such as using up a predetermined amount of life of the player object has been reached, the continuation or backup of the game is performed in the subsequent step 12. A game over process such as a process of selecting data storage is performed. If a condition for clearing the stage (for example, defeating a boss) is detected in step 11, the process returns to step 1 after performing a clearing process in step 12. The detailed operation of each subroutine will be described below.

Next, the display processing of the player object will be described in detail with reference to FIG. First, step 30
In step 1, the joystick data stored in the control pad data area 156 is read, and the data is corrected. For example, data at the center of the joystick 45 is deleted, and processing is performed so that the data becomes "0" when the stick comes near the center (for example, a radius of 10 counts). In this way, the joystick data can be accurately regulated to "0" even if there is a manufacturing error in the joystick 45 or the player's finger shakes slightly. In addition, the joystick 45 also corrects a predetermined range of the outer peripheral portion of the operable range (that is, corrects so as not to output data of a portion unnecessary in the game). Then, joystick data Xj and Yj used during the game are obtained. That is, the data obtained in step 301 is stored in the counters 444X and 444Y.
Is converted to a value that can be easily processed in the game. Specifically, Xj becomes "0" when the stick is not tilted, becomes "+64" when the stick is tilted to the maximum in the -X (left) direction, and becomes "+64" when it is tilted to the maximum in the + X (right) direction. −64 ”. Yj becomes "0" when the stick is not tilted, and + Y (front)
"-64" when tilted to the maximum in the direction, -Y (after)
It becomes "+64" when it is tilted to the maximum in the direction. In order to move the player object based on such joystick data, its coordinate position is obtained.

In step 302, processing such as flying the player object, cutting an enemy with a sword, or firing a missile is performed in accordance with the operation of the push button switch. In step 303, step 3
01 and data of the player object to be displayed on one screen are registered in the display list area 150 based on the data on the player object obtained in step 302. This registration process is performed as a pre-process when a player object is displayed in a drawing process (described later with reference to FIG. 23).

With reference to FIG. 10, the details of the background object display processing (processing in step 4) will be described. In step 401, 1 is set in the background object register R5.
Is set. In step 402, register R5
Is registered in the display list. In step 403, 1 is set in the register R5.
Is added. In step 404, it is determined whether or not the process for displaying all the background objects set by the program has been completed (in other words, whether the value of the register R5 matches the number of background objects to be displayed on one screen). No) is determined. If all the processes have not been completed, the process returns to the switch 402, and steps 402 to 4 are performed.
Step 04 is repeated. When all processes are completed,
The process returns to the main routine (Step 5 in FIG. 8).

Here, prior to the detailed description of the sound processing (step 5; subroutine of FIGS. 11 and 12) which is a feature of the present invention, an outline of the contents of a game using the sound generating function of the present invention will be described. In this game, a player object clears an event while moving through various stages or fields in a three-dimensional space, or defeats an enemy and clears each stage. This is to achieve the purpose defined by the program while inputting the scale and playing music. In this game, one or more types of music are displayed on a bulletin board or the like in the middle of the game, and when the player plays the music by operating the controller, the music is a predetermined music (that is, the object is changed). Is determined, and the display state of at least one of the player object and the non-player object is changed. As a specific example of changing the object when a predetermined song or music is played (input of sound), the player object is moved (or warped) to a certain place in a specific three-dimensional space, or the player object is moved to a specific place. Allow entry into the area (room) (or unlock the door)
This may change the background screen around the player object. In other words, the display state of the non-player object is changed by changing to the background screen of the warp destination when warping is performed, and changing to a scene in the room when allowing to enter a specific room. . As another example, the determination that the performance music is a predetermined music may be used as a condition for unlocking a treasure chest, or a special object such as a protective gear or a weapon may be added to the player object. In that case, change the display state of the non-player object to open the treasure chest,
The display state is changed so that the player object wears armor or the like or has a weapon or the like.

FIG. 13 is a view showing the entire three-dimensional space in one stage or field. However, FIG. 13 shows the entire virtual space in a bird's-eye view.
What is displayed on the screen of the CRT 30 as the actual game screen is a part near the player object. In this state, the player object is at the lower right position (place), and when the controller 40 is operated to play music of a predetermined song, the first to third locations determined to correspond to the song Instantaneously (so-called warp). At this time, the camera that captures the player object captures the player object in the moved location and the background image or still image in the vicinity thereof. As a result, the player object captured by the camera and the background image in the vicinity thereof are displayed on the CRT 30. Will be displayed on the screen.

Next, the details (subroutine) of the sound processing shown in step 5 will be described with reference to FIGS. In step 501, it is determined whether a song selection screen is displayed. The song selection screen is, for example, a screen as shown in FIG.
When a mode for playing a musical instrument (for example, playing an ocarina) by operating S) (or clicking an instrument mark icon) is selected, a window is displayed. At this time, the window displays a list of songs that can be currently played, as well as options for a free performance (playing a song not in the song list) mode, options for closing the window, and the like. Preferably, a score (not necessarily a staff) is displayed in a part of the window, and a sound or a switch symbol corresponding to a note is displayed. The music list may be increased with the progress of the game or participation in an event during the game. The player operates the controller 40 to move the cursor displayed on the left side of the window up and down, thereby selecting an arbitrary song and selecting a free performance mode or a window closing mode. In response to the selection result, the CPU 11 executes a program corresponding to the selection.

If it is determined in step 501 that the music selection screen is displayed, step 50
In 2, it is determined whether the first song (for example, a wind melody) is selected by the player. If it is determined that the first song has been selected, in step 503, the data of the first song stored in the program area of the ROM 21 or the RAM 15 is stored in the song data register R1.
Is stored. In step 504, the number "1" indicating that the first sound has been input is stored in the sound number register R2.
Is set to In step 505, the process in the matching mode is started. Specifically, a process (see the description of step 524) for switching the screen from the music selection screen to the sound input screen (see FIG. 15) is performed. afterwards,
It returns to the main routine (S6).

On the other hand, if it is determined in step 502 that the player has not selected the first song, in step 506 the player selects the second song (eg,
It is determined whether the flame melody has been selected. Second
When it is determined that the music of the program No. is selected, step 50
At 7, the data of the second music stored in the program area of the ROM 21 or the RAM 15 is stored in the music data register R1. Similarly, steps 502 and 5
If it is determined in step 06 that the music is not the first music or the second music, the process proceeds to step 508 for judging whether or not music after the third music has been selected. However, in the figure, instead of describing the specific determination step of whether or not the music piece is the third music piece, the Nth music piece is replaced with the Nth music piece.
(N is the maximum number determined by the program from 3)
It is shown as a general expression of whether the song is the th song. In step 508, it is determined whether or not the Nth tune has been selected by the player. If it is determined that the Nth tune has been selected, at step 509, the Nth tune data is stored in the tune data register R1.

On the other hand, if it is determined in steps 502, 506, and 508 that none of the first to N-th songs has been selected, it is determined in step 510 whether the free play mode has been selected. . When the free play mode is selected, the process of the free play mode is started in step 511, and the screen is switched from the music selection screen to the free play mode screen (a screen excluding the display of the operation guide in FIG. 15). Return to S6). If it is determined in step 510 that the free performance mode has not been selected, it is determined in step 512 whether closing the window (or canceling the mode) has been selected. When closing the window is selected, after the window is closed and normal game processing is performed in step 513, the main routine (S6)
Return to

On the other hand, if it is determined in step 501 that the screen is not a music selection screen, it is determined in step 520 whether or not the collation mode is being executed. If it is determined that the matching mode is being executed, it is determined in step 521 whether or not the automatic performance is being executed. If it is determined that the automatic performance is not being performed, it is determined in step 522 whether a performance operation has been performed. If a performance operation has been performed, it is detected in step 523 which switch corresponding to which sound has been operated based on the control pad data. Specifically, the type of the push button switch stored in the control pad data area 156 of the RAM 15 and / or the joystick 45
The specified sound or scale is detected based on the inclination amount data of.

In the following step 524, note symbols are registered in a display list in order to display a fairy-like note symbol (object) as shown in FIG. 17 on a musical score. For example, it is detected whether a switch corresponding to any one of the push button switches is pressed, and an object such as a note is registered in a display list in order to display a note object at a position of a musical score corresponding to the note. Is done. For example, when the sound input mode is selected by operating the controller 40, an object for displaying the image shown in FIG. 15 (for example, a musical score is displayed at the upper part of the screen, an operation guide is displayed at the lower part, and the player An object for displaying an image in which the object blows an ocarina in response to a sound input operation of the player (a plurality of objects) or an object for displaying the image shown in FIG. (A plurality of objects for displaying images without operation guides) are registered in the display list. At this time, a musical score as shown in the upper part of FIG. 17 is displayed on the note display part in the upper part of the screen, and a fairy symbol as shown on the left of the second part is displayed at a position corresponding to the note to be inputted. A key input is prompted, and when a note to be input is input by a key input operation, a right key input is displayed as shown on the right of the second row, and a third row is displayed when there is no key input in time. Display as shown on the right. The data of the object for realizing such a display is registered in the display list. When such registration in the display list is performed, after returning to the main routine after the processing in step 528 described later, the drawing processing based on the registration in the display list is performed in step 7, and as a result, the step 9, an image as shown in any of FIGS. 15 to 17 is displayed on the CRT 30. The data of the detected sound is registered in the voice list.
In step 525, the scale of the On-th sound in the music data stored in the music data register R1 is compared with the scale specified by the operation of the controller 40, and a predetermined relationship is established. ), The comparison result is stored in the sound collation register R4. For example, "1" if the scales match, "0" if they do not match
Is stored in each bit of the sound collation register R4 according to the order of sounds. As another storage method of the comparison result, "1" is written to the sound collation flag F1 if all the scales match, and if even one sound is incorrect, the sound collation flag F1 is used.
The comparison result may be stored by writing “0” in the field.

In step 526, 1 is added to the value of the tone number register R2, and the addition result is temporarily stored in the tone number register R2. In other words, On = On + 1 is calculated, and the latest calculation result is stored as On. At step 527, it is determined whether or not the value (On) of the tone number register R2 is greater than the number of sounds. If it is determined that the value is greater, the automatic performance process is performed at step 528. Thereafter, the process returns to the main routine (S6).

On the other hand, if it is determined in step 522 that the controller 40 has not been operated,
In step 529, it is determined whether a predetermined time has elapsed. If the predetermined time has elapsed, step 526 is executed.
If not, return to the main routine. Here, the elapse of the predetermined time is determined if the player does not press the push button switch within the predetermined time (for example, 5 seconds), assuming that a sound has not been input, and a switch other than the sound is activated. This is for shifting to input processing.

On the other hand, when it is determined in step 521 that the automatic performance is being performed, step 530 is executed.
Automatic performance processing based on the collation result (see FIG. 18)
Is performed. Next, details of the automatic performance processing will be described with reference to FIG. In step 531, it is determined whether or not the automatic performance has been completed. If not, automatic performance processing is performed in step 532. Specifically, the score is first blanked out. Next, based on the scale data temporarily stored in the input scale register R4, a note symbol (object) is displayed at the position of the musical score corresponding to each input sound from the first sound to the last sound. , Note symbols are registered in the display list, and voice data corresponding to the scale is registered in the voice list. as a result,
As shown in FIG. 17, symbols (▽, left-pointing triangle, A, right-pointing triangle, △) indicating switches (47Cd, 47Cl, 47A, 47r, 47u) corresponding to sounds to be input are displayed on the score. In the state (refer to the first row), when the input is performed correctly, the symbol (A) corresponding to the switch is displayed (refer to the right of the second row) and the sound is emitted. At this time, if the wrong switch is operated, the next sound is produced. If it is determined in step 523 that there is no performance operation and that the predetermined time has elapsed in step 529, no processing is performed in steps 523 and 525, and nothing is displayed (see the third row). ) Will be silent.

On the other hand, if it is determined in step 531 that the automatic performance has ended, it is determined in step 533 whether or not all the scales input by the player are correct. This match is determined by the song data register R
1 and the data stored in the input scale register R3. As another determination method, it may be determined that the data stored in the sound collation register R4 is all “1” or that the sound collation flag F1 is “1”. If it is determined that the musical scale is correct, step 5
At 34, a matching (matching) process is performed. As the matching processing, predetermined object data is registered in a display list to display that a correct scale has been input, or predetermined voice data is registered in a voice list to play music such as fanfare. This is the process. Continue,
In step 535, it is determined whether the matching process has been completed. If it is determined that the game has ended, in step 536, the game process corresponding to the input of the N-th song is started. For example, the player object is moved to a place corresponding to the song selected on the song selection screen in FIG. 14 (in the example of FIG. 13, any one of the first place to the third place) and displayed. The coordinate position of the player object in the three-dimensional space is determined by calculation,
It will be displayed in the place after moving accordingly. Accordingly, the player object has warped to a place different from the place where the user was before inputting the music, and is displayed in front of the warped destination background object. If it is determined in step 535 that the matching process has not been completed, the process returns to the main routine (S6).

On the other hand, when it is determined in step 533 that all the scales inputted by the player are not correct scales, the process proceeds to step 537. In step 537, "1" is set in the sound number register R2 (On = 1), and the player is prompted to perform the sound input operation again. Thereafter, the process returns to the main routine (S6).

If it is determined in step 520 that the collation mode is not currently being executed, it is determined in step 540 whether or not the free play mode is being executed. Free performance processing is performed. In this free performance process, a subroutine process shown in FIG. 19 is performed. That is, step 55
At 1, the pressed push-button switch is detected based on the data stored in the control pad data area 156 of the RAM 15. Step 552
, A scale corresponding to the push button switch is detected, and corresponding scale data is generated. Step 553
, The detected switch is the F button (switch 4
7R) is determined. If the F button is pressed, a process for raising a semitone is performed in step 554. If the F button is not pressed, the process skips step 554 and proceeds to step 555. The process for raising the semitone is a process of changing the scale data so that the scale corresponding to the operated switch is set to a scale raised by a semitone.
For example, when the player has selected the “La” pitch, 44
Although pitch data for generating a sound of a frequency of 0 Hz is generated, when the switch 47R is pressed, the pitch data is converted to pitch data for generating a sound of 440 × 2 ＾ (1/12) Hz which is a semitone higher pitch. Is done. However, the symbol “＾” means that the value before it is raised to the power by the value in parentheses after it.

In the following step 555, it is determined whether or not the joystick 45 is operated up and down (for example, whether or not the Y-axis counter 444Y is counting the stick tilt). When it is determined that the operation is performed up and down, in step 556, the scale data is changed in order to change the scale according to the amount of inclination of the joystick 45. For example, when the stick is neutral, the scale is based on the push button switch, and when the stick is tilted to the maximum upward position, the whole tone (or 1
Note) When the stick is tilted to the maximum downward position, the pitch is lowered by a full pitch. When the stick is between the neutral position and the maximum vertical tilt position, the scale is set to one tone according to the amount of tilt. Vary up and down in a range. For details,
1 cent divided into 200 whole notes (unit of scale: 2 ＾)
(1/200)) It may be raised or lowered in units. But,
Since the joystick 45 detects the amount of tilt of the stick with a count value of 0 to 64, it cannot be divided into 200. Therefore, when the stick is tilted upward, every time the absolute value X of the count value changes (1 cent. ) ＾ (200 /
The scale at the frequency of 64 × X) is changed.
Conversely, when the stick is tilted downward, every time the absolute value X of the count value changes (1 cent) / (200/6
4 × X). Now, assuming that the “la” interval (440 Hz) is selected, the interval data is 440 × ((2 ＾ (1 /
200)) A change is made to the pitch data for generating a sound of (200/64 × X)) Hz. That is, based on the scale specified by the push button switch, the frequency data of the scale changed upward or downward within the range of the whole tone corresponding to the inclination amount specified by the joystick is generated, and is generated in the voice list 158. (S554, S556, S558, S56)
0). The music data input by this repetition
In the audio processing of FIG. 24 to be described later, the music is read out at a fixed period and is generated as music. It should be noted that instead of changing within a range of one tone in step 556, when the stick is within a certain range between the neutral and the maximum inclination below or above, it may be changed by a semitone upward or downward. .

After step 556 or after it is determined in step 555 that the joystick 45 has not been operated up and down, the flow proceeds to step 557. Step 5
At 57, it is determined whether or not the joystick 45 is operated to the left or right (that is, whether or not the X-axis counter 444X counts the tilt of the stick). If it is determined that the operation has been performed to the left or right, a process for changing to vibrato-scale data with a changed depth value is performed in step 558 based on the left or right tilt amount of the joystick 45. Will be For example, do not apply vibrato when the stick is neutral,
When the stick is tilted left or right to the maximum, the deepest vibrato is applied, and when the tilt amount of the stick is between the neutral position and the maximum tilt position, the depth value is changed up and down according to the tilt amount. In the embodiment, in order to apply four-stage vibrato, a count value from 0 to 64 (X: absolute value) is processed, and the depth value is changed according to the count value. More specifically, when the stick is tilted to the left (or right), the depth value is set to 1.001807 / (X / 4). Each numerical value or set value is determined by experiment so as to provide a comfortable sound. Now, assuming that the user selects the “La” pitch (440 Hz),
The pitch data is 440 x (depth value = 1.001807 ＾)
(X / 4))-440 / (depth value = 1.001807)
程 (X / 4)) is changed to the pitch data of the vibrato sound whose frequency fluctuates up and down (vibrates).

After step 558 or after it is determined in step 557 that no operation has been made to the left or right, the flow advances to step 559. In step 559, the switch detected in step 551 is the G button (switch 47).
Z) is determined. In the case of the G button, in step 560, volume data for increasing the volume, for example, by 1.4 times, is generated so that the volume is increased while the scale remains unchanged. Thereafter, or after it is determined in step 559 that the G button has not been pressed, the process returns to the main routine (S6). The scale data and volume data generated as described above are registered in a voice list as sound data, and are output in voice processing (S8) and voice output (S10) described later.

On the other hand, when it is determined in step 540 that the free play mode is not being executed, it is determined in step 570 whether or not the game mode is being executed. If the game is being executed, a game process is performed in step 580. The game processing is performed by processing of a subroutine shown in FIG. That is, step 58
At 1, the position of the player object is detected. In step 582, it is determined whether or not the player object is at a position where a musical score of warp music should be displayed. If it is determined that the player object is at that position, in step 583, the bulletin board object is registered in the display list to display the score of a predetermined song on the bulletin board, and the song displayed on the bulletin board is displayed. Is written in the working memory area 157 of the RAM 15. As a result, an image as shown in FIG. 21 is displayed. This song is registered in the song list as a song that can be played, and is displayed as shown in FIG. Thereafter, or when it is determined in step 582 that it is not at the display position, the process proceeds to step 584.

At step 584, it is determined whether or not the player object is at a position where the sound played by the player should be recorded. If it is determined that the player object is at that position, in step 585,
Recording processing of the sound played by the player is performed. In this recording process, for example, when the player object encounters a specific person or object, an instruction is given to play music, and the player performs an operation for free performance (see the description of FIG. 19) according to the instruction. Then, the data of the performance song is
M15. The recording process is performed by executing a subroutine shown in FIG. That is, in step 586, 1 /
It is determined whether 20 seconds (3 frames) have elapsed, and if it has elapsed, in step 587, the data (all or sound-related data) stored in the control pad data area 156 is stored in the sound memory area 155. It is stored as recording data. Then or step 5
After it is determined at 86 that 1/20 second has not elapsed, the routine proceeds to step 588 (see FIG. 20).

At step 588, it is determined whether or not the player object is at the sound collation position. If the player object is at that position, step 58
At 9, a collation process of the sound played by the player is performed. This collation processing is the same as the collation processing in steps 520 to 530 except that the object to be collated with the played music is “the music selected by the player” or “q music recorded by the player”. Therefore, the description is omitted. Then or step 58
After it is determined in step 9 that the position is not at the sound collation position, the process proceeds to step 590.

At step 590, it is determined whether or not the player object is at a place (or position) where sound should be reproduced. If you are at that location, go to step 591
, A process of arranging sound data based on the recorded controller data is performed. The arranging process is, for example, a process of adding a tone of an instrument other than the instrument played by the player, or changing the rhythm according to the atmosphere of the screen. In step 592,
A sound setting process is performed. In this process, music data created by the arrangement process and other sound data are mixed and registered in a voice list. By performing the sound setting process, the music input (composed) by the player is
M can be generated during a game or used as a sound of an animal object. In step 593, processing of other games that are not processed in steps 581 to 592 described above (for example, battle processing between a player object and an enemy, processing for displaying characters, and the like) are performed.

Next, the operation of the above-described drawing process (step 7) subroutine will be described with reference to FIG. In step 701, a coordinate conversion process is performed. Under the control of the RCP 12, the coordinate conversion processing is performed by converting coordinate data of a plurality of polygons of a moving object such as an enemy, a player, a friend, or a stationary object such as a background stored in the image data area 154 of the RAM 15 into a camera. Is performed by converting the coordinates into the viewpoint coordinates. Specifically, an operation is performed to convert each polygon data constituting a plurality of moving objects and stationary objects from absolute coordinates to data of camera coordinates so that an image is viewed from the viewpoint of the camera. In step 702, a drawing process is performed on the frame memory. In this process, color data determined based on texture data is stored in a frame memory area 1 on one triangular surface forming each object surrounded by polygon coordinates converted into camera coordinates.
This is performed by writing every 52 dots. At this time, based on the depth data of each polygon, the object in front (near) is displayed preferentially,
The color data of the nearby object is written, and the depth data corresponding to the dot on which the color data is written is Z
The data is written to the corresponding address in the buffer area 153. Thereafter, the process returns to the main routine (S8). This step 701
And 702 are performed within a fixed time for each frame, but are sequentially processed for each polygon constituting each of a plurality of objects to be displayed on one screen, and the processing of all the objects to be displayed on one screen Is repeated until the process ends.

Next, the operation of the above-described audio processing (step 8) subroutine will be described with reference to FIG. At step 801, it is determined whether or not the audio flag is turned on. If it is determined that the switch is turned on, the audio data registered in the audio list 158 is read out in step 802, and the sampled audio digital data to be reproduced in one frame (1/60 second) is buffered. (Not shown). In step 803, the sound generation circuit 16 converts the digital data (or frequency data) stored in the buffer into an analog signal, and sequentially outputs the analog signal to the speaker. Thereafter, the process returns to the main routine (S9), and the processing of steps 9 to 12 is performed. Note that a plurality of frequency data corresponding to music input by operation of the controller 40 are registered in the voice list 158 in advance in the automatic performance processing shown in FIG. 18 or the free performance processing shown in FIG.
In this audio processing (S801, S802), music is generated by being sequentially read from the audio list 158 at a constant period and converted into an analog signal.

[0076]

[Brief description of the drawings]

FIG. 1 is a principle block diagram of the present invention.

FIG. 2 is an external view showing a configuration of a video game system according to one embodiment of the present invention.

FIG. 3 is a block diagram of a video game system according to one embodiment of the present invention.

FIG. 4 is a block diagram of a controller 40;

FIG. 5 is a memory map schematically showing a memory space of an external ROM 21.

FIG. 6 is a memory map showing a part of a memory space of an external ROM 21 in detail.

FIG. 7 is a memory map schematically showing a memory space of a RAM 15;

FIG. 8 is a main routine flowchart of a game process according to one embodiment of the present invention.

FIG. 9 is a subroutine flowchart of a player object process.

FIG. 10 is a subroutine flowchart of background object processing.

FIG. 11 is a subroutine flowchart of a sound processing mode selection process.

FIG. 12 is a subroutine flowchart of sound processing.

FIG. 13 is a schematic view of a three-dimensional game field of the present invention.

FIG. 14 shows a display example of a music selection screen.

FIG. 15 shows a display example of a sound input mode screen.

FIG. 16 shows a display example of a screen during automatic performance.

FIG. 17 is a display example of a musical score / note on a sound input screen.

FIG. 18 is a subroutine flowchart of an automatic performance process.

FIG. 19 is a subroutine flowchart of a free performance process.

FIG. 20 is a subroutine flowchart of a game process.

FIG. 21 shows a display example of a bulletin board.

FIG. 22 is a subroutine flowchart of a recording process.

FIG. 23 is a subroutine flowchart of a drawing process.

FIG. 24 is a flowchart illustrating a subroutine of audio processing.

[Explanation of symbols]

REFERENCE SIGNS LIST 10 video game machine 11 CPU (central processing unit) 12 RCP (reality coprocessor) 15 RAM (temporary storage memory) 18 controller control circuit 20 ROM Cartridge 21 ROM storing game program (information storage medium storing game program) 30 Display device 40 Controller (operation means) 44 Operation signal processing circuit 45 Analog joystick (Joystick) 50: RAM cartridge 51: RAM (writable / readable memory)

 ──────────────────────────────────────────────────続 き Continued on the front page (72) Koji Kondo, Nintendo Co., Ltd., 60, Fukuinakamimatsumatsu-cho, Higashiyama-ku, Kyoto (72) Inventor Yoji Inagaki 60, Fukuinakami-Takamatsucho, Higashiyama-ku, Kyoto, Nintendo Co., Ltd. (72) Inventor Tsuyoshi Kihara 60 Fukuinakami Takamatsucho, Higashiyama-ku, Kyoto Nintendo Co., Ltd.

Claims (15)

[Claims] An operation means operated by a player,
A video game having sound input and sound generation functions, including image processing means for performing processing based on a program, changing a display image in accordance with operation of an operation means, and supplying image data for display to a display device; In the apparatus, the operation means includes at least a plurality of push button switches for instructing an operation of a player object, a player object image data generating means for generating data for displaying an image of the player object, A non-player object image data generating means for generating data for displaying an image of an object; a push button detecting means for detecting a type of the pressed push button switch among the plurality of push button switches; Push button detected Scale selection means for selecting a corresponding scale; frequency data generation means for directly generating frequency data corresponding to the scale selected by the scale selection means based on the type of the push button switch detected by the push button detection means A temporary storage unit for storing a plurality of the frequency data; a writing unit for sequentially writing the frequency data generated by the frequency data generation unit in the temporary storage unit at a constant cycle; a frequency data stored in the frequency data temporary storage unit Reading means for sequentially reading out frequency data which is present, voice signal generating means for generating a voice signal of a frequency corresponding to frequency data based on the frequency data read by the reading means, and voice signal generating means for generating the voice signal. In connection with music, the player object image data generation A sound input and sound generation function comprising a display object changing means for changing a display state of at least one of a player object generated from a row and a non-player object generated from the non-player object image data generating means; Video game device having. 2. The operating means further includes an analog joystick capable of selecting a plurality of positions and instructing a moving direction of a player object on a screen in accordance with the operation, and detecting a tilt amount of the analog joystick. Frequency data generating means, based on the amount of tilt detected by the tilt amount detecting means and the type of push button switch detected by the push button detecting means. The video game having a sound input and sound generation function according to claim 1, wherein the frequency data corresponding to the selected scale is generated directly or the frequency data obtained by changing the frequency corresponding to the selected scale is generated. apparatus. 3. The video game apparatus according to claim 1, wherein said display image changing means changes the display state of the non-player object. 4. The display image changing unit according to claim 3, wherein the display image changing unit changes the display state of the non-player object so that the background screen on which the player object exists advances to a scene different from the scene immediately before. A video game device having a sound input and sound generation function. 5. The video game apparatus according to claim 1, wherein said display image changing means changes the display state of the player object. 6. Operation means operated by a player;
A video game device having a sound input and sound generation function including image processing means for performing a process based on a program, changing a display image in accordance with an operation of an operation means, and supplying image data for display to the display device In the above, the operation means, a plurality of push button switches for instructing the operation of the player object, and an analog joystick capable of selecting a plurality of positions and instructing the moving direction of the player object on the screen according to the operation, A player object image data generating means for generating data for displaying an image of the player object; a non-player object image data generating means for generating data for displaying an image of an object other than the player object; Push button switch A push button detecting unit that detects a type of a pressed push button switch; a scale selecting unit that selects a scale corresponding to the push button detected by the push button detecting unit; a tilt that detects a tilt amount of the analog joystick Based on the tilt amount detected by the tilt amount detecting means and the type of the push button switch detected by the push button detecting means, frequency data corresponding to the scale selected by the scale selecting means. It occurs as it is,
Or frequency data generating means for generating frequency data with a frequency corresponding to the selected scale changed, temporary storage means for storing a plurality of the frequency data, frequency data generated by the frequency data generating means at a fixed period Writing means for sequentially writing to the temporary storage means; reading means for sequentially reading the frequency data stored in the frequency data temporary storage means; corresponding to the frequency data based on the frequency data read by the reading means. Audio signal generating means for generating an audio signal having a frequency, and a player object generated from the player object image data generating means in association with music generated by the audio signal generating means; and a non-player object image data generating means. Of the non-player object generated by the means A video game device having a sound input and sound generation function, comprising a display image changing means for changing at least one display state. 7. The frequency generating means, when the inclination amount detecting means does not detect the inclination amount of the analog joystick, generates the frequency corresponding to the scale selected by the scale selecting means as it is, and the inclination amount detecting means The sound input according to claim 6, wherein when detecting the inclination amount of the analog joystick, a frequency changed according to the inclination amount is generated based on a frequency corresponding to the scale selected by the scale selection means. A video game device having a sound generation function. 8. A frequency data generating means for generating frequency data corresponding to the push button switch selected by the scale selecting means, a temporary storing means for temporarily storing frequency data, a frequency data generating means. Writing / reading means for writing the frequency data generated by the means to the temporary storage means or reading out the frequency data temporarily stored in the temporary storage means, wherein the writing / reading means comprises: When the inclination amount of the analog joystick is not detected, a digital value corresponding to a frequency corresponding to the scale selected by the scale selection unit is written as frequency data in the temporary storage unit. When the amount is detected, the sound selected by the scale selecting means is selected. Based on the corresponding frequency, write frequency data was changed in the temporary storage means according to the inclination amount, a video game device having a sound input and sound generating function according to claim 6. 9. The tilt amount detecting means changes the frequency of the musical scale to be higher within a predetermined pitch range in response to tilting the analog joystick to one side, and responds to tilting the analog joystick to the other side. 7. The video game device according to claim 6, wherein the frequency of the musical scale is changed so as to lower the frequency within a predetermined pitch range. 10. An operating means having a plurality of push button switches for instructing an operation of a player object operated by a player, and a display image is changed according to an operation of the operating means by performing a process based on a program. Video including processing means for supplying image data for display to a display device, temporary storage means for temporarily storing data relating to processing, and audio processing means for generating an audio signal by performing processing based on a program An information storage medium that stores a game program and is applied to a game device, wherein a player object image data storage unit that generates data for displaying an image of the player object, for displaying an image of an object other than the player object. Non-player object image data A push button detection program storage unit that stores a program for detecting the type of the pressed push button switch among the plurality of push button switches; a scale corresponding to the push button detected by the push button detection program A scale selection program storage unit for selecting a frequency, a frequency data generation program storage for directly generating frequency data corresponding to the scale selected by the scale selection program based on the type of the push button switch detected by the push button detection program. A writing program storage unit for sequentially writing the frequency data generated by the frequency data generation unit to the temporary storage unit at a constant cycle, and a reading program for sequentially reading the frequency data stored in the temporary storage unit. Read program An audio signal generation program storage unit for storing an audio signal generation program for generating an audio signal of a frequency corresponding to the frequency data in association with the frequency data read by the processing based on the read program; A display state of at least one of a player object read from the player object image data storage unit and a non-player object read from the non-player object image data storage unit changes based on music generated by the processing of the signal generation program. An information storage medium storing a game program, the storage medium having a display image change program storage unit for storing a program for changing a display image to be displayed. 11. The display image change program storage section,
The information storage medium storing the game program according to claim 10, wherein a program for changing the display state of the non-player object so as to advance the background screen on which the player object is present to a scene different from the previous scene is stored. . 12. The information storage medium according to claim 10, wherein said display image change program storage means stores a program for changing a display state of a player object. 13. A predetermined music determination program storage section storing a program for determining that music based on frequency data sequentially read by processing the program in the read program storage section is predetermined music. The display image change program storage unit displays an image of at least one of a non-player object and a player object in response to a determination that the music is a predetermined music by the processing of the program in the predetermined music determination program storage unit. Memorize the program that changes the state,
An information storage medium storing the game program according to claim 10. 14. The predetermined music judgment program storage section,
Data relating to music input by the operation of the operation means is temporarily stored, and when music is input by operating the operation means with a certain delay, music input first and music input later 14. An information storage medium storing the game program according to claim 13, which stores a program for comparing the music program with a music program when there is a predetermined relationship. 15. The operation means further includes an analog joystick capable of selecting a plurality of positions and instructing a moving direction of a player object on a screen in accordance with the operation, and detecting a tilt amount of the analog joystick. Frequency data generating means, based on the amount of tilt detected by the tilt amount detecting means and the type of push button switch detected by the push button detecting means. The information storage medium storing the game program according to claim 10, wherein the game program according to claim 10, which directly generates frequency data corresponding to the selected scale, or generates frequency data obtained by changing a frequency corresponding to the selected scale.