JP3515398B2 - Sound generator - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a sound (or music) generating device, and more particularly to a sound generating device for inputting a sound or playing music using a controller for a video game machine, for example.

[0002]

2. Description of the Related Art In a conventional video game, like the game software "Mario Paint" sold by the applicant of the present application, a staff notation is displayed on the screen, and an operator is operated to display notes or tones on the staff. The sound to be generated was input by entering a designated symbol (hereinafter collectively referred to as a note). Further, there was an electronic musical instrument (keyboard musical instrument) having a keyboard including key switches corresponding to musical scales. Furthermore, in a conventional video game, when a specific switch for instructing an operation such as missile launch, jump, or punch is pressed, a sound effect (missile launch sound, jump, punch, etc.) corresponding to the operation is generated based on a program. The generated sound effect) is generated, and the BGM music is generated according to the change of the game screen.

[0003]

A sound generating device used in a conventional video game (including a game for a game-only machine or a game for a personal computer) requires the display of a staff, and the program becomes complicated. The operation for inputting is also not easy, and does not generate a scale sound according to the key input by the player. On the other hand, an electronic musical instrument having a keyboard can generate only a sound corresponding to the switch when the switch is pressed, and requires a number of key switches corresponding to the scale of the required range, and inputs the sound with a small number of switches. However, it was difficult to change the sound complicatedly, and the structure was complicated and expensive. Further, in the conventional video game having a sound generation function, the progress of the game is not changed or the progress of the game is not influenced based on the sound or music generated by the operation of the player.

[0004] The main purpose of the therefore, the present invention is, flop
The music registered in the layer can be generated as BGM.
It is to provide a sound generating device for a game machine that is capable. Another object of the present invention is to provide a limited and small number of operation button switches.
The music of the scale that cannot be expressed only by the player.
A game that can be generated as BGM of registered music
It is to provide a sound generating device for beam machine.

[0005]

The invention according to claim 1 is
A game console controller with multiple operation switches
You can enter notes with different scales by specifying the scale using
A game that generates music based on the input force and the input sound
A sound generator for a machine, which is a temporary storage device for operating state data.
Stage, registration processing means, music data temporary storage means, sound setting hand
A stage, a reading means and a voice signal generating means are provided. Operation letter
State data temporary storage means, among the plurality of operation switches,
The operation state data of the operated operation switch is stored.
The registration processing means stores the operation state data of the operation switch in one
Extracted at regular intervals and registered in operation status data temporary storage means
To do. The music data temporary storage means temporarily stores the music data.
I remember. The sound setting means is operated by the registration processing means.
Based on the operation status data registered in the data temporary storage means
And corresponds to the scale specified by the operation switch.
Generate frequency data and write it to the music data temporary storage means.
Put in. The reading means is stored in the music data temporary storage means.
Frequency data is read out sequentially. Audio signal generating means
Is based on the frequency data read by the reading means.
And generate a voice signal of the scale corresponding to the frequency data.
It Then, the reading means writes in the music data temporary storage means.
Continuously read the stored frequency data for a certain time
By issuing it, the music registered by me is emitted as BGM.
Grow The invention according to claim 2 is the game according to claim 1.
The operation switches of the controller
Multiple operation button switches assigned to the scale
Analog joy that can select multiple tilt positions
Composed of sticks. Registration processing means operation
When the button switch is operated, the operation button switch
Operation data as the operation status data
State data temporary storage means to store the analog joystick.
Analog joystick when the control is operated
Operation state data using the tilt amount data of
It is configured to be stored in the temporary storage means. Sound setting hand
The column indicates the operation status registered in the operation status data temporary storage means.
If the status data is the operation button switch type data,
In the scale specified by the type of the operation button switch
Generate the corresponding frequency data,
The tilt amount differs from the scale corresponding to the operation button switch.
The frequency data of the corresponding scale of the intermediate tone is generated. Claim
The invention according to 3, includes a plurality of operation button switches and a plurality of stages.
Analog joysty with selectable floor tilt position
Using a controller for game consoles with
By inputting the sound of the specified scale and
Sound generation for game consoles that generate music based on the input sound
A raw device, which is a temporary storage unit for operation state data, a registration unit
Processing means, music data temporary storage means, sound setting means, reader
And a sound signal generating means. Operation status data 1
The time storage means is the operation which is pressed among the operation switches.
Operation switch type data and analog joystick
And the inclination amount data of are stored as operation state data. Noboru
The recording processing means keeps the operation state data of the operation switch constant.
Extracted at each cycle and registered in the operation status data temporary storage means
It The music data temporary storage means temporarily stores the music data.
To do. The sound setting means is operated by the registration processing means.
Based on the operation status data registered in the temporary data storage means
To generate frequency data and store it in the music data temporary storage means.
Write. The reading means is stored in the music data temporary storage means.
The frequency data being read are sequentially read. Voice signal generation
Means for reading the frequency data read by the reading means.
Based on the audio data of the frequency corresponding to the frequency data
Occur. The reading means is a music data temporary storage device.
The frequency data for a certain time stored in the
The music registered by me can be read as BGM by reading
And generate it. The invention according to claim 4 includes a plurality of operation steps.
Using a controller for game consoles with an
Input and input sounds of different scales by specifying
Sound generator for game machines that generates music based on the generated sound
A background image data generating means, a player object
Image data generation means, operation status data temporary storage
Stage, registration processing means, music data temporary storage means, sound setting hand
A stage, a reading means and a voice signal generating means are provided. Background
Image data generation means
The first place where you can register your desired music
So that you can generate your own music as BGM
Background images including the background image of the second location defined in
Generates background image data for the surface. Player object
The image data generation means is the controller of the player.
A player object that moves in the game space by operation
Generate image data of the image. Temporary storage of operation status data
The means is the operation switch that is operated among the plurality of operation switches.
Stores the operation status data of the switch. The registration processing means is
The player object is the first place in the game space
Control switch operation status data
Is extracted at regular intervals to temporarily store operation state data.
Register with. The music data temporary storage means stores the music data.
Store temporarily. The sound setting means is registered by the registration processing means.
Based on the recorded operation status data, the operation switch
Frequency data corresponding to the scale specified by
Write to music data temporary storage means. The reading means is
The ear object is in the second place in the game space
When present, it is stored in the music data temporary storage means
Frequency data is read out sequentially. The voice signal generating means is
Based on the frequency data read by the output means,
An audio signal of a scale corresponding to the frequency data is generated. So
Then, the reading means is stored in the music data temporary storage means.
The frequency data for a certain time
Generates music that you registered as BGM by
It The invention according to claim 5 is the reading means according to claim 4.
However, if the player object is
Music data temporary storage means during the period of existence in the place
Is the stored frequency data for a certain time continuous?
Music that you registered by repeatedly reading one
Are repeatedly generated as BGM.

FIG . 1 is a block diagram of the principle of a sound generator.
It Next, the principle of the sound generator will be described with reference to FIG.
It The sound generation device has different scales by designating a scale using a game machine controller having a plurality of push button switches and an analog joystick (hereinafter, abbreviated as “joystick”) capable of selecting a plurality of stages of positions. A sound generation device for inputting a sound and generating the input sound (or music based on the sound), comprising a push button detection means, an inclination amount detection means, a frequency generation means, and an audio signal generation means. . The push button switch is, for example, "re", "fa", which is provided for scale selection.
Includes multiple switches to generate each of the "La" and "Si" sounds, and a switch to generate the "Le" sound that is one octave higher if necessary, and an auxiliary scale selection The switch further includes a switch for increasing the sound selected by the switch for a semitone, a volume up switch for increasing the sound, and a switch for canceling the sound input mode and returning to the game mode. The joystick includes photointerrupts for the X-axis and the Y-axis in order to decompose the lever tilt direction into the X-axis direction and the Y-axis direction and generate the number of pulses proportional to the tilt amount. By giving the generated pulse signal to the counter and counting it, a count value proportional to the amount of tilt of the stick is generated. The push button detection means detects the type of the pressed switch among the plurality of push button switches. The scale selecting means selects a scale corresponding to the push button detected by the push button detecting means. The tilt amount detecting means detects the tilt amount of the joystick. Specifically, the tilt amount detecting means detects the tilt angle in one direction from the neutral position of the joystick in 64 steps, for example. The frequency generating means corresponds to the scale selected by the scale selecting means based on the type of the push button switch detected by the push button detecting means when the inclination amount detected by the inclination detecting means is in the neutral position. When the tilt amount (or tilt angle) detected by the tilt amount detection means is not in the neutral position, the frequency corresponding to the selected scale is set according to the tilt amount of the analog joystick. Generate a changed frequency. The voice signal generating means generates a tone signal having a scale corresponding to the frequency generated by the frequency generating means. The signal output from the audio signal generating means is given to an audio generator such as a speaker and is generated as an audio of the input sound. Thus, the game machine controller can be used to input a sound or a scale with a small number of switches and a simple operation.

[0007] If necessary, vibrato means are further provided in order to generate a vibrato sound with a wide variety of and simple operations. Vibrato means is a one which changes a depth value of vibrato based on the inclination amount detected by the tilt amount detection means, different inclination from the inclination direction of the joystick used for the frequency generating means to vary the frequency Of the vibrato based on the direction (the tilt direction for detecting the degree of vibrato: for example, if the tilt direction for changing the frequency is the vertical direction, the tilt direction for detecting the vibrato is selected as the horizontal direction). Change the depth value. In this case, the frequency generating means is
When the amount of tilt of the joystick is in the neutral position, the frequency corresponding to the scale selected by the scale selection means is generated without vibrato based on the type of the push button switch detected by the push button detection means, and the tilt is generated. When the amount of tilt detected by the amount detecting means is not in the neutral position, the sound of the frequency corresponding to the scale based on the type of push-button switch and changed according to the depth value of the vibrato (vibrato applied) Sound). Further, if necessary, the tilt direction of the joystick may be specified by a combination of a direction specifying the frequency (up and down) and a direction specifying the vibrato depth value (left and right). Furthermore, a volume means may be provided together with a damping means to enhance the vibrato effect. When the push button switch is pressed, the attenuating means is used to gradually reduce the volume at a predetermined time and smoothly attenuate it to zero. The volume means is used for adjusting the volume.

[0008] As a specific configuration of the frequency generating means comprises a frequency data generation means, a temporary storage means, and writing and reading means. The frequency data generating means generates frequency data corresponding to the push button switch selected by the scale selecting means. The temporary storage means temporarily stores frequency data corresponding to the input sound or scale. write·
The reading means writes the frequency data generated by the frequency data generating means in the temporary storage means or reads the frequency data temporarily stored in the temporary storage means. Also,
The writing / reading means, when the tilt amount detecting means does not detect the tilt amount of the joystick, writes the digital value corresponding to the frequency corresponding to the scale selected by the scale selecting means into the temporary storage means as the frequency data, and calculates the tilt amount. When the detecting means detects the tilt amount of the joystick, the frequency corresponding to the scale selected by the scale selecting means is used as a reference, and the digital value of the frequency changed according to the tilt amount is written in the temporary storage means as frequency data. . The frequency data read from the temporary storage means by the writing / reading means is converted into a sound signal of a corresponding frequency by the sound signal generating means and is generated.

According to the present invention, a controller for a game machine
By specifying the scale using
The music registered in can be generated as BGM.

[0010]

EXAMPLES Next, specific examples of the sound generating apparatus of the present invention will be described. In the following embodiments, a case where the sound generating device is applied to a video game device will be described.
It is pointed out in advance that the technical idea of the present invention can be applied to an information processing device such as a personal computer or an electronic musical instrument. Further, as the operation means, the case of the controller for the video game machine will be explained, but any structure may be adopted as long as it has a plurality of switches and an analog operation input means.

FIG. 2 is an external view showing the structure of a video game device according to an embodiment of the present invention. The video game device (or video game system) is a video game console body 10.
And a ROM cartridge 20 which is an example of an external storage means,
It is configured to include a CRT display 30 which is an example of a display device connected to the video game machine body 10 and a controller 40 which is an example of operation means (or operation input means).
The RAM cartridge 50 (or the vibration cartridge 50A) is detachably attached to the controller 40 as needed.

The controller 40 comprises a housing 41 having a shape that can be held by both hands or one hand, and is provided with a plurality of switches or buttons. Specifically, the controller 4
In the case of 0, handles 41L, 41C and 41R are provided at the lower portions of the left and right and the center of the housing 41, and the upper surface thereof is used as an operation area. In the operation area, an analog joystick (hereinafter abbreviated as “joystick”) 45 capable of analog direction input is provided at the lower center, and a cross-shaped digital direction switch (hereinafter referred to as “cross switch”) 46 is provided on the left side. Therefore, a plurality of button switches 47A to 47C are provided on the right side. The joystick 45 is used to instruct or input the moving direction and / or moving speed (or moving amount) of the player object according to the tilt amount and direction of the stick. In addition, the joystick 45 indicates a frequency change amount for changing the frequency of the inputted scale when playing a music by inputting a sound or inputting a sound, and a sound when vibrato is applied to the sound. It is used to change the frequency of the generated sound in various ways by designating a depth value indicating the depth of. The cross switch 46 is used instead of or together with the joystick 45 to digitally instruct the moving direction of the player object. The plurality of button switches 47 include switches 47A and 47B for instructing the operation of the player object in a normal game mode, a switch 47C used for switching the viewpoint of the image viewed from the camera, and the start switch 4.
7S, an operation switch 47L provided on the upper left side surface of the housing 41, an operation switch 47R provided on the upper right side surface of the housing 41, and a switch 47Z provided on the back side of the handle 41C. The switch 47C has four button switches 47Cu, 47Cd, 4 on the left, right, top and bottom.
7Cl and 47Cr are arranged to control the moving speed in a shooting or action game (eg acceleration,
It is also used for deceleration.

The video game machine controller 40 is also provided.
The switch 47A is used as a button for selecting a scale (for example, a button for generating a "re" tone) in order to input an arbitrary tone or scale by using or to play music by inputting the tone. . The switch 47B is used to return from the mode of playing music to the normal game mode. The switch 47R is used to raise the selected scale by a semitone. The switch 47Z is used to increase the volume (for example, 1.4 times). Switch 47C (a plurality of switches 47Cu, 47Cl, 47C
r, 47Cd) is used as a button for selecting a musical scale, like the switch 47A. In the following embodiment, the switch 47Cd is “Fa”, the switch Cr is “Ra”, the switch Cl is “Si”, and the switch Cu is “Re” (the switch 4).
It is used as a button to specify each sound of "Le" which is one octave higher than "Le" of 7A. The functions of these switches 47A to 47Z are defined as arbitrary functions by the game program.

FIG. 3 is a block diagram of a video game system according to an embodiment of the present invention. The video game machine 10 includes a central processing unit (hereinafter abbreviated as “CPU”) 1
1 and a coprocessor (reality coprocessor: abbreviated as “RCP” hereinafter) 12 are incorporated. RCP12
Includes a bus control circuit 121 for controlling the bus,
An image processing unit (reality signal processor; hereinafter abbreviated as "RSP") 122 for performing polygon coordinate conversion, shading processing, etc., and polygon data can be rasterized into an image to be displayed and stored in a frame memory. An image processing unit (reality display processor; hereinafter abbreviated as “RDP”) 123 for converting into a data format (dot data) is included. The RCP 12 is connected to a cartridge connector 13 for detachably mounting the ROM cartridge 20, a disk drive connector 14 for detachably mounting the disc drive 26, and a RAM 15. Further, the RCP 12 is connected to an audio signal generation circuit 16 for outputting an audio signal processed by the CPU 11 and an image signal generation circuit 17 for outputting an image signal. Further, the RCP 12 is connected to a controller control circuit 18 for serially transferring operation data of one or more controllers 40A to 40D and / or data of the expansion RAM cartridge 50.

Bus control circuit 121 included in RCP 12
Performs parallel-serial conversion of a command given as a parallel signal from the CPU 11 via the bus and supplies the command to the controller control circuit 18 as a serial signal. In addition, the bus control circuit 121 is the controller control circuit 18
The serial signal input from is converted into a parallel signal,
It is given to the CPU 11 via the bus. Controller 40A
The data indicating the operation state read from -40D is C
It is processed by the PU 11 or temporarily stored in the RAM 15. In other words, the RAM 15 includes a storage area for temporarily storing the data processed by the CPU 11, and is used to smoothly read or write the data via the bus control circuit 121.

A connector 195 provided on the rear surface of the video game machine 10 is connected to the output portion of the audio signal generation circuit 16. A connector 196 provided on the rear surface of the video game machine 10 is connected to the output section of the image signal generation circuit 17. A voice generator 32 such as a speaker of a television is detachably connected to the connector 195. Connector 196
A display 31 such as a television receiver or a CRT is detachably connected to the.

Controller connectors (hereinafter abbreviated as “connectors”) 191 to 194 provided on the front surface of the video game machine 10 are connected to the controller control circuit 18. The controllers 40A to 40D are detachably connected to the connectors 191 to 194 via connection jacks. In this way, by connecting the controllers 40A to 40D to the connectors 191 to 194, the controllers 40A to 40D are electrically connected to the video game machine 10, and it is possible to transmit / receive or transfer data to / from each other.

FIG. 4 is a detailed circuit diagram of the controller 40 and the RAM cartridge 50. The housing of the controller 40 includes a joystick 45 and switches 4
Various circuits such as the operation signal processing circuit 44 are incorporated in order to detect the operation state of 6, 47 and the like and transfer the detection data to the controller control circuit 18. The operation signal processing circuit 44 includes a reception circuit 441, a control circuit 442, a switch signal detection circuit 443, a counter circuit 444, a joyport control circuit 446, a reset circuit 447, and a NOR gate 448. The receiving circuit 441 converts a control signal transmitted from the controller control circuit 18 and a serial signal such as write data to the RAM cartridge 50 into a parallel signal and supplies the parallel signal to the control circuit 442. The control circuit 442 is
When the control signal transmitted from the controller control circuit 18 is a reset signal for the X and Y coordinates of the joystick 45, a reset signal is generated and the NOR gate 448 is used to output the X-axis counter 444X and the Y-axis counter. The count value of the counter 444Y is reset (forced to 0).

The joystick 45 includes photointerrupts for the X-axis and the Y-axis in order to decompose the tilt direction of the lever into the X-axis direction and the Y-axis direction to generate a pulse number proportional to the tilt amount. Counter 444 for each pulse signal
X and counter 444Y. Counter 444X
Counts the number of pulses generated according to the amount of tilt when the joystick 45 is tilted in the X-axis direction. The counter 444Y counts the number of pulses generated according to the tilt amount when the joystick 45 is tilted in the Y-axis direction. Therefore, the moving direction and the coordinate position of the player object (or the protagonist character or the cursor) are determined by the combined vector of the X axis and the Y axis determined by the count values of the counters 444X and 444Y. The counter 444X and the counter 4
The count value of 44Y is also reset by a reset signal given from the reset signal generation circuit 447 when the power is turned on or a reset signal given from the switch signal detection circuit 443 when the player presses two predetermined switches at the same time. To be done.

The switch signal detection circuit 443 responds to the switch state output command given from the control circuit 442 at a constant cycle (for example, 1/60 second interval which is a television frame cycle), and the cross switch 46 and the switch 47A. A signal that changes depending on the pressed state of ~ 47Z is read and given to the control circuit 442. Control circuit 442
Responds to the read command signal of the operation state data from the controller control circuit 18, and supplies the operation state data of the switches 47A to 47Z and the count values of the counters 444X and 444Y to the transmission circuit 445 in a predetermined data format. The transmission circuit 445 converts the parallel signal output from the control circuit 442 into a serial signal, and the conversion circuit 43
And to the controller control circuit 18 via the signal line 42. A port control circuit 446 is connected to the control circuit 442 via an address bus and a data bus. When the RAM cartridge 50 is connected to the port connector 449, the port control circuit 446 controls data input / output (or transmission / reception) in accordance with an instruction from the CPU 11.

The ROM cartridge 20 is an external ROM 2
1 is mounted on a board, and the board is housed in a housing. The external ROM 21 stores image data and program data for image processing of games and the like, and also stores voice data such as music, sound effects, and messages as necessary.

FIG. 5 is a memory map schematically showing the memory space of the external ROM 21. FIG. 6 shows an external ROM 21
3 is a memory map showing in detail a part (image data area 24) of the memory space of FIG. The external ROM 21 has a plurality of storage areas (hereinafter, abbreviated as “area” when the data type name is added before “storage area”), for example, FIG.
As shown in, the program area 22 and the character code area 2
3, including an image data area 24 and a sound memory area 25, various programs are fixedly stored in advance.

The program area 22 is a program necessary for performing image processing such as a game (see FIGS. 8 to 1 which will be described later).
2, FIG. 18 to FIG. 20, and FIG. 22 to FIG. 24) stores programs for realizing the functions of the respective flowcharts, game data according to game contents, and the like. Specifically, the program area 22 is the storage areas 22a to 22 for fixedly storing the operation program of the CPU 11 in advance.
Including i. The main program area 22a stores a processing program of a main routine of a game or the like shown in FIG. 8 described later. The control pad data (operation state) determination program area 22b stores a program for processing data indicating the operation state of the controller 40 and the like. In the write program area 22c, the frame memory and Z to be written by the CPU 11 in the RCP 12 are written.
A writing program to the buffer is stored. For example, in the write program area 22c, color data is written in a frame memory area (152 in FIG. 7) of the RAM 15 as image data based on texture data of a plurality of moving objects or background objects to be displayed on one background screen. A program and a program for writing the depth data in the Z buffer area (153 in FIG. 7) are stored respectively. The moving object control program area 22d stores a control program for the CPU 11 to act on the RCP 12 to change the position of the moving object in the three-dimensional space. The camera control program area 22e stores a camera control program for controlling at which position and in which direction in a three-dimensional space a moving object including a player object and a background object are photographed. In the player object program area 22f,
A program (see FIG. 9) for display control of an object operated by the player is stored. In the background program area 22g, the CPU 11 acts on the RCP 12 to generate a three-dimensional background screen (still screen or course screen).
Background creation program (see Figure 10)
Is memorized. The voice processing program area 22h stores a program (see FIG. 24) for generating a sound effect, music, or a message by voice. The game-over processing program area 22i stores programs for processing when the game is over, such as detection of the game-over state and processing for saving backup data of the game state up to that point when the game is over. .

The character code area 23 is an area for storing a plurality of types of character codes, and stores, for example, dot data of a plurality of types of characters corresponding to the codes. The character code data stored in the character code area 23 is used for displaying an explanation to the player in the course of the game. For example, a text message (or an appropriate operation method) at an appropriate timing according to the surrounding environment of the player object (eg, location, type of obstacle, type of enemy object) or the situation where the player object is placed (or Used to display words).

The image data area 24 includes storage areas 24a-24b as shown in FIG. Image data area 24
Stores the image data such as coordinate data and texture data of a plurality of polygons for each object of the background object and / or the moving object, and fixedly displays or moves these objects at predetermined positions. It stores a display control program for causing it. For example, the storage area 24a stores a program for displaying the player object. A background object program for displaying a plurality of background (or stationary) objects 1 to n1 is stored in the storage area 24b.

The sound memory area 25 stores sound data corresponding to each scene, such as dialogue for outputting a message suitable for the scene by voice, sound effects, game music, and the like.

As the external storage device, various storage media such as a CD-ROM and a magnetic disk may be used instead of the ROM cartridge 20 or in addition to the ROM cartridge 20. In that case, various data for game (including program data and data for image display) are read from an optical or magnetic disk-shaped storage medium such as a CD-ROM or a magnetic disk, or written as necessary. A disc drive (recording / reproducing device) 26 is provided for loading. The disk drive 26 reads data stored in a magnetic disk or an optical disk in which program data similar to the ROM 21 is magnetically or optically stored, and transfers the data to the RAM 15.

FIG. 7 is a memory map schematically showing the memory space of the RAM 15. The RAM 15 includes various storage areas 150 to 159. For example, in RAM15,
Display list area 150, program area 151, 1
A frame memory (or image buffer memory) area 152 for temporarily storing image data for frames, a Z buffer area 153 for storing depth data for each dot of the frame memory area, an image data area 154, and a sound processing area. Sound memory area 155 for temporarily storing data
An area 156 for storing the operation state data of the control pad, and a working memory area 157.
, Voice list area 158, and register / flag area 1
59 and 59 are included.

Each of the storage areas 151-159 has a CPU 11
Is a memory space that can be directly accessed by the RCP 12 via the bus control circuit 121, and is allocated to an arbitrary capacity (or memory space) depending on the game used. In addition, the program area 151 and the image data area 15
4. The sound memory area 155 is a part of data of a game program stored in the storage areas 22, 24, 25 of the ROM 21 for all stages (or scenes or fields) of one game, such as an action or a data. In the role-playing game, when a game program necessary for a certain stage or field (course in a racing game) is transferred, corresponding data is temporarily stored. In this way, a part of various program data necessary for a certain scene is stored in each storage area 151, 154,
If it is stored in the memory 155, the CPU 11 reads the data from the ROM 21 directly every time when the CPU 11 needs it, and processes it by C.
The efficiency of the PU 11 can be increased and the image processing speed can be increased.

Specifically, the frame memory area 152
Has a storage capacity corresponding to the number of pixels (pixels or dots) of the display 30 × the number of bits of color data per pixel, and stores color data for each dot corresponding to the pixels of the display 30. The frame memory area 152 is
Three-dimensional coordinates for displaying one or more stationary objects and / or moving objects to be displayed on one background screen stored in the image data area 154 in the image processing mode as an aggregate of a plurality of polygons Color data for each dot of an object visible from the viewpoint position is temporarily stored based on the data, and moving objects such as a player object, a companion object, an enemy object, and a boss object stored in the image data area 154 in the display mode. Background (or still)
When displaying various objects such as objects, color data for each dot is temporarily stored. Since moving objects such as enemy objects and boss objects, and background (or stationary) objects are objects that the player cannot move or change by operating the controller 40, they are collectively referred to as “non-players”. Sometimes called "object".

The Z buffer area 153 is used for the display 3
It has a storage capacity equivalent to the number of 0 pixels (pixels or dots) × the number of bits of depth data per pixel, and stores depth data for each dot corresponding to each pixel of the display 30. The Z buffer area 153 is a part of the object that can be seen from the viewpoint position based on the three-dimensional coordinate data for displaying one or more objects of the stationary object and / or the moving object in the image processing mode as an aggregate of a plurality of polygons. The depth data is temporarily stored for each dot, and the depth data for each dot of each moving and / or stationary object in the display mode is temporarily stored.

The image data area 154 stores the coordinate data and texture data of a polygon which is stored in the ROM 21 and is composed of a plurality of aggregates for each stationary and / or moving object for game display. Therefore, data for at least one stage or field is transferred from the ROM 21 prior to the image processing operation.

The sound memory area 155 is the ROM 21.
Part of the voice data (data of words, music, and sound effects) stored in the storage area is transferred, and the frequency data of the voice generated from the voice generation device 32 is temporarily stored. Further, the tone or scale data input by the player is also stored. The voice list area 158 stores voice data for creating a sound generated by a speaker.

The control pad data (operation state data) area 156 temporarily stores the operation state data indicating the operation state read from the controller 40. The work memory area 157 temporarily stores data such as parameters while the CPU 11 is executing the program.

The register / flag area 159 includes a plurality of register areas 159R and a plurality of flag areas 159F. The register area 159R is a register (music data register) R1 for storing musical scale data of a musical piece, a register (tone number register) R2 for storing the order of musical notes, a register for storing musical scale data input by a player (input musical scale). Register) R3, a register (tone matching register) R4 for storing the result of matching the scale, a register (background object number register) R5 for storing the number of background objects, and the like. The flag area 159F is
This is an area for storing a flag for knowing the state of the game in progress, and includes, for example, a sound collation flag F1, a game over flag F2 for identifying whether or not a condition for reaching the game over is detected.

FIG. 8 is a flow chart of the main routine of the video game system according to the embodiment of the present invention. Next, along the main routine flow chart of FIG. 8, referring to the detailed (or subroutine) flow chart of each operation shown in FIG. 9 to FIG. 12, FIG. 18 to FIG. The operation will be described.

When the power is turned on, at the start,
When the video game machine 10 is set to a predetermined initial state,
The CPU 11 transfers the start-up program of the game programs stored in the program area of the ROM 21 to the program area 151 of the RAM 15, sets each parameter to the initial value, and then executes the processing of the main routine flowchart shown in FIG. Run.

The main routine process is a process performed by the CPU 11 for each frame (1/60 seconds).
That is, the CPU 11 executes step 1 (indicated by adding “S” in the figure), step 2 to step 1 until one stage (or field or course) is cleared.
After performing the operation of 1, the operations of steps 2 to 11 are repeated. However, steps 7 and 8 are RCP12
Processed by. When the game is over without succeeding in clearing the stage, the CPU 11 performs the game over process of step 12. If the stage is successfully cleared, the process returns from step 11 to step 1.

Specifically, in step 1, a predetermined game is initialized (that is, a game start process). If necessary, when the game can be started from any position of a plurality of stages or courses, a stage or course selection screen is displayed. Since the game of stage 1 is played immediately after the start, the game start process of the stage is performed. For example, the register area 159R and the flag area 159F are cleared, various data necessary for playing the game of stage 1 (selected stage or course is also possible) are read from the ROM 21, and the storage areas 151 to 151 of the RAM 15 are read. 155.

In step 2, controller processing is performed. This process is performed by detecting which of the joystick 45, the cross switch 46, and the switches 47A to 47Z has been operated, reading the detection data (controller data) of the operation state, and writing the read controller data. Done.

In step 3, processing for displaying the player object is performed. This processing is basically processing for changing the direction and shape of the joystick 45 operated by the player and the presence or absence of an attack from an enemy, which will be described later with reference to FIG. For example, the display control of the player object is controlled by the storage area 22.
Based on the program transferred from f, the polygon data of the player object transferred from the storage area 24a, and the operation state of the joystick 45, the coordinate position and shape of the changed polygon data are calculated.
Color data is written at each address of the storage area 154 corresponding to the surfaces of a plurality of triangles formed by a plurality of polygons obtained as a result so that a pattern or colored paper designated by the texture data is attached.

In step 4, the background (or static,
(Operation) A process for displaying an object is performed. This process is a process of calculating the display position and the shape of the background object based on the program partially transferred from the storage area 22g and the polygon data of the background object transferred from the storage area 24.
This will be described later with reference to 0.

In step 5, sound processing is performed.
This sound processing is processing for playing the music input (played) by the player operating the controller 40, and specifically includes the processing shown in FIGS. 11 and 12 described later. Further, the subroutine during the sound processing includes the automatic performance processing shown in FIG. 18, the free performance processing shown in FIG. 19, the recording processing shown in FIG.

In step 6, camera processing is performed. For example, coordinate calculation of the angle at which each object is viewed is performed so that the line of sight or field of view when viewed through the viewfinder of the camera is at the angle specified by the player.

In step 7, the RSP 122 performs drawing processing. That is, the RCP 12, under the control of the CPU 11, based on the respective texture data of the enemy, the player, and the background object (moving object or stationary object) stored in the image data area 154 of the RAM 15, the moving object and the stationary object. Image data conversion processing (coordinate conversion processing and frame memory drawing processing) for the display processing is performed. Specifically, at each address of the storage area 154 corresponding to the surface of each triangle formed by a plurality of polygons for each of a plurality of moving objects and stationary objects, the texture data determined for each object is designated. Color data is written in order to paste colors and the like. For details on the drawing process,
It will be described later with reference to FIG.

In step 8, voice processing is performed based on voice data such as a message, music and sound effect. Details of the voice processing will be described later with reference to FIG.

At step 9, the RCP 12 reads out the image data stored in the frame memory area 152 based on the result of the drawing processing at step 7 to detect a player object, a moving object, a stationary object, an enemy object, etc. It is displayed on the display screen 31.

In step 10, the RCP 12 reads out the voice data obtained by the voice processing in step 8 to output voice such as music, sound effect or conversation.

In step 11, it is judged (clear detection) whether or not the stage or field has been cleared. If it has not been cleared, it is judged in step 11 whether or not the game is over, and if it is not over, the process returns to step 2 and the operations of steps 2 through 11 are repeated until the game over condition is detected. When it is detected that the number of mistakes allowed by the player reaches a predetermined number or a game over condition such as the life of the player object is exhausted by a predetermined number is detected, the game is continued or backed up in the following step 12. Game over processing such as data storage selection processing is performed. When the condition for clearing the stage (for example, defeating the boss) is detected in step 11, clear processing is performed in step 12, and then the process returns to step 1. The detailed operation of each subroutine will be described below.

Next, with reference to FIG. 9, the details of the player object display processing will be described. First, step 30
1, the joystick data stored in the control pad data area 156 is read and the data is corrected. For example, the data of the central part of the joystick 45 is deleted, and when the stick comes near the center (for example, radius 10 count), the data is processed so as to become "0". In this way, even if the manufacturing error of the joystick 45 or the player's finger slightly shakes, the joystick data can be accurately regulated to "0". The joystick 45 also corrects a predetermined range of the outer peripheral part of the operable range (that is, corrects so as not to output data of unnecessary parts in the game). Then, the joystick data Xj, Yj used during the game is obtained. That is, the data obtained in step 301 is the counters 444X and 444Y.
Since it is a count value of, it is converted into a value that is easy to process in the game. Specifically, Xj becomes "0" when the stick is not tilted, "+64" when it is tilted to the maximum in the -X (left) direction, and "+64" when it is tilted to the maximum in the + X (right) direction. -64 ". Yj becomes "0" when the stick is not tilted, and + Y (front)
When it is tilted to the maximum in the direction, it becomes "-64", and -Y (rear)
When it is maximally knocked in the direction, it becomes “+64”. In order to move the player object based on such joystick data, its coordinate position is obtained.

In step 302, processing such as a player object flying, cutting an enemy with a sword, or launching a missile is performed according to the operation of the push button switch. In Step 303, Step 3
The data of the player object to be displayed on one screen is registered in the display list area 150 based on 01 and the data on the player object obtained in step 302. This registration process is performed as a pre-process when displaying the player object in the drawing process (which will be described later with reference to FIG. 23).

The details of the background object display processing (processing of step 4) will be described with reference to FIG. In step 401, 1 is set in the background object number register R5. In step 402, register R
The background object specified by 5 is registered in the display list. In step 403, 1 is added to the register R5. Whether or not the process for displaying all the background objects of the number set by the program in step 404 is completed (in other words, whether the value of the register R5 matches the number of background objects to be displayed on one screen). Or not) is determined. If all the processing has not been completed, the process returns to the sweep 402, and steps 402 to
The process of 404 is repeated. When all the processes are completed, the process returns to the main routine (step 5 in FIG. 8).

Prior to a detailed description of the sound processing (step 5; the subroutine shown in FIGS. 11 and 12), which is a feature of the present invention, an outline of the game contents in which the sound generation function of the present invention is used will be described. This game is a game in which a player object clears an event while moving on various stages or fields in a three-dimensional space, or defeats an enemy to clear each stage. It is to achieve the purpose defined by the program while inputting a scale and playing music. Also, in this game, one or more kinds of songs are displayed on a bulletin board or the like in the middle of the game, and when the player operates the controller to play the songs, the predetermined music (that is, change the object The display state of at least one of the player object and the non-player object is changed. Specific examples of changing the object when a predetermined song or music is played (sound is input) include moving (or warping) the player object to a certain place in a specific three-dimensional space, and Allow entry into area (room) (or unlock door)
This may change the background screen around the player object. In other words, when warped, the display state of the non-player object is changed by changing to the background screen of the warp destination, and when allowing entry into a specific room, changing to a scene in that room. . As another example, it may be used to determine that the musical piece to be played is a predetermined musical piece, as a condition for unlocking the treasure box, or to attach a special armor or weapon to the player object. In that case, change the display state of the non-player object to open the treasure box,
The display state is changed so that the player object wears armor or the like, or has a weapon or the like.

FIG. 13 is a view showing the entire three-dimensional space in one stage or field. However, FIG. 13 is a bird's-eye view of the entire virtual space,
What is displayed on the screen of the CRT 30 as an actual game screen is a part of the vicinity of the player object. In this state, the player object is in the lower right position (place), and when the controller 40 is operated to play the music of a predetermined song, any one of the first to third places corresponding to the song is played. It is possible to move (or warp) to. At that time, the camera that captures the player object captures the player object in the moved place and the background image or the still image in the vicinity thereof, and as a result, the player object captured by the camera and the background image in the vicinity thereof are displayed on the CRT 30. It will be displayed on the screen.

Next, the details (subroutine) of the sound processing shown in step 5 will be described with reference to FIGS. 11 and 12. In step 501, it is determined whether or not the music selection screen is displayed. This song selection screen is, for example, a screen shown in FIG. 14, in which the player selects a specific button switch (for example, the start switch 47) during the game.
When S) is operated (or the icon of the instrument mark is clicked) to select a mode for playing an instrument (for example, blowing an ocarina), a mode is displayed as a window. At this time, in the window, a list of songs that can be played at present is displayed, as well as options for a free-playing (playing a song not in the song list) mode, options for closing the window, and the like. Preferably, a score (not necessarily a staff notation) is displayed in a part of the window, and a switch symbol corresponding to a note or a note is displayed. Further, the song list may be increased as the game progresses or an event in the game participates. The player operates the controller 40 to move a cursor displayed on the left side of the window up and down to select an arbitrary song and a free performance mode or a mode in which the window is closed. According to the selection result, the CPU 11 executes the program corresponding to the selection.

When it is determined in step 501 that the music selection screen is displayed, step 50
At 2, it is determined whether the player has selected the first song (for example, wind melody). When it is determined that the first song is selected, the data of the first song stored in the program area of the ROM 21 or the RAM 15 is stored in the song data register R1 in step 503.
Memorized in. In step 504, the number "1" indicating that the first sound is input is the sound number register R2.
Is set to. In step 505, the collation mode process is started. Specifically, processing for switching the screen from the music selection screen to the sound input screen (see FIG. 15) (see the description of step 524 for details) is performed. afterwards,
Return to the main routine (S6).

On the other hand, when it is determined in step 502 that the player has not selected the first song, in step 506 the player selects the second song (for example,
It is determined whether or not the melody of flame) is selected. Second
If it is determined that the selected song is selected, step 50
7, the data of the second music piece stored in the program area of the ROM 21 or the RAM 15 is stored in the music piece data register R1. Similarly, steps 502 and 5
If it is determined in 06 that it is not the first or second song, the process proceeds to step 508 to determine whether or not a song after the third song has been selected. However, in the figure, instead of the description of the specific determination step of whether or not it is the third piece,
(N is the maximum number determined by the program from 3)
It is shown as a general expression of whether or not the second song. In step 508, it is determined whether the Nth song has been selected by the player. When it is determined that the Nth song has been selected, the Nth song data is stored in the song data register R1 in step 509.

On the other hand, if it is determined in steps 502, 506, and 508 that none of the first to Nth songs has been selected, it is determined in step 510 whether the free performance mode has been selected. . When the free performance mode is selected, the processing of the free performance mode is started in step 511, the music selection screen is switched to the free performance mode screen (screen excluding the display of the operation guide in FIG. 15), and then the main routine ( Return to S6). If it is determined in step 510 that the free performance mode is not selected, it is determined in step 512 whether closing the window (or canceling the mode) is selected. When closing the window is selected, the window is closed in step 513 and normal game processing is performed, and then the main routine (S6).
Return to.

On the other hand, when it is determined in step 501 that the music selection screen is not displayed, it is determined in step 520 whether the collation mode is being executed. When it is determined that the collation mode is being executed, it is determined in step 521 whether the automatic performance is being executed. When it is determined that the automatic performance is not being executed, it is determined in step 522 whether or not the performance operation is being performed. If a performance operation has been performed, then in step 523 it is detected based on the control pad data which sound the switch corresponding to has been operated. Specifically, the type of push button switch and / or the joystick 45 stored in the control pad data area 156 of the RAM 15
The specified sound or scale is detected based on the inclination amount data of.

In the following step 524, the note symbols are registered in the display list in order to display the note symbols (objects) in the shape of a fairy as shown in FIG. 17 on the score. For example, in order to detect which of the scales of the push button switches has been pressed and to display the note object at the position of the score corresponding to that note, an object such as a note is registered in the display list. To be done. For example, when the sound input mode is selected by operating the controller 40, an object for displaying the image shown in FIG. 15 (for example, a music score is displayed in the upper stage of the screen, an operation guide is displayed in the lower stage, and a player is displayed between them). The object is a plurality of objects for displaying an image of playing an ocarina along with the sound input operation of the player) or an object for displaying the image shown in FIG. 16 (for example, an image showing automatic performance, which is compared to FIG. 15). A plurality of objects for displaying images without operation guides are registered in the display list. At this time, in the note display section in the upper part of the screen, the score as shown in the upper part of FIG. 17 is displayed, and at the position corresponding to the note to be input, the fairy symbol as shown on the left of the second part is displayed. When the key input is urged and a note to be input is input by the key input operation, the correct key input is displayed as shown on the right of the second row, and if there is no key input within the time, the third row Display as shown on the right. Object data for realizing such display is registered in the display list. When such registration in the display list is performed, after returning to the main routine after the processing in step 528 described later, in step 7, the drawing processing based on the registration in the display list is performed, and as a result, the step In FIG. 9, the image as shown in any of FIGS. 15 to 17 is displayed on the CRT 30. In addition, the detected sound data is registered in the sound list.
In step 525, the scale of the On-th tone in the song data stored in the song data register R1 and the scale specified by the operation of the controller 40 are compared to establish a predetermined relationship (or coincidence). If it is present), the comparison result is stored in the sound collation register R4. For example, "1" if the scales match and "0" if they do not match.
Are stored in the respective bits of the sound matching register R4 according to the order of sounds. As another method of storing the comparison result, if all the scales match, "1" is written in the sound collation flag F1 and if one sound is wrong, the sound collation flag F1 is written.
The comparison result may be saved by writing “0” in.

At step 526, 1 is added to the value of the note number register R2, and the addition result is temporarily stored in the note number register R2. In other words, the calculation of On = On + 1 is performed, and the latest calculation result is stored as On. In step 527, it is determined whether or not the value (On) of the tone number register R2 is larger than the number of notes, and if it is determined to be larger, automatic performance processing is performed in step 528. After that, the process returns to the main routine (S6).

On the other hand, if it is determined in step 522 that the controller 40 is not operated,
In step 529, it is determined whether a predetermined time has passed. If the predetermined time has elapsed, step 526
If not, it returns to the main routine. Here, the determination of the lapse of the predetermined time is made by assuming that the sound is not input unless the player presses the push button switch within the predetermined time (for example, 5 seconds), and switches other than the sound are detected. This is to shift to input processing.

On the other hand, when it is determined in step 521 that the automatic performance is being performed, step 530
Automatic performance processing based on the collation result (see Figure 18)
Is done. Next, details of the automatic performance process will be described with reference to FIG. In step 531, it is determined whether or not the automatic performance has ended. If not, the automatic performance processing is performed in step 532. Specifically, the score is initially blank. Next, based on the scale data temporarily stored in the input scale register R4, in order to display the musical notation mark (object) at the position of the score corresponding to each of the inputted first to last notes. , The musical notation mark is registered in the display list, and the voice data corresponding to the scale is registered in the voice list. as a result,
As shown in FIG. 17, symbols (▽, leftward triangle, A, rightward triangle, Δ) indicating switches (47Cd, 47Cl, 47A, 47r, 47u) corresponding to sounds to be input are displayed on the score. In the state (see the first step), when the input is correct, the symbol (A) corresponding to the switch is displayed (see the second step right) and the sound is emitted. At this time, if the wrong switch is operated, the next sound is started. If it is determined in step 522 that there is no performance operation and that the predetermined time has elapsed in step 529, no processing is performed in steps 524 and 525, so nothing is displayed (see the third row). ) Becomes silent.

On the other hand, when it is determined in step 531 that the automatic performance has ended, it is determined in step 533 whether all the scales input by the player are correct scales. This matching judgment is made by the music data register R
This is done by comparing the data stored in 1 with the data stored in the input scale register R3. As another determination method, it may be determined that all the data stored in the sound collation register R4 is "1" or that the sound collation flag F1 is "1". If it is determined that the scale is correct, step 5
At 34, a match process is performed. As the matching process, predetermined object data is registered in the display list to display that the correct scale has been input, or predetermined sound data is registered in the voice list to play music such as fanfare. Processing. Continue,
At step 535, it is determined whether the matching process is completed. If it is determined that the process is finished, then in step 536, the game process corresponding to the input of the Nth song is started. For example, so that the player object is moved to and displayed at a place (one of the first place to the third place in the example of FIG. 13) corresponding to the song selected on the song selection screen of FIG. The coordinate position of the player object in the three-dimensional space is determined by calculation,
According to it, it is displayed at the place after the move. Therefore, the player object is warped to a place different from the place where the player object was before inputting the song, and is displayed in front of the background object to which the warp is made. If it is determined in step 535 that the matching process has not been completed, the process returns to the main routine (S6).

On the other hand, when it is determined in step 533 that all the scales input by the player are not correct scales, the process proceeds to step 537. Step 5
37, "1" is set in the tone number register R2 (On
= 1) and prompts the player to perform the sound input operation again. Then, the process returns to the main routine (S6).

When it is determined in step 520 described above that the collation mode is not currently being executed, it is determined in step 540 whether or not the free performance mode is being executed, and if it is being executed, in step 550. Free performance processing is performed. This free performance process (the process of inputting one halftone or halftone that cannot be input only by the push button switch using the joystick, which is a feature of the present invention), is achieved by the subroutine process shown in FIG. That is, in step 551, RA
The pushed pushbutton switch is detected based on the data stored in the control pad data area 156 of M15. In step 552, the scale corresponding to the pushbutton switch is detected and the corresponding scale data is generated. In step 553, it is determined whether the detected switch is the F button (switch 47R). If the F button is being pressed, step 554
In step 5, when the processing for raising the semitone is performed and the F button is not pressed, step 554 is skipped and step 5 is performed.
Proceed to 55. This processing for raising the semitone is processing for changing the scale data so that the scale corresponding to the operated switch is changed to a semitone higher scale. The pitch data for generating the sound of the frequency is generated, but when the switch 47R is pressed, the pitch is 440 × 2 ^ which is a semitone higher pitch.
It is converted into pitch data for generating a sound of (1/12) Hz. However, the symbol “^” means that the previous value is raised to the power in the subsequent parentheses.

In the following step 555, it is judged whether or not the joystick 45 is operated up and down (for example, whether or not the Y-axis counter 444Y counts the tilt of the stick). When it is determined that the scale is operated up and down, in step 556, the scale data is changed in order to change the scale according to the tilt amount of the joystick 45. For example, when the stick is neutral, the scale is based on the push button switch, and when the stick is tilted to the maximum position in the upward direction, the whole tone (or 1
The scale is raised, and when the stick is pushed down to the maximum position, it is lowered by all tones, and when the stick is between the neutral position and the maximum up / down tilt position, the scale is changed to one note according to the tilt amount. Change up and down in the range. In detail,
A whole note divided into 200 1 cent (scale unit: 2 ^
It may be raised or lowered in units of (1/200). But,
Since the joystick 45 detects the amount of tilt of the stick with a count value of 0 to 64, it cannot be divided into 200. Therefore, when the stick is tilted upward, each time the absolute value X of the count value changes (1 cent ) ^ (200 /
The scale of the frequency 64 × X) will be changed.
Conversely, when the stick is tilted downward, (1 cent) ^ (200/6) every time the absolute value X of the count value changes.
4 × X) is divided into a scale of a frequency. Assuming that the “La” pitch (440 Hz) is selected, the pitch data is 440 × ((2 ^ (1 /
200)) ^ (200 / 64xX)) Hz is changed to generate pitch data. That is, the frequency data of the scale that is changed up or down within the range of one tone specified by the joystick is generated with reference to the scale specified by the push button switch, and it is written in the audio list 158. It is stored (S5
54, S556, S558, S560). The music data input by this repetition is read out at a constant cycle in the audio processing shown in FIG. 24 described later and generated as music. Note that 1 in step 556
Instead of varying over a range of sounds, when the stick is within a certain range midway between neutral and up or down maximum tilt,
You may make it change only a semitone up or down.

After step 556 or after it is determined in step 555 that the joystick 45 has not been operated up or down, the routine proceeds to step 557. Step 5
At 57, it is determined whether or not the joystick 45 is operated to the left or right (that is, whether or not the X-axis counter 444X counts the tilt of the stick). If it is determined that the operation has been performed to the left or right, in step 558, processing for changing to the vibrato scale data with the changed depth value is performed based on the left or right tilt amount of the joystick 45. Be seen. For example, when the stick is neutral, do not apply vibrato,
When the stick is maximally tilted to the left or right, the deepest vibrato is applied, and when the tilt amount of the stick is between the neutral position and the maximum tilt position, the depth value is changed up and down according to the tilt amount. In the embodiment, in order to apply vibrato in four stages, the count value (X: absolute value) from 0 to 64 is processed, and the depth value is changed according to the count value. More specifically, when the stick is tilted to the left (or right), the depth value is set to 1.001807 ^ (X / 4). Each numerical value or set value is determined by experiment so that the sound is comfortable to hear. Assuming that the user has selected the "La" pitch (440 Hz),
Interval data is 440 x (depth value = 1.001807 ^
(X / 4)) to 440 / (depth value = 1.001807)
^ (X / 4)) is added to the pitch data of the vibrato sound whose frequency fluctuates up and down (vibrates).

After step 558 or after it is determined in step 557 that the operator has not operated to the left or right, the process proceeds to step 559. In step 559, the switch detected in step 551 is the G button (switch 47
Z) or not. In the case of the G button, volume data for increasing the volume by, for example, 1.4 times is generated so as to increase the volume while keeping the scale in step 560. After that, or after it is determined in step 559 that the G button has not been pressed, the process returns to the main routine (S6). The scale data and the volume data generated as described above are output as voice data (S8) and voice output (S10) described below by registering them as voice data in the voice list.

On the other hand, when it is determined in step 540 that the free performance mode is not being executed, it is determined in step 570 whether the game mode is being executed. If it is being executed, game processing is performed in step 580. The game process for changing the display state of the object based on the music input by the player is performed by processing the subroutine shown in FIG. That is, in step 581,
The position of the player object is detected. Step 5
At 82, it is determined whether the player object is at the position where the score of the warp music should be displayed. When it is determined that the player object is at that position,
In step 583, for example, in order to display the score of a predetermined song on the bulletin board, the bulletin board object is registered in the display list, and the scale data corresponding to the song displayed on the bulletin board is stored in the working memory area 157 of the RAM 15. Written. As a result, an image as shown in FIG. 21 is displayed. This song is registered as a playable song in the song list and displayed as shown in FIG. After that, or when it is determined in step 582 that it is not in the display position, the process proceeds to step 584.

In step 584, it is determined whether the player object is at the position where the sound played by the player should be recorded. When it is determined that the player object is in that position, in step 585,
The recording process of the sound played by the player is performed. This recording process is instructed to play music, for example, when the player object encounters a specific person or object, but the player performs an operation for free performance (see the description of FIG. 19) according to the instruction. Then, the data of the performance song is RA
It is to be stored in M15. The recording process is performed by executing the subroutine shown in FIG. That is, in step 586, 1 /
It is determined whether 20 seconds (3 frames) have elapsed, and if so, the data stored in the control pad data area 156 (all or data related to sound) is stored in the sound memory area 155 in step 587. It is stored as recorded data. Then, or step 5
After it is determined at 86 that 1/20 second has not elapsed, the routine proceeds to step 588 (see FIG. 20).

In step 588, it is determined whether the player object is at the sound collation position. If the player object is in that position, step 58.
At 9, the matching process of the sound played by the player is performed. This matching process is the same as the matching process of steps 520 to 530, except that the target to be matched with the played music is "the music selected by the player" or "the music recorded by the player". Since this is a process, description thereof will be omitted. Then, or step 589
After it is determined that the character is not at the sound collation position, the process proceeds to step 590.

At step 590, it is determined whether or not the player object is at the place (or position) where the sound should be reproduced. If you're there, step 591
At, processing for adding an arrangement to the sound data based on the recorded controller data is performed. This arranging process is, for example, a process of adding a tone color of a musical instrument other than the musical instrument played by the player, or changing the rhythm according to the atmosphere of the screen. In step 592,
Sound setting processing is performed. This process is a process of mixing the music data created by the arranging process with other sound data and registering them in the audio list. By performing the sound setting process, the music input (composed) by the player is played as BG.
It can also be generated as M during the game, or can be used as a bark of an animal object. In step 593, other game processing that has not been processed in the above steps 581 to 592 (for example, battle processing between the player object and the enemy, processing for displaying characters, etc.) is performed.

Next, the operation of the above-mentioned drawing processing (step 7) subroutine will be described with reference to FIG. In step 701, coordinate conversion processing is performed. The coordinate conversion process is performed under the control of the RCP 12 to convert the coordinate data of a plurality of polygons of each moving object such as an enemy, a player, or a companion stored in the image data area 154 of the RAM 15 or a stationary object such as a background to a camera. This is done by converting to the viewpoint coordinates of. Specifically, an arithmetic operation is performed for converting each polygon data forming a plurality of moving objects and stationary objects from absolute coordinates into data of camera coordinates so as to form an image viewed from the viewpoint of the camera. In step 702, drawing processing is performed on the frame memory. In this processing, color data determined based on the texture data is added to the frame memory area 1 on the surface of a triangle forming each object surrounded by the polygon coordinates after being converted into the camera coordinates.
This is done by writing every 52 dots. At this time, based on the depth data for each polygon, the object in front (nearby) is displayed with priority,
When the color data of a nearby object is written and the depth data corresponding to the dot for which the color data is written is Z
It is written in the corresponding address of the buffer area 153. After that, the process returns to the main routine (S8). This step 701
The operations 702 and 702 are performed within a fixed time for each frame, but are sequentially processed for each polygon constituting each of a plurality of objects to be displayed on one screen, and all objects to be displayed on one screen are processed. Is repeated until.

Next, with reference to FIG. 24, the operation of the above-mentioned voice processing (step 8) subroutine will be described. In step 801, it is determined whether or not the voice flag is turned on. If it is determined that the audio data is turned on, the audio data stored in the audio list 158 is read out in step 802, and the sampled audio digital data to be reproduced in one frame (1/60 seconds) is buffered. (Not shown). In step 803, the sound generation circuit 16 converts the digital data stored in the buffer into an analog signal and sequentially outputs the analog signal to the speaker. After that, the process returns to the main routine (S9) and the processes of steps 9 to 12 are performed. It should be noted that the plurality of frequency data corresponding to the music input by the operation of the controller 40 is the voice list 1 in the automatic performance process shown in FIG. 18 or the free performance process shown in FIG.
This voice processing (S80
1, S802), the audio list 158 is sequentially read out at a constant cycle and converted into an analog signal to be generated as music.

[0076]

[Brief description of drawings]

FIG. 1 is a block diagram of the principle of the present invention.

FIG. 2 is an external view showing a configuration of a video game system according to an embodiment of the present invention.

FIG. 3 is a block diagram of a video game system according to an embodiment of the present invention.

FIG. 4 is a block diagram of a controller 40.

5 is a memory map schematically showing a memory space of an external ROM 21. FIG.

FIG. 6 is a memory map showing a part of the memory space of the external ROM 21 in detail.

FIG. 7 is a memory map schematically showing a memory space of a RAM 15.

FIG. 8 is a flowchart of a main routine of game processing according to an embodiment of the present invention.

FIG. 9 is a subroutine flowchart of player object processing.

FIG. 10 is a subroutine flowchart of background object processing.

FIG. 11 is a subroutine flowchart of a mode selection process of sound processing.

FIG. 12 is a subroutine flowchart of sound processing.

FIG. 13 is a schematic view of a three-dimensional game field of the present invention.

FIG. 14 shows a display example of a music selection screen.

FIG. 15 shows a display example of a sound input mode screen.

FIG. 16 shows a display example of a screen during automatic performance.

FIG. 17 shows a display example of music scores and notes on a sound input screen.

FIG. 18 is a subroutine flowchart of an automatic performance process.

FIG. 19 is a subroutine flowchart of free performance processing.

FIG. 20 is a subroutine flowchart of game processing.

FIG. 21 shows a display example of a bulletin board.

FIG. 22 is a subroutine flowchart of a recording process.

FIG. 23 is a subroutine flowchart of drawing processing.

FIG. 24 is a flowchart of a subroutine for voice processing.

[Explanation of symbols]

10 ... Video game machine 11 ... CPU (central processing unit) 12 ... RCP (reality coprocessor) 15 ... RAM (temporary storage memory) 18 ... Controller control circuit 20 ... ROM Cartridge 21 ... ROM (information storage medium) storing a game program 30 ... Display device 40 ... Controller 44 ... Operation signal processing circuit 45 ... Analog joystick (joystick) 50 ... RAM cartridge 51 ... RAM (write / read memory)

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI G10H 1/043 G10H 1/043 A (72) Inventor Yoji Inagaki 60 Fukuinekamitakamatsucho, Higashiyama-ku, Kyoto City Nintendo Co., Ltd. ( 72) Inventor Tsuyoshi Kihara 60, Fukuinakami Takamatsucho, Higashiyama-ku, Kyoto Nintendo Co., Ltd. (56) References JP-A-55-55391 (JP, A) JP-A-4-242684 (JP, A) JP Japanese Unexamined Patent Publication No. 6-118962 (JP, A) Japanese Unexamined Patent Publication No. 61-286897 (JP, A) Japanese Unexamined Patent Publication No. 6-165878 (JP, A) Japanese Unexamined Patent Publication No. 7-152369 (JP, A) , U) Jikkou Hei 7-31276 (JP, Y2) Jikkou Sho 59-1268 (JP, Y1) Jikkou 63-44869 (JP, Y1) (58) Fields investigated (Int.Cl. ⁷ , DB) Name) G10H 1/00-7/12 A63F 13/00 A63F 13/06

Claims (5)

(57) [Claims] 1. A sound generation device for a game machine, which inputs sounds of different tones and generates music based on the inputted sounds by specifying a scale using a controller for a game machine having a plurality of operation switches. Of the plurality of operation switches, the operated operation switch
Storage of operation status data Temporary storage of operation status data
Means, extract the operation state data of the operation switch, the predetermined cycle
Registration to register the operation status data in the temporary storage means
Processing means, music data temporary storage means for temporarily storing music data, and operation state data temporary storage by the registration processing means
Based on the operation status data registered in the method, the operation switch
Frequency data corresponding to the scale specified by
Sound settings to generate and write to the music data temporary storage means
Means for storing the frequency data stored in the music data temporary storage means.
Based on the frequency data read by the reading means.
And generate a voice signal of the scale corresponding to the frequency data.
And a read-out means stored in the music data temporary storage means.
Continuously read out frequency data for a certain time
As a result, the music registered by me will be generated as BGM.
A sound generation device for a game machine, which is characterized in that 2. An operation switch for the game machine controller.
J is a number of operations assigned to different scales.
Button switch and multiple tilt positions can be selected
Functioning analog joystick, and the operation button switch is operated in the registration processing means.
When the type data corresponding to the operation button switch is
The operation status data is temporarily stored as the operation status data.
The analog joystick is operated.
Tilt data of the analog joystick
The operation state data is temporarily recorded as
The sound setting means is stored in the operation state data temporary storage means.
The registered operation status data is the operation button switch type.
For data, it depends on the type of operation button switch.
Generates frequency data corresponding to the specified scale and
In the case of data What is the scale corresponding to each operation button switch
Generates frequency data of the intermediate tone scale according to different tilt amounts.
The sound generation device for a game machine according to claim 1, which is formed. 3. A plurality of operation button switches and a plurality of stages
Analog joystick with selectable tilt position
Specify a scale using a controller for game consoles having and
Input and input the sound of the specified scale by
Sound generator for game machines that generates music based on the generated sound
A location, the pressed operation Botansu among the plurality of operation switches
Switch type data and the analog joystick
Operation status that stores the tilt amount data and operation status data
State data temporary storage means, the operation button switch, or the analog joystick.
Operation status data of the computer
Registration processing means for registering in the production state data temporary storage means, music data temporary storage means for temporarily storing music data , and operation state data temporary storage means by the registration processing means.
Frequency data based on the operation status data registered in
A sound device for generating and writing in the music data temporary storage means.
Setting means, the frequency data stored in the music data temporary storage means.
Based on the frequency data read by the reading means.
The audio signal of the frequency corresponding to the frequency data.
Audio signal generating means, and the reading means is stored in the music data temporary storage means.
Continuously read out frequency data for a certain time
As a result, the music registered by me will be generated as BGM.
A sound generation device for a game machine, which is characterized in that 4. A game console having a plurality of operation switches.
By specifying the scale using the controller,
You enter different sounds and play music based on the entered sounds.
It is a sound generator for live game machines, and you can register your own music in a wide game space.
No. 1 place designated as Noh and sound registered by me
The second place where music can be generated as BGM
Background image data of multiple background screens including background images
The background image data generating means to be generated, the game according to the operation of the controller by the player.
Image data of a player object moving in the game space
Of the player object image data generating means, and the operation switch operated among the plurality of operation switches.
Storage of operation status data Temporary storage of operation status data
Means, the player object is in front of the game space
Note that when it is in the first place,
The operation state data is extracted at regular intervals to obtain the operation state.
Registration processing means for registering in the data temporary storage means, music data temporary storage means for temporarily storing music data, and the operation state data temporary storage by the registration processing means
Based on the operation status data registered in the method, the operation switch
Frequency data corresponding to the scale specified by
Sound settings to generate and write to the music data temporary storage means
Means, the player object is in front of the game space
The music data is temporarily recorded when the music data exists in the second place.
Read the frequency data stored in the memory sequentially
Based on the frequency data read by the output means and the reading means.
And generate a voice signal of the scale corresponding to the frequency data.
And a read-out means stored in the music data temporary storage means.
Continuously read out frequency data for a certain time
As a result, the music registered by me will be generated as BGM.
A sound generation device for a game machine, which is characterized in that 5. The reading means is the player object.
Exists in the second location in the game space
During the period, the music data is temporarily stored in the storage means.
Frequency data for a certain period of time continuously and repeatedly
By reading it out, the music registered by me can be used as BGM.
5. The method according to claim 4, characterized in that
The sound generating device for the game machine described.