JP2001184525A - Image processor, image processing method, recording medium and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To display a novel line art image on a monitor screen. SOLUTION: A character object line art image 401Ih is display on a virtual road object line art image 420Ih inserted with respective obstacle object line art images 411Ib, 414Ib, 413Ib and 412Ib of there-dimensional line art image. Besides, the novel line art image can be display by oscillating these obstacle object line art images 411Ib, 414Ib, 413Ib and 412Ib, the virtual road object line art image 420Ib and the character object line art image 401Ib.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing apparatus, a method, a recording medium, and a program capable of displaying a new line drawing image related to music on a monitor screen.

[0002]

2. Description of the Related Art As an information device (entertainment system) such as an entertainment device including a video game machine, for example, a game content stored in a recording medium such as a CD-ROM is displayed on a screen of a television receiver as a monitor. In some cases, the game is advanced by operating with the operation device while the game is being displayed.

[0003]

[0007] By the way, in the games currently provided on the market, realization of game images,
Advancements and refinements have been promoted, and in response to this, vibrations have been applied to operating devices and analogization of button inputs has progressed, which has the potential to make games and the like even more interesting. Has increased, and all users cannot complete the game. In addition, there is a possibility that these games are cleared once, and once the player gets used to the operation, they may get bored.

On the other hand, a game that displays only a line drawing image on a screen has a faint feeling, and has a possibility of supporting a wide range of age groups from a low age group to a high age group. In addition, music has various genres, and has a possibility of being accepted by everyone.

The present invention has been made in view of such problems, and provides an image processing apparatus, a method, a recording medium, and a program capable of displaying a new line drawing image on a monitor screen. With the goal.

[0006]

An image processing apparatus according to the present invention comprises a line drawing image generating means for generating a line drawing image composed of line drawing image pieces, and a fluctuation applying means for giving a fluctuation to each line drawing image piece constituting the line drawing image. And a drawing means for drawing each line drawing image piece to which the fluctuation has been applied in the storage means (the invention according to claim 1).

According to the present invention, it is possible to obtain a line drawing image (a new line drawing image which has not been hitherto provided) comprising a line drawing image piece to which fluctuation has been given.

In this case, the line drawing image can be obtained as a three-dimensional line drawing image, whereby a line drawing image having a higher entertainment property can be obtained (the invention according to claim 2).

The fluctuation given to each of the line drawing image pieces is easily generated by adding random numbers to each vertex of each polygon constituting the line drawing image piece object arranged in the three-dimensional space by the fluctuation applying means. (Invention of claim 3).

[0010] 3 is drawn on the storage means by the drawing means
By providing a three-dimensional line drawing image as an image consisting of a line drawing image piece provided with a substantially linear fluctuation extending from substantially one end side to the other end side in the horizontal direction on the display screen, the content of the line drawing image has diversity. There is a possibility that it can be performed (the invention according to claim 4).

In addition, by inserting a non-linear line drawing image with a fluctuation into a part of a substantially linear image composed of a line drawing image part with a fluctuation, the content of the line drawing image can be more diversified. There is a possibility that it can be performed (the invention according to claim 5).

According to the image processing method of the present invention, there is provided a line drawing image generating step of generating a line drawing image composed of line drawing image pieces, a fluctuation giving step of giving a fluctuation to each of the line drawing image pieces constituting the line drawing image, and a step of giving the fluctuation. And a drawing step of drawing each of the line drawing image pieces in the storage means (the invention according to claim 6).

According to the present invention, it is possible to obtain a line drawing image (a new line drawing image which has not existed in the past) consisting of a line drawing image piece to which fluctuation has been applied.

In this case, the line drawing image can be obtained as a three-dimensional line drawing image, so that a line drawing image having higher entertainment can be obtained.

The fluctuation given to each line drawing image piece is easily generated by adding random numbers to each vertex of each polygon constituting the line drawing image piece object arranged in the three-dimensional space by the fluctuation applying means. (Invention of claim 8).

The recording medium according to the present invention has a line drawing image generating step of generating a line drawing image composed of line drawing image pieces, a fluctuation applying step of giving fluctuations to each of the line drawing image pieces constituting the line drawing image, and providing the fluctuations. And a drawing step of drawing each of the line drawing image pieces in the storage means.

According to the present invention, it is possible to obtain a line drawing image (a new line drawing image which has never existed in the past) composed of a line drawing image piece to which fluctuation has been given.

In this case, the line drawing image can be a three-dimensional line drawing image, so that a line drawing image having higher entertainment can be obtained (the tenth aspect of the present invention).

The fluctuation given to each of the line drawing image pieces is easily generated by adding a random number to each vertex of each polygon constituting the line drawing image piece object arranged in the three-dimensional space in the fluctuation giving step. Fluctuations can be imparted (the invention according to claim 11).

The three-dimensional line drawing image drawn on the storage means in the drawing step is converted into an image consisting of a line drawing image piece provided with a substantially linear fluctuation extending from substantially one end to the other end in the horizontal direction on the display screen. By doing so, there is a possibility that the content of the line drawing image can be given diversity (the invention according to claim 12).

Further, by inserting a non-linear line drawing image with a fluctuation into a part of a substantially linear image composed of a line drawing image piece with a fluctuation, the contents of the line drawing image can be more diversified. There is a possibility that it can be performed (the invention according to claim 13).

A program according to the present invention comprises a line drawing image generating step for generating a line drawing image composed of line drawing image fragments;
The apparatus according to claim 14, further comprising a fluctuation applying step of applying a fluctuation to each of the line drawing image pieces constituting the line drawing image, and a drawing step of drawing each of the line drawing image pieces to which the fluctuation is applied in a storage unit.

According to the present invention, it is possible to obtain a line drawing image (a new line drawing image which has never existed in the past) composed of a line drawing image piece to which fluctuation has been given.

In this case, the line drawing image can be obtained as a three-dimensional line drawing image, so that a line drawing image having higher entertainment properties can be obtained (the invention according to claim 15).

The fluctuation given to each of the line drawing image pieces is easily generated by adding a random number to each vertex of each polygon constituting the line drawing image piece object arranged in the three-dimensional space in the fluctuation applying step. Fluctuation can be imparted (the invention of claim 16).

The three-dimensional line drawing image drawn on the storage means in the drawing step is converted into an image consisting of a line drawing image piece provided with a substantially linear fluctuation extending from substantially one end to the other end in the horizontal direction on the display screen. By doing so, there is a possibility that the content of the line drawing image can be given diversity (the invention according to claim 17).

Also, by inserting a non-linear line drawing image with a fluctuation into a part of a substantially linear image composed of a line drawing image piece with a fluctuation, the content of the line drawing image can be more diversified. There is a possibility that it can be performed (the invention according to claim 18).

[0028]

An embodiment of the present invention will be described below with reference to the drawings.

FIG. 1 shows the overall configuration of an entertainment system 10 to which the image processing apparatus according to the embodiment is applied.

This entertainment system 10
Basically, an entertainment device 12 for executing various programs, a memory card 14 detachably attached to the entertainment device 12, and an operation device (controller detachably attached to the entertainment device 12 via a connector 62). ) 16 and a monitor (display) 18 which is a display device such as a television receiver to which a video / audio signal from the entertainment device 12 is supplied.

The entertainment device 12 reads out programs and data stored in a large-capacity storage medium such as an optical disk 20 such as a CD-ROM, and responds to an instruction from a user (user: a game player, for example). To execute a game or the like.
The execution of the game mainly refers to receiving an input from the operation device 16 through the connector 62 and controlling the progress of the game while controlling the display and sound on the monitor 18.

Note that the entertainment device 12 includes a CD (compact-disc) as a storage medium as the optical disc 20.
k) can also be played, in which case the CD
Music data (also referred to as tone data) as an audio signal is read out and reproduced with reference to the TOC (table of contents) data stored in.

As will be described later, the entertainment device 12 can execute a game using TOC data and music data stored on a CD.

The recording medium for supplying the application program and the music data is not limited to the optical disk 20, but may be supplied via a communication line.

The entertainment device 12 has a substantially flat rectangular parallelepiped shape, and has a central portion in which application programs and data for a video game and the like are stored and an optical disk 20 for supplying them is mounted. A mounting unit 22, a reset switch 24 for arbitrarily resetting a currently running program,
It is provided with a disk operation switch 26 for operating the mounting of the optical disk 20, a power switch 28, and, for example, two slot portions 30, 32.

The slots 30 and 32 are respectively composed of upper slots 30B and 32B and lower slots 30A and 30B.
32A, and the lower slot portions 30A, 32A.
A, the operating device 16 can be connected to each through a connector 62, and the upper slot portions 30B, 32B
Can be equipped with a memory card 14 capable of storing a flag or the like indicating an intermediate state of a game or the like.

The slot 30 (30A, 30A)
B) and 32 (32A, 32B) have asymmetric shapes to avoid erroneous insertion.

As shown in FIGS. 1 and 2, the operating device 16 basically includes first and second operating units 34 and 36.
, An L button 38L and an R button 38R, a start button 40, a selection button 42, left and right rotary operators 44 and 46 capable of analog operation, and an operation mode of these rotary operators 44 and 46. It has a mode selection switch 48 and a display unit 50 for displaying the selected operation mode. The display unit 50 is configured by a light emitting element such as a light emitting diode.

Further, as shown in FIG. 2, the operating device 16 has an operating device main body 104 in which an upper half 100 and a lower half 102 are attached to each other and connected using fixing means such as screws.

As shown in FIG. 2, the operation device 16 is connected to the entertainment device 12 at the end of the operation device main body 104 so that, for example, when executing a game or searching for information, the left and right palms are used. The left and right grip portions 106 and 108 gripped so as to be included are provided so as to protrude.

As shown in FIG. 1, the left and right grips 106 and 108 are arranged so as to be spaced apart from each other toward the distal end and to face the lower side of the operation device main body 104.

As shown in FIG. 2, on one of the upper surfaces of the operating device main body 104, the first to fourth pressing operators 110a to 110d projecting to the upper surface are arranged so as to be orthogonal to each other. Is provided.

The first operation section 34 is internally provided with switch elements as signal input elements corresponding to the first to fourth pressing operators 110a to 110d, respectively. The first operation unit 34 functions, for example, as a direction instruction control unit that controls the movement of the display character, and selectively presses the first to fourth pressing operators 110a to 110d. By turning on / off the switch elements corresponding to the children 110a to 110d, each of the pressing operators 1 whose display characters on the screen are pressed, for example.
It moves in the arrangement direction of 10a to 110d. In general, the pressing operator 110a moves upward in “↑”, the pressing operator 110b moves rightward in “→”, the pressing operator 110c moves leftward in “←”, and the pressing operator 110d moves downward in “↓”. Show. In that sense, the first to fourth pressing operators 1
10a to 110d are referred to as an upper button 110a, a right button 110b, a left button 110c, and a lower button 110, respectively.
Also called d.

On the other side of the upper surface side of the operating device main body 104, there are first to fourth pressing operators 1 protruding toward the upper surface side.
12a to 112d are arranged so as to be orthogonal to each other.
Operation unit 36 is provided.

The first to fourth pressing operators 112a to 112a
112d is formed as an independent member, and a switch element as a signal input element is provided inside corresponding to each of the pressing operators 112a to 112d.

The second operation unit 36 is, for example, a first to a fourth
By turning on the switches corresponding to the pressing operators 112a to 112d, for example, each of the pressing operators 11a to 112d is turned on.
It is used as a function setting execution unit that sets the functions of the display characters assigned to 2a to 112d or executes the functions of the display characters.

Note that the first to fourth pressing operators 112a to 112a
112d is a △ button 112a and a ボ タ ン button 11 respectively.
2b, × button 112c and □ button 112d.

An L button 38L and an R button 38R are provided on the left and right sides on the front side of the operation device main body 104. The L button 38L and the R button 38R are, as shown in FIG.
4a, 114b and 116a, 116b.

Each of these pressing operators 114a, 114b,
Switch elements are provided in the respective sections 116a and 116b.

The L button 38L and the R button 38R
For example, the first and second pressing operators 114a, 114
By turning on the switches corresponding to b, 116a and 116b, for example, each of the pressing elements 114a and 11
4b, 116a, and 116b are used as function setting execution units for setting the functions of the display characters assigned to the display characters or executing the functions of the display characters.

In this case, the first pressing operation element 114a is L
The first button 114a, the second pressing operator 114b is the L2 button 114b, the first pressing operator 116a is the R1 button 116a, and the second pressing operator 116b is the R2 button 11
6b.

As shown in FIG. 2, the operation device 16 has left and right analog operation units 118 and 120 at opposite positions on the base end side of the left and right grip units 106 and 108. .

The left and right analog operation units 118 and 12
0 denotes left and right rotary operators 44 and 46 rotatable in a 360-degree direction about the operation axis, and
4, a signal input element such as an internal variable resistance element operated by 46 is provided. That is, the left and right rotary operators 44 and 46 are attached to the distal end side of the operation shaft attached to return to the neutral position by the elastic member, and are rotated 360 degrees around the rotation fulcrum of the operation shaft. .

The left and right analog operation units 118 and 12
0 indicates an analog movement such as moving the display character while rotating or moving the display character while changing the speed, and further changing the form by rotating the left and right rotary operators 44 and 46. It is used as an operation unit capable of inputting a command signal enabling the operation.

By the switching operation of the mode selection switch 48, for example, an operation mode in which a command signal can be input from the analog operation units 118 and 120 and a command signal input from the left and right analog operation units 118 and 120 are set. An operation mode to be prohibited is selected.

By the switching operation of the mode selection switch 48, the left and right analog operation units 118 and 120 are further provided.
And input of a command signal from the second operating unit 36 to the first to fourth pressing operators 112a to 112d.
And the first and second pressing operators 114a, 114b, 116a, 11 of the L button 38L and the R button 38R.
The operation mode in which the function of 6b is switched is selected. The display unit 50 flashes according to the state of the operation mode, and the display light is switched.

As described above, the operating device 16 provided with the left and right grips 106 and 108 protruding from the operating device main body 104, as shown in FIG.
By grasping 06 and 108 in such a manner that they are wrapped in the palms of both hands, it is not necessary to indicate the operation device main body 104 with fingers, and a maximum of 10 fingers of both hands and at least 6 fingers are grasped in a freely movable state. be able to.

As shown in FIG. 2, when the left and right grips 106 and 108 are gripped so as to be wrapped in the palms of both hands, for example, the thumbs Rf1 and Lf1 of the left and right hands Rf and Lf are held.
On the left and right rotary operators 44 and 46 of the left and right analog operation units 118 and 120, respectively,
The first to fourth pressing operators 112a to 112d on the fourth pressing operators 110a to 110d and the second operating unit 36
The rotary operation members 44 and 46 and the pressing operation members 110a to 110d and 112a to 112d can be selectively pressed to extend upward.

In particular, the left and right analog operation units 118 and 12
0 rotary operation elements 44 and 46 are opposed to each other on the base end side of the left and right grips 106 and 108 which are gripped so as to be wrapped in the palms of both hands, which are connected to the operation device main body 104. Therefore, when the left and right grips 106 and 108 are gripped by the left and right hands Rf and Lf, the left and right hands R
f and Lf are extended to positions closest to the respective thumbs Rf1 and Lf1. Therefore, each of the rotary operators 44 and 46 can be easily rotated by the thumbs Rf1 and Lf1 of the left and right hands Rf and Lf.

Also, as shown in FIG.
06 and 108 are wrapped in the palms of both hands, when the index fingers Rf2 and Lf of the left and right hands Rf and Lf are grasped.
2 and the middle fingers Rf3, Lf3 with the R buttons 38R and L
A first and a second pressing operator 116a of the button 38L,
116b, 114a, 114b can be extended to a position where the pressing operation can be selectively performed.

The operating device 16 is provided with a vibration imparting mechanism including a drive motor (not shown), and a vibration command is issued from the entertainment device 12 to the vibration imparting mechanism in accordance with the progress of the game. Is done.

Next, the circuit configuration of the entertainment device 12 and the operation device 16 will be described.

FIG. 3 shows a configuration of an entertainment system 10 including an example of a schematic circuit configuration of a main part of the entertainment apparatus 12.

The entertainment device 12 has a central processing unit (CPU) 251.
And a control system 250 including peripheral devices and the like, and an image processing apparatus (GPU: Gr
a graphic system 260 comprising an aphic processing unit (262), a sound system 270 comprising a sound processing unit (SPU: Sound Processing Unit) 271 for generating musical sounds and sound effects, and the like, and an optical disk 20 on which an application program is recorded. An optical disk control unit 280 for controlling, a memory card 14 for recording a signal from the operation device 16 to which an instruction from a user is input, a game setting, and the like, and controlling input / output of data from a portable electronic device. The communication system includes a communication control unit 290 and a bus BUS to which the above units are connected.

The control system 250 includes a CPU 251 and
Interrupt control and direct memory access (DMA: Di
rect Memory Access) a peripheral device control unit 252 that controls transfer and the like, and a random access memory (RAM).
Main memory (main storage device) consisting of Access Memory
253 and a read-only memory (ROM: Read Only Memory) storing programs such as a so-called operating system for managing the main memory 253, the graphic system 260, the sound system 270, and the like.
ry) 254. Here, the main memory 253 refers to one that can execute a program on the memory.

The CPU 251 controls the entire entertainment apparatus 12 by executing an operating system stored in the ROM 254, and is composed of, for example, a 32-bit RISC-CPU.

Then, the entertainment device 12
When the power is turned on, the CPU of the control system 250
When the CPU 251 executes the operating system stored in the ROM 254, the CPU 251 causes the graphic system 260 and the sound system 2 to operate.
70 and the like are controlled. When the operating system is executed, the CPU 251 initializes the entire entertainment apparatus 12 such as operation check, and then controls the optical disc control unit 280 to
An application program such as a game recorded on the optical disk 20 mounted and accommodated in the disk mounting section 22 (see FIG. 1) is executed. By executing a program such as a game, the CPU 251 controls the graphic system 260, the sound system 270, and the like in accordance with an input from a user to display an image, sound effects, and music (also referred to as musical sounds). Control the occurrence.

The graphic system 260
Is a geometry transfer engine (GTE: Geometry Transfer Engine) that performs processing such as coordinate transformation including perspective projection transformation.
r Engine) 261, a GPU 262 that performs drawing in accordance with a drawing instruction from the CPU 251, and stores an image drawn by the GPU 262 and, in principle, generates an image every time a screen switching signal (image switching) such as a vertical synchronization signal is generated. A frame buffer 263 to be updated and an image decoder 264 for decoding image data compressed and encoded by orthogonal transform such as discrete cosine transform are provided. In this case, the image drawn in the frame buffer 263 is G
A video output is provided via the PU 262, and the video output is provided via an output terminal to a monitor 18 such as a television receiver.
Is supplied to the display section 18A. Images (including three-dimensional images) displayed on the screen (screen) of the display unit 18A.
Is updated for each vertical synchronization signal.

The above-mentioned GTE 261 includes, for example, a parallel operation mechanism for executing a plurality of operations in parallel.
In response to an operation request from the CPU 51, coordinate transformation (including perspective projection transformation for transforming an image in a three-dimensional space into an image in a two-dimensional space to execute perspective projection), light source calculation, matrix or vector The calculation can be performed at high speed. Specifically, for example, in the case of an operation of performing flat shading in which one triangular polygon is drawn in the same color, the GTE 261
Coordinate calculations of about 500,000 polygons can be performed. With this, in the entertainment apparatus 12, the load on the CPU 251 can be reduced and high-speed coordinate calculations can be performed. . In this embodiment, the CPU 251 and the GTE2
61 constitutes a drawing control means.

The GPU 262 renders a polygon (polygon) on the frame buffer 263 in accordance with a rendering command from the CPU 251. This GPU262
Can draw up to about 360,000 polygons per second.

Further, the frame buffer 263
Consists of a so-called dual port RAM, GPU2
Rendering from the main memory 253 or transfer from the main memory 253 and reading for display can be performed simultaneously. The frame buffer 263 has a capacity of, for example, 1 Mbyte, and has a capacity of 16 bits each.
It is treated as a matrix consisting of 1024 pixels horizontally and 512 pixels vertically. Also, this frame buffer 263
In addition to the at least two drawing areas selectively switched by the GPU 262 for drawing an image and outputting a video of a drawn image, a color lookup referred to when the GPU 262 draws a polygon or the like. CL in which table (CLUT: Color Look Up Table) is stored
A UT area and a texture area for storing a material (texture) to be inserted (mapped) into a polygon or the like which is subjected to coordinate conversion at the time of drawing and drawn by the GPU 262 are provided. In this texture area, a material of a two-dimensional background image representing the sky, clouds, and the like is also stored.

The CLUT area and the texture area are dynamically changed according to a change in the display area.

In addition to the above-described flat shading, the GPU 262 performs Gouraud shading, which determines the color in the polygon by complementing the colors of the vertices of the polygon, and converts the texture stored in the texture area into a polygon. Texture mapping for pasting can be performed. When performing these Gouraud shading or texture mapping,
The above-mentioned GTE 261 can perform a coordinate calculation of about 500,000 polygons at maximum per second.

Further, the image decoder 264 performs the above-described C
Under the control of the PU 251, the image data of the still image or the moving image stored in the main memory 253 is decoded and stored in the main memory 253.

The reproduced image data is stored in a GP.
By storing the image in the frame buffer 263 via the U 262, the image can be used as a background of an image drawn by the GPU 262.

The sound system 270 has a CPU
The SPU 271 generates a musical sound, a sound effect, and the like based on an instruction from the CPU 251 and a sound buffer 272 in which waveform data and the like are recorded by the SPU 271.
Musical sounds, sound effects, and the like generated by the PU 271 are supplied as audio output to the speaker section 18B of the monitor 18, and the musical sounds are output from the speaker section 18B.

The SPU 271 stores the 16-bit audio data, for example, as an ADPCM decoding function for reproducing adaptively encoded PCM (Adaptive Differential PCM) audio data as a 4-bit differential signal, and is stored in the sound buffer 272. It has a reproduction function of generating a sound effect or the like by reproducing the waveform data stored therein, a modulation function of modulating and reproducing the waveform data stored in the sound buffer 272, and the like.

By providing such a function, the sound system 270 can be used as a so-called sampling sound source that generates musical tones, sound effects, and the like based on waveform data recorded in the sound buffer 272 in accordance with an instruction from the CPU 251. Is available.

The optical disk control unit 280 is provided with an optical disk device 281 for reproducing programs, data, and the like recorded on the optical disk 20 and, for example, an error correction code (EC).
C: Decoder 282 for decoding programs, data, etc. recorded with an Error Correction Code) added.
And a buffer 283 for temporarily storing data from the optical disk device 281 to speed up the reading of data from the optical disk 20. The sub CPU 284 is connected to the decoder 282.

The audio data read by the optical disk device 281 and recorded on the optical disk 20 includes so-called PCM data obtained by converting an audio signal from analog to digital, in addition to the above-described ADPCM data.

As the ADPCM data, for example, audio data recorded by representing the difference of 16-bit digital data by 4 bits is decoded by the decoder 282 and then supplied to the above-mentioned SPU 271, where the SPU 271 performs digital / analog conversion. After processing such as is performed, it is used to drive the speaker unit 18B.

The audio data recorded as PCM data, for example, as 16-bit digital data, is decoded by the decoder 282, and then decoded by the speaker unit 18B.
Used to drive.

Further, the communication control unit 290 includes a bus BUS
A communication controller 291 for controlling communication with the CPU 251 via the CPU. The communication controller 291 includes an operation device 16 for inputting an instruction from a user, and an auxiliary storage device for storing game setting data and the like. And a portable electronic device (not shown) are connected.

Operation device 1 connected to communication controller 291
6 is for inputting an instruction from a user.
As shown in (1), it has ten and several instruction keys, and transmits the state of the instruction keys to the communication controller 291 about 60 times per second by synchronous communication according to an instruction from the communication controller 291. Then, the communication controller 291 controls the controller 1
The status of the instruction key No. 6 is transmitted to the CPU 251.

Thus, the instruction from the user is transmitted to the CPU 2
The CPU 251 performs processing in accordance with an instruction from a user based on a game program or the like being executed.

Here, the main memory 253, GP
A large amount of image data must be transferred at high speed between the U 262, the image decoder 264, the decoder 282, and the like when reading a program, displaying an image, or drawing. Therefore, in the entertainment apparatus 12, as described above, the main memory 253 is controlled by the peripheral device control unit 252 without the intervention of the CPU 251.
GPU 262, image decoder 264 and decoder 282
So-called DMA transfer, in which data is transferred directly between the devices, can be performed. Thus, the load on the CPU 251 due to data transfer can be reduced, and high-speed data transfer can be performed.

Further, when it is necessary to store the setting data and the like of the game being executed,
The stored data is transmitted to the communication controller 291, and the communication controller 291 transmits the data from the CPU 251 to the memory card 14 inserted into the slot units 30 </ b> B and 32 </ b> B and a portable information terminal (not shown) that functions as a portable information terminal. Write to electronic devices.

Here, the memory card 14 has a main body interface for connecting to the entertainment device 12 and a memory interface for inputting / outputting data to / from a built-in nonvolatile memory.

The communication controller 291 (see FIG. 3) has a built-in protection circuit for preventing electrical destruction. The memory card 14 is separated from the bus BUS, and can be inserted and removed with the entertainment device 12 powered on. Therefore, when the storage capacity of the memory card 14 becomes insufficient,
A new memory card 14 can be inserted without shutting off the power supply of the main body of the entertainment apparatus 12. Therefore, the game data that needs to be backed up is not lost and the new memory card 14
And the necessary data can be written to the new memory card 14.

The parallel I / O interface (P
IO) 296 includes a CD player and a D player as shown in FIG.
A music playback device (also referred to as a tone playback device) 298 such as an AT (digital audio tape recorder) can be connected, and the music playback device 29 can be connected from the CPU 251 side.
8 (for example, power on / off, playback, stop, skip, music selection) can be controlled. The serial I / O interface (SIO) 297 includes a portable information terminal (personal information) such as a portable electronic device (not shown).
digital assistant) can be connected.

In the entertainment apparatus 12, a digital audio signal can be fetched from the music reproduction apparatus 298 via the PIO 296 in parallel while executing the program recorded on the optical disk 20 by the optical disk apparatus 281.

The entertainment device 12 and the operating device 1
6, the connector 62 for performing bidirectional serial communication with the operation device 16 can be connected to the entertainment device 12 as shown in FIG.

The operation device 16 performs the bidirectional communication function. The operation device 16 includes a serial I / O interface SIO for performing serial communication with the entertainment device 12 and a parallel I / O interface for inputting operation data from a plurality of operation buttons PB.
O interface PIO, CPU, RAM and ROM
And a drive motor 130 for a vibration imparting mechanism.
And a motor driver 150 that rotationally drives the motor. The driving motor 130 is rotationally driven by a supply voltage and a current from the motor driver 150.

Note that a plurality of operation buttons PB are shown in FIG.
, The upper button 110a, the right button 110b, the left button 110c, the lower button 110d,.
Button 112a, ○ button 112b, × button 112
c, □ button 112d, L1 button 114a, L2 button 114b, R1 button 116a, R2 button 116b
There are more than a dozen buttons.

The entertainment device 12 has a structure in which a serial I / O interface SIO for performing serial communication between the operating devices 16 is provided. When a connector 62 of the operating device 16 is connected, the connector 62 is connected thereto. It is connected to the serial I / O interface SIO on the operation device 16 side, and has a configuration capable of performing bidirectional communication means, that is, bidirectional serial communication. The other detailed configuration of the entertainment device 12 is omitted.

Signal lines and control lines for performing bidirectional serial communication are connected from the entertainment device 12 to the operation device 16.
Data transmission signal line TXD (Tr
ansmit X 'for Data), a data transmission signal line RXD (Received X' for Data) for transmitting data from the operation device 16 to the entertainment device 12, and data from the data transmission signal lines TXD and RXD. A signal line SCK (Serial Clock) for a serial synchronous clock to be extracted,
A control line DTR (Data Terminal Ready) for establishing and interrupting communication with the operating device 16 on the terminal side.
And a control line DSR (Data Set Ready) for flow control for transferring a large amount of data.

As shown in FIG. 4, an entertainment device 1 includes a signal line and a control line for performing bidirectional serial communication, in addition to the signal line and the control line.
2 includes a power cable 152 directly taken out of the power supply on the second side.
6 is connected to the motor driver 150 and the drive motor 1
30 and a power source for rotating the operation device 1.
6 is supplied with power.

The bidirectional serial communication procedure having such a configuration is performed, for example, by the entertainment apparatus 12 communicating with the operation apparatus 16 and the first and second operation sections 34, 3
6 and operation data (button information) of the operation buttons PB such as the L button 38L and the R button 38R,
First, the entertainment device 12 outputs selection data to the control line DTR. As a result, the operating device 16 confirms that it has been selected by the control line DTR, and waits for reception of the subsequent signal line TXD. Subsequently, the entertainment device 12 sends an identification code indicating the operation device 16 to the data transmission signal line TXD. Thereby, the operating device 16 receives this identification code from the signal line TXD.

When the operation device 16 recognizes the identification code, the communication with the entertainment device 12 is started thereafter. That is, control data and the like are transmitted from the entertainment device 12 to the operation device 16 via the data transmission signal line TXD, and conversely, operation data and the like operated by the operation buttons are transmitted from the operation device 16 to the data transmission. It is transmitted to the entertainment device 12 via the signal line RXD. In this way, bidirectional serial communication is performed between the entertainment device 12 and the operation device 16,
This communication is performed by the entertainment device 12 via the control line DTR.
The process is terminated by outputting the selection stop data through.

With the bidirectional serial communication function as described above, the operation data of the operation buttons PB from the operation device 16 can be transmitted to the entertainment device 12 and the entertainment device 1 can be transmitted.
From the second side, a vibration generation command for rotating the drive motor 130 of the vibration imparting mechanism 128 can be transmitted to the operation device 16 via the data transmission signal line TXD.

The vibration generation command for rotating the drive motor 130 is set in advance by the optical disc 20 set in the entertainment device 12.

Next, the characteristic functions and operations of the entertainment system 10 according to this embodiment will be described with reference to the flowchart shown in FIG.

First, the monitor 18, the memory card 14, and the operation device 16 are connected to the entertainment device 12. Also, an optical disc 2 as a recording medium such as a CD-ROM in which various functions are recorded as programs and data.
0 is the disk loading unit 2 of the entertainment device 12
2 is attached.

In this state, when the power switch 28 is pressed in step S1, power is supplied to the entertainment apparatus 12 from an AC power supply (not shown) or the like.

When power is supplied, in step S2, the CPU 251 starts the operation of the operating system stored in the ROM 254,
Initial settings such as downloading necessary programs and data (including initial screen data and initial music data) from the main memory 253 are performed.

In step S3, the peripheral device control unit 2
52, the initial screen data is stored in the image decoder 2.
64, drawn on the frame buffer 263 via the GPU 262, the drawn initial screen data is supplied to the display unit 18A of the monitor 18 as a video output via the GPU 262, and the initial screen is displayed on the display unit 18A. At this time, the initial music data stored in the ROM 254 is stored in the sound buffer 272 via the SPU 271, and the stored initial screen data is output as audio output via the SPU 271 to the speaker unit 1 of the monitor 18.
8B and the speaker unit 1 in synchronization with the initial screen.
Music (musical sound) is emitted from 8B.

Next, in step S4, for example, C
The state of the decoder 282 is confirmed by the PU 251 and CD
-Whether the program and data are downloaded to the buffer 283 from the optical disk device 281 automatically started by mounting the optical disk 20 as the ROM through the decoder 282,
Is confirmed in the disk mounting section 22.

In practice, when the optical disk 20 does not exist, the initial screen display of step S3 is continued until the confirmation of the mounting of the optical disk 20 to the disk mounting portion 22 is made, and the existence of the optical disk 20 is confirmed. When done
The process moves to the next step S5.

In the process of step S5, under the control of the sub CPU 284 through the optical disk device 281, the program or data downloaded from the optical disk 20 is directly transferred to the main memory 25 through the decoder 282.
3 is stored in the main memory 253 via the buffer 283.

In the following description, the subject of image processing is the CPU 251 or the GPU 262.

FIG. 6 shows a start screen 300 displayed on the display section 18A by the processing in step S5.

On this start screen 300,
3D line drawing image of a given length and given fluctuation,
Alternatively, “Vibr” in alphabetical notation, which is a three-dimensional line drawing image divided by a predetermined length and given fluctuations
ibbon "and" bibbon "in katakana notation
Character, English notation "Push Start" character,
Several asterisk patterns and the like are displayed. In this state, for example, the display of “Vibribbon” is such that the peripheral wall is rotated in the horizontal direction on the screen about the axis of the virtual transparent cylinder every predetermined time (“Vibribbon”).
The display of “bon” turns to the back side of the screen and returns to the front side while being integrated.)

It should be noted that a basic feature of the display according to the present invention is a process of generating a three-dimensional line drawing image which is divided at a predetermined length or at a predetermined length and is given a fluctuation (three-dimensional image). The details of the line drawing discrete display process will be described later.

While the start screen 300 shown in FIG. 6 is displayed, if it is detected in step S6 that the start button 40 of the operating device 16 has been pressed, the process proceeds to step S7.
Then, a user (operator) name registration process is performed.

In step S7, a name registration processing screen 302 as shown in FIG. 7 is displayed on the screen of the display section 18A. In the name registration processing screen 302, the currently selected portion is enlarged (see the character "C" in FIG. 7), and each character or symbol is displayed separately in a three-dimensional line drawing. Then, by operating the operation button PB of the operation device 16, the name is input as "poke" in katakana notation, and the operation button PB causes the cursor (the cursor is shown at a position where the cursor is enlarged and displayed in a three-dimensional line drawing separately. .) As shown on the display screen 304 of FIG.
And press the ボ タ ン button 112b to store (register) the input name in the main memory 253.

At this time, in step S8, a game selection screen 306 which is a three-dimensional line drawing image shown in FIG. 9 for performing a game selection process is displayed. On this screen,
Selectable game types and the like are displayed on a straight line drawn outward from each vertex of the zero-angle object 308. Currently, the type of game selected is "easy". This bib ribbon game (What is a bib ribbon?
Means a vibrating ribbon. In), three types of games having different degrees of difficulty in operating characters related to music are previously stored on the optical disc 20 respectively.
The bamboo “Fuji” and the pine “Muzukashii” are stored so as to be selectable. Note that these three types of games include:
Two pieces of music are recorded in the optical disc 20 so as to be selectable.

A music CD can be used for music in the “endless” mode. For example, when the “endless” mode is selected on the game selection screen 306 in FIG. 9, a display notifying the user that a music CD is necessary is displayed on the screen of the display unit 18A,
When the user mounts a music CD on the disk mounting unit 22 instead of the optical disk 20 storing the program, the music stored on the music CD is shuffled (randomly reproduced), and details will be described later. You can enjoy the endless (endless) bib ribbon game.

Of course, the music CD can be reproduced by the music reproducing device 298.
When the “endless” mode is selected, the optical disk 20 on which the program and data of the bib ribbon game are recorded is loaded into the disk mounting unit 22.
It is possible to execute the bib ribbon game without removing the game from the game, and in this case, the real-time performance of the game is further improved. That is, the music CD is transferred to the music playback device 2
By attaching the music CD to the CD-ROM 98, the music stored in the music CD is shuffled at a location (step) designated by the program, and the music is played on the entertainment device 12 via the music playback device 298 almost in real time. Read and stored.

In this game selection screen 306, each time one of the up and down buttons 110a and 110d is pressed once, the decagonal object 308 and the options are displayed in FIG.
The game is rotated as shown in the game selection screen 310 of 0, and another desired game can be selected. In the game selection screen 310 of FIG. 9, "speed" at which the music tempo increases
The mode is highlighted. In this state, when the user presses the determination button 112b, the "speed mode" is selected.

The game selection screen 3 shown in FIG. 8 or FIG.
At 06, by selecting the “Exit” mode, the start screen 300 of the bib ribbon game shown in FIG.
Go back. Normally, when the start screen 300 is displayed, the power is turned off by pressing the power switch 28.

In this embodiment, it is assumed that, in step S9, in the state of the game selection screen 306 (see FIG. 9), the ボ タ ン button 112b as the decision button is pressed.
With this determination, the bib ribbon game in the plum “easy” mode is started, and the game processing in step S10 is performed.

FIG. 11 shows a detailed flow of the game processing in step S10.

First, in step S21, it is confirmed whether or not the initial processing related to the game processing described in the next step S22 has been performed.

In the initial processing related to the game processing in step S22, the three types of character objects 401, 402,
403, four types of obstacle objects 41 shown in FIG.
1, 412, 413, and 414, and the movement path (also referred to as virtual load) object 420 shown in FIG. 14 are read and stored in the main memory 253 in the world coordinate system.

Here, the character object 401,
Numerals 402 and 403 are modified animals, rabbits, frogs, and snakes. The obstacle objects 411, 412, 413, and 414 are obtained by modifying quadrangular (square, box), circular, V-shaped (inverted triangle), and zigzag (symbol of resistor), respectively.
Further, the virtual load object 420 is a virtual load (three-dimensional line drawing image load) for moving the character objects 401, 402, and 403. The virtual load object 420 includes the obstacle objects 411 and 41 generated according to a sound analysis result described later.
2, 413 and 414 are inserted and arranged.

In this case, each character object 40
1, 402, 403 and each obstacle object 411, 4
12, 413, 414 and virtual load object 420
Are basically shown in FIG. 15 as an example of the obstacle object 411 as an example.
It comprises a basic object 415 as a slender rectangular parallelepiped convex shape model (convex polyhedron model). Enlargement / reduction / coordinate conversion (including movement) of the basic object 415 can be performed by the GTE 261.

As can be seen from FIG. 15, each of the character objects 401, 402, and 403, each of the obstacle objects 411, 412, 413, and 414, and the virtual load object 420 are polygons that constitute each basic object 415, such as a square ( Each polygon is defined by its three-dimensional vertex coordinates and the colors at the vertices, and is defined in a predetermined area of the main memory 253 (each of the character objects 401, 402, 403 and each of the obstacles). Object 411, 412, 413, and 414 and the virtual load object 420).

In this embodiment, the color is white (for example, if the luminance gradation is 8 bits, R (red), G
R (red) = G (green) = B
(Blue) = 255). It goes without saying that other colors can be used.

Further, in the initial processing in step S22,
Operation buttons PB and obstacle objects 411 and 412 related to the execution of the bib ribbon game schematically shown in FIG.
Correspondence tables (operation button obstacle correspondence tables) 416 of 413 and 414 are read from the optical disc 20 and stored in a predetermined area of the main memory 253 (operation button obstacle correspondence table storage area).

In this correspondence table 416, as can be seen from FIG. 16, the obstacle objects 411, 412, 4
13 and 414, corresponding to the L1 button 114, respectively.
a, an R1 button 116a, an upper button 110a, and a △ button 112a.

Further, in the initial processing of step S22, a flag (NG flag F1 and the like) described later and a register (character object state register) 456 and the like are set to an initial state (also described later).

After the end of the initial processing in step S22, in the processing in step S23, it is confirmed whether or not music data remains in the buffer 283, and the buffer 2
If there is no music data left in step 83, step S
At 24, it is confirmed whether or not the game for one piece of music data has ended. If the game for one piece of music data has not ended, at step S25, for example, one piece of music in the plum "easy" mode The corresponding music data is read from the optical disc 20 and stored in the main memory 253. In this case, the data may be stored in the buffer 283.

In the endless mode described above, in the process of step S25, for example, the music reproducing device 29
The music data for one music is read from a CD or the like mounted on the CD-ROM 8 and stored in the main memory 253.

Next, the audio signal analysis processing in step S26 and the line drawing display update processing in step S27 are performed in parallel, and a game image is displayed on the screen of the display unit 18A.

FIG. 17 shows a flowchart of the audio signal analysis processing (audio signal analysis means) in step 26.

In the process of step S51, it is determined whether music data for a predetermined time for reproduction has been read out based on whether music data is stored in the buffer 283.

If no music data is stored in the buffer 283, the process proceeds to step S52.
For a predetermined period of time from the beginning of the music data for the music, in this embodiment, the virtual load object 420 is moved for 8 seconds from the upper right side to the lower left side of the screen for one screen (more precisely, 8 seconds). (The time for the second + the time for the margin) is read out and written into the buffer 283.

Next, the music data for 8 seconds stored in the buffer 283 (music data storage area for a predetermined time) is divided into predetermined times for each minute time (in this embodiment,
Analyze the audio signal (split into 16 every 0.5 seconds)
The process of determining the occurrence of an obstacle object as a result will be described.

In this case, in step S53, in order to divide the audio signal (also referred to as music data) into minute time, in this embodiment, 0.5 second, the buffer 283 corresponds to 0.5 second. Read music data.

In step S54, the register i is updated by 1 as a count parameter for this read operation (i ← i + 1).

Next, in step S55, music data for a very short time is sampled at a sampling frequency, and in step S56, a frequency spectrum is extracted. That is, fast Fourier transform processing is performed. After sampling, a process using a band-pass filter in an audio frequency band may be performed to remove noise.

Next, in the process of step S57, peak values (waves that are the loudness of sound) are respectively higher and lower than a predetermined frequency fc (this frequency can be changed at random) in the extracted frequency spectrum. (High value) can be detected (this number can also be changed appropriately). In step S58, detection is performed in each frequency region, that is, in a frequency region lower than the predetermined frequency fc and a frequency region higher than the predetermined frequency fc. The peak values of the obtained frequency spectrum are arranged in descending order, and the arrangement order of the frequencies related to each of the three peak values up to the third is determined.

For example, three peak frequencies lower than the predetermined frequency fc are determined in order of frequency from fl1, fl2, fl3.
Assuming that three peak frequencies higher than the predetermined frequency fc are f4, f5, and f6 in descending order of frequency, there are six combinations in each of a frequency region equal to or higher than fc and a frequency region lower than fc. The combination of the arrangement order P of the peak frequencies is generated.

Next, in step S59, the order P of peak frequency arrangement and the obstacle objects 411, 412,
Table 428 shown in FIG.
Referring to (correspondence table between audio signal analysis result and obstacle object to be generated), step S60
In, one of the obstacle objects 411, 412, 413, and 414 to be generated in the current frequency analysis result is determined.

As can be seen from FIG. 18, for example, the peak frequency arrangement order P is P = [fl1, fl2, fl3, f
h1, fh2, fh3], the obstacle object 411 is determined, and P = [fl3, fl2, fl
1, fh3, fh2, fh1], the obstacle object 414 is determined.

Of course, the order in which a plurality of obstacle objects are generated can be determined based on the result of one frequency analysis.

Note that the audio signal analysis processing in steps S53 to S60 is an example on the frequency axis.
It can be performed not only on the frequency axis but also on the time axis.
In this case, the music data is divided on a time axis at regular intervals, for example, every 0.5 seconds, and five peak values of the amplitude of the sound in the interval are extracted in descending order. Then, as shown in FIG. 19, a slope Q between peaks adjacent on the time axis among the five peaks may be calculated, and a correspondence table 429 may be provided with a permutation combination of the slopes Q. For example, if the combination of the slope Q between the peaks is slope: positive, positive, positive, positive, the obstacle object 41
It is sufficient to decide to select 1.

In the audio signal analysis processing, for example, in the endless mode, failures are determined in advance not based on the audio signal itself but on the TOC (table of contents) data (number of songs, playing time, logical address of the song, etc.) of the CD. Object objects 411, 412, 413, 414
May be determined in advance.

Next, the line drawing display updating process of step S27 (see FIG. 11) is performed. During this line drawing display updating process, the processes of step S61 and step S62 are performed in parallel. In the process of step S61, step S54
Until the value of the register i related to the counter parameter set in the above becomes i = 16 (a value corresponding to the above 8 seconds)
Steps S53 to S60 are repeated. When i = 16, the value of the register i related to the counter parameter is set to i = 0 in step S62. At this time, all the music data for 8 seconds in the buffer 283 (music data storage area for a predetermined time) is read, and the process proceeds to step S27 (see FIG. 11).

FIG. 20 shows a flowchart of the line drawing display update process (including the first display) in step S27.

In step S71, on the display screen of the display section 18A of the monitor 18, a substantially straight line (actually, a divided straight line) extending from the lower left end to the upper right end of the screen is displayed.
The line drawing image of the book is a virtual load object 420 (FIG. 1).
4) by GTE 261 and this GPU
262, the drawing area 265 (two drawing areas 265A, 265B) in the schematic diagram of the frame buffer 263 shown in FIG.
265B), for example, the drawing area 26
5A is drawn. Here, the frame buffer 263
Is, for example, 1024 pixels × 51 in the xy directions.
It functions as a so-called double buffer having a size of two pixels and having drawing areas 265A and 265B of, for example, 256 pixels × 240 pixels.

In step S72, as will be described later, an obstacle, which is a non-linear line drawing image determined by the audio signal analysis result in step S58, is included in the one substantially linear line drawing image. Object 41
1, 412, 413, and 414 are drawn in the drawing area 265A of the frame buffer 263 in the same manner as the line drawing images to be inserted into the screen at the back right on the screen in the analysis order. The image and the non-linear line drawing image are combined.

Further, in step S73, a line drawing image of a predetermined character object 401 (see FIG. 12) is stored in the frame buffer near the left end of the screen on the substantially linear one line drawing image with the non-linear line drawing image. 263 are drawn in the drawing area 265A in the same manner. It should be noted that which of the character objects 401, 402, 403, etc. is selected depends on the contents of a character object status register 456 described later with reference to FIG. At the start of the game, the contents (data) of the character object state register 456 are data corresponding to the character object 401 by the above-described initial processing in step S22.

In the processing of steps S71, S72, and S73, the virtual load object 420 relating to the substantially linear line drawing image and the obstacle objects 411, 412, 413, 414 relating to the non-linear line drawing image are actually drawn. And character object 40 related to a non-linear line drawing image
1 for each of the basic objects 415 (see FIG. 15), which are elongated rectangular parallelepipeds, are converted from the world coordinates to the camera coordinate system, further converted to the screen coordinate system by perspective projection conversion, hidden surface processing, Rendering processing such as color processing for polygons (expansion and reduction processing is also performed as appropriate) is performed and rendered.

FIG. 22 schematically shows the processing before the virtual load object 420 composed of the basic object 415 is arranged on the camera coordinate system xyz and before it is arranged on the screen coordinate system xy (xy plane). In this manner, in the example of FIG. 22, one linear three-dimensional line drawing image is displayed on the screen (xy plane) of the display unit 18A from the lower left lower front side to the right upper upper back side. become.

Here, for ease of understanding, for convenience,
A description will be given of a three-dimensional image in which drawing data is read out from the other drawing area 265B on which the previous drawing was performed, of the drawing areas 265A and 265B, and displayed on the display unit 18A.

FIG. 23 shows a state in which color processing and the like are performed from the drawing areas 265A and 265B to the monitor 18 side by the GPU 262 and read out, and displayed on the screen of the display unit 18A.
A three-dimensional line drawing image 430 is shown.

On this three-dimensional line drawing image 430, a character object line drawing image 401Ia is provided on the left end side of a virtual load object line drawing image 420Ia composed of line drawing pieces corresponding to the divided and fluctuated basic object 415, respectively. The image is like riding.

In step S74, the virtual load object line drawing image 420Ia (if there is an obstacle object line drawing image, the virtual load object line drawing image into which the obstacle object line drawing image is inserted) is moved in the direction of arrow E for a predetermined time. Every time, for example, every time the screen is updated (every 1/30 second in the NTSC system), a component that is drawn so as to move by a predetermined amount and simultaneously constitutes the character object line drawing image 401Ia, in this case, a modified rabbit arm When the character object line drawing image 401Ia is drawn on the screen as if it is relatively moving (running) in the direction of arrow F, the image is drawn so that the feet, feet, etc. are alternately moved in the front-back direction. can get.

The three-dimensional line image 43 shown in FIG.
0 is an image in which only the character object line drawing image 401Ia and the virtual road object line drawing image 420Ia are displayed. After this display, the line drawing image corresponding to the obstacle object according to the frequency analysis result is displayed based on the frequency analysis result.

In FIG. 23, reference numeral 415I denotes a line drawing image of the basic object 415 (basic object line drawing image). Actually, since the basic object 415 is an extremely elongated object, only the edges of the polygons constituting the object are drawn in white.

Therefore, the three-dimensional line image 4 shown in FIG.
Reference numeral 30 denotes a very simple monochrome image (actually, a monochrome image) in which the background is black and the line drawing portion formed by the ridge lines of the polygon is white.

In this embodiment, the time required for the right end of the virtual load object line drawing image 420I to move to the left end on the three-dimensional line drawing image 430 is set to the above-mentioned 8 seconds.

In practice, when the obstacle object line drawing image described later appears in the virtual road object line drawing image 420Ia on the screen of the display unit 18A of the monitor 18, the user (game player) operates the operation button shown in FIG. The operation of the operation button PB defined in the obstacle correspondence table 416 is performed at a predetermined timing suitable for various elements extracted from music flowing from the speaker unit 18B of the monitor 18 or headphones (not shown). , The obstacle object line drawing image can be cleared. “Clearing” refers to a state in which the character object line drawing image moves over or rotates over the obstacle object line drawing image at an appropriate timing suitable for various elements extracted from the music. Alternatively, when the operation button PB defined at a predetermined timing cannot be operated, and becomes the non-clear state, a specific image described later is generated. The bib ribbon game proceeds in this manner.

In this embodiment, in step 74, the clear state is determined based on the state of an NG flag F1 described later. If the NG flag F1 is F1 = 0 (clear), in step S76, a small fluctuation imparting process for imparting a small fluctuation (relatively small vibration) to the next three-dimensional line drawing image to be drawn is performed. F1 is F1
If = 1 (non-clear, that is, NG), in step S77, a large fluctuation applying process for applying a large fluctuation (relatively large vibration) to the next three-dimensional line drawing image to be drawn is performed.

In general, small fluctuations give the user (operator) a comfortable feeling and rhythmic feeling, and large fluctuations give the user (operator) surprise and the like. From the speaker section 18B, music having a comfortable rhythmic sense is generated in synchronization with a small fluctuation, and a sound such as a large pop sound is generated in synchronization with a large fluctuation.
Note that music may not be generated.

In this case, a small fluctuation and a large fluctuation show a degree of difference. In this embodiment, the small fluctuation means a range of fluctuation (small vibration) that can keep the original shape of the object, and the large fluctuation is A fluctuation (large vibration) that makes the original shape of an object unclear.

When the large fluctuation applying process in step S77 is performed, the NG flag F1 is set in step S78.
Is reset to F1 ← 0 (F = 0) (the flag is lowered).

Then, in a step S79, a step S79 is executed.
The three-dimensional line drawing image after the new fluctuation application (the application of the small fluctuation or the large fluctuation) to the drawing area 265A currently being drawn which is different from the above described drawing area 265B which is currently read out for display by the processing of 78 To draw.

Here, the fluctuation processing in steps S76 and S77 will be described.

The fluctuation imparting process includes adding a random number to each vertex of the polygon of each basic object 415, which is a line drawing image piece constituting all the objects arranged in the three-dimensional space, and then adding a random number to each vertex of the polygon. The process is to redraw an image consisting only of the ridge line portion of the.

To explain mathematically, a relatively small random number RDS is generated for a small fluctuation process, and a relatively large random number RDB is generated for a large fluctuation process. Then, when the NG flag F1 is F1 = 0, the relatively small random number RDS (Δxs, Δy) is set at each vertex coordinate (x, y, z) of the basic object 415.
s, Δzs) and the vertex coordinates (x
+ Δxs, y + Δys, z + Δzs), and a straight line is drawn between the converted vertex coordinates to obtain a new ridge line of a new polygon.

On the other hand, when the NG flag F1 is F1 = 1, the relatively large random numbers RDB (Δxb, Δy
b, Δzb) to each vertex coordinate (x, y, z) to convert the vertex coordinates into vertex coordinates (x + Δxb, y + Δyb, z
+ Δzb), a straight line is drawn between the converted vertex coordinates to obtain a new ridge line of a new polygon.

Referring to the drawings, as shown in FIG.
In the small fluctuation process, the basic object 415 drawn first is slightly moved (rotated, enlarged, and moved) in the three-dimensional space by the arrows SV and SV ′.
The basic object 415a is created, and in the large fluctuation process, the basic object 415b that has moved greatly in the three-dimensional space by the arrows LV and LV 'is created.

In step S77, the three-dimensional object to which the fluctuation has been applied is drawn in the other drawing area 265 (265A or 265B) that is not currently being drawn. At the time of drawing in the drawing area 264, no texture is attached to the surface of the polygon constituting the basic object 415. Therefore, even if the basic object 415 is enlarged or reduced, the texture and texture of the image do not change. The advantage is that the simplicity of the image is not impaired even if the image is enlarged or reduced.

The three-dimensional line image 43 shown in FIG.
0 indicates an image in which small fluctuations are added to each basic object line drawing image 415Ia.

[0177] In step S79, the three-dimensional line drawing image to which the fluctuation has been applied is not currently displayed in the drawing area 26.
5B, and in step S80, display is performed by the drawing area 265A in which drawing has already been completed. Note that, as described above, the display processing in step S80 and other processing are performed in parallel. Here, the other processing includes step S26 (steps S51 to S6).
0) and the processing from steps S71 to S79 and the processing from step S28 to step S26 to step S26 to be described later.

Here, for convenience of understanding, the display unit 18
The three-dimensional line drawing image displayed on the screen A and the game progress will be described with reference to FIGS.

FIG. 25 is a flowchart showing the operation in step S10 shown in FIG.
After the game processing flow is repeated for several seconds, shows a three-dimensional line drawing image 432 to which only small fluctuations are given.

In the three-dimensional line drawing image 432, the character appears to be running as a divided line drawing image piece constituting the character, but the character as a whole is relatively stationary near the left end of the screen. For the object line drawing image 401Ib, the obstacle object line drawing image 411Ib and the obstacle object line drawing image 41 inserted in the virtual load object line drawing image 420Ib.
4Ib and obstacle object line drawing image 412Ib
Shows an image in a state where the image is sequentially moving from the right rearward direction to the left frontward direction (arrow E direction) of the screen.

In other words, in the three-dimensional line drawing image 432, if expressed in a figurative manner, a rabbit (character object line drawing image 401Ib) is a rectangular obstacle (obstacle object object) that moves from the front. The positions of the line drawing image 411Ib), the zigzag obstacle (obstacle object line drawing image 414Ib), the V-shaped obstacle (obstacle object line drawing image 413Ib), and the circular obstacle (obstacle object line drawing image 412Ib) It appears to be running up and down.

Next, a three-dimensional line drawing image 434 shown in FIG.
Now, the obstacle object line drawing image 411Ic that has moved toward the left end side and has become a large square on the three-dimensional image.
L1 button 1 at a predetermined timing (predetermined range)
When the button 14a is pressed, the character object line drawing image 401Ic jumps over the quadrangular obstacle object line drawing image 411Ic in a so-called horse jumping style, and shows a state in which the character object line drawing image 401Ic jumps over. In this way, the quadrangular obstacle object line drawing image 411Ic can be cleared.

At this time, the remaining virtual load object line drawing image 420Ic and the obstacle object line drawing image 41
4Ic, the obstacle object line drawing image 413Ic, and the obstacle object line drawing image 412Ic are also moving while gradually increasing in the direction of arrow E.

The three-dimensional line drawing image 436 shown in FIG.
When the タ イ ミ ン グ button 112a is pressed at a predetermined timing (predetermined range) with respect to the obstacle object line drawing image 414Id moving toward the left end and becoming a large zigzag shape, the character object line drawing image 401I is pressed.
c is a zigzag obstacle object line drawing image 41
4Id shows a state of moving in a so-called forward rotation. Thus, the zigzag obstacle object line drawing image 414Id can be cleared.

At this time, the remaining virtual load object line drawing image 420Id and the obstacle object line drawing image 41
3Id and an obstacle object line drawing image 412Id
Also move while gradually increasing in the direction of arrow E.

Further, the three-dimensional line drawing image 43 shown in FIG.
In FIG. 8, when the upper button 110a is pressed at a predetermined timing (predetermined range) with respect to the obstacle object line drawing image 413Ie that has moved toward the left end and formed a large V-shape, the character object line drawing image 401Ie is displayed.
Is a V-shaped obstacle object line drawing image 413Ie
Is moving so as to walk on a so-called straddle. In this manner, the V-shaped obstacle object line drawing image 413Ie can be cleared.

In this case, the remaining virtual road object line drawing image 420Ie and the obstacle object line drawing image 412Ie also move while gradually increasing in the direction of arrow E.

In the three-dimensional line drawing image 438, a new obstacle object line drawing image 4 generated by the audio signal analysis processing performed in parallel with the display processing is displayed.
14Ie is a virtual road object line drawing image 420Ie
Is drawn on the right end side of.

Further, in the three-dimensional line drawing image 440 shown in FIG. 29, the R1 button 116a is moved at a predetermined timing (predetermined range) with respect to the obstacle object line drawing image 412If which has moved toward the left end and has become a large circular shape. Is pressed, the character object line drawing image 401
If is a circular obstacle object line drawing image 412If
The figure shows a state where the user is moving so as to walk inside. In this manner, the circular obstacle object line drawing image 41
2If can be cleared.

At this time, the remaining virtual road object line drawing image 420If, obstacle object line drawing image 414If, and newly generated obstacle object line drawing image 413If are also moving in the direction of arrow E while gradually increasing.

FIGS. 26 to 29 show the obstacle objects 411, 412, 4
13 and 14 show line drawing images when cleared.

On the other hand, the three-dimensional line drawing image 432 shown in FIG.
Is displayed at a predetermined timing (predetermined range) with respect to the obstacle object line drawing image 411b.
Therefore, when the L1 button 114a is not pressed, or at a predetermined timing (a predetermined range), the corresponding L1 button 114a is pressed.
A three-dimensional line drawing image 450 immediately after an operation button PB other than the 1 button 114a is pressed, that is, immediately after a so-called non-clear state.
Is shown in FIG.

As can be seen from FIG. 30, each of the basic object line drawing images 415Ig constituting the obstacle object line drawing image 411Ig is subjected to step S77.
The large fluctuation (burst vibration) described as the process (1) is applied, and the image is displayed as a separated image. This large fluctuation is caused by the character object line drawing image 4
01Ig and the virtual load object line drawing image 420Ig in the vicinity thereof are also affected. As shown in FIG. 12, each of the basic object line drawing images 401Ig constituting the character object line drawing image 401Ig and the virtual load object line drawing image 420Ig is affected. However, the image is in the category of small fluctuations related to the processing of step S76, but with relatively large fluctuations.

At this time, vibration can be applied to the rotary operators 44 and 46 via the motor driver 150 and the motor 130.

[0195] By using the three-dimensional line drawing image 450 including the separated objects shown in FIG.
It is possible to clearly know that the obstacle object line drawing image 411Ig could not be cleared (not clear, that is, NG).

FIG. 31 shows an obstacle object line drawing image 4
A three-dimensional line drawing image 452 after a fixed time (for example, within one second) when 11 Ig cannot be cleared is shown.

As can be seen from FIG. 31, the obstacle object line drawing image 411Ib shown in FIG. 25 (the same applies to other obstacle line drawing images 414Ib, 413Ib, and 412Ib).
Is not clear, the fluctuation is an image to which a small fluctuation is slightly increased. When the object is not cleared, the moving speed of the virtual road object line drawing image 420Ig in the direction of arrow E is increased, and the obstacle object 4 is moved by the character object 401Ih.
The predetermined timing (predetermined range) for clearing 14Ih can be further shortened, and the difficulty of the game can be increased.

FIG. 32 shows a character state table 454 related to the plum “easy” mode, which shows the change state (simulated degeneration and evolution) of the character objects 401, 402, and 403 shown in FIG.

As can be seen from the character state table 454, the character object that appears first (at the start of the game) in the “easy” mode of the bib ribbon game has only a slight fluctuation (a small fluctuation in step S76) obtained by modifying the rabbit. If the obstacle object 411, 412, 413, or 414 cannot be cleared for the given character object 401, the above-described large fluctuation (large vibration) is applied, and the object is separated. It becomes a large character object 401 '.

In the state of the character object 401 'in which the fluctuation is increased (small fluctuation in step S76 for keeping the original shape), if the character object 401' cannot be further cleared, the above-mentioned large fluctuation (large vibration) gives rise to a dispersion. After that, the frog is transformed into a character object 402 with a slight fluctuation that has been modified.

Similarly, when non-clearing is repeated, the change of the character object is repeated. More specifically, after the above-mentioned large fluctuation (large vibration) is applied, the character object 402 ′ is changed into a character object 402 ′ having a larger fluctuation, and is slightly modified by modifying a snake having a smaller fluctuation. The character object 403 is given a fluctuation. Furthermore, the character object changes to a character object 403 ′ with a larger fluctuation. Thus, the appearance of the character object becomes miserable each time it is not cleared.
Finally, the obstacle objects 411, 412, 41
If the game cannot be cleared even if the number of times 3, 414 is exceeded a predetermined number of times, that is, if the clearing of the obstacle object has failed after changing to the character object 403 ', the game is over, that is, the game is over.

Note that once the character object 40
1 changes (degenerates) in the direction of arrow B, that is, the character object 401 changes to 401 ′, 402, 4
Even if it changes in the order of 02 ', 403, and 403', if the clear state continues or the probability of clearing increases thereafter, it changes in the direction of arrow F opposite to the direction of arrow B (evolution). ). For example, from character object 403 to character object 402
等 etc. can be transformed again.

An algorithm such as what kind of clear state is achieved when the player transforms is determined in advance for each game mode, and the number of times, pattern, and the like are determined in the program.

Character objects 401, 401
', 402, 402', 403, 403 ', when one piece of music ends, the game mode ends in the clear state, and the obstacle objects 411, 412, 413, 414 at this time are ended. The score is displayed according to the clear state of the.

Character objects 401, 401
', 402, 402', 403, 403 'are C
This is stored as a character object state in a register in the PU 251 {character object state register (character object state storage area) 456 schematically shown in FIG. At the start of the game in the "easy" mode, this character object status register 4
The content of 56 is data indicating the character object 401.

The above is the description of the three-dimensional line drawing image displayed on the screen of the display section 18A and the game progress relating to the operation device 16.

The progress of the game will be described with reference to the flowchart shown in FIG.

The three-dimensional line drawing image 4 shown in FIGS.
In a state where 32 or the like is displayed, for example, FIG.
In a state where the three-dimensional line drawing image 432 shown in FIG. 5 is displayed, in step S28, it is confirmed whether or not the operation button PB has been operated.

If the operation has not been confirmed, in step S29 the character object line drawing image 4
It is checked whether 01Ib has reached a predetermined position of the obstacle object line drawing image 411Ib, for example, a rising position, and the obstacle object line drawing image 411I is confirmed.
If it has not reached the predetermined position b, it is not NG, so that in step S30, the NG flag F1 is set to F1.
= 0, and the processing after step S23, and when music data remains, the audio signal analysis processing of step S26 and the line drawing display update processing of step S27 are performed.

In the line drawing display updating process in step S27, the NG flag F1 in step S75 (see FIG. 20) is used.
Is determined as F1 = 0, the display is performed with small fluctuations.

On the other hand, if it is determined in step S28 that the operation button PB has been operated, then in step 31,
It is determined whether it has been cleared. Specifically, at the time of the operation, the character object line drawing image 40
Whether or not a predetermined portion of 1Ib, for example, a forefoot portion is within a predetermined range of a predetermined position (for example, a rising position) of the obstacle object line drawing image 411Ib (actually determined by the number of pixels), and an obstacle object It is determined whether or not the operation button PB appropriate to exceed the line drawing image 411Ib, that is, the operation of the L1 button 114a, has been determined.
FIG. 1 shows a predetermined pixel number table, not shown, respectively.
The determination is made with reference to the operation button obstacle correspondence table 416 shown in FIG.

In step S31, if any of the conditions is satisfied, it is determined to be clear, and step S32
NG flag F1 is set to a state indicating OK (clear), that is, F1 ← 0. Note that when the obstacle objects 411, 412, 413, and 414 are cleared, the points are added to a point register (not shown).

If any of the conditions (a predetermined range and a predetermined button) is not satisfied in step S31, it is determined that the state is not cleared, and in step S33, N is determined.
The G flag F1 is set to a state indicating NG (not cleared), that is, F1 ← 1.

[0214] If the operation button PB is not operated in the determination in the above step S29, even when the character object line drawing image 401Ib or the like has reached the predetermined position of the obstacle object line drawing image 411Ib or the like. , The operation of the operation button PB is regarded as being delayed, and the NG flag F1 is set to F1 ← 1 (NG).

After the process in step S33 (F1 ← 0), in step S34, the character objects 401, 402, and 403 are normalized in the current display state (this means a change in the direction of arrow F in FIG. 32). It is determined whether or not is possible. The normalization is possible, for example, by changing the character object 401 ′ (see FIG. 32) to the character object 401 with less fluctuation, or by changing the character object 402 to the character object 401. ′, A change in the direction of arrow F.

When the determination in step S34 is established, in other words, in the character object state register 45,
When the character object 401 refers to the data of character objects 401 ′, 402, 402 ′, 403, and 4
If the state is any of 03 ′, step S
At 36, the character object status register 4
The content of 56 is rewritten to data representing a character object in the direction of arrow F.

Of course, if the determination in step S34 is not satisfied, the character object status register 45
6 is the data representing the character object 401.

As inferred from the processing of steps S32, S34 and S36, the processing of step S32 (F1 ←
After 1), in step S35, in the current display state, the character objects 401, 402, 403
(Depending on the direction of arrow B in FIG. 32) is determined. Deterioration is possible, for example, when the character object 401 ′ (see FIG. 32) is used, the character object 402 is transformed into a character object 402, and when the character object 402 is used, the character object 40 has a large fluctuation.
This means a change in the direction of arrow B, which is a change to 2 '.

When the determination in step S35 is satisfied, in other words, in the character object state register 45
When referencing the data of No. 6, the character object is
Character objects 401, 401 ', 402, 4
If the state is any of 02 'and 403, in step S36, the contents of the character object state register 456 are rewritten to data indicating the one in the direction of arrow B. If the determination in step S35 is not satisfied, it means that the content of the character object state register 456 is data representing the character object 403 ', and the process proceeds to step S11 (see FIG. 5).

In the determination in step S24, 1
Even when the game for the music has ended, the process proceeds to step S11.

FIG. 33, FIG. 34, and FIG. 35 respectively show ending possible screens 457, 458, and 460 performed in the processing of step S11 related to the ending processing of step S12.

That is, if the judgment in step S35 is negative, an endable screen 457 shown in FIG. 33 is displayed.

On the ending possible screen 457, “game over! (Meaning of ending the game)”, “mokkaiyaru? (Meaning whether to play the game again)”, “Yes” , A character representing “No (the character on the screen is crushed)” is displayed. In this state, if the ○ button 112b is pressed, the game is challenged once more, and the determination in step S12 is negative. , And the game process in step S10 is started, and the game selection screen 306 shown in FIG. 9 is displayed.

On the game selection screen 306, “Exi
If "t" is selected and determined, the start screen 300 shown in FIG. 6 is displayed.

Also, on the end screen 457 shown in FIG.
The screen when “No” is selected by using the lower button 110c is the endable screen 458 shown in FIG. In this state, if the ボ タ ン button 112b is pressed, the determination in step S12 becomes affirmative, and the start screen 300 shown in FIG. 6 is displayed.

Further, if the determination in step S24 is affirmative, an endable screen (game clear screen) 460 shown in FIG. 35 is displayed.

In this end possible screen 460, characters representing "clear!", "1570 ten", and "dayong (meaning" is. ")" Are displayed by small fluctuation processing, respectively. When the button 112b is pressed, the determination in step S12 becomes negative, and the
The game processing of 10 is started, and the game selection screen 306 shown in FIG. 9 is displayed.

FIG. 36 is a functional block diagram of image processing and audio processing according to the above-described embodiment.

In FIG. 36, an audio signal analyzing means 502 is an audio signal dividing means 504 for dividing an audio signal read from the optical disc 20 or a music CD or the like at regular intervals, and an audio signal dividing means 504 for dividing the audio signal divided at regular intervals. Sampling means 506 for sampling
A frequency spectrum detecting means 508 for detecting a frequency spectrum from a sampling result; and a peak value detecting means 510 for detecting a peak value of each detected frequency spectrum or directly detecting a signal peak value from the sampling result. An order determining means 512 for processing the detected peak values to determine a certain order, a non-linear object determining means (obstacle object determining means) 514 for determining the obstacle object 411 and the like based on the determined order. Having.

Here, as the order determination processing in the order determination means 512, first, as processing on the frequency axis via the frequency spectrum detection means 508 (frequency analysis processing), a detected peak value is used. 500H
There is a process of dividing the peak values into lower and higher frequency ranges than z, arranging the detection frequencies in descending order of the peak value between the low frequency and the high frequency, and determining the arrangement order of the detected frequencies as an order.
As processing on the time axis (amplitude analysis processing) bypassing the frequency spectrum detecting means 508, the detected peak values are detected from the largest value to the fifth peak value, and the adjacent peak values on the time axis are detected. And the peak value, the slope (differential value) between the peak value and the next peak value is defined as positive or negative, and the order of the positive and negative values is determined as an order.

The non-linear object determination means 514 refers to the correspondence table 428 or 429 between the audio signal analysis result and the obstacle object to be generated, and determines a predetermined non-linear object corresponding to the determined order. (Obstacle object) is determined and sent to the non-linear line image generating means 516.

In the image processing / audio processing function block shown in FIG. 36, the line drawing image generating means includes a linear line drawing image generating means 518 and a character object line drawing generating means 520 in addition to the non-linear line drawing image generating means 516. Have. In this case, the character object line drawing image generating means 520 monitors the operation timing of the predetermined push button PB of the operating device 16 by the operation monitoring means 52.
A predetermined character object line drawing image is generated based on the determination of the character object line drawing image change determining means 524 which determines the change of the character object line drawing image based on the monitoring result from Step 2.

The movement giving means 526 gives a movement amount to the linear line drawing image, the non-linear line drawing image, and the character object line drawing image.

The fluctuation amount determining means 528 determines the fluctuation amount based on the monitoring result of the operation monitoring means 522.

The fluctuation applying means 530 performs different processing on the linear line drawing image, the non-linear line drawing image, and the character object line drawing image to which the moving amount has been added, based on the fluctuation amount determined by the fluctuation amount determining means 528. Give the fluctuation.

The linear line drawing image, the non-linear line drawing image, and the character object line drawing image to which the movement and the fluctuation are given are synthesized by the synthesizing means 532 and drawn in the frame buffer 263 by the drawing means 534.

The image drawn on the frame buffer 263 is displayed on the screen of the display section 18A under the control of the display control means 536 (GPU 262).

As described above, according to the above-described embodiment, a three-dimensional line drawing image 430 including a line drawing image piece (such as the basic object 415I) to which the fluctuation is given by the fluctuation giving means 530 is obtained. The three-dimensional line drawing image 430 or the like is a new highly entertaining image that does not exist in the past.

The fluctuation given to each line drawing image piece is shown in FIG.
As shown in FIG. 4, the fluctuation is easily generated by adding a random number to each vertex of each polygon constituting the line drawing image piece object (basic object 415) arranged in the three-dimensional space by the fluctuation applying unit 530. Can be granted.

Also, the three-dimensional line drawing image 430 and the like are shown in FIG.
(For example, a virtual road object line drawing image 420Ia) including a line drawing image piece (415I or the like) given a substantially linear fluctuation extending from substantially one end side to the other end side in the horizontal direction on the display screen as shown in FIG. By doing so, there is a possibility that the content of the line drawing image can be given diversity.

As shown in FIG. 25, a part of an image (virtual road object line drawing image 420Ib, etc.) composed of a substantially linear line drawing image with fluctuation is added to a non-linear line drawing image with fluctuation. (Obstacle object line drawing images 411Ib, 414Ib, 413Ib, 413I
By using the image in which b) is inserted, there is a possibility that the content of the line drawing image can have more diversity.

Here, as the audio signal, a recording medium (optical disc 20 or music CD) or an audio signal downloaded by communication with the entertainment apparatus 12 can be used.

The above-described audio signal analyzing means 50
2. Line drawing image generating means 516, 518, 520, movement giving means 526, character object line drawing image change determining means (character object line drawing image changing means) 5
24 and the fluctuation imparting means 530 can be stored in a recording medium such as the optical disk 20 as a program.

A game operation according to this embodiment will be described with reference to FIG. 26, for example, by pressing the L1 button 114a, which is a predetermined operation button PB of the operation device 16, at a predetermined timing. , Obstacle object line drawing images 411Ic, 414Ic, 413Ic, and 4R moving from the right back to the left front (the direction of arrow E) of the screen.
Virtual road object line drawing image 420I with 12Ic
c can be cleared by the character object line drawing image 401Ic.

In this case, if the timing of pressing the operation button PB is lost or if the type of the operation button PB to be pressed is wrong, as shown in FIG. 30, the obstacle object 411 to be cleared hardly retains its original shape. Obstacle object line drawing image 411Ig is obtained, and the character object 401 changes to a character object line drawing image 401Ig to which a considerably large fluctuation vibration is applied.

It can be said that the entertainment of the game operation executed by such an operation is extremely high.

The present invention is not limited to the above-described embodiment, but can adopt various configurations without departing from the gist of the present invention.

(1) For example, an operation button obstacle correspondence table 416A shown in FIG. 37 as another example of a so-called key assignment (key assignment) table 416A shown in FIG. You can also remember it. In the operation button obstacle correspondence table 416A, the obstacle objects 411, 412,
For 413 and 414, L1 and L2 buttons 114a and 114b (either may be used), R1 and R2, respectively.
Buttons 116a and 116b (whichever may be used), a lower button 110d, and an X button 112c are assigned. By doing so, it is possible to match the user's (operator's) preference and the like.

(2) Further, as an obstacle object generated based on the audio signal analysis processing of step S26, a correspondence table 428 between the audio signal analysis result shown in FIG. 18 and FIG. 38, an obstacle object 602 obtained by combining the obstacle objects 414 and 412 by the combining means, for example, as shown in FIG. 38, may be generated. This composite obstacle object 602
In order to clear by the character object 401 or the like, it is necessary to simultaneously press the corresponding R1 button 116a and × button 112c at a predetermined timing (a predetermined range).

As the composite obstacle object, in addition to the composite obstacle object 602, various composite obstacle objects 604, 606, 608, and 6 as shown in FIG.
10, 612 can be generated (created).

(3) Further, in order to simplify the operation of the game, when the start button 40 is pressed while the start screen 300 is displayed, the name registration described with reference to FIGS. The processing (step S7) is not performed, and the game selection screen 306 shown in FIG.
May be displayed, and the name registration process may be omitted.

(4) Obstacle object 4
11, 412, 413, and 414, and a special movement can be added to the virtual load object 420. First, the moving speed of the virtual road object line drawing image 420Ib is suddenly changed by the setting of the game program, regardless of, for example, the music (song) element or the music element. it can. Second
In FIG. 25, for example, the obstacle object line drawing image 413Ib on the front side can be overtaken by the obstacle object 412Ib on the rear side at a high speed. Third, in FIG. 40, as shown in a three-dimensional line drawing image 622 in a screen 620 of the display unit 18A, an obstacle object line drawing image 602Iia,
602Iib may be displayed so as to rotate rightward and / or leftward about virtual load object line drawing image 420Ii while moving in the direction of arrow E.

[0253]

As described above, according to the present invention, a new line drawing image can be displayed on a monitor screen or the like.

According to the present invention, a line drawing image of a character object is generated on a substantially linear line drawing image with a non-linear line drawing image portion based on an audio signal analysis result. A new line drawing image can be displayed on a monitor screen or the like.

Further, according to the present invention, a fluctuating line drawing image can be displayed on the monitor screen.

As described above, the game for displaying the line drawing image on the screen has a subtle feeling, and may be applicable to a wide range of ages from a low age group to a high age group.

In this case, by using a line drawing image as a three-dimensional line drawing image, it is possible to provide a game related to music that does not get tired and has high entertainment properties.

[Brief description of the drawings]

FIG. 1 is a perspective view showing a configuration of an entertainment system to which an embodiment of the present invention is applied.

FIG. 2 is a perspective view showing an operation device.

FIG. 3 is a block diagram showing a circuit configuration of the entertainment system.

FIG. 4 is a block diagram illustrating a circuit configuration of the operating device.

FIG. 5 is a flowchart provided to explain the overall operation of the entertainment system;

FIG. 6 is an explanatory diagram showing a game start screen.

FIG. 7 is an explanatory diagram showing a name registration screen.

FIG. 8 is an explanatory diagram showing a name registration screen.

FIG. 9 is an explanatory diagram showing a game selection screen.

FIG. 10 is an explanatory diagram showing a game selection screen.

FIG. 11 is a flowchart showing details of a game process.

FIG. 12 is an explanatory diagram of a character object.

FIG. 13 is an explanatory diagram of an obstacle object.

FIG. 14 is an explanatory diagram of a virtual load object.

FIG. 15 is an explanatory diagram illustrating a configuration example of an object.

FIG. 16 is an explanatory diagram of an operation button obstacle object correspondence table.

FIG. 17 is a flowchart provided to describe an audio signal analysis process;

FIG. 18 is an explanatory diagram of a correspondence table between an audio signal analysis result and an obstacle object to be generated.

FIG. 19 is an explanatory diagram of a correspondence table between an audio signal analysis result and an obstacle object to be generated;

FIG. 20 is a flowchart illustrating a line drawing display update process;

FIG. 21 is an explanatory diagram of a frame buffer.

FIG. 22 is a diagram provided for describing generation of a three-dimensional linear line drawing.

FIG. 23 is an explanatory diagram showing a screen immediately after a game is started.

FIG. 24 is a diagram provided for describing fluctuation processing.

FIG. 25 is an explanatory diagram showing a screen several seconds after the game starts.

FIG. 26 is an explanatory diagram showing a screen on which a character object passes over an obstacle object.

FIG. 27 is an explanatory diagram showing a screen on which a character object rotates on an obstacle object.

FIG. 28 is an explanatory diagram showing a screen on which a character object straddles an obstacle object.

FIG. 29 is an explanatory diagram showing a screen on which a character object rotates inside an obstacle object.

FIG. 30 is an explanatory diagram showing a screen immediately after a character object has failed to get over an obstacle object.

FIG. 31 is an explanatory diagram showing a screen when a time of about one second or more has passed after a character object failed to get over an obstacle object.

FIG. 32 is an explanatory diagram showing a character state table.

FIG. 33 is an explanatory diagram showing a game ending possible screen.

FIG. 34 is an explanatory diagram showing a game ending possible screen.

FIG. 35 is an explanatory diagram showing a clear screen.

FIG. 36 is a block diagram illustrating image processing / audio processing functions.

FIG. 37 is an explanatory diagram of an operation button obstacle correspondence table of another example.

FIG. 38 is a diagram which is used for describing creation of an obstacle object in another example.

FIG. 39 is an explanatory diagram of an obstacle object of another example.

FIG. 40 is an explanatory diagram showing a screen when an obstacle object rotates around a virtual load.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 10 ... Entertainment system 12 ... Entertainment device 16 ... Operating device 18 ... Monitor 20 ... Optical disk (recording medium) 263 ... Frame buffer 401, 402, 403 ... Character object 411, 412, 413, 414 ... Obstacle object 415, 415a, 415b ... Basic object 420... Virtual load object 428, 429... Correspondence table between audio signal analysis result and fault object to be generated 502. Audio signal analysis means 504. Audio signal division means 506 ... Sampling means 508. … Peak value detecting means 512… order determining means 514… non-linear object deciding means (obstacle object deciding means) 516… non-linear line drawing image generating means 5 18 ... Linear line image generating means 520 ... Character object line image generating means 522 ... Operation monitoring means 524 ... Character object line image change determining means 526 ... Moving imparting means 528 ... Fluctuating amount determining means 530 ... Fluctuating imparting means 532 ... Synthesizing means 534 ... Drawing means 536 ... Display control means

Claims (18)

[Claims] 1. A line drawing image generating means for generating a line drawing image composed of line drawing image fragments, a fluctuation applying means for fluctuating each of the line drawing image fragments constituting the line drawing image, and a line drawing image fragment having the fluctuation An image processing apparatus comprising: a drawing unit that draws in a storage unit. 2. An image processing apparatus according to claim 1, wherein said line drawing image is a three-dimensional line drawing image. 3. The image processing apparatus according to claim 2, wherein said fluctuation applying means converts the fluctuation given to each of said line drawing image pieces to each of said polygons constituting said line drawing image piece object arranged in a three-dimensional space. An image processing apparatus characterized in that a vertex is generated by adding a random number. 4. The image processing apparatus according to claim 3, wherein the three-dimensional line drawing image drawn by the drawing means on the storage means extends substantially from one end side to the other end side in the horizontal direction on the display screen. An image processing apparatus characterized in that the image processing apparatus is an image composed of line drawing image pieces to which linear fluctuations are given. 5. The image processing apparatus according to claim 4, wherein the non-linear line image with the fluctuation is inserted in a part of the substantially linear image composed of the line image pieces with the fluctuation. An image processing apparatus characterized by the above-mentioned. 6. A line drawing image generating step for generating a line drawing image composed of line drawing image fragments, a fluctuation giving step for giving a fluctuation to each line drawing image piece constituting the line drawing image, A drawing step of drawing in a storage means. 7. The image processing method according to claim 6, wherein the line drawing image is a three-dimensional line drawing image. 8. The image processing method according to claim 7, wherein the fluctuation imparting means converts the fluctuation applied to each of the line drawing image pieces to each of the polygons constituting the line drawing image piece object arranged in a three-dimensional space. An image processing method characterized in that a vertex is generated by adding a random number. 9. A line drawing image generating step for generating a line drawing image composed of line drawing image fragments, a fluctuation providing step for providing fluctuations to each line drawing image fragment constituting the line drawing image, and each of the line drawing image fragments provided with the fluctuation And a drawing step of drawing in a storage means. 10. The recording medium according to claim 9, wherein the line drawing image is a three-dimensional line drawing image. 11. The recording medium according to claim 10, wherein, in the fluctuation applying step, the fluctuation applied to each of the line drawing image pieces is set to a vertex of each polygon constituting the line drawing image piece object arranged in a three-dimensional space. A recording medium characterized by generating by adding a random number. 12. The recording medium according to claim 11, wherein said image is drawn on said storage means by said drawing step.
A recording medium, wherein the two-dimensional line drawing image is an image formed of a line drawing image piece provided with a substantially linear fluctuation extending substantially from one end side to the other end side in the horizontal direction on the display screen. 13. A recording medium according to claim 12, wherein a non-linear line drawing image provided with the fluctuation is inserted in a part of the substantially linear image formed of the line drawing image pieces provided with the fluctuation. Recording medium characterized by the above-mentioned. 14. A line drawing image generating step for generating a line drawing image composed of line drawing image fragments, a fluctuation providing step for providing fluctuations to each line drawing image fragment constituting the line drawing image, and each line drawing image fragment provided with fluctuations And a drawing step of drawing in a storage means. 15. The program according to claim 14, wherein the line drawing image is a three-dimensional line drawing image. 16. The program according to claim 15, wherein, in the fluctuation applying step, a fluctuation given to each of the line drawing image pieces is a random number at a vertex of each polygon constituting the line drawing image piece object arranged in a three-dimensional space. A program characterized by generating the following. 17. The program according to claim 16, wherein the drawing step is performed on the storage means by the drawing step.
The program is characterized in that the two-dimensional line drawing image is an image including a line drawing image piece provided with a substantially linear fluctuation extending substantially from one end side to the other end side in the horizontal direction on the display screen. 18. The program according to claim 17, wherein the non-linear line drawing image provided with the fluctuation is inserted into a part of the substantially linear image composed of the line drawing image pieces provided with the fluctuation. Features program.