JP2002066132A - Entertainment system, entertainment unit, recording medium, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable a player to arbitrarily generate music according to timing of operation input by the player and further to combine animations corresponding to the kind of the operation input to make the first scene thus to give a player pleasure of composing music and making an image of one scene. SOLUTION: A frame object 204 moved matching a prescribed tempo is displayed on the screen 200 of a monitor to make a player trially fit plural kinds of objects 202 into the frame object 204. Plural kinds of animations 206 corresponding to the block objects 202 fit into the frame object 204 are combined with plural kinds of animations 26 corresponding to the block object 202 fit into the frame object 202 to make an image of one scene. Further, arbitrary sound is outputted when the block object 202 is fit into the frame block object 204.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an entertainment system connected to an entertainment device for executing various programs and having at least one operating device for inputting an operation request from a user to the entertainment device, and an operating device and a display device. The present invention relates to an entertainment device that can be connected, a recording medium on which programs and data used in the entertainment system and the entertainment device are recorded, and the program itself.

[0002]

2. Description of the Related Art As an information device (entertainment system) such as an entertainment device including a video game machine, for example, a game content stored in a recording medium such as a CD-ROM is displayed on a screen of a television receiver. There are devices that operate the operation device to advance the game.

In the entertainment system, the entertainment device and the operating device are usually connected by a serial interface. When a clock is sent from the entertainment device, the operating device responds to a user's operation in synchronization with the clock. Key switch information and the like are sent.

Further, recently, a vibration generating means for giving a vibration to a user in response to a request from the outside (for example, an entertainment device) is provided in the operating device so that the device responds to the user's operation during a game, for example. As a result, a system for giving various vibrations to a user has been developed and has been put to practical use.

[0005]

By the way, as a music video game using the above-mentioned entertainment system, of the buttons arranged on the operation device, the designated button displayed on the display device is adjusted to the rhythm. There are video games in which the user pushes the button or enjoys stepping on a button arranged on a controller on a plane laid on the floor in rhythm.

[0006] In these games, it is determined whether or not a designated button has been operated at a predetermined timing to determine a win or loss. Therefore, the player has a strong sense of playing sports rather than music. Lack of fun.

[0007] When riding on the rhythm of music, it is said that the user's interest can be sustained by pressing an arbitrary button according to the rhythm as he / she likes with free ideas, rather than pressing a forcibly designated button. It is effective and interesting.

Further, an arbitrary sound is generated in accordance with the timing of the operation input by the user, and the moving images are combined in accordance with the type of the operation input so that an image of one scene is finally created. Then, the pleasure of creating one music and the pleasure of creating a video of one scene can be enjoyed at the same time, and the interest in the video game can be maintained.

The present invention has been made in view of such a problem. An arbitrary sound is generated in accordance with the timing of an operation input by a user, and a moving image is combined in accordance with the type of the operation input. An entertainment system, an entertainment apparatus, a recording medium, and a storage medium capable of finally creating a video of one scene and simultaneously enjoying a pleasure of creating one music and a pleasure of creating a video of one scene. The purpose is to provide the program.

[0010]

An entertainment system according to the present invention comprises: an entertainment device for executing various programs; at least one operating device for inputting a user's operation request to the entertainment device; and an output from the entertainment device. In an entertainment system having a display device that displays the image, a frame that moves in accordance with a predetermined tempo is displayed on the display device, and a user is caused to try to fit a plurality of types of objects into the frame. The image processing apparatus further includes a video creating unit that creates a video of one scene by combining a plurality of types of moving image data corresponding to the objects fitted in the frame.

The entertainment device according to the present invention can be connected to an operation device for receiving an operation request from a user and a display device for displaying an image, and
In an entertainment device that executes various programs, a frame that moves in accordance with a predetermined tempo is displayed on the display device, and a user tries to fit a plurality of types of objects into the frame, and the user fits the frame. It is characterized by having video creating means for creating a video of one scene by combining a plurality of types of moving image data corresponding to objects.

Further, a recording medium according to the present invention includes an entertainment device for executing various programs, at least one operating device for inputting an operation request from a user to the entertainment device, and an image output from the entertainment device. On a recording medium on which a program or data used in an entertainment system having a display device for displaying is recorded, a frame that moves in accordance with a predetermined tempo is displayed on the display device, and a user is provided with a plurality of frames for the frame. The method is characterized in that it has a video creating step of trying to fit an object of a type and combining a plurality of types of moving image data corresponding to the object fitted in the frame to create a video of one scene.

[0013] The program according to the present invention displays an entertainment device for executing various programs, at least one operating device for inputting an operation request from a user to the entertainment device, and an image output from the entertainment device. In a computer-readable and executable program used in an entertainment system having a display device that performs a display, the display device displays a frame that moves in accordance with a predetermined tempo, and the user is provided with a plurality of types of the frame. And a video creating step of creating a video of one scene by combining a plurality of types of moving image data corresponding to the object fitted in the frame.

Thus, each time a plurality of types of objects are fitted in the frame, a plurality of types of moving image data corresponding to the objects fitted in the frame are combined,
An image of one scene is created.

In this case, instead of forcibly pressing a designated button, moving images are combined by pressing an arbitrary button according to a rhythm freely according to a free idea. , And the user can enjoy a video game that combines music and video, in which a video of one scene is created while riding on the rhythm of music.

And the image creating means (step)
A moving image reading means (step) for reading moving image data corresponding to the object fitted into the frame from a plurality of types of moving image data; and a moving image display means (step) for sequentially displaying the read moving image data. May be provided.

Further, the image creating means (step) comprises:
A noise image drawing means (step) for displaying a noise image for a predetermined time when the user fails to insert the object may be provided.

Further, the image creating means (step) comprises:
Replay means (step) for storing information relating to the fitting of an object by the user in order and replaying a video of one scene based on the stored information;
May be provided.

Further, the image creating means (step) includes:
Object drawing means (step) for performing continuous display of throwing and falling of the object on the display device
And a fitting state processing means (step) for determining whether or not the user has fitted the object into the frame by detecting a timing of an operation input when the object falls into the frame. You may.

Further, the image creating means (step) includes:
A sound processing unit (step) for outputting an arbitrary sound when the object is fitted into the frame may be provided. In this case, the continuous movement from the throwing up of the object to the dropping thereof serves as a kind of metronome, and the user fits the object into the frame by operating any button while watching the continuous movement.
An arbitrary sound is output, and one music is completed by the output sound and BGM each time the object is fitted in the frame.

In this case, instead of forcibly pressing a designated button, an arbitrary sound is output by pressing an arbitrary button according to a rhythm freely according to a free idea. The user's interest in the video game is maintained, and the user can enjoy the music video game in the sense of riding the music rhythm.

The object drawing means (step) may change the shape of the object according to the type of operation input when fitting the object into the frame. Further, the video creating means (step) may include a frame drawing means (step) for moving the frame in one direction in accordance with a predetermined tempo.

Further, the image creating means (step) comprises:
Frame drawing means (step) for moving the frame in one direction in accordance with a predetermined tempo, and changing the shape of the object according to the type of operation input when fitting the object into the frame; In addition, an object drawing means (step) for throwing up and displaying the object so as to have a flight time corresponding to the shape and the predetermined tempo may be provided.

In this case, the acquisition-side object moves in one direction in accordance with a predetermined tempo, and further, the object is thrown up and falls during a flight time corresponding to the shape and the predetermined tempo. Therefore, it is possible to realize a video game in which the frame moves in accordance with the tempo of BGM (background music) and an arbitrary sound is generated when the thrown object is fitted into the frame.

In this video game, the length of the sound changes, such as a quarter note or an eighth note, depending on the shape of the object, and the timing at which an operation input is to be made can be changed thereafter. That is, a simple input timing or a complicated input timing can be arbitrarily selected depending on the type of operation input, and the rhythm of the completed music can be diversified.

The image creating means (step) comprises:
A score drawing means (step) for displaying a score calculated according to a combination of various shapes at the time of acquiring the object may be provided. In this case, the timing of the operation input changes depending on the type of the operation input, and the rhythm also changes at the same time.
For example, by setting so as to increase the score, the user can challenge a more complicated rhythm, and the video game described above can have a sporty aspect.

The present invention also provides a display device that displays a frame that moves in accordance with a predetermined tempo, and allows a user to try to fit a plurality of types of objects into the frame.
An audio processing unit (step) for creating and reproducing a series of music by combining a plurality of types of audio information corresponding to the object fitted in the frame may be provided.
In this case, various voice changes and rhythm variations can be enjoyed.

[0028]

BEST MODE FOR CARRYING OUT THE INVENTION An embodiment in which an entertainment system and an entertainment apparatus according to the present invention are applied to a video game apparatus, and a recording medium and a program according to the present invention which execute a program and data executed by the video game apparatus. An embodiment applied to a recorded recording medium and a program will be described with reference to FIGS.

First, the entertainment system 10 according to the present embodiment is basically configured as shown in FIG.
Entertainment device 1 for executing various programs
2, a memory card 14 detachable from the entertainment device 12, an operation device (controller) 16 detachable from the entertainment device 12 by a connector 62, and video / audio from the entertainment device 12. A monitor (display) 18 which is a display device such as a television receiver to which a signal is supplied is provided.

The entertainment device 12 includes, for example,
This is for reading a program recorded on a large-capacity storage medium such as an optical disk 20 such as a CD-ROM and executing a game or the like in response to an instruction from a user (user: a game player or the like). The execution of the game mainly means that an input from the operation device 16 is transmitted to the connector 6.
2 to control the progress of the game while controlling the display and sound on the monitor 18.

The entertainment apparatus 12 has a substantially flat rectangular parallelepiped shape, and has a disk mounting section 2 in the center of which an optical disk 20 storing application programs and data for a video game or the like is mounted.
2, a reset switch 24 for arbitrarily resetting the currently running program, a disk operation switch 26 for operating the mounting of the optical disk 20, a power switch 28, and two slot units 30, 32, for example. It is provided with.

The recording medium for supplying the application program is not limited to the optical disk 20, but the application program may be supplied via a communication line.

The slot portions 30 and 32 are respectively composed of upper slot portions 30B and 32B and lower slot portions 30A and 30B.
32A, and the lower slot portions 30A, 32A.
A can be connected to the operation device 16 respectively.
A memory card 14 capable of storing a flag indicating an intermediate state of a game or the like and a portable information terminal (not shown) functioning also as the memory card 14 are mounted in the upper slot portions 30B and 32B, respectively. You can do it. The slot 30 (30A, 30A)
B) and 32 (32A, 32B) have asymmetric shapes to avoid erroneous insertion.

As shown in FIGS. 2 to 4, the operating device 16 includes first and second operating units 34 and 36 and an L button 3
Left and right joysticks 44 and 46 having 8L and R buttons 38R, a start button 40, and a selection button 42, and capable of analog operation, and a mode selection switch 48 for selecting an operation mode of these joysticks 44 and 46. And a display unit 50 for displaying the selected operation mode. The display unit 50 is configured by a light emitting element such as a light emitting diode.

As shown in FIG. 2, the operating device 16 has an operating device main body 104 in which an upper half 100 and a lower half 102 abut against each other and are connected using fixing means such as screws.

As shown in FIGS. 2 and 3, from one side of each end of the operation device main body 104, when this operation device 16 is connected to the entertainment device 12, for example, when searching for information or executing a game. Left and right grips 106 and 108 which are gripped so as to be included by the left and right palms are protrudingly provided.

The left and right grips 106 and 108 are
As shown in FIG. 3, the projections are spaced apart from each other toward the distal end and project downward toward the operation device main body 104.

As shown in FIG. 3, the left and right grip portions 106 and 108 are tapered from the connection portion side to the operating device main body 104 toward the distal end side, as shown in FIG. , The peripheral surface has an arc surface, and the tip side is formed in an arc shape.

FIG. 2 shows one end of the operating device main body 104.
As shown in FIG. 3, four operators 110 a to 110 d (an upward operator 110 a, a right operator 110 b, a lower operator 110 c, and a left operator 110 c) protruding from the upper surface side of the operating device main body 104. The first operation unit 34 in which the operation elements 110d) are arranged to be orthogonal to each other is provided.

The first operating section 34 includes four operating elements 11
Switch elements as signal input elements are provided corresponding to 0a to 110d, respectively. The first operation unit 34 functions as, for example, a direction instruction control unit that controls the movement of the display character, selectively presses the operation elements 110a to 110d, and turns on the switch elements corresponding to the operation elements 110a to 110d. By turning on / off, each operating element 110a on which a display character on the screen is pressed, for example.
Ｄ110d in the arrangement direction.

As shown in FIGS. 2 and 3, four operating elements 112a to 112d projecting from the upper surface of the operating device main body 104 are provided at the other end of the operating device main body 104.
Mark operator (△ button) 112a, □ mark operator (□ button) 112b, × mark operator (x button) 112c, and ○ mark operator (（button) 112
The second operation unit 36 in which d｝ is arranged to be orthogonal to each other
Are arranged.

These four operators 112a to 112d
Are formed as independent members, respectively.
Switch elements as signal input elements are provided corresponding to 2a to 112d.

The second operation unit 36 sets, for example, the functions of the display characters assigned to the respective operators 112a to 112d by turning on the switches corresponding to the four operators 112a to 112d, for example. Alternatively, it is used as a function setting execution unit that executes a function of the display character.

Also, the L button 38 is located at each of the left and right ends on the front side opposite to the rear side, which is one side where the left and right grips 106 and 108 of the operating device main body 104 protrude.
L and R buttons 38R are provided. 2 and 4
As shown in the figure, the L button 38L is
1 button) 114a and left second operator (L2 button)
The R button 38R includes a right first operator (R1 button) 116a and a right second operator (R2 button) 116b.

The L1 button 114a and L2 button 114b and the R1 button 116a and R2 button 11
6b is provided with a switch element corresponding to each operation element.

The L button 38L and the R button 38R are turned on by, for example, switches corresponding to the L1 button 114a and the L2 button 114b, and the R1 button 116a and the R2 button 116b, so that the L1 button 114a, the L2 button 114b, and the R1 button The function of the display character assigned to the button 116a and the R2 button 116b is set, or the function is used as a function setting execution unit that executes the function of the display character.

The operation device 16 is similar to that shown in FIGS.
As shown in the figure, the left and right analog operating units 118 and 12 are located at opposing positions of the corners on the side of the connecting unit to the operating device main body 104, which are the base ends of the left and right gripping units 106 and 108.
0 is provided.

The left and right analog operation units 118 and 1
Reference numeral 20 includes left and right joysticks 44 and 46 that can be tilted and rotated in a 360 ° direction about an operation axis, and signal input elements such as variable resistance elements operated by the left and right joysticks 44 and 46. That is, the left and right joysticks 44 and 46 are provided on the distal end side of the operation shaft mounted so as to return to the neutral position by the urging member, and are operated to rotate in a 360 ° direction about the rotation fulcrum of the operation shaft. .

The left and right analog operation units 118 and 1
20 is to perform analog motion such as moving the display character while rotating or moving while changing the speed, and further changing the form by rotating the left and right joysticks 44 and 46. It is used as an operation unit capable of inputting a command signal enabling the operation.

Then, the switching operation of the mode selection switch 48 causes, for example, the left and right analog operation sections 118.
And an operation mode in which the input of command signals from the analog operation units 118 and 120 is prohibited.

Each of the operating elements 112 of the second operating section 36 is operated by the switching operation of the mode selection switch 48.
The functions a to 112d and the functions of the L1 button 114a and the L2 button 114b of the L button 38L and the R button 38R, and the functions of the R1 button 116a and the R2 button 116b also change according to the operation mode associated with the switching. . The display unit 50 blinks according to the state of these operation modes, and further, the display light is switched.

As described above, the operating device 16 having the left and right grips 106 and 108 protruding from the operating device main body 104.
As shown in FIG. 4, the left and right grips 106 and 108
Is held in the palms of both hands Rf and Lf, thereby eliminating the need to support the operation device main body 104 with fingers, and a state in which at least six fingers and at least six fingers of both hands Rf and Lf can be freely moved. Can be gripped.

As shown in FIG. 4, for example, when the left and right grips 106 and 108 are gripped so as to be wrapped in the palms of both hands Rf and Lf, the thumbs Rf1 and Lf1 of the left and right hands Rf and Lf are respectively moved to the left and right. Analog operation unit 1
18 and 120 left and right joysticks 44 and 46
Upper, first to fourth pressing operators 110 of the first operating unit 34
a to 110d and the first to fourth pressing operators 112a to 112d of the second operation unit 36, these joysticks 44 and 46, and each pressing operator 110a to 110d.
110d and 112a-112d can be selectively pressed.

In particular, the left and right analog operation units 118 and 1
Each of the joysticks 44 and 46 of 20 is opposed to the base end side which is the connecting portion side of the left and right grip portions 106 and 108 gripped so as to be wrapped by the palms of both hands Rf and Lf to the operating device main body 104. Since they are arranged, when the left and right grips 106 and 108 are gripped by the left and right hands Rf and Lf, the thumb Rf of the left and right hands Rf and Lf
1 and Lf1. Therefore, the joysticks 44 and 46 are moved to the left and right hands Rf and L
The rotation operation can be easily performed by the thumb Rf1 and Lf1 of f.

Further, as shown in FIG.
When the hands 06 and 108 are grasped so as to be wrapped in the palms of both hands, the index fingers Rf2 and Lf2 and the middle fingers Rf3 and Lf3 of the left and right hands Rf and Lf are held at the R button 38R and the L button 38L by the R1 button 116a and the R2 button 116b and L1. Button 114a and L2 button 11
4b can be extended to a position where it can be selectively pressed.

Further, as shown in FIG.
6 includes two vibration applying mechanisms 12 for applying vibration to the user so that the game can be executed with a more realistic feeling.
8R and 128L are provided.

Each of the vibration applying mechanisms 128R and 128L
As shown in FIG. 5, the operation device 16 is disposed on the base end side of the left and right grip portions 106 and 108 which are gripped by fingers when gripping the operation device 16.

Typically, the right vibration applying mechanism 128R is
The drive motor 130R is driven by a vibration generation command supplied from the entertainment apparatus 12, and includes an eccentric member 134R attached to a drive shaft of the drive motor 130R. Left vibration applying mechanism 128
L also has a similar configuration.

Each of the eccentric members 134R and 134L is formed of a heavy metal member, is eccentrically attached to a fitting hole which is fitted to a drive shaft and serves as a center of rotation, and is formed as a semicircular weight. I have.

The vibration imparting mechanism 128 thus configured
The drive motors 130R and 130L are driven by the drive motors 130R and 130L, and the eccentric members 134R and 134L are rotated, so that the drive motors 130R and 130L vibrate, and the vibration is generated by the left grip 106 and the right grip 10.
The vibration is transmitted to the fingers holding the left grip 106 and the right grip 108.

Here, the vibration imparting mechanisms 128R and 128L disposed on the left and right grips 106 and 108, respectively.
Are configured to have different vibration characteristics.

For example, the drive motor 130L of the left vibration applying mechanism 128L is replaced with the right drive motor 130R.
The rotation speed changes according to the vibration value included in the vibration generation command transmitted from the entertainment device 12, and the frequency of the generated vibration changes according to the vibration value. . In this example,
The frequency of the vibration is set to increase in proportion to the vibration value.

On the other hand, the drive motor 130R of the right vibration imparting mechanism 128R "drives" or "stops" according to the logical value "1" or "0" of the vibration value included in the vibration generation command. Unlike the vibration applying mechanism 128L on the left side, either a certain vibration is performed or no vibration is performed.

As described above, in order to drive the drive motors 130R and 130L to vibrate the entire operation device 16, it is necessary to provide a bidirectional communication function between the operation device 16 and the entertainment device 12. Is required, and this function will be described later.

Next, the circuit configuration of the entertainment device 12 and the operation device 16 will be described with reference to FIGS.

First, as shown in FIG. 6, the entertainment apparatus 12 has a central processing unit (CPU: Central Processing Unit).
Processing Unit) 80 and a control system 82 composed of peripheral devices and the like, and an image processing device (G) that includes a frame buffer (not shown) and performs drawing in the frame buffer.
PU: Graphic Processing Unit (GPU), etc., a sound system 86, such as a sound processing unit (SPU: Sound Processing Unit) for generating musical sounds and sound effects, and an optical disk on which application programs and data are recorded An optical disk control unit 88 for performing read control of the device 20, a communication control unit 90 for performing input / output of data and the like with respect to the operating device 16 and the memory card 14, and a system bus 9 to which these units are connected
2 is provided.

In this case, the video signal and the audio signal output from the graphic system 84 and the sound system 86 constituting the entertainment apparatus 12 are transmitted to the monitor 18.
The video is displayed on the screen of the monitor 18 and the sound is output from the speaker 94 of the monitor 18.

On the other hand, as shown in FIG. 7, the operation device 16 includes a communication control unit 150, a CPU 152, a program memory 154, an operation RAM 156, a digital input block 158, an analog input block 160, a left motor driver 170L, and a left motor driver 170L. A driving motor 130L, a right motor driver 170R, and a right driving motor 130R are provided. These components are connected to a bus 162.

The digital input block 158 has, for example, a function as an input operation unit for each of the operators 110a to 110d and 112a to 112d constituting the first operation unit 34 and the second operation unit 36. And
The analog input block 160 has a function as an input operation unit for the left and right joysticks 44 and 46. Accordingly, the digital input block 158 and the analog input block 160 allow the user to input various information.

The communication control section 150 has a function of performing serial communication with an external device. The communication control unit 150 can be electrically connected to, for example, the communication control unit 90 (see FIG. 6) of the entertainment device 12, whereby the entertainment device 12
And data communication processing can be performed.

On the other hand, the bidirectional communication function between the entertainment device 12 and the operation device 16 is achieved by connecting a connector 62 for performing bidirectional serial communication with the operation device 16 to the entertainment device 12 as shown in FIG. It can be carried out.

The operation device 16 performs a bidirectional communication function by a serial I / O interface SIO for performing serial communication with the entertainment device 12 and a parallel I / O interface PIO for inputting operation data from a plurality of operation buttons. , A CPU, a RAM and a ROM, a one-chip microcomputer (hereinafter, referred to as a microcomputer), and motor drivers 170R and 170L for rotatingly driving the driving motors 130R and 130L of the vibration applying mechanisms 128R and 128L. The motors 130R and 130L are the corresponding motor drivers 1
It is driven to rotate by the supply voltage and current from 70R and 170L.

The entertainment device 12 has a structure in which a serial I / O interface SIO for performing serial communication between the operation devices 16 is provided. When a connector 62 of the operation device 16 is connected, the connector 62 is connected thereto. It is connected to the serial I / O interface SIO on the operation device 16 side, and has a configuration capable of performing bidirectional communication means, that is, bidirectional serial communication.
The other detailed configuration of the entertainment device 12 is omitted.

Signal lines and control lines for performing bidirectional serial communication are connected from the entertainment device 12 to the operation device 16.
Data transmission signal line TXD (Tr
ansmit X 'for Data), a data transmission signal line RXD (Received X' for Data) for transmitting data from the operation device 16 to the entertainment device 12, and data from the data transmission signal lines TXD and RXD. A signal line SCK (Serial Clock) for a serial synchronous clock to be extracted,
A control line DTR (Data Terminal Ready) for establishing and interrupting communication with the operating device 16 on the terminal side.
And a control line DSR (Data Set Ready) for flow control for transferring a large amount of data.

As shown in FIG. 7, the cable including the signal line and the control line for performing bidirectional serial communication includes an entertainment device 1 in addition to the signal line and the control line.
Power cable 172 directly taken from the power supply on the 2 side
The power cable 172 is connected to the motor drivers 170R and 17R on the operation devices 16A and 16B side.
0L, and supplies power for rotating each of the drive motors 130R and 130L.

The bidirectional serial communication procedure having such a configuration is performed in such a manner that, for example, the entertainment device 12 communicates with the operation device 16 and fetches operation data from the digital input block 158 and the analog input block 160. , The entertainment device 12 outputs the selected data to the control line DTR. As a result, the operating device 16 confirms that it has been selected by the control line DTR, and waits for reception of the subsequent signal line TXD. Subsequently, the entertainment device 12 sends an identification code indicating the operation device 16 to the data transmission signal line TXD. Thereby, the operating device 16 receives this identification code from the signal line TXD.

After the operation device 16 recognizes the identification code, the communication with the entertainment device 12 is started thereafter. That is, control data and the like are transmitted from the entertainment device 12 to the operation device 16 via a data transmission signal line TXD, and conversely, the operation device 16 transmits a digital input block 158 and an analog input block 16.
The operation data or the like operated at 0 is transmitted to the signal line R for data transmission.
It is transmitted to the entertainment device 12 via the XD. In this way, bidirectional serial communication is performed between the entertainment device 12 and the operation device 16, and this communication ends when the entertainment device 12 outputs the selection stop data through the control line DTR.

If the bidirectional serial communication function is provided as described above, the operation data of the digital input block 158 and the analog input block 160 from the operation device 16 can be mainly transmitted to the entertainment device 12. From the entertainment device 12 side, the drive motors 130R and 13R of the respective vibration imparting mechanisms 128R and 128L are transmitted via the data transmission signal line TXD.
Operation device 1 transmits a vibration generation command for rotating 0L.
6 can be sent out.

The vibration generation command for rotating each of the drive motors 130R and 130L includes a command preset by the optical disc 20 set in the entertainment device 12 and a command newly created by the entertainment device 12. For example, according to the operation target of the user playing the game, the entertainment device 12
Thus, feedback by vibration transmission for a certain period of time is performed on the operation device 16 itself.

Next, the characteristic functions of the entertainment system 10 according to this embodiment will be described with reference to FIG.
This will be described with reference to FIGS.

This function displays on the monitor 18 a frame object (hereinafter simply referred to as a frame object) that moves in accordance with a predetermined tempo, and allows the user to input a plurality of types of block objects (hereinafter referred to as frame objects) to the frame object. ,
(Hereinafter simply referred to as a block object), and a plurality of types of moving image data corresponding to the block object inserted into the frame object are combined to create an image of one scene.

Specifically, for example, as shown in FIG. 8, a screen object 200 on the monitor 18 has a block object 202 on which continuous operation of throwing and falling is performed, and a film of a movie, and moves in one direction. Frame object 20
4 and a moving image 206 corresponding to the type of the block object 202 fitted in the frame object 204 is displayed.

As shown in FIG. 9A, for example, the block object 202 has an initial velocity v at the throwing start position.
It is thrown up at ₀ , and reaches the highest point when the upward speed v _t becomes 0. Then, block object 2
02 is free fall and returns to the original position (throwing position) when the downward speed becomes the same as the initial speed v _0, and at this time, the user performs a predetermined operation input, and as shown in FIG. As shown, the block object 202 will fit into the frame object 204. When the block object 202 is stuck in the frame object 204, the block object 202 is thrown up again,
The same operation as described above will be performed.

If the block object 202 reaches the frame object 204 and does nothing, or if the timing of the operation input is shifted, the block object 202 falls as it is and cannot be seen from the screen.

When the block object 202 gets stuck in the frame object 204, it changes into a block of various forms according to the type of operation input by the user, and is thrown up again in the state of the changed block. Will be.

For example, as shown in FIG.
When the user operates the button 12a, it changes to one block 202a (hereinafter referred to as one set block), and the □ button 112b
Is changed to a block 202b in which two blocks are combined in the horizontal direction (hereinafter, referred to as two sets of blocks).

When the ボ タ ン button 112d is operated, a block 20 in which three blocks are connected in the horizontal direction is used.
When the button is changed to 2c (hereinafter, referred to as a three-set block) and the X button 112c is operated, the block is changed to a block 202d (hereinafter, referred to as a four-set block) in which four blocks are combined in the horizontal direction. At the initial stage, four sets of blocks 202d
Is thrown up.

The frame object 204 moves in one direction (for example, leftward) in accordance with the tempo of BGM (background music), and the block object 202 stores the shape of the block and the hang time corresponding to the tempo of the BGM. It is thrown up to become. Here, the hang time refers to the time from the time when the block object 202 is thrown up from the throwing position to the time when it falls again at the throwing position.

In this embodiment, the hang time of the block object 202 is set to the time during which the frame object 204 moves by the number of frames corresponding to the number of blocks of the block object 202. That is, the block object 202 is
In the case of a, the time required to move by one frame is the hang time, and the block object 202 is divided into two sets of blocks 202.
In the case of b, the time for moving by two frames is the hang time, and so on.

The adjustment of the flight time of the block object 202 can be derived from the following relational expression representing the vertical displacement y of the block object 202.

[0091] ^{_{y = v 0 t-gt 2}} /2 In other words, in the case of the block objects 202 is, for example, a set block 202a, in the time frame object 204 is moved by one frame in accordance with the tempo of the BGM, a set block For example, the initial velocity v ₀ and the gravitational acceleration g (the gravitational acceleration pseudo-defined in this function) are performed so that a series of operations of throwing up, reaching the highest point, and falling to the original position are performed. Is adjusted). The same applies to the two-set block 202b and the three-set block 202c.

[0092] This hang time can be replaced by the length of the sound. Specifically, the block object 202
When the length of eight frames (the length of one serial number) is one bar, the first set block 202a is an eighth note, the second set block 202b is a quarter note, and the third set block 202c is a dotted quarter. The note and the fourth block 202d are half notes.

For the moving image 206, for example, 8 frames
11A to 11C, a first bar in which a plurality of moving image data for the four-block set 202d are arranged for each scene, as shown in FIGS. 11A to 11C. Movie data file group 210 (FIG. 1)
1A), a second moving image data file group 212 in which a plurality of moving image data for three sets of blocks 202c are arranged (see FIG. 11B), and a third moving image in which a plurality of moving image data for two sets of blocks 202b are arranged. Data file group 214
(See FIG. 11C). Each of the moving image data file groups 210, 212, and 214 has three types of moving image data files (210a, 210b, 210c) and (212a) corresponding to three phrases that constitute one scene. ,
212b, 212c) and (214a, 214b, 21)
4c) is prepared.

Here, the setting of the moving picture data corresponding to one phrase is, for example, for four sets of blocks 202d, three kinds of moving picture data for the flight time of the four sets of blocks 202d are prepared, and for the three sets of blocks 202c, for example. ,
For example, four types of moving image data for the hang time of the three sets of blocks 202c are prepared, and for the two sets of blocks 202b, for example, six types of moving image data for the hang times of the two sets of blocks 202b are prepared.

These moving image data are 3D image moving image data created by changing the viewpoint of the camera according to the type.

Each time, for example, four blocks 202d are selected by an operation input by the user, for example, three types of moving image data stored in the moving image data file 210a are sequentially output and displayed.
Each time the set block 202c is selected, for example, four types of moving image data stored in the moving image data file 212a are output and displayed in order, and the same applies to the two set block 202b.

The user sets one block 2 by operation input.
When 02a is selected, the next type of moving image data of the moving image data corresponding to the block selected last time is displayed for the time of hang of the one set block 202a, that is, only the viewpoint of the camera changes. It is.

When this function is realized as a video game, the fitting state of the block object 202 to the frame object 204 is stepwisely changed according to the timing of the operation input by the user when the block object 202 falls on the frame object 204. Is preferably displayed.

Specifically, the block object 202
If there is just an operation input at the time when the object has fallen on the frame object 204, as shown in FIG. 12A, the center line of the frame object 204 (not shown) and the center line of the block object 202 (not shown) Are displayed so that the block object 202 is inserted into the frame object 204 so that the values substantially coincide with each other. When the operation input is slightly delayed, as shown in FIG. As the center line of the block object 202 is located slightly below,
The state where the block object 202 is inserted into the frame object 204 is displayed.

When the operation input is slightly earlier, the block object 202 is moved so that the center line of the block object 202 is located slightly above the center line of the frame object 204 as shown in FIG. 12C. The display of the state inserted into the frame object 204 is performed.

Further, an arbitrary sound may be output when the block object 202 is inserted into the frame object 204. As a result, the sound of, for example, one percussion instrument is output in accordance with the operation input, and it is possible to add the fun that one music is completed by the fusion of the BGM and the sound of this percussion instrument.

Further, the block shape of the block object 202 may be selected by the user's arbitrary operation input. However, the block shape is designated periodically or temporarily, and the designated block shape is designated. (Hereinafter, referred to as a task block) may be determined. This allows
Sporty elements can also be added.

For example, eight frames are defined as one measure, and four measures are defined as one measure.
When the phrase is used, the assignment block 220 is designated at the last part of the four measures as shown in FIG. In the example of FIG. 13, two blocks 202b are used as the assignment block 220.
Shows an example in which is specified.

Then, by selecting a block corresponding to the task block 220 specified in the last part of the four measures by operation input, the next phrase is selected, and a block corresponding to the task block 220 is selected. If not, the scenario may return to the beginning of the current phrase. In this case, if a setting is made such that one scene is completed (cleared) when a certain number of phrases are completed within a predetermined time, the game characteristics can be further enhanced.

As an example of returning to the beginning of the current phrase, in addition to the case where the block corresponding to the above-mentioned task block 220 has not been selected, the block object 202 has fallen from the frame object 204 in each bar. In some cases, the specified eight block objects 202 cannot be inserted into one measure.

Eight block objects 20 per bar
For example, as shown in FIG. 14A, a case where two four-blocks 202d are inserted, as shown in FIG.
As shown in FIG. 4B, when two three-block sets 202c and two two-block sets 202b are inserted, or in FIG.
As shown in FIG. C, there are various patterns such as a case where two sets of two sets of blocks 202b are inserted and four sets of one set of blocks 202a are inserted.

On the other hand, as shown in FIG. 14D, for example, one four-set block 202d and one two-set block 202b
In addition, when one three-set block 202c is inserted, the total number of blocks becomes nine, and one block protrudes. In other words, it does not mean that the specified eight blocks have been inserted into one measure, and in this case, the result is NG.

When inserting a block into one measure,
There is difficulty in the insertion pattern. For example, as shown in FIG. 14B, two 3-block blocks 202c and one 2-block block 202b are inserted, as shown in FIG. 14B, or as shown in FIG. 14C. As shown in FIG.
It is more difficult to insert two and one set of blocks 202a.

Therefore, in the present embodiment, for example, an insertion pattern for each bar is inspected, a score is calculated based on the degree of difficulty according to the insertion pattern, and the score is displayed by a bar or an index. In the example of FIG. 8, an example is shown in which the current score is displayed by the index 232 that moves up and down the score scale 230.

Here, for example, when a one-week television program is created as a video game scenario, the user himself becomes a director or a director and takes charge of a program frame of one scene a day. Assume a scenario of a simulated experience of creating a television program in which a video created by the user is incorporated.

[0111] In this case, the user
4. Insert block objects 202 one after another into
A user-specific one-scene video (combination of moving images) is created, and the created one-scene video is incorporated into a designated program frame. This process is performed for seven scenes, and a one-week program is created and broadcast. This broadcast scene is shown in Fig. 1.
As shown in FIG. 5, only the created combination of moving images is displayed on the monitor 18 as an image.

[0112] In a simulated flow of time flowing in a video game, images created by the user are sequentially broadcast, and in the process, the audience rating is calculated. The audience rating is calculated based on the quality of the video and the score at the time of creation. When the audience rating falls below a predetermined value (for example, 10%), the program is terminated and the game is over, and the audience rating of 10% or more is obtained. Is maintained, it is possible to take a form of moving to program creation for the next week.

The quality of the video, which is one factor that determines the audience rating, is changed according to the state of the block object 202 being inserted into the frame object 204 (insertion state) and the time required to complete one scene. Can be.

For example, when the fitting of the block object 202 into the frame object 204 fails (operation input mistake), the noise image data is replaced with the noise image data during the period from the failure point to the beginning of the phrase in question. The quality of the image is degraded by displaying the output. As shown in FIG. 16, as the creation time of one scene approaches the time limit, for example, vertical streak noise 240
To cause poor quality.

Therefore, in order to obtain a high audience rating, the user needs to select the frame object 20 of the block object 202.
4 can be completed quickly without fail, and a complicated insertion pattern of the block object 202 (such as the two-set block 202b or the three-set block 20).
It is necessary to complete one scene with an insertion pattern that makes full use of 2c).

By setting a scenario as described above, the block object 20
Various factors can be incorporated into a simple game of fitting 2, and the user can enjoy an unprecedented video game in which a one-week program is produced while increasing the audience rating.

Next, software (video creating means 300) for realizing the above functions will be described with reference to FIGS.
This will be described with reference to FIG.

The image creating means 300 is, for example, a CD-ROM.
It is provided to the entertainment system 10 via a randomly accessible recording medium such as a ROM or a memory card 14 or a network. Here, an optical disk 20 such as a CD-ROM is used.
The description will proceed on the assumption that the device is operated by being read from the entertainment device 12.

That is, the video creating means 300 is downloaded from a specific optical disc 20 which is reproduced by the entertainment apparatus 12 in advance to the main memory in the control system 82 of the entertainment apparatus 12 through a predetermined process. 82 CP
It is designed to operate on U80.

As shown in FIG. 17, the video creating means 300 displays the block object 202 on the monitor 18,
A display processing unit 302 for displaying the frame object 204, the moving image 206, etc., an audio processing unit 304 for outputting predetermined audio data to the speaker 94 in accordance with BGM or an operation input by a user, a display processing unit 302 and an audio processing unit 3
Instruction control means 30 for performing various instructions and controls on
6 and replay processing means 308 for replaying the created combination of moving images and audio.

The instruction control means 306 controls the task block 22
A task block processing unit 310 for performing a process related to 0;
A block throwing instruction unit 312 for instructing the type of the block object 202 to be thrown, and an operation input processing unit 31 for performing a process corresponding to an operation input from the operation device 16
4 and the frame object 2 of the block object 202
It has an inset state processing unit 316 for calculating or determining the state of inset into the block 04, and a score calculating unit 318 for calculating a score from the insertion pattern of the block object 202 in units of measures.

As shown in FIG. 18, the display processing means 302 comprises: an object drawing means 322 for drawing 3D image data of the block object 202 (in this case, a designated block) in the image memory 320 of the graphic system 84; Frame drawing means 324 for drawing 3D image data of the object 204 in the image memory 320, index drawing means 326 for drawing 3D image data of the index 232 in the image memory 320 based on the score data, and the frame object 204 Block object 20
Moving picture drawing means 3 for drawing moving picture data according to two types
28, a noise image drawing means 330 for drawing a noise image when an operation input has failed, an image memory 320
And image display means 332 for displaying the 3D image data drawn on the monitor 18 on the monitor 18.

As shown in FIG. 17, the sound processing means 304 outputs a BGM designated by the speaker 94 to the BGM.
It has an output unit 340 and an audio data output unit 342 that outputs audio data to the speaker 94 at the timing of operation input.

The replay processing means 308 includes a display replay means 350 for sequentially displaying the created combination of moving images on the monitor 18 and a BGM output when the combination of moving images is created.
And audio replay means 352 for replaying audio data.

Next, the respective processing operations of the instruction control means 306, the display processing means 302, the audio processing means 304 and the replay processing means 308 constituting the video creating means 300 will be described with reference to the functional block diagrams of FIGS. ~ Fig. 25
This will be described with reference to the flowchart of FIG.

First, in step S1 of FIG. 19, the instruction control means 306 stores an initial value "0" in an index register m used for updating a scene (scene).
The index register m is initialized.

Next, at step S2, the m-th event image is displayed on the monitor 18. The event image includes, for example, a description of a scene to be tried and a description of an operation.

Next, in step S3, the display processing means 302 is activated, and in the next step S4, the sound processing means 304 is activated. These instruction control means 306,
The display processing means 302 and the audio processing means 304 operate in a multi-task system.

Next, in step S5, the initial value "0" is stored in the index register k used for updating the phrase, and the index register k is initialized.

Next, in step S6, the index register i used for updating the bar and the subject block 2
The initial value “0” is stored in each of the index registers n used for the appearance timing M of 20 to initialize the index registers i and n.

Next, in step S7, information of the task block 220 (information of the first set block 202a, the second set block 202b, etc.) of the phrase is read through the task block processing means 310.

Next, in step S8, the appearance timing M of the task block 220 is calculated based on the read information of the task block 220. This calculation is
For example, assuming that the task block 220 appears at the end of four measures, M = 4 (measures) × 8 (blocks) −
It can be obtained by X (the number of task blocks). Here, X indicates the number (the number of blocks) based on the type of the assignment block 220, “1” for the one set block 202 a, “2” for the two set block 202 b, 3
"3" in the case of the set block 202c, and 4 set blocks 20
In the case of 2d, it is "4".

Next, in step S9, an initial value "0" is stored in the index register j used for updating the obtained block object 202, and the index register j is initialized.

Next, in step S10, the four-block 202d
To launch In accordance with this instruction, the display processing means 302 performs a display in which the four-group block 202d is thrown upward. The processing in the display processing means 302 will be described later.

Next, in step S11, it is determined whether or not there is an operation input from the operation device 16 through the operation input processing means 314. If there is no operation input, the process proceeds to step S12, and it is determined whether the time is over. This time is the time from when the block object 202 is thrown up to when the block object 202 falls and disappears from the screen. If the time is not over, the operation input is discriminated again in step S11.

Then, when there is an operation input, the process proceeds to the next step S13, and the fitting state is calculated through the fitting state processing means 316. This calculation method includes time calculation and address calculation.

The time calculation is performed by using the block object 202.
When the time from the time when the block object 202 is thrown to the time when the block object 202 is inserted into a position substantially matching the frame of the frame object 204 (see FIG. This is a method of comparing the time up to a certain point with the specified time.

In the address calculation, when an address (especially a row address) of a typical vertex of the frame object 204 on the screen is defined as a specified address, a typical vertex of the block object 202 on the screen at the time of operation input is specified. Is compared with the specified address (particularly, the row address).

Next, in step S14, it is determined whether or not the result of the comparison is within an allowable range. If the comparison result is within the allowable range, step S16 in FIG.
Proceed to.

On the other hand, if it is determined in step S14 of FIG. 19 that the time is out of the allowable range, or if it is determined in step S12 that the time is over, the flow advances to step S15 to issue a redo instruction. It returns to S6. In response to the redo instruction in step S15, the frame object 204 returns to the first part of the current phrase and the BGM also returns to the beginning and is output.

In step S11, when an operation is input, audio data is output through the audio processing means 304, and a sound of, for example, a percussion instrument matching the BGM tempo is output from the speaker 94. .

Here, the processing in the audio processing means 304 will be described with reference to the flowchart of FIG.

The audio processing means 304 first
In step S101, it is determined whether or not an instruction to start over has been issued from the instruction control means 306. If there is an instruction to start over, the process proceeds to the next step S102, and a noise sound is output to the speaker 94.

Next, in step S103, it is determined whether or not a predetermined time (time required to return to the first part of the phrase) has elapsed. If the predetermined time has not elapsed, the process returns to step S102, and the output of the noise sound is continued.

When the predetermined time has elapsed, the process proceeds to the next step S 104, where BGM information relating to the current phrase is read out via the BGM output means 340. Then
In step S105, the audio data output unit 342
, The information of the audio data output when the block object 202 is fitted is read out.

Next, in step S106, the BGM
The output of the BGM corresponding to the read BGM information is started through the output unit 340. At this stage, the BGM corresponding to the phrase is continuously output from the speaker 94.

Next, in step S107, it is determined whether or not an operation input has been made. This determination is made based on whether or not an interruption based on an operation input from the instruction control unit 306 has occurred.

If there is an operation input, the next step S1
In step 08, the read audio data is output to the speaker 94 through the audio data output unit 342. When it is determined that the operation in step S108 has been completed or in step S107 that no operation input has been made, the process proceeds to the next step S109, where it is determined whether the phrase has changed. This determination is made based on the information on the phrase from the instruction control unit 306.

If the phrase has not changed, the flow returns to step S107, and the processing from step S107 is repeated. Then, when the phrase is changed, the process proceeds to the next step S110, and this time,
Then, it is determined whether or not there is a program end request (game over, power off, etc.) for No. 4. If there is no program end request, the process returns to step S101 to perform the processing for the next phrase. At the stage where the program end request is made, the processing by the voice processing means 304 ends.

Returning to the main routine of FIG. 20, in the next step S16, it is determined whether or not an instruction for the task block 220 has been issued through the task block processing means 310. The instruction of the assignment block 220 is performed in step S23 described later. When there is an instruction for the assignment block 220, it is determined whether or not a specified block corresponding to the assignment block 220 has been selected by an operation input. If it is a specified block, the process proceeds to step S18, and if it is not a specified block, the process returns to step S6 via a redo instruction of step S15 in FIG.

In step S18 of FIG. 20, the number (block number A) based on the type of block selected by the operation input is accumulated in the value of the index register j. Then, in step S19, the block number A is calculated. It accumulates to the value of the index register n.

Next, in step S20, whether or not the fitting of the block object 202 for one measure has been completed is determined through the fitting state processing means 316. This determination is made based on whether the value of the index register j is 8 or more.

If the fitting of one measure has not been completed, the process proceeds to step S21, and the block throwing instruction means 3
Through 12, the user instructs to throw the block object 202 corresponding to the operation input. In response to this instruction, the display processing unit 302 throws up one set of blocks 202a when the △ button 112a is operated, throws up two sets of blocks 202b when the □ button 112b is operated, and When the three-set block 202c is thrown up and the X button 112c is operated, a display in which the four-set block 202d is thrown up is performed.

Here, the processing in the display processing means 302 will be described with reference to the flowchart in FIG.

The display processing means 302 first
In step S201 of FIG.
Wait for the release instruction of 02. When instructed,
Proceeding to the next step S202, necessary parameters are received. The parameters include information such as the type of the block object 202 to be thrown (the distinction between the first set block 202a and the second set block 202b, etc.), the tempo of the BGM, the number of the scene and the number of the phrase. .

Next, in step S203, it is determined whether or not there has been a redo instruction from the instruction control means 306. If there is no redo instruction, the next step S2
In step 04, moving image data is read out from the corresponding moving image data file in address order based on the scene and phrase information.

Next, in step S205, the read moving image data is registered in the moving image data file for replay in address order. Subsequently, step S20
In step 6, the read moving image data is drawn in the image memory 320 through the moving image drawing means 328.

In this case, the vertex data of each object projected as the moving image 206 is rewritten based on the moving image data. Then, in the image memory 320, the image data of each object is drawn at a position (coordinate) based on the rewritten vertex data.

Next, in step S 207, the presence or absence of a vertical streak noise image is determined based on the time difference between the current elapsed time and the time limit. Are drawn in the image memory 320 in accordance with the number of noises. The expression of the vertical streak noise is performed from, for example, 20 seconds before the time limit, and the drawing is performed such that the number of vertical streak noises increases as the time approaches the time limit.

Next, in step S208, along with the registration of the moving image data, information on the noise of the vertical streak (the number of noises, etc.) is registered in the moving image data file for replay.

Next, in step S209, the trajectory of the block object 202 instructed to be thrown is calculated. Specifically, the data of the elapsed time t from the time of release is received, and further, the designated block object 2
And data of the gravitational acceleration g corresponding to 02, receives the data of the initial speed v _0, determine the vertical displacement y of the following equation ^{_{y = v 0 t-gt 2}} /2 from the block objects 202.

Next, in step S210, the vertex data (particularly information about coordinates) of the specified block object 202 is rewritten through the block drawing means 322 based on the displacement y.

On the other hand, if it is determined in step S203 that a redo instruction has been given, the process proceeds to step S203.
In step 211, the information of the noise image is registered in the moving image data file for replay in address order. Subsequently, in step S212, the image data of the noise is drawn in the image memory 320 through the noise image drawing means 330.

Step S210 or step S21
At the stage where the processing in step 2 has been completed, the process proceeds to step S213, where the frame object 204
Is drawn in the image memory 320. In this case, the vertex data of the frame object 204 is rewritten based on the current BGM tempo and the elapsed time from the start of the current phrase, and the position (coordinate) based on the vertex data in the image memory 320 is set to the frame object. The image data of 204 is drawn in the image memory 320.

Next, in step S 214, the image data of the index 232 is drawn in the image memory 320 through the index drawing means 326. In this case, the instruction control means 30
6, the vertex data of the index 232 is rewritten based on the score data calculated through the score calculation means 318,
The image data of the index 232 is drawn in the image memory 320 at a position (coordinate) based on the vertex data in the image memory 320.

Next, in step S215, the image data drawn in the image memory 320 is output to the monitor 18 via the image display means 332, and the block object 202, the frame object 204, and the index 232 are displayed on the monitor 18. And a moving image 206 are displayed.

Next, in step S216, it is determined whether there is a temporary termination request. This determination is made based on whether or not an operation input has been made through the instruction control unit 306, or whether or not a predetermined time (time until returning to the first portion of the phrase) has elapsed after the redo instruction.

If there is no request for temporary termination, the process returns to step S203, and the processes after step S203 are repeated. By repeating the processing of steps S203 to S216, the designated block object 2
02 and the continuous motion of falling are performed, and a moving image corresponding to the type of the block object 202 is displayed.

In step S216, when there is a temporary end request, the process proceeds to next step S217, and it is determined whether there is a program end request (game over, power off, etc.) to the display processing means 302. Is determined. If there is no program end request, the process returns to step S201 and waits for the next throwing instruction.

Then, in step S217,
At the stage where the program end request is received, the processing by the display processing means 302 ends.

Returning to the main routine of FIG. 20, in the next step S22, it is determined whether or not a predetermined timing is reached through the task block processing means 310, that is, whether or not the appearance timing M of the task block 220 is reached in the next turn. Is determined. This determination is made by the index register n
Is determined based on whether or not the value coincides with the appearance timing M.

In the next turn, when it is determined that the appearance timing M of the task block 220 is reached, the next step S
Proceeding to 23, an instruction is issued to indicate that the task block is 220. This instruction is determined in step S16.

At the stage when the processing in step S23 is completed, or when it is determined in step S22 that the timing is not the predetermined timing, step S1 in FIG.
The process returns to 1 and the processes after step S11 are repeated.

On the other hand, if it is determined in step S20 that the inset of the block object for one measure has been completed, the flow advances to the next step S24, in which the number of acquired blocks is the prescribed eight. Is determined. As shown in FIG. 14D, when the number of blocks is more than eight, the process proceeds to step S15 in FIG. 19, and returns to step S6 via a redo instruction.

If the number of blocks fitted in the frame object 204 is the prescribed eight, the next step S2
Proceeding to 5, the score is calculated through the score calculation means 318. In this calculation, a score is calculated based on the difficulty level according to the insertion pattern of the block object 202 in one bar. The calculated score is calculated by the display processing means 302.
Through the indicator is displayed.

Next, in step S26, the value of the index register i is updated by +1.
At 27, through the fit state processing means 316,
It is determined whether the fitting of the block object 202 for one phrase is completed. This determination is made based on whether the value of the index register i is 4 or more.

Block object 20 for one phrase
If the fitting of No. 2 has not been completed, the process proceeds to step S7 in FIG. 19, and the process for the next phrase is performed.
If the acquisition of the block object 202 for one phrase has been completed, the process proceeds to the next step S28, and it is determined through the assignment block processing means 310 whether or not the fitting process for the assignment block 220 has been executed. This determination is made based on whether the routine of step S23 has been passed.

If the fitting process has not been performed on the task block 220, the process proceeds to step S15 in FIG.
After the retry instruction, the process returns to step S6. If the fitting process has been performed on the task block 220, the process proceeds to step S29 in FIG. 21 to calculate the evaluation for one phrase. This evaluation is calculated based on the state of fitting the block object into the frame object 204 and the score.

Next, after the value of the index register k is updated by +1 in step S30, the next step S30 is executed.
At 31, an instruction to throw up the four-set block 202d is issued through the block throwing up instruction means 312. In accordance with this instruction, the display processing means 302
A display for throwing 2d upward is performed.

Next, in step S32, it is determined whether a predetermined time has elapsed. This time is the time from when the four-set block 202d is thrown up to when it falls onto the frame object 204. When the predetermined time has elapsed, the process proceeds to the next step S33, and it is determined whether or not the four-set block 202d has been thrown up a predetermined number of times.

The processing in steps S31 to S33 is performed by, for example, the four sets of blocks 20 in one bar interval inserted between the phrases of the frame object 204.
In the throwing process of 2d, for example, when the throwing for two times is completed, the process proceeds to the next step S34.

In step S34, through the fitting state processing means 316, three phrases (one scene)
It is determined whether the fitting process of the block object 202 has been completed. If not, the process returns to step S6 in FIG. 19, and the process for the next phrase is performed.

When the processing for one scene has been completed, the process proceeds to the next step S35, where the value of the index register m is updated by +1. In the next step S36, it is determined whether or not the processing has been completed for all scenes. Is determined. This determination is made based on whether the value of the index register m is 7 or more.

If the processing has not been completed for all the scenes, the flow returns to step S2 in FIG. 19 to perform the processing for the next scene. Is completed.

Next, each processing operation of the display replay means 350 and the audio replay means 352 constituting the replay processing means 308 will be described with reference to the flowcharts of FIGS. These display replay means 350
The voice replay unit 352 operates in a multitasking manner.

First, the display replay means 350
In step S301, an initial value “0” is stored in an index register m used for updating a scene (scene), and the index register m is initialized.

Next, in step S302, an initial value "0" is stored in an index register k used for updating a phrase, and the index register k is initialized.

Next, in step S303, of the replay moving image data files, moving image data is sequentially read from the replay moving image data file based on the values of the index registers m and k.

Next, in step S304, noise information is read together with the reading of the moving image data.

Next, in step S305, the vertex data of each object projected as a moving image by the phrase is rewritten based on the read moving image data, and the position (based on the rewritten vertex data) in the image memory is determined. At each coordinate, the image data of the object is drawn.

Next, in step S306, the image data drawn in the image memory 320 is displayed on the monitor 1.
8 to display a moving image 206 on the monitor 18 as shown in FIG.

Next, in step S307, it is determined whether the display of the moving image for one phrase has been completed. 1
If the display of the moving image for the phrase has not been completed, the process returns to step S303 to read the next moving image data of the phrase and display the moving image 206.

When the display of the moving image for one phrase is completed, the process proceeds to the next step S308, where the audience rating is calculated.
This calculation is performed based on the evaluation for each phrase calculated in step S30 (see FIG. 21) in the instruction control means 306.

Next, in step S309, it is determined whether or not the display of the moving image has been terminated. This determination is made based on whether the calculated audience rating is less than 10%. If the display is not censored, the next step S310
After updating the value of the index register k by +1 in the next step S311, three phrases (1
It is determined whether or not the display of the moving image for the scene has been completed. If the display has not been completed, the process proceeds to step S303.
And the moving image is displayed in the next phrase.

When the display of the moving image for one scene is completed, the flow advances to the next step S312 to update the value of the index register m by +1. Then, in the next step S313, it is determined whether or not the processing has been completed for all scenes. Is determined. This determination is made based on whether the value of the index register m is 7 or more.

If the processing has not been completed for all the scenes, the flow returns to step S302 to perform the processing for the next scene. When the processing has been completed for all the scenes, the processing by the replay processing means 308 is performed. Ends.

While the processing in steps S302 to S313 is repeated, the processing in step S30 is repeated.
In step 9, when it is determined that the game is to be terminated, the process proceeds to step S314, in which various processes for game over, such as erasing the moving image 206 and displaying an image indicating game over, are performed.

On the other hand, the audio replay means 352 first
In step S401 in FIG. 25, it is determined whether a noise image is currently displayed. If a noise image is displayed, the process proceeds to the next step S402, and a noise sound is output to the speaker 94.

Next, in step S403, it is determined whether or not a predetermined time (time required to return to the first portion of the phrase) has elapsed. If the predetermined time has not elapsed, the process returns to step S402, and the output of the noise sound is continued.

After the predetermined time has elapsed, the flow advances to the next step S404 to read BGM information relating to the current phrase. Next, in step S405, information of audio data output at the time when the block object 202 is fitted is read.

Next, in step S406, output of the BGM corresponding to the read BGM information is started. At this stage, the BGM corresponding to the phrase is continuously output from the speaker 94.

Next, in step S407, it is determined whether or not the displayed moving image data has been switched (moving data switching history based on an operation input). If the moving image data has been switched, the next step S408
And outputs the read audio data to the speaker 94. When the processing in step S408 is completed, or when it is determined in step S407 that the moving image data has not been switched, the process proceeds to the next step S409, and it is determined whether the phrase has changed.

If the phrase has not changed, the flow returns to step S407, and the processing from step S407 is repeated. Then, when the phrase is changed, the process proceeds to the next step S410, and it is determined whether or not there is a program termination request (game over, power off, etc.) to the audio replay unit 352. If there is no request to end the program, the process returns to step S401, and the process for the next phrase is performed. At the stage when there is a request to end the program, the process by the audio replay unit 352 ends.

The audio replay means 352 may perform the following processing in addition to the above processing.

That is, various BGMs are assigned to each phrase, and the sound assigned to each bar is changed according to the type of block incorporated in the bar.

The reproduction process will be described with reference to FIGS. First, in step S501 in FIG. 26, an initial value “1” is stored in an index register k used for updating a phrase, and the index register k is initialized.

Next, in step S502, voice information (BGM) relating to the k-th phrase is read. Thereafter, in step S503, an initial value “1” is stored in an index register i used for updating the number of measures, and the index register i is initialized.

Next, in step S504, the audio information in the i-th measure (hereinafter referred to as measure unit audio information for convenience) is read from the read audio information.

Next, in step S505, the initial value “0” is stored in the index register p used for updating the number of blocks, and the initial value “1” is stored in the index register j used for searching for blocks. Then, the index registers p and j are initialized, respectively.

Next, in step S506, the type of the j-th block is read from the arrangement information of the block in the i-th measure.

Next, in step S507, it is determined whether the reproduction timing is the first half or the second half of the bar. This determination is made based on whether the value of the index register p is less than 4.

When the value of the index register p is 4, that is,
If it is determined that it is the first half of the bar, the next step S
Proceeding to 508, the sound corresponding to the type of the current block is reproduced from the beginning of the read measure unit sound information.

On the other hand, if it is determined in step S507 that it is the latter half, the process proceeds to step S509,
A sound corresponding to the type of the current block is reproduced from the middle of the read measure unit sound information.

Step S508 or step S508
At the stage when the processing in 509 is completed, the next step S51
The process proceeds to 0, and the number of blocks A according to the type of the current block is accumulated in the value of the index register p.

Next, in step S511, after updating the value of the index register j by +1, it is determined whether or not the processing for one bar has been completed. This determination is made based on whether or not the value of the index register p is “8” or more. If the process for one bar has not been completed, the process returns to step S506, and the processes from step S506 are repeated.

Here, the processing in steps S506 to S512 will be specifically described with reference to FIGS. 27 and 28. As shown in FIG. 27, it is assumed that eight blocks are fitted in one measure, and Assuming that the sound assigned to is 4 in the playback order, as shown in the item of FIG. 28, if two 4-block blocks 202d are inserted in the bar, the first 4
Since the set block 202d is located in the first half of the bar,
“I'm playing” is reproduced from the beginning of the sound, and “Isukina” is reproduced from the middle of the sound because the next four-set block 202d is located in the latter half of the bar.

Next, as shown in the item of FIG. 28, two blocks 202b and three blocks 20
2c, two sets of blocks 202b and one set of blocks 202a
Are inserted in order, the first two sets of blocks 2
Since 02b is located in the first half of the measure, "I" is reproduced from the beginning of the sound, and the next three-block 202c is located in the first half of the measure, so "I" is reproduced from the beginning of the sound again. Since the next two sets of blocks 202b are located in the latter half of the bar, a "chair" is reproduced from the middle of the sound, and the last set of blocks 202a is located in the latter half of the measure, so that the "chair" is reproduced from the middle of the sound Is played.

As another example, the item is 3 per bar.
Shows a case where a group block 202c, a group block 202a, and two group blocks 202b are arranged.
A case where four 1-set blocks 202a and one 4-set block 202d are arranged in one bar is shown. In the item, two sets of blocks 202b and four sets of blocks 202d and 2 are set in one measure.
A case in which one set of blocks 202a is arranged is shown, and items include two sets of three blocks 202c and one 2
An example in which the set blocks 202b are arranged will be described.

Returning to the description of the routine shown in FIG. 26, in the next step S513, the value of the index register i is updated by +1. In step S514, it is determined whether or not all measures relating to one phrase have been processed. This determination is made when the value of the index register i is 1
This is performed depending on whether the number of measures B of the phrase has been exceeded.

If all measures relating to one phrase have not been processed, the flow returns to step S504, and the processing from step S504 is repeated. At the stage where all measures relating to one phrase have been processed, the process proceeds to the next step S515, where the value of the index register k is set to +
After one update, in the next step S516, it is determined whether or not all phrases have been processed. This determination is made based on whether the value of the index register k exceeds the number C of phrases.

If all the phrases have not been processed, the process returns to step S502, and the process returns to step S502.
The subsequent processing is repeated. Then, at the stage when all the phrases have been processed, this series of reproduction processing ends.

According to the above-mentioned reproduction processing, even when a harmony progression (chord change) is performed within a bar, reproduction without a sense of incongruity can be performed. There are no uncomfortable feelings because the playback rules allow the player to control the game to some extent. Since the position of a strong beat in a bar can be shifted by rearranging blocks, various rhythm variations can be obtained.

As described above, in the entertainment system 10 according to the present embodiment, the monitor 18 displays the frame object 204 moving in accordance with the predetermined tempo, and allows the user to input a plurality of types of block objects to the frame object 204. Try to fit 202
A plurality of types of moving image data corresponding to the block object 202 inserted into the frame object 204 are combined to create an image of one scene.

For this reason, each time a plurality of types of objects are fitted in a frame, a plurality of types of moving image data corresponding to the objects fitted in the frame are combined to form one object.
An image of one scene is created.

In this case, instead of forcibly pressing a designated button, moving images are combined by pressing an arbitrary button according to a rhythm freely according to a free idea. Interest is maintained, and the user can enjoy a video game in which music and video are combined, in which a video of one scene is created while riding on the rhythm of music.

In particular, in the present embodiment, an arbitrary sound is output when the block object 202 is fitted into the frame object 204, so that the continuous movement of the block object 202 from throwing up to falling is a kind of metronome. The user plays the block object 20 while watching this continuous operation.
2 is inserted into the frame object 204 by an arbitrary button operation, an arbitrary sound is output, and one music is completed by the sound and the BGM output each time the block object 202 is inserted into the frame object 204. Will go on.

In this case, instead of forcibly pressing a designated button, an arbitrary sound is output by pressing an arbitrary button according to a rhythm freely according to a free idea. The user's interest in the video game is maintained, and the user can enjoy the music video game in the sense of riding the music rhythm.

Further, in the present embodiment, as described above, for example, when creating a fictitious TV program for one week,
The user himself / herself becomes a director or a director and is in charge of a program frame of one scene a day, and can enjoy a simulated experience of television program creation in which a video created by the user himself is incorporated into one scene.

In this case, various elements can be incorporated in a simple game of fitting the block object 202 into the frame object 204, and the user can produce a one-week program while increasing the audience rating. You can enjoy video games.

In the present embodiment, the display processing means 302 draws a frame object 204 that moves in one direction at a point where the block object 202 falls at a predetermined tempo.
And the shape of the block object 202 is changed according to the type of operation input when the block object 202 is fitted.
Block drawing means 322 for throwing up and displaying 2 so as to have a flight time corresponding to its shape and a predetermined tempo.
To have.

In this case, the frame object 204 moves in one direction in accordance with a predetermined tempo, and further, the block object 202 is thrown up and falls with a hang time corresponding to the shape and the predetermined tempo. Therefore, it is possible to realize a video game in which an arbitrary sound is generated when the frame object 204 moves according to the tempo of the BGM and the thrown-up block object 202 is fitted into the frame object 204.

In this video game, the length of the sound changes, such as a quarter note or an eighth note, depending on the shape of the block object 202, and the timing at which the operation input is to be made can be changed thereafter. That is, a simple input timing or a complicated input timing can be arbitrarily selected depending on the type of operation input, and the rhythm of the completed music can be diversified.

In this embodiment, the scores calculated according to various combinations of shapes when the block object 202 is fitted are displayed as indices. In this case, the timing of operation input changes according to the type of operation input, and the rhythm also changes at the same time.However, by setting the operation input on a complicated rhythm with good timing, for example, setting to increase the score Thereby, the user wants to challenge a more complicated rhythm, and the above-mentioned video game can have a sporty element.

The entertainment system, the entertainment apparatus, the recording medium, and the program according to the present invention are not limited to the above-described embodiments, but may adopt various configurations without departing from the gist of the present invention. is there.

[0235]

As described above, according to the entertainment system, the entertainment apparatus, the recording medium, and the program according to the present invention, an arbitrary sound is generated in accordance with the timing of the operation input by the user, and the type of the operation input is further increased. The videos are combined according to
A video of one scene can be created, and the enjoyment of creating one music and the enjoyment of creating a video of one scene can be simultaneously enjoyed. It is also possible to enjoy various voice changes and rhythm variations.

[Brief description of the drawings]

FIG. 1 is a configuration diagram showing an entertainment system according to an embodiment.

FIG. 2 is a perspective view showing an operation device.

FIG. 3 is a plan view showing the operation device.

FIG. 4 is a perspective view showing a use state of the operating device.

FIG. 5 is a partially cutaway bottom view showing a state in which a vibration imparting mechanism is provided in left and right grips.

FIG. 6 is a block diagram showing a circuit configuration of the entertainment device.

FIG. 7 is a block diagram showing a main part for performing bidirectional serial communication between the operation device and the entertainment device.

FIG. 8 is an explanatory diagram illustrating an example in which a block object, a frame object, an index, and a moving image are displayed on a monitor.

FIG. 9A is an explanatory diagram illustrating a state where an object is thrown from a throwing position and reaches a highest point, and FIG. 9B illustrates a state where a falling object is acquired by an acquisition-side object; FIG.

FIG. 10 is an explanatory diagram illustrating an example of a type of an object assigned to each button of the operation device.

FIG. 11A is an explanatory diagram showing a first moving image data file group corresponding to four sets of blocks;
FIG. 11C is an explanatory diagram showing a second moving image data file group corresponding to three sets of blocks, and FIG. 11C is an explanatory diagram showing a third moving image data file group corresponding to two sets of blocks.

FIG. 12A is an explanatory diagram showing a state in which a block object is fitted into a frame object as specified; FIG. 12B is an explanatory diagram showing a state in which the block object is fitted when an operation input is slightly late; FIG. 12C is an explanatory diagram showing a state where the block object is fitted when the operation input is slightly earlier.

FIG. 13 is an explanatory diagram illustrating an example of a task block.

FIG. 14A is an explanatory diagram showing a first insertion pattern of a block object; FIG. 14B is an explanatory diagram showing a second insertion pattern of a block object; and FIG. FIG. 14D is an explanatory diagram showing an example of a pattern that has been protruded and inserted.

FIG. 15 is an explanatory diagram showing a pattern in which a combination of moving images created by a user is displayed on a monitor by a replay function.

FIG. 16 is an explanatory diagram showing a state in which vertical streak noise appears in a moving image portion as the time limit approaches.

FIG. 17 is a functional block diagram illustrating a configuration of a video creating unit.

FIG. 18 is a functional block diagram illustrating a configuration of a display processing unit.

FIG. 19 is a flowchart (No. 1) showing a processing operation of an instruction control means constituting the video creation means.

FIG. 20 is a flowchart (part 2) illustrating the processing operation of the instruction control means;

FIG. 21 is a flowchart (3) showing a processing operation of the instruction control means.

FIG. 22 is a flowchart showing a processing operation of a voice processing unit.

FIG. 23 is a flowchart showing the processing operation of the display processing means.

FIG. 24 is a flowchart showing a processing operation of a display replay unit.

FIG. 25 is a flowchart showing a processing operation of the audio replay unit.

FIG. 26 is a flowchart showing another example of the processing operation of the audio replay unit.

FIG. 27 is an explanatory diagram showing a reproduction order of music (video) and its source.

FIG. 28 is a table showing the relationship among the arrangement state of blocks, the order in which music is reproduced, and reproduced sound.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 10 ... Entertainment system 12 ... Entertainment device 16 ... Operating device 18 ... Monitor 20 ... Optical disk 80 ... CPU 84 ... Graphic system 86 ... Sound system 94 ... Speaker 202 ... Block object 202a ... One set block 202b ... Two set block 202c ... Three set Block 202d 4 blocks 204 Frame object 206 Video 220 Assignment block 232 Index 300 Image creation means 302 Display processing means 304 Audio processing means 306 Instruction control means 308 Replay processing means

──────────────────────────────────────────────────の Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) G06T 13/00 G06T 13/00 B G10K 15/04 302 G10K 15/04 302G (72) Inventor Naoto Nakai Tokyo 7-1-1, Akasaka, Minato-ku, Japan Sony Computer Entertainment Inc. (72) Inventor Tomoaki Tachizawa 1-1-4 Kamiochiai, Shinjuku-ku, Tokyo Suzuki Building 2F, 3F Gonzo Co., Ltd. F-term (reference) 2C001 BB01 CA01 CA04 CA09 CB06 CB08 CC08 5B050 AA08 BA07 BA08 BA09 BA11 CA07 EA19 EA24 FA02 FA10 FA13 FA17

Claims (38)

[Claims] 1. An entertainment device comprising: an entertainment device for executing various programs; at least one operating device for inputting an operation request from a user to the entertainment device; and a display device for displaying an image output from the entertainment device. In the system, a frame that moves in accordance with a predetermined tempo is displayed on the display device, and a user tries to fit a plurality of types of objects into the frame, and a plurality of types corresponding to the objects fitted into the frame are displayed. Combine video data from
An entertainment system comprising an image creating means for creating an image of one scene. 2. The entertainment system according to claim 1, wherein said video creation means reads out, from a plurality of types of video data, video data corresponding to an object fitted into said frame, And a moving image display means for displaying moving image data in order. 3. The entertainment system according to claim 1, wherein said image creating means includes a noise image drawing means for displaying a noise image for a predetermined time when the user fails to insert the object. An entertainment system characterized by having. 4. The entertainment system according to claim 1, wherein said video creating means stores information relating to the inset of an object by said user in order, and replays a video of one scene based on said stored information. An entertainment system comprising replaying means for performing an operation. 5. The entertainment system according to claim 1, wherein said video creating means includes: an object drawing means for performing continuous display of throwing and falling of said object on said display device; An entertainment system comprising: an inset state processing unit that determines whether or not the object is fitted into the frame by detecting an operation input timing when the object falls into the frame. 6. The entertainment system according to claim 5, wherein said video creating means has sound processing means for outputting an arbitrary sound when said object is fitted into said frame. 7. The entertainment system according to claim 5, wherein said object drawing means changes a shape of said object according to a type of operation input when said object is fitted into said frame. Entertainment system. 8. The entertainment system according to claim 1, wherein said video creating means has a frame drawing means for moving said frame in one direction in accordance with a predetermined tempo. 9. The entertainment system according to claim 1, wherein said video creating means comprises: frame drawing means for moving said frame in one direction in accordance with a predetermined tempo; and An object drawing means for changing the object according to the type of operation input at the time of fitting into the frame and throwing up and displaying the object so as to have a hang time corresponding to the shape and the predetermined tempo; An entertainment system characterized by the following. 10. The entertainment system according to claim 1, wherein said video creating means has a score drawing means for displaying a score calculated according to a combination of various shapes at the time of acquiring said object. A unique entertainment system. 11. An entertainment device having an entertainment device for executing various programs, at least one operating device for inputting an operation request from a user to the entertainment device, and a display device for displaying an image output from the entertainment device. In the system, a frame that moves in accordance with a predetermined tempo is displayed on the display device, and a user tries to fit a plurality of types of objects into the frame, and a plurality of types corresponding to the objects fitted into the frame are displayed. An entertainment system comprising audio processing means for creating and reproducing a series of music by combining the audio information. 12. The entertainment system according to claim 11, wherein said voice processing means reads out voice information corresponding to an object fitted in said frame from a plurality of types of voice information; And an audio output means for sequentially outputting the output audio information. 13. An entertainment system according to claim 11, wherein said audio processing means includes replay means for sequentially outputting audio according to information on the user's fitting of the object. 14. An entertainment device which can be connected to an operation device for receiving an operation request from a user and a display device for displaying an image, and which executes various programs. Displaying a frame that moves together, causing the user to try to fit a plurality of types of objects into the frame, and combining a plurality of types of moving image data corresponding to the objects fitted into the frame,
An entertainment apparatus, comprising: an image creating unit that creates an image of one scene. 15. The entertainment device according to claim 14, wherein said video creating means reads out moving image data corresponding to an object fitted into said frame from a plurality of types of moving image data. And a moving image display means for sequentially displaying moving image data. 16. The entertainment apparatus according to claim 14, wherein said image creating means includes a noise image drawing means for displaying a noise image for a predetermined time when said user fails to insert an object. An entertainment device, comprising: 17. The entertainment apparatus according to claim 14, wherein said video creating means stores information on the user's fitting of an object in order, and replays a video of one scene based on the stored information. An entertainment apparatus, comprising: a replay unit that performs replay. 18. The entertainment apparatus according to claim 14, wherein said image creating means comprises: object drawing means for performing continuous display of throwing and falling of said object on said display device; An entertainment apparatus, comprising: an inset state processing unit that determines whether or not the object is fitted into the frame by detecting a timing of an operation input when the object falls into the frame. 19. An entertainment apparatus according to claim 18, wherein said video creating means has an audio processing means for outputting an arbitrary audio when said object is fitted in said frame. 20. An entertainment apparatus according to claim 18, wherein said object drawing means changes a shape of said object in accordance with a type of operation input when said object is fitted into said frame. Entertainment device. 21. An entertainment apparatus according to claim 14, wherein said video creating means has a frame drawing means for moving said frame in one direction in accordance with a predetermined tempo. 22. The entertainment apparatus according to claim 14, wherein said image creating means comprises: frame drawing means for moving said frame in one direction in accordance with a predetermined tempo; and An object drawing means for changing the object according to the type of operation input at the time of fitting into the frame and throwing up and displaying the object so as to have a hang time corresponding to the shape and the predetermined tempo; An entertainment device characterized by that: 23. The entertainment apparatus according to claim 14, wherein said video creating means has a score drawing means for displaying a score calculated in accordance with a combination of various shapes at the time of acquiring said object. A unique entertainment device. 24. An entertainment device comprising: an entertainment device for executing various programs; at least one operating device for inputting an operation request from a user to the entertainment device; and a display device for displaying an image output from the entertainment device. On a recording medium on which a program or data used in the system is recorded, a frame that moves in accordance with a predetermined tempo is displayed on the display device, and a user is caused to try to fit a plurality of types of objects into the frame. , Combining a plurality of types of moving image data corresponding to the object fitted in the frame,
A recording medium having an image creating step of creating an image of one scene. 25. The recording medium according to claim 24, wherein the video creating step includes: a moving image reading step of reading moving image data corresponding to an object fitted into the frame from a plurality of types of moving image data; A moving image display step of sequentially displaying moving image data. 26. The recording medium according to claim 24, wherein the image creating step includes a noise image drawing step for displaying a noise image for a predetermined time when the user fails to insert the object. A recording medium comprising: 27. The recording medium according to claim 24, wherein said video creating step stores information relating to the inset of an object by said user in order, and replays a video of one scene based on said stored information. A recording medium, comprising: 28. The recording medium according to claim 24, wherein the image creating step includes: an object drawing step for performing continuous display of the throwing and falling of the object on the display device; A recording medium, comprising: a fitting state processing step of performing presence / absence of fitting into the frame by detecting a timing of an operation input when the object falls into the frame. 29. A recording medium according to claim 28, wherein said video creating step includes an audio processing step of outputting an arbitrary audio when said object is fitted into said frame. 30. The recording medium according to claim 28, wherein in the object drawing step, the shape of the object is changed according to the type of operation input when the object is fitted into the frame. recoding media. 31. A recording medium according to claim 24, wherein said video creating step includes a frame drawing step for moving said frame in one direction in accordance with a predetermined tempo. 32. The recording medium according to claim 24, wherein said image creating step includes: a frame drawing step for moving said frame in one direction in accordance with a predetermined tempo; An object drawing step of changing the shape of the object according to the type of operation input at the time of fitting into the frame and throwing up and displaying the object so as to have a hang time corresponding to the shape and the predetermined tempo. A recording medium characterized by the above-mentioned. 33. The recording medium according to claim 24, wherein the image creating step includes a score drawing step for displaying a score calculated according to a combination of various shapes at the time of acquiring the object. Characteristic recording medium. 34. An entertainment device comprising: an entertainment device for executing various programs; at least one operating device for inputting a user's operation request to the entertainment device; and a display device for displaying an image output from the entertainment device. On a recording medium on which programs and data used in the system are recorded, a frame that moves in accordance with a predetermined tempo is displayed on the display device, and a user is caused to try to fit a plurality of types of objects into the frame. And a sound processing step of creating and reproducing a series of music by combining a plurality of kinds of sound information corresponding to the object fitted in the frame. 35. The recording medium according to claim 34, wherein the audio processing step includes: an audio reading step of reading audio information corresponding to the object fitted into the frame from a plurality of types of audio information. And a sound output step of sequentially outputting the sound information. 36. The recording medium according to claim 34, wherein said audio processing step includes a replay step of sequentially outputting audio according to information on the user inserting the object. 37. An entertainment device comprising: an entertainment device for executing various programs; at least one operating device for inputting an operation request from a user to the entertainment device; and a display device for displaying an image output from the entertainment device. In a program used by the system and read by a computer and executable, a frame that moves in accordance with a predetermined tempo is displayed on the display device, and the user is caused to try to fit a plurality of types of objects into the frame. , Combining a plurality of types of moving image data corresponding to the object fitted in the frame,
A program having an image creating step of creating an image of one scene. 38. An entertainment device comprising: an entertainment device for executing various programs; at least one operating device for inputting an operation request from a user to the entertainment device; and a display device for displaying an image output from the entertainment device. In a program used by the system and read by a computer and executable, a frame that moves in accordance with a predetermined tempo is displayed on the display device, and the user is caused to try to fit a plurality of types of objects into the frame. And a sound processing step of creating and playing back a series of music by combining a plurality of kinds of sound information corresponding to the object fitted in the frame.