JP2001137544A - Entertainment system, entertainment device, recording medium and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable a player to make a body imitating an object displayed on a monitor screen act in time to the movement of the object. SOLUTION: Two controllers 16A and 16B are connected to two slots 30A and 32A of this entertainment device 12 respectively by way of connectors 62. One controller 16A is operated by a user as a regular controller, while the other controller 16B, inverted and put on a table 70 for example, is made to function as a body to act by vibrations (the action controller 16B). The action controller 16B is made to act in time to the movement of an object 180 displayed on a monitor 18.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an entertainment system having an entertainment device for executing various programs, an entertainment system connected to the entertainment device, and at least one operating device for inputting an operation request from a user to the entertainment device. The present invention relates to an entertainment device that executes various programs, a recording medium on which programs and data used in the entertainment system are recorded, and the programs themselves.

[0002]

2. Description of the Related Art As an information device (entertainment system) such as an entertainment device including a video game machine, for example, a game content stored in a recording medium such as a CD-ROM is displayed on a screen of a television receiver. There are devices that operate the operation device to advance the game.

In the entertainment system, the entertainment device and the operating device are usually connected by a serial interface. When a clock is sent from the entertainment device, the operating device responds to a user's operation in synchronization with the clock. Key switch information and the like are sent.

Further, recently, a vibration generating means for giving a vibration to a user in response to a request from the outside (for example, an entertainment device) is provided in the operating device so that the device responds to the user's operation during a game, for example. As a result, a system for giving various vibrations to a user has been developed and has been put to practical use.

[0005]

By the way, in a game using the above-mentioned entertainment apparatus, for example, an object consisting of an image or the like imitating a person, a car, an airplane, a card, or the like displayed on a monitor is operated by an operating device. In many cases, the game is played on the monitor screen, and most of the games progress only on the monitor screen.

The present invention has been made in view of such a problem, and an object imitating an object displayed on a monitor (an object occupying a three-dimensional space and subject to human perception) is replaced with the object. An entertainment system that can be operated in accordance with the movement of, for example, not only the movement of the object on the monitor screen using the operation device, but also the movement of the object in space,
It is an object to provide an entertainment device, a recording medium, and a program.

[0007]

An entertainment system according to the present invention comprises: an entertainment device for executing various programs; at least one operating device for inputting a user's operation request to the entertainment device; And at least one operation device that operates according to the instruction.

An entertainment device according to the present invention is an entertainment device in which at least an operation device for outputting an operation request from a user and a display device for displaying an image can be connected to the entertainment device main body. At least one operating device that operates according to an instruction from the entertainment apparatus main body is connectable.

Thus, the operating device occupying the space moves according to the instruction from the entertainment device. For example, when the user is moving the object displayed on the monitor using the operating device, the operating device is moved to the object. Can be operated in accordance with the movement of.

Therefore, when the entertainment system according to the present invention or the entertainment device according to the present invention is applied to a video game machine, for example,
A video game that has been progressing only on the monitor screen can be further enjoyed while watching the operation device operating in the space, and a new way of enjoying the video game can be created.

[0011] In the above configuration, a plurality of the operation devices may be provided, and at least one of the plurality of operation devices may also be used as the operation device.

[0012] In the above structure, the apparatus further includes a display device for displaying an image output from the entertainment device, and an operation instruction means for operating the operation device in accordance with the movement of the object displayed on the display device. You may have it.

In this case, the object may move according to operation information based on an input signal from the operation device, or may move according to preset operation information.

In the above structure, the operating device further includes vibration generating means for generating vibration in accordance with an instruction from the entertainment device, and the operation instructing means displays the object on the display device, The apparatus may include an object display unit that operates according to the operation information and a vibration instruction unit that outputs the operation information as vibration information to the vibration generation unit.

In this case, the vibration generating means includes a plurality of vibration sources having different vibration characteristics, and the vibration instruction means calculates vibration information to be given to each vibration source in accordance with the vibration characteristics of each vibration source. You may make it.

Next, the present invention provides an entertainment device for executing various programs, at least one operating device connected to the entertainment device, for inputting a user's operation request to the entertainment device, and a connection to the entertainment device. And a display medium for recording a program or data used in an entertainment system having at least one operating device that operates according to an instruction from the entertainment device and a display device that displays at least one object. And an operation instruction step of operating the operation device in accordance with the movement of the object displayed on the display device.

[0017] A program according to the present invention includes an entertainment device for executing various programs, at least one operating device connected to the entertainment device, for inputting a user's operation request to the entertainment device, and the entertainment device. Is used in an entertainment system having at least one operating device that operates according to an instruction from the entertainment device and a display device that displays at least one object, wherein the computer-readable and executable program includes: An operation instruction step for operating the operation device in accordance with the movement of the object displayed on the display device is provided.

By using the recording medium or the program, the operation device occupying the space moves according to the instruction from the entertainment device. For example, the user moves the object displayed on the monitor using the operation device. In this case, the operating device can be operated in accordance with the movement of the object.

Therefore, when the program or data recorded on the recording medium according to the present invention or the program according to the present invention is applied to, for example, a video game, the user can play the video game which has been progressing only on the monitor screen. , You can enjoy more while watching the operating device that operates in space,
A new way to enjoy video games can be created.

In this case, the object may move according to operation information based on an input signal from the operation device, or may move according to preset operation information.

In the case where the operating device includes vibration generating means for generating vibration in accordance with an instruction from the entertainment device, the operation instructing step includes displaying the object on the display device, and displaying the object in accordance with the operation information. The method may include displaying an object to be operated and a vibration instruction step of outputting the operation information as vibration information to the vibration generating unit.

When the vibration generating means has a plurality of vibration sources having different vibration characteristics, the vibration instructing step calculates the vibration information to be given to each vibration source in accordance with the vibration characteristics of each vibration source. You may make it.

[0023]

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, an embodiment in which an entertainment system and an entertainment apparatus according to the present invention are applied to an entertainment system and an entertainment apparatus for executing a video game and the like, and a recording medium and a program according to the present invention will be described. Embodiments applied to a recording medium on which a program or data to be executed by a system is recorded and a program will be described with reference to FIGS.

The entertainment system 10 according to the present embodiment basically includes, as shown in FIG. 1, an entertainment device 12 for executing various programs,
A memory card 14 detachably attached to the entertainment device 12, operating devices (controllers) 16A and 16B detachably attached to the entertainment device 12 by a connector 62, and video / audio signals from the entertainment device 12. (Display) 18 which is a display device such as a television receiver to which the image is supplied.
It is composed of

The entertainment device 12, for example,
This is for reading a program recorded on a large-capacity storage medium such as an optical disk 20 such as a CD-ROM and executing a game or the like in response to an instruction from a user (user: a game player or the like). The execution of the game mainly refers to controlling the progress of the game while receiving inputs from the operation devices 16A and 16B through the connector 62 and controlling the display and sound on the monitor 18.

The entertainment apparatus 12 has a substantially flat rectangular parallelepiped shape, and has a central portion on which an optical disk 20 on which application programs and data of a video game or the like is stored (recorded) is mounted. Unit 22, a reset switch 24 for arbitrarily resetting a currently running program, and an optical disc 2
Disk operation switch 26 for operating the mounting of 0
, A power switch 28 and, for example, two slot portions 3
0 and 32 are provided.

The recording medium for supplying the application program is not limited to the optical disk 20, and the application program may be supplied via a communication line.

The slot portions 30 and 32 include upper slot portions 30B and 32B and lower slot portions 30A and 30B, respectively.
32A, and the lower slot portions 30A, 32A.
A can be connected to operating devices 16A and 16B, respectively, and the upper slot portions 30B and 32B each have a memory card 14 or a memory card capable of storing a flag indicating an intermediate state of a game or the like. A portable information terminal (not shown) that also functions as a card can be attached. The slot 30 (30
A, 30B) and 32 (32A, 32B) have asymmetric shapes to avoid erroneous insertion.

In particular, in the entertainment system 10 according to this embodiment, the two operating devices 16A and 16B are connected to the two slot portions 30A and 32A through the connectors 62, respectively, and one of the operating devices 16A, for example, The operation device 16A connected to the slot 30A is operated by the user as the original operation device, and the other operation device 16B is placed on the table 70 in an upside-down state as shown in FIG. Thus, it functions as an object (operating device 16B) that operates by vibration.

As shown in FIG. 1, the operating device 16A typically has first and second operating units 34 and 36, an L button 38L and an R button 38R, a start button 40, and a selection button 42. Further, left and right rotary operators 44 and 46 capable of analog operation, and these rotary operators 44
Mode selection switch 4 for selecting the operation modes of and 46
8 and a display unit 5 for displaying the selected operation mode
0. The display unit 50 is configured by a light emitting element such as a light emitting diode.

As shown in FIG. 3, the operating device 16A has an operating device main body 104 in which an upper half 100 and a lower half 102 abut against each other and are connected using fixing means such as screws.

As shown in FIGS. 3 and 4, from one end of the operation device main body 104, when the operation device 16A is connected to the entertainment device 12, for example, when searching for information or executing a game. Left and right grips 106 and 108 which are gripped so as to be included by the left and right palms are protrudingly provided.

The left and right grips 106 and 108 are
As shown in FIG. 4, the projections are separated from each other toward the distal end and project downward toward the operation device main body 104.

As shown in FIG. 4, the left and right grips 106 and 108 are tapered from the connecting portion to the operating device main body 104 toward the distal end, as shown in FIG. , The peripheral surface has an arc surface, and the tip side is formed in an arc shape.

At one end of the operating device main body 104, FIG.
As shown in FIG. 4, four first to fourth pressing operators 110 a to 110 projecting to the upper surface side of the operating device main body 104.
The first operation unit 34 in which 0d are arranged so as to be orthogonal to each other is provided.

The first operation section 34 is provided with switch elements as signal input elements corresponding to the first to fourth pressing operators 110a to 110d, respectively. The first operation unit 34 functions as, for example, a direction instruction control unit that controls the movement of the display character, and includes the first to fourth pressing operators 110.
a to 110d are selectively pressed and the switch elements corresponding to the pressed operators 110a to 110d are turned on / off, so that, for example, each of the pressed operators 110a to 110d whose display characters on the screen are pressed. It will move in the array direction.

As shown in FIGS. 3 and 4, on the other end of the operating device main body 104, four first to fourth pressing operators 112 projecting toward the upper surface side of the operating device main body 104.
A second operation unit 36 in which a to 112d are arranged so as to be orthogonal to each other is provided.

The first to fourth pressing operators 112a to 112a
112d is formed as an independent member, and a switch element as a signal input element is provided corresponding to each of the pressing operators 112a to 112d.

The second operation unit 36 is, for example, a first to a fourth
By turning on the switches corresponding to the pressing operators 112a to 112d,
It is used as a function setting execution unit that sets the functions of the display characters assigned to a to 112d or executes the functions of the display characters.

The L button 38 is located at each of the left and right ends on the front side opposite to the rear side, which is one side where the left and right grips 106 and 108 of the operating device main body 104 protrude.
L and R buttons 38R are provided. L button 38
The L and R buttons 38R are, as shown in FIG. 5, the first and second pressing operators 114a, 114b and 11 respectively.
6a and 116b.

Each of these pressing operators 114a and 114b
Also, switch elements are provided on 116a and 116b corresponding to the respective pressing operators 114a and 114b and 116a and 116b.

The L button 38L and the R button 38R are, for example, first and second pressing operators 114a and 114b.
And turning on the switches corresponding to 116a and 116b, for example, to set the functions of the display characters assigned to the respective pressing operators 114a and 114b and 116a and 116b, or to execute the functions of the display characters Used as an execution unit.

As shown in FIGS. 3 and 4, the operating device 16A has opposite corners on the side of the connecting portion to the operating device main body 104, which is the base end of the left and right grips 106 and 108. Left and right analog operation units 118 and 1
20 are provided.

The left and right analog operation units 118 and 1
Reference numeral 20 includes left and right rotary operators 44 and 46 capable of tilting and rotating in a 360 ° direction about an operation axis, and signal input elements such as variable resistance elements operated by the left and right rotary operators 44 and 46. ing. That is, the left and right rotary operators 44 and 46 are attached to the distal end side of the operation shaft attached to return to the neutral position by the urging member,
The rotation operation is performed in a 360 ° direction around the rotation fulcrum of the operation shaft.

The left and right analog operation units 118 and 1
Reference numeral 20 denotes an analog movement such as moving the display character while rotating or moving the display character while changing the speed, and further changing the form by rotating the left and right rotary operators 44 and 46. It is used as an operation unit capable of inputting a command signal enabling the operation.

Then, the switching operation of the mode selection switch 48 causes, for example, the left and right analog operation sections 118.
And an operation mode in which the input of command signals from the analog operation units 118 and 120 is prohibited.

The switching operation of the mode selection switch 48 further causes the left and right analog operation units 118 and 1 to operate.
20 and the first to fourth pressing operators 112a to 112 of the second operating unit 36.
d function and first and second pressing operators 114a, 114b and 116 of the L button 38L and the R button 38R.
The operation mode in which the functions a and b are switched is selected. The display unit 50 flashes according to the state of the operation mode, and the display light is further switched.

As described above, the operating device 16 having the left and right grips 106 and 108 protruding from the operating device main body 104.
A, as shown in FIG. 5, the left and right grips 106 and 10
By grasping 8 so as to wrap it in the palms of both hands, it is not necessary to support the operation device main body 104 with fingers, and it is possible to grasp up to 10 fingers of both hands and at least 6 fingers in a freely movable state. it can.

As shown in FIG. 5, for example, when the left and right grips 106 and 108 are grasped so as to be wrapped in the palms of both hands, the thumbs Rf1 and Lf1 of the left and right hands Rf and Lf are respectively moved to the left and right analog operation sections. 118 and 12
0 on the left and right rotary operators 44 and 46, the first operation unit 3
Fourth first to fourth pressing operators 112a to 112d on the first to fourth pressing operators 110a to 110d and the second operating unit 36.
112d, and these rotary operators 44 and 4
6, each pressing operator 110a-110d and 112a-1
12d can be selectively pressed.

In particular, the left and right analog operation units 118 and 1
The left and right grips 106 and 10 are gripped so as to be wrapped in the palms of both hands.
8 are disposed opposite to each other on the base end side, which is the connection side to the operating device main body 104, so that when the left and right grips 106 and 108 are gripped by the left and right hands, the left and right hands R
f and Lf are extended to the positions closest to the thumbs Rf1 and Lf1. Therefore, each of the rotary operators 44 and 46 can be easily rotated by the thumbs Rf1 and Lf1 of the left and right hands Rf and Lf.

Also, as shown in FIG.
When the hands 06 and 108 are grasped so as to be wrapped in the palms of both hands, the index fingers Rf2 and Lf2 and the middle fingers Rf3 and Lf3 of the left and right hands Rf and Lf are pressed by the first and second pressing operators of the R button 38R and the L button 38L. 116a
And 116b and 114a and 114b can be extended to positions where they can be selectively pressed.

Further, as shown in FIG.
6A and 16B are provided with two vibration imparting mechanisms 128R and 128L that impart a vibration to the user so that the game can be executed with more realistic feeling.

Each of the vibration applying mechanisms 128R and 128L
As shown in FIG. 6, when the operation devices 16A and 16B are gripped, they are disposed on the base end sides of left and right grips 106 and 108 which are gripped by fingers.

These vibration applying means 128R and 128L
Since each has the same configuration, the vibration applying mechanism 128R on the right side will be representatively described. The vibration applying means 128R is driven by a vibration generating command supplied from the entertainment device 12, as shown in FIG. Drive motor 130R, the drive motor 130R
And an eccentric member 134R attached to the drive shaft 132R.

The eccentric member 134R is formed of a heavy metal member, and is eccentrically attached to a fitting hole 136R serving as a rotation center fitted to the drive shaft 132R.
It is configured as a semicircular weight 134a.

The drive motor 130R in which the eccentric member 134R is attached to the drive shaft 132R, as shown in FIG.
For example, the motor housing 1 is fitted into a fitting concave portion 138R formed in a rectangular cylindrical shape formed on the inner side of the right grip portion 108.
40R is fitted and attached.

The vibration imparting mechanism 128 thus configured
R is driven by the drive motor 130R, and the eccentric member 134R
Is rotated, the drive motor 130R is vibrated, and the vibration is generated by the peripheral wall 138 forming the fitting recess 138R.
The vibration is transmitted to the right grip portion 108 via the a, and the finger holding the grip portion 108 is transmitted.

Here, vibration imparting mechanisms 128R and 128L provided on the left and right grips 106 and 108, respectively.
Are configured to have different vibration characteristics.

For example, the drive motor 130L in the left vibration applying mechanism 128L is replaced with the right drive motor 130R.
The rotation speed changes according to the vibration value _VL included in the vibration generation command transmitted from the entertainment device 12, and the frequency of the generated vibration changes according to the vibration value _VL. It has become. In this example, the vibration frequency is set so as to increase in proportion to the vibration value _VL .

[0060] On the other hand, the drive motor 130R on the right side of the vibration imparting mechanisms 128R, in accordance with the logic value "1" or "0" of the vibration value V _R contained in the vibration generating command,
It is "driven" or "stopped", and unlike the vibration applying mechanism 128L on the left side, either a certain vibration is performed or no vibration is performed.

As described above, in order to drive the drive motors 130R and 130L to vibrate the entire operation devices 16A and 16B, a bidirectional communication function is provided between the operation devices 16A and 16B and the entertainment device 12. The function must be configured, but this function will be described later.

Next, the circuit configuration of the entertainment device 12 and the operating devices 16A and 16B will be described with reference to FIGS.

First, as shown in FIG. 9, the entertainment apparatus 12 has a central processing unit (CPU: Central Processing Unit).
Processing Unit) 80 and a control system 82 composed of peripheral devices and the like, and an image processing device (G) that includes a frame buffer (not shown) and performs drawing in the frame buffer.
PU: Graphic Processing Unit (GPU), etc., a sound system 86, such as a sound processing unit (SPU: Sound Processing Unit) for generating musical sounds and sound effects, and an optical disk on which application programs and data are recorded An optical disc control unit 88 for performing read control of the operation devices 20A and 1
A communication control unit 90 controls input and output of data and the like to and from the memory card 6B and the memory card 14, and a system bus 92 to which these units are connected.

In this case, the video signal and the audio signal output from the graphic system 84 and the sound system 86 constituting the entertainment apparatus 12 are transmitted to the monitor 1.
8, the video is displayed on the screen of the monitor 18, and the sound is output from the speaker of the monitor 18.

As shown in FIG. 10, the operation devices 16A and 16B include a communication control unit 150, a CPU 152, a program memory 154, an operation RAM 156, a digital input block 158, an analog input block 160, a left motor driver 170L, and a left motor driver 170L. Drive motor 130L, right motor driver 170R, right drive motor 130
R is provided. These components are connected to a bus 162.

The digital input block 158 includes, for example, each of the pressing operators 110a to 110d and 112a to 112d constituting the first operating unit 34 and the second operating unit 36.
The analog input block 160 is configured to have a function as an input operation unit for the left and right rotary operators 44 and 46. Therefore, digital input block 1
58 and the analog input block 160 allow the user to input various information.

The communication control section 150 has a function of performing serial communication with an external device. The communication control unit 150 can be electrically connected to, for example, the communication control unit 90 (see FIG. 9) of the entertainment device 12.
And data communication processing can be performed.

On the other hand, the two-way communication function between the entertainment device 12 and the operation device 16A (and 16B)
As shown in FIG. 11, a connector 62 for performing bidirectional serial communication with the operating device 16A (and 16B) can be connected to the entertainment device 12.

The configuration for performing the two-way communication function on the operation devices 16A and 16B is a serial I / O interface SIO for performing serial communication with the entertainment device 12.
A parallel I / O interface PIO for inputting operation data from a plurality of operation buttons, a CPU, a one-chip microcomputer which is a RAM and a ROM (hereinafter, referred to as a microcomputer), and vibration imparting mechanisms 128R and 128R.
The motor drivers 170R and 170L rotate the 28L drive motors 130R and 130L. The drive motors 130R and 130L are driven to rotate by supply voltages and currents from the corresponding motor drivers 170R and 170L.

The entertainment device 12 has a structure provided with a serial I / O interface SIO for performing serial communication with the operation devices 16A (and 16B), and connects the connection terminals 62 of the operation devices 16A and 16B. Then, the operation device 16 is connected via the connection terminal portion 62.
Serial I / O interface SI for A and 16B side
O and a configuration capable of performing bidirectional communication means, that is, bidirectional serial communication. In addition,
Other detailed configurations of the entertainment device 12 are omitted.

Signal lines and control lines for performing bidirectional serial communication are connected from the entertainment device 12 to the operation device 16.
A signal transmission line TXD (Transmit X 'for Data) for transmitting data to A and 16B;
And a data transmission signal line RXD (Received X'for) for transmitting data from the 16B side to the entertainment apparatus 12 side.
Data) and a signal line S for a serial synchronous clock for extracting data from the signal lines TXD and RXD for each data transmission.
CK (Serial Clock), a control line DTR (Data Terminal Ready) for establishing and interrupting communication between the operation devices 16A and 16B on the terminal side, and control for flow control for transferring a large amount of data. Line DSR (Data
Set Ready).

As shown in FIG. 11, a cable consisting of a signal line and a control line for performing bidirectional serial communication was directly taken out of the power supply of the entertainment apparatus 12 in addition to the signal line and the control line. Power cable 17
The power cable 172 is connected to the motor drivers 170R and 170R on the operating devices 16A and 16B side.
70L, each drive motor 130R and 130L
Supply power to rotate.

In the bidirectional serial communication procedure having such a configuration, for example, in order for the entertainment apparatus 12 to communicate with the operation apparatuses 16A and 16B and take in the operation data (button information) of the operation buttons, first the entertainment is performed. The device 12 outputs the selection data to the control line DTR. As a result, the operating devices 16A and 16B confirm that they have been selected by the control line DTR, and enter a state of waiting for reception of the subsequent signal line TXD. Subsequently, the entertainment device 12 sends the identification codes indicating the operation devices 16A and 16B to the data transmission signal line TXD.
As a result, the operating devices 16A and 16B receive this identification code from the signal line TXD.

When the operation devices 16A and 16B recognize the identification code, the communication with the entertainment device 12 is started thereafter. That is, control data and the like are transmitted from the entertainment device 12 to the signal line T for data transmission.
Transmitted to the operating devices 16A and 16B via the XD,
Conversely, operation data and the like operated by the operation buttons are transmitted from the operation devices 16A and 16B to the entertainment device 12 via the data transmission signal line RXD. In this way, the entertainment device 12 and the operating device 16A
, And 16B, and this communication ends when the entertainment apparatus 12 outputs the selection stop data through the control line DTR.

With the bidirectional serial communication function as described above, mainly the operation data of the operation buttons from the operation devices 16A and 16B can be transmitted to the entertainment device 12 and the entertainment device 12 From this, a vibration generation command for rotating the drive motors 130R and 130L of the respective vibration imparting mechanisms 128R and 128L can be sent to the operation devices 16A and 16B via the data transmission signal line TXD.

The vibration generation command for rotating each of the drive motors 130R and 130L includes a command preset by a CD-ROM set in the entertainment device 12 and a command newly created by the entertainment device 12. For example, according to the operation target of the user who plays the game, the entertainment device 12 provides feedback to the operating devices 16A and 16B by vibration transmission for a certain period of time.

Next, the characteristic functions of the entertainment system 10 according to the present embodiment will be described with reference to FIG. 2 and FIGS.

As shown in FIG. 2, this function is to operate an operation device 16B (hereinafter, also referred to as an operation device 16B) as an operation device in accordance with an instruction from the entertainment device 12, and in particular, in this embodiment, In the form,
The operation device 16B is operated in accordance with the movement of the object 180 displayed on the monitor 18.

In this case, the object 180 displayed on the monitor 18 is an input signal from the operating device 16A,
In particular, it moves in accordance with an analog input value based on operations on the left and right rotary operators 44 and 46.

As shown in FIG. 12, the analog input values obtained by operating the left and right rotary operators 44 and 46 are "0" to "0" from top to bottom in the vertical direction.
"255", and "0" to "255" in the horizontal direction from left to right.

As software for realizing the above-mentioned functions, as shown in FIG. 13, for example, the operation device 16 is incorporated in the entertainment device 12 and moves in accordance with the movement of the object 180 displayed on the monitor 18.
B, which is incorporated in the operation devices 16A and 16B, and transmits operation data in accordance with a request from the entertainment device 12, and operates the drive motor 130R and the drive motor 130R based on a vibration generation command from the entertainment device 12. And / or operation processing means 202 for driving 130L.

As shown in FIG. 9, the operation instructing means 200 is, for example, downloaded from a specific CD-ROM reproduced in advance in the entertainment device 12 to the main memory of the entertainment device 12 through a predetermined process. The CP of the entertainment device 12
It is designed to operate on U80.

The operation processing means 202 stores the operation R from the program memory 154 of the operation devices 16A and 16B.
By being transferred to the AM 156, it is operated on the CPU 152 of the operating devices 16A and 16B.

As shown in FIG. 14, the operation instructing means 2
00 is the operation devices 16A and 1 via the communication control unit 90.
A communication requesting unit 21 for making a data transfer request (operation data transmission request or vibration generation command VC reception request) or a vibration generation command VC transmission request to 6B;
0 and the operation devices 16A and 16B via the communication control unit 90.
Communication path establishing means 212 for starting communication with the communication control unit 150 of the operating device 1 and establishing a communication path,
And data receiving means 214 for receiving operation data from 6A and 16B.

The operation instructing means 200 converts the received operation data, in particular, the analog input value into a value in which the sensitivity is partially reduced,
Input value conversion means 216 for converting into only a value (slope value) indicating only the inclination of each of the right and left rotation operators 44 and 46, and from the inclination value to each of the vibration imparting mechanisms 128R and / or 128L. Vibration value calculation means 218 for calculating a vibration value to be given, operation analysis means 220 for analyzing the operation state of the object 180 based on the obtained vibration value, and display of the object 180 on the monitor 18 to obtain the motion analysis. Display means 222 for operating the object 180 in accordance with the obtained operation information
And a vibration instructing means 2 for generating a vibration generation command VC from the obtained vibration value and transmitting it to the operating devices 16A and 16B.
24, and an end determination unit 226 that determines whether or not the processing in the entertainment apparatus 12 has ended.

As shown in FIG. 15, the operation processing means 202 of the operating devices 16A and 16B includes a transfer request determining means 230 for determining whether there is a data transfer request from the entertainment apparatus 12 via the communication control section 150. A communication path establishing unit 232 for starting communication with the communication control unit 90 of the entertainment apparatus 12 via the communication control unit 150 to establish a communication path when a data transfer request is received; Transmission / reception determining means 2 for determining
34.

The operation processing means 202 includes operation data transmitting means 236 for transmitting operation data from the digital input block 158 and the analog input block 160 to the entertainment device 12 through the established communication path, and entertainment data through the established communication path. Command receiving means 238 for receiving a vibration generation command VC from the device 12
And command analysis means 240 for analyzing the received vibration generation command VC and outputting the analysis result to the corresponding motor driver 170R and / or 170L, and whether or not the processing in the operating devices 16A and 16B has been completed. And end determination means 242 for performing the determination.

Next, the respective processing operations of the operation instructing means 200 in the entertainment apparatus 12 and the operation processing means 202 in the operation apparatus 16A (and the operation apparatus 16B) will be described with reference to the flowcharts of FIGS.

First, in step S1 of FIG. 16, the operation instructing means 200 transmits image data of a specific object 180, for example, an object 180 imitating a crab, to the monitor 18 through the object displaying means 222, as shown in FIG. Then, the object 180 is displayed on the screen of the monitor 18.

Next, in step S 2, the operation device 1 is transmitted via the communication request unit 210 via the communication control unit 90.
A data transfer request is made to 6A.

Next, in step S 3, the operating device 1 is transmitted through the communication control section 90 through the communication path establishing means 212.
Communication with the 6A communication control unit 150 is started to establish a communication path.

The processing operation of the operation processing means 202 in the operation device 16A at this time will be described.
In step S301 of FIG.
, And waits for a transfer request for operation data from the entertainment apparatus 12.

If there is a data transfer request from the entertainment device 12, the process proceeds to the next step S302, where communication with the communication control unit 90 of the entertainment device 12 is started via the communication control unit 150 via the communication path establishing means 232, and To establish. This communication path establishment processing is performed in cooperation with the communication path establishment processing in step S3 in the operation instruction means 200 of the entertainment apparatus 12.

Next, in step S303, the transmission / reception determining means 234 determines whether or not the data transfer request from the entertainment device 12 at this time is an operation data transmission request.

If it is a request to transmit operation data, the flow advances to the next step S304, where the digital input block 1 is transmitted through the established communication path via the operation data transmission means 236.
58 or the operation data from the analog input block 160 is transmitted.

When the processing in step S304 is completed, the flow advances to the next step S305, where the end determination means 2
Through 42, it is determined whether or not there is a request to end the processing in the operation device 16A. If there is no end request, the process returns to step S301, and the operation data is transmitted again. When there is a termination request, the processing by the operation processing unit 202 is terminated.

Returning to the routine of the operation instructing means shown in FIG. 16, in the next step S4, the data receiving means 21
4, the operation data from the operation device 16A is received through the established communication path and stored in, for example, a main memory. If the operation data is based on the operation of the left and right rotary operators 44 and 46, the left and right discrimination codes and the vertical value Lv and the horizontal value Lh are stored in the main memory.

Next, in step S5, the processing by the input value conversion means 216 is started. This input value conversion means 216
First, in step S101 in FIG. 18, it is determined whether or not the vertical value Lv satisfies 0 ≦ Lv ≦ 89.
If 0 ≦ Lv ≦ 89, the process proceeds to the next step S102, where 90 is subtracted from the current vertical value Lv, and the subtracted value is stored in the register R1.

In step S101, 0 ≦ Lv
If it is determined that ≦ 89, the process proceeds to step S103, and it is determined whether the vertical value Lv satisfies 90 ≦ Lv ≦ 165. If 90 ≦ Lv ≦ 165, the process proceeds to the next step S104, where “0” is stored in the register R1.

In step S103, 90 ≦ L
When it is determined that v ≦ 165, that is, the vertical value Lv
If 166 ≦ Lv ≦ 255, the process proceeds to the next step S105, in which 165 is subtracted from the current vertical value Lv, and the subtracted value is stored in the register R1.

At steps S101 to S105, the conversion process for the vertical value Lv is completed. At the next steps S106 to S110, the conversion process for the horizontal value Lh is performed.

By the above-described steps S101 to S110, of the operations on the left and right rotary operators 44 and 46, the operation near the center can have "play". Of course, the processing of steps S101 to S110 may not be performed, but the operation sensitivity of the left and right rotary operators 44 and 46 becomes very high, and the left and right rotary operators 44 and 4
Even with a slight displacement of 6, the operating device 16B may follow and move, and on the contrary, the usability may deteriorate. As mentioned above,
By providing the operation with "play", the operation device 16B can be moved almost in synchronization with the movement of the human finger, and the operation of the left and right rotary operators 44 and 46 can be given a margin.

Then, in the next step S111,
The inclination value Di of the left or right rotary operator 44 or 46 is calculated. This calculation is performed with Di = √ (R1 ² + R2 ² ). As a result, the slope value Di falls within the range of 0 ≦ Di ≦ 90.

Returning to the main routine of FIG. 16, in the next step S6, the current operation is
4 is determined. This is determined based on the received left and right distinction codes.

If it is an operation on the left rotary operation element 44, the process proceeds to the next step S7, and through the vibration value calculating means 218, the left vibration applying mechanism 1 in the operating device 16B.
Left vibration value V to be applied to 28L drive motor 130L
Calculate _L. This calculation is performed by V _L = 255 × inclination value (Di) / 90. As a result, the left vibration value _VL is in the range of 0 to 255. This is because the vibration level of the left drive motor 130L has 256 levels and the left vibration value _VL corresponding to this vibration level is set. Therefore, when the left vibration value _VL is 0, the vibration level becomes minimum, and when the left vibration value _VL is 255, the vibration level becomes maximum.

If it is determined in step S6 that the operation is for the right rotary operator 46, the flow advances to step S8 to determine whether or not the inclination value Di is greater than zero. If the gradient value Di is larger than 0, in step S9, the right vibration value V _R is set to "1", if the slope value Di is 0, in step S10, the right vibration value V _R "0" And

At the stage where any one of the above-mentioned steps S7, S9 and S10 is completed, the process proceeds to the next step S11, in which the operation analysis means 220 is started. Processing in the motion analysis unit 220, the right vibration value V _R and the left vibration value V _L
, The following four operating states are determined.

[0108] Condition 1: stopped 2: Left rotation state 3: Right rotating state 4: forward and state 1 (stop) is a right vibration value V _R is 0, the left vibration value V _L is 0 or more, less than 100 FIG. 1
In step 9, the routine goes from step S201 to step S202 to step S203. In step S203, "1" is set in the register Mi indicating the operation.
Is stored.

[0109] Condition 2 (left rotation) is right vibration value V _R is 0
In the left vibration value V _L is 100 or more, in the case of 255 or less, the right vibration value V _R is 1, greater than left vibration value V _L is 170, the case 255 below, in FIG. 19, step S201 → Step S202 → Step S204
Or step S201 → step S205
→ The routine of step S207 → step S209 is performed, and step S204 or step S209 is performed.
, "2" is stored in the register Mi indicating the operation.

[0110] Condition 3 (right rotation) is 1 the right vibration value V _R
This is the case where the left vibration value _VL is smaller than 100. In FIG. 19, step S201 → step S205 →
After the routine of step S206, "3" is stored in the register Mi indicating the operation in step S206.

[0111] state 4 (advancing) is, 1 is the right vibration value V _R
This is a case where the left vibration value _VL is 100 or more and 170 or less. In FIG.
It goes through the routine of 205 → step S207 → step S208, and in this step S208, “4” is stored in the register Mi indicating the operation.

[0112] Returning to the main routine of FIG. 17, in a next step S12, through the vibration instructing means 224, creating a vibration generating command VC based on the right vibration value V _R and left vibration value V _L.

Next, in step S13, a transfer request is made to the operating device 16B through the communication control unit 90 through the communication request means 210, and then, in step S14, the operation is performed through the communication path establishing means 212. The communication with the communication control unit 150 of the device 16B is started to establish a communication path. After that, in step S15, the vibration generation command VC is transmitted to the operating device 16B through the vibration communication unit 224 through the established communication path.

The processing operation of the operating device 16B at this time will be described. First, in step S301 of FIG. 20, the transfer request determining means 230 waits for a transfer request of operation data from the entertainment device 12.

If there is a data transfer request from the entertainment device 12, the process proceeds to the next step S302, where communication with the communication control unit 90 of the entertainment device 12 is started via the communication control unit 150 via the communication channel establishing means 232, and To establish. This communication channel establishment process is performed in cooperation with the communication channel establishment process in step S14 in the operation instruction means 200 of the entertainment apparatus 12.

Next, in step S303, the transmission / reception determining means 234 determines whether or not the data transfer request from the entertainment device 12 at this time is a request for transmitting operation data.

In this case, since it is a request to receive the vibration generation command VC, the process proceeds to step S306, and receives the vibration generation command VC from the entertainment device 12 through the established communication path via the command receiving means 238.

Then, in the next step S307,
The received vibration generation command VC is analyzed through the command analysis means 240, and the analysis result is output to the left and right motor drivers 170R and 170L.

[0119] right motor driver 170R drives the drive motor 130R on the basis of the right vibration value V _R from the command analyzing unit 240. Specifically, the right vibration value V
_{When R} is "1", a drive current is supplied to the drive motor 130R to drive the drive motor 130R, thereby giving a constant vibration to the right grip 108. If the right vibration value V _R is "0", the drive motor 130
The supply of the drive current to R is stopped.

On the other hand, the left motor driver 170L is
The rotation speed of the drive motor 130L is determined by the command
It is driven so as to change according to the left vibration value _VL (0 to 255) from 0, and the left gripper 106 is driven to the left vibration value _VL.
Vibration is performed at a vibration intensity and a vibration frequency according to.

When the processing in step S307 is completed, the flow advances to the next step S305, where the end determination means 2
Through 42, it is determined whether or not there is a request to end the processing in the operating device 16B. If there is no end request, the process returns to step S301, and the vibration generation command VC is received again. If there is an end request, the processing by the operation processing means 202 ends.

Returning to the routine of the operation instructing means 200 shown in FIG. 17, in the next step S16, the value of the register Mi indicating the operation of the object 180 displayed on the screen of the monitor 18 is displayed through the object displaying means 222. Operate according to.

That is, if the value of the register Mi is “1”, the object 180 is set to the stop state. At this time,
The operation device 16B, 0 as the right vibration value V _R, for 0 ≦ V _L <100 as the left vibration value V _L is supplied, it is stopped said operating device 16B. That is, the left vibration value V
_L is a small value of less than 100, yet, since the right vibration value V _R is 0 in the case of V _L> 0, the rotation of the left motor 130L is slowly in the operation device 16B, the operation device 16B Driving force enough to operate is not obtained, and apparently the vehicle is stopped. of course,
When V _L = 0, the state is completely stopped.

If the value of the register Mi is "2",
The object 180 is rotated left. At this time,
The right vibration value V_R0, left vibration value V_L
100 ≦ V_L≤ 255 supplied or right-handed vibration
Value V_R1, left side vibration value V _L170 <V_L≦ 2
55 is supplied, the operating device 16B also rotates counterclockwise.
Will do.

If the value of the register Mi is "3",
The object 180 is rotated right. At this time, the operation device 16B, 1 as the right vibration value V _R, the left vibration value V _L
Since V _L <100 is supplied as will also be right rotation said operating device 16B.

If the value of the register Mi is "4",
Move object 180 forward. At this time, the operation device 16B, 1 as the right vibration value V _R, for 100 ≦ V _L ≦ 170 as the left vibration value V _L is supplied, so that also advancing said operating device 16B.

Next, in step S17, it is determined through the end determination means 226 whether or not a request for terminating the processing by the operation instruction means 200 has been made. If there is no end request, the process returns to step S2 and the operation device 1
Based on the operation data from 6A, the object 180 on the screen of the monitor 18 is operated, and at the same time, the operating device 16B is operated in substantially the same direction as the object 180. This operation is a concept including stopping.

If there is a termination request in step S17, the operation instruction means 200 terminates.

As described above, the entertainment device 12 for executing various programs, at least one operation device 16A for inputting an operation request from a user to the entertainment device 12, and at least one operation for operating in accordance with an instruction from the entertainment device 12. Device 16
B, the operation device 16 occupying the space
B moves in accordance with the instruction from the entertainment device 12. For example, when the user is moving the object 180 displayed on the monitor 18 using the operating device 16A, the operating device 16B is moved in accordance with the movement of the object 180. Operation.

Therefore, when the entertainment system 10 according to the present embodiment is applied to, for example, a video game machine, the user can change the video game that has been progressing only on the screen of the monitor 18 to operate in space. Device 16B
You can enjoy more while watching, and you can create a new way of enjoying video games.

In the above example, the object 180 displayed on the screen of the monitor 18 is operated based on the operation data from the operation device 16A, and at the same time, the operation device 16B connected to the entertainment device 12 is operated. However, the object 180 and the operating device 16B may be operated based on data of a preset operation pattern.

[0132] In this case, as shown in FIG. 14, for example, the operation instructing means 200, the data (e.g., the right vibration value of the operation pattern from the operation pattern file 260 data are arranged in advance operation pattern V _R and left vibration value V _L ) may be sequentially read out, and a demonstration processing unit 262 for operating the object 180 and the operation device 16B based on the data may be provided.

[0133] The operation pattern file 260, for example, as shown in FIG. 21, the left vibration value V _L in the record
File structure right vibration value V _R is stored and can be employed.

Here, demonstration processing means 2
The processing operation of 62 will be described based on the flowchart of FIG.

The demonstration processing means 262
First, in step S401 in FIG. 22, an initial value "0" is stored in an index register i used for a record search of the operation pattern file 260, and the index register i is initialized.

Next, in step S402, pattern data (left vibration value _VL and right vibration value V _R ) is read from the i record of the operation pattern file 260.

Next, in step S403, it is determined whether or not the read pattern data is a code indicating the end of the data, for example, EOD (end of data). If the data has not ended, the process proceeds to the next step S404, and the processing in the operation analyzing means 220 is started. As described above, the operation of the operation analyzing means 220 is the same as the operation shown in FIG. 19, and the description thereof is omitted here. _L and the operation state based on the right vibration value V _R (1: stop, 2: left rotation, 3: right rotation, 4: forward) is stored.

[0138] Next, in step S405, through the vibration instructing means 224, creating a vibration generating command VC based on the right vibration value V _R and left vibration value V _L.

Next, in step S406, a transfer request is made to the operating device 16B via the communication control unit 90 via the communication requesting means 210, and then, in step S407, the operation is performed via the communication path establishing means 212. The communication with the communication control unit 150 of the device 16B is started to establish a communication path. Then, in step S408, the vibration generation command VC is transmitted to the operation device 16B via the vibration communication means 224 via the established communication path.

Next, in step S409, the object 180 displayed on the screen of the monitor 18 is operated through the object display means 222 according to the value of the register Mi indicating the operation.

As a result, the operating device 16B operates in accordance with the operation of the object 180 displayed on the screen of the monitor 18.

Next, in step S410, the value of the index register i is updated by +1 and then, in step S4
02, and repeats the processing from step S402. That is, the pattern data is read from the next record of the operation pattern file 260, and the object 180 and the operation device 16B are operated based on the pattern data.

When it is determined in step S403 that the data has been completed, the processing by the demonstration processing means 262 ends.

The demonstration processing means 262
Is used, the object 180 and the operating device 16B can be operated based on preset pattern data, and various demonstrations can be expressed on the screen of the monitor 18 and the operating device 16B.

In the above example, the operating device 16B is moved in accordance with the movement of one object 180 displayed on the screen of the monitor 18.
As shown in the figure, a plurality of objects (for example, objects 180A and 18
0B) is displayed and these objects 180A and 1
At the same time as displaying an operation for fighting the 80B, a plurality of operating devices 16 connected to the entertainment device 12 are displayed.
C and 16D are assigned to the plurality of objects 180A and 1
You may make it operate according to 80B.

In this case, for example, two operating devices 16A and 16B are connected to one slot (for example, 30A) of the entertainment device 12 by using the connection hub 250, and
The two operating devices 16C and 16D are connected. Operating device 1
6C and 16D may have the same configuration as the operating devices 16A and 16B, but may be wrestler models 16C and 16D as shown in FIG. Then, the operation device 16A is attached to the models 16C and 16D of each wrestler.
Right and left vibration imparting mechanisms 128R provided in the inside and the 16B
And 128L similar vibration imparting mechanisms 128R and 128L
By providing L, it is possible to operate according to the wrestlers 180A and 180B displayed on the screen of the monitor 18, and to provide the user with a new way of enjoying the battle game.

[0147] The entertainment system and the recording medium according to the present invention are not limited to the above-described embodiment.
Of course, various configurations can be adopted without departing from the gist of the present invention.

[0148]

As described above, according to the entertainment and recording medium of the present invention, an object imitating an object displayed on a monitor (occupying a three-dimensional space and subject to human perception) can be obtained. The operation can be performed in accordance with the movement of the object. For example, not only the movement of the object on the monitor screen but also the movement of the object in space can be enjoyed by using the operation device.

[Brief description of the drawings]

FIG. 1 is a configuration diagram showing an entertainment system according to an embodiment.

FIG. 2 is an explanatory diagram showing an example of a use form in the entertainment system according to the present embodiment.

FIG. 3 is a perspective view showing an operation device.

FIG. 4 is a plan view showing the operation device.

FIG. 5 is a perspective view showing a use state of the operating device.

FIG. 6 is a partially cutaway bottom view showing a state in which a vibration imparting mechanism is provided in left and right grips.

FIG. 7 is an exploded perspective view showing a vibration imparting mechanism.

FIG. 8 is a perspective view showing a state in which the vibration imparting mechanism is incorporated in the operation device.

FIG. 9 is a block diagram showing a circuit configuration of the entertainment device.

FIG. 10 is a block diagram illustrating a configuration of an operating device.

FIG. 11 is a block diagram showing a main part for performing bidirectional serial communication between the operation device and the entertainment device.

FIG. 12 is an explanatory diagram showing a relationship between a vertical value and a horizontal value by operating left and right rotary operators.

FIG. 13 is a functional block diagram showing a configuration of an entertainment system according to the present embodiment.

FIG. 14 is a functional block diagram illustrating a configuration of an operation instruction unit.

FIG. 15 is a functional block diagram illustrating a configuration of an operation processing unit.

FIG. 16 is a flowchart (part 1) illustrating a processing operation of the operation instruction means;

FIG. 17 is a flowchart (part 2) illustrating the processing operation of the operation instruction means;

FIG. 18 is a flowchart showing a processing operation of an input conversion unit.

FIG. 19 is a flowchart showing a processing operation of a motion analysis unit.

FIG. 20 is a flowchart illustrating a processing operation of an operation processing unit.

FIG. 21 is a flowchart showing details of an operation pattern file.

FIG. 22 is a flowchart showing the processing operation of the demonstration processing means.

FIG. 23 is an explanatory diagram showing an example of another usage form in the entertainment system according to the present embodiment.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 10 ... Entertainment system 12 ... Entertainment device 16A ... Operating device 16B ... Operating device (operating device) 16C, 16D ... Operating device (model of wrestler) 18 ... Monitor 20 ... Optical disk 44 ... Left-hand rotary operator 46 ... Right-hand rotary operation Child 106: Left grip 108: Right grip 128R, 128L: Vibration imparting mechanism 130R, 130
L: Driving motor 170R, 170L: Motor driver 180, 180A, 180B: Object 200: Operation instructing means 202: Operation processing means 216: Input value converting means 218: Vibration value calculating means 220: Motion analyzing means 222: Object displaying means 224 ... vibration instruction means 250 ... connection hub 262 ... demonstration processing means

 ────────────────────────────────────────────────── ─── Continued on the front page (72) Inventor Akira Koike 7-1-1 Akasaka, Minato-ku, Tokyo Sony Computer Entertainment Inc.

Claims (14)

[Claims] An entertainment device for executing various programs, at least one operating device for inputting an operation request from a user to the entertainment device, and at least one operating device for operating in accordance with an instruction from the entertainment device An entertainment system characterized by the following. 2. The entertainment system according to claim 1, further comprising a plurality of said operating devices, wherein at least one of said plurality of operating devices also serves as said operating device. Entertainment system. 3. The entertainment system according to claim 1, further comprising: a display device for displaying an image output from the entertainment device, wherein the operating device is adapted to a movement of an object displayed on the display device. An entertainment system comprising an operation instructing means for operating a computer. 4. The entertainment system according to claim 3, wherein the object moves according to operation information based on an input signal from the operation device. 5. The entertainment system according to claim 3, wherein the object moves according to preset operation information. 6. The entertainment system according to claim 3, further comprising: vibration generating means for generating vibration in accordance with an instruction from said entertainment device, wherein said operation device includes: An entertainment system comprising: an object display unit that displays the object on the display device and operates according to the operation information; and a vibration instruction unit that outputs the operation information as vibration information to the vibration generation unit. . 7. The entertainment system according to claim 6, wherein said vibration generating means has a plurality of vibration sources having different vibration characteristics, and said vibration instruction means transmits vibration information to be given to each vibration source to each vibration. An entertainment system characterized by performing calculations in accordance with the vibration characteristics of the source. 8. An entertainment device in which an operation device for outputting at least a user's operation request and a display device for displaying an image can be connected to the entertainment device main body, according to an instruction from the entertainment device main body. An entertainment device, wherein at least one operating device that operates is connectable. 9. An entertainment device for executing various programs; at least one operating device connected to the entertainment device for inputting a user operation request to the entertainment device; and an entertainment device connected to the entertainment device. At least one that works according to instructions from
In a recording medium in which a program or data used in an entertainment system having one operating device and a display device for displaying at least one object, the program is adapted to detect the movement of the object displayed on the display device. A recording medium, comprising: an operation instruction step for operating the operation device together. 10. The recording medium according to claim 9, wherein the object moves according to operation information based on an input signal from the operation device. 11. The recording medium according to claim 9, wherein the object moves according to preset operation information. 12. The recording medium according to claim 9, further comprising: a vibration generating unit configured to generate vibration in accordance with an instruction from the entertainment device, in the operation device, wherein the operation instruction step includes: A recording medium comprising: an object display step of displaying the object on the display device and operating the object in accordance with the operation information; and a vibration instruction step of outputting the operation information as vibration information to the vibration generation unit. . 13. A recording medium according to claim 12, wherein said vibration generating means has a plurality of vibration sources having different vibration characteristics, and said vibration instruction step includes transmitting vibration information to be given to each vibration source to each vibration source. A recording medium, wherein the calculation is performed in accordance with the vibration characteristics of the source. 14. An entertainment device for executing various programs, at least one operating device connected to the entertainment device and inputting a user's operation request to the entertainment device, and an entertainment device connected to the entertainment device. At least one that works according to instructions from
A computer which is used in an entertainment system having one operating device and a display device for displaying at least one object, and which can be read and executed by a computer, in accordance with the movement of the object displayed on the display device. A program having an operation instruction step for operating an apparatus.