JP4735802B2 - GAME DEVICE, GAME PROGRAM, AND GAME DEVICE CONTROL METHOD - Google Patents

Description

  The present invention relates to a game apparatus for playing a game by operating an object displayed on a display by operating an operation article, and a related technology.

  Patent Document 1 discloses the following maze game device. The player operates an input device (keyboard, mouse, etc.) to move the object displayed on the display, and proceeds through the maze. In this case, the maze is changed every time a predetermined time elapses. This provides a maze game in which the player does not get bored.

  On the other hand, there are conventional games in the following real space. For example, a path is formed by arranging two metal lines in the vertical direction. The player inserts a bar with metal attached into the path from the side, and moves the bar along the path so as not to contact the metal line. Since current flows through the two metal wires, if any metal wire comes into contact with the metal portion of the rod, a spark is scattered and the game is over.

  Conventionally, there is a mobile game that realizes such a game in real space in a virtual space. That is, the player operates an input device (such as a game machine controller) to move an object displayed on the display, and proceeds through the maze. When the object touches the wall of the maze, the game is over. As such a mobile game device, for example, there is a video game released by Zaurus Co., Ltd. on March 19, 1998 (trade name “Current Frustrated Bar (registered trademark) Returns”).

JP 2002-263370 A (0020, FIG. 8)

  In the conventional maze game apparatus as described above, the operation of the object is performed by a mouse or the like, which is a general input device of a personal computer, and is merely an extension of the operation of the personal computer. In addition, since an input device such as a mouse is for a personal computer, it cannot be said that it is necessarily suitable for such a game device in terms of operability. In the case of a game using a personal computer, it may be difficult for those who are not familiar with the personal computer to execute the game.

  In the conventional mobile game apparatus as described above, since the operation of the object is performed by a general-purpose controller for a game machine, the object is moved by operating a direction key or an analog stick. That is, the game machine controller itself is not basically moved, but the object is moved by pressing a mounted direction key or pushing an analog stick. Some people may find it difficult to operate, and it may be difficult to perform a sufficient operation as intended.

  Therefore, an object of the present invention is to provide a game device that enables an intuitive operation of an object displayed on a display and can play a game by an easy operation.

  According to the first aspect of the present invention, the game device is configured to irradiate the operation article operated by the player with light at a predetermined cycle, and each time the stroboscope is turned on and off. Imaging means for photographing the operation article and generating an image signal at the time of emission and an image signal at the time of extinction; difference signal generation means for generating a difference signal between the image signal at the time of emission and the image signal at the time of extinction; State information calculating means for calculating state information of the operation article based on the difference signal; and interlocking object control means for controlling display of the interlocking object linked to the operation article based on the state information of the operation article; And a restricted image control means for controlling a restricted image for restricting the movement of the interlocking object.

  According to this configuration, since the interlocking object moves in conjunction with the movement of the operation article itself, an intuitive operation of the interlocking object is possible, and a game can be played with an easy operation.

  In this game apparatus, the game is over when the interlocking object touches or enters the area where the restricted image is displayed.

  According to this configuration, since the operation object itself can be moved to operate the interlocking object, the restricted image and the interlocking object are present on the display, as if avoiding obstacles existing in the real space. It is possible to give the player the impression of moving the operation article. In addition, the cost can be reduced and the space can be saved as compared with a game device that avoids an obstacle existing in the real space.

  According to the second aspect of the present invention, the game device has a stroboscope that irradiates the operation article operated by the player with light in a predetermined cycle, and each time the stroboscope is turned on and off. Imaging means for photographing the operation article and generating an image signal at the time of emission and an image signal at the time of extinction; difference signal generation means for generating a difference signal between the image signal at the time of emission and the image signal at the time of extinction; Based on the difference signal, state information calculation means for calculating the state information of the operation article, and cursor control for controlling the display of the cursor representing the position of the operation article on the screen based on the state information of the operation article Means and tracking object control means for controlling the display of the tracking object that follows the movement of the cursor based on the coordinate information of the cursor.

  According to this configuration, since the cursor represents the position of the operation article on the screen, the movement of the cursor needs to be synchronized or almost synchronized with the operation article. For this reason, the control of the cursor is restricted by the movement of the operation article. On the other hand, since the following object follows the movement of the cursor, it is possible to arbitrarily determine how the cursor follows the cursor. Therefore, it is possible to focus on the movement of the tracking object and to increase the visual effect.

  Further, since the cursor is controlled based on the state information of the operation article, the cursor moves in synchronization with or substantially in synchronization with the movement of the operation article itself. Therefore, the player can intuitively operate the cursor, and can play the game with an easy operation.

  The game apparatus may further include a restricted image control unit that controls a restricted image that restricts movement of the following object.

  According to this configuration, the player must move the tracking object so as to avoid the restricted image by operating the cursor with the operation article. For this reason, game nature improves and it becomes more interesting for a player.

  In this game apparatus, the game is over when the following object touches or enters the area where the restricted image is displayed.

  According to this configuration, since the operation object itself can be moved to operate the cursor and the tracking object, the restriction image, the cursor, and the tracking object exist on the display, but the obstacle exists as if in the real space. It is possible to give the player the impression of moving the operation object while avoiding the object. In addition, the cost can be reduced and the space can be saved as compared with a game device that avoids an obstacle existing in the real space.

  The game apparatus may further include a game continuation management unit that manages information serving as an index by which the player can continue the game and ends the game based on the information serving as the index.

  According to this configuration, the player can no longer play the game without limitation, so that a sense of tension increases and a more interesting game device can be provided.

  In the above game device, the restricted image is an image constituting a maze.

  According to this configuration, the interlocking object, or the cursor and the tracking object move in conjunction with the movement of the operation article itself, so that these intuitive operations can be performed, and a maze game can be performed by an easy operation. Can do.

  In the above game device, the state information of the operation article calculated by the state information calculation unit includes speed information, movement direction information, movement distance information, speed vector information, acceleration information, movement trajectory information, area information, or Any one of the position information, or a combination of two or more thereof.

  According to this configuration, the interlocking object or the cursor can be controlled using various pieces of information of the operation article, so that the degree of freedom in designing the game content is increased.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the drawings, the same or corresponding parts are denoted by the same reference numerals, and the description thereof is incorporated.

  FIG. 1 is a diagram showing an overall configuration of a game system according to an embodiment of the present invention. As shown in FIG. 1, the game system includes a game apparatus 1, an operation article 150, and a television monitor 90.

  An imaging unit 13 is incorporated in the housing 19 of the game apparatus 1. The imaging unit 13 includes four infrared light emitting diodes 15 and an infrared filter 17. The light emitting part of the infrared light emitting diode 15 is exposed from the infrared filter 17.

  A DC power supply voltage is applied to the game apparatus 1 by an AC adapter 92. However, instead of the AC adapter 92, a DC power supply voltage can be applied by a battery (not shown).

  The television monitor 90 is provided with a screen 91 on the front surface thereof. The television monitor 90 and the game apparatus 1 are connected by an AV cable 93. Note that the game apparatus 1 is placed on the upper surface of the television monitor 90, for example, as shown in FIG.

  When the player 94 turns on a power switch (not shown) provided on the back of the game apparatus 1, a game screen is displayed on the screen 91. The player 94 operates the operation article 150 to move a cursor and a tracking object (described later) on the game screen to execute the game. Here, the operation of the operation article 150 means moving (for example, moving) the operation article itself, and does not include pressing a switch, moving an analog stick, or the like.

  The infrared light emitting diode 15 of the imaging unit 13 emits infrared light intermittently. Infrared light from the infrared light emitting diode 15 is reflected by a reflection sheet (described later) attached to the operation article 150 and is input to an imaging device (described later) provided inside the infrared filter 17. In this way, the operation article 150 is photographed intermittently. Therefore, the game apparatus 1 can acquire an intermittent image signal of the operation article 150 moved by the player 94. The game apparatus 1 analyzes this image signal and reflects the analysis result in the game.

  The reflective sheet used in the present embodiment is, for example, a retroreflective sheet.

  FIG. 2 is a perspective view of the operation article 150 of FIG. As shown in FIG. 2, the operation article 150 is configured by fixing a reflective ball 151 to the tip of a stick 152. The reflection ball 151 reflects infrared light from the infrared light emitting diode 15. Details of the reflective ball 151 will be described.

  3A is a top view of the reflective ball 151 in FIG. 2, FIG. 3B is a side view of the reflective ball 151 from the direction of arrow A in FIG. 3A, and FIG. It is a side view of the reflective ball | bowl 151 from the arrow B direction of 3 (a).

  As shown in FIG. 3A to FIG. 3C, the reflective ball 151 includes a spherical inner shell inside a spherical outer shell 153 having a transparent color (including translucent, colored transparent, and colorless transparent). 154 is fixed. A reflective sheet 155 is attached to the spherical inner shell 154. The reflection sheet 155 reflects the infrared light from the infrared light emitting diode 15.

  4 is a longitudinal sectional view of the reflective ball 151 of FIG. As shown in FIG. 4, the spherical outer shell 153 is formed by fixing two hemispherical outer shells with a boss 156 and a screw (not shown). The spherical inner shell 154 is formed by fixing two hemispherical inner shells with a boss 157 inside the spherical outer shell 153. Further, a stick 152 is inserted and fixed to the reflective ball 151. Specifically, the stick 152 is sandwiched between two hemispherical outer shells constituting the spherical outer shell 153 and two hemispherical inner shells constituting the spherical inner shell 154, and the two hemispherical outer shells are connected to the boss 156. In addition, the stick 152 is attached to the reflective ball 151 by fixing the two hemispherical inner shells with the boss 157 together with the screws.

  FIG. 5 is an illustrative view showing one example of the imaging unit 13 of FIG. As shown in FIG. 5, the imaging unit 13 includes a unit base 35 formed by plastic molding, for example, and a support cylinder 36 is attached in the unit base 35. A trumpet-shaped opening 41 whose inner surface has an inverted conical shape is formed on the upper surface of the support cylinder 36, and a concave lens 39 is formed inside the cylindrical portion below the opening 41, for example, by molding of transparent plastic. An optical system including a convex lens 37 is provided, and an image sensor 43 as an image sensor is fixed below the convex lens 37. Therefore, the image sensor 43 can take an image corresponding to light incident from the opening 41 through the lenses 39 and 37.

  The image sensor 43 is a low-resolution CMOS image sensor (for example, 32 pixels × 32 pixels: gray scale). However, the image sensor 43 may have a larger number of pixels or may be composed of other elements such as a CCD. In the following description, it is assumed that the image sensor 43 is composed of 32 pixels × 32 pixels.

  In addition, a plurality (four in the embodiment) of infrared light emitting diodes 15 whose light emission directions are all upward are attached to the unit base 35. This infrared light emitting diode 15 irradiates infrared light above the imaging unit 13. An infrared filter (a filter that transmits only infrared light) 17 is attached above the unit base 35 so as to cover the opening 41. The infrared light emitting diode 15 functions as a stroboscope because lighting / extinguishing (non-lighting) is repeated continuously as will be described later. However, “stroboscope” is a general term for devices that illuminate a moving body intermittently. Therefore, the image sensor 43 photographs an object that moves within the photographing range, that is, the operation article 150. As will be described later with reference to FIG. 8, the stroboscope mainly includes an infrared light emitting diode 15, an LED drive circuit 75, and a high-speed processor 200.

  Here, the imaging unit 13 is incorporated in the housing 19 so that the light receiving surface of the image sensor 43 is inclined by a predetermined angle (for example, 90 degrees) from the horizontal plane. Further, the imaging range of the image sensor 43 by the concave lens 39 and the convex lens 37 is, for example, a range of 60 degrees.

  FIG. 6 is a diagram showing an electrical configuration of the game apparatus 1 of FIG. As shown in FIG. 6, the game apparatus 1 includes an image sensor 43, an infrared light emitting diode 15, a video signal output terminal 47, an audio signal output terminal 49, a high speed processor 200, a ROM (read only memory) 51, and a bus 53. ,including.

  A bus 53 is connected to the high speed processor 200. Further, the ROM 51 is connected to the bus 53. Accordingly, since the high speed processor 200 can access the ROM 51 via the bus 53, the game program stored in the ROM 51 can be read and executed, and the image data and musical tone data stored in the ROM 51 are read. Thus, a video signal and an audio signal can be generated and output to the video signal output terminal 47 and the audio signal output terminal 49.

  The operation article 150 is irradiated with infrared light emitted from the infrared light emitting diode 15, and the infrared light is reflected by the reflection sheet 155. The reflected light from the reflection sheet 155 is detected by the image sensor 43, and thus the image signal of the reflection sheet 155 is output from the image sensor 43. The analog image signal from the image sensor 43 is converted into digital data by an A / D converter (described later) built in the high speed processor 200. Similar processing is performed when the infrared light is turned off. The high speed processor 200 analyzes the digital data and reflects the analysis result in the game process.

  FIG. 7 is a block diagram of the high speed processor 200 of FIG. As shown in FIG. 7, the high-speed processor 200 includes a central processing unit (CPU) 201, a graphic processor 202, a sound processor 203, a DMA (direct memory access) controller 204, a first bus arbitration circuit 205, Second bus arbitration circuit 206, internal memory 207, A / D converter (ADC: analog to digital converter) 208, input / output control circuit 209, timer circuit 210, DRAM (dynamic random access memory) refresh control circuit 211, external memory interface Circuit 212, clock driver 213, PLL (phase-locked loop) circuit 214, low voltage detection circuit Path 215, first bus 218, and second bus 219.

  The CPU 201 performs various operations and controls the entire system according to a program stored in the memory (the internal memory 207 or the ROM 51). The CPU 201 is a bus master of the first bus 218 and the second bus 219, and can access resources connected to the respective buses.

  The graphic processor 202 is a bus master of the first bus 218 and the second bus 219, generates a video signal based on data stored in the internal memory 207 or the ROM 51, and outputs the video signal to the video signal output terminal 47. . The graphic processor 202 is controlled by the CPU 201 through the first bus 218. The graphic processor 202 has a function of generating an interrupt request signal 220 to the CPU 201.

  The sound processor 203 is a bus master of the first bus 218 and the second bus 219, generates an audio signal based on data stored in the internal memory 207 or the ROM 51, and outputs the audio signal to the audio signal output terminal 49. . The sound processor 203 is controlled by the CPU 201 through the first bus 218. Further, the sound processor 203 has a function of generating an interrupt request signal 220 to the CPU 201.

  The DMA controller 204 manages data transfer from the ROM 51 to the internal memory 207. The DMA controller 204 has a function of generating an interrupt request signal 220 to the CPU 201 in order to notify the completion of data transfer. The DMA controller 204 is a bus master for the first bus 218 and the second bus 219. The DMA controller 204 is controlled by the CPU 201 through the first bus 218.

  The internal memory 207 includes necessary ones among a mask ROM, an SRAM (static random access memory), and a DRAM. When it is necessary to hold SRAM data by a battery, the battery 217 is required. When a DRAM is installed, an operation for holding stored contents called refresh is required periodically.

  The first bus arbitration circuit 205 receives a first bus use request signal from each bus master of the first bus 218, performs arbitration, and issues a first bus use permission signal to each bus master. Each bus master is permitted to access the first bus 218 by receiving the first bus use permission signal. Here, the first bus use request signal and the first bus use permission signal are shown as a first bus arbitration signal 222 in FIG.

  The second bus arbitration circuit 206 receives a second bus use request signal from each bus master of the second bus 219, performs arbitration, and issues a second bus use permission signal to each bus master. Each bus master is permitted to access the second bus 219 by receiving the second bus use permission signal. Here, the second bus use request signal and the second bus use permission signal are shown as a second bus arbitration signal 223 in FIG.

  The input / output control circuit 209 performs communication with an external input / output device or an external semiconductor element via an input / output signal. Input / output signals are read / written from the CPU 201 via the first bus 218. The input / output control circuit 209 has a function of generating an interrupt request signal 220 to the CPU 201.

  The input / output control circuit 209 outputs an LED control signal LEDC for controlling the infrared light emitting diode 15.

  The timer circuit 210 has a function of generating an interrupt request signal 220 for the CPU 201 based on a set time interval. The time interval and the like are set by the CPU 201 via the first bus 218.

  The ADC 208 converts the analog input signal into a digital signal. This digital signal is read by the CPU 201 via the first bus 218. Further, the ADC 208 has a function of generating an interrupt request signal 220 to the CPU 201.

  The ADC 208 receives pixel data (analog) from the image sensor 43 and converts it into digital data.

  The PLL circuit 214 generates a high frequency clock signal obtained by multiplying the sine wave signal obtained from the crystal resonator 216.

  The clock driver 213 amplifies the high frequency clock signal received from the PLL circuit 214 to a signal strength sufficient to supply the clock signal 225 to each block.

  The low voltage detection circuit 215 monitors the power supply voltage Vcc, and issues a reset signal 226 of the PLL circuit 214 and other system-wide reset signals 227 when the power supply voltage Vcc is equal to or lower than a certain voltage. Further, when the internal memory 207 is composed of SRAM and data retention by the SRAM battery 217 is required, the battery backup control signal 224 is issued when the power supply voltage Vcc is equal to or lower than a predetermined voltage. .

  The external memory interface circuit 212 has a function for connecting the second bus 219 to the external bus 53, and a function for controlling the bus cycle length of the second bus by issuing a cycle end signal 228 of the second bus 219. Have.

  The DRAM refresh control circuit 211 unconditionally acquires the right to use the first bus 218 at regular intervals and performs a DRAM refresh operation. The DRAM refresh control circuit 211 is provided when the internal memory 207 includes a DRAM.

  Here, a configuration for capturing pixel data from the image sensor 43 to the high-speed processor 200 will be described in detail with reference to FIGS.

  FIG. 8 is a circuit diagram showing a configuration and an LED driving circuit for fetching pixel data from the image sensor 43 in FIG. 6 to the high-speed processor 200. FIG. 9 is a timing chart showing an operation when the pixel data is taken into the high speed processor 200 from the image sensor 43 of FIG. FIG. 10 is an enlarged timing diagram showing a part of FIG.

  As shown in FIG. 8, since the image sensor 43 is of a type that outputs pixel data D (X, Y) as an analog signal, the pixel data D (X, Y) is an analog input port of the high-speed processor 200. Is input. The analog input port is connected to the ADC 208 in the high-speed processor 200, and thus the high-speed processor 200 acquires pixel data converted from the ADC 208 into digital data therein.

  The midpoint of the analog pixel data D (X, Y) described above is determined by the reference voltage applied to the reference voltage terminal Vref of the image sensor 43. Therefore, a reference voltage generation circuit 59 composed of, for example, a resistance voltage dividing circuit is provided in association with the image sensor 43, and a reference voltage having a constant magnitude is always supplied from the circuit 59 to the reference voltage terminal Vref.

  Each digital signal for controlling the image sensor 43 is supplied to or output from the I / O port of the high-speed processor 200. Each of these I / O ports is a digital port capable of controlling input / output, and is connected to the input / output control circuit 209 by this high speed processor 200.

  More specifically, a reset signal reset for resetting the image sensor 43 is output from the output port of the high speed processor 200 and is supplied to the image sensor 43. Further, the image sensor 43 outputs a pixel data strobe signal PDS and a frame status flag signal FSF, and these signals are given to the input port of the high speed processor 200.

  The pixel data strobe signal PDS is a strobe signal as shown in FIG. 9B for reading each pixel signal D (X, Y) described above. The frame status flag signal FSF is a flag signal indicating the state of the image sensor 43, and defines the exposure period of the image sensor 43 as shown in FIG. That is, the low level shown in FIG. 9A of the frame status flag signal FSF indicates the exposure period, and the high level shown in FIG. 9A indicates the non-exposure period.

  The high speed processor 200 outputs a command (or command + data) to be set in a control register (not shown) of the image sensor 43 from the I / O port as register data, and repeats, for example, a high level and a low level. A set clock CLK is output and supplied to the image sensor 43.

  As the infrared light emitting diode 15, four infrared light emitting diodes 15a, 15b, 15c and 15d connected in parallel with each other are used as shown in FIG. As described above, the four infrared light emitting diodes 15a to 15d irradiate infrared light in the same direction as the viewpoint direction of the image sensor 43 so as to illuminate the operation article 150, and the image sensor 43. Arranged to surround. However, these individual infrared light-emitting diodes 15a to 15d are simply referred to as infrared light-emitting diodes 15 unless it is particularly necessary to distinguish them.

  The infrared light emitting diode 15 is turned on or off (not lit) by the LED drive circuit 75. The LED drive circuit 75 receives the above-described frame status flag signal FSF from the image sensor 43, and this flag signal FSF is given to the base of the PNP transistor 77 through a differentiation circuit 67 including a resistor 69 and a capacitor 71. A pull-up resistor 79 is further connected to the PNP transistor 77, and the base of the PNP transistor 77 is normally pulled up to a high level. When the frame status signal FSF becomes low level, the low level is input to the base via the differentiation circuit 67, so that the PNP transistor 77 is turned on only when the flag signal FSF is low level.

  The emitter of the PNP transistor 77 is grounded via resistors 73 and 65. The connection point between the emitter resistors 73 and 65 is connected to the base of the NPN transistor 81. The collector of the NPN transistor 81 is commonly connected to the anodes of the infrared light emitting diodes 15a to 15d. The emitter of the NPN transistor 81 is directly connected to the base of another NPN transistor 61. The collector of the NPN transistor 61 is commonly connected to the cathodes of the infrared light emitting diodes 15a to 15d, and the emitter is grounded.

  In this LED drive circuit 75, only when the LED control signal LEDC output from the I / O port of the high speed processor 200 is active (high level) and the frame status flag signal FSF from the image sensor 43 is low level. The infrared light emitting diode 15 is turned on.

  As shown in FIG. 9A, when the frame status flag signal FSF becomes low level, the PNP transistor 77 is turned on during the low level period (although there is actually a delay due to the time constant of the differentiation circuit 67). Therefore, when the LED control signal LEDC shown in FIG. 9D is output from the high speed processor 200 at a high level, the base of the NPN transistor 81 becomes high level, and the transistor 81 is turned on. When the transistor 81 is turned on, the transistor 61 is turned on. Therefore, a current flows from the power source (indicated by small white circles in FIG. 8) through each of the infrared light emitting diodes 15a to 15d and the transistor 61. Accordingly, as shown in FIG. 9E, each of the infrared light emitting diodes 15a to 15d Illuminated.

  In this way, in the LED drive circuit 75, the infrared light-emitting diode 15 is activated only when the LED control signal LEDC in FIG. 9D is active and the frame status flag signal FSF in FIG. 9A is at a low level. Since it is lit, the infrared light emitting diode 15 is lit only during the exposure period of the image sensor 43 (see FIG. 9F).

  Therefore, useless power consumption can be suppressed. Further, since the frame status flag signal FSF is coupled by the capacitor 71, even if the flag signal FSF is stopped at a low level due to the runaway of the image sensor 43, the transistor 77 is always turned off after a certain time. The infrared light emitting diode 15 is also always turned off after a certain time.

  As described above, by changing the duration of the frame status signal FSF, the exposure time of the image sensor 43 can be set or changed arbitrarily and freely.

  Furthermore, by changing the duration and period of the frame status signal FSF and the LED control signal LEDC, the light emission period, non-light emission period, light emission / non-light emission period, etc. of the infrared light emitting diode 15, that is, the stroboscope can be arbitrarily and freely set. Can be changed or set.

  As described above, when the operation article 150 is irradiated with the infrared light from the infrared light emitting diode 15, the image sensor 43 is exposed by the reflected light from the operation article 150. In response, the image sensor 43 outputs the pixel data D (X, Y) described above. More specifically, the image sensor 43 performs the pixel data strobe PDS shown in FIG. 9B during a period in which the frame status flag signal FSF in FIG. 9A is at a high level (non-lighting period of the infrared light emitting diode 15). In synchronism with this, analog pixel data D (X, Y) is output as shown in FIG.

  The high speed processor 200 acquires digital pixel data through the ADC 208 while monitoring the frame status flag signal FSF and the pixel data strobe PDS.

  However, as shown in FIG. 10C, the pixel data is output in the order of row 0, row 1,... Row 31. However, as will be described later, the first pixel of each row is dummy data.

  Next, game content by the game apparatus 1 will be described with specific examples.

  FIG. 11 is a view showing an example of the first stage game screen displayed on the screen 91 of the television monitor 90 of FIG. As shown in FIG. 11, the game screen includes a background 120, a cursor 111, a tracking object 112, obstacle objects 104 to 106, a physical strength gauge 131, and masks 101 and 102. The background 120 includes obstacle images 113 to 115. The physical strength gauge 131 includes a bar 103. Here, since the tracking object 112 is a figure imitating a mermaid, it is hereinafter simply referred to as a “mermaid 112”. Further, when the failure objects 104 to 106 and a failure object described later are comprehensively expressed, they may be referred to as a failure object P. When the failure images 113 to 115 and the failure images described later are comprehensively expressed, they may be referred to as failure images Q.

  The physical strength gauge 131 expresses the physical strength of the mermaid 112. At the start of the game, this bar 103 is the longest and has sufficient physical strength. Then, as time passes, the bar 103 becomes shorter (physical strength decreases), and the game is over when the length of the bar 103 becomes “0” (when physical strength is lost). In principle, the bar 103 is shortened at a constant speed from the longest time to the disappearance time. That is, as a general rule, the physical strength of the mermaid 112 decreases at a constant speed.

  The background 120 is scrolled leftward toward the screen 91. Naturally, the obstacle images 113 to 115 that are part of the background 120 are also scrolled to the left. On the other hand, each of the obstacle objects 104 to 105 is composed of one or a plurality of sprites, appears from the right side (mask 102 side) of the screen 91, moves leftward, and moves to the left side (mask 101 side) of the screen 91. Disappears. The sprite will be described later.

  The cursor 111 represents the position of the operation article 150 on the screen 91, and moves on the screen 91 in conjunction with the movement of the operation article 150. Therefore, from the viewpoint of the player 94, the operation of the operation article 150 and the operation of the cursor 111 are synonymous. The mermaid 112 follows the movement of the cursor 111 (indirectly, the movement of the operation article 150). The player 94 operates the mermaid 112 with the operation article 150 to avoid the obstacle objects 104 to 106 and the obstacle images 113 to 115 while the physical strength remains (the length of the bar 103 becomes “0”). Before) you must reach the goal.

  When the mermaid 112 collides with the obstacle objects 104 to 106 or the obstacle images 113 to 115, the bar 103 of the physical strength gauge 131 is shortened by a predetermined length regardless of the above constant speed, and the physical strength is drastically reduced. Depending on the subsequent collision for a certain time after the mermaid 112 has collided with the obstacle objects 104 to 106 or the obstacle images 113 to 115, it is possible not to perform the process of sharply reducing the physical strength of the mermaid 104.

  FIG. 12 is a view showing another example of the first stage game screen displayed on the screen 91 of the television monitor 90 of FIG. As shown in FIG. 12, the game screen includes a background 120, a cursor 111, a mermaid 112, obstacle objects 107 to 109, a physical strength gauge 131, an item 110, and masks 101 and 102. The background 120 includes obstacle images 116 and 117.

  When the player 94 operates the operation article 150 to move the mermaid 112 to a predetermined area where the item 110 is displayed, the bar 103 of the physical strength gauge 131 becomes longer by a predetermined length. That is, in this case, the physical strength of the mermaid 112 increases, which is advantageous to the player 94. The fault objects 107 to 109 and the fault images 116 and 117 are the same as the fault objects 104 to 106 and the fault images 113 to 115, respectively.

  FIG. 13 is a view showing an example of the second stage game screen displayed on the screen 91 of the television monitor 90 of FIG. As shown in FIG. 13, the game screen includes a background 120, a cursor 111, a mermaid 112, obstacle objects 121 to 125, a physical strength gauge 131, and an item 126.

  Each of the obstacle objects 121 to 125 and the item 126 are configured by one or a plurality of sprites, appear on the upper side of the screen 91, descend, and disappear on the lower side of the screen 91. In the second stage, the background 120 is not scrolled.

  The player 94 must avoid the obstacle objects 121 to 125 by operating the mermaid 112 with the operation article 150. When the mermaid 112 collides with the obstacle objects 121 to 125, the bar 103 of the physical strength gauge 131 is shortened by a predetermined length. That is, the physical strength of the mermaid 112 decreases. Item 126 is the same as item 110 in FIG.

  Here, each of the obstacle objects 104 to 109 and the mermaid 112 is an image of a certain frame of animation. Therefore, a series of images of the mermaid 112 are prepared for the animation of the mermaid 112. For each of the obstacle objects 104 to 109, a series of images of the obstacle objects 104 to 109 are prepared for the obstacle objects 104 to 109.

  As described above, the mermaid 112, each of the obstacle objects 104 to 109, 121 to 125, each of the items 110 and 126, and the physical strength gauge 131 are formed of one or a plurality of sprites. The sprite is a rectangular pixel set and can be arranged at an arbitrary position on the screen 91. Note that the mermaid 112, each of the obstacle objects 104 to 109, 121 to 125, each of the items 110 and 126, and the physical strength gauge 131 may be collectively referred to as an object (or an object image).

  FIG. 14 is an explanatory diagram of sprites that constitute objects displayed on the screen 91. As shown in FIG. 14, the mermaid 112 in FIG. 11 includes, for example, six sprites SP0 to SP5. Each of the sprites SP0 to SP5 is composed of, for example, 16 pixels × 16 pixels. When the mermaid 112 is arranged on the screen 91, for example, the coordinates on the screen 91 where the center of the sprite SP0 at the upper left corner is arranged are specified. Based on the designated coordinates and the sizes of the sprites SP0 to SP5, the coordinates for arranging the centers of the sprites SP1 to SP5 are calculated.

  Next, scrolling of the background 120 will be described. First, the background screen will be described.

  FIG. 15 is an explanatory diagram of a background screen displayed on the screen 91 of the television monitor 90 of FIG. As illustrated in FIG. 15, the background screen 140 includes, for example, 32 × 32 blocks “0” to “1023”. Each of the blocks “0” to “1023” is, for example, a rectangular element composed of 8 pixels × 8 pixels. Corresponding to the blocks “0” to “1023”, arrays PA [0] to PA [1023] and arrays CA [0] to CA [1023] are prepared. Here, when the block “0” to the block “1023” are comprehensively expressed, it is simply expressed as “block”, and when the array PA [0] to PA [1023] is comprehensively expressed, the “array” When it is expressed as “PA” and the sequences CA [0] to CA [1023] are comprehensively expressed, they are expressed as “array CA”.

  Storage position information of data (pixel pattern data) designating the pixel pattern of the corresponding block is substituted into the array PA. The pixel pattern data includes color information of each pixel of 8 pixels × 8 pixels constituting the block. In addition, information (color palette information) and a depth value for designating the color palette used for the corresponding block are substituted into the array CA. The color palette includes a predetermined number of color information. The depth value is information representing the depth of the pixel, and when a plurality of pixels are present at the same position, only the pixel having the largest depth value is displayed.

  FIG. 16A is an explanatory diagram before scrolling the background screen 140, and FIG. 16B is an explanatory diagram after scrolling the background screen 140. As shown in FIG. 16A, since the size of the screen 91 of the television monitor 90 is 224 pixels × 256 pixels, a range of 224 pixels × 256 pixels of the background screen 140 is displayed on the screen 91. The Here, consider that the center position of the background screen 140 is scrolled to the left by k pixels. Then, since the width of the background screen 140 in the horizontal direction (horizontal direction) is the same as the width of the screen 91 in the horizontal direction, as shown in FIG. A hatched portion is displayed at the right end of the screen 91. That is, conceptually, when scrolling in the horizontal direction, it can be considered that the same plurality of background screens 140 are connected in the horizontal direction.

  For example, if the portion outside the range of the screen 91 (shaded portion) is the block “64”, the block “96”,..., The block “896”, the block “928” in FIG. An image defined by the arrays PA [64], PA “96”,..., PA “896”, PA [928] and the arrays CA [64], CA “96”,. It is displayed at the right end of the screen 91. Therefore, in order to make the background continuously continuous by left-scrolling the background screen 140, it is substituted into the array PA and the array CA corresponding to the blocks included in the portion outside the range of the screen 91 (shaded portion). Updated data needs to be updated. Then, an image determined by the updated array PA and array CA is displayed on the right end of the screen 91.

  In order to make the background appear smooth and continuous, it is necessary to update the data of the corresponding array PA and array CA before being displayed on the right end of the screen 91. Then, when the data is being displayed at the left end of the screen 91, it is necessary to update the data in the corresponding array PA and array CA, and the display at the left end of the screen 91 becomes discontinuous. Therefore, in order to avoid such an inconvenience, a mask 101 is placed on the left end of the screen 91 as shown in FIGS. In the present embodiment, scrolling in the right direction is not performed, but a mask 102 is also provided at the right end for balance.

  The background 120 is scrolled by scrolling the background screen 140 as described above.

  FIG. 17 is a conceptual diagram showing programs and data stored in the ROM 51 of FIG. As shown in FIG. 17, the ROM 51 stores a game program 300, image data 301, and musical sound data 304. The image data 301 includes object image data 302 (including image data such as a mermaid 112, obstacle objects 104 to 109, 121 to 125, items 110 and 126, and a physical strength gauge 131) and background image data 303. The musical sound data 304 includes score data 305 and waveform data (sound source data) 306. The high speed processor 200 executes the game program 300 stored in the ROM 51 and uses the image data 301 and the musical sound data 304.

  Main processes executed by the high speed processor 200 will be described.

  [Pixel Data Group Acquisition Processing] The CPU 201 acquires digital pixel data obtained by converting analog pixel data output from the image sensor 43, and substitutes it into the array P [X] [Y]. The horizontal direction (lateral direction, row direction) of the image sensor 43 is taken as the X axis, and the vertical direction (longitudinal direction, column direction) is taken as the Y axis.

  [Difference Data Calculation Processing] The CPU 201 calculates the difference between the pixel data P [X] [Y] when the infrared light emitting diode 15 is turned on and the pixel data P [X] [Y] when the infrared light emitting diode 15 is turned off. The difference data is substituted into the array Dif [X] [Y]. Here, the effect of obtaining the difference will be described with reference to the drawings. Here, the pixel data represents luminance. Therefore, the difference data also represents luminance.

  FIG. 18A is an illustration of an image taken by a general image sensor and not subjected to special processing, and FIG. 18B is a level discrimination of the image signal of FIG. FIG. 18C is an exemplary diagram of an image signal when the image sensor 43 is turned on via the infrared filter 17, and FIG. (D) is an exemplary diagram of an image signal when the image signal when the image sensor 43 is turned off via the infrared filter 17 is level-discriminated by a certain threshold, and FIG. It is an illustration figure of the difference signal with the image signal at the time of light extinction.

  As described above, the operation article 150 is irradiated with infrared light, and an image of reflected infrared light incident on the image sensor 43 via the infrared filter 17 is captured. When the operation article 150 is photographed with a stroboscope using a general light source in a general indoor environment, a general image sensor (corresponding to the image sensor 43 in FIG. 5) is shown in FIG. As shown in FIG. 5, in addition to the image of the operation article 150, not only a light source such as a fluorescent light source, an incandescent light source, and sunlight (window), but also all images of the room. Therefore, to process only the image of the operation article 150 by processing the image of FIG. 18A requires a considerably high speed computer or processor. However, such a high-performance computer cannot be used in an inexpensive device. Therefore, it is conceivable to reduce the burden by performing various processes.

  Note that the image in FIG. 18A is originally an image represented by black and white gradations, but the illustration thereof is omitted. Further, in FIGS. 18A to 18E, the reflection sheet 155 of the operation article 150 is photographed.

  FIG. 18B is an image signal when the image signal of FIG. 18A is level-discriminated by a certain threshold value. Such level discrimination processing can be executed either by a dedicated hardware circuit or by software. However, by any method, if level discrimination that cuts pixel data of a certain amount or less is executed, the operation article Low luminance images other than 150 and the light source can be removed. In the image of FIG. 18B, processing of an image other than the operation article 150 and the light source in the room can be omitted, and thus the burden on the computer can be reduced. However, a high-intensity image including the light source image is still captured. Therefore, it is difficult to separate the operation article 150 from other light sources.

  Therefore, as shown in FIG. 5, the infrared filter 17 is used to prevent the image sensor 43 from capturing an image other than an infrared image. Thereby, as shown in FIG. 18C, the image of the fluorescent light source that hardly contains infrared light can be removed. However, sunlight and incandescent lamps are still included in the image signal. Therefore, in order to further reduce the burden, the difference between the pixel data when the infrared stroboscope is turned on and the pixel data when the infrared stroboscope is turned off is calculated.

  Therefore, the difference between the pixel data of the image signal when turned on in FIG. 18C and the pixel data of the image signal when turned off in FIG. 18D was calculated. Then, as shown in FIG.18 (e), the image only for the difference is acquirable. The image based on the difference data includes only the image obtained by the operation article 150, as is clear from comparison with FIG. Therefore, the state information of the operation article 150 can be acquired while reducing the processing.

  Here, the state information is, for example, one of speed information, moving direction information, moving distance information, velocity vector information, acceleration information, moving trajectory information, area information, or position information, or two of them. A combination of the above.

  For the reasons described above, the CPU 201 calculates the difference between the pixel data when the infrared light emitting diode 15 is turned on and the pixel data when the infrared light emitting diode 15 is turned off, and obtains difference data.

  [Attention Point Extraction Processing] The CPU 201 obtains the coordinates of the attention point of the operation article 150 based on the calculated difference data Dif [X] [Y]. This point will be described in detail.

  FIG. 19 is an explanatory diagram of the coordinate calculation of the attention point of the operation article 150. The image sensor 43 shown in FIG. 19 is assumed to be 32 pixels × 32 pixels.

  As shown in FIG. 19, the CPU 201 scans differential data for 32 pixels in the X direction (horizontal direction, horizontal direction, row direction), increments the Y coordinate, and stores differential data for 32 pixels in the X direction. And the Y coordinate is incremented, and the difference data for 32 pixels is scanned in the X direction while incrementing the Y coordinate.

  In this case, the CPU 201 obtains the maximum brightness value difference data from the scanned difference data of 32 pixels × 32 pixels, and compares the maximum brightness value with a predetermined threshold Th. Then, when the maximum luminance value is larger than the predetermined threshold Th, the CPU 201 calculates the coordinates of the attention point of the operation article 150 based on the coordinates of the pixel having the maximum luminance value. This point will be described in detail.

  FIG. 20A is an explanatory diagram of X-direction scanning when calculating the point-of-interest coordinates of the operation article 150 based on the coordinates of the pixel having the maximum luminance value, and FIG. 20B has the maximum luminance value. FIG. 20C is an explanatory diagram at the start of the Y-direction scan when calculating the attention point coordinates of the operation article 150 based on the coordinates of the pixel, and FIG. 20C shows the operation article based on the coordinates of the pixel having the maximum luminance value. FIG. 20D is an explanatory diagram of Y-direction scanning when calculating 150 attention point coordinates, and FIG. 20D is a result of calculating the attention point coordinates of the operation article 150 based on the coordinates of the pixel having the maximum luminance value. It is explanatory drawing.

  As shown in FIG. 20A, the CPU 201 scans the difference data in the X direction around the coordinates of the pixel having the maximum luminance value, and detects a pixel having a luminance value larger than the predetermined threshold Th. . In the example of FIG. 20A, X = 11 to 15 are pixels that exceed a predetermined threshold Th.

  Next, as shown in FIG. 20B, the CPU 201 obtains the center of X = 11-15. Then, the X coordinate of the center is Xc = 13.

  Next, as shown in FIG. 20C, the difference data is scanned in the Y direction around the X coordinate (= 13) obtained in FIG. 20B, and is larger than a predetermined threshold Th. Detect pixels with luminance values. In the example of FIG. 20C, Y = 5 to 10 are pixels that exceed a predetermined threshold Th.

  Next, as shown in FIG. 20D, the CPU 201 obtains the center of Y = 5-10. Then, the Y coordinate of the center is Yc = 7.

  The CPU 201 substitutes the coordinates Xc (= 13) of the attention point calculated as described above into PX [M], and substitutes the coordinates Yc (= 7) into PY [M]. Then, the CPU 201 calculates a moving average (AX, AY) of the attention point (Xc, Yc). Further, the CPU 201 converts the average coordinates (AX, AY) of the target point on the image sensor 43 into coordinates (xc, yc) on the screen 91. Then, the CPU 201 assigns the coordinate xc to the array Ax [M], and assigns the coordinate yc to the array Ay [M]. The CPU 201 executes processing for obtaining the coordinates of the attention point (Ax [M], Ay [M]) as described above every time the frame is updated. Here, for example, the coordinate origin on the screen 91 is the center position of the screen 91.

For example, the CPU 201 calculates a moving average for (n + 1) frames by the following equation. “N” is a natural number (eg, “3”).
AX = (PX [M] + PX [M−1] +... + PX [M−n]) / (n + 1) (1)
AY = (PY [M] + PY [M−1] +... + PY [M−n]) / (n + 1) (2)
“M” is an integer, and is incremented by 1 each time the frame displayed on the screen 91 is updated.

  [Background Control Processing] In the first stage of the game (see FIG. 11 and FIG. 12), the CPU 201 changes the arrangement of the center position of the background screen 140 at a constant speed (FIG. 16 (a) and FIG. b)), and the arrangement coordinates after the change of the center position are registered. In this case, the CPU 201 changes the data of the corresponding array PA and array CA. As described above, the CPU 201 performs scroll control of the background 120. In the second stage of the game (see FIG. 13), the CPU 201 changes the data of the array PA and the array CA according to the game program 300 to change part or all of the contents of the background 120.

  [Automatic Object Control Processing] The CPU 201 calculates and registers the coordinates of the obstacle object P and the items 110 and 126. For example, coordinate calculation is performed so that the obstacle object P and the item 110 move at a constant speed, and the result is registered (stored in the internal memory 207). Further, the CPU 201 registers the storage position information of the failure object P to be displayed and the animation table of the items 110 and 126. This animation table is the same as the animation table of the mermaid 112 described later.

  [Cursor control processing] The CPU 201 registers the coordinates (Ax [M], Ay [M]) of the attention point of the operation article 150 as the coordinates of the cursor 105 to be displayed in the next frame (stored in the internal memory 207). . Further, the CPU 201 registers storage position information of the animation table of the cursor 111. This animation table is the same as the animation table of the mermaid 112 described later.

  [Following Object Control Processing] The CPU 201 causes the mermaid 112 to follow the movement of the cursor 111. In this case, the mermaid 112 is moved with a first acceleration. For the first acceleration, a larger value is set as the distance between the cursor 111 and the mermaid 112 is larger, and a smaller value is set as the distance is smaller. Note that the direction of the first acceleration is the positive direction. The positive direction is the direction of travel of the mermaid. The mermaid 112 is also moved with a second acceleration. For this second acceleration, a larger value is set as the speed of the mermaid is larger, and a smaller value is set as it is smaller. The direction of the second acceleration is a negative direction. The negative direction is the direction opposite to the direction of travel of the mermaid. As described above, it is possible to obtain an effect as if the mermaid 112 is exercising in the water. The above points will be described with specific examples.

FIG. 21 is an explanatory diagram of the tracking object control process by the CPU 201. The CPU 201 uses, for example, the following equation in order to calculate the current coordinates (xm [M], ym [M]) of the mermaid 112.
xm [M] = xm [M-1] + Vxm [M-1] * (1-k) + Bx [M] (3)
ym [M] = ym [M-1] + Vym [M-1] × (1-k) + By [M] (4)
Vxm [M-1] = xm [M-1] -xm [M-2] (5)
Vym [M-1] = ym [M-1] -ym [M-2] (6)
Bx [M] = Lx [M] × B0 (7)
By [M] = Ly [M] × B0 (8)
Lx [M] = Ax [M] −xm [M−1] (9)
Ly [M] = Ay [M] −ym [M−1] (10)
As shown in FIG. 21, in the equations (3) to (10), the previous coordinates (xm [M−1], ym [M−1]) of the mermaid 112 and the previous velocity vector (Vxm [ M-1], Vym [M-1]), current acceleration vector (Bx [M], By [M]) of the mermaid 112, previous coordinates of the mermaid 112 (xm [M-2], ym [M -2]), a constant k representing the resistance of water (k <1), and a constant B0 for adjusting the acceleration of the mermaid 112. Here, when it is desired to increase the resistance of water, the constant k is set to a large value, and when it is desired to decrease, the resistance k is set to a small value. The mermaid accelerations Bx [M] and By [M] are proportional to the distances Lx [M] and Ly [M] between the current cursor 111 and the previous mermaid 112. The value of the constant k and the value of the constant B0 can be arbitrary values, and can be determined by experience, for example.

Further, the CPU 201 calculates the current velocity vector (Vxm [M], Vym [M]) of the mermaid 112 by the following equation.
Vxm [M] = xm [M] −xm [M−1] (11)
Vym [M] = ym [M] −ym [M−1] (12)
Further, the CPU 201 calculates the movement distance mx in the x direction and the movement distance my in the y direction of the mermaid 112. The movement distance mx in the x direction is the absolute value of the x component Vxm [M], and the movement distance my in the y direction is the absolute value of the y component Vym [M].

  As described above, the CPU 201 controls not only the position of the mermaid 112 but also the animation of the mermaid 112. This point will be described in detail.

  The CPU 201 determines the size of the mermaid 112 between the movement distance mx in the x direction and the predetermined value xr. The CPU 201 determines whether the mermaid 112 is large or small between the movement distance my in the y direction and the predetermined value yr. As a result of the determination, when the movement distance mx is larger than the predetermined value xr and the movement distance my is smaller than the predetermined value yr, the CPU 201 sets a value corresponding to the angle flag to move the mermaid 112 in the horizontal direction (horizontal direction). Set to.

  As a result of the determination, if the moving distance mx is smaller than the predetermined value xr and the moving distance my is larger than the predetermined value yr, the CPU 201 corresponds to the angle flag to move the mermaid 112 in the vertical direction (vertical direction). Set to value. As a result of the determination, when the moving distance mx is larger than the predetermined value xr and the moving distance my is larger than the predetermined value yr, the CPU 201 sets the angle flag to a corresponding value in order to move the mermaid 112 in an oblique direction. .

  Further, the CPU 201 determines the sign of the velocity vector (Vxm [M], Vym [M]) of the mermaid 112 and sets the x direction flag and the y direction flag to corresponding values. Note that when the x direction flag and the y direction flag are comprehensively expressed, they are simply referred to as a direction flag.

  Then, the CPU 201 determines the moving direction information of the mermaid 112 according to the values set in the angle flag, the x direction flag, and the y direction flag. The movement direction information of the mermaid 112 is information representing a movement mode of the mermaid 112. Based on this movement direction information, the direction of the mermaid 112 is determined. Details of this point will be described.

  22A is a relationship diagram between the value of the angle flag and the angle, FIG. 22B is a relationship diagram between the value of the direction flag and a code representing the direction, and FIG. 22C is an angle flag and a direction. It is a relationship diagram between a flag and movement direction information. As described above, the CPU 201 determines the size between the movement distances mx and my of the mermaid 112 and the predetermined values xr and yr, and sets the angle flag as shown in FIG.

  Further, as described above, the CPU 201 determines the sign of the velocity vector (Vxm [M], Vym [M]) of the mermaid 112, and as shown in FIG. 22 (b), the x direction flag and the y direction flag. Set.

  Furthermore, as illustrated in FIG. 22C, the CPU 201 determines the moving direction information of the mermaid 112 from the values set in the angle flag, the x direction flag, and the y direction flag.

  FIG. 23 is a relationship diagram between the movement direction information of FIG. 22C and the movement direction of the mermaid 112. As shown in FIGS. 22 and 23, the moving direction information A0 means that the mermaid 112 is moved in the horizontal direction and in the positive direction (right direction) of the x-axis. The movement direction information A1 means that the mermaid 112 is moved in the horizontal direction and in the negative direction (left direction) of the x axis. The movement direction information A2 means that the mermaid 112 is moved in the vertical direction and in the positive direction (upward direction) of the y-axis. The movement direction information A3 means that the mermaid 112 is moved in the vertical direction and in the negative direction (downward) of the y axis. The movement direction information A4 means that the mermaid 112 is moved in the upper right diagonal direction. The movement direction information A5 means that the mermaid 112 is moved in the diagonally lower right direction. The movement direction information A6 means that the mermaid 112 is moved in the upper left diagonal direction. The movement direction information A7 means that the mermaid 112 is moved in the diagonally lower left direction.

  The CPU 201 registers animation table storage position information associated with the movement direction information A0 to A7 acquired as described above (mermaid animation registration). The animation table storage position information is information indicating the storage position of the animation table. The animation table in this case includes various information for animating the mermaid 112.

  FIG. 24 is a relationship diagram between the movement direction information A0 to A7 and the animation table storage position information. In FIG. 24, for example, the moving direction information A0 and the animation table storage position information address0 are associated with each other. Here, the animation table storage position information is the top address information of the area in which the animation table is stored.

  FIG. 25 is an exemplary diagram of an animation table for animating the mermaid 112, which is indicated by the animation table storage position information of FIG. As shown in FIG. 25, the animation table includes the storage position information of animation image data, the number of objects (mermaid 112) to be animated arranged in time series, the number of continuous frames, the next object information, and the object (mermaid 112). ) Size information, color palette information, depth value information, and sprite size information.

  The animation image data is data in which a plurality of object (mermaid 112) images are arranged in time series. The information on the number of continuous frames is information indicating how many frames are continuously displayed for each object (mermaid 112). The next object information is information instructing what number object (mermaid 112) is displayed after the object (mermaid 112) is displayed according to the information on the number of continuous frames. For example, the next object information “next” means that the object of the next number “2” is displayed after the object of the number “1” is displayed for one frame (number of continuous frames). Further, for example, the next object information “top” means that after the object with the number “15” is displayed for one frame (number of continuous frames), the first object with the number “1” is displayed.

  The animation image data is pixel pattern data. Here, the pixel pattern data and the depth value are related to the sprite constituting the object (mermaid 112), and the meaning thereof is the same as that related to the block described in FIG.

  Here, the animation table of FIG. 25 is for performing animation of the mermaid 112. Therefore, for example, the moving direction information A0 in FIG. 24 is information indicating that the mermaid 112 is moved in the horizontal direction and the forward direction, and therefore the animation table storage position information address0 corresponding to the moving direction information A0 indicates the animation table. The storage position information ad0 indicates the storage position of the animation image data of the mermaid 112 facing in the horizontal direction and the positive direction.

  As described above, the animation table storage position information address0 to address7 corresponding to the movement direction information A0 to A7 of the mermaid 112 is registered, and the movement direction information A0 to A7 of the mermaid 112 is the attention point (cursor of the operation article 150) 111) based on the coordinates (Ax [M], Ay [M]) (see Expression (9) and Expression (10)), and thus the animation of the mermaid 112 facing the moving direction of the operation article 150 (cursor 111). Is executed.

  Furthermore, the CPU 201 determines whether or not the mermaid 112 has collided with the obstacle object P or the obstacle image Q. When the mermaid 112 collides, the CPU 201 restricts the movement of the mermaid 112 and turns on the collision flag. This point will be described in detail.

  FIG. 26 is an explanatory diagram of the collision determination process performed by the CPU 201. As shown in FIG. 26, the mermaid 112, the obstacle object P, and the obstacle image Q are modeled by a rectangle or a set of rectangles. Then, the CPU 201 determines the collision between the mermaid 112 and all the displayed obstacle objects P and all the displayed obstacle images Q. Here, a rectangle constituting the mermaid 112 is called a “mermaid rectangle”, and a rectangle constituting the obstacle object P or the obstacle image Q is called a “failure rectangle”. The collision determination will be described in detail.

  The CPU 201 determines the overlap between the mermaid rectangle and the obstacle rectangle using each vertex coordinate of each mermaid rectangle and each vertex coordinate of each obstacle rectangle. If any mermaid rectangle and any obstacle rectangle overlap, the CPU 201 collides with the mermaid 112 and the obstacle object P having the overlapping obstacle rectangle, or overlaps with the mermaid 112. It is determined that the failure image Q having the failure rectangle has collided, and the collision flag is turned on.

  FIG. 27 is an explanatory diagram of overlapping patterns determined by the tracking object control process by the CPU 201. As shown in FIGS. 27A to 27N, there are 14 overlapping patterns of the mermaid rectangle rcm and the obstacle rectangle rco. If any overlapping pattern exists, the CPU 201 collides with the mermaid 112 and the obstacle object P having the overlapping obstacle rectangle rco, or the mermaid 112 and the obstacle image Q having the overlapping obstacle rectangle rco , Is determined to have collided.

  The processing as described above is performed between the mermaid 112 and all the displayed obstacle objects P and all the displayed obstacle images Q.

  [Physical Strength Gauge Control Processing] The CPU 201 controls the physical strength gauge 131. This point will be described with reference to the drawings.

  FIG. 28A is an exemplary view of a frame constituting the physical strength gauge 131 of FIGS. 11 to 13, and FIG. 28B is an exemplary view of elements constituting the bar 103 of the physical strength gauge 131. As shown in FIG. 28A, the frame of the physical strength gauge 131 has a size of 8 × 56 pixels, and is configured by displaying seven 8 × 8 pixel sprites.

  As shown in FIG. 28B, in order to display the bar 103, eight sprites P0 to P7 each having 8 × 8 pixels are prepared. In FIG. 28B, for example, the broken line portion is red, and the others are white. The CPU 201 selects one or a plurality of sprites from the sprites P0 to P7 so as to shorten the bar 103 at a constant speed, and displays them within the frame of the physical strength gauge 131.

  For example, the CPU 201 displays seven sprites P7 in the frame at the start of the game, and sets the bar 103 as the longest. When a certain time t has elapsed from the start of the game, sprite P6 is displayed in the frame instead of the rightmost sprite P7, and when a certain time t has elapsed, sprite P5 is replaced in the frame instead of sprite P6. The red bar 103 is shortened as the fixed time t elapses. That is, every time the fixed time t elapses, the bar 103 is shortened by one pixel.

  Further, when the collision flag is turned on, that is, when the mermaid 112 collides with the obstacle object or the obstacle image, the red bar 103 is shortened by a predetermined length (for example, 4 pixels). In this way, the sprites P0 to P7 are selected and displayed. For example, in the physical strength gauge 131, the CPU 201 removes the sprite P0 when the collision flag is on when the six sprites are sprites P7 and the rightmost side is the sprite P0. Instead of the sprite P7 on the left side of the sprite P0, the sprite P4 is displayed. As a result, the bar 103 is shortened by 4 pixels.

  [Image Display Processing] The CPU 201 vertically outputs information necessary for drawing based on information registered by background control processing, automatic object control processing, cursor control processing, tracking object control processing, and physical strength gauge control processing. In the blanking period, it is given to the graphic processor 202 of FIG. Then, the graphic processor 202 generates a video signal based on the given information and outputs it to the video signal output terminal 47. Thereby, a game screen including the mermaid 112 is displayed on the screen 91 of the television monitor 90. More specifically, it is as follows.

  The CPU 201 calculates display coordinates of each sprite constituting the obstacle object P based on the animation table of the obstacle object P and the coordinate information registered in the automatic object control process. Then, the CPU 201 refers to the animation table of the obstacle object P, and displays display coordinate information, color palette information, depth value, size information, and pixel pattern data storage position information of each sprite constituting the obstacle object P. The graphic processor 202 is given.

  Further, the CPU 201 calculates display coordinates of each sprite constituting the cursor 111 based on the animation table of the cursor 111 and the coordinate information registered in the cursor control process (the coordinate information of the attention point of the operation article 150). Then, the CPU 201 refers to the animation table of the cursor 111 to display the display coordinate information, color palette information, depth value, size information, and pixel pattern data storage position information of each sprite constituting the cursor 111 as a graphic processor. 202.

  Further, the CPU 201 refers to the animation table based on the animation table storage position information registered in the tracking object control process, and acquires the size information of the mermaid 112 (object) and the size information of the sprites constituting the mermaid 112. To do. Then, the CPU 201 calculates the display coordinates of each sprite constituting the mermaid 112 based on the above information and the coordinates (xm [M], ym [M]) calculated in the tracking object control process. Further, the CPU 201 configures the mermaid 112 based on the object number of the mermaid 112 to be displayed, the size information of the mermaid 112, the size information of the sprite that configures the mermaid 112, and the storage position information of the animation image data. The pixel pattern data storage position information of each sprite is calculated.

  Further, the CPU 201 refers to the animation table, and displays the color palette information, depth value, and size information of each sprite constituting the mermaid 112 together with pixel pattern data storage position information and display coordinate information of each sprite. To the graphic processor 202. In this case, the CPU 201 gives the above information to the graphic processor 202 according to the information on the number of continuous frames in the animation table and the next object information.

  In addition, the CPU 201 provides the graphic processor 202 with color palette information, depth values, size information, pixel pattern data storage position information, and display coordinate information of each sprite constituting the frame of the physical strength gauge 131. Further, the CPU 201 stores the color palette information, depth value, size information, pixel pattern data storage position information, and display coordinate information of each sprite constituting the bar 103 registered in the physical strength gauge control process in the graphic processor 202. give.

  In addition, the CPU 201 arranges the arrangement coordinates of the center position of the background screen 140 registered in the background control process, the start address of the array PA [0] to the array PA [1023] set in the background control process, and the array CA [0]. The start address of the array CA [1023] is given to the graphic processor 202. The graphic processor 202 reads the information of the array PA [0] to the array PA [1023] based on the given head address, and based on the information, the pixel pattern of the block [0] to the block [1023] Read data storage location information. In addition, the graphic processor 202 reads the information in the array CA [0] to the array CA [1023] based on the given head address.

  The graphic processor 202 generates a video signal representing the obstacle object P, the cursor 111, the mermaid 112, the physical strength gauge 131, and the background 120 based on the information given from the CPU 201 and the read information, and outputs the video signal. Output to terminal 47.

  [Musical sound reproduction] Musical music is reproduced by interrupt processing. The CPU 201 reads and interprets the score data 305 while incrementing the score data pointer. Note that the musical score data pointer is a pointer indicating the reading position of the musical score data 305.

  If the command included in the read score data 305 is note-on, the CPU 201 indicates the pitch (pitch) indicated by the note number included in the score data 305 and the instrument (timbre) indicated by the instrument designation information. Is given to the sound processor 203 the head address where the waveform data (sound source data) 306 is stored. Further, if the command included in the read musical score data 305 is note-on, the CPU 201 gives the sound processor 203 a head address where necessary envelope data is stored. Further, if the command included in the read score data 305 is note-on, the CPU 201 indicates pitch control information corresponding to the pitch (pitch) indicated by the note number included in the score data 305, and Volume information included in the musical score data 305 is given to the sound processor 203.

  Here, the pitch control information will be described. The pitch control information is used for pitch conversion performed by changing the cycle for reading the waveform data (sound source data) 306. That is, the sound processor 203 reads and accumulates pitch control information at regular intervals. Then, the sound processor 203 processes this accumulation result to obtain an address pointer for the waveform data (sound source data) 306. Therefore, if the pitch control information is set to a large value, the address pointer is incremented quickly, the frequency of the waveform data (sound source data) 306 is increased, and if the pitch control information is set to a small value, the address pointer is incremented. Is incremented slowly, and the frequency of the waveform data (sound source data) 306 is lowered. In this way, the sound processor 203 performs pitch conversion of the waveform data (sound source data) 306.

  The sound processor 203 reads the waveform data (sound source data) 306 stored at the position indicated by the given head address from the ROM 51 while incrementing the address pointer based on the given pitch control information. The sound processor 203 multiplies the waveform data (sound source data) 306 sequentially read out by the envelope data and the volume information to generate an audio signal. In this way, an audio signal of the tone color, pitch (pitch), and volume of the musical instrument indicated by the score data 305 is generated and output to the audio signal output terminal 49.

  On the other hand, the CPU 201 manages the gate time included in the read score data 305. Accordingly, the CPU 201 instructs the sound processor 203 to end the sound generation of the corresponding musical sound when the gate time has elapsed. In response to this, the sound processor 203 ends the sound generation of the instructed musical sound.

  As described above, music is reproduced based on the musical score data 305 and is generated from a speaker (not shown) of the television monitor 90.

  Next, an example of the overall processing flow of the game apparatus 1 of FIG. 1 will be described using a flowchart.

  FIG. 29 is a flowchart showing an example of the overall processing flow of the game apparatus 1 of FIG. As shown in FIG. 29, in step S1, the CPU 201 executes initial setting of the system.

  In step S2, the CPU 201 confirms the physical strength of the mermaid 112. If the physical strength is “0” (the length of the bar 103 of the physical strength gauge 131 is “0”), a predetermined failure screen is displayed and the game is displayed. If the physical strength remains, the process proceeds to step S3. In step S3, the CPU 201 determines whether or not the mermaid 112 has arrived at the goal. If the mermaid 112 has arrived, the CPU 201 displays a predetermined success screen, ends the game, and if it has not arrived, Proceed to S4.

  In step S4, the CPU 201 calculates state information of the operation article 150. In step S5, the CPU 201 controls display of the background 120. In step S6, the CPU 201 controls display of the failure object P. In step S <b> 7, the CPU 201 controls the display of the cursor 111 based on the state information of the operation article 150.

  In step S <b> 8, the CPU 201 controls the display of the mermaid 112 based on the coordinate information of the cursor 111 (see formula (3) to formula (12)). In step S <b> 9, the CPU 201 controls the display of the physical strength gauge 131.

  In step S <b> 10, the CPU 201 determines whether “M” is smaller than a predetermined value “K”. If “M” is greater than or equal to the predetermined value “K”, the CPU 201 proceeds to step S11, substitutes “0” for “M”, and proceeds to step S12. On the other hand, when “M” is smaller than the predetermined value “K”, the CPU 201 proceeds from step S10 to step S12. This “M” will become clear in the following description.

  In step S12, the CPU 201 determines whether to wait for a video synchronization interrupt. The CPU 201 gives image information for updating the display screen of the television monitor 90 to the graphic processor 202 after the start of the vertical blanking period. Therefore, when the calculation process for updating the display screen is completed, the process is not allowed to proceed until there is a video synchronization interrupt. If “YES” in the step S12, that is, if the video synchronization interruption is awaited (no interruption by the video synchronization signal), the process returns to the same step S12. On the other hand, if “NO” in the step S12, that is, if not waiting for a video synchronization interrupt (if there is an interrupt due to a video synchronization signal), the process proceeds to a step S13.

  In step S13, the CPU 201 gives image information necessary for generating a game screen (see FIGS. 11 to 13) to the graphic processor 202 based on the results of steps S5 to S9 (image display processing). Then, the process proceeds to step S2.

  FIG. 30 is a flowchart showing an example of the flow of the initial setting process in step S1 of FIG. As shown in FIG. 30, in step S <b> 20, the CPU 201 executes an initial setting process for the image sensor 43. In step S21, the CPU 201 initializes various flags and various counters. In step S22, the CPU 201 sets the timer circuit 210 as an interrupt source for sound generation. Note that the processing by the sound processor 203 is executed by the interrupt processing, and the music is output from the speaker of the television monitor 90.

  FIG. 31 is a flowchart showing an example of the sensor initial setting process in step S20 of FIG. As shown in FIG. 31, in the first step S30, the high speed processor 200 sets a command “CONF” as setting data. However, the command “CONF” is a command for notifying the image sensor 43 that the setting mode for transmitting the command from the high speed processor 200 is entered. Then, in the next step S31, command transmission processing is executed.

  FIG. 32 is a flowchart showing an example of the command transmission process in step S31 of FIG. As shown in FIG. 32, in the first step S40, the high speed processor 200 sets the setting data (command “CONF” in the case of step S31) to the register data (I / O port), and in the next step S41, the register Set clock CLK (I / O port) is set to low level. Thereafter, after waiting for a specified time in step S42, the register setting clock CLK is set to a high level in step S43. Further, after waiting for the specified time in step S44, the register setting clock CLK is set to the low level again in step S45.

  In this way, as shown in FIG. 33, the command (command or command + data) transmission process is performed by setting the register setting clock CLK to the low level, the high level, and the low level while waiting for the specified time. Done.

  Returning to the description of FIG. In step S32, the pixel mode is set and the exposure time is set. In this embodiment, since the image sensor 43 is, for example, a 32 pixel × 32 pixel CMOS image sensor as described above, the pixel mode register of the setting address “0” has 32 pixels × 32 pixels. “0h” is set. In the next step S33, the high speed processor 200 executes a register setting process.

  FIG. 34 is a flowchart showing an example of the register setting process in step S33 of FIG. As shown in FIG. 34, in the first step S50, the high speed processor 200 sets the command “MOV” + address as the setting data, and in the next step S51, executes the command transmission process described earlier in FIG. And send it. Next, in step S52, the high speed processor 200 sets the command “LD” + data as setting data, executes command transmission processing in the next step S53, and transmits it. In step S54, the high speed processor 200 sets the command “SET” as setting data, and transmits it in the next step S55. Note that the command “MOV” is a command indicating that the address of the control register is transmitted, the command “LD” is a command indicating that the data is transmitted, and the command “SET” is for actually setting the data to the address. Command. This process is repeatedly executed when there are a plurality of control registers to be set.

  Returning to the description of FIG. In step S34, the setting address is set to “1” (indicating the address of the exposure time setting register), and the data “Fh” of “FFh” indicating the maximum exposure time is set as data to be set. In step S35, the register setting process of FIG. 34 is executed. Similarly, in step S36, the setting address is set to “2” (indicating the high nibble address of the exposure time setting register), and the high nibble data “Fh” of “FFh” indicating the maximum exposure time is set as data to be set. In step S37, register setting processing is executed.

  Thereafter, a command “RUN” is set in step S38 to indicate the end of setting and to cause the image sensor 43 to start outputting data, and is transmitted in step S39. In this way, the sensor initial setting process in step S20 shown in FIG. 30 is executed. However, the specific examples shown in FIGS. 31 to 34 can be appropriately changed according to the specifications of the image sensor 43 used.

  FIG. 35 is a flowchart showing an example of the flow of state information calculation processing in step S4 of FIG. As shown in FIG. 35, in step S60, the CPU 201 acquires digital pixel data from the ADC 208. The digital pixel data is obtained by converting analog pixel data from the image sensor 43 to digital by the ADC 208.

  In step S61, attention point extraction processing is executed. Specifically, the CPU 201 calculates a difference between pixel data when the infrared light emitting diode 15 emits light and pixel data when the infrared light emitting diode 15 is turned off, and obtains difference data. Then, the CPU 201 detects the maximum value of the difference data and compares it with a predetermined threshold Th. Furthermore, when the maximum value of the difference data exceeds a predetermined threshold Th, the CPU 201 calculates the coordinates of the pixel having the maximum difference data. Further, the CPU 201 obtains a moving average of the coordinates calculated as described above, converts this to coordinates on the screen 91 of the television monitor 90, and coordinates of the attention point (Ax [M]) of the operation article 150. , Ay [M]).

  FIG. 36 is a flowchart showing an example of the pixel data group acquisition process in step S60 of FIG. As shown in FIG. 36, in the first step S70, the CPU 201 sets “−1” for X and “0” for Y as the element number of the pixel data array. The pixel data array in the present embodiment is a two-dimensional array with X = 0 to 31 and Y = 0 to 31, but dummy data is output as data of the first pixel in each row as described above. “−1” is set as an initial value. In a succeeding step S71, pixel data acquisition processing is executed.

  FIG. 37 is a flowchart showing an example of the pixel data acquisition process in step S71 of FIG. As shown in FIG. 37, in the first step S80, the CPU 201 checks the frame status flag signal FSF from the image sensor 43, and whether or not the up edge (from low level to high level) has occurred in step S81. to decide. When the up edge of the flag signal FSF is detected in step S81, in the next step S82, the CPU 201 instructs the start of conversion of the analog pixel data input to the ADC 208 into digital data. Thereafter, the pixel strobe PDS from the image sensor 43 is checked in step S83, and it is determined in step S84 whether or not an up edge from the low level to the high level of the strobe signal PDS has occurred.

  If “YES” is determined in the step S84, the CPU 201 determines whether or not X = −1, that is, whether or not it is the first pixel in a step S85. As described above, since the first pixel of each row is set as a dummy pixel, if “YES” is determined in this step S85, the pixel data at that time is not acquired in the next step S87, and the element The number X is incremented.

  If “NO” is determined in step S85, the pixel data is the second and subsequent pixel data in the row. Therefore, in step S86 and S88, the pixel data at that time is obtained and the pixel data is stored in a temporary register (not shown). Store the data. Thereafter, the process proceeds to step S72 in FIG.

  In step S72 of FIG. 36, the pixel data stored in the temporary register is substituted into the pixel data array P [Y] [X].

  In the following step S73, X is incremented. When X is less than 32, the processes from S71 to S73 are repeated. When X is 32, that is, when the acquisition of pixel data has reached the end of the row, “−1” is set to X in the following step S75, Y is incremented in step S76, and the beginning of the next row is started. Repeat the pixel data acquisition process.

  If Y is 32 in step S77, that is, if the acquisition of pixel data has reached the end of the pixel data array P [Y] [X], the process proceeds to step S61 in FIG.

  FIG. 38 is a flowchart showing an example of the flow of attention point extraction processing in step S61 of FIG. As shown in FIG. 38, in step S90, the CPU 201 calculates the difference between the pixel data when the infrared light emitting diode 15 is turned on and the pixel data when the infrared light emitting diode 15 is turned off from the image sensor 43. Calculate to obtain difference data. In step S91, the CPU 201 assigns the calculated difference data to the array Dif [X] [Y]. Here, in the embodiment, since the image sensor 43 of 32 pixels × 32 pixels is used, X = 0 to 31 and Y = 0 to 31.

  In step S92, the CPU 201 scans all elements of the array Dif [X] [Y] and detects the maximum value. If the maximum value is greater than the predetermined threshold Th, the CPU 201 proceeds to step S94, and if not greater than the predetermined threshold Th, the CPU 201 proceeds to step S10 in FIG. 29 (step S93).

  In step S94, the CPU 201 calculates the coordinates (Xc, Yc) of the attention point of the operation article 150 based on the coordinates of the maximum value. In step S95, the CPU 201 increments the value of the number of times M by one (M = M + 1).

  In step S96, the CPU 201 assigns the coordinates Xc and Yc to the arrays PX [M] and PY [M], respectively. In step S97, the CPU 201 calculates a moving average (AX [M], AY [M]) of the attention point (Xc, Yc) of the operation article 150. In step S98, the CPU 201 converts the average coordinates (AX [M], AY [M]) of the target point on the image sensor 43 into coordinates (xc, yc) on the screen 91 of the television monitor 90.

  FIG. 39 is a flowchart showing an example of the flow of attention point coordinate calculation processing in step S94 of FIG. As shown in FIG. 39, in step S100, the CPU 201 substitutes the maximum X and Y coordinates obtained in step S92 for “m” and “n”, respectively. In step S101, the CPU 201 increments “m” by one (m = m + 1). If the difference data Dif [m] [n] is greater than the predetermined threshold Th, the CPU 201 proceeds to step S103, otherwise proceeds to step S104 (step S102). In step S103, the CPU 201 assigns “m” at that time to “mr”. In this way, while repeating steps S101 to S103, scanning is performed in the positive direction of the X axis from the maximum value, and the X coordinate of the extreme difference data whose value exceeds the predetermined threshold Th is obtained.

  In step S104, the CPU 201 assigns the maximum value X coordinate obtained in step S92 to “m”. In step S105, the CPU 201 decrements “m” by one. If the difference data Dif [m] [n] is greater than the predetermined threshold Th, the CPU 201 proceeds to step S107, otherwise proceeds to step S108 (step S106). In step S107, the CPU 201 assigns “m” at that time to “ml”. In this way, while repeating steps S105 to S107, scanning is performed in the negative direction of the X axis from the maximum value, and the X coordinate of the extreme difference data whose value exceeds the predetermined threshold Th is obtained.

  In step S108, the CPU 201 calculates the center coordinate between the X coordinate mr and the X coordinate ml and sets it as the X coordinate (Xc) of the target point. In step S109, the CPU 201 assigns “Xc” obtained in step S108 and the maximum Y coordinate obtained in step S92 to “m” and “n”, respectively. In step S110, the CPU 201 increments “n” by one (n = n + 1). If the difference data Dif [m] [n] is greater than the predetermined threshold Th, the CPU 201 proceeds to step S112, otherwise proceeds to step S113 (step S111). In step S112, the CPU 201 assigns “n” at that time to “nd”. In this way, while repeating steps S110 to S112, scanning is performed in the positive direction of the Y axis from the maximum value, and the Y coordinate of the extreme difference data whose value exceeds the predetermined threshold Th is obtained.

  In step S113, the CPU 201 assigns the maximum Y coordinate obtained in step S92 to “n”. In step S114, the CPU 201 decrements “n” by one. If the difference data Dif [m] [n] is larger than the predetermined threshold Th, the CPU 201 proceeds to step S116, otherwise proceeds to step S117 (step S115). In step S116, the CPU 201 assigns “n” at that time to “nu”. In this way, while repeating steps S114 to S116, scanning is performed from the maximum value in the negative direction of the Y axis, and the Y coordinate of the extreme difference data whose value exceeds the predetermined threshold Th is obtained.

  In step S117, the CPU 201 calculates the center coordinate between the Y coordinate nd and the Y coordinate nu and sets it as the Y coordinate (Yc) of the target point. As described above, the coordinates (Xc, Yc) of the attention point of the operation article 150 are calculated.

  FIG. 40 is a flowchart showing an example of the flow of the tracking object control process in step S8 of FIG. As shown in FIG. 40, in step S140, the CPU 201 calculates and registers the display coordinates (xm [M], ym [M]) of the mermaid 112 using the equations (3) and (4).

  In step S141, the CPU 201 refers to the collision flag to check whether the mermaid 112 has collided with the obstacle image Q or the obstacle object P in the currently displayed frame. As a result, the CPU 201 proceeds to step S151 when the collision flag is on, and proceeds to step S142 when it is off (step S141).

  In step S142, the CPU 201 compares the movement distance mx in the x direction of the mermaid 112 with a predetermined value xr. Further, the CPU 201 compares the moving distance my in the y direction of the mermaid 112 with the predetermined value yr. In step S143, the CPU 201 sets an angle flag based on the comparison result in step S142 (see FIG. 22A).

  In step S144, the CPU 201 determines the sign of the velocity vector (Vxm [M], Vym [M]) of the mermaid 112. In step S145, the CPU 201 sets a direction flag based on the result of step S144 (see FIG. 22B).

  In step S146, the CPU 201 determines movement direction information with reference to the angle flag and the direction flag (see FIG. 22C). In step S147, the CPU 201 registers the animation table storage position information according to the determined moving direction information (see FIG. 24).

  On the other hand, in step S151, the CPU 201 determines whether or not the obstacle image Q is the one that the mermaid 112 collides with. As a result of the determination, if the CPU 201 collides with the obstacle image Q, the process proceeds to step S152. If not, that is, if it collides with the obstacle object P, the process proceeds to step S153.

  In step S152, the CPU 201 calculates the display coordinates of the mermaid 112 again based on the scroll speed of the background 120, and re-registers it. More specifically, the CPU 201 sets the x coordinate of the mermaid 112 to the x coordinate of the scroll speed as a new x coordinate of the mermaid 112. Note that the y coordinate of the mermaid maintains the previous y coordinate. On the other hand, in step S153, the CPU 201 re-registers the coordinates of the currently displayed mermaid 112.

  In step S154, the CPU 201 registers the storage position information of the animation table used when the mermaid 112 collides. In step S155, the CPU 201 turns off the collision flag.

  In step S148, the CPU 201 performs a collision determination between the mermaid 112, the obstacle image Q, and the obstacle object P based on the coordinates of the mermaid 112 calculated in step S140 (see FIGS. 26 and 27). ). When the CPU 201 determines that a collision has occurred, the CPU 201 turns on the collision flag.

  As described above, in the present embodiment, since the cursor 111 (interlocking object) moves in conjunction with the movement of the operation article 150 itself, intuitive operation of the cursor 111 is possible and easy operation is possible. A game can be played.

  Further, since the cursor 111 represents the position of the operation article 150 on the screen 91, the movement of the cursor 111 needs to be synchronized or almost synchronized with the operation article 150. For this reason, the control of the cursor 111 is restricted by the movement of the operation article 150. On the other hand, since the mermaid 112 (following object) follows the movement of the cursor 111, it is possible to arbitrarily determine how the cursor 111 follows the movement. Therefore, it is possible to focus on the movement of the mermaid 112 and increase the visual effect. In the present embodiment, whether the mermaid 112 is moving underwater in consideration of the movement of the mermaid 112 and the acceleration determined by the positional relationship with the cursor 111 and the resistance according to the speed of the mermaid 112. (See formulas (3) and (4)).

  Further, in the present embodiment, the CPU 201 manages the physical strength gauge 131 (information serving as an index by which the player 94 can continue the game) and ends the game based on the physical strength gauge 131. That is, in this embodiment, when the length of the bar 103 of the physical strength gauge 131 becomes “0”, the game is over. In this way, the player 94 cannot execute the game indefinitely, so that a sense of tension is increased and the player can be more interesting.

  Furthermore, in the present embodiment, when the mermaid 112 touches or enters the area where the restricted image (the obstacle object P or the obstacle image Q) is displayed, the physical strength gauge 131 is changed to the first rule (the principle rule). Is changed according to the second rule (exceptional rule that is disadvantageous to the player 94). That is, in this embodiment, in such a case, the bar 103 of the physical strength gauge 131 is abruptly shortened. In this way, it is necessary for the player 94 to operate the mermaid 112 via the cursor 111 so as to avoid the restricted image, which further increases the interest.

  Further, in the present embodiment, when the mermaid 112 touches or enters the area where the items 110 and 126 are displayed, the health gauge 131 is set to the third rule that is not the first rule (the principle rule). Change according to (exceptional rules advantageous to the player 94). That is, in this embodiment, in such a case, the bar 103 of the physical strength gauge 131 is lengthened by a predetermined length. In this way, the player 94 needs to operate the mermaid 112 via the cursor 111 so as to acquire the items 110 and 126, which further increases the interest.

  Furthermore, in the present embodiment, the background image 120 includes the fault image Q, and thus the scroll control of the background 120 and the control of the fault image Q are synonymous. For this reason, display control of the fault image Q is facilitated.

  Further, in the present embodiment, since the obstacle object P is constituted by one or a plurality of sprites, detailed display control of the obstacle object P is possible, and the degree of freedom in designing the game content is increased.

  Furthermore, in the present embodiment, the state information of the operation article 150 is any one of speed information, movement direction information, movement distance information, speed vector information, acceleration information, movement trajectory information, area information, or position information. Or a combination of two or more thereof. For this reason, since the cursor 111 and the mermaid 112 can be controlled using various information of the operation article 150, the degree of freedom in designing the game content is increased.

  Further, in the present embodiment, the state information of the operation article 150 is obtained by intermittently irradiating the operation article 150 with light and photographing it. For this reason, in order to obtain the state information of the operation article 150, it is not necessary to incorporate a circuit driven by the power source in the operation article 150. Therefore, the operability and reliability of the operation article 150 can be improved, and the cost can be reduced.

  Next, a modification of the present embodiment will be described. FIG. 41 is a view showing an example of a game screen in a modification of the present embodiment. In FIG. 41, the same parts as those in FIG. 11 are denoted by the same reference numerals. As shown in FIG. 41, the game screen displayed on the screen 91 of the television monitor 90 is a maze, and the maze includes a passage 133 and a wall 134. The player 94 operates the operation article 150 to operate the cursor 135 on the game screen. The cursor 135 is the same as the cursor 111 in FIGS. 11 to 13 and is linked to the operation article 150. Note that the control of the cursor 135 is the same as the control of the cursor 111.

  The player 94 moves along the passage 133 by operating the cursor 135 with the operation article 150. When the cursor 135 moves to the right end or the left end of the screen 91, the game screen is scrolled. The scroll control is the same as that in the above embodiment. Therefore, this game screen is configured as a background screen 140 (see FIG. 15).

  FIG. 42 is an explanatory diagram of collision determination on the game screen of FIG. As shown in FIG. 42, an area (28 × 32 blocks) displayed on the screen 91 in the background screen 140 is considered. Then, arrays JA [0] to JA [895] corresponding to the 28 × 32 blocks are prepared. Note that the array JA [0] to JA [895] are collectively expressed as the array JA. Here, “0” is assigned to the array JA corresponding to the block constituting the passage 133, and “1” is assigned to the array JA corresponding to the block constituting the wall 134.

  The CPU 201 checks the element of the array JA corresponding to the block where the attention point of the operation article 150 is located. If the element of the corresponding array JA is “1”, the CPU 201 moves the cursor 135 to the wall 134 as follows. That is, the cursor 135 cannot move beyond the wall 134.

  FIG. 43 is an explanatory diagram of coordinate calculation when the cursor 135 of FIG. 41 collides with the wall 134. As shown in FIG. 43, for example, consider a block 149 corresponding to an array JA [10] whose element is “1”. The previous position of the attention point is point A, and the current position of the attention point is point B. In this case, first, the CPU 201 calculates whether the straight line AB intersects the straight line ab, the straight line bc, the straight line cd, or the straight line da. That is, if two vector outer products are “0”, there is no intersection of the two vectors.

  Next, the CPU 201 calculates the intersection I between the straight line ac and the straight line AB where the straight line AB intersects. Then, the CPU 201 sets the coordinates of the intersection point I as the current display coordinates of the cursor 135. In this way, the cursor 135 does not enter the wall 134.

  According to this modification, as in the embodiment, the cursor 135 moves in conjunction with the movement of the operation article 150 itself. Therefore, the cursor 135 can be intuitively operated, and the maze can be easily operated. Can play games.

  It should be noted that only a predetermined range centered on the cursor 135 can be seen as if a spot is applied, and other regions can be darkened. In this way, even if the labyrinth is simple, the difficulty level becomes high and it becomes more interesting.

  In the above example, the cursor 135 is operated with the operation article 150 to move the maze. However, as shown in FIG. 11 and the like, a tracking object is displayed separately from the cursor 135, and the tracking object is displayed. Can be operated via the cursor 135 to move in the maze. In this case, for example, the control of the cursor 135 can be the same as in the embodiment, and the control of the tracking object can be the same as the control of the mermaid 112.

  In the above description, when the point of interest of the operation article 150 enters the block corresponding to the array JA whose element is “1”, the cursor 135 is moved to the boundary between the passage 133 and the wall 134, and the cursor 135 movements were restricted within the passage 133. However, as another example, when the position of the attention point of the operation article 150 is in the block 149 corresponding to the array JA whose element is “1”, the game may be over. Therefore, in this case, the player 94 must operate the cursor 135 so as not to touch the wall 134. In this case as well, as shown in FIG. 11 and the like, a tracking object can be displayed separately from the cursor 135, and the tracking object can be operated via the cursor 135 to move in the maze. .

  According to this modification, as in the embodiment, since the operation object 150 itself can be moved and the cursor 135 can be operated, it is as though the wall 134 corresponding to the obstacle exists on the screen 91. It is possible to give the player 94 the impression of moving the operation article 150 while avoiding obstacles existing in the real space. In addition, the cost can be reduced and the space can be saved as compared with a game device that avoids an obstacle existing in the real space.

  The present invention is not limited to the above-described embodiment, and can be implemented in various modes without departing from the gist thereof. For example, the following modifications are possible.

  (1) In the embodiment, the mermaid 112 as the following object is caused to follow the cursor 111 (linked object). However, the mermaid 112 can be displayed as the cursor 111 without displaying the mermaid 112 as the tracking object. In this case, the player 94 operates the operation article 150 to move the mermaid 112 as the cursor 111. Thus, in this example, the player 94 directly operates the mermaid 112 with the operation article 150. In the embodiment, the player 94 indirectly operates the mermaid 112 with the operation article 150 via the cursor 111.

  (2) In the embodiment, the operation article 150 including the stick 152 and the reflective ball 151 is employed as the operation article. However, if the operation article 150 includes a reflector (for example, a retroreflective sheet), the form of the operation article is used. Is not limited to this.

  (3) In the embodiment, as shown in FIGS. 20A to 20D, the coordinates of the attention point of the operation article 150 are calculated, but the pixel having the maximum luminance value exceeding the predetermined threshold Th. Can be converted into coordinates on the screen 91 and used as the coordinates of the target point.

  (4) Although any type of processor can be used as the high-speed processor 200 of FIG. 6, it is preferable to use a high-speed processor that has already been filed for patent. This high speed processor is disclosed in detail, for example, in Japanese Patent Laid-Open No. 10-307790 and US Pat. No. 6,070,205 corresponding thereto.

The figure which shows the whole structure of the game system in embodiment of this invention. The perspective view of the operation thing of FIG. (A) The top view of the reflective ball | bowl of FIG. (B) The side view of the reflective ball | bowl from the arrow A direction of Fig.3 (a). (C) The side view of the reflective ball | bowl from the arrow B direction of Fig.3 (a). FIG. 3 is a longitudinal sectional view of the reflective ball in FIG. 2. FIG. 2 is an illustrative view showing one example of an imaging unit in FIG. 1. The figure which shows the electrical structure of the game device of FIG. FIG. 7 is a block diagram of the high speed processor of FIG. 6. FIG. 7 is a circuit diagram showing a configuration for taking pixel data from the image sensor of FIG. (A) Timing diagram of the frame status flag signal FSF output from the image sensor of FIG. (B) Timing diagram of the pixel data strobe signal PDS output by the image sensor of FIG. (C) Timing diagram of pixel data D (X, Y) output from the image sensor of FIG. (D) Timing diagram of the LED control signal LEDC output by the high speed processor of FIG. (E) Timing diagram showing the lighting state of the infrared light emitting diode of FIG. (F) Timing diagram showing the exposure period of the image sensor of FIG. (A) The enlarged view of the frame status flag signal FSF of FIG. (B) The enlarged view of the pixel data strobe signal PDS of FIG. (C) The enlarged view of the pixel data D (X, Y) of FIG. The illustration figure of the game screen of the 1st stage displayed on the screen of the television monitor of FIG. The other example figure of the game screen of the 1st stage displayed on the screen of the television monitor of FIG. The illustration figure of the game screen of the 2nd stage displayed on the screen of the television monitor of FIG. Explanatory drawing of the sprite which comprises the object displayed on the screen of the television monitor of FIG. Explanatory drawing of the background screen displayed on the screen of the television monitor of FIG. (A) Explanatory drawing before scrolling a background screen. (B) Explanatory drawing after scrolling a background screen. The conceptual diagram which shows the program and data which were stored in ROM of FIG. (A) The illustration figure of the image which is image | photographed with the general image sensor and does not perform a special process. FIG. 18B is a view showing an example of the image signal when the image signal shown in FIG. (C) The example of an image signal when the image signal at the time of lighting of the image sensor through an infrared filter is level-discriminated by a certain threshold value. (D) An exemplary view of an image signal when the image signal when the image sensor is turned off via an infrared filter is level discriminated by a certain threshold value. (E) The example figure of the difference signal of the image signal at the time of lighting, and the image signal at the time of light extinction. Explanatory drawing of the coordinate calculation of the attention point of the operation thing of FIG. (A) Explanatory drawing of the X direction scan at the time of calculating the attention point coordinate of an operation thing based on the coordinate of the pixel with the largest luminance value. (B) Explanatory drawing at the time of the start of the Y direction scan at the time of calculating the attention point coordinate of an operation thing based on the coordinate of the pixel with the largest luminance value. (C) Explanatory drawing of the Y direction scan at the time of calculating the attention point coordinate of an operation thing based on the coordinate of the pixel with the largest luminance value. (D) Explanatory drawing of the result at the time of calculating the attention point coordinate of an operation thing based on the coordinate of the pixel with the largest luminance value. Explanatory drawing of the tracking object control process by CPU201. (A) Relationship diagram between angle flag value and angle. (B) The relationship figure of the value of a direction flag and the code | symbol showing a direction. (C) Relationship diagram between angle flag and direction flag, and movement direction information. FIG. 23 is a relationship diagram between the moving direction information of FIG. 22C and the moving direction of the mermaid. FIG. 23 is a relationship diagram between the moving direction information and the animation table storage position information of FIG. The illustration figure of the animation table for animating mermaid shown by the animation table storage position information of FIG. Explanatory drawing of the collision determination in the tracking object control process by CPU201. (A) Explanatory drawing of the 1st duplication pattern judged by the tracking object control process of CPU201. (B) Explanatory drawing of the 2nd duplication pattern judged by the tracking object control process of CPU201. (C) Explanatory drawing of the 3rd duplication pattern judged by the tracking object control process of CPU201. (D) Explanatory drawing of the 4th duplication pattern judged by the tracking object control process of CPU201. (E) Explanatory drawing of the 5th duplication pattern judged by the tracking object control process of CPU201. (F) Explanatory drawing of the 6th duplication pattern judged by the tracking object control process of CPU201. (G) Explanatory drawing of the 7th duplication pattern judged by the tracking object control process of CPU201. (H) Explanatory drawing of the 8th duplication pattern judged by the tracking object control process of CPU201. (I) Explanatory drawing of the 9th duplication pattern judged by the tracking object control process of CPU201. (J) Explanatory drawing of the 10th duplication pattern judged by the tracking object control process of CPU201. (K) Explanatory drawing of the 11th duplication pattern judged by the tracking object control process of CPU201. (L) Explanatory drawing of the 12th duplication pattern judged by the tracking object control process of CPU201. (M) Explanatory drawing of the 13th duplication pattern judged by the tracking object control process of CPU201. (N) Explanatory drawing of the 14th duplication pattern judged by the tracking object control process of CPU201. (A) The illustration figure of the frame which comprises the physical strength gauge of FIGS. 11-13. (B) The example of the element which comprises the bar of a physical strength gauge. The flowchart which shows an example of the flow of the whole process of the game device of FIG. FIG. 30 is a flowchart showing an example of a flow of initial setting processing in step S1 of FIG. 29. FIG. The flowchart which shows an example of the flow of the sensor initial setting process of step S20 of FIG. The flowchart which shows an example of the flow of the command transmission process of step S31 of FIG. (A) Timing diagram of the register setting clock CLK of FIG. (B) Timing diagram of the register data of FIG. FIG. 32 is a flowchart showing an example of the flow of register setting processing in step S33 of FIG. 31. FIG. 30 is a flowchart showing an example of a flow of state information calculation processing in step S4 of FIG. 29. 36 is a flowchart showing an example of the pixel data group acquisition process in step S60 of FIG. 37 is a flowchart showing an example of the pixel data acquisition process in step S71 of FIG. 36 is a flowchart showing an example of the flow of attention point extraction processing in step S61 of FIG. FIG. 39 is a flowchart showing an example of the flow of attention point coordinate calculation processing in step S94 of FIG. 38. The flowchart which shows an example of the flow of the tracking object control process of FIG.29 S8. The illustration figure of the game screen in the modification of this Embodiment. FIG. 42 is an explanatory diagram of collision determination on the game screen of FIG. 41. FIG. 42 is an explanatory diagram of coordinate calculation when the cursor in FIG. 41 collides with a wall.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Game device, 13 ... Imaging unit, 15 ... Infrared light emitting diode, 17 ... Infrared filter, 19 ... Housing, 35 ... Unit base, 36 ... Supporting cylinder, 37 ... Convex lens, 39 ... Concave lens, 41 ... Opening part 43 ... Image sensor, 47 ... Video signal output terminal, 49 ... Audio signal output terminal, 51 ... ROM, 53 ... Bus, 59 ... Reference voltage generation circuit, 61, 81 ... NPN transistor, 67 ... Differentiation circuit, 71 ... Capacitor, 75 ... LED drive circuit, 77 ... PNP transistor, 65, 69, 73, 79 ... resistive element, 90 ... television monitor, 91 ... screen, 92 ... AC adapter, 93 ... AV cable, 94 ... player, 101, 102 ... Mask, 103 ... Bar, 104 to 109, 121 to 125, P ... Obstacle object, 110, 126 ... Item DESCRIPTION OF SYMBOLS 111,135 ... Cursor, 112 ... Following object, 113-117, Q ... Obstacle image, 120 ... Background, 131 ... Physical strength gauge, 133 ... Passage, 134 ... Wall, 140 ... Background screen, 149 ... Block, 150 ... Operation 151, reflective ball, 152 ... stick, 153 ... spherical outer shell, 154 ... spherical inner shell, 155 ... reflective sheet, 156, 157 ... boss, 200 ... high speed processor, 201 ... CPU, 202 ... graphic processor, 203 ... Sound processor 204 ... DMA controller 205 ... first bus arbitration circuit 206 ... second bus arbitration circuit 207 ... internal memory 208 ... ADC (A / D converter) 209 ... input / output control circuit 210 ... timer circuit 211 ... DRAM refresh control circuit, 212 ... external memo Interface circuit, 213 ... clock driver, 214 ... PLL circuit, 215 ... low voltage detection circuit, 216 ... crystal oscillator, 217 ... battery, 218 ... first bus, 219 ... second bus, 300 ... game program, 301 ... image Data 302... Object image data 303. Background image data 304. Music data 305. Score data 306 Waveform data.

Claims (15)

Imaging means for photographing an operation article operated by a player;
State information calculating means for calculating state information of the operation article based on an image captured by the imaging means;
Cursor control means for controlling the position of the cursor representing the position of the operation article on the screen based on the state information of the operation article;
A game apparatus comprising: a tracking object control unit that controls display of a tracking object that follows the movement of the cursor based on coordinate information of the cursor. A restriction image control means for controlling a restriction image for restricting movement of the tracking object;
The game device according to claim 1, wherein movement of the cursor is not restricted by the restriction image.   The game apparatus according to claim 2, further comprising a game continuation management unit that manages information serving as an index by which a player can continue the game and ends the game based on the information serving as the index.   The game device according to claim 2, wherein the restriction image is an image constituting a maze.   The game device according to claim 2, wherein the game is over when the tracking object touches or enters an area where the restricted image is displayed.   The state information of the operation article calculated by the state information calculation means is any of speed information, movement direction information, movement distance information, speed vector information, acceleration information, movement trajectory information, area information, or position information. The game device according to claim 1, or a combination of two or more thereof. The operation article further includes a stroboscope that emits light at a predetermined cycle,
The imaging means shoots the operation article including the retroreflective means at the time of light emission and light extinction of the stroboscope, and generates a light emission image signal and a light extinction image signal,
The game apparatus according to claim 1, wherein the state information calculation unit calculates state information of the operation article based on a difference signal between the light-emitting image signal and the light-off image signal. The stroboscope includes a light source that outputs light in a specific wavelength region,
The game device includes:
Unit base,
A filter that transmits only light in the specific wavelength region, and
The unit base is
A support cylinder having an opening;
A lens provided below the opening and provided in the support cylinder,
The filter is disposed so as to cover the opening of the support cylinder,
The imaging means is disposed in the unit base and below the lens,
The game device according to claim 7, wherein the light source is disposed in the vicinity of the filter so as to illuminate the operation article. Controlling an imaging means for photographing a photographing object;
Obtaining a captured image from the imaging means, and calculating state information of the photographing object based on the captured image;
Controlling the position of the cursor representing the position of the photographing object on the screen of a display device based on the state information of the photographing object;
A game program for causing a computer to execute, based on coordinate information of the cursor, a display of the tracking object that follows the movement of the cursor on the display device. A computer controlling imaging means for photographing an object to be photographed;
The computer obtaining a captured image from the imaging means, and calculating state information of the object to be photographed based on the captured image;
The computer controlling the position of the cursor representing the position of the photographing object on the screen of the display device based on the state information of the photographing object ;
A control method of the game device, comprising: controlling the display of the tracking object that follows the movement of the cursor on the display device based on coordinate information of the cursor. An imaging means for photographing a photographing object;
State information calculating means for calculating state information of the object to be photographed based on a captured image obtained by the imaging means;
Cursor control means for controlling the position of the cursor representing the position of the shooting object on the screen based on the state information of the shooting object;
A game apparatus comprising: a tracking object control unit that controls display of a tracking object that follows the movement of the cursor based on coordinate information of the cursor.   The game device according to claim 1, wherein the following object control unit calculates the current coordinates of the following object based on past coordinates of the following object and current coordinates of the cursor.   The tracking object control means calculates a distance between the past tracking object and the current cursor based on the past coordinates of the tracking object and the current coordinates of the cursor, and reflects the distance. The game apparatus according to claim 12, wherein the current coordinates of the following object are calculated.   The game device according to claim 12 or 13, wherein the following object control means calculates the current coordinates of the following object, reflecting a past speed of the following object.   The follow-up object control means calculates a current velocity vector of the follow-up object, and controls the moving direction and animation of the follow-up object based on the speed vector. Game device.

Images