JP4789984B2 - GAME DEVICE, GAME PROGRAM, GAME SYSTEM, AND GAME PROCESSING METHOD - Google Patents

Description

The present invention relates to a game device , a game program , a game system, and a game processing method , and more specifically, to a game device , a game program game system, and a game processing method that determine the movement of an operation device including an acceleration sensor. .

  2. Description of the Related Art Conventionally, a device has been developed in which a user operates an input device provided with an acceleration sensor and discriminates the movement of the input device using an output from the acceleration sensor. For example, a game device is disclosed that includes a three-axis acceleration sensor in a game controller simulating a glove and enjoys a game using an output from the acceleration sensor (see, for example, Patent Document 1).

The controller (glove) disclosed in Patent Document 1 includes a triaxial acceleration sensor having a sensor X, a sensor Y, and a sensor Z. Then, when a large value suddenly enters the sensor Y, the game device goes back to the output waveform obtained from the sensor Y and sets the time around 0 as time t0. A time point at which a value of about 0 is obtained after a small value is rapidly obtained in the output waveform is defined as a time point t1. On the other hand, the acceleration detected during the period from time t0 to time t1 is extracted from the output waveforms of the sensor X and sensor Z, and the punch type (for example, straight, hook, upper, etc.) is selected using the output waveform of each component. Judgment. Specifically, when the output waveform from the sensor X shows a slightly positive value and there is no change in the output waveform from the sensor Z, the game device determines that the player has released a straight punch. The game device determines that the player has released the hook punch when the output waveform of the sensor X shows a negative value when the operation starts and then shows a positive value and there is no change in the output waveform from the sensor Z. To do. Further, the game apparatus determines that the player has released the upper punch when the output waveform from the sensor X shows an indefinite shape and the output waveform from the sensor Z shows a positive value after showing a large negative value. To do.
JP 2002-153673 A

  However, since the game apparatus disclosed in Patent Document 1 determines the punch type in association with the output waveforms of the sensor X and the sensor Z, the movement of each sensor in the acceleration detection direction is determined as a motion. As a standard. That is, the determination of the punch type depends on the orientation (posture) of the glove (controller). Therefore, normal determination cannot be made if the orientation of the glove worn by the player changes. For example, when the player wears the glove upside down or left and right, the accurate determination cannot be made even if the player releases the same punch. In other words, it is greatly affected by the posture of the glove. Furthermore, the game controller generally has a shape that the player can hold in his / her hand without any distinction in the vertical direction. When such a game controller is provided with a three-axis acceleration sensor, the above-described problems become more prominent. It becomes. Thus, in order for the player to obtain an accurate determination, the degree of freedom with respect to the direction in which the controller is held (the attitude of the controller) is reduced.

  Therefore, an object of the present invention is to provide a motion capable of discriminating the movement of an input device while realizing a highly flexible operation with respect to the posture of the input device in an operation input using an input device including an acceleration sensor. It is to provide a discrimination device and a motion discrimination program.

  In order to achieve the above object, the present invention employs the following configuration. Note that the reference numerals in parentheses, step numbers, and the like indicate correspondence with the embodiments described later in order to help understanding of the present invention, and do not limit the scope of the present invention.

  The first invention is a motion discriminating device (3) for discriminating the motion of an input device (7) provided with an acceleration sensor (701) for detecting acceleration in at least two axial directions (X and Y axial directions). The motion discriminating apparatus includes data acquisition means (S61, S64, S77, S92 executed by the CPU 30; only the step numbers are shown below), motion direction discrimination means (S71, S101, S102, S103), and output means (S75, S76, S91, S94, S104, S106, S109). The data acquisition means acquires acceleration data (Da) output from the acceleration sensor. The movement direction discriminating means is based on the transition of the acceleration data acquired by the data acquisition means (FIGS. 9 to 12 and 14), and the movement direction of the input apparatus based on the direction of the gravitational acceleration acting on the input apparatus. Is determined. The output means outputs motion data (Dc, Dd, Dj, Dl) including at least the motion direction determined by the motion direction determination means.

  In a second aspect based on the first aspect, the movement direction determination means includes transitional circulation direction determination means (S66, S71). The transitional circulation direction determination means has coordinate axes (X axis and Y axis) defined on the basis of the biaxial component of the acceleration data, and the acceleration data value in a state where acceleration including gravitational acceleration does not act on the acceleration sensor. In a two-dimensional coordinate system (XY coordinate system) that is the origin, a turning direction (clockwise, counterclockwise) in which acceleration data changes in time series with the origin as an axis is determined (FIGS. 9 to 12). The movement direction determination unit determines a direction (left swing, right swing) in which the input device has moved based on the circulation direction determined by the transition rotation direction determination unit. The output means outputs motion data including at least the moving direction determined by the motion direction determining means.

  According to a third aspect, in the second aspect, the transitional circulation direction determination unit increases the degree of contribution to the determination of the rotation direction with respect to acceleration data having a relatively large distance from the origin in the two-dimensional coordinate system. In addition, the rotation direction is determined using an operation that increases the degree of contribution to the determination of the rotation direction with respect to the acceleration data (transition R in FIG. 12) that changes in time series in the rotation direction with the origin as the axis. To do.

  According to a fourth aspect of the present invention based on the third aspect, the transitional circulation direction determining means is a coordinate point indicated by two acceleration data that are continuous in time series in the two-dimensional coordinate system and that transition in one of the circumferential directions. The first cumulative area (area A13 in FIG. 12), which is obtained by sequentially accumulating the area of the triangle having the vertex of the point and the origin in the time series, is calculated, continuously in time series, and changes in the revolving direction in the reverse direction. A second cumulative area (area A36 in FIG. 12) obtained by sequentially accumulating the triangular areas having the apexes of the coordinate point and the origin indicated by the two acceleration data in time series is calculated, and the first cumulative area and its When any one of the second cumulative areas exceeds the threshold value, it is determined that the acceleration data changes in a time series in the circulation direction in which the cumulative area is obtained.

  In a fifth aspect based on the second aspect, the motion determination apparatus further comprises a storage means (33). The storage means stores acceleration data sequentially acquired by the data acquisition means. In the two-dimensional coordinate system, the transitional circulation direction determination unit determines a circulation direction in which acceleration data acquired in a predetermined period among the acceleration data stored in the storage unit transitions in time series.

  In a sixth aspect based on the fifth aspect, the acceleration sensor detects acceleration in three axial directions (X, Y, Z axis directions) orthogonal to the input device. The transitional circulation direction determination means sets a period during which the acceleration in the first axis direction (Z-axis direction) included in the three axis directions exceeds a predetermined value as a predetermined period (Yes in S62). In the two-dimensional coordinate system, coordinate axes are defined based on other second axis and third axis direction (X and Y axis direction) components included in the three axis directions. The transitional circulation direction determination unit determines a circulation direction in which acceleration data in the other second axis and third axis directions acquired in a predetermined period and stored in the storage unit transition in time series.

  In a seventh aspect based on the sixth aspect, the motion determination apparatus further includes inclination determination means (S63, FIG. 16, FIG. 17). The inclination determination means determines the inclination state (UD) of the input device immediately before the predetermined period based on the acceleration data (Zave) in the first axis direction stored in the storage means before the predetermined period.

  In an eighth aspect based on the fifth aspect, the movement direction determination means further includes an angle calculation means (S101) and a rotation direction determination means (S102). In the two-dimensional coordinate system, the angle calculation means includes a vector heading from the origin to the coordinate point (start point Ps) indicated by the acceleration data acquired at the beginning of the predetermined period of the acceleration data stored in the storage means, and a predetermined period of time. The angle (θ) formed by the vector from the origin to the coordinate point (end point Pe) indicated by the finally acquired acceleration data is calculated. The rotation direction determination means determines that the input device has rotated in one direction with the direction orthogonal to the two axes (Z-axis direction) as the rotation axis when the angle exceeds the first threshold (120 °). When the angle is less than the second threshold (70 °), it is determined that the input device has rotated in the other direction with respect to the rotation axis. The output means outputs motion data further including the rotation direction (S) determined by the rotation direction determination means.

  In a ninth aspect based on the first aspect, the movement direction determination means includes transition direction determination means (S71). In the two-dimensional coordinate system in which coordinate axes are defined based on two-axis direction components of acceleration data, the transition direction determination means is a direction in which acceleration data transitions in time series with reference to the direction of gravitational acceleration acting on the input device. Determine. The movement direction determination means determines the movement direction of the input device relative to the gravitational acceleration acting on the input device based on the transition direction determined by the transition direction determination means. The output means outputs motion data including at least the moving direction determined by the motion direction determining means.

  In a tenth aspect based on the first aspect, the acceleration sensor detects acceleration including at least a centrifugal force component generated when the user grips and shakes the input device, and outputs acceleration data. The movement direction determination unit determines the movement direction of the input device using the acceleration data acquired during the period in which the acceleration of the centrifugal force component exceeds the threshold among the transition of the acceleration data acquired by the data acquisition unit.

  An eleventh aspect of the invention is a motion discrimination program executed by a computer (30) of a motion discrimination device that discriminates the motion of an input device that includes an acceleration sensor that detects acceleration in at least two axial directions. The motion determination program causes the computer to execute a data acquisition step, a motion direction determination step, and an output step. In the data acquisition step, acceleration data output from the acceleration sensor is acquired. The movement direction determination step determines the movement direction of the input device based on the direction of the gravitational acceleration acting on the input device based on the transition of the acceleration data acquired in the data acquisition step. The output step outputs motion data including at least the motion direction determined in the motion direction determination step.

  In a twelfth aspect based on the eleventh aspect, the movement direction determination step includes a transitional circulation direction determination step. The transitional orbiting direction determination step is a two-dimensional coordinate system in which coordinate axes are defined based on two-axis direction components of acceleration data, and the origin is the value of acceleration data in a state where acceleration including gravitational acceleration does not act on the acceleration sensor. , The turning direction in which the acceleration data changes in time series with the origin as the axis is determined. In the movement direction determination step, the direction in which the input device has moved is determined based on the rotation direction determined in the transition rotation direction determination step. In the output step, motion data including at least the moving direction determined in the motion direction determining step is output.

  In a thirteenth aspect based on the twelfth aspect, in the transitional circulation direction determination step, the degree of contribution to the determination of the rotation direction with respect to acceleration data having a relatively large distance from the origin in the two-dimensional coordinate system is increased. In addition, the rotation direction is determined using an operation that increases the degree of contribution to the determination of the rotation direction with respect to acceleration data that changes in time series in the rotation direction about the origin.

  In a fourteenth aspect based on the thirteenth aspect, in the transitional circulation direction determining step, coordinate points respectively indicated by two acceleration data that are continuous in time series in the two-dimensional coordinate system and transition in one of the circumferential directions. The first accumulated area is calculated by sequentially accumulating the area of the triangle with the apex and the origin as vertices along the time series, and two acceleration data that are continuous in time series and transition in the reverse direction of rotation are shown respectively. When a second cumulative area is calculated by sequentially accumulating the area of a triangle whose apex is the coordinate point and the origin in time series, and either one of the first cumulative area or the second cumulative area exceeds a threshold value , It is determined that the acceleration data changes in a time series in the circumferential direction in which the accumulated area is obtained.

  In a fifteenth aspect based on the twelfth aspect, the motion determination program causes the computer to further execute a storage control step. In the storage control step, the acceleration data sequentially acquired in the data acquisition step is stored in the memory (33). In the transitional lap direction determination step, in the two-dimensional coordinate system, among the acceleration data stored in the memory, the lap direction in which the acceleration data acquired in a predetermined period changes in time series is determined.

  In a sixteenth aspect based on the fifteenth aspect, the acceleration sensor detects acceleration in three axial directions orthogonal to the input device. In the transitional circulation direction determination step, a period in which the acceleration in the first axis direction included in the three axis directions exceeds a predetermined value is set as the predetermined period. In the two-dimensional coordinate system, coordinate axes are defined based on other second axis and third axis direction components included in the three axis directions. In the transitional circulation direction determination step, the circulation direction that changes in time series of the acceleration data in the other second axis and third axis directions acquired in a predetermined period and stored in the memory is determined.

  In a seventeenth aspect based on the sixteenth aspect, the motion determination program causes the computer to further execute an inclination determination step. In the inclination determination step, the inclination state of the input device immediately before the predetermined period is determined based on the acceleration data in the first axis direction stored in the memory before the predetermined period.

  In an eighteenth aspect based on the fifteenth aspect, the movement direction determination step further includes an angle calculation step and a rotation direction determination step. In the two-dimensional coordinate system, the angle calculation step includes a vector heading from the origin to the coordinate point indicated by the acceleration data acquired at the beginning of the predetermined period among the acceleration data stored in the memory, and acquired at the end of the predetermined period. An angle formed by a vector from the origin to the coordinate point indicated by the acceleration data is calculated. In the rotation direction determination step, when the angle exceeds the first threshold, it is determined that the input device has rotated in one direction with the direction orthogonal to the two axes as the rotation axis, and the angle is less than the second threshold. At this time, it is determined that the input device has rotated in the other direction with respect to the rotation axis. In the output step, motion data further including the rotation direction determined in the rotation direction determination step is output.

  In a nineteenth aspect based on the eleventh aspect, the movement direction determination step includes a transition direction determination step. The transition direction determination step is a direction in which acceleration data transitions in time series with reference to the direction of gravitational acceleration acting on the input device in a two-dimensional coordinate system in which coordinate axes are defined based on two-axis direction components of acceleration data. Determine. In the movement direction determination step, the movement direction of the input device relative to the gravitational acceleration acting on the input device is determined based on the transition direction determined in the transition direction determination step. In the output step, motion data including at least the moving direction determined in the motion direction determining step is output.

  In a twentieth aspect based on the eleventh aspect, the acceleration sensor detects acceleration including at least a centrifugal force component generated when the user grips and shakes the input device, and outputs acceleration data. In the movement direction determination step, the movement direction of the input device is determined using the acceleration data acquired during the period in which the acceleration of the centrifugal force component exceeds the threshold among the transition of the acceleration data acquired in the data acquisition step.

  According to the first aspect of the invention, since the direction of movement based on the direction of gravitational acceleration acting on the input device is determined, the direction of movement of the input device can be accurately determined, and the direction in which the user has the input device The degree of freedom with respect to (the attitude of the input device) becomes very high.

  According to the second aspect of the present invention, in the two-dimensional coordinate system showing the obtained acceleration data in time series, the direction in which the user has the input device (input device) is determined by determining the rotation direction in which the acceleration data changes. The direction in which the input device has moved relative to the gravitational acceleration can be accurately determined, and the moving direction can also be used as an operation input.

  According to the third aspect of the invention, with respect to the determination of the rotation direction, the evaluation of the determination of the rotation direction is improved by performing the evaluation so that the contribution degree of the highly reliable acceleration data is increased.

  According to the fourth aspect of the present invention, by evaluating the area of the triangle connecting the acceleration data transitioning in the forward or reverse direction and the origin of the two-dimensional coordinate system, respectively, the reliability regarding the determination of the direction of rotation is obtained. Judgment can be made appropriately.

  According to the fifth aspect, the determination using the acceleration data obtained during the predetermined period reduces the influence of noise and the like that are unnecessary for the determination, and improves the determination accuracy in the circulation direction.

  According to the sixth aspect of the invention, determination is made using acceleration data of the remaining two axes in a period in which the value of the first axis exceeds the predetermined value among the three axes orthogonal to each other. Accordingly, by setting the acceleration when the user swings the input device to affect the first axis direction, it is possible to determine the period during which the input device is being shaken. The moving direction in which the user shakes the input device can be determined.

  According to the seventh aspect, since it is possible to determine the tilt direction of the input device before the user swings the input device, the movement direction and the tilt direction can be used as operation inputs.

  According to the eighth aspect of the invention, when the user moves (swings) the input device while rotating (twisting), the direction of rotation of the input device can be determined in addition to the direction of movement of the input device. The direction and rotation direction can also be used as operation inputs.

  According to the ninth aspect, in the two-dimensional coordinate system showing the obtained acceleration data in time series, the transition direction of the acceleration data is determined with reference to the direction of the gravitational acceleration obtained from the acceleration data. Thus, the direction in which the input device has moved relative to the gravitational acceleration can be accurately determined without being affected by the direction in which the user holds the input device (the posture of the input device).

  According to the tenth aspect of the present invention, the determination is made using the acceleration data obtained when the acceleration generated when the user swings the input device exceeds a predetermined value, so that it is obtained only from the start of swing to the end of swing. The determination using the acceleration data obtained can be performed, and the moving direction or the like in which the user swings the input device from the start to the end of the swing can be determined.

  According to the motion discrimination program of the present invention, the same effect as that of the motion discrimination device described above can be obtained.

  With reference to FIG. 1, a motion discriminating apparatus according to an embodiment of the present invention will be described. Hereinafter, in order to make the description more specific, the game system 1 using the motion determination device will be described as an example. FIG. 1 is an external view for explaining the game system 1. Hereinafter, the game system 1 will be described with reference to an example of a stationary game device corresponding to the motion determination device of the present invention.

  In FIG. 1, the game system 1 includes a stationary game apparatus (hereinafter referred to as a monitor) 2 connected to a display (hereinafter referred to as a monitor) 2 having a speaker 2a such as a home television receiver via a connection cord. 3) and a controller 7 that gives operation information to the game apparatus 3. The game apparatus 3 is connected to the receiving unit 6 via a connection terminal. The receiving unit 6 receives transmission data wirelessly transmitted from the controller 7, and the controller 7 and the game apparatus 3 are connected by wireless communication. Further, an optical disk 4 as an example of an information storage medium that can be used interchangeably with the game apparatus 3 is attached to and detached from the game apparatus 3. The upper main surface of the game apparatus 3 is provided with a power ON / OFF switch of the game apparatus 3, a reset switch for game processing, and an OPEN switch for opening the lid on the upper part of the game apparatus 3. Here, when the player presses the OPEN switch, the lid is opened, and the optical disk 4 can be attached and detached.

  Further, an external memory card 5 equipped with a backup memory or the like for storing save data or the like in a fixed manner is detachably attached to the game apparatus 3 as necessary. The game apparatus 3 displays a result as a game image on the monitor 2 by executing a game program or the like stored on the optical disc 4. Furthermore, the game apparatus 3 can reproduce the game state executed in the past by using the save data stored in the external memory card 5 and display the game image on the monitor 2. Then, the player of the game apparatus 3 can enjoy the progress of the game by operating the controller 7 while viewing the game image displayed on the monitor 2.

  The controller 7 wirelessly transmits transmission data from a communication unit 75 (described later) provided therein to the game apparatus 3 to which the receiving unit 6 is connected, using, for example, Bluetooth (registered trademark) technology. The controller 7 is an operation means for operating a player object appearing in a game space mainly displayed on the monitor 2. The controller 7 is provided with an operation unit such as a plurality of operation buttons, keys, and sticks. Further, as will be apparent from the description below, the controller 7 includes an imaging information calculation unit 74 that captures an image viewed from the controller 7. In addition, as an example of an imaging target of the imaging information calculation unit 74, two LED modules (hereinafter referred to as markers) 8L and 8R are installed near the display screen of the monitor 2. These markers 8L and 8R each output infrared light toward the front of the monitor 2. In this embodiment, since the imaging information by the imaging information calculation unit 74 is not used, the markers 8L and 8R need not be installed.

  Next, the configuration of the game apparatus 3 will be described with reference to FIG. FIG. 2 is a functional block diagram of the game apparatus 3.

  In FIG. 2, the game apparatus 3 includes, for example, a risk (RISC) CPU (Central Processing Unit) 30 that executes various programs. The CPU 30 executes a startup program stored in a boot ROM (not shown), initializes a memory such as the main memory 33, and the like, then executes a game program stored in the optical disc 4, and according to the game program Game processing and the like. Note that the game program stored on the optical disc 4 includes the motion determination program of the present invention, and the CPU 30 also performs a motion determination process for determining the movement of the controller 7 in the game process. A GPU (Graphics Processing Unit) 32, a main memory 33, a DSP (Digital Signal Processor) 34, and an ARAM (Audio RAM) 35 are connected to the CPU 30 via a memory controller 31. The memory controller 31 is connected to a controller I / F (interface) 36, a video I / F 37, an external memory I / F 38, an audio I / F 39, and a disk I / F 41 via a predetermined bus. The receiving unit 6, the monitor 2, the external memory card 5, the speaker 2a, and the disk drive 40 are connected.

  The GPU 32 performs image processing based on an instruction from the CPU 30, and is configured by a semiconductor chip that performs calculation processing necessary for displaying 3D graphics, for example. The GPU 32 performs image processing using a memory dedicated to image processing (not shown) and a partial storage area of the main memory 33. The GPU 32 generates game image data and movie video to be displayed on the monitor 2 using these, and outputs them to the monitor 2 through the memory controller 31 and the video I / F 37 as appropriate.

  The main memory 33 is a storage area used by the CPU 30 and stores game programs and the like necessary for the processing of the CPU 30 as appropriate. For example, the main memory 33 stores a game program read from the optical disc 4 by the CPU 30 and various data. The game program and various data stored in the main memory 33 are executed by the CPU 30.

  The DSP 34 processes sound data generated by the CPU 30 when the game program is executed, and is connected to an ARAM 35 for storing the sound data. The ARAM 35 is used when the DSP 34 performs a predetermined process (for example, storage of a pre-read game program or sound data). The DSP 34 reads the sound data stored in the ARAM 35 and outputs the sound data to the speaker 2 a included in the monitor 2 via the memory controller 31 and the audio I / F 39.

  The memory controller 31 controls the overall data transfer and is connected to the various I / Fs described above. The controller I / F 36 includes, for example, four controller I / Fs 36a to 36d, and connects the external device and the game apparatus 3 that can be fitted to each other via a connector included in the controller I / F 36 so as to communicate with each other. For example, the receiving unit 6 is fitted with the connector and connected to the game apparatus 3 via the controller I / F 36. As described above, the receiving unit 6 receives the transmission data from the controller 7 and outputs the transmission data to the CPU 30 via the controller I / F 36. A monitor 2 is connected to the video I / F 37. An external memory card 5 is connected to the external memory I / F 38 and can access a backup memory or the like provided in the external memory card 5. A speaker 2a built in the monitor 2 is connected to the audio I / F 39 so that sound data read out from the ARAM 35 by the DSP 34 or sound data directly output from the disk drive 40 can be output from the speaker 2a. A disk drive 40 is connected to the disk I / F 41. The disk drive 40 reads data stored on the optical disk 4 arranged at a predetermined reading position, and outputs the data to the bus of the game apparatus 3 and the audio I / F 39.

  With reference to FIG. 3 and FIG. 4, the controller 7 which is an example of the input device of this invention is demonstrated. FIG. 3 is a perspective view of the controller 7 as viewed from the upper rear side. FIG. 4 is a perspective view of the controller 7 as seen from the bottom rear side.

  3 and 4, the controller 7 includes a housing 71 formed by plastic molding, for example, and the housing 71 is provided with a plurality of operation units 72. The housing 71 has a substantially rectangular parallelepiped shape whose longitudinal direction is the front-rear direction, and is a size that can be gripped with one hand of an adult or a child as a whole.

  A cross key 72 a is provided on the center front side of the upper surface of the housing 71. The cross key 72a is a cross-shaped four-direction push switch, and operation portions corresponding to the four directions (front and rear, left and right) indicated by arrows are arranged at 90 ° intervals on the cross protruding pieces, respectively. The player selects one of the front, rear, left and right directions by pressing one of the operation portions of the cross key 72a. For example, when the player operates the cross key 72a, it is possible to instruct the moving direction of the player character or the like appearing in the virtual game world, or to instruct the moving direction of the cursor.

  Note that the cross key 72a is an operation unit that outputs an operation signal in response to the above-described direction input operation of the player, but may be an operation unit of another mode. For example, instead of the cross key 72a, a composite switch in which a push switch having a four-direction operation portion in a ring shape and a center switch provided at the center thereof may be provided. Further, an operation unit that outputs an operation signal according to the tilt direction by tilting a tiltable stick protruding from the upper surface of the housing 71 may be provided instead of the cross key 72a. Furthermore, an operation unit that outputs an operation signal corresponding to the sliding direction by sliding a horizontally movable disk-shaped member may be provided instead of the cross key 72a. Further, a touch pad may be provided instead of the cross key 72a. Further, an operation unit that outputs an operation signal in response to a switch pressed by the player may be provided instead of the cross key 72a for switches indicating at least four directions (front / rear / left / right).

  A plurality of operation buttons 72 b to 72 g are provided on the rear surface side of the cross key 72 a on the upper surface of the housing 71. The operation buttons 72b to 72g are operation units that output operation signals assigned to the operation buttons 72b to 72g when the player presses the button head. For example, functions such as an X button, a Y button, and a B button are assigned to the operation buttons 72b to 72d. Further, functions as a select switch, a menu switch, a start switch, and the like are assigned to the operation buttons 72e to 72g. Each of these operation buttons 72b to 72g is assigned a function according to a game program executed by the game apparatus 3, but will not be described in detail because it is not directly related to the description of the present invention. In the arrangement example shown in FIG. 3, the operation buttons 72 b to 72 d are arranged side by side along the center front-rear direction on the upper surface of the housing 71. Further, the operation buttons 72e to 72g are arranged in parallel between the operation buttons 72b and 72d along the left-right direction of the upper surface of the housing 71. The operation button 72f is a type of button whose upper surface is buried in the upper surface of the housing 71 and is not accidentally pressed by the player.

  An operation button 72h is provided on the front surface side of the cross key 72a on the upper surface of the housing 71. The operation button 72h is a power switch for remotely turning on / off the game apparatus 3 main body. This operation button 72h is also a type of button whose upper surface is buried in the upper surface of the housing 71 and that the player does not accidentally press.

  A plurality of LEDs 702 are provided on the rear surface side of the operation button 72 c on the upper surface of the housing 71. Here, the controller 7 is provided with a controller type (number) to distinguish it from other controllers 7. For example, the LED 702 is used to notify the player of the controller type currently set in the controller 7. Specifically, when transmission data is transmitted from the controller 7 to the receiving unit 6, the LED corresponding to the type among the plurality of LEDs 702 is turned on according to the controller type.

  On the other hand, a recess is formed on the lower surface of the housing 71. As will be described later, the recess on the lower surface of the housing 71 is formed at a position where the player's index finger or middle finger is positioned when the player holds the controller 7. And the operation button 72i is provided in the rear surface side inclined surface of the said recessed part. The operation button 72i is an operation unit that functions as an A button, for example, and is used for a trigger switch in a shooting game, an operation for causing a player object to pay attention to a predetermined object, or the like.

  An imaging element 743 that constitutes a part of the imaging information calculation unit 74 is provided on the front surface of the housing 71. Here, the imaging information calculation unit 74 is a system for analyzing the image data captured by the controller 7 to determine a location where the luminance is high and detecting the position of the center of gravity, the size, and the like of the location. Since the maximum sampling period is about 200 frames / second, even a relatively fast movement of the controller 7 can be tracked and analyzed. A connector 73 is provided on the rear surface of the housing 70. The connector 73 is a 32-pin edge connector, for example, and is used for fitting and connecting with a connection cable, for example. In the present invention, since information from the imaging information calculation unit 74 is not used, further explanation is omitted here.

  Here, in order to explain specifically, a coordinate system set for the controller 7 is defined. As shown in FIGS. 3 and 4, XYZ axes orthogonal to each other are defined for the controller 7. Specifically, the longitudinal direction of the housing 71, which is the front-rear direction of the controller 7, is the Z axis, and the front surface (the surface on which the imaging information calculation unit 74 is provided) of the controller 7 is the Z axis positive direction. Further, the vertical direction of the controller 7 is defined as the Y axis, and the upper surface (the surface provided with the cross key 72a and the like) of the housing 71 is defined as the Y axis positive direction. Further, the left-right direction of the controller 7 is taken as the X axis, and the left side surface (side face shown in FIG. 4 but not shown in FIG. 3) direction is taken as the X-axis positive direction.

  Next, the internal structure of the controller 7 will be described with reference to FIG. FIG. 5A is a perspective view showing a state in which the upper housing (a part of the housing 71) of the controller 7 is removed. FIG. 5B is a perspective view showing a state where the lower casing (a part of the housing 71) of the controller 7 is removed. Here, the substrate 700 shown in FIG. 5B is a perspective view seen from the back surface of the substrate 700 shown in FIG.

  5A, a substrate 700 is fixed inside the housing 71, and operation buttons 72a to 72h, an acceleration sensor 701, an LED 702, a crystal resonator 703, a wireless module are provided on the upper main surface of the substrate 700. 753, an antenna 754, and the like are provided. These are connected to the microcomputer 751 (see FIG. 6) by wiring (not shown) formed on the substrate 700 or the like. The acceleration sensor 701 detects and outputs an acceleration that can be used for calculating inclination, vibration, and the like in the three-dimensional space in which the controller 7 is arranged.

  More specifically, as shown in FIG. 6, the controller 7 preferably includes a triaxial acceleration sensor 701. The three-axis acceleration sensor 701 is linearly accelerated in three directions, that is, a vertical direction (Y axis shown in FIG. 3), a horizontal direction (X axis shown in FIG. 3), and a front-back direction (Z axis shown in FIG. 3). Is detected. In other embodiments, depending on the type of control signal used in the game process, the biaxial acceleration that detects only the linear acceleration along each of the X axis and the Y axis (or another pair of axes). Detection means may be used. For example, the triaxial or biaxial acceleration sensor 701 may be of the type available from Analog Devices, Inc. or ST Microelectronics NV. The acceleration sensor 701 is preferably a capacitance type (capacitive coupling type) based on a micro-electromechanical system (MEMS) micromachined silicon technique. However, the triaxial or biaxial acceleration sensor 701 may be provided by using existing acceleration detecting means technology (for example, a piezoelectric method or a piezoresistive method) or other appropriate technology developed in the future.

  As known to those skilled in the art, the acceleration detection means used in the acceleration sensor 701 can detect only the acceleration (linear acceleration) along a straight line corresponding to each axis of the acceleration sensor. That is, the direct output from the acceleration sensor 701 is a signal indicating linear acceleration (static or dynamic) along each of the two or three axes. For this reason, the acceleration sensor 701 cannot directly detect physical characteristics such as movement, rotation, rotational movement, angular displacement, inclination, position, or posture along a non-linear (for example, arc) path.

  However, it is understood by those skilled in the art that additional information regarding the controller 7 can be estimated or calculated (determined) by performing additional processing on the acceleration signal output from the acceleration sensor 701. It will be easily understood from the explanation. For example, when static acceleration (gravity acceleration) is detected, the output of the acceleration sensor 701 is used to calculate the inclination of the target (controller 7) with respect to the gravity vector by calculation using the inclination angle and the detected acceleration. Can be determined. Thus, by using the acceleration sensor 701 in combination with the microcomputer 751 (or other processor), the inclination, posture, or position of the controller 7 can be determined. Similarly, when the controller 7 including the acceleration sensor 701 is dynamically accelerated and moved by a user's hand, for example, as will be described later, the acceleration signal generated by the acceleration sensor 701 is processed. Correct movement and / or position can be calculated. In another embodiment, the acceleration sensor 701 is a built-in signal processing device or other device for performing desired processing on the acceleration signal output from the built-in acceleration detection means before outputting the signal to the microcomputer 42. This type of processing device may be provided. For example, if the acceleration sensor is for detecting a static acceleration (for example, gravitational acceleration), the built-in or dedicated processing device uses the detected acceleration signal as the corresponding inclination angle (or other It may be converted into a preferable parameter.

  Further, the controller 7 functions as a wireless controller by the communication unit 75 including the wireless module 753 and the antenna 754. The crystal resonator 703 generates a basic clock for the microcomputer 751 described later.

  On the other hand, in FIG. 5B, the imaging information calculation unit 74 is provided at the front edge on the lower main surface of the substrate 700. The imaging information calculation unit 74 includes an infrared filter 741, a lens 742, an imaging element 743, and an image processing circuit 744 in order from the front of the controller 7, and each is attached to the lower main surface of the substrate 700. A connector 73 is attached to the rear edge on the lower main surface of the substrate 700. And the operation button 72i is attached on the lower main surface of the board | substrate 700 in the back of the imaging information calculating part 74, and the battery 705 is accommodated in the back further. A vibrator 704 is attached on the lower main surface of the substrate 700 between the battery 705 and the connector 73. The vibrator 704 may be a vibration motor or a solenoid, for example. Since the vibration is generated in the controller 7 by the operation of the vibrator 704, the vibration is transmitted to the hand of the player holding it, and a so-called vibration-compatible game can be realized.

  Next, the internal configuration of the controller 7 will be described with reference to FIG. FIG. 6 is a block diagram showing the configuration of the controller 7.

  The imaging information calculation unit 74 includes an infrared filter 741, a lens 742, an imaging element 743, and an image processing circuit 744. The infrared filter 741 allows only infrared rays to pass from light incident from the front of the controller 7. The lens 742 condenses the infrared light that has passed through the infrared filter 741 and outputs the condensed infrared light to the image sensor 743. The imaging element 743 is a solid-state imaging element such as a CMOS sensor or a CCD, for example, and images the infrared rays collected by the lens 742. Therefore, the image sensor 743 captures only the infrared light that has passed through the infrared filter 741 and generates image data. Image data generated by the image sensor 743 is processed by an image processing circuit 744. Specifically, the image processing circuit 744 processes the image data obtained from the image sensor 743 to detect high-luminance portions, and transmits processing result data indicating the result of detecting their position coordinates and area to the communication unit 75. Output to. The imaging information calculation unit 74 is fixed to the housing 71 of the controller 7, and the imaging direction can be changed by changing the direction of the housing 71 itself.

  As described above, the acceleration sensor 701 detects and outputs acceleration by dividing the controller 7 into three axis components in the vertical direction (Y-axis direction), the horizontal direction (X-axis direction), and the front-back direction (Z-axis direction). Sensor. Data indicating the acceleration of the three-axis components detected by the acceleration sensor 701 is output to the communication unit 75, respectively. Based on the acceleration data output from the acceleration sensor 701, the movement of the controller 7 can be determined. As the acceleration sensor 701, an acceleration sensor that detects acceleration with respect to any two axes according to data necessary for a specific application may be used.

  The communication unit 75 includes a microcomputer (microcomputer) 751, a memory 752, a wireless module 753, and an antenna 754. The microcomputer 751 controls the wireless module 753 that wirelessly transmits transmission data while using the memory 752 as a storage area during processing.

  An operation signal (key data) from the operation unit 72 provided in the controller 7, a triaxial acceleration signal (X, Y, and Z axis direction acceleration data) from the acceleration sensor 701, and an imaging information calculation unit 74 The processing result data is output to the microcomputer 751. The microcomputer 751 temporarily stores each input data (key data, X, Y, and Z-axis direction acceleration data, processing result data) as transmission data to be transmitted to the receiving unit 6 in the memory 752. Here, the wireless transmission from the communication unit 75 to the receiving unit 6 is performed every predetermined cycle, but since the game processing is generally performed in units of 1/60 seconds, it is shorter than that. It is necessary to transmit at periodic intervals. Specifically, the processing unit of the game is 16.7 ms (1/60 seconds), and the transmission interval of the communication unit 75 configured by Bluetooth (registered trademark) is 5 ms. When the transmission timing to the receiving unit 6 comes, the microcomputer 751 outputs the transmission data stored in the memory 752 as a series of operation information and outputs it to the wireless module 753. The wireless module 753 radiates operation information from the antenna 754 as a radio wave signal using a carrier wave of a predetermined frequency using, for example, Bluetooth (registered trademark) technology. That is, key data from the operation unit 72 provided in the controller 7, X, Y and Z axis direction acceleration data from the acceleration sensor 701, and processing result data from the imaging information calculation unit 74 are transmitted from the controller 7. . Then, the radio signal is received by the receiving unit 6 of the game apparatus 3, and the radio signal is demodulated or decoded by the game apparatus 3, thereby a series of operation information (key data, X, Y, and Z-axis direction acceleration data). , And processing result data). And CPU30 of the game device 3 performs a game process based on the acquired operation information and a game program. When the communication unit 75 is configured using the Bluetooth (registered trademark) technology, the communication unit 75 can also have a function of receiving transmission data wirelessly transmitted from other devices.

  Next, before describing specific processing performed by the game apparatus 3, an outline of a game performed by the game apparatus 3 will be described. As shown in FIG. 7, the controller 7 has a size that can be held with one hand of an adult or a child as a whole. And in order to play a game using the controller 7 with the game system 1, a player hold | grips the controller 7 with one hand (for example, right hand) so that the front surface of the controller 7 may face the front direction of a player. For example, the player attaches the thumb to the left side of the controller 7, attaches the palm to the top surface of the controller 7, attaches the index finger, middle finger, ring finger, and little finger to the bottom surface of the controller 7, and the front surface of the controller 7 is exposed in the forward direction of the player. Then, the controller 7 is gripped as if a tennis racket is being gripped.

  The player swings the arm holding the controller 7 from the right to the left as viewed from the player in accordance with the game image represented on the monitor 2 (hereinafter referred to as “left swing”), or the controller 7. By swinging the arm holding the handle from the left to the right when viewed from the player (hereinafter referred to as “right swing”), the controller 7 controls the operation information (specifically, X, Y, and Z). Axis direction acceleration data) is given to the game apparatus 3. In addition to the left and right swings described above, the player swings left and right while swinging the controller 7 upward from the bottom, swings left and right while swinging the controller 7 downward from the top, Various X, Y, and Z-axis direction acceleration data can be given to the game apparatus 3 from the controller 7 by performing a left swing or a right swing while twisting right or left.

  As shown in FIG. 8, a tennis game or the like is represented on the monitor 2 in accordance with X, Y, and Z-axis direction acceleration data received from the controller 7. Specifically, a tennis court set in the virtual game space is represented on the monitor 2 as a three-dimensional game image. In the virtual game space, a player character PC operated by the player, an opponent character EC as an opponent player of the player character PC, a ball character BC indicating a tennis ball moving on the tennis court, and the like are arranged on the monitor 2. Expressed. Hereinafter, for the sake of specific explanation, a game program representing a tennis game is stored in the optical disc 4, and a movement determination process for the CPU 30 to determine the movement of the controller 7 during the tennis game process will be described.

  The player character PC has a tennis racket and is placed on the tennis court set in the virtual game space. Then, an animation in which the player character PC also swings the tennis racket is expressed in accordance with the motion of the player swinging the controller 7. When the player character PC hits the incoming ball character BC with a tennis racket, the ball character BC hit with the tennis racket flies toward the court on the opponent character EC side. In other words, when the player performs the motion of holding the controller 7 and swinging, the player character PC similarly expresses the motion of swinging the tennis racket, and the player seems to play tennis by swinging the tennis racket. You can experience a virtual sports game.

  For example, when the player character PC represents a right-handed tennis player, the player character PC swings the tennis racket with the forehand by holding the controller 7 and “swinging left”. On the other hand, the player character PC swings the tennis racket with the back hand by holding the controller 7 and “swinging to the right”. That is, according to the direction in which the player swings the controller 7, the player character PC performs an action of swinging the tennis racket in the same direction.

  Further, the direction and speed of the ball character BC that is hit with the tennis racket on which the player character PC swings changes according to the timing and speed at which the player swings the controller 7. Further, the trajectory height of the ball character BC changes as the player swings left or right while swinging the controller 7 up and down. In addition, when the player swings the controller 7 while turning it to the right or left, it is possible to return the ball character BC to which the so-called top spin or under spin is applied to the opponent character EC. As will be described later, these operations can be distinguished by X, Y, and Z-axis direction acceleration data output from the controller 7, and tennis that reflects various operations performed by the player on the controller 7. A game can be expressed.

First, a method for determining whether or not the controller 7 has been shaken will be described. First, when the Z-axis direction acceleration data indicates a value in the positive Z-axis direction that exceeds the threshold value, the game apparatus 3 determines that the player has swung the controller 7. For example, when the controller 7 is in a stationary state, the acceleration sensor 701 does not detect an acceleration exceeding the gravitational acceleration 9.8 m / s ² . On the other hand, as described above, when the player grips the controller 7 and swings his / her arm, the front end of the controller 7 moves along an arcuate trajectory. ) Acceleration is detected. In this embodiment, when a threshold value equal to or higher than the gravitational acceleration is set and the Z-axis direction acceleration data indicates an acceleration exceeding the threshold value, it is determined that the player is swinging the controller 7.

  Next, a method for determining the direction in which the controller 7 is being shaken based on the X and Y-axis direction acceleration data when it is determined that the controller 7 is being shaken will be described with reference to FIG. FIGS. 9A to 9D are examples of graphs in which the positive and negative accelerations and magnitudes indicated by the X and Y axis direction acceleration data are X and Y axes, respectively. Then, the accelerations indicated by the X and Y-axis direction acceleration data obtained at the same time every income time (for example, every 5 ms) are plotted in order in the XY coordinate system. In FIG. 9A to FIG. 9D, the acceleration indicated by the X-axis and Y-axis direction acceleration data obtained at the same time is shown as a point P, and is shown by an arrow in the order in which the data was obtained. 9A to 9D show the values of acceleration data in a state where no acceleration including gravitational acceleration is added to the acceleration sensor 701. The origin (X, Y) = (0, 0). The magnitude of gravitational acceleration is indicated as “1” (corresponding to the position indicated by the broken line).

  When the controller 7 is gripped and shaken, the swing start is accelerated and the swing end is decelerated. Therefore, after the acceleration in the same direction as the direction of waving at the beginning of the swing is generated in the controller 7, the magnitude of the acceleration gradually decreases, and the acceleration is in the direction opposite to the direction of waving at the end of the swing. Arise. On the other hand, in general, the acceleration vector (or the sign of acceleration) output from the acceleration sensor 701 is a vector that is opposite to the acceleration direction of the controller 7. Therefore, the acceleration sensor 701 detects the acceleration in a direction opposite to the direction that the controller 7 swings at the start of swinging, and then gradually decreases in magnitude to the same direction as the direction that swings at the end of swinging. Acceleration is detected.

  For example, when acceleration is performed by swinging leftward with the upper surface of the controller 7 facing upward (that is, the acceleration direction of the controller 7 is the positive direction of the X axis), the acceleration vector obtained from the acceleration sensor 701 is a vector in the negative direction of the X axis. Will be obtained. Therefore, when the acceleration indicated by the X and Y-axis direction acceleration data obtained simultaneously while shaking is plotted in the XY coordinate system, the plot is started from the negative direction of the X-axis when the controller 7 starts accelerating. Begins. Since the end of the swing of the controller 7 is decelerated, it is plotted in the positive direction of the X axis. Further, since gravitational acceleration is always applied to the acceleration sensor 701, an acceleration having a magnitude of “1” is detected in the vertical direction (here, the Y-axis negative direction). Therefore, when the controller 7 is swung horizontally with the top surface facing upward, the acceleration in the Y-axis direction changes from “X-axis negative direction to X-axis positive direction (X + direction) sequentially while the X-axis direction acceleration changes to“ − ”. The points P that become constant at “1” are sequentially plotted in the XY coordinate system (FIG. 9A).

  As the acceleration vector obtained from the acceleration sensor 701 when the top surface of the controller 7 is accelerated horizontally by swinging leftward toward the 90 ° left direction when viewed from the player (that is, the acceleration direction of the controller 7 is the positive direction of the Y axis). Will yield a vector in the negative Y-axis direction. Therefore, when the acceleration indicated by the X and Y-axis direction acceleration data obtained simultaneously while shaking is plotted on the XY coordinate system, the plot is started from the negative direction of the Y-axis when the controller 7 starts to swing. Begins. Since the end of the swing of the controller 7 is decelerated, it is plotted in the positive Y-axis direction. Further, since gravitational acceleration is always applied to the acceleration sensor 701, an acceleration having a magnitude of “1” is detected in the vertical direction (here, the positive direction of the X axis). Therefore, when the upper surface of the controller 7 is horizontally swung toward the left 90 ° direction when viewed from the player, the acceleration in the X-axis direction is constant “+1” and the acceleration in the Y-axis direction is positive from the Y-axis negative direction to the Y-axis positive direction. The points P that sequentially transition in the direction (Y + direction) are plotted in order in the XY coordinate system (FIG. 9B).

  Further, when acceleration is performed by swinging leftward with the upper surface of the controller 7 facing down (that is, the acceleration direction of the controller 7 is the negative X-axis direction), the acceleration vector obtained from the acceleration sensor 701 is a vector in the positive X-axis direction. Will be obtained. Therefore, when the accelerations indicated by the X and Y axis direction acceleration data obtained simultaneously when shaking is plotted in the XY coordinate system, the plotting is started from the X axis positive direction when the controller 7 starts accelerating. Begins. Since the end of the swing of the controller 7 is decelerated, it is plotted in the X axis negative direction. Further, since gravitational acceleration is always applied to the acceleration sensor 701, an acceleration having a magnitude of “1” is detected in the vertical direction (here, the Y-axis positive direction). Therefore, when the controller 7 is swung horizontally with the upper surface facing downward, the acceleration in the Y-axis direction changes while the acceleration in the X-axis direction sequentially changes from the positive X-axis direction to the negative X-axis direction (X-direction). The points P that become constant at “+1” are plotted in order in the XY coordinate system (FIG. 9C).

  Further, when the upper surface of the controller 7 is viewed from the player and turned leftward in the direction of 90 ° rightward (ie, the acceleration direction of the controller 7 is the Y axis negative direction), the acceleration vector obtained from the acceleration sensor 701 is obtained as an acceleration vector. Will obtain a vector in the positive direction of the Y-axis. Therefore, when the acceleration indicated by the X and Y-axis direction acceleration data obtained simultaneously while shaking is plotted in the XY coordinate system, the controller 7 plots from the positive direction of the Y-axis when accelerating at the beginning of the swing. Begins. Since the end of the swing of the controller 7 is decelerated, it is plotted in the Y axis negative direction. Further, since gravitational acceleration is always applied to the acceleration sensor 701, an acceleration having a magnitude “1” is detected in the vertical direction (here, the X-axis negative direction). Therefore, when the upper surface of the controller 7 is horizontally swung toward the right 90 ° direction when viewed from the player, the acceleration in the X-axis direction is constant “−1” and the acceleration in the Y-axis direction is changed from the Y-axis positive direction to the Y-axis. Points P that sequentially transition in the negative direction (Y-direction) are plotted in order in the XY coordinate system (FIG. 9D).

  Thus, when the player holds the controller 7 and swings left, the change tendency of the acceleration obtained from the X and Y-axis direction acceleration data differs depending on the direction in which the player holds the controller 7. However, as is apparent from FIGS. 9A to 9D, when the player swings the controller 7 to the left, all the points P shift clockwise around the origin of the XY coordinate system. ing. On the other hand, when the player swings the controller 7 to the right, it is clear that the acceleration tends to be opposite to that of the left swing, and all the points P shift counterclockwise around the origin of the XY coordinate system. Become. In other words, by calculating the turning direction in which the plot point P changes based on the origin of the XY coordinate system, it is possible to determine the direction in which the player is swinging the controller 7 (the moving direction of the controller 7). Become. The relationship between the turning direction in which the plot point P changes and the direction in which the controller 7 is swung varies depending on the setting of the coordinate axis, the characteristics of the acceleration sensor, the setting of the XY coordinate system, and the like. The relationship may be adjusted according to Specifically, based on the direction of gravitational acceleration based on the obtained acceleration data (broken arrow direction shown in FIGS. 9A to 9D), the transition direction of the acceleration data with respect to the direction of the gravitational acceleration. Can be accurately determined in the direction in which the controller 7 is swung.

  However, in reality, the transition of the point P plotted in the XY coordinate system is complicated as shown in FIG. 10 due to the influence of backswing (swinging) and twisting performed before the player swings the controller 7. Often draws a curve. For example, FIG. 10 shows an example of a left-handed transition. At the beginning of the swing, a counterclockwise transition (points P1 to P3; transition L) appears with respect to the origin, and then a clockwise transition (points P3 to P3). P10; transition R) appears, so if the swing direction is determined at the time of transition L, it is determined to be right swing. The transition L is a data group in which the magnitude of the acceleration is relatively small because the back swing swing strength is weak. Moreover, although the transition is close to the radial direction from the origin, this is because the controller 7 is swung in a direction different from the right swing or the left swing. Therefore, it can be said that the data group in which the magnitude of the acceleration is relatively small and changes from the origin to the radial direction is data with low reliability for determining the swing direction. Therefore, it can be said that the swing direction can be accurately determined by using a transition similar to the rotation direction centered on the origin, such as the transition R, which is a data group having a relatively large acceleration. In other words, in order to determine the swing direction, the data having a relatively large acceleration has a higher reliability, and the transition closer to the rotation direction around the origin has a higher reliability.

  The reliability is represented by the area of a triangle connecting two acceleration data that are continuous in time series and the origin. For example, as shown in FIG. 11, consider an area A45 of a triangle surrounded by straight lines connecting points P4 and P5 adjacent in time series and the origin. In this case, if the triangle is formed using the point P having a relatively large acceleration, the area A45 becomes large. In addition, when a triangle is formed using the point P that changes in the circulation direction around the origin, the area A45 increases. That is, it can be seen that the reliability can be expressed by the size of the area A45.

  FIG. 12 shows an area A13 of a region in which triangles formed by two adjacent points and the origin are accumulated at points P1 to P3 that are continuous in time series shown in FIG. It is a figure which shows area A36 (area A13 overlaps with a part of area A36) of the area | region which accumulated the triangle formed by each two adjacent points and the origin. As shown in FIG. 12, the area A <b> 13 is a cumulative area of triangles calculated using points P <b> 1 to P <b> 3 that show a counterclockwise transition with respect to the origin. On the other hand, the area A36 is a cumulative area of triangles calculated using points P3 to P6 showing a clockwise transition with respect to the origin. As is apparent from FIG. 12, the area A13 is much smaller than the area A36. In the present embodiment, the area of the clockwise triangle and the area of the counterclockwise triangle are accumulated along the time series, and if one of the accumulated values exceeds the threshold value, it is included in the triangle forming the exceeding accumulated area. The swing direction is determined based on whether the transition of the point P is clockwise or counterclockwise. Thereby, it is possible to determine an accurate swing direction while eliminating the influence of data with low reliability. Here, if all the points P from the start to the end of swing are analyzed, it can be considered that the correct swing direction can be determined. However, in this embodiment, the swing direction is determined at an early stage during the swing operation. In order to make a determination, a determination based on a threshold is performed.

  Next, the determination of the speed at which the player swings the controller 7 will be described. When the player swings the controller 7 quickly, the period from acceleration to deceleration is relatively short. On the other hand, when the player swings the controller 7 slowly, the period from acceleration to deceleration is relatively long. That is, when the player swings the controller 7 with the same swing width, the interval between the points P plotted in the XY coordinate system (hereinafter sometimes referred to as data interval) becomes wider as the player swings the controller 7 faster. Become. Therefore, it is possible to calculate the speed at which the player swings the controller 7 by determining the intervals between the points P that are continuous in time series. In the present embodiment, all points P from the start to the end of swing are analyzed, and the speed of swinging is calculated by extracting the one having the widest interval among the points P that are continuous in time series.

  Next, a method of determining the direction in which the controller 7 is twisted based on the X and Y-axis direction acceleration data when the controller 7 is shaken will be described with reference to FIGS. FIG. 13 is a perspective view for explaining the twist direction of the controller 7. FIG. 14A to FIG. 14C are examples of graphs showing the acceleration values indicated by the X-axis and Y-axis direction acceleration data according to the twist applied to the controller 7. FIG. 15 is a graph showing an example of the spin parameter S calculated according to the angle θ in FIGS. 14 (a) to 14 (c). 14A to 14C are connected by arrows in the order in which the points P are obtained as in FIG. 9, and no acceleration including gravitational acceleration is added to the acceleration sensor 701. The value of the acceleration data is the origin (X, Y) = (0, 0).

  In FIG. 13, when the player holds the controller 7 and swings left or right, the player can add “left twist” or “right twist” to the controller 7 around the Z axis. Here, “left twist” indicates that the controller 7 is rotated counterclockwise about the Z axis as viewed from the player. “Right twist” indicates that the controller 7 is rotated clockwise around the Z axis as viewed from the player. The results of these twist determinations are reflected in spins (top spin and back spin) applied to the ball character BC.

  Here, in order to determine the twisted angle when the controller 7 is being shaken, it is necessary to analyze the X and Y-axis direction acceleration data from the start to the end of the swing. In the present embodiment, the point Ps indicating the X and Y axis direction acceleration data obtained at the beginning of the swing (that is, the starting point plotted first in the XY coordinate system) and the X and Y axis direction acceleration data obtained at the end of the swing are obtained. The controller 7 determines the twisted angle using the indicated point Pe (that is, the end point plotted last in the XY coordinate system).

  For example, FIG. 14A shows X and X obtained from the start to the end of swinging when the controller 7 is kept in a state where the upper surface is directed upward (that is, “no twist”) and is swung horizontally. An example of Y-axis direction acceleration data is shown. Then, an angle θ formed between the straight line connecting the start point Ps and the origin and the straight line connecting the end point Pe and the origin (hereinafter referred to as an angle θ from the start point Ps to the end point Pe) is calculated, and the angle θ is calculated. A corresponding spin parameter S is set. In this case, since the direction of gravity acting on the controller 7 is constant, a moderate angle θ is obtained. Here, the angle θ can be obtained by calculating the absolute value of the angle formed by the vector from the origin to the start point Ps and the vector from the origin to the end point Pe in the XY coordinate system.

  FIG. 14B shows X and Y-axis direction acceleration data obtained from the start to the end of swinging when the controller 7 is turned leftward with a “left twist” from the state in which the upper surface is directed upward. An example is shown. In this case, since the direction of gravity acting on the controller 7 changes clockwise according to the twist, the angle θ from the start point Ps obtained by the “left twist” to the end point Pe than the angle θ obtained by “no twist”. Becomes larger.

  FIG. 14C shows X and Y-axis acceleration data obtained from the start to the end of swinging when the controller 7 is turned leftward with a “right twist” from the state in which the upper surface is directed upward. An example is shown. In this case, since the direction of gravity acting on the controller 7 changes counterclockwise according to the twist, the angle θ from the start point Ps obtained by the “right twist” to the end point Pe than the angle θ obtained by “no twist”. Becomes smaller.

  In this way, by paying attention to the angle θ from the start point Ps to the end point Pe, the twist direction and twist angle applied to the controller 7 while shaking can be determined. For example, when the controller 7 is “left-handed”, it can be determined as “left twist” when the angle θ is larger than the threshold, and “right twist” when the angle θ is smaller than the threshold. When the controller 7 is “right-handed”, these tendencies appear in reverse. That is, when the controller 7 is “right-handed”, it can be determined that “right twist” is when the angle θ is larger than the threshold, and “left twist” when the angle θ is smaller than the threshold. That is, using the start point Ps and the end point Pe indicated by the X-axis direction acceleration data and the Y-axis direction acceleration data as coordinate points in the XY coordinate system, the Z axis orthogonal to the X axis and the Y axis is defined as the rotation axis. The rotation operation of the controller 7 can be discriminated.

  In addition, the amount of rotation by which the player twists the controller 7 is determined according to the difference in the angle θ with reference to the angle θ obtained by “no twist” (FIG. 14A). Can do. In this embodiment, using a predetermined conversion table, the angle θ used for the twist recognition is replaced with the spin parameter S according to the magnitude of the angle θ, and the subsequent game processing is performed. The spin parameter S is a floating point number of −1.0 to 1.0 determined according to the magnitude of the angle θ, for example. In the game process, the maximum effect of back spin is given when S = −1.0, and the maximum effect of top spin is given when S = 1.0.

  For example, as shown in FIG. 15, when the angle θ ≦ 30 °, the spin parameter S is converted to −1.0. When 30 ° <angle θ ≦ 70 °, conversion is performed by changing linearly between the spin parameters S = −1.0 to 0.0. When 70 ° <angle θ ≦ 120 °, the spin parameter S is converted to 0.0. When 120 ° <angle θ ≦ 160 °, conversion is performed by changing linearly between spin parameters S = 0.0 to 1.0. When 160 ° <angle θ, the spin parameter S is converted to 1.0. By adjusting these conversion tables, the effect of reflecting the twist on the controller 7 in the game process can be adjusted.

  Next, a method for determining a state in which the controller 7 is being swung up or down is described with reference to FIGS. 16 and 17. 16A to 16C are diagrams for explaining the relationship between the state in which the controller 7 is tilted in the vertical direction and the coordinate axes thereof. FIG. 17 is a graph showing an example of the vertical angle UD calculated according to the Z-axis direction acceleration data.

  In this embodiment, it is determined whether the controller 7 is swung up or down based on the vertical direction of the controller 7 before the start of swinging. For example, when the front surface of the controller 7 is turned downward from the horizontal by a predetermined angle or more before the player starts to swing the controller 7, it is determined that the player swings by swinging up the controller 7. On the other hand, when the player turns the front surface of the controller 7 upward from the horizontal by a predetermined angle or more before starting to swing the controller 7, it is determined that the player swings down by swinging the controller 7.

  Specifically, when it is determined that the controller 7 is being shaken, the vertical direction of the controller 7 before the start of the shake is determined based on the Z-axis direction acceleration data obtained for the previous few frames. . For example, as shown in FIG. 16A, when the controller 7 is horizontal before the player starts to swing the controller 7, the gravitational acceleration acts in the negative Y-axis direction, so that the gravity data in the Z-axis direction acceleration data The effect of acceleration does not appear. On the other hand, as shown in FIG. 16B, when the front surface of the controller 7 is directed upward from the horizontal before the player starts to swing the controller 7, the gravitational acceleration is in the Y-axis negative direction and the Z-axis negative direction. In order to act, the Z-axis direction acceleration data indicates the Z-axis negative direction acceleration due to the influence of the gravitational acceleration. In addition, as shown in FIG. 16C, when the front surface of the controller 7 is directed downward from the horizontal before the player starts to swing the controller 7, the gravitational acceleration is in the Y-axis negative direction and the Z-axis positive direction. In order to act, the Z-axis direction acceleration data indicates the acceleration in the Z-axis positive direction due to the influence of the gravitational acceleration. That is, if the Z-axis direction acceleration data before the player starts to swing the controller 7 is analyzed, the vertical direction before the player starts to swing the controller 7 can be determined.

  In this embodiment, the obtained Z-axis direction acceleration data is stored in the main memory 33, and when it is determined that the controller 7 is shaken, the Z-axis direction obtained for the previous 30 frames is determined. The average value Zave of the acceleration data is converted into the vertical angle UD of the controller 7, and the subsequent game processing is performed.

  For example, as shown in FIG. 17, when the average value Zave ≦ −0.2G, the vertical angle UD is converted to 60 °. When −0.2 G <average value Zave ≦ 1.0 G, conversion is performed by linearly changing the vertical angle UD = 60 ° to −60 °. When 1.0 G <average value Zave, the vertical angle UD is converted to −60 °. Here, the balance of the vertical angle UD converted with respect to the average value Zave is shifted in the positive direction of the Z axis. This is because the acceleration data in the Z axis direction always swings in the positive direction of the Z axis at the beginning of swinging. This is because the influence is taken into consideration. By adjusting these conversion tables, it is possible to adjust the effect of reflecting the Z-axis direction acceleration data obtained before the controller 7 starts swinging in the game process.

  Next, the details of the game process performed in the game system 1 will be described. First, main data used in the game process will be described with reference to FIG. FIG. 18 is a diagram showing main data stored in the main memory 33 of the game apparatus 3.

  As shown in FIG. 18, the main memory 33 includes acceleration data Da, vertical angle data Db, counterclockwise accumulated area data Dc, clockwise accumulated area data Dd, first ball trajectory data De, second ball trajectory data Df, First dummy ball data Dg, second dummy ball data Dh, ball character data Di, start point-end point angle data Dj, spin parameter Dk, maximum plot interval data Dl, count data Dm, image data Dn, and the like are stored. In the main memory 33, in addition to the data included in the information shown in FIG. 18, data (position data, etc.) relating to the player character PC and opponent character EC appearing in the game, data relating to the virtual game space (terrain data, etc.) Etc., data necessary for the game processing is stored.

  The acceleration data Da is acceleration data included in a series of operation information transmitted as transmission data from the controller 7, and the obtained acceleration data is stored for a predetermined frame (for example, 1 frame (1/60 which is a game processing interval). For 30 frames). The acceleration data Da includes X-axis direction acceleration data Da1, Y-axis direction acceleration data Da2, and Z-axis direction acceleration data Da3 detected by the acceleration sensor 701 separately for the X-axis, Y-axis, and Z-axis components. It is. The receiving unit 6 provided in the game apparatus 3 receives acceleration data Da included in the operation information transmitted from the controller 7 at a predetermined interval, for example, every 5 ms, and is stored in a buffer (not shown) provided in the receiving unit 6. Thereafter, it is read out every frame which is the game processing interval and stored in the main memory 33.

  The vertical angle data Db is data indicating the vertical angle UD (see FIGS. 16 and 17) calculated according to the Z-axis direction acceleration data Da3 obtained from the controller 7 before the start of swinging. The counterclockwise accumulated area data Dc is data obtained by accumulating triangular areas (see FIG. 12) formed using acceleration data that moves counterclockwise with respect to the origin in the XY coordinate system. The clockwise accumulated area data Dd is data obtained by accumulating triangular areas (see FIG. 12) formed using acceleration data that changes clockwise with respect to the origin in the XY coordinate system.

  The first ball trajectory data De is data obtained by calculating a trajectory (first ball trajectory TR1) in which the ball character BC moves in the virtual game space based on data at an initial stage in a motion recognition process described later. The second ball trajectory data Df is data obtained by calculating a trajectory (second ball trajectory TR2) in which the ball character BC moves in the virtual game space based on data obtained during the entire period of the motion recognition process. The first dummy ball position data Dg includes first dummy ball speed data Dg1 and first dummy ball position data Dg2, and the speed and position of the first dummy ball to be moved along the track indicated by the first ball track data De. These are velocity vector data and position coordinate data for a virtual game space. The second dummy ball position data Dh includes second dummy ball speed data Dh1 and second dummy ball position data Dh2, and the speed and position of the second dummy ball to be moved along the track indicated by the second ball track data Df. These are velocity vector data and position coordinate data for a virtual game space. Ball character data Di includes ball character speed data Di1 and ball character position data Di2, and is speed vector data and position coordinate data for a virtual game space indicating the current speed and position of ball character BC.

  The start point-end point angle data Dj is data indicating an angle θ (see FIG. 14) from the start point Ps to the end point Pe in the XY coordinate system. The spin parameter Dk is data indicating the spin parameter S (see FIG. 15) obtained by replacing the angle θ. The maximum plot interval data Dl is data in which the interval that is continuous in time series becomes maximum when plotted in the XY coordinate system based on the X and Y axis direction acceleration data obtained during the entire period of the motion recognition process. This is data indicating the interval. The count data Dm is data indicating a count value used in a flowchart described later.

  The image data Dn includes player character image data Dn1, ball image data Dn2, and the like, and is data for generating a game image by arranging the player character PC and the ball character BC in the virtual game world.

  Next, with reference to FIGS. 19 to 26, details of the game process performed in the game apparatus 3 will be described. FIG. 19 is a flowchart showing a flow of game processing executed in the game apparatus 3. FIG. 20 is a subroutine showing the detailed operation of the initial motion recognition process in step 51 in FIG. FIG. 21 is a subroutine showing the detailed operation of the animation start process in step 52 in FIG. FIG. 22 is a subroutine showing the detailed operation of the first behavior process in step 53 in FIG. FIG. 23 is a subroutine showing the detailed operation of the second behavior processing at step 54 in FIG. FIG. 24 is a diagram illustrating timings at which motion recognition processing, animation processing, and ball behavior processing are performed. FIG. 25 is a diagram illustrating an example of the ball behavior determined according to the spin parameter S. FIG. 26 is a diagram illustrating an example of the first ball trajectory TR1 and the second ball trajectory TR2. In the flowcharts shown in FIGS. 19 to 23, game processing performed based on a game operation by the player shaking the controller 7 will be described, and other game processing not directly related to the present invention will be described. Will not be described in detail. In FIGS. 19 to 23, each step executed by the CPU 30 is abbreviated as “S”.

  When the power of the game apparatus 3 is turned on, the CPU 30 of the game apparatus 3 executes a startup program stored in a boot ROM (not shown), thereby initializing each unit such as the main memory 33. Then, the game program stored in the optical disc 4 is read into the main memory 33, and the CPU 30 starts executing the game program. The flowchart shown in FIGS. 12 to 15 is a flowchart showing the game process performed after the above process is completed.

  In FIG. 19, the CPU 30 performs an initial motion recognition process (step 51), an animation start process (step 52), a first behavior process (step 53), and a second behavior process (step 54) in this order. Details of these operations will be described later. Then, the CPU 30 determines whether or not to end the game (step 55). As the conditions for ending the game, for example, a condition that the game is over (for example, a tennis game played by the player character is ended), or that the player performs an operation to end the game, etc. is there. CPU30 returns to the said step 51, and repeats a process, when not complete | finishing a game, and complete | finishes the process by the said flowchart, when a game is complete | finished.

  With reference to FIG. 20, the operation | movement of the initial motion recognition process in the said step 51 is demonstrated. First, the CPU 30 acquires acceleration data included in the operation information received from the controller 7 (step 61), and advances the processing to the next step. Then, the CPU 30 stores the acquired acceleration data in the main memory 33 as the acceleration data Da. Here, the acceleration data acquired in step 61 includes X-, Y-, and Z-axis direction acceleration data detected by the acceleration sensor 701 separately for the three-axis components of the X, Y, and Z axes. . Here, the communication unit 75 transmits operation information to the game apparatus 3 at a predetermined time interval (for example, at an interval of 5 ms), and at least acceleration data is stored in a buffer (not shown) provided in the receiving unit 6. Then, the CPU 30 acquires acceleration data stored in the buffer for each frame, which is a game processing unit, and stores it in the main memory 33.

  Next, the CPU 30 determines whether or not the controller 7 has been swung by the player using the acquired acceleration data (step 62). Specifically, the CPU 30 determines that the player has swung the controller 7 when the Z-axis direction acceleration data acquired in step 61 indicates a value in the positive Z-axis direction that exceeds the threshold value. Then, when the controller 7 is shaken, the CPU 30 advances the process to the next step 63. On the other hand, if the controller 7 is not shaken, the CPU 30 returns to step 61 and repeats the process.

  In step 63, the CPU 30 determines the vertical direction of the controller 7 before the start of swinging, and advances the processing to the next step. Specifically, the CPU 30 calculates an average value Zave of the Z-axis direction acceleration data Da3 for the past several frames (for example, 30 frames) stored in the main memory 33. Then, the CPU 30 converts the average value Zave into the vertical angle UD (see FIG. 17) and stores data indicating the vertical angle UD as the vertical angle data Db.

  Next, the CPU 30 acquires acceleration data included in the operation information received from the controller 7 by the same process as in step 61 (step 64), and whether the Z-axis direction data of the acquired acceleration data is equal to or less than a threshold value. Based on the above, it is determined whether or not the player has finished moving the controller 7 (step 65). Then, when the operation of shaking the controller 7 is continued, the CPU 30 advances the process to the next step 66. On the other hand, when the operation of shaking the controller 7 is finished, the CPU 30 returns to step 51 and repeats the process.

  In step 66, the CPU 30 accumulates the triangular area formed with the origin in the XY coordinate system based on the acceleration data obtained in step 64, and advances the processing to the next step. Specifically, as described with reference to FIG. 12, when the acceleration data obtained in step 64 is counterclockwise with respect to the origin of the XY coordinate system, the CPU 30 is appropriately formed. The area of the triangle is accumulated and stored in the counterclockwise accumulated area data Dc. On the other hand, when the acceleration data obtained in step 64 is moving clockwise with respect to the origin of the XY coordinate system, the CPU 30 accumulates an appropriately formed area of the triangle in the clockwise accumulated area data Dd. Store.

  Next, the CPU 30 determines an interval (data interval) plotted in the XY coordinate system based on the acceleration data obtained in step 64 (step 67), and advances the processing to the next step. Specifically, when the obtained data interval is wider than the data interval currently stored in the maximum plot interval data Dl, the CPU 30 updates the maximum plot interval data Dl to the obtained data interval. On the other hand, if the obtained data interval is the same or narrower than the data interval currently stored in the maximum plot interval data Dl, the CPU 30 proceeds to the next step as it is.

  Next, the CPU 30 determines whether one of the cumulative area indicated by the counterclockwise cumulative area data Dc and the cumulative area indicated by the clockwise cumulative area data Dd exceeds a threshold value (step 68). If any one of the accumulated areas exceeds the threshold value, the CPU 30 ends the process by the subroutine and proceeds to step 52 described above. On the other hand, when the accumulated area does not exceed the threshold value, the CPU 30 returns to step 64 and repeats the process.

  With reference to FIG. 21, the operation of the animation start process in step 52 will be described. After the process of step 68, the CPU 30 determines the direction swung with respect to the controller 7 (step 71), and advances the process to the next step. For example, if it is determined in step 68 that the cumulative area indicated by the counterclockwise cumulative area data Dc exceeds the threshold, the acceleration data is shifted counterclockwise around the origin of the XY coordinate system described above. It is determined that the player is “right swinging” the controller 7 (see FIG. 7). On the other hand, if it is determined in step 68 that the accumulated area indicated by the clockwise accumulated area data Dd has exceeded the threshold, the acceleration data has shifted clockwise around the origin of the XY coordinate system described above. It is determined that the player is “left-handed” the controller 7 (see FIG. 7).

  As is clear from the processing in these steps 68 and 71, the step 71 is performed when either one of the cumulative area indicated by the counterclockwise cumulative area data Dc and the cumulative area indicated by the clockwise counterclockwise area data Dd exceeds the threshold value. This process is not executed when the player finishes swinging the controller 7. As shown in FIG. 24, processing (motion recognition processing) for recognizing an operation from when the player starts to swing the controller 7 until it finishes swinging is performed from time T1 to time T4. On the other hand, the process (animation process) for expressing the animation in which the player character PC swings the tennis racket is performed after time T2, and is started in the middle of the motion recognition process. That is, the swing direction with respect to the controller 7 is determined in the middle of the swing from the start of swinging of the controller 7 to the end of swinging, and is reflected in the game image. Here, the initial motion recognition process in step 51 is a process performed at times T1 to T2 in the motion recognition process.

  The relationship between the cumulative area exceeding the threshold and the direction in which the controller 7 is swung varies depending on the setting of the coordinate axis in the controller 7, the characteristics of the acceleration sensor, the setting of the XY coordinate system, and the like. What is necessary is just to adjust a relationship suitably according to each setting. Specifically, the direction in which the controller 7 is swung can be accurately determined by analyzing the relationship between the cumulative area exceeding the threshold and the swing direction with reference to the direction of gravitational acceleration based on the obtained acceleration data. Can be determined.

  Next, the CPU 30 determines whether or not the player character PC strikes back the ball character BC (step 72), and determines whether or not the player character PC is swung (step 73). Here, in the steps executed so far, the player character PC has not started the action of swinging the racket. However, the CPU 30 arrives from data such as the current position of the player character PC and the subsequent predicted position, the current position of the ball character BC and the subsequent predicted trajectory, and the direction in which the player character PC swings the tennis racket. It is possible to predict and determine the hit of hitting the ball character BC by this swing. Then, when it is predicted that the player character PC is swung, the CPU 30 starts a process of displaying an animation swung by the player character PC on the monitor 2 (step 76), and proceeds to step 55 to perform the process. On the other hand, if it is predicted that the player character PC will strike back the ball character BC, the CPU 30 advances the process to the next step 74.

  In step 74, the CPU 30 calculates a time t from the present time until the player character PC strikes back the ball character BC, starts counting, and updates the count data Dn. And CPU30 starts the process which displays the animation which the player character PC strikes back the ball character BC on the monitor 2 (step 75), and advances a process to the next step. Note that the animation to be returned is expressed by a swing according to the up and down angle UD. That is, an animation in which the player character PC swings up or down the tennis racket in the vertical direction indicated by the vertical angle UD is expressed.

  Next, the CPU 30 acquires acceleration data included in the operation information received from the controller 7 (step 77), and determines whether or not the player has finished moving the controller 7 based on the acquired acceleration data. (Step 78). Then, when the operation of shaking the controller 7 is continued, the CPU 30 advances the process to the next step 79. On the other hand, if the operation of shaking the controller 7 has been completed, the CPU 30 advances the process to the next step 101. The acceleration data acquisition process in step 77 is the same as that in step 61 described above, and a detailed description thereof will be omitted. Further, the swing determination method in step 78 is the same as step 62 described above except that the acceleration data acquired in step 77 is used, and thus detailed description thereof is omitted.

  In step 79, the CPU 30 determines an interval (data interval) plotted in the XY coordinate system based on the acceleration data obtained in step 77. Note that the data interval determination process in step 79 is the same as step 67 described above except that the acceleration data acquired in step 77 is used, and a detailed description thereof will be omitted. Next, the CPU 30 determines whether or not the count value of the current count data Dn has reached the time t (step 80). If the current count value has not reached time t, the CPU 30 updates the count value of the count data Dn (step 81), returns to step 77, and repeats the processing. On the other hand, when the current count value reaches time t, the CPU 30 ends the process by the subroutine and advances the process to step 53.

  With reference to FIG. 22, the operation of the first behavior process in step 53 will be described. After the process of step 80, the CPU 30 calculates the initial speed, direction, and position at which the ball character BC is returned, displays the ball character BC at the position (step 91), and advances the process to the next step. Specifically, the CPU 30 indicates the speed and direction of the ball character BC by a speed vector (vx, vy, vz), and stores data indicating the speed vector in the ball character speed data Di1. Here, the magnitude of the velocity vector (vx, vy, vz) is set as a fixed value. The direction of the velocity vector (vx, vy, vz) is based on the direction in which the player swings the controller 7, the relationship between the timing at which the player starts to swing the controller 7 and the timing at which the ball character BC arrives, the vertical angle UD, and the like. Is set. Specifically, the left-right direction in which the ball character BC is hit back includes the left-right direction in which the player character PC swings the tennis racket (that is, the swing direction of the controller 7) and the timing at which the ball character BC is hit (that is, the start of the swing of the controller 7). The timing is determined. Further, the vertical direction in which the ball character BC is hit back is determined by the vertical direction in which the player character PC swings the tennis racket (that is, the vertical angle UD). For example, when the vertical angle UD is a positive angle, it is a downward swing, so the velocity vector of the ball character BC is set in a low direction corresponding to the numerical value of the vertical angle UD. Further, when the vertical angle UD is a negative angle, it is a swing-up, so that the velocity vector of the ball character BC is set in a higher direction according to the numerical value of the vertical angle UD. Further, the CPU 30 indicates the position at which the ball character BC was hit with the tennis racket of the player character PC by the position coordinates (x, y, z) in the virtual game space, and the data indicating the position coordinates is displayed in the ball character position data Di2. Store.

  Next, the CPU 30 acquires acceleration data included in the operation information received from the controller 7 (step 92). Then, the CPU 30 determines an interval (data interval) plotted in the XY coordinate system based on the acceleration data obtained in step 92 (step 93), and advances the processing to the next step. The acceleration data acquisition process in step 92 is the same as that in step 61 described above, and a detailed description thereof will be omitted. The data interval determination process in step 93 is the same as that in step 67 except that the acceleration data acquired in step 92 is used, and a detailed description thereof will be omitted.

  Next, the CPU 30 determines the first ball trajectory TR1 based on the velocity vector (vx, vy, vz) and the position coordinates (x, y, z) stored in the current ball character velocity data Di1 and ball character position data Di2. And the ball character BC is moved along the first ball trajectory TR1 and displayed on the monitor 2 (step 94). The CPU 30 artificially or strictly defines a real world physics law (for example, gravity, air resistance, wind influence) in the virtual game space, and the velocity vector (vx, vy, vz) and position coordinates (x , Y, z), the spin parameter S (here, S = 0.0) and the physical law, the first ball trajectory TR1 is calculated and stored in the first ball trajectory data De. Then, the velocity vector (vx, vy, vz) and position coordinates (x, y, z) of the ball character BC are newly calculated so as to move along the first ball trajectory TR1. Then, the CPU 30 stores the new velocity vector (vx, vy, vz) and the position coordinates (x, y, z) in the ball character speed data Di1 and the ball character position data Di2, and stores the position coordinates (x, y, In z), the ball character BC is displayed on the monitor 2. Then, the CPU 30 advances the process to the next step.

  Next, the CPU 30 determines whether or not the player has finished moving the controller 7 based on the acceleration data acquired in step 92 (step 95). If the operation of shaking the controller 7 is continued, the CPU 30 returns to step 92 and repeats the process. On the other hand, when the operation of shaking the controller 7 has been completed, the CPU 30 advances the process to the next step 54. Note that the swing determination method in step 95 is the same as step 62 described above except that the acceleration data acquired in step 92 is used, and thus detailed description thereof is omitted.

  As is apparent from the processing in steps 91 to 95, the first behavior processing is processing from when the ball character BC is hit until the player finishes swinging the controller 7. As shown in FIG. 24, the process of expressing the behavior of the ball character BC being hit back (ball behavior process) is performed after time T3 and is started in the middle of the motion recognition process. That is, based on the operation information (acceleration data) determined in the middle of the swing from the start of the controller 7 to the end of the swing, the state in which the ball character BC is returned is reflected in the game image. Here, the animation start process in step 52 is a process performed at times T2 to T3 in the animation process. Further, the first behavior processing in step 53 is processing performed at times T3 to T4 in the ball behavior processing. Further, the second behavior process described later is a process that expresses a behavior in which the ball character BC is returned after the player finishes swinging the controller 7, and is a process performed after time T4 in the ball behavior process.

  With reference to FIG. 23, the operation | movement of the 2nd behavior process in the said step 54 is demonstrated. After the process of step 95, the CPU 30 calculates an angle θ (see FIG. 14) from the start point Ps to the end point Pe, and stores it in the start point-end point angle data Dj (step 101). Next, the CPU 30 converts the angle θ into the spin parameter S (see FIG. 15) and stores it in the spin parameter Dk (step 102). Then, the CPU 30 calculates the velocity vector (v2x, v2y, v2z) of the second dummy ball based on the data interval stored in the maximum plot interval data Dl, and stores it in the second dummy ball velocity data Dh1 ( Step 103), The process proceeds to the next step.

  Here, the velocity vector (v2x, v2y, v2z) of the second dummy ball goes back to the time when the player character PC hits the ball character BC with a tennis racket (time T3 shown in FIG. 24), and the data interval (that is, The velocity vector of the ball character BC is recalculated with the influence of the velocity of the controller 7 being shaken). Therefore, the magnitude of the velocity vector (v2x, v2y, v2z) is set according to the data interval. Specifically, when the data interval is relatively wide, the speed vector size is set to be relatively large, and when the data interval is relatively narrow, the speed vector size is set to be relatively small. . The direction of the velocity vector (v2x, v2y, v2z) is set in the same manner as in step 91 above.

  Next, the CPU 30 performs a process of adjusting an animation in which the player character PC started in step 75 returns the ball character BC and displays it on the monitor 2 (step 104), and the process proceeds to the next step. This is because, in step 75 (time T2 shown in FIG. 24), only the left and right and up and down directions and the timing of shaking of the player 7 are known, so an animation based only on those information is started. ing. However, in step 104 (time T4 shown in FIG. 24), the twist angle that the player has applied to the controller 7 and the speed at which the player 7 has swung the controller 7 are further known, so that an animation based on more information can be reproduced. That is, from the step 104, the animation started from the step 75 is adjusted to an animation reflecting the top spin and the back spin determined from the twist angle and the swing speed determined from the data interval. Display on the monitor 2.

  Next, the CPU 30 refers to the ball character position data Di2 and determines whether or not the ball character BC has reached a predetermined space in the virtual game space (step 105). Here, the predetermined space is, for example, a space on the opponent's court set in the virtual game space or a space outside (out) the tennis court. If the ball character BC has not reached the predetermined space, the CPU 30 advances the process to the next step 106. On the other hand, when the ball character BC has reached the predetermined space, the CPU 30 advances the process to the next step 109.

  In step 106, the CPU 30 calculates the first ball trajectory TR1 and the second ball trajectory TR2, and performs a process of interpolating the trajectory of the ball character BC from the first ball trajectory TR1 to the second ball trajectory TR2. Then, the CPU 30 moves the ball character BC along the interpolated trajectory to update the ball character speed data Di1 and the ball character position data Di2, and displays the ball character BC on the monitor 2 (step 107). The process proceeds to the next step 108.

  The second ball trajectory TR2 and the interpolation process will be described with reference to FIGS. The first ball trajectory TR1 calculated in the above step 94 is a trajectory of the ball character BC calculated only by information recognized in the initial motion recognition process (left and right and up and down swing direction of the controller 7, and swing timing). On the other hand, the second ball trajectory TR2 is a trajectory of the ball character BC calculated by adding information that can be recognized in the entire motion recognition process (twist angle and swing speed to the controller 7).

  Similarly to the first ball trajectory TR1, the second ball trajectory TR2 defines real world physics in the virtual game space, and includes a velocity vector (v2x, v2y, v2z), position coordinates (x2, y2, z2), spin It is calculated based on the parameter S and the physical law and is stored in the second ball trajectory data Df. The CPU 30 uses the position coordinates (x2, y2, z2) and the velocity vector (v2x, v2y, v2z) obtained in step 103 to determine the position at which the ball character BC was hit with the tennis racket of the player character PC. The second ball trajectory TR2 is calculated by adding the influence of the spin parameter S to the trajectory calculated in the same manner as the one-ball trajectory TR1.

  As shown in FIG. 25, when the player “turns left” while adding “left twist” to the controller 7, or “turns right” while adding “right twist” to the controller 7, the spin parameter S> 0. 0 and “top spin” is expressed. On the other hand, if the player “turns left” while adding a “right twist” to the controller 7, or “turns right” while adding a “left twist” to the controller 7, the spin parameter S <0.0. "Backspin" is expressed. When the spin parameter S indicates the top spin (S> 0.0), the CPU 30 changes the trajectory so that it rapidly drops in the vertical direction. Further, when the spin parameter S indicates back spin (S <0.0), the CPU 30 bends in the horizontal direction according to the swing direction so that the flight distance increases in the vertical direction ("left swing" Change the trajectory so that it turns to the right and turns to the left when turning to the right. When the spin parameter S indicates no spin (S = 0.0), the CPU 30 does not add a change due to the spin parameter S to the orbit.

  As shown in FIGS. 24 and 26, since the second ball trajectory TR2 is calculated at time T4 when the controller 7 finishes swinging, the ball character BC displayed on the monitor 2 is already along the first ball trajectory TR1. (Bold line between times T3 and T4 in FIG. 26). On the other hand, since the trajectory reflecting all the data obtained by the player swinging the controller 7 is the second ball trajectory TR2, the trajectory of the ball character BC is changed from the first ball trajectory TR1 to the second ball trajectory TR2. It is desirable to move it. Therefore, in order to move the ball character BC along the second ball trajectory TR2 without causing the player to feel uncomfortable, it is necessary to smoothly connect the first ball trajectory TR1 to the second ball trajectory TR2 (FIG. 26). (Bold line between times T4 and T5). In this embodiment, in the process of connecting from the first ball trajectory TR1 to the second ball trajectory TR2 (time T4 to T5 shown in FIG. 16), dummy balls that are not displayed along the respective trajectories are skipped, and the positions of the dummy balls The position for interpolating between the positions is the position of the ball character BC.

  The CPU 30 sets the dummy ball flying along the first ball trajectory TR1 as the first dummy ball B1, and sets the first dummy ball speed (v1x, v1y, v1z) and the first dummy ball position (x1, y1, z1) to the first. The ball parameter of the dummy ball. Further, the CPU 30 sets the dummy ball flying along the second ball trajectory TR2 as the second dummy ball B2, and sets the second dummy ball speed (v2x, v2y, v2z) and the second dummy ball position (x2, y2, z2). The ball parameter of the second dummy ball is used. Then, the interpolation time Ti is set as the time required for interpolation (time T5-T4 shown in FIG. 26).

  First, at time T4, the CPU 30 sets the ball character speed (vx, vy, vz) and the ball character position (x, y, z) stored in the ball character data Di to the first dummy ball speed (v1x, v1y), respectively. , V1z) and the first dummy ball position (x1, y1, z1) are stored in the first dummy ball data Dg. On the other hand, based on the second dummy ball data Dh, the second dummy ball B2 is moved along the second ball trajectory TR2 to a position corresponding to time T4 to update the second dummy ball data Dh.

At time Tn between times T4 and T5, the CPU 30 updates the ball parameters of the first dummy ball B1 and the second dummy ball B2 by physical calculation, and follows the first ball trajectory TR1 and the second ball trajectory TR2, respectively. To move every frame. Then, the CPU 30 calculates the position and speed at which these dummy balls are interpolated using the following formula, and updates the ball character speed data Di1 and the ball character position data Di2 (between times T4 to T5 in FIG. 26). Thick line).
ratio = (Tn−T4) ÷ Ti
x = x2 * ratio + x1 * (1.0-ratio)
y = y2 * ratio + y1 * (1.0-ratio)
z = z2 * ratio + z1 * (1.0-ratio)
vx = v2x * ratio + v1x * (1.0-ratio)
vy = v2y * ratio + v1y * (1.0-ratio)
vz = v2z × ratio + v1z × (1.0−ratio) In this way, the ball character speed data Di1 and the ball character position data Di2 between the times T4 and T5 are the first dummy ball B1 and the first The speed and position of each of the two dummy balls B2 are weighted at a predetermined ratio and averaged.

  After time T5, the CPU 30 discards the first dummy ball B1 and the second dummy ball B2. Then, the CPU 30 sets the second ball trajectory TR2 based on the velocity vector (vx, vy, vz) and the position coordinates (x, y, z) stored in the current ball character velocity data Di1 and ball character position data Di2. The ball character BC is moved along the second ball trajectory TR2 to update the ball character speed data Di1 and the ball character position data Di2, and the ball character BC is displayed on the monitor 2 (after time T5 in FIG. 26). Thick line).

  Returning to FIG. 23, in step 108, the CPU 30 determines whether or not the ball character BC is hit back to the opponent character EC or the ball character BC is out (goes directly out of the court). If the ball character BC has not been returned to the opponent character EC and is not out, the CPU 30 returns to step 106 and repeats the process. On the other hand, the CPU 30 returns the ball character BC to the opponent character EC. Alternatively, if it is out, the process by the subroutine is terminated, and the process proceeds to step 55.

  On the other hand, when the ball character BC has reached the predetermined space in step 105, the CPU 30 moves the ball character BC along the first ball trajectory TR1 and displays it on the monitor 2 (step 109). The process proceeds to the next step. The CPU 30 calculates the first ball trajectory TR1 based on the velocity vector (vx, vy, vz) and the position coordinates (x, y, z) stored in the current ball character velocity data Di1 and ball character position data Di2. The ball character BC is moved along the first ball trajectory TR1 and displayed on the monitor 2. Since this step 109 is the same process as the above-mentioned step 94, further explanation is omitted.

  Next, the CPU 30 determines whether or not the ball character BC is hit back to the opponent character EC or the ball character BC is out (goes directly out of the court) (step 110). If the ball character BC has not been returned to the opponent character EC and is not out, the CPU 30 returns to step 109 and repeats the process. On the other hand, the CPU 30 returns the ball character BC to the opponent character EC. Alternatively, if it is out, the process by the subroutine is terminated, and the process proceeds to step 55.

  As described above, in the game device 3 according to the above embodiment, if the player holds the controller 7 with one hand so that the front surface of the controller 7 faces the forward direction of the player, the direction in which the controller 7 is swung. Movements such as (the movement direction of the controller 7) and the twist direction (the rotation direction with the Z axis of the controller 7 as the rotation axis) can be accurately determined. Further, the player may hold and shake the upper surface of the controller 7 in any direction. Therefore, the degree of freedom with respect to the direction in which the player holds the controller 7 (the posture of the controller 7) is very high. Further, it is possible to determine the rotational motion applied to the main body of the controller 7, and it is also possible to determine a combination of a plurality of movements such that the player swings while rotating the controller 7. And since the rotation operation | movement added to such a controller 7 can be used as an operation input, the kind of operation of the controller 7 which can be input becomes abundant.

  In the above-described processing procedure, it has been described that the calculation of the first ball trajectory TR1 and the second ball trajectory TR2 is performed for each frame (that is, performed in the processing loop at step 94, step 106, and step 109). However, the trajectory may be calculated using other procedures. For example, the first ball trajectory TR1 and the second ball trajectory TR2 calculated once may be stored in a memory, and the trajectory data stored as appropriate may be used. In this case, if the first ball trajectory TR1 and / or the second ball trajectory TR2 is calculated before the processing loop (for example, after step 91 and after step 103), it is necessary to calculate the trajectory for each frame. Disappear.

  In the above description, the example in which the tennis game is performed using the triaxial acceleration data output from the controller 7 has been described. However, the game can be used for other game processes. For example, it goes without saying that the present invention can be applied to a game in which the player character shakes some object (table tennis, badminton, baseball, sword cutting, etc.). In the above description, the example in which the motion discriminating device that discriminates the motion of the controller 7 is applied to the game system 1 has been described. However, information processing such as a general personal computer operated by an input device having an acceleration sensor is described. It can also be applied to devices. For example, according to the determined movement of the input device, data displayed by the information processing device moves, a page on which the information processing device displays information is changed, a figure is drawn, etc. Various processes can be performed based on the discrimination result by the motion discrimination device. Furthermore, the motion determination device may create motion data indicating the motion of the input device according to the determined motion of the input device and output the motion data to another device.

  Further, although the acceleration sensor 701 provided in the controller 7 has been described using the triaxial acceleration sensor that detects and outputs each of the triaxial components orthogonal to each other, the acceleration that detects at least the orthogonal biaxial components is described. The present invention can be realized by using a sensor. For example, even if an acceleration sensor that detects and outputs acceleration in a three-dimensional space in which the controller 7 is arranged is divided into two axis components of the X and Y axes (see FIGS. 3 and 4), the above-described left and right swings are used. Direction determination and twist direction determination can be performed. In this case, it is impossible to determine the swing start and swing end determined using the acceleration of the Z-axis component in the above description, but the centrifugal force component generated by the horizontal swing obtained from the acceleration component with respect to the X and Y axes is used. The start and end of swing may be determined, or the start and end of swing may be determined using another sensor different from the acceleration sensor 701. In addition, a game rule is set such that when the player swings the controller 7, any one of the operation buttons 72 is pressed, and the swing start and the swing end are performed according to a period during which any one of the operation buttons 72 is pressed. May be judged.

  In the above description, the controller 7 and the game apparatus 3 are connected by wireless communication. However, the controller 7 and the game apparatus 3 may be electrically connected via a cable. In this case, the cable connected to the controller 7 is connected to the connection terminal of the game apparatus 3.

  Further, the reception unit 6 connected to the connection terminal of the game apparatus 3 has been described as the reception means for receiving transmission data wirelessly transmitted from the controller 7, but the reception module provided inside the main body of the game apparatus 3 The receiving means may be configured as follows. In this case, the transmission data received by the receiving module is output to the CPU 30 via a predetermined bus.

  In addition, the shape of the controller 7 described above and the shape, number, and installation position of the operation unit 72 provided in them are merely examples, and even if the shape, number, and installation position are other, It goes without saying that the invention can be realized. Further, the position of the imaging information calculation unit 74 in the controller 7 (the light incident port of the imaging information calculation unit 74) does not have to be the front surface of the housing 71. It does not matter if it is provided.

  The motion discriminating apparatus and the motion discriminating program according to the present invention can discriminate the motion of the input device while realizing an operation with a high degree of freedom with respect to the posture of the input device, and are operated according to the motion of the game controller. It is useful as a device or a program for discriminating the movement of an input device such as a device or a game program.

1 is an external view for explaining a game system 1 according to an embodiment of the present invention. Functional block diagram of the game apparatus 3 of FIG. The perspective view seen from the upper surface rear of the controller 7 of FIG. The perspective view which looked at the controller 7 of FIG. 3 from the lower surface back. The perspective view which shows the state which removed the upper housing | casing of the controller 7 of FIG. The block diagram which shows the structure of the controller 7 of FIG. An illustrative view outlining the state when operating the game using the controller 7 of FIG. The figure which shows an example of the tennis game image represented on the monitor 2 according to the X, Y, and Z-axis direction acceleration data received from the controller 7 of FIG. An example of a graph in which the positive and negative accelerations and magnitudes indicated by the X and Y axis direction acceleration data are X and Y axes, respectively. In the graph shown in FIG. The figure which shows the area A45 of the triangle enclosed by the straight line which each connects the points P4 and P5 which adjoin in time series shown in FIG. 10, and an origin. The figure which shows area A13 which accumulated the triangle formed by the points P1-P3 and the origin which were time-sequentially shown in FIG. 10, and the area A36 which accumulated the triangle formed by the points P3-P6 and the origin The perspective view for demonstrating the twist direction of the controller 7 of FIG. An example of a graph showing acceleration values indicated by the X-axis and Y-axis direction acceleration data in accordance with a twist applied to the controller 7 14 is a graph showing an example of the spin parameter S calculated according to the angle θ in FIGS. The figure for demonstrating the state tilted to the up-down direction of the controller 7, and those coordinate axes The graph which shows an example of the up-and-down angle UD calculated according to Z-axis direction acceleration data The figure which shows the main data memorize | stored in the main memory 33 of the game device 3 The flowchart which shows the flow of the game process performed in the game device 3 Subroutine showing the detailed operation of the initial motion recognition process in step 51 in FIG. Subroutine showing the detailed operation of the animation start process in step 52 in FIG. Subroutine showing the detailed operation of the first behavior processing at step 53 in FIG. Subroutine showing the detailed operation of the second behavior processing at step 54 in FIG. The figure which shows the timing when each of motion recognition processing, animation processing, and ball behavior processing is performed The figure which shows an example of the ball | bowl behavior determined according to the spin parameter S The figure which shows an example of 1st ball track TR1 and 2nd ball track TR2

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Game system 2 ... Monitor 2a ... Speaker 3 ... Game device 30 ... CPU
31 ... Memory controller 32 ... GPU
33 ... Main memory 34 ... DSP
35 ... ARAM
36 ... Controller I / F
37 ... Video I / F
38 ... External memory I / F
39 ... Audio I / F
40 ... disk drive 41 ... disk I / F
DESCRIPTION OF SYMBOLS 4 ... Optical disk 5 ... External memory card 6 ... Reception unit 7 ... Controller 71 ... Housing 72 ... Operation part 73 ... Connector 74 ... Imaging information calculating part 741 ... Infrared filter 742 ... Lens 743 ... Imaging element 744 ... Image processing circuit 75 ... Communication Part 751 ... Microcomputer 752 ... Memory 753 ... Wireless module 754 ... Antenna 700 ... Substrate 701 ... Acceleration sensor 702 ... LED
703 ... Crystal oscillator 704 ... Vibrator 705 ... Battery 8 ... Marker

Claims (7)

A game apparatus for performing a game process based on the swing operation on the operation device provided with acceleration sensors of at least two axes,
Acceleration data acquisition means for acquiring acceleration data output from the acceleration sensor;
In a two-dimensional coordinate system in which coordinate axes are defined based on two-axis direction components of the acceleration data and acceleration data including gravitational acceleration does not act on the acceleration sensor, the origin is A rotating direction determining means for determining a rotating direction in which the acceleration data changes in time series as an axis ;
Swing discriminating means for discriminating whether the fore swing or the back swing based on the circulation direction;
A game apparatus comprising: game processing means for performing game processing based on the swing . In the two-dimensional coordinate system, the rotation direction determination unit increases the degree of contribution to the determination of the rotation direction with respect to acceleration data having a relatively large distance from the origin, and uses the origin as an axis. The game device according to claim 1, wherein the circulation direction is determined using an operation that increases a degree of contribution to the determination of the rotation direction with respect to acceleration data that changes in a time series in the rotation direction. In the two-dimensional coordinate system, the rounding direction determination unit is configured to calculate an area of a triangle whose apexes are the coordinate point and the origin indicated by two acceleration data that are continuous in time series and transition in one rounding direction. A first cumulative area that is sequentially accumulated along the time series is calculated, and a triangle having apexes at the coordinate point and the origin that are respectively indicated by two acceleration data that are continuous in time series and that move in the opposite direction of rotation. The second cumulative area is sequentially accumulated along the time series, and when one of the first cumulative area and the second cumulative area exceeds a threshold, the acceleration data obtains the cumulative area. The game device according to claim 2, wherein the game device determines that the movement is made in a time series in the circumferential direction. The acceleration sensor detects accelerations in three axial directions orthogonal to the input device;
The transitional circulation direction determination means is configured to obtain time-series acceleration data in the other second and third axes acquired during a period in which the acceleration in the first axis included in the three axes exceeds a predetermined value. The game device according to claim 1, wherein the turning direction that changes automatically is determined. A game program executed by a computer of a game device that performs a game process based on a swing operation on an operation device including at least a biaxial acceleration sensor,
The computer,
Acceleration data acquisition means for acquiring acceleration data output from the acceleration sensor;
In a two-dimensional coordinate system in which coordinate axes are defined based on two-axis direction components of the acceleration data and acceleration data including gravitational acceleration does not act on the acceleration sensor, the origin is A rotating direction determining means for determining a rotating direction in which the acceleration data changes in time series as an axis;
Swing discriminating means for discriminating whether the fore swing or the back swing based on the circulation direction;
A game program that functions as game processing means for performing game processing based on the swing. A game system that performs a game process based on a swing operation on an operation device including at least a biaxial acceleration sensor,
Acceleration data acquisition means for acquiring acceleration data output from the acceleration sensor;
In a two-dimensional coordinate system in which coordinate axes are defined based on two-axis direction components of the acceleration data and acceleration data including gravitational acceleration does not act on the acceleration sensor, the origin is A rotating direction determining means for determining a rotating direction in which the acceleration data changes in time series as an axis;
Swing discriminating means for discriminating whether the fore swing or the back swing based on the circulation direction;
A game system comprising game processing means for performing game processing based on the swing. A game processing method for performing a game process based on a swing operation on an operation device including at least a biaxial acceleration sensor,
An acceleration data acquisition step of acquiring acceleration data output from the acceleration sensor;
In a two-dimensional coordinate system in which coordinate axes are defined based on two-axis direction components of the acceleration data and acceleration data including gravitational acceleration does not act on the acceleration sensor, the origin is A circumferential direction determination step for determining a circumferential direction in which the acceleration data changes in time series as an axis;
A swing determination step for determining whether the fore swing or the back swing based on the circulation direction;
And a game processing step of performing a game process based on the swing.

Images