JP5746644B2 - GAME DEVICE AND PROGRAM - Google Patents

Description

  The present invention relates to a game device, a game device control method, and a program.

  Conventionally, a game in which a player moves a part according to music is known. For example, Patent Document 1 describes a game device that executes a game in which a player aims to move his / her foot on a button of a mat-type controller arranged at his / her foot in accordance with music.

JP 2001-231904 A

  However, in the technique of Patent Document 1, the game play is evaluated only based on whether or not a part is placed at a predetermined position at a given timing. For example, the player quickly moves the part and performs a given pose. It was impossible to judge whether he took a given pose with a slow motion, and could not evaluate the difference between these motions.

  The present invention has been made in view of the above problems, and an object of the present invention is, for example, a game device and a game device capable of evaluating that a player quickly moves a part and takes a given pose. It is providing the control method and program of this.

  In order to solve the above-described problems, a game device according to the present invention is a game device that executes a game in which a player moves a part in accordance with music, and acquires position information regarding the positions of a plurality of parts of the player. Position information acquisition means, movement determination means for determining whether at least one of the plurality of parts has moved at a reference speed or higher based on the position information, and at least one of the plurality of parts is When it is determined that the vehicle has moved at the reference speed or higher, a stop determination is made based on the position information to determine whether or not the portion that has moved at the reference speed or higher has been substantially stopped after moving for a reference period. Means and evaluation means for evaluating the game play of the player based on the determination result of the stop determination means.

  The game apparatus control method according to the present invention is a game apparatus control method for executing a game in which a player moves a part in accordance with music, and acquires position information regarding the positions of a plurality of parts of the player. A position information acquisition step, a movement determination step for determining whether or not at least one of the plurality of parts has moved at a reference speed or more based on the position information, and at least one of the plurality of parts is When it is determined that the vehicle has moved at the reference speed or higher, a stop determination is made based on the position information to determine whether or not the portion that has moved at the reference speed or higher has been substantially stopped after moving for a reference period. And an evaluation step for evaluating the game play of the player based on the determination result in the stop determination step. .

  The program according to the present invention is a program for causing a computer to function as a game device that executes a game in which a player moves a part in accordance with music, and acquires position information regarding the positions of a plurality of parts of the player. Position information acquisition means for performing movement determination means for determining whether or not at least one of the plurality of parts has moved at a reference speed or more based on the position information, and at least one of the plurality of parts is the Stop determination means for determining, based on the position information, whether or not a state in which a portion moved at the reference speed or higher has substantially stopped after moving has been continued for a reference period when it is determined that the movement has been performed at a reference speed or higher. , Causing the computer to function as an evaluation unit that evaluates the game play of the player based on the determination result of the stop determination unit. .

  An information storage medium according to the present invention is a computer-readable information storage medium recording the above program.

  According to the present invention, it is possible to evaluate that a player has moved a part quickly and has taken a given pose.

  In one aspect of the present invention, the game device displays on the display screen a player image obtained by continuously shooting the player with a shooting unit, or a character that moves corresponding to the player based on the position information. When the portion moved at the reference speed or higher is substantially stopped after movement, a contour image having a shape corresponding to the contour of the player image or the contour of the character is displayed on the player image or the character. It further comprises means for displaying at corresponding positions, and contour image control means for gradually changing the size of the contour image in accordance with the duration of the state.

  In the aspect of the invention, the contour image control unit may gradually change the size of the contour image according to the duration of the state when the duration of the state does not reach the reference period. And when the duration of the state reaches the reference period, the contour image is erased from the display screen after changing the size of the contour image at a faster speed than the first means. And second means.

  In one aspect of the present invention, the contour image control means may cause the contour image and the contour of the player image or the contour of the character to substantially match when the duration of the state becomes the reference period. Means for gradually reducing the contour image larger than the player image or the character according to the duration of the state, and when the duration of the state becomes the reference period, At least one of means for gradually increasing the contour image smaller than the player image or the character according to the duration of the state so that the contour of the player image or the contour of the character substantially matches. It is characterized by including.

  In one aspect of the present invention, the game device may be configured such that after the portion that has moved at the reference speed or higher is substantially stopped after the movement, the duration of the state does not reach the reference period. The apparatus further includes means for restricting execution of the display control process of the contour image by the contour image control means and erasing the contour image from the display screen when the state does not continue.

  In one embodiment of the present invention, the game is a game in which the player aims to place a part at a given position at a given timing in accordance with the music, and the game device has a reference timing. Means for acquiring reference data from means for storing reference data in which the reference position is associated with the reference position, at least one position of the plurality of parts at a time corresponding to the reference timing, and the reference position. Comparing means for comparing, wherein the movement determination means determines whether at least one of the plurality of parts has moved at a reference speed or higher between one reference timing and the next reference timing. The stop determination unit determines whether the stop speed is greater than or equal to the reference speed between the one reference timing and the next reference timing. It is determined whether or not the state where the moved part is substantially stopped after movement continues for the reference period, and the evaluation means is based on the comparison result of the comparison means and the determination result of the stop determination means. The game play of the player is evaluated.

  In the aspect of the invention, the evaluation unit may be configured to change the score of the player based on the determination result of the stop determination unit and the unit that changes the score of the player based on the comparison result of the comparison unit. And a means for determining a change amount, wherein the game play of the player is evaluated by changing the score of the player by the determined change amount.

  In one aspect of the present invention, the game device may perform comparison processing by the comparison means when it is not determined that the portion that has moved at the reference speed or higher has stopped substantially after the movement has continued for the reference period or longer. Means for restricting execution or execution of the evaluation process by the evaluation means.

  In the aspect of the invention, the position information acquisition unit acquires position information regarding the position of at least one hand and at least one foot of the player, and the movement determination unit includes at least one hand of the player. Whether or not at least one foot has moved at a reference speed or higher is determined based on the position information, and the stop determination means has at least one hand of the player and at least one foot at the reference speed or higher. When it is determined that the limb has moved, it is determined based on the position information whether or not the state in which the limb is substantially stopped after the movement continues for a reference period.

  In one aspect of the present invention, the game device further includes means for determining whether at least one of the plurality of parts is substantially stopped based on the position information, and the movement determination means After determining that at least one of the plurality of parts is substantially stopped, it is determined whether the substantially stopped part has moved at the reference speed or more. .

  In one aspect of the present invention, the game device further includes means for setting the reference speed based on the tempo of the music.

  In one aspect of the present invention, the game device further includes means for setting the length of the reference period based on the tempo of the music.

  Further, in one aspect of the present invention, the stop determination unit determines whether or not the part moved at the reference speed or more is within a range determined based on the position of the part after the movement. Means for determining whether or not the part is substantially stopped, and determining whether or not the state where the part is within the range continues for a reference period.

  Moreover, in one aspect of the present invention, the stop determination means determines whether or not the part moved at the reference speed or more is decelerated after the movement and the movement speed is substantially zero. Includes a means for determining whether or not is substantially stopped, and it is determined whether or not the state in which the moving speed of the part is substantially zero has continued for a reference period.

  In one aspect of the present invention, the position information acquisition means acquires position information related to positions of the plurality of parts of the player in the real space, and the movement determination means is at least one of the plurality of parts. Whether or not the player has moved at a reference speed or higher based on the positions of the plurality of parts in the real space, and the stop determination means is configured so that at least one of the plurality of parts is at or above the reference speed. If it is determined that the part moved at the reference speed or higher is in a substantially stopped state based on the position in the real space of the part moved at the reference speed or higher. It is characterized by.

  Moreover, in one aspect of the present invention, the position information acquisition unit acquires position information regarding a position in the display screen or virtual space corresponding to the positions of the plurality of parts of the player in the real space, and the movement determination unit Whether or not the player has moved at least one of the plurality of parts at a reference speed or higher is based on a display screen or a position in the virtual space corresponding to the position of the plurality of parts of the player in the real space. And when the at least one of the plurality of parts has moved at the reference speed or more, the stop judging means has a state in which the part moved at the reference speed or more is substantially stopped for a reference period or more. It is determined whether or not the operation has continued based on a display screen or a position in the virtual space corresponding to the position in the real space of the part moved at the reference speed or higher. To.

It is a figure which shows the mode of the player who plays a game. It is a figure which shows an example of the picked-up image produced | generated by a CCD camera. It is a figure for demonstrating the measuring method of the depth of the player by an infrared sensor. It is a figure which shows an example of the depth image obtained by an infrared sensor. It is a figure which shows an example of the player site | part information produced | generated by a position detection apparatus. It is a figure which shows the position of the player specified by player part information. It is a figure which shows an example of a game screen. It is a figure which shows an example of the game screen when a hit trick is performed. It is a figure which shows an example of the game screen in case a rhythm trick is performed. It is a figure which shows an example of the game screen when a pause trick is performed. It is a figure which shows the hardware constitutions of a position detection apparatus. It is a figure which shows the hardware constitutions of a game device. It is a functional block diagram which shows the function implement | achieved in a game device. It is a figure which shows an example of reference | standard data. It is explanatory drawing for demonstrating a determination area | region. It is explanatory drawing for demonstrating the determination method of an operation | movement determination part. It is explanatory drawing for demonstrating the comparison process by a timing comparison part. It is explanatory drawing for demonstrating the determination method of a movement determination part and a stop determination part. It is a flowchart which shows an example of the process performed in a game device. It is a figure which shows the determination process of a rhythm trick. It is a figure which shows the determination process of a pause trick. It is a figure which shows the determination process of a ripple operation | movement. It is a figure which shows the determination process of hit trick. It is an example of the game screen in a modification (1-3). It is an example of the game screen in a modification (2-4). It is a figure which shows an example of the game screen in a modification (3-1). It is a figure for demonstrating the change method of the magnitude | size of an outline image. It is a figure for demonstrating the change method of the outline image in a modification (3-2).

[1. Embodiment]
Hereinafter, an example of an embodiment of the present invention will be described in detail with reference to the drawings. The case where the game device according to the embodiment of the present invention is applied to a consumer game machine (stationary game machine) will be described as an example. The game apparatus is a computer such as a portable game machine or a mobile phone (smart phone). May be.

  FIG. 1 is a diagram illustrating a state of a player playing a game. As shown in FIG. 1, the player 100 is located in front of the position detection device 1, for example. The position detection device 1 and the game device 20 are connected so that data communication is possible.

[2. Operation of position detection device]
First, the position detection apparatus 1 will be described. The position detection device 1 generates player part information relating to the position of the player in the real space. In the present embodiment, a case will be described in which the player part information includes information regarding the positions of a plurality of parts of the player 100. The part of the player 100 is, for example, the head or both hands.

  As shown in FIG. 1, the position detection device 1 includes, for example, a CCD camera 2, an infrared sensor 3, a microphone 4 including a plurality of microphones, and the like.

  The CCD camera 2 is a known camera equipped with a CCD image sensor. The CCD camera 2 generates a captured image (for example, an RGB digital image) obtained by capturing the player 100 at a predetermined time (for example, every 1/60 seconds), for example.

  FIG. 2 is a diagram illustrating an example of a captured image generated by the CCD camera 2. As shown in FIG. 2, the photographed image includes, for example, a player 100. An Xs axis and a Ys axis that are orthogonal to each other are set in the captured image. For example, the upper left of the photographed image is the origin Os (0, 0). In addition, for example, the lower right corner of the captured image is set as coordinates Pmax (Xmax, Ymax). The position of each pixel corresponding to the captured image is specified by two-dimensional coordinates (Xs-Ys coordinates) assigned to each pixel.

  The infrared sensor 3 includes, for example, an infrared light emitting element and an infrared light receiving element (for example, an infrared diode). The infrared sensor 3 detects reflected light obtained by irradiating infrared light. The infrared sensor 3 measures the depth of the subject (for example, the player 100) based on the detection result of the reflected light.

  The subject depth is a distance interval between the measurement reference position and the subject position. The measurement reference position is a position serving as a reference when measuring the depth (depth) of the position of the player 100. The measurement reference position may be a predetermined position associated with the position of the position detection device 1, for example, the position of the infrared light receiving element of the infrared sensor 3. For example, the infrared sensor 3 measures the depth of the player 100 based on a flight time (TOF: Time of Flight) from when the infrared ray is irradiated until when the reflected light is received.

  FIG. 3 is a diagram for explaining a method of measuring the depth of the player 100 by the infrared sensor 3. As shown in FIG. 3, pulsed infrared light is emitted from the infrared sensor 3 at a predetermined interval. Infrared light emitted from the infrared sensor 3 spreads in a spherical shape with the light emission position of the infrared sensor 3 as a center point.

  For example, the infrared light emitted from the infrared sensor 3 strikes the surface of the player 100 body. Infrared light hitting these surfaces is reflected. The reflected infrared light is detected by the infrared light receiving element of the infrared sensor 3. That is, the infrared sensor 3 detects reflected light whose phase is inverted by 180 degrees with respect to the irradiated infrared ray.

  For example, as shown in FIG. 3, when the player 100 projects both hands forward, the projected hands are closer to the infrared sensor 3 than the body of the player 100. That is, the flight time of the infrared light reflected by both hands of the player 100 is shorter than the flight time of the infrared light reflected by the player's 100 body.

  The value obtained by multiplying the time from when the infrared sensor 3 irradiates the infrared light to the time when the reflected light is detected (that is, the flight time) and the speed of the infrared rays and dividing the result by the half is the measurement reference position and the player 100. Is equivalent to the distance interval (ie, depth). By performing such processing, the infrared sensor 3 measures the depth of the player 100.

  The infrared sensor 3 also detects the contour of the subject (player 100) by detecting the depth difference obtained from the reflected infrared light. As described above, the fact that the infrared sensor 3 receives the reflected light of the infrared light means that an object is arranged at this place. Also, if no other object is placed near the rear of this object, the depth difference between this object and the surroundings of this object will be large. For example, the contour of the player 100 is detected by connecting places where the depth difference is larger than a predetermined value.

  Note that the method of detecting the contour of the player 100 is not limited to the above example. In addition, for example, the contour may be detected based on the luminance of each pixel of the captured image obtained by the CCD camera 2. Also in this case, for example, the contour of the player 100 can be detected by connecting portions having a large luminance difference between pixels.

  Information (depth information) relating to the depth of the player 100 detected as described above is expressed as a depth image, for example. In the present embodiment, an example will be described in which depth information is expressed as a grayscale depth image (for example, 256-bit grayscale image data).

  FIG. 4 is a diagram illustrating an example of a depth image obtained by the infrared sensor 3. As shown in FIG. 4, for example, an object close to the infrared sensor 3 is expressed bright (high brightness), and a distant object is expressed dark (low brightness). The depth of the player 100 corresponds to the brightness (pixel value) of the depth image.

  For example, when the depth image is represented as 256-bit grayscale image data, the brightness of the depth image is different by 1 bit every time the depth of the player 100 is different by 2 centimeters. In this case, the infrared sensor 3 indicates that the depth of the subject can be detected in units of 2 cm. When the player 100 projects both hands forward (FIG. 3), as shown in FIG. 4, the pixels corresponding to both hands of the player 100 are expressed brighter (higher brightness) than the pixels corresponding to the trunk.

  In the present embodiment, the infrared sensor 3 generates a depth image every predetermined time (for example, every 1/60 seconds) as in the CCD camera 2. Based on the captured image obtained by the CCD camera 2 and the depth image obtained by the infrared sensor 3, player part information relating to the position of the part of the player 100 is generated.

  For example, a composite image (RGBD data) is generated by adding the depth information (Depth) indicated by the depth image to the captured image (RGB data) obtained by the CCD camera 2. That is, the composite image includes color information (RGB brightness) and depth information for each pixel.

  When the player part information is generated based on the composite image, first, pixels corresponding to the contour of the player 100 are specified based on the depth image. Next, the color information (RGB brightness) of the pixels surrounded by the outline in the composite image is referred to. Based on the color information of the composite image, pixels corresponding to each part of the body of the player 100 are specified. As this specifying method, for example, a known method such as a pattern matching method for extracting an object (that is, each part of the body of the player 100) from an image by comparison with a comparison image (teacher image) can be applied. is there.

  Based on the pixel values (RGBD values) of the pixels specified as described above, three-dimensional coordinates such as the head and shoulders of the player 100 are calculated. For example, a three-dimensional coordinate is generated by performing a predetermined matrix conversion process on the pixel value. This line example conversion process is executed by, for example, line example calculation similar to the conversion process of two coordinate systems of world coordinates-screen coordinates in 3D graphics. That is, the RGB value indicating the pixel color information and the D value indicating the depth are substituted into a predetermined determinant to calculate the three-dimensional coordinates of the pixel.

  A known method can be applied to the method for calculating the three-dimensional coordinates corresponding to the pixel from the pixel value (RGBD value), and this calculation method is not limited to the above example. In addition, for example, coordinate conversion may be performed using a lookup table.

  FIG. 5 is a diagram illustrating an example of player part information generated by the position detection device 1. As shown in FIG. 5, the player part information includes a plurality of pieces of information regarding the positions of the plurality of parts of the player 100. The player part information is stored in association with each part of the player 100 and three-dimensional coordinates, for example.

  FIG. 6 is a diagram illustrating the position of the player 100 specified by the player part information. In the present embodiment, for example, a predetermined position (for example, a measurement reference position) corresponding to the position detection device 1 is set as the origin Op. For example, the origin Op is a three-dimensional coordinate corresponding to the measurement reference position of the infrared sensor 3. Note that the position of the origin Op may be set anywhere in the three-dimensional space where the player 100 is located. For example, a three-dimensional coordinate corresponding to the origin Os of the captured image may be set as the origin Op.

  As shown in FIG. 6, for example, the player part information includes the head P1, the shoulder center P2, the left shoulder P3, the right shoulder P4, the left hand P5, the right hand P6, the back P7, the left knee P8, the right knee P9, and the left foot P10 of the player 100. Eleven three-dimensional coordinates corresponding to the right foot P11 are included.

  Note that the body part of the player 100 indicated by the player part information may be a predetermined part of the player's body (skeleton). For example, this part may be any part of the body that can be specified by the pattern matching method described above.

  For example, the player part information generated at predetermined intervals (for example, every 1/60 seconds) is transmitted from the position detection device 1 to the game device 20. The game device 20 receives the player part information from the position detection device 1 to identify the position of each part of the player (hereinafter, the player's “100” is omitted), and responds to the movement of the player part. Various processes are executed.

[3. Outline of game executed on game device]
The game apparatus 20 executes a game in which the player aims to place a part at a given position at a given timing. Here, when the player places limbs at a given position according to the music, a game in which the player's score increases is executed. When the game is started, music is output from the game device 20 and a game screen is displayed.

  FIG. 7 is a diagram illustrating an example of the game screen. As shown in FIG. 7, a character 32 that performs an action corresponding to the action of the player is displayed on the game screen 30. Based on the change in the three-dimensional coordinates of each part of the player, the position of each part of the character 32 changes. The character 32 can be said to be an image for guiding (presenting) the position of each part of the player detected by the game apparatus 20 to the player. The player can grasp that the position of each part is normally detected by looking at the character 32.

  Here, since the character 32 displayed on the game screen 30 faces the player, the character 32 performs a movement obtained by horizontally inverting the movement of the player. For example, when the player raises the right hand, the display of the character 32 is updated so that the right hand is raised as viewed from the player in the real space. Note that an image (player image) obtained by extracting the contour of the player from the photographed image and performing left-right reversal processing may be displayed on the game screen 30 instead of the character 32.

  When the reference timing at which the player should place the part at a predetermined position is approaching, a reference image 34 and a guide image 36 are displayed on the game screen 30. The reference image 34 is an image for guiding the reference position to be touched by the player to the player. The guidance image 36 is an image for guiding the reference timing to the player.

  The guide image 36 is generated from the reference image 34 and moves away from the reference image 34 in a predetermined direction after the reference image 34 is displayed. When the guide image 36 is separated from the reference image 34 by a predetermined distance, the guide image 36 is folded back and moved so as to approach the reference image 34. When the reference timing arrives, the reference image 34 and the guide image 36 overlap. The player can grasp the reference timing based on the positional relationship between the reference image 34 and the guide image 36.

  When the reference timing comes, the player actually moves the limbs so that the limb indicated by the character 32 touches the reference image 34. In the example shown in FIG. 7, when the player extends the left hand P5 sideways so as to touch the reference image 34 on the left side of the character 32 at the timing when the reference image 34 and the guide image 36 overlap, the player is highly evaluated. Is given. When a high evaluation is given to the player, the player's score 38 and the combo number 40 increase. In the following, the fact that the player actually moves the limb so that the limb indicated by the character 32 touches the reference image 34 is also simply referred to as “the player performs a ripple action”.

  When the reference timing comes, the reference image 34 and the guide image 36 disappear. When the next reference timing approaches, a reference image 34 that guides the reference position to be touched at the reference timing and a guide image 36 that guides the reference timing are displayed on the game screen 30.

  In the present embodiment, when the player performs a special action, the increase amount of the score 38 is increased under a predetermined condition. Hereinafter, the special operation is referred to as “trick”. Here, a plurality of types of tricks are prepared. As an example, a “hit trick” in which the player touches the reference image 34 at a part where the reference image 34 is difficult to touch, and a “rhythm” in which the player shakes the body to take the rhythm. The “trick” and the “pause trick” in which the player poses will be described.

  FIG. 8 is a diagram illustrating an example of the game screen 30 when a hit trick is performed. As shown in FIG. 8, when the reference image 34 is displayed on the right side of the character 32, the player can easily perform a ripple action by using the right hand P6. Here, when the player dares to use the left hand P5 and performs a ripple motion by twisting the body, the hit trick is successful. In this state, as shown in FIG. 8, since the player is in a posture that twists his body, the player appears to be dancing.

  When the player succeeds in the hit trick, a trick name 42 indicating the type of trick that the player has succeeded is displayed, and the trick gauge 44 is increased. When the trick gauge 44 is full, the magnification 46 indicating the increase amount of the score 38 increases, and the trick gauge 44 returns to 0 again. As the numerical value indicated by the magnification 46 increases, the amount of increase in the score 38 when the player performs a ripple action increases. When the player fails in the ripple action (when the combo is interrupted), the magnification 46 may return to zero.

  FIG. 9 is a diagram illustrating an example of the game screen 30 when the rhythm trick is performed. As shown in FIG. 9, the rhythm trick succeeds when the player slightly lowers his / her hips and swings his / her hips up and down like the rhythm of the music. In this case, the display of the trick name 42 is updated to indicate that the rhythm trick is being performed.

  For example, the trick gauge 44 gradually increases according to the time during which the rhythm trick is performed. In this state, the player swings his / her hips up and down and performs a ripple motion while taking a rhythm, so the player seems to dance by stretching their limbs while shaking their bodies so as to get on the rhythm. .

  FIG. 10 is a diagram illustrating an example of the game screen 30 when a pause trick is performed. As shown in FIG. 10, for example, after the player quickly moves the limbs, if a given pose is taken and the limbs are stopped for a certain period, the pose trick is successful. In this case, the display of the trick name 42 is updated to indicate that the rhythm trick is being performed.

  For example, if the pause trick is successful, the trick gauge 44 is increased by a predetermined value. If the player makes a successful pose trick, it will appear to be a dance that poses after quickly moving the limbs and making a crisp move.

  As described above, the game apparatus 20 according to the present embodiment allows the player to freely dance as compared to a case where the player simply performs a ripple motion because the score magnification increases when the player performs various tricks. In addition, the dance can be accurately evaluated. Hereinafter, this technique will be described in detail.

  First, the hardware configuration of the position detection device 1 and the game device 20 will be described.

[4. Configuration of position detection device]
FIG. 11 is a diagram illustrating a hardware configuration of the position detection device 1. As illustrated in FIG. 11, the position detection device 1 includes a control unit 10, a storage unit 11, a photographing unit 12, a depth measurement unit 13, a voice input unit 14, and a communication interface unit 15. Each component of the position detection apparatus 1 is connected by a bus 16 so that data can be transmitted and received.

  The control unit 10 controls each unit of the position detection device 1 based on an operating system and various programs stored in the storage unit 11.

  The storage unit 11 stores an operating system, a shooting unit 12, a program for operating the depth measurement unit 13, and various parameters. The storage unit 11 stores a program for generating player part information based on the captured image and the depth image.

  The photographing unit 12 includes a CCD camera 2 and the like. For example, the photographing unit 12 generates a photographed image of the player. The depth measurement unit 13 includes the infrared sensor 3 and the like. For example, the depth measurement unit 13 generates a depth image based on the flight time obtained by the infrared sensor 3. As described above, the control unit 10 is based on the captured image generated by the imaging unit 12 and the depth image generated by the depth measurement unit 13 every predetermined time (for example, every 1/60 seconds). Then, player part information is generated.

  The voice input unit 14 includes a microphone 4 and the like. The communication interface unit 15 is an interface for transmitting various data such as player part information to the game apparatus 20.

[5. Configuration of game device]
FIG. 12 is a diagram illustrating a hardware configuration of the game apparatus 20. As shown in FIG. 12, the game apparatus 20 includes a control unit 21, a main storage unit 22, an auxiliary storage unit 23, an optical disc playback unit 24, a communication interface unit 25, an operation unit 26, a display unit 27, and an audio output unit 28. Including. Each part of the game apparatus 20 is connected by a bus 29.

  The control unit 21 includes, for example, a CPU, a GPU (Graphics Processing Unit), a SPU (Sound Processing Unit), and the like. The control unit 21 executes various processes according to the operating system and other programs. The control unit 21 also includes a real time clock and functions as a time measuring means.

  The main storage unit 22 includes, for example, a RAM (Random Access Memory). The auxiliary storage unit 23 includes, for example, a hard disk device (information storage medium). The main storage unit 22 stores programs and data read from the auxiliary storage unit 23 or the optical disc (information storage medium). The main storage unit 22 is also used as a work memory that stores data necessary in the course of processing. Further, for example, the main storage unit 22 stores player part information received from the position detection device 1 in time series.

  The optical disc playback unit 24 reads programs and data stored on the optical disc. For example, a game program is stored on the optical disc.

  The communication interface unit 25 is an interface for connecting the game apparatus 20 to a communication network. The game device 20 acquires player part information from the position detection device 1 via the communication interface unit 25.

  The operation unit 26 is for a player to perform various operations. The operation unit 26 includes, for example, a game controller, a touch panel, a mouse, or a keyboard. The display unit 27 is, for example, a home television receiver or a liquid crystal display panel. The display unit 27 displays a screen according to instructions from the control unit 21. The audio output unit 28 includes, for example, a speaker or headphones.

  In the present embodiment, a case where various programs and data are supplied to the game apparatus 20 via an optical disc will be described. Note that these programs and data may be supplied to the game apparatus 20 via another information storage medium (for example, a memory card). Alternatively, the program and data may be supplied to the game apparatus 20 from a remote location via a communication network.

[6. Functions realized with game devices]
FIG. 13 is a functional block diagram showing functions implemented in the game apparatus 20. As shown in FIG. 13, in the game apparatus 20, a position information acquisition unit 50, a game data storage unit 52, a game execution unit 54, a ripple motion determination unit 56, a part information acquisition unit 58, a motion determination unit 60, and direction change timing acquisition The unit 62, the timing comparison unit 64, the movement determination unit 66, the stop determination unit 68, the evaluation unit 70, and the display control unit 72 are realized. These functions are realized by the control unit 21 operating according to a program read from the optical disc.

[6-1. Location information acquisition unit]
The position information acquisition unit 50 is realized mainly by the control unit 21. The position information acquisition unit 50 acquires position information related to the position of one or more parts of the player. In the present embodiment, the player part information corresponds to the “position information”. The player part information indicates the position of one or more parts of the player in the real space. Here, the position of at least one hand (right hand and / or left hand) and at least one foot (right foot and / or left foot) of the player. Contains information about.

  The position information acquisition unit 50 acquires player part information based on a photographed image obtained from a photographing unit that photographs a player in the real space. For example, the position information acquisition unit 50 generates position information for the player based on the captured image obtained from the image capturing unit that captures the player, and the depth information related to the distance between the measurement reference position of the depth measuring unit and the player. Player part information is acquired from the generating means. When the position information acquisition unit 50 acquires the player part information, the player part information is stored in history data (described later) in time series.

[6-2. Game data storage unit]
The game data storage unit 52 is implemented mainly by the main storage unit 22, the auxiliary storage unit 23, and an optical disc. The game data storage unit 52 stores various information necessary for executing the game. Here, the game data storage unit 52 stores the following data.
(1) Music data (2) Reference data (3) History data in which player part information is stored in time series (4) Game status data indicating the status of the game being executed

  Note that the music data and the reference data may be data prepared in advance by a game creator or data created by a player. The history data is updated every time the player part information is acquired by the position detection device 1. The game situation data is data that is generated and updated when the game is started.

  The music data is data in which general popular music or the like is stored in a predetermined data format. In the present embodiment, the music data includes information related to the tempo of the music and information related to the timing at which the music beats. The information related to the tempo of music is information indicating the speed of the music, and stores the speed at which beats are recorded (BPM; Beats Per Minute). The information regarding the timing at which the beat is engraved is information indicating the beat timing of the music, and information regarding the elapsed time from the start of the music to the time at which each beat is engraved is stored.

  FIG. 14 is a diagram illustrating an example of the reference data. As shown in FIG. 14, the reference data is data in which a reference timing and a reference position are associated with each other. The reference timing is a timing at which the player should place (move) the part at the reference position. The reference timing stores information indicating the passage of time since the reproduction of the music is started. For example, the time at which the music beats (m / n (m and n are integers) beats after the music start time is stored. Time) is stored.

  The reference position is a position where the player's part should be at the reference timing. Here, the three-dimensional coordinates in the real space (the three-dimensional coordinate space indicated by the player part information) are stored as the reference position.

  In the present embodiment, as shown in FIG. 14, a reference part is associated with the reference timing and the reference position. The reference part is a part that is easy to touch the reference position, and is a part determined based on the reference position. The reference data is created in consideration of, for example, the tempo (rhythm) of the music.

  The game situation data includes, for example, information indicating the player's current score, information indicating the current score magnification, information indicating the current elapsed time of the music, current values corresponding to the trick gauge 44, and information regarding the current number of combos. Etc. are stored. The score of the player may increase as the player is given higher evaluation, or may decrease. As the information indicating the score magnification, a numerical value displayed in the magnification 46 is stored. The numerical value corresponding to the trick gauge has a minimum value and a maximum value, and takes a value between 0 and 100, for example.

  The data stored in the game data storage unit 52 is not limited to the above example. The game data storage unit 52 may store various data for executing the game. In addition, for example, various data of the reference image 34 and the guide image 36, data (image data and audio data) for performing various effect processes on the game screen 30, and the like may be stored. Further, the control unit 21 functions as a means for acquiring various data stored in the game data storage unit 52.

[6-3. Game execution part]
The game execution unit 54 is realized mainly by the control unit 21. The game execution unit 54 executes a game in which the player moves the part according to the music. In the present embodiment, the game execution unit 54 executes a game in which the player aims to place at least one of the plurality of parts at a given position at a given timing according to the music.

  The game execution unit 54 updates the game situation data according to the game play of the player. For example, the game execution unit 54 updates the current playback time of the music or updates the number of combos according to the progress of the game.

[6-4. Ripple action determination unit]
The ripple operation determination unit 56 is realized mainly by the control unit 21. The ripple motion determination unit 56 determines whether or not at least one of the plurality of parts of the player is within the determination region including the reference position at the time corresponding to the reference timing.

  The “time point corresponding to the reference timing” is any time point within a predetermined period including the reference timing (a predetermined time before the reference timing, after the predetermined time, or the reference timing itself). Indicates the timing itself. The ripple action determination unit 56 determines whether or not the position of each part indicated by the player part information is included in the determination area.

  FIG. 15 is an explanatory diagram for explaining a determination region. Here, as shown in FIG. 15, twelve types of reference positions 80A to 80L (hereinafter collectively referred to as “reference position 80”) are prepared, and twelve types of determination areas 82A to 82L (hereinafter referred to as “reference positions 80”). The case where these are collectively referred to simply as the determination region 82) will be described.

  For example, the reference position 80 is set around a representative position 84 (a player standing position when standing in front of the position detecting device 1) that is a predetermined distance away in the front direction of the position detecting device 1. One of these 12 types of three-dimensional coordinates of the reference position 80 is stored in the reference data. As shown in FIG. 15, the determination area 82 is an area having a predetermined shape including the reference position 80, and here is an area surrounded by a sphere having a predetermined radius r centering on the reference position 80. The size of the determination area 82 may be set to a predetermined size, or may be determined according to, for example, a game situation or a player's body size.

  The ripple action determination unit 56 compares the player part information at the time corresponding to the reference timing with the reference position 80, so that the position of the player part in the real space is set in the real space at the reference timing. It is determined whether or not it is within the determination area 82 including the reference position 80.

  Further, based on the positional relationship between the representative position 84 and each reference position 80, a reference part is set at each reference position 80. For example, since the reference position 80A is at the upper part of the player when the player stands at the representative position 84, the left hand P5 or the right hand P6 is the reference part. Since the reference positions 80B to 80F are on the right side of the player when the player stands at the representative position 84, the right hand P6 or the right foot P11 is the reference portion. For example, since the reference position 80G is below the player when the player stands at the representative position 84, the left foot P10 or the right foot P11 is the reference portion. Since the reference positions 80H to 80L are on the left side of the player when the player stands at the representative position 84, the left hand P5 or the left foot P10 is the reference portion.

[6-5. Part information acquisition unit]
The part information acquisition unit 58 is realized mainly by the control unit 21. The part information acquisition unit 58 acquires part information related to the type of part of the player determined to be within the determination area 82 at the time corresponding to the reference timing. The part information acquisition unit 58 specifies the kind of part associated with the three-dimensional coordinates in the determination area 82 by referring to the player part information. The part information acquired by the part information acquisition unit 58 is used for hit trick evaluation by the evaluation unit 70 described later.

[6-6. Operation determination unit]
The operation determination unit 60 is realized mainly by the control unit 21. In the motion determination unit 60, the player performs an operation (hereinafter referred to as a direction changing operation) to change the direction of the part (at least one of the plurality of parts) based on the position change of the part (position change in the real space). It is determined whether or not. The motion determination unit 60 identifies the moving direction of each part based on the time-series change of the player part information, and determines whether the moving direction of each part has changed by a predetermined angle (for example, 30 °) or more. Thus, it is determined whether or not the direction changing operation has been performed.

FIG. 16 is an explanatory diagram for explaining a determination method of the operation determination unit 60. The t axis shown in FIG. 16 is a time axis. Here, a case will be described in which it is determined whether or not a direction changing operation has been performed based on a change in the position of the three-dimensional coordinates of the back P7 corresponding to the position of the player's waist. As shown in FIG. 16, the moving direction V _P7 (t) of the back P7 is specified based on the time-series change of the three-dimensional coordinates of the back P7.

When the angle θ _P7 formed by the current moving direction V _P7 (t) and the immediately preceding moving direction V _P7 (t) is equal to or greater than a predetermined angle, it is determined that the direction changing operation has been performed. Here, the case where the back P7 moves up and down by the player swinging the whole body up and down will be described. For example, when the back P7 moves up (time t _a , t _b state) and the back P7 extends (time t _c state), the direction is changed and the back P7 starts moving downward ( the state of the time _t d, _{t e).} This turning-back operation is a direction changing operation. Similarly, after the player moves the back P7 downward, the direction is changed and the back P7 starts moving upward.

  Thus, in this embodiment, the motion determination unit 60 determines whether or not the reciprocating motion of the part has been performed by the player. The reciprocating motion is an operation of repeatedly moving a specific part so as to reciprocate in a predetermined direction.

[6-7. Direction change timing acquisition unit]
The direction change timing acquisition unit 62 is realized mainly by the control unit 21. The direction change timing acquisition unit 62 acquires the direction change timing of the part in the direction change operation. The direction change timing acquisition unit 62 acquires the timing when the moving direction of the player's part changes by a predetermined angle or more.

  Here, since the reciprocating motion of the player is detected, the direction change timing acquisition unit 62 acquires the part return timing in the motion as the direction change timing. The turn-back timing is a timing at which the moving direction of the back P7 is shifted by approximately 180 °. Note that approximately 180 ° means that the moving direction may not be completely 180 °, and the moving direction may deviate from 180 ° by about 10 ° or 15 ° depending on the movement of the player. .

[6-8. Timing comparison unit]
The timing comparison unit 64 is realized mainly by the control unit 21. The timing comparison unit 64 compares the direction change timing with the timing determined based on the beat of the music. The “timing determined based on the beat of the music” is a timing (a predetermined time before the beat timing, a predetermined time after the beat timing, or the beat timing itself) determined based on the timing at which the music beats (beat timing). For example, the beat timing itself. As described above, information indicating the timing at which music beats may be included in music data, for example.

  FIG. 17 is an explanatory diagram for explaining the comparison processing by the timing comparison unit 64. As shown in FIG. 17, here, the timing comparison unit 64 compares the turn-back timing of the back P7 with the timing determined based on the beat of the music. For example, the timing comparison unit 64 determines whether or not the deviation time Δt between the turn-back timing of the back P7 and the timing determined based on the beat of the music is equal to or less than a threshold value. When the shift time Δt is equal to or less than the threshold value, it is determined that the rhythm trick has been successful, and an evaluation by the evaluation unit 70 described later is performed.

[6-9. Movement determination unit]
The movement determination unit 66 is realized mainly by the control unit 21. The movement determination unit 66 determines whether or not at least one of the plurality of parts (for example, at least one hand and at least one foot of the player) has moved at a reference speed or more, as positional information (for example, the plurality of parts). The position in the real space). The movement determination unit 66 identifies the movement speed of each part of the player based on the time-series change of the player part information, and compares the movement speed of each part with the reference speed.

  The reference speed may be a predetermined speed, or may be a speed set based on the game situation or the player's body size. Here, the movement determination unit 66 includes a plurality of movements between one reference timing and the next reference timing (between the first reference timing and the second reference timing that arrives after the first reference timing). It is determined based on the position information whether or not at least one of the parts has moved at a reference speed or higher.

[6-10. Stop determination unit]
The stop determination unit 68 is realized mainly by the control unit 21. When it is determined that at least one of the plurality of parts (for example, at least one hand and at least one foot of the player) has moved at a reference speed or higher, the stop determination unit 68 moves at a reference speed or higher. Whether or not the state in which the limb (for example, the limb) is substantially stopped after the movement continues for the reference period is determined based on the position information (for example, the position in the real space of the part moved at the reference speed or higher).

  Here, the stop determination unit 68 determines whether or not the part moved at the reference speed or more is within the range determined based on the position of the part after the movement, thereby substantially stopping the part. Means for determining whether or not the region is within the range, and determines whether or not the state where the portion is within this range has continued for the reference period. In addition, the stop determination unit 68 determines whether or not a state in which the portion moved at the reference speed or more is substantially stopped after the movement continues between the one reference timing and the next reference timing.

  FIG. 18 is an explanatory diagram for describing the determination methods of the movement determination unit 66 and the stop determination unit 68. As illustrated in FIG. 18, when the movement determination unit 66 determines that the movement speed of the player's limb is equal to or higher than the reference speed, the movement determination unit 66 determines whether the movement speed of the limb is equal to or lower than a predetermined value. Then, it is determined whether or not the limb remains in the region including the position of the limb when the moving speed of the limb is equal to or less than a predetermined value. The stop determination unit 68 determines whether or not the stayed state has continued for the reference period T.

  Note that the determination method of the stop determination unit 68 is not limited to the above example. In addition, for example, the stop determination unit 68 determines whether or not a part that has moved at a reference speed or higher is decelerated after the movement and the movement speed is substantially zero (for example, a state below the reference value). May include means for determining whether or not the part is substantially stopped and determine whether or not the state in which the moving speed of the part is substantially zero has continued for a reference period.

[6-11. Evaluation Department]
The evaluation unit 70 is realized mainly by the control unit 21. The evaluation unit 70 evaluates the game play of the player. Here, the evaluation unit 70 evaluates the player's game play by changing the player's score based on the determination result of the ripple motion determination unit 56.

  For example, when the player's part is included in the determination area 82 at the reference timing, the evaluation unit 70 increases the player's score. In this embodiment, the standard increase amount of the score when the score magnification indicated by the game situation data is 1 is determined, and the player's score increases by a value obtained by multiplying the standard increase amount by the current score magnification. . Note that the method by which the evaluation unit 70 increases the score of the player is not limited to this, and the increase amount of the score is stored in a table, and the score is increased by referring to the value of this table. Good.

  As described above, in the present embodiment, based on the evaluation results of the three types of tricks by the player, the evaluation unit 70 increases the score magnification under a predetermined condition, thereby determining the amount of change in the player's score. decide. The evaluation unit 70 evaluates the player's game play by changing the player's score by the determined change amount.

[Evaluation method of hit trick]
First, a hit trick evaluation method will be described. The evaluation unit 70 evaluates the player's game play based on the type of part acquired by the part information acquisition unit 58. The evaluation unit 70 compares the type of the part of the player determined to be in the determination area 82 and the reference part, and evaluates the game play of the player based on the comparison result. Here, when the type of the part of the player determined to be within the determination region is different from the reference part, the evaluation unit 70 gives the player a higher evaluation than when the part is the same.

  The evaluation unit 70 also includes means for determining the amount of change in the player's score based on the type of the part of the player determined to be in the determination area 82 at the time corresponding to the reference timing. Here, the evaluation unit 70 determines the amount of change in the score of the player by determining the score magnification according to the type of the part acquired by the part information acquisition unit 58.

  That is, the evaluation unit 70 determines the score when the part information acquisition unit 58 acquires the type of the part, or when the score of the player is changed based on the determination result of the ripple motion determination part 56 after this case. The amount of change is determined based on the type of part acquired by the part information acquisition unit 58. For example, the type of part and the amount of change in score may be associated with each other and stored in the game data storage unit 52. In this case, the score changes with the amount of change associated with the type of part acquired by the part information acquisition unit 58.

[Rhythm trick evaluation method]
Next, a rhythm trick evaluation method will be described. The evaluation unit 70 evaluates the game play of the player based on the comparison result of the timing comparison unit 64. Here, when the deviation time Δt between the turn-back timing and the beat timing is equal to or less than the threshold, the player is given a higher evaluation than when the difference is larger than the threshold.

  In the present embodiment, the player performs a ripple action while performing a rhythm trick, so the evaluation unit 70 performs the game play of the player based on the comparison result of the ripple action determination unit 56 and the comparison result of the timing comparison unit 64. Will be evaluated. For example, the evaluation unit 70 includes means for determining the amount of change in the player's score based on the determination result of the timing comparison unit 64. The evaluation unit 70 determines the amount of change in the score of the player by determining the score magnification according to the comparison result of the timing comparison unit 64.

  That is, the evaluation unit 70 changes the score when the comparison by the timing comparison unit 64 is performed or when the score of the player is changed based on the comparison result of the ripple motion determination unit 56 after this case. Is determined based on the comparison result of the timing comparison unit 64. For example, the condition relating to the deviation time Δt and the amount of change in the score may be associated with each other and stored in the game data storage unit 52. In this case, the score changes with the amount of change associated with the condition that the deviation time Δt satisfies.

[Pose Trick Evaluation Method]
Next, a rhythm trick evaluation method will be described. The evaluation unit 70 evaluates the game play of the player based on the determination result of the stop determination unit 68. The evaluation unit 70 gives a higher evaluation to the player when the state where the part is substantially stopped continues for the reference period than when the part does not continue for the reference period.

  In the present embodiment, the player may perform a ripple motion while performing a pause trick. Therefore, the evaluation unit 70 determines that the player is based on the comparison result of the ripple motion determination unit 56 and the determination result of the stop determination unit 68. Will evaluate the gameplay. For example, the evaluation unit 70 includes means for determining the change amount of the player's score based on the determination result of the stop determination unit 68. The evaluation unit 70 determines the amount of change in the score of the player by determining the score magnification based on the determination result of the stop determination unit 68.

  For example, the movement determination unit 66 makes a determination between a first reference timing and a second reference timing that is a reference timing that comes next to the first reference timing, and the stop determination unit 68 Since the determination is performed between the first reference timing and the second reference timing, the evaluation unit 70 determines the ripple operation determination unit 56 related to the second reference timing or a reference timing that arrives after the second reference timing. The amount of change in the score when the player's score is changed based on the comparison result is determined based on the determination result of the stop determination unit 68.

  Here, a mode is described in which a higher evaluation is given when the player succeeds in the trick than in the normal case, but a normal evaluation is given and the trick is performed when the player succeeds in the trick. If not, a low rating may be given. That is, when the player succeeds in the trick, a relatively high evaluation may be given compared to the normal case.

[6-12. Display control unit]
The display control unit 72 is realized mainly by the control unit 21. The display control unit 72 executes various display control processes related to the game screen 30. For example, the display control unit 72 causes the character 32 to move within the game screen 30 based on a time-series change in the player part information.

[7. Processing executed in game device]
FIG. 19 is a flowchart showing an example of processing executed in the game apparatus 20. The process of FIG. 19 is executed by the control unit 21 operating according to a program read from the optical disc when a game start instruction is issued.

  As shown in FIG. 19, first, the control unit 21 starts playing a music piece (S101). The control unit 21 displays the game screen 30 on the display unit 27 (S102). At the start of the game, game situation data is generated in the main storage unit 22 and an initial value is stored. For example, the score of the player, the number of combos, and the trick gauge are 0, and the score magnification is 1. Based on these initial values, the score 38, the number of combos 40, the trick gauge 44, and the magnification 46 of the game screen 30 are displayed. When the game situation data is updated by the processing described later, the display is also updated as appropriate.

  The control unit 21 acquires player part information from the position detection device 1 and stores it in the main storage unit 22 (S103). The control unit 21 performs display control of the character 32 based on the latest player part information (S104). In S104, display control of the character 32 is performed so as to perform an action corresponding to the action of the player. For example, skeleton information is set for the character 32, and the character 32 performs the action corresponding to the player by changing the position of the skeleton of the character 32 indicated by the skeleton information based on the player part information.

  The control unit 21 executes a rhythm trick determination process (S105).

FIG. 20 is a diagram illustrating a rhythm trick determination process. As shown in FIG. 20, the control unit 21 refers to the three-dimensional coordinates of the back P7 (S201). The control unit 21 determines whether or not the back P7 has changed direction based on the time-series change of the three-dimensional coordinates of the back P7 (S202). In S202, the movement direction VP7 of the back _P7 is acquired based on the time-series position change of the back P7, and it is determined whether or not the change of the movement direction _VP7 is equal to or greater than a predetermined angle. It is determined whether or not the back P7 has changed direction.

  When it determines with the back P7 having changed the direction (S202; Y), the control part 21 acquires the present time as a direction change timing (S203). The control unit 21 refers to the music data and determines whether or not the shift time Δt between the direction change timing acquired in S203 and the beat timing of the music is equal to or less than a threshold value (S204).

  When it is determined that the shift time is equal to or less than the threshold (S204; Y), the control unit 21 displays a trick name 42 indicating a rhythm trick on the game screen 30 (S205). The control unit 21 increases the numerical value indicated by the trick gauge 44 by a predetermined value, and extends the trick gauge 44 (S206). A predetermined value may be used as the amount of change of the trick gauge 44 when the rhythm trick is successful, or may be changed in accordance with each element such as the game situation and the difficulty level of the music.

  The control unit 21 determines whether or not the trick gauge 44 is full (S207). In S207, it is determined whether or not the value of the trick gauge 44 stored in the game situation data has reached the maximum value. Alternatively, it is determined whether or not the trick gauge 44 has extended to the end.

  When it is determined that the trick gauge 44 is full (S207; Y), the control unit 21 increments the score magnification stored in the game situation data and updates the display of the magnification 46 (S208). Next, the control unit 21 returns the trick gauge 44 to 0 and updates the display of the trick gauge 44 (S209).

  On the other hand, when it is not determined that the back P7 has changed direction (S202; N), the processing of S203 to S209 is not executed. In this case, since the back P7 is moving in the same direction as immediately before, it is not determined that the rhythm trick has been successful.

  Further, when it is not determined that the shift time is equal to or less than the threshold (S204; N), the processing of S205 to S209 is not executed. In this case, the timing at which the back P7 swings up and down is significantly different from the beat timing. Therefore, the player is not on the rhythm of the music, and it is not determined that the rhythm trick has succeeded.

  If it is not determined that the trick gauge 44 is full (S207; N), the processing of S208 and S209 is not executed. In this case, the rhythm trick has been successful, but the value of the trick gauge 44 has not reached the maximum value, so the score magnification does not change.

  When the rhythm trick determination process ends, the process returns to FIG. 19, and the control unit 21 executes the pause trick determination process (S106).

  FIG. 21 is a diagram illustrating pause trick determination processing. As shown in FIG. 21, the control unit 21 determines whether or not the moved flag is 0 (S301). The moved flag is a flag indicating whether or not the player has moved the limb at a reference speed or higher, and that the moved flag is “0” indicates that the player has not moved the limb at the reference speed or higher yet. The fact that the moved flag is “1” indicates that the player has already moved the limb at a reference speed or higher.

  When it is determined that the moved flag is 0 (S301; Y), the control unit 21 three-dimensional coordinates of the player's limbs (for example, left hand P5, right hand P6, left foot P10, right foot P11) indicated by the player part information. (S302).

  The control unit 21 determines whether or not the moving speed of the player's limbs is equal to or higher than the reference speed (S303). In S303, the movement speed of the limb is specified based on the time-series change of the three-dimensional coordinates of the player's limb, and the movement speed is compared with the reference speed.

  When it is determined that the movement speed of the player's limbs is equal to or higher than the reference speed (S303; Y), the control unit 21 sets the moved flag to 1 (S304).

  On the other hand, when it is determined that the moved flag is 1 (S301; Y), since the player's limbs are already moving at the reference speed or higher, the processing of S302 to S304 is not performed, and the processing is S305. Migrate to

  The control unit 21 determines whether or not the player's limb is still moving (S305). In S305, it may be determined whether or not the current movement speed of the player's limb is equal to or less than a predetermined value, or whether or not a predetermined time has elapsed since the moved flag becomes 1. It may be determined.

  When it is determined that the player's limb is still moving (S305; Y), the process proceeds to S107.

  When it is not determined that the player's limb is still moving (S305; N), the control unit 21 determines whether or not the limb moved at or above the reference speed is substantially stopped (S306). In S306, for example, it is determined whether or not the current player's limb is within the area including the position of the limb at the time when the determination in S305 is performed, so that the player's limb is substantially stopped. It is determined whether or not there is.

  When it is not determined that the player's limbs are substantially stopped (S306; N), the control unit 21 sets the moved flag to 0 (S307), and the process proceeds to S107. In this case, since the player does not fix the limbs, it is not determined that the pause trick has been successful.

  When it is determined that the player's limbs are substantially stopped (S306; Y), the control unit 21 measures the time and updates the duration (S308). Information indicating the duration is stored in, for example, game situation data. When the time is measured in S308, the numerical value indicating the duration is increased in accordance with the time measurement.

  The control unit 21 determines whether the reference period has elapsed (S309). In S309, the determination is performed by comparing the continuation period updated in S308 with the reference period.

  When it is determined that the reference period has elapsed (S309; Y), the control unit 21 sets the moved flag to 0 (S310). Subsequent S311 to S315 are the same as S205 to S209. In other words, a process of displaying the trick name 42 indicating that the pause trick has been successful, increasing the numerical value indicated by the trick gauge 44 by a predetermined value, and incrementing the score magnification if the numerical value is the maximum value to return the numerical value to 0. Is executed.

  Returning to FIG. 19, the control unit 21 executes a ripple operation determination process (S107).

  FIG. 22 is a diagram illustrating a determination process of a ripple operation. As shown in FIG. 22, the control unit 21 determines whether or not the current time is within the guidance target period (S401). The guidance target period is a period during which the reference timing should be guided to the player, and is a period corresponding to the reference timing. The guidance target period is, for example, a predetermined period including a reference timing (a period from the first time before the reference timing to the second time), or from a predetermined time before the reference timing to the reference timing.

  If it is not determined that the current time is within the guidance target period (S401; N), the process proceeds to S108. In this case, since the reference timing is not approaching, the determination process of the ripple operation and the display control process of the reference image 34 and the guide image 36 are not performed.

  On the other hand, when it is determined that the current time is within the guidance target period (S401; N), the control unit 21 guides the reference image 34 and the guidance image 36 for guiding the reference timing and the reference position corresponding to the guidance target period. Display control processing is performed (S402). In S402, for example, the display position of the guide image 36 is determined so that the distance between the reference image 34 and the guide image 36 corresponds to the time difference between the current time and the reference timing.

  The control unit 21 determines whether or not the reference timing has come (S403). If it is not determined that the reference timing has come (S403; N), the process proceeds to S108. In this case, since the current time is before the reference timing, the determination process of the ripple operation is not performed.

  On the other hand, when it is determined that the reference timing has arrived (S403; Y), the control unit 21 determines whether or not there is a player's part in the determination region 82 including the reference position 80 associated with the reference timing. (S404). In S <b> 404, it is determined whether or not the three-dimensional coordinates of each part indicated by the latest player part information are within the determination area 82.

  When it is determined that there is a player's part in the determination area 82 (S404; Y), the control unit 21 executes a hit trick determination process (S405).

  FIG. 23 is a diagram illustrating hit trick determination processing. As shown in FIG. 23, the control unit 21 acquires the type of a part in the determination area 82 (S501). In S501, the player part information is referred to, and the part type associated with the three-dimensional coordinates in the determination area 82 is acquired.

  The control unit 21 determines whether or not the type of the part acquired in S501 is a reference part (S502). In S501, it is determined whether or not the reference portion associated with the reference timing and the reference position matches the type of the portion acquired in S501.

  When it is determined that the part in the determination region 82 is the reference part (S502; Y), the process proceeds to S406. In this case, since the player touches the reference position 80 at a part that is easy to touch, the hit trick has not been successful, and the trick gauge 44 does not change.

  On the other hand, when it is not determined that the part in the determination region 82 is the reference part (S502; N), the process proceeds to S503. S503 to S507 are the same as S205 to S209, respectively. That is, a process of displaying the trick name 42 indicating that the hit trick has been successful, increasing the numerical value indicated by the trick gauge 44 by a predetermined value, and if the numerical value is the maximum value, incrementing the score magnification and returning the numerical value to 0 Is executed.

  Returning to FIG. 22, the control unit 21 increases the score of the player based on the current score magnification (S406), and increments the number of combos (S407). In S406, the player's score is increased by a value obtained by multiplying the standard increase amount by the current score magnification.

  On the other hand, when it is not determined that there is a player's part in the determination area 82 (S404; N), the control unit 21 sets the trick gauge 44 to 0 (S408). The control unit 21 returns the score magnification to 1 (S409) and sets the number of combos to 0 (S410). The control unit 21 deletes the reference image 34 and the guide image 36 from the game screen 30 (S411).

  Returning to FIG. 19, the control unit 21 determines whether or not the reproduction of the music has ended (S108). If it is not determined that the music has been played back (S108; N), the process returns to S103. In this case, the latest player part information is acquired again, and various trick determination processes and ripple action determination processes are performed.

  When it is not determined that the reproduction of the music has ended (S108; Y), the control unit 21 displays a game result screen indicating the game result on the game screen 30 (S109), and the process ends.

  According to the game device 20 described above, when the player succeeds in various tricks, the multiplication factor of the score increase amount when the ripple action is successful can be increased. For example, when the player makes a successful hit trick, the player simply performs a ripple action using a difficult part compared to a game that aims to place the part at a predetermined position at a predetermined timing. Appreciate gameplay and give satisfaction.

  Further, the game apparatus 20 can evaluate that the player is playing the game while riding the rhythm of the music piece by performing the rhythm trick determination process.

  In addition, the game device 20 can evaluate that the player has moved a part quickly and has taken a given pose by performing a pose trick determination process.

  In addition, when the player makes various tricks, the player can be encouraged to perform various tricks by changing the amount of change in the score, and the satisfaction when the player makes various tricks is improved. be able to.

  Further, by determining the pose trick based on the position change of only the player's limbs, it is possible to determine the pose trick with a simpler process than when determining using the whole body part.

[7. Modified example]
The present invention is not limited to the embodiments and modifications described above, and can be appropriately changed without departing from the spirit of the present invention.

[7-1. Variations on hit tricks]
(1-1) For example, in the embodiment, a case has been described in which the ripple action is successful when even one player's part is in the determination area 82, but the player has a plurality of parts in the determination area 82. The ripple operation may be made successful when. In this case, the game play of the player may be evaluated according to the combination of the parts arranged in the determination area 82.

  The ripple motion determination unit 56 of the present modification determines whether or not two or more of the plurality of parts of the player are within the determination area 82 at the time corresponding to the reference timing. The ripple motion determination unit 56 determines whether or not two or more of the three-dimensional coordinates indicated by the player part information are included in the determination region 82.

  In addition, the part information acquisition unit 58 of the present modification acquires part information related to a combination of part types determined to be in the determination region 82. The part information acquisition unit 58 acquires a combination of types of parts of the player determined to be in the determination area 82 by acquiring a type of part associated with the three-dimensional coordinates included in the determination area 82. .

  In addition, the evaluation unit 70 of this modification evaluates the game play of the player based on the combination of the types of parts acquired by the part information acquisition unit 58. The evaluation unit 70 evaluates the game play of the player by determining whether or not the combination of the part types acquired by the part information acquisition unit 58 is a given combination.

  For example, the game data storage unit 52 may store data associating the conditions related to the combination of the parts with the evaluation contents for the player (for example, the increase amount of the trick gauge 44). In this case, the evaluation content associated with the condition satisfied by the combination of the types of the parts acquired by the part information acquiring unit 58 is given to the player.

  For example, a combination of a plurality of reference parts may be stored in the reference data. In this case, the evaluation unit 70 evaluates the game play of the player by determining whether or not the combination of the parts acquired by the part information acquisition unit 58 matches the combination of the plurality of reference parts. For example, when the combination of the parts acquired by the part information acquisition unit 58 matches the combination of a plurality of reference parts, the evaluation unit 70 gives the player a higher evaluation or a lower evaluation than the case where they do not match.

  According to this modified example, the player's evaluation changes according to the combination of the parts where the player has performed the ripple action. Therefore, the player's movement (dance) is more difficult than the case where the evaluation is performed using only one part. Can also be evaluated.

  (1-2) For example, in the embodiment, the case where the hit trick is successful when the reference position is touched at a part different from the reference part has been described. For example, the reference part associated with a certain reference position is In the case of the right hand, the reference position indicates that it is easy to touch with the right hand, so that when the ripple action is performed with the left hand or left foot that is relatively difficult to touch, it is determined that the hit trick has been successful. Also good.

  In this modification, the reference data includes the upper limb (a part beyond the shoulder; the whole arm is shown) or the lower limb (a part beyond the waist; the whole leg is shown) corresponding to the reference position on one side of the player. The included parts are associated. The upper limb or the lower limb on one side of the player corresponding to the reference position is an upper limb or a lower limb that is easy to touch the reference position. It is determined in advance based on the positional relationship with a fixed point. For example, any of the left hand P5, the right hand P6, the left foot P10, and the right foot P11 is set in advance as the reference portion.

  When the part acquired by the part information acquiring part 58 is a part included in the upper limb or the lower limb opposite to the part included in the upper limb or the lower limb corresponding to the reference position, A higher evaluation is given to the player than when the part is included in the upper limb or the lower limb of the one side. The “opposite side of the upper limb or lower limb on one side” is the left side if it is the upper limb or lower limb on the right side, and the right side if it is the left upper limb or lower limb.

  For example, when the upper limb or lower limb of the player corresponding to the reference position is the right hand P6 or the right foot P11, the reference position indicates that it is easy to touch with the right hand P6 or the right foot P11. High evaluation is given when a ripple motion is performed with the left hand P5 or the left foot P10. Similarly, when the upper limb or lower limb of the player corresponding to the reference position is the left hand P5 or the left foot P10, the reference position indicates that it is easy to touch with the left hand P5 or the left foot P10. High evaluation is given when a ripple operation is performed with a certain right hand P6 or right foot P11.

  According to this modification, it is possible to accurately evaluate the game play in which the player performs the ripple motion by twisting the body by detecting that the player performs the ripple motion with the opposite hand or foot. .

  (1-3) Also, for example, when the hit trick is successful, various effect processes related to the reference image 34 or the guide image 36 may be executed.

  The display control unit 72 of this modification includes means for displaying an image (for example, the reference image 34 or the guide image 36) that guides the player with the reference timing and the reference position on the display screen. The display control unit 72 includes means for changing the display mode of the image based on the evaluation result by the evaluation unit 70. “Changing the display mode of an image” means changing the size, shape, color, brightness, and pattern of an image and applying a given effect process to the image.

  The display control unit 72 includes means for determining a method for changing the display mode of the image based on the type of the part acquired by the part information acquisition unit 58. For example, the display control unit 72 changes the reference image 34 or the guide image 36 in the first mode when the hit trick is successful, and changes the reference image 34 or the guide image 36 when the hit trick is not successful. 36 is changed in the second mode.

  FIG. 24 is an example of the game screen 30 in the modified example (1-3). As shown in FIG. 24, when the hit trick is successful, the reference image 34 or the guide image 36 may be popped and disappear. For example, the game data storage unit 52 associates the type of the part with information indicating how to change the size, shape, color, brightness, and pattern of the image or information for identifying the effect processing to be performed on the image. It may be stored. In this case, the reference image 34 or the guide image 36 changes based on the information associated with the type of part acquired by the part information acquisition unit 58.

  According to this modification, the effect processing of an image can be varied according to the part where the player has performed a ripple operation.

[7-2. Variations on Rhythm Trick]
(2-1) For example, in the embodiment, the case where the rhythm trick is evaluated by referring only to the direction change timing of the part has been described, but whether or not the part is being shaken with a certain amplitude is determined. It may be a condition for a successful rhythm trick.

  In the game apparatus 20 of the present modified example, based on the position change of the part, whether or not the movement amount of the part between the one direction change timing and the next direction change timing (between the direction change timings) is greater than or equal to the reference amount. A moving amount determining means for determining whether or not. The means is realized by the game execution unit 54, for example. For example, the distance (in the case of a reciprocating motion) between the three-dimensional coordinates indicated by the player part information when a certain direction change timing is acquired and the three-dimensional coordinates indicated by the player part information when the direction change timing is acquired next. Is obtained as a movement amount. The reference amount may be a predetermined value, or may be determined based on the game situation or the size of the player's body.

  The evaluation unit 70 of the present modification evaluates the player's game play based on the determination result of the movement amount determination means and the comparison result of the timing comparison unit 64. For example, the evaluation unit 70 determines that the rhythm trick has been successful and gives a high evaluation to the player when the movement amount of the part is equal to or greater than the reference amount and the timing deviation is within a threshold value. Also good.

  According to this modification, it is determined that the rhythm trick has succeeded when the player shakes the body part to a certain extent, so that it is possible to request the player to make a large movement that makes a dynamic dance.

  (2-2) For example, if the tempo of music increases, the player may not be able to shake the part greatly. Therefore, the reference amount described in the modification (2-1) may be set according to the tempo of the music.

  The game apparatus 20 of this modification includes means for setting a reference amount based on the tempo of the music. The means is realized by the game execution unit 54, for example. The reference amount is set to be smaller as the tempo of the music is faster. For example, the condition relating to the tempo of the music and the reference amount may be associated with each other and stored in the game data storage unit 52. In this case, a reference amount associated with the above condition that the tempo of the music indicated by the music data is set is set.

  According to this modification, it is possible to more accurately determine the rhythm trick according to the tempo of the music.

  (2-3) In addition, for example, the case where the rhythm trick is successful even if the player shakes the body only once is explained. However, like an actual dancer, the player moves the body according to the music for a certain period of time. The rhythm trick may not be successful if it is not shaken. For example, it may be determined that the rhythm trick has been successful when the player has shaken his / her hips to the music for one beat or more.

  The game apparatus 20 of the present modification includes a limiting unit that limits the execution of the evaluation process by the evaluation unit 70. The means is realized by the game execution unit 54, for example. Here, “restricting the execution of the evaluation process” is to prevent the player from being given a high evaluation, for example, to prevent the player from determining that the rhythm trick has been successful.

  In addition, the game apparatus 20 includes means for determining whether or not a state in which the deviation between the direction change timing and the timing determined based on the beat of the music is equal to or less than a reference value has continued for a predetermined period. The means is realized by the game execution unit 54, for example. For example, in S204, timing is started when the deviation is equal to or less than the reference value, and it is determined whether or not the period during which the deviation is equal to or less than the reference value continues for a certain period or more. Further, for example, in S204, it may be determined whether or not the number of times that the deviation is continuously determined to be equal to or less than a reference value is equal to or greater than a certain number.

  Further, the game device 20 includes means for releasing the restriction by the restriction means when it is determined that the state where the deviation is equal to or less than the reference value has continued for a predetermined period. The means is realized by the game execution unit 54, for example. “The restriction on the execution of the evaluation process is released” means that a high evaluation is given to the player, for example, it is determined that the rhythm trick is successful.

  According to the present modification, it is possible to determine that the rhythm trick has been successful when the player shakes the body for a certain period of time in accordance with the rhythm of the music, so it is possible to request the player to perform a more advanced action.

  (2-4) Further, for example, when the rhythm trick is successful, an effect process may be executed such that the paint flies to a position such as the waist of the character 32.

  The game apparatus 20 of the present modification includes means for displaying on the display screen a player image obtained by continuously photographing the player with the photographing means, or a character 32 that performs an action corresponding to the player based on the position information. This means is realized by the display control unit 72. In addition, although the case where the character 32 was displayed was demonstrated in embodiment, you may make it display a player image by acquiring a picked-up image from the position detection apparatus 1. FIG.

  FIG. 25 is an example of the game screen 30 in the modified example (2-4). As shown in FIG. 25, when the rhythm trick is successful, a given image 48 is displayed around a portion of the character 32 where the player is performing a direction change action.

  The game apparatus 20 according to the present modification includes means for displaying a given image at a position corresponding to the part of the player image or the character 32 based on the comparison result of the timing comparison unit 64. This means is realized by the display control unit 72. For example, based on a time-series change in the player part information, a part where the player has changed the direction is acquired, and a given image is displayed at a position corresponding to the part.

  According to this modification, an effect can be generated on the game screen 30 when the player makes a successful rhythm trick.

  (2-5) For example, if the player does not succeed in the rhythm trick, the determination of the ripple action may not be performed. That is, if the player does not shake the body and get on the rhythm of the music, even if the player touches the reference position at the reference timing, the player's score may not increase.

  The game apparatus 20 of the present modification includes means for restricting the execution of the comparison process by the ripple action determination unit 56 or the execution of the evaluation process by the evaluation unit 70 based on the comparison result of the timing comparison unit 64. The means is realized by the game execution unit 54, for example. “Restricting the execution of the comparison process by the ripple operation determination unit 56” is to suppress the execution of the comparison process between the part and the reference position by the ripple operation determination unit 56.

  According to this modified example, if the player does not perform the rhythm trick, the increase in the score is limited, so that the player can be prompted to perform the rhythm trick.

[7-3. Variations on pause tricks]
(3-1) For example, when the pause trick is successful, a special effect process related to the character 32 may be executed to encourage the player to perform a pause trick.

  In the game device 20 of the present modified example, when a portion moved at a reference speed or higher is in a substantially stopped state (pause state) after movement, a contour image having a shape corresponding to the contour of the player image or the contour of the character 32 Is displayed at a position corresponding to the player image or the character 32. This means is realized by the display control unit 72.

  FIG. 26 is a diagram illustrating an example of the game screen 30 in the modified example (3-1). As shown in FIG. 26, the contour image 49 is generated by extracting the contour of the character 32. That is, an image generated based on an image obtained by cutting out the outline portion of the character 32 is the outline image 49. Here, a line having a given thickness indicating the outline of the character 32 is the outline image 49.

The “position corresponding to the player image or character 32” is a display position determined based on the display position of the player image or the display position of the character 32, and the position where the contour image 49 is displayed so as to surround the player image or character. In addition, this is a position where the contour image 49 is displayed so as to be surrounded by the contour of the player image or the contour of the character.

  The game apparatus 20 according to the present modification includes contour image 49 control means for gradually changing the size of the contour image 49 according to the duration of the pause state. This means is realized by the display control unit 72. “The size of the contour image 49 changes gradually” means that the difference between the size of the contour image 49 and the contour of the player image or the contour of the character corresponds to the duration of the pause state. It is to change to become the size of.

  FIG. 27 is a diagram for explaining a method of changing the size of the contour image 49. As shown in FIG. 27, when the player is in a paused state, a contour image 49 is generated so as to be superimposed on or adjacent to the contour of the character 32 and gradually increases. Here, the contour image control means includes first means for gradually changing the size of the contour image 49 in accordance with the duration of the pause state when the duration of the pause state has not reached the reference period. Become. In this case, the enlargement speed or reduction speed of the contour image 49 may be determined in advance, or may vary depending on the game situation.

  As shown in FIG. 27, when the pause trick is successful, the contour image 49 is rapidly enlarged and erased from the screen. Here, the contour image control means, when the duration of the pause state reaches the reference period, the contour image at a faster speed (meaning that the enlargement rate or reduction rate per unit time is higher) than the first means. After changing the size of 49, the second means for deleting the contour image 49 from the display screen is included.

  According to this modification, it is possible to guide the player whether or not the pose trick has been successful by changing the size of the contour image 49.

  (3-2) Further, for example, another effect process may be performed to inform the player that the pause trick has been successful.

  FIG. 28 is a diagram for explaining a method of changing the contour image 49 in the modified example (3-2). As shown in FIG. 28, when the player is in a pose state, a contour image 49 larger than the character 32 is displayed, the difference between the period during which the pose state continues and the reference period, and the size of the contour image 49 The size of the contour image 49 may be changed so that the difference between the character 32 and the character 32 corresponds. Here, the contour image control means controls the contour image 49 from the player image or the character 32 so that the contour image 49 and the contour of the player image or the contour of the character 32 substantially coincide when the duration of the pause state becomes the reference period. The large contour image 49 is gradually reduced according to the duration of the state.

  Further, when the player is in a paused state, a contour image 49 smaller than the character 32 is displayed, the difference between the period during which the paused state continues and the reference period, the size of the contour image 49 and the size of the character 32 are displayed. The size of the contour image 49 may be changed so as to correspond to the difference. Here, the contour image control means is smaller than the player image or character so that the contour image 49 and the contour of the player image or the contour of the character 32 substantially coincide when the duration of the pause state becomes the reference period. The contour image 49 is gradually enlarged according to the duration of the state.

  According to this modified example, when the size of the contour image 49 matches the size of the character 32, the player can be informed that the pose trick has been successful.

  (3-3) Further, for example, when the state in which the player is in a pose cannot be continued for the reference period, the contour image 49 may be deleted halfway.

  In the game device 20 of the present modified example, after the part that has moved at the reference speed or higher becomes in a state of being substantially stopped after the movement, the state does not continue without the duration of the state reaching the reference period. And a means for restricting the execution of the display control processing of the contour image 49 by the contour image control means and for deleting the contour image 49 from the display screen. This means is realized by the display control unit 72. “Restrict the execution of the display control process” indicates that the display of the contour image 49 is suppressed.

  According to this modification, the player can be informed that the pause trick has not been successful.

  (3-4) Further, for example, the ripple operation may not be determined unless the pause trick is successful.

  When it is not determined that the state in which the portion that has moved at the reference speed or higher has been substantially stopped after the movement has continued for the reference period or longer, the game device 20 according to the present modification performs the comparison process by the ripple motion determination unit 56 or the evaluation unit 70. Means for restricting the execution of the evaluation process. This means is realized by the game execution unit 54.

  According to this modification, since the increase in score is limited unless the player performs a pause trick, the player can be prompted to perform a pause trick.

  (3-5) Further, for example, the pose trick success condition may be that the limb substantially stops before the player's limb moves at a reference speed or higher.

  The game apparatus 20 of the present modification further includes means for determining whether or not at least one of the plurality of parts is substantially stopped based on the position information. This means is realized by the game execution unit 54. The determination method is the same as the determination method by the stop determination unit 68.

  After determining that at least one of the plurality of parts is substantially stopped, the movement determination unit 66 of the present modification determines whether the substantially stopped part has moved at a reference speed or higher. .

  According to the present modification, it is possible to accurately evaluate the motion of posing a stationary part suddenly.

  (3-6) Also, for example, since the moving speed of the part for posing varies according to the speed of the tempo of the music, the reference speed may be changed according to the tempo of the music.

  The game apparatus 20 of this modification further includes means for setting a reference speed based on the tempo of the music. This means is realized by the game execution unit 54. The reference speed is set to increase as the tempo of the music increases. For example, the condition relating to the tempo of the music and the reference speed may be associated with each other and stored in the game data storage unit 52. In this case, a reference speed associated with the above condition that satisfies the tempo of the music indicated by the music data is set.

  According to this modification, it is possible to evaluate whether or not a pause is made at a speed that matches the tempo of the music.

  (3-7) Also, for example, the time during which the pause state should be maintained may be varied according to the tempo of the music.

  The game apparatus 20 of the present modification further includes means for setting the length of the reference period based on the tempo of the music. This means is realized by the game execution unit 54. The reference period is set to be shorter as the music tempo is faster. For example, the condition relating to the tempo of the music and the length of the reference period may be associated with each other and stored in the game data storage unit 52. In this case, a reference period having a length associated with the above condition that satisfies the tempo of the music indicated by the music data is set.

  According to this modification, it is possible to evaluate whether or not a pause is made only for a period that matches the tempo of the music.

[7-4. Other variations]
(4) Further, for example, in the embodiment, the case where various determination processes are performed based on the information indicating the position of each part of the player in the real space has been described, but the information on the part of the player is used. In addition, for example, the position of the part of the player in the display screen or the virtual space may be used.

  In this case, the position information acquisition unit 50 includes position information related to positions in the display screen or virtual space corresponding to positions in the real space of a plurality of parts (hereinafter simply referred to as positions of parts in the display screen or virtual space). get. The “position in the display screen corresponding to the position of the plurality of parts in the real space” is the position of each part of the player shown in the captured image. For example, the two-dimensional coordinates of the part specified by pattern matching That is. The “position in the virtual space corresponding to the position of the plurality of parts in the real space” is a position in the virtual space set based on the player part information. For example, each of the characters 32 arranged in the virtual space The position of the part.

  In this modification, for example, the reference position is a position set in the display screen or the virtual space, and the determination area is also set in the display screen or the virtual space. The ripple operation determination unit 56 determines whether or not the position of the part in the display screen or the virtual space is within the determination region including the reference position set in the display screen or the virtual space.

  In addition, the motion determination unit 60 determines whether or not the player has performed a direction changing operation based on a change in position of a part in the display screen or the virtual space. The movement determination unit 66 and the stop determination unit 68 perform the determination based on the position of the part in the display screen or the virtual space.

  (5) Further, for example, in the embodiment, the case where the determination of the ripple motion is performed based on whether or not the player places the part at the reference position at the reference timing has been described. You may make it evaluate the shift | offset | difference of the set timing and reference | standard timing.

  The ripple operation determination unit 56 of the modification (5) is a unit that determines whether at least one of the plurality of parts in the period corresponding to the reference timing is within the determination region 82 including the reference position. And means for determining whether or not a difference between a timing at which at least one of the plurality of parts is disposed in the determination region 82 and a reference timing is equal to or less than a predetermined value.

  For example, the evaluation unit 70 evaluates the player's game play based on the deviation. For example, the player is given higher evaluation as the deviation becomes smaller.

  When it is determined that the deviation between the timing at which at least one of the plurality of parts is arranged in the determination region 82 and the reference timing is equal to or less than a predetermined value, the part information acquisition unit 58 of the modification (5) The site information related to the type of the site is acquired. Again, the type of the part is acquired by referring to the player part information.

  According to the modified example (5), the player's game play can be evaluated based on the difference between the timing at which the player places the part in the determination area 82 and the reference timing.

  (6) For example, the various numerical values shown in the embodiment and the modification may be larger or smaller than the numerical values shown above. These numerical values may be values specified in advance or values calculated based on a given mathematical expression.

  Moreover, although the case where the information which shows the timing of the beat of a music was contained in music data was demonstrated, the said information does not need to be contained in music data. The timing at which the beat of the music is engraved may be acquired based on information indicating the tempo of the music. Also, the music may not necessarily be output.

  Moreover, the data storage example of reference | standard data is not restricted to the example of embodiment. The reference data and the reference position only need to be associated with the reference data. In addition, for example, information for identifying the part and a score to be given to the player may be associated with the reference timing and the reference position. In this case, a score associated with the part where the player has performed the ripple action is given.

  Further, for example, a case has been described in which it is determined that the rhythm trick is successful when the player reciprocates at a given rhythm, but the rhythm trick determination process is executed based on the direction change motion by the player. do it. In addition, for example, the rhythm trick determination process may be performed based on the direction change timing when the player moves the limb to a triangle or a rectangle.

  Further, for example, in the above description, the example in which the position detection device 1 includes the means for generating the position information based on the captured image and the depth information (depth image) has been described. It may be included in the device 20. For example, the game device 20 may receive a captured image and a depth image from the position detection device 1 and generate position information based on them. Further, for example, the position detection device 1 may be integrated with the game device 20, and the position detection device 1 may be included in the game device 20.

  Moreover, although the case where a hit trick, a rhythm trick, and a pause trick are performed in the game apparatus 20 has been described, any one or two of these may be performed. Further, for example, when the hit trick is not performed, the ripple operation determination process may not be performed. That is, the present invention may be applied to a game that evaluates only the success or failure of a rhythm trick or the success or failure of a pose trick.

  For example, when only the hit trick determination is performed, the motion determination unit 60, the direction change timing acquisition unit 62, the timing comparison unit 64, the movement determination unit 66, and the stop determination unit 68 are included in the game device 20. It does not have to be. When only the rhythm trick determination is performed, the ripple motion determination unit 56, the part information acquisition unit 58, the movement determination unit 66, and the stop determination unit 68 may not be included in the game device 20. When only the pose trick determination is performed, the ripple motion determination unit 56, the part information acquisition unit 58, the motion determination unit 60, the direction change timing acquisition unit 62, and the timing comparison unit 64 are included in the game device 20. It does not have to be.

  Moreover, you may combine any 2 or more of the said embodiment and modification.

  Further, in the embodiment, the case where the determination of the ripple action, the hit trick, the rhythm trick, and the pose trick is performed based on a specific part such as a hand or a foot among the parts of the player has been described. These determinations may be made by using. In addition, for example, the position of a part such as a wrist, arm, elbow, ankle, shin, knee, or thigh may be detected, and a ripple operation or various tricks may be determined based on these parts. .

  DESCRIPTION OF SYMBOLS 1 Position detection apparatus, 2 CCD camera, 3 Infrared sensor, 4 Microphone, 10 Control part, 11 Memory | storage part, 12 Imaging | photography part, 13 Depth measurement part, 14 Voice input part, 15 Communication interface part, 16, 29 Bus | bath, 20 game Device, 21 control unit, 22 main storage unit, 23 auxiliary storage unit, 24 optical disc playback unit, 25 communication interface unit, 26 operation unit, 27 display unit, 28 audio output unit, 30 game screen, 32 character, 34 reference image, 36 guide images, 38 scores, 40 combo numbers, 42 trick names, 44 trick gauges, 46 magnifications, 48 images, 49 contour images, 50 position information acquisition unit, 52 game data storage unit, 54 game execution unit, 56 ripple motion determination Part, 58 part information acquisition part, 60 motion determination part, 62 direction change timing Acquisition unit, 64 timing comparison unit, 66 movement determination unit, 68 stop determination unit, 70 evaluation unit, 72 display control unit, 80 reference position, 82 determination area, 84 representative position, 100 players.

Claims (17)

A game device for executing a game in which a player moves a part in accordance with music,
Position information acquisition means for acquiring position information regarding the positions of the plurality of parts of the player;
A movement determining means for determining whether at least one of the plurality of parts has moved at a reference speed or higher based on the position information;
If it is determined that at least one of the plurality of parts has moved at the reference speed or higher, whether the part moved at the reference speed or higher has substantially stopped after the movement continues for a reference period, Stop determination means for determining based on the position information;
Evaluation means for evaluating the game play of the player based on the determination result of the stop determination means;
A game apparatus comprising: The game device includes:
Means for displaying on the display screen a player image obtained by continuously photographing the player with photographing means, or a character that moves corresponding to the player based on the position information;
When a portion moved at the reference speed or higher is in a substantially stopped state after movement, a contour image having a shape corresponding to the contour of the player image or the contour of the character corresponds to the player image or the character. Means for displaying the position;
Contour image control means for gradually changing the size of the contour image according to the duration of the state;
The game apparatus according to claim 1, further comprising: The contour image control means includes
First means for gradually changing the size of the contour image according to the duration of the state when the duration of the state does not reach the reference period;
A second means for deleting the contour image from the display screen after changing the size of the contour image at a faster speed than the first means when the duration of the state reaches the reference period;
The game apparatus according to claim 2, further comprising: The contour image control means includes
The contour image larger than the player image or the character so that the contour image and the contour of the player image or the contour of the character substantially coincide when the duration of the state becomes the reference period, Means for gradually decreasing according to the duration of the state;
The contour image smaller than the player image or the character so that the contour image and the contour of the player image or the contour of the character substantially coincide when the duration of the state becomes the reference period, Means for gradually increasing the duration of the state;
The game device according to claim 2, comprising at least one of the following. The game device includes:
After the part that has moved above the reference speed is in a substantially stopped state after the movement, if the state does not continue without reaching the reference period, the contour image control means Means for restricting execution of the display control process of the contour image, and erasing the contour image from the display screen;
The game device according to claim 2, further comprising: The game is a game in which the player aims to place a part at a given position at a given timing according to the music,
The game device includes:
Means for acquiring reference data from means for storing reference data in which a reference timing and a reference position are associated;
Comparison means for comparing at least one position of the plurality of parts at a time corresponding to the reference timing with the reference position;
Including
The movement determination means includes
Whether or not at least one of the plurality of parts has moved at a reference speed or more between one reference timing and the next reference timing is determined based on the position information,
The stop determination means includes
Between the one reference timing and the next reference timing, determine whether or not the portion that has moved at the reference speed or more has stopped substantially after the movement has continued for the reference period;
The evaluation means includes
Evaluating the game play of the player based on the comparison result of the comparison means and the determination result of the stop determination means;
The game device according to claim 1, wherein the game device is a game device. The evaluation means includes
Means for changing the score of the player based on a comparison result of the comparison means;
Means for determining the amount of change in the score of the player based on the determination result of the stop determination means;
And evaluating the game play of the player by changing the score of the player by the determined amount of change.
The game device according to claim 6. The game device includes:
Means for restricting execution of comparison processing by the comparison means or execution of evaluation processing by the evaluation means when it is not determined that the state where the portion moved at the reference speed or more has substantially stopped after the movement has continued for the reference period or longer ,
The game device according to claim 6, further comprising: The position information acquisition means acquires position information related to a position of at least one hand and at least one foot of the player;
The movement determination means includes
It is determined based on the position information whether at least one hand and at least one foot of the player have moved at a reference speed or higher,
The stop determination means includes
If it is determined that at least one hand and at least one foot of the player have moved at or above the reference speed, whether or not the state in which the limb has stopped substantially after the movement has continued for a reference period has been determined. Based on
The game device according to claim 1, wherein the game device is a game device. The game device includes:
Means for determining whether or not at least one of the plurality of parts is substantially stopped based on the position information;
The movement determination means includes
After determining that at least one of the plurality of parts is substantially stopped, it is determined whether or not the substantially stopped part has moved at the reference speed or more,
The game device according to claim 1, wherein the game device is a game device. The game device includes:
Means for setting the reference speed based on the tempo of the music;
The game apparatus according to claim 1, further comprising: The game device includes:
Means for setting the length of the reference period based on the tempo of the music;
The game apparatus according to claim 1, further comprising: The stop determination means includes
It is determined whether or not the part that has moved at the reference speed or higher is within a range determined based on the position of the part after the movement, so that the part is substantially stopped. Determining whether or not the state where the part is within the range continues for a reference period,
The game device according to claim 1, wherein the game device is a game device. The stop determination means includes
Means for determining whether or not the part has substantially stopped by determining whether or not the part moved at the reference speed or more is decelerated after the movement and the moving speed is substantially zero; It is determined whether or not the state where the moving speed of the part is substantially zero has continued for a reference period,
The game device according to claim 1, wherein the game device is a game device. The position information acquisition means acquires position information related to positions in the real space of the plurality of parts of the player,
The movement determination means includes
Determining whether or not the player has moved at least one of the plurality of parts at a reference speed or more based on positions of the plurality of parts in the real space;
The stop determination means includes
If at least one of the plurality of sites have been determined to have moved in the reference speed or higher, whether the state in which the site was moved at the reference speed or higher is substantially stopped after the movement has continued reference period MaTsugi Is determined based on the position in the real space of the part moved at the reference speed or higher,
The game device according to claim 1, wherein the game device is a game device. The position information acquisition means acquires position information related to positions in the display screen or virtual space corresponding to positions in the real space of the plurality of parts of the player,
The movement determination means includes
Whether or not the player has moved at least one of the plurality of parts at a reference speed or higher is determined based on the display screen corresponding to the position of the plurality of parts in the real space or the position in the virtual space. Judgment,
The stop determination means includes
If at least one of the plurality of sites have been determined to have moved in the reference speed or higher, whether the state in which the site was moved at the reference speed or higher is substantially stopped after the movement has continued reference period MaTsugi Is determined based on the position in the display screen or virtual space corresponding to the position in the real space of the part moved at the reference speed or higher,
The game device according to claim 1, wherein the game device is a game device. The program for functioning a computer as a game device in any one of Claims 1-16.

Images