JP5466089B2 - Game device and program - Google Patents

Description

  The present invention relates to a game apparatus and game suitable for presenting to a player in an easy-to-understand manner the timing at which a gesture such as waving or stepping a hand or arm should be executed, the timing to start, or the timing to end. The present invention relates to a control method and a program for realizing these by a computer.

  Conventionally, there has been proposed a technique of a rhythm game that presents to a player which gesture should be stepped on at any timing on the front, back, left and right of the platform.

  For example, the technique disclosed in Patent Document 1 is as follows. That is, four lanes extending in the vertical direction are provided in the screen. Each lane is associated with each of the front, back, left and right of the platform. In each lane, arrow-shaped figures associated with the front, back, left and right of the platform are displayed. Marks in the lane move from bottom to top in the screen. When the player makes a gesture of stepping on the position associated with the mark at the moment when the mark reaches the reference position, a score is obtained.

  In such a rhythm game, not only a stepping gesture but also a gesture for waving an arm or a hand has been proposed for scoring. In such a rhythm game, it has been required to take the gesture at a predetermined timing.

Japanese Patent No. 3003851

  However, there are some gestures that should be performed over time. For example, it is a gesture such as moving the right hand to the left and then extending to the right while passing through the bottom.

  Therefore, there is a need to distinguish the start timing and end timing of time-consuming gestures, the execution timing of gestures that can be executed instantaneously, and the types of these gestures on the screen and present them to the player in an easy-to-understand manner. Is strong.

  On the other hand, with regard to gestures that take time, there is a desire to encourage the player to become proficient by presenting to the player what the current player's gesture is.

  The present invention solves the above-described problems so that it is easy for the player to understand the timing at which a gesture such as waving or stepping a hand or arm should be executed, the timing to start, or the timing to end. It is an object of the present invention to provide a game device, a game control method, and a program for realizing these on a computer.

  In order to achieve the above object, the following invention is disclosed in accordance with the principle of the present invention.

  A game device according to a first aspect of the present invention includes a detection unit, a display unit, and a determination unit, and is configured as follows.

  That is, the detection unit detects left and right hand gestures by the player and left, rear, front, and right stepping gestures by the player.

  Typically, left and right hand gestures are detected by an acceleration sensor in the controller that the player holds with each hand, and front, back, left, and right foot gestures are sensed on a mat or step on the floor. It is detected by a pressure sensor or switch. In addition to this, it is also possible to adopt a technique of photographing the player's appearance with a camera and detecting a gesture by image recognition.

  On the other hand, the display unit displays the foot type graphic, the hand type graphic, and the timing graphic on the screen.

  Here, the type graphic for step indicates the type of stepping gesture to be taken by the player and the execution timing at which the stepping gesture should be executed.

  For example, the front / rear / left / right stepping gestures can be indicated by type figures in the form of front / rear / left / right arrows.

  Further, the execution timing of the stepping gesture is presented by a method similar to that of the conventional rhythm game, as will be described later.

  Further, the hand type graphic indicates the type of gesture to be performed by the player.

  For example, the type of gesture of hand gesture is indicated by a circular figure with a pattern drawn inside. This pattern is drawn, for example, in the shape of a bent arrow, and the shape of the hand movement can be represented by the shape.

  On the other hand, the timing diagram indicates a start timing at which a gesture of hand gesture should be started.

  The start timing of the hand gesture is indicated by a substantially rectangular timing diagram. The timing graphic and the gesture gesture type graphic for the start timing are typically displayed in the vicinity as described later.

Furthermore, the determination unit determines whether or not the gesture by the player is successful.
(A) whether or not the type of gesture gesture detected is the type displayed on the screen, and the time difference between the timing when the detected gesture gesture is started and the start timing displayed on the screen; ,
(B) Whether or not the type of the detected stepping gesture is the type displayed on the screen, and the time difference between the timing at which the detected stepping gesture is executed and the execution timing displayed on the screen ,
Based on the determination.

  That is, when the type of gesture detected matches the type of gesture indicated by the type graphic displayed on the screen, the type of gesture by the player is correct.

  Also, in the case of hand gestures, if the time difference between the timing when the player actually starts the hand gesture and the start timing indicated by the timing graphic displayed on the screen is small, the player's timing is appropriate. Would be inappropriate.

  Furthermore, in the case of a stepping gesture, if the time difference between the timing when the player actually executes the stepping gesture and the execution timing indicated by the stepping type graphic displayed on the screen is small, the player's timing is appropriate. If it is large, it is inappropriate.

  As described above, in this game, whether or not the gesture is successful is determined according to the type and timing of the gesture actually performed by the player, and the player is given a score.

  Here, the predetermined direction in the screen is the vertical direction, and in the screen, four rows of lanes are set parallel to the predetermined direction, and the foot type figure indicating the left stepping gesture is four rows. The left-hand lane of the left lane, and the foot type figure indicating the subsequent treading gesture move the lane next to either the left-most or right-most lane of the four lanes, The type graphic for foot indicating the previous stepping gesture moves to the lane adjacent to the left or rightmost lane of the four lanes, and the type graphic for foot indicating the right stepping gesture is Move the rightmost lane among the four lanes.

  For example, when the same form as that disclosed in Patent Document 1 is adopted, the front, rear, left, and right arrows move from the bottom of the screen to the top in accordance with the type of each arrow. In this embodiment, a left arrow, a rear arrow, a front arrow, and a right arrow are assigned to each lane in order from the left to the right lane.

  However, the direction in which the foot-type graphic composed of arrows moves in the lane may be from top to bottom, and the lanes in which the front and rear arrows move may be exchanged.

  The timing diagram indicating the player's left hand gesture moves to the leftmost and adjacent lanes of the four lanes, and the timing diagram indicating the player's right hand gesture is the four lanes. Move to the right and the next lane.

  That is, the horizontal width of the timing graphic representing the gesture of hand gesture is two lanes, which is much larger than the type graphic for foot of the arrow representing the gesture of stepping.

  The left-hand timing diagram moves in the left two lanes, and the right-hand timing diagram moves in the right two lanes.

  Due to such display differences, the player recognizes and recognizes the stepping gesture and the hand gesture.

  Further, the type graphic for the foot for the stepping gesture moves in a predetermined direction on the screen before the execution timing, reaches the execution reference line set in the screen at the execution timing, and in the predetermined direction of the timing graphic. The front end moves in a predetermined direction on the screen before the start timing, and reaches the front reference line set in the screen at the start timing.

  As in the above example, when a rectangle is adopted as the timing graphic and moves from the bottom to the top, the front end of the timing graphic corresponds to the upper side of the rectangle.

  The moment when the stepping-type figure for the foot reaches the execution reference line in the screen is the execution timing at which the stepping gesture should be executed, and the moment when the timing figure for the hand movement reaches the front reference line in the screen This is the start timing for starting the gesture of the hand gesture. In this way, the player recognizes the timing related to the gesture by moving the foot type graphic and the timing graphic within the screen.

  Furthermore, the hand-type graphic for the gesture of hand gesture is displayed at a position shifted from the front end of the timing graphic by a displacement determined based on the size and direction of the detected gesture.

  In the above example, the circular hand type figure for the right hand gesture is placed so as to overlap the timing figure for the gesture, and the circular hand type figure for the left hand gesture is Typically, it is arranged so as to overlap the inside of the timing diagram.

  If the hand type figure is shifted and displayed with respect to the timing figure by the displacement corresponding to the detected size and direction of the gesture, the user can see how his / her gesture is recognized by the game device. It is also possible to grasp.

  According to the present invention, the player can easily recognize and recognize the types of gestures of hand gestures and stepping by the type of foot figure, the type of hand figure, and the timing figure displayed on the screen or start these gestures. It becomes possible to easily grasp the timing and execution timing.

  A game device according to a second aspect of the present invention is a generalization of the above invention, and includes a detection unit, a display unit, and a determination unit, and is configured as follows.

  That is, the detection unit detects a gesture by the player.

  On the other hand, the display unit displays on the screen a type graphic indicating the type of gesture to be taken by the player and a timing graphic indicating the start timing at which the gesture should be started.

  Further, the determination unit determines whether or not the type of the detected gesture is the type displayed on the screen and the time difference between the timing at which the detected gesture is started and the start timing displayed on the screen. Then, it is determined whether or not the gesture by the player is successful.

  The front end of the timing graphic in a predetermined direction moves in the screen in a predetermined direction before the start timing, and reaches the front reference line set in the screen at the start timing.

  On the other hand, the type graphic is displayed at a position shifted from the front end of the timing graphic by a displacement determined based on the size and direction of the detected gesture.

  According to the present invention, the game apparatus detects how the player's gesture is detected by shifting the type figure with respect to the timing figure by a displacement corresponding to the size and direction detected for the gesture. , Will be able to present properly to the player.

  The game device of the present invention can be configured as follows.

  That is, the timing graphic further indicates the end timing at which the gesture should be ended.

  In this aspect, the start timing and end timing of the gesture are presented to the player by a timing diagram.

  Then, the rear end in the predetermined direction of the timing graphic moves in the predetermined direction on the screen before the end timing, and reaches the rear reference line set in the screen at the end timing.

  The time when the front end reaches the front reference line in the screen is the start timing, and the time when the rear end reaches the rear reference line in the screen is the end timing.

  On the other hand, the determination unit displays on the screen the detected gesture type displayed on the screen and the timing when the detected gesture starts and the timing when the detected gesture ends. If it is included between the start timing and the end timing, it is determined that the gesture by the player is successful.

  In the present invention, if a gesture that takes time is taken from the start timing to the end timing, it is determined that the player's gesture is successful.

  According to the present invention, the start timing and end timing of a period in which a time-consuming gesture should be taken can be presented to the player in an easy-to-understand manner.

  In the game device of the present invention, the front end moves at a predetermined speed on the screen before the start timing, stays at the front reference line from the start timing to the end timing, and the rear end before the end timing. , It can be configured to move within the screen at a predetermined speed.

  Since the front end and the rear end move within the screen at a predetermined speed, the entire timing diagram moves at that speed. From the start timing to the end timing, the front end does not move and the rear end moves, so that the timing diagram is deformed so that the length becomes shorter at a predetermined speed.

  According to the present invention, by presenting to the player whether or not the timing graphic is deformed, the player can easily recognize whether or not it is a time period for taking a time-consuming gesture. Become.

  In the game device of the present invention, the display of the timing graphic on the screen can be configured to start before a predetermined grace time from the start timing.

  Also in the invention disclosed in Patent Document 1, a graphic representing a stepping gesture is displayed on the screen from some time before the stepping timing. Similarly, in the present invention, the timing diagram is displayed on the screen in advance.

  According to the present invention, since a gesture to be taken by the player in the future is announced in the screen, the player can easily grasp the gesture to be taken by the player.

  In the game device of the present invention, the detection unit detects the acceleration of the gesture by the player, and a virtual elastic force that attempts to return the displacement to a predetermined value, and a virtual frictional force that is proportional to the change in the displacement. The displacement can be determined by a physical simulation in which a virtual external force based on acceleration acts.

  According to the present invention, when a gesture of hand gesture is recognized by an inexpensive acceleration sensor, the current state of the gesture of the player is presented by the displacement of the type figure with respect to the timing figure.

  In the present invention, the measurement result of the acceleration sensor is not displayed on the screen as it is, but the displacement is obtained by simulating the situation where the elastic force, the viscous frictional force, and the external force by the spring act on the mass point. Here, the measurement result of the acceleration sensor is adopted as the external force.

  According to the present invention, the state of the gesture detected by the game device can be presented to the player in an easy-to-understand manner, and the player can naturally determine what gesture should be determined as successful. You will be able to learn.

  In the game device of the present invention, the displacement can be configured to be constant regardless of the size and direction of the detected gesture.

  The present invention corresponds to the simplest form in which the relative positional relationship between the front end of the timing graphic and the type graphic does not change, and the timing graphic and the type graphic are integrated into a single gesture gesture. It is also possible to think that it is a figure.

  In the present invention, by simplifying the screen display, even a novice player can easily grasp a gesture to be taken.

  A game control method according to another aspect of the present invention is executed by a game device having a detection unit, a display unit, and a determination unit, and includes a detection step, a display step, and a determination step, and is configured as follows.

  That is, in the detection step, the detection unit detects a gesture by the player.

  On the other hand, in the display step, the display unit displays a type graphic indicating the type of gesture to be taken by the player and a timing graphic indicating the start timing at which the gesture should be started on the screen.

  Further, in the determination step, the determination unit determines whether or not the type of the detected gesture is the type displayed on the screen, and the timing at which the detected gesture is started and the start timing displayed on the screen. Based on the time difference, it is determined whether or not the gesture by the player is successful.

  The front end of the timing graphic in a predetermined direction moves in the screen in a predetermined direction before the start timing, and reaches the front reference line set in the screen at the start timing.

  On the other hand, the type graphic is displayed at a position shifted from the front end of the timing graphic by a displacement determined based on the size and direction of the detected gesture.

  A program according to another aspect of the present invention is configured to cause a computer to function as a detection unit, a display unit, and a determination unit as follows.

  That is, the detection unit detects a gesture by the player.

  On the other hand, the display unit displays on the screen a type graphic indicating the type of gesture to be taken by the player and a timing graphic indicating the start timing at which the gesture should be started.

  Further, the determination unit determines whether or not the type of the detected gesture is the type displayed on the screen and the time difference between the timing at which the detected gesture is started and the start timing displayed on the screen. Then, it is determined whether or not the gesture by the player is successful.

  The front end of the timing graphic in a predetermined direction moves in the screen in a predetermined direction before the start timing, and reaches the front reference line set in the screen at the start timing.

  On the other hand, the type graphic is displayed at a position shifted from the front end of the timing graphic by a displacement determined based on the size and direction of the detected gesture.

  The program of the present invention can be recorded on a computer-readable information storage medium such as a compact disk, flexible disk, hard disk, magneto-optical disk, digital video disk, magnetic tape, and semiconductor memory.

  The above program can be distributed and sold via a computer communication network independently of the computer on which the program is executed. The information storage medium can be distributed and sold independently from the computer.

  According to the present invention, a game device suitable for presenting a timing for executing a gesture such as waving and stepping a hand or arm, a timing for starting, and a timing for ending so that the player can easily understand the timing. Further, it is possible to provide a game control method and a program that realizes these on a computer.

It is a schematic diagram which shows schematic structure of a typical information processing apparatus. It is a schematic diagram which shows the external appearance of the information processing apparatus which concerns on this embodiment. It is a mimetic diagram showing the outline composition of the game device concerning this embodiment. It is explanatory drawing which shows the example of a display as which the figure which instruct | indicates a task to a player was displayed on the screen of a monitor. It is explanatory drawing which shows a mode that the combination of a timing figure and a hand type figure moves with progress of time. It is explanatory drawing which shows a mode that the combination of a timing figure and a hand type figure moves with progress of time. It is explanatory drawing which shows a mode that the combination of a timing figure and a hand type figure moves with progress of time. It is explanatory drawing which shows a mode that the combination of a timing figure and a hand type figure moves with progress of time. It is explanatory drawing which shows a mode that the combination of a timing figure and a hand type figure moves with progress of time. It is explanatory drawing which shows a mode that the combination of a timing figure and a hand type figure moves with progress of time. It is explanatory drawing which shows a mode that the combination of a timing figure and a hand type figure moves with progress of time. It is a flowchart which shows the flow of control of the game control process which concerns on this embodiment. (A) is a graph showing the relationship between the position of the front end and the rear end of the timing diagram and time, and (b) is a graph showing the relationship between the position of the left end and the right end of the timing diagram and time. (A) is explanatory drawing which shows the mode of a hand module, (b) is explanatory drawing which shows the reference | standard position and displacement relationship of a hand type figure. It is explanatory drawing explaining a mode that the displacement of the manual type figure with respect to the reference position fixed to the timing figure changes, this figure (a) shows the positional relationship in the time corresponding to FIG. 4, and this figure (b) ) Shows the positional relationship at the time point corresponding to FIG. 5, FIG. 10C shows the positional relationship at the time point corresponding to FIG. 6, and FIG. 9D shows the positional relationship at the time point corresponding to FIG. (E) shows the positional relationship at the time point corresponding to FIG. 8, (f) shows the positional relationship at the time point corresponding to FIG. 9, and (g) in FIG. FIG. 11H shows the positional relationship at the time point corresponding to FIG. 11.

  Embodiments of the present invention will be described below. In the following, for ease of understanding, an embodiment in which the present invention is realized using a game information processing device will be described. However, the embodiment described below is for explanation, and the present invention is described. It does not limit the range. Therefore, those skilled in the art can employ embodiments in which each or all of these elements are replaced with equivalent ones, and these embodiments are also included in the scope of the present invention.

(Information processing device)
FIG. 1 is a schematic diagram showing a schematic configuration of a typical information processing apparatus that performs functions of a game apparatus according to an embodiment of the present invention by executing a program. Hereinafter, a description will be given with reference to FIG.

  The information processing apparatus 100 includes a CPU (Central Processing Unit) 101, a ROM 102, a RAM (Random Access Memory) 103, an interface 104, a controller 105, an external memory 106, an image processing unit 107, and a DVD-ROM. (Digital Versatile Disc ROM) drive 108, NIC (Network Interface Card) 109, audio processing unit 110, and microphone 111.

  When a DVD-ROM storing a game program and data is loaded into the DVD-ROM drive 108 and the information processing apparatus 100 is turned on, the program is executed, and the game apparatus according to the present embodiment is realized. Is done.

  The CPU 101 controls the overall operation of the information processing apparatus 100 and is connected to each component to exchange control signals and data. Further, the CPU 101 uses arithmetic operations such as addition / subtraction / multiplication / division, logical sum, logical product, etc. using an ALU (Arithmetic Logic Unit) (not shown) for a storage area called a register (not shown) that can be accessed at high speed. , Logic operations such as logical negation, bit operations such as bit sum, bit product, bit inversion, bit shift, and bit rotation can be performed. In addition, the CPU 101 itself is configured so that saturation operations such as addition / subtraction / multiplication / division for multimedia processing, vector operations such as trigonometric functions, etc. can be performed at a high speed, and those provided with a coprocessor. There is.

  The ROM 102 records an IPL (Initial Program Loader) that is executed immediately after the power is turned on, and when this is executed, the program recorded on the DVD-ROM is read out to the RAM 103 and execution by the CPU 101 is started. The The ROM 102 stores an operating system program and various data necessary for operation control of the entire information processing apparatus 100.

  The RAM 103 is for temporarily storing data and programs, and holds programs and data read from the DVD-ROM and other data necessary for game progress and chat communication. Further, the CPU 101 provides a variable area in the RAM 103 and performs an operation by directly operating the ALU on the value stored in the variable, or temporarily stores the value stored in the RAM 103 in the register. Perform operations such as performing operations on registers and writing back the operation results to memory.

  The controller 105 connected via the interface 104 receives an operation input performed when the user executes the game. As will be described later, the controller 105 according to the present embodiment includes a hand module 201 that the player holds with each of the right hand and the left hand, and a mat-shaped foot module 202 that is installed on the floor and is stepped on with the player's foot. .

  FIG. 2 is a schematic diagram illustrating an appearance of the information processing apparatus 100 according to the present embodiment. Hereinafter, a description will be given with reference to FIG.

  The two hand modules 201 have a substantially rectangular parallelepiped shape such as a stick and incorporate an acceleration sensor. The acceleration sensor detects the acceleration in the triaxial direction of the hand module 201. From the detection result of the acceleration sensor, it is possible to estimate the position, tilt, and movement of the hand module 201.

  The foot module 202 has a mat-like shape, and this figure shows a state seen from above. Pressure sensors are built in four step pressure points 203a, 203b, 203c, 203d on the front, rear, left and right. From the detection result of the pressure sensor, it is possible to obtain which stepping pressure portion 203 the user's foot is stepping on.

  In the aspect shown in this figure, the interface 104 built in the main body 205 of the information processing apparatus 100 is connected to the hand module 201 wirelessly and is connected to the foot module 202 by wire. The form of communication is not limited to these, and various modes such as wireless communication, infrared communication, and wired communication can be employed.

  Furthermore, in the present embodiment, the information processing apparatus 100 is connected to a television apparatus 207 in which a monitor and a speaker are integrally configured by wire. Various information indicating the game situation is displayed on the monitor of the television device 207, and various sounds of the game are output from the speaker.

  In addition, instead of using the hand module 201 and the foot module 202, the player's hand motion and stepping gesture are obtained by capturing a video of the player's state with a camera and recognizing the result. It is also good.

  Returning to FIG. 1, the external memory 106 detachably connected via the interface 104 stores data indicating game play status (past results, etc.), game progress data, and network battles. Chat communication log (record) data and the like are stored in a rewritable manner. The user can record these data in the external memory 106 as appropriate by inputting an instruction via the controller 105.

  A DVD-ROM mounted on the DVD-ROM drive 108 stores a program for realizing the game and image data and audio data associated with the game. Under the control of the CPU 101, the DVD-ROM drive 108 performs a reading process on the DVD-ROM loaded therein, reads out necessary programs and data, and these are temporarily stored in the RAM 103 or the like.

  The image processing unit 107 processes the data read from the DVD-ROM by an image arithmetic processor (not shown) included in the CPU 101 or the image processing unit 107, and then processes the processed data on a frame memory ( (Not shown). The image information recorded in the frame memory is converted into a video signal at a predetermined synchronization timing and output to a monitor (not shown) connected to the image processing unit 107. Thereby, various image displays are possible.

  The image calculation processor can execute a two-dimensional image overlay calculation, a transmission calculation such as α blending, and various saturation calculations at high speed.

  In addition, when the virtual space is configured in three dimensions, polygon information that is arranged in the three-dimensional space and to which various texture information is added is rendered by the Z buffer method, and a predetermined viewpoint position is used. It is also possible to perform a high-speed execution of a calculation that obtains a rendering image obtained by looking down at a polygon arranged in the virtual space in the direction of a predetermined line of sight.

  Further, the CPU 101 and the image arithmetic processor operate in a coordinated manner, so that a character string can be drawn as a two-dimensional image in a frame memory or drawn on the surface of each polygon according to font information that defines the character shape. is there.

  The NIC 109 is used to connect the information processing apparatus 100 to a computer communication network (not shown) such as the Internet, and is based on the 10BASE-T / 100BASE-T standard used when configuring a LAN (Local Area Network). To connect to the Internet using an analog modem, ISDN (Integrated Services Digital Network) modem, ADSL (Asymmetric Digital Subscriber Line) modem, cable television line A cable modem or the like and an interface (not shown) that mediates between these and the CPU 101 are configured.

  The audio processing unit 110 converts audio data read from the DVD-ROM into an analog audio signal and outputs the analog audio signal from a speaker (not shown) connected thereto. Further, under the control of the CPU 101, sound effects and music data to be generated during the progress of the game are generated, and sound corresponding to this is output from the speaker.

  When the audio data recorded on the DVD-ROM is MIDI data, the audio processing unit 110 refers to the sound source data included in the audio data and converts the MIDI data into PCM data. If the compressed audio data is in ADPCM format or Ogg Vorbis format, it is expanded and converted to PCM data. The PCM data can be output by performing D / A (Digital / Analog) conversion at a timing corresponding to the sampling frequency and outputting it to a speaker.

  Furthermore, a microphone 111 can be connected to the information processing apparatus 100 via the interface 104. In this case, the analog signal from the microphone 111 is subjected to A / D conversion at an appropriate sampling frequency so that processing such as mixing in the sound processing unit 110 can be performed as a PCM format digital signal.

  In addition, the information processing apparatus 100 uses a large-capacity external storage device such as a hard disk so as to perform the same function as the ROM 102, the RAM 103, the external memory 106, the DVD-ROM mounted on the DVD-ROM drive 108, and the like. You may comprise.

  The information processing apparatus 100 described above corresponds to a so-called “consumer video game apparatus”, but the present invention can be realized as long as it performs image processing to display a virtual space. Therefore, the present invention can be realized on various computers such as a mobile phone, a portable game device, a karaoke apparatus, and a general business computer.

  For example, a general computer, like the information processing apparatus 100, includes an image processing unit that includes a CPU, RAM, ROM, DVD-ROM drive, and NIC and has simpler functions than the information processing apparatus 100. In addition to having a hard disk as an external storage device, a flexible disk, a magneto-optical disk, a magnetic tape, and the like can be used. Further, not the controller 105 but a keyboard or a mouse is used as an input device.

  FIG. 3 is a schematic diagram showing a schematic configuration of the game device according to the present embodiment. Hereinafter, an outline of the game apparatus will be described first with reference to FIG.

  As shown in the figure, the game apparatus 301 includes a detection unit 302, a display unit 303, and a determination unit 304.

  Here, the detection unit 302 detects a gesture by the player. As described above, the hand module 201 or the foot module 202 of the controller 105 detects the type and timing of the gesture of the player by detecting the acceleration of the hand or the stepped pressure position.

  On the other hand, the display unit 303 indicates the type of gesture to be taken by the player, the type figure indicating the execution timing at which the stepping gesture should be executed for the stepping gesture, and the start timing at which the gesture of hand gesture should be started. Display timing diagrams on the monitor screen.

  In the present embodiment, the end timing for ending the gesture of hand gesture is also shown on the monitor screen by the timing graphic, but this display can be omitted.

  Further, the method of displaying the type graphic and the timing graphic in this embodiment will be described later.

  The process of displaying the type graphic and the timing graphic on the monitor screen according to the type and timing of the gesture to be performed by the player is executed by the image processing unit 107 under the control of the CPU 101.

The determination unit 304 determines whether or not the gesture by the player is successful. In this case, the following criteria are used.
(A) Is the detected gesture type displayed on the screen?
(B) If the detected gesture is a hand gesture, is the time difference between the timing when the gesture is started and the start timing displayed on the screen sufficiently small?
(C) If the detected gesture is a stepping gesture, is the time difference between the timing at which the gesture is executed and the execution timing displayed on the screen sufficiently small?

  The result of the determination made here may be displayed on the display unit 303.

  In the present embodiment, the determination unit 304 determines whether or not the gesture by the player is successful in consideration of the time difference between the timing at which the detected gesture of gesture is ended and the timing at which the gesture is displayed on the screen. However, this process can be omitted.

  In the present embodiment, the CPU 101 functions as the determination unit 304 by comparing the type and timing of the gesture to be taken by the player with the actual gesture detected by the controller 105.

  Hereinafter, first, a method for presenting to the player the gesture to be taken by the player, that is, the game task given to the player in the game device 301 will be described, and then the game control process executed in the game device 301 will be described. Will be described.

(Aspect display mode)
In the present embodiment, the following gesture by the player is detected.
(A) A stepping gesture in which the player steps on the left treading pressure spot 203a.
(B) A stepping gesture in which the player steps on the subsequent treading pressure point 203b.
(C) A stepping gesture in which the player steps on the previous treading pressure point 203c.
(D) A stepping gesture in which the player steps on the right treading pressure spot 203d.
(E) Gesture of gesture that moves player's left hand (left arm).
(F) Gesture for moving the player's right hand (right arm).

  The stepping gestures (a) to (d) are for stepping on the specified treading pressure point 203 at the specified moment. This moment is called the execution timing of the stepping gesture.

On the other hand, hand gestures (e) and (f) have various types of trajectories for moving the hand. In general, many hand gestures are time-consuming. For example, the following operations can be considered.
(1) An operation of moving the left arm (right arm) lowered from above so as to spread to the left side (right side).
(2) The operation of turning the arm clockwise or counterclockwise.
(3) An operation of moving the left arm (right arm) from the front of the body to the right side (left side) and then extending it to the left side (right side) while curving downward. This is similar to the shape of the operation (2) in which the circular shape is an ellipse that is long horizontally.

  Since these hand gestures (e) and (f) take a long time to perform an operation, it is necessary to perform a specified operation during a specified period. Therefore, the start time of the operation is called the start timing of the gesture of hand gesture, and the end time is called the end timing of the gesture of hand gesture.

  In the game apparatus 301 of the present embodiment, the audio processing unit 110 reproduces music data read from a DVD loaded in the DVD-ROM drive 108. Then, according to the rhythm of the played music, the player shakes his hand or steps.

  Such choreography based on hand gestures and stepping gestures is a game task that a player should execute. This problem is presented to the player by displaying on the monitor screen a graphic similar to a score in musical instrument performance.

  FIG. 4 is an explanatory view showing a display example in which a graphic for instructing a player to perform a task is displayed on a monitor screen. Hereinafter, description will be given with reference to these drawings.

  In these drawings, in order to facilitate understanding, elements that are not actually displayed on the screen are indicated by dotted lines, and elements that are displayed on the screen are indicated by thick solid lines.

The problem shown in this figure is to ask the player to perform the following gestures in order. That is,
(1) Left foot with 1 beat (2) Back foot with 1 beat (3) Hand motion with a right ellipse from top to left and bottom with a long ellipse extending to the right in 2 beats (4) Rest by 1 beat (5 ) Stepping forward with 1 beat (6) Stepping with right foot after 1 beat (7) Shaking with 2 beats extending the left hand from the top to the right and the bottom from the side to a long ellipse and then to the left

  In the screen 401, four linear lanes 402a, 402b, 402c, and 402d are installed in order from left to right in the vertical direction. Type graphics 403a, 403b, 403c, and 403d are arranged. In the following description, when an individual lane or individual foot type graphic is designated, a, b, c, and d at the end of the code are clearly indicated. b, c, and d are omitted.

  A foot type figure 403a indicating that the left treading pressure point 203a should be stepped has a left-pointing arrow shape, and moves from bottom to top along the lane 402a.

  The foot type figure 403b indicating that the subsequent treading pressure point 203b should be stepped has a downward arrow shape, and moves from bottom to top along the lane 402b (the lane adjacent to the leftmost lane 402a). .

  The foot type graphic 403c indicating that the previous treading pressure point 203c should be stepped has an upward arrow shape, and moves from bottom to top along the lane 402c (the lane adjacent to the rightmost lane 402d). .

  The foot type figure 403d indicating that the right treading pressure point 203d should be stepped has a left-pointing arrow shape, and moves from bottom to top along the lane 402d.

  The speeds at which the foot type figures 403a, 403b, 403c, and 403d move from the bottom to the top are all equal and constant.

  In the rhythm game according to the present embodiment, when the game is started, the performance of BGM (Back Ground Music) is also started. In this game, the player is required to step on the specified treading pressure point 203 in accordance with the rhythm of the BGM.

  Here, the moment that the foot type graphic 403 moves and reaches the execution reference line 405 is set to match the rhythm of the BGM. For example, if the BGM is a 4-beat song, one bar consists of 4 beats (4 quarter notes), but the moment when the foot type figure 403 reaches the execution reference line 405 is the moment of any beat. It matches. Hereinafter, this time point is referred to as the execution timing of the gesture associated with the foot type graphic 403.

  That is, when the player executes the gesture of stepping on the treading pressure portion 203 corresponding to the foot type graphic 403 at the moment when the foot type graphic 403 reaches the execution reference line 405 set in the screen, the score of the game is increased. can get. That is, the task of stepping on the specified pedal pressure position 203 at the moment of the correct beat is given to the player.

  Although the interval between each beat is not displayed on the screen 401, in this figure, for easy understanding, the interval between each beat of the BGM is clearly shown by drawing a horizontal two-dot chain line.

  In the rhythm game, a score given to the player due to an error between the moment when the player steps on the stepping pressure portion 203 corresponding to the foot type graphic 403 and the moment when the foot type graphic 403 reaches the execution reference line 405 is obtained. Set to increase or decrease. That is, the smaller the error is, the larger the score is set. Typically, when a player steps on an incorrect treading pressure point 203, a score is not obtained, but it may be set so that the obtained score is reduced.

  In the screen 401, a foot indicator graphic 404 having the same shape as the foot type graphic 403 is displayed.

  In this figure and the subsequent figures, for ease of understanding, only the foot type figures 404a and 404d arranged in the right and left lanes 402a and 402d are provided with reference numerals, and the foot type figures 404b, The reference numeral 404c is omitted. Moreover, when naming generically, it demonstrates by abbreviate | omitting the code | symbol end a, b, c, d.

  At the moment when the foot type graphic 403 reaches the execution reference line 405, the foot type graphic 403 and the foot index graphic 404 overlap, so that the player can easily grasp the moment when the stepping gesture should be executed. become.

  These aspects are similar to the technique disclosed in Patent Document 1.

  In addition, in the drawing, a timing diagram 411a that moves so as to cover the lanes 402a and 402b and a timing diagram 411b that moves so as to cover the lanes 402c and 402d are illustrated.

  The timing graphic 411a and the timing graphic 411b move from the bottom to the top of the screen 401, respectively, and have a substantially rectangular shape having a front end (upper side) 471a and a rear end (bottom side) 472a, and a front end 471b. It has a substantially rectangular shape with a rear end 472b.

  Here, the timing graphic 411a presents a period during which the player should move the left hand, and what kind of hand gesture should be performed is instructed by the hand type graphic 412a. The timing graphic 411a moves from the bottom two lanes 402a and 402b from the bottom to the top at the same speed as each of the foot type graphic 403, and the hand type graphic 412a also moves accordingly.

  On the other hand, the timing graphic 411b presents a period during which the player should move the right hand, and the hand type graphic 412b indicates what kind of gesture should be performed. The two lanes 402c and 402d on the right side move from the bottom to the top at the same speed as each of the foot type figures 403, and the hand type figure 412b also moves accordingly.

  In the following, when individually explaining the timing graphic and the hand type graphic, a and b at the end of the code shall be specified, and when describing collectively, the a and b at the end of the code will be omitted.

  In the vicinity of the information in the screen 401, the execution reference line 405, a front reference line 415 and a rear reference line 416 are arranged. The vertical height of the timing diagram 411 is longer than the interval between the front reference line 415 and the rear reference line 416.

  Therefore, the moment when the front end 471 reaches the front reference line 415 in the moving direction of the timing diagram 411 is earlier than the moment when the rear end 472 reaches the rear reference line 416.

  In the present embodiment, from the moment when the front end 471 of the timing diagram 411 reaches the front reference line 415 (hereinafter referred to as “start timing”), the moment when the rear end 472 of the timing diagram 411 reaches the rear reference line 416 (hereinafter referred to as “start timing”). The player is required to execute the gesture of the hand gesture designated by the hand type figure 412 until “end timing”.

  The player is given a start timing and an end timing that match the rhythm of the BGM as tasks.

  Under such settings, if the player correctly performs stepping and hand gestures according to the presented task, the player can behave as if brilliantly dancing to the BGM.

  While the vertical direction of the screen 401 is limited, the foot type graphic 403 and the timing graphic 411 move at a constant speed.

  Therefore, the time when the foot type graphic 403 appears in the screen 401 is the time when the distance between the lower end of the screen 401 and the execution reference line 405 is divided by the speed from the execution timing of the foot type graphic 403. It becomes.

  Also, the timing when the timing graphic 411 appears in the screen 401 is before the time obtained by dividing the distance between the lower end of the screen 401 and the front reference line 415 by the speed from the start timing of the timing graphic 411.

  The relative position of the hand type graphic 412 with respect to the timing graphic 411 is determined by various methods described later. Based on the position thus determined, whether or not the hand-type graphic 412 is displayed in the screen 401 is determined.

  In this aspect, the foot type graphic 403 and the timing graphic 411 are assumed to move in the screen 401 from the bottom to the top at a constant speed. However, this aspect can be modified.

  For example, the foot type graphic 403 and the timing graphic 411 may move on the screen 401 from top to bottom, from right to left, from left to right, or diagonally at a constant speed.

  In addition, it is assumed that the foot type figure 403 and the timing figure 411 move in the three-dimensional virtual space at a constant speed in the three-dimensional virtual space, and this state is photographed with a camera arranged in the three-dimensional virtual space. There is also a method of displaying on the screen 401 like a bird's eye view.

  In this case, since the foot type graphic 403 and the timing graphic 411 are drawn in the screen 401 by so-called perspective projection, the moving speed in the screen 401 is not constant.

  Furthermore, in this figure, the score “52134” that the player has acquired so far is displayed in the score display field 421.

  FIG. 5 to FIG. 11 are explanatory diagrams sequentially showing how the combination of the timing graphic 411 and the hand-type graphic 412 moves as time passes. Hereinafter, a description will be given with reference to FIG.

  The timing diagram 411b shown in the figure is for designating the gesture of a right hand gesture of two beats to the player. In the hand type figure 412b, an arrow is drawn in a counterclockwise direction along a horizontally long ellipse from the top to the left side to the right side.

  Therefore, the player needs to take a gesture to move his hand from the top to the left slightly in front of two beats and to extend to the right after passing a little below the front.

  In the example shown in FIGS. 5 to 11, the hand-type graphic 412b is arranged at the center near the front end 471b of the timing graphic 411b, and the relative position thereof does not change. A mode in which the relative position changes will be described later.

  FIG. 5 illustrates a state two beats before the start timing of the gesture of gesture. In this figure, the distance between the front end 471b of the timing diagram 411b and the front reference line 415 is a length obtained by multiplying the moving speed of the timing diagram 411b by the time of two beats.

  The distance between the rear end 472b of the timing diagram 411b and the rear reference line 416 is also equal to this length.

  In the present embodiment, the distance between the front reference line 415 and the rear reference line 416 is set to be approximately equal to the distance obtained by multiplying the moving speed of the timing diagram 411b and the like by the time for one beat. This distance is set to be substantially equal to the height of the foot type figure 403.

  FIG. 6 illustrates a state one beat before the start timing of the gesture of gesture. The timing diagram 411b shown in this figure is moving upward in the same shape as in FIG. The distance between the front end 471b of the timing diagram 411b and the front reference line 415 is a length obtained by multiplying the moving speed of the timing diagram 411b by the time of one beat, and the front end 471b of the timing diagram 411b and the rear reference line 416 are overlapping.

  FIG. 7 illustrates a state at the start timing of the gesture of gesture. In this figure, the front end 471b of the timing diagram 411b overlaps the front reference line 415.

  FIG. 8 illustrates a state after half a beat from the start timing, and FIG. 9 illustrates a state after one beat from the start timing.

  In the present embodiment, once the front end 471b of the timing diagram 411b overlaps the front reference line 415, it does not move thereafter.

  On the other hand, the rear end 472b of the timing diagram 411b moves at the same speed as before. For this reason, in the example shown in these figures, the height of the timing diagram 411b in the vertical direction is shorter as time passes than in FIGS.

  FIG. 10 illustrates a state at the end timing. In this figure, the rear end 472b of the timing diagram 411b overlaps the rear reference line 416.

  In this embodiment, the hand type graphic 412b is set so that the relative position of the timing graphic 411b with respect to the front end 471b does not change. Therefore, after FIG. 7, the hand type figure 412b also stays at the same position.

  The timing figure 411b and the hand type figure 412b present the player with the gesture gesture type, start timing, and end timing.

  When the player clears this task, that is, when the gesture of the type specified by the hand type graphic 412b is made between the start timing and the end timing specified by the timing graphic 411b, The operation is determined to be successful, and a score is added to the player.

  After the situation shown in FIG. 10 is reached, the timing graphic 411b and the hand type graphic 412b may move upward again at the same speed, or the display may disappear at that location. Further, when the gesture of the player's hand gesture is successful, the timing graphic 411b and the hand type graphic 412b are made to emit light strongly for a moment, or the display color is changed, and this is fed back to the player. It is also good.

  In addition to the above, there may be the following modes. That is, in the examples shown in FIGS. 5 to 10, the end of the hand gesture is ended by extending the hand to the right. Therefore, when the gesture of the player's hand gesture is successful, the timing graphic 411b and the hand type graphic 412b disappear while moving to the right side of the screen 401 after the end timing.

  FIG. 11 illustrates a state in which the timing graphic 411b and the hand type graphic 412b disappear while moving to the right side.

  In this figure, since the gesture has been successful, the numerical value displayed in the score display field 421 is increased from “52134” to “52845” compared to the other figures.

  In this figure, compared with FIG. 10, while the foot type figure 403c representing the next gesture proceeds upward, the already completed timing figure 411b and hand type figure 412b have moved to the right.

  In this way, it is determined whether or not the player's operation is successful by matching the direction of the last gesture of the player's gesture with the direction of movement of the timing figure 411b and the hand-type figure 412b after the gesture is successful. Can be shown to the player in an easy-to-understand manner.

  In the present embodiment, when the front end 471b of the timing graphic 411b reaches the front reference line 415, the timing figure 411b stays there. However, a mode is adopted in which the front end 471b is moved upward at the same speed. It is also good. In this aspect, the vertical height of the timing graphic 411b does not change.

  In addition, when this mode is adopted, the hand-type graphic 412b is present between the front-side reference line 415 and the rear-side reference line 416 in order to easily present a time-consuming gesture of hand gesture to the player. It is desirable to set.

  In this aspect, when the rear end 472b of the timing graphic 411b reaches the rear reference line 416, the timing graphic 411b and the hand type graphic 412b disappear or move in various modes as described above. It is also good. In particular, it is possible to employ a technique in which the timing graphic 411b and the hand type graphic 412b are moved upward at the same speed.

  In this aspect, it can be considered that “box” is expressed by the timing graphic 411b, and “ball placed in the box” is expressed by the hand type graphic 412b.

  When such an expression is adopted, it appears to the player that the timing graphic 411b and the type graphic 412b are moving as follows.

  That is, initially, the box moves from bottom to top at a constant speed, and the ball is in contact with the front end 471 of the box until the front end 471 of the box reaches the front reference line 415. While the box crosses the front reference line 415 and the rear reference line 416, the ball stays between them. After the rear end 472 of the box reaches the rear reference line 416, the ball moves in contact with the rear end 472 of the box.

  Considering this expression, it can be considered that the embodiment presented above corresponds to a mode in which the length in the moving direction of the box changes.

  The description here has been made by taking the timing graphic 411b and the hand type graphic 412b for the right hand as an example, but the same display is applied to the timing graphic 411a and the hand type graphic 412a for the left hand. Techniques can be employed.

  Further, the type of hand gesture presented by the hand type graphic 412 can be changed as appropriate according to the type of game. In this case, by using a symbol corresponding to the type for the hand type figure 412, the type of gesture of hand gesture can be presented to the player in an easy-to-understand manner.

(Game control process)
The game control process for realizing the rhythm game according to the present embodiment is started when the information processing apparatus 100 reads a program from the DVD-ROM mounted in the DVD-ROM drive 108 into the RAM 103 and executes it. Is done. By executing the game control process, the information processing apparatus 100 functions as each unit of the game apparatus 301 according to the present invention.

  FIG. 12 is a flowchart showing the flow of control of the game control process according to the present embodiment. Hereinafter, a description will be given with reference to FIG.

  When the game control process is started, the CPU 101 performs various initializations (step S601). In this initialization, the following information is read out from the DVD-ROM loaded in the DVD-ROM drive 108 to the RAM 103.

  (A) BGM audio data to be reproduced in a rhythm game. Audio data is typically represented by MIDI data. When PCM data is used, it is general that buffering processing is performed as appropriate rather than reading the entire data into the RAM 103.

  (B) The types of gestures and stepping gestures that match the rhythm of the BGM, and the execution timing or start timing and end timing of the gesture. These timings are generally expressed by the elapsed time from the start of BGM playback. Note that these timing information can be stored as extended commands in the MIDI data of (a).

  (C) Image data such as foot type graphic 403, timing graphic 411, hand type graphic 412, size of screen 401, position of lane 402, execution reference line 405, front reference line 415, rear reference line 416, etc. Information indicating From these pieces of information, the moving speed of the foot type graphic 403 and the timing graphic 411 within the screen 401 can be determined.

  In this embodiment, in the initialization process, the RAM 103 has a ring buffer for holding a history of the operation of the controller by the player for a certain period (typically, a length corresponding to one bar of BGM). Provided. By referring to this ring buffer, it is possible to check the acceleration detected by the left and right hand modules 201, the presence or absence of the treading pressure detected by the foot module 202, and the history of treading pressure positions.

  Further, an area for storing the player's score is prepared in the RAM 103. This area is cleared to zero by initialization.

  When the initialization is completed, the CPU 101 controls the audio processing unit 110 to start BGM reproduction (step S602), and starts measuring the elapsed time since the BGM reproduction is started (step S603). . BGM playback is performed in parallel with the processing described below.

  Then, the CPU 101 controls the image processing unit 107 to generate an image to be displayed on the screen 401 in the RAM 103 based on the current elapsed time (step S604).

  FIG. 13 is a graph showing the relationship between the position of a certain timing diagram 411 and time. Here, FIG. 11A is a graph showing the relationship between the positions of the front end 471 and the rear end 472 of the timing diagram 411 and time, and FIG. 9B shows the positions and time of the left end and right end of the timing diagram 411. It is a graph showing the relationship.

  In this figure (a), the horizontal axis corresponds to the passage of time, and the vertical axis corresponds to the height from the lower end to the upper end in the screen. The front end 471 and the rear end 471 of the timing graphic 411 move from the bottom to the top in the screen 401 at the same speed before the start timing.

  After the start timing, the height of the front end 471 in the screen 401 is constant, that is, the height of the front reference line 415.

  On the other hand, until the end timing, the rear end 472 moves from the bottom to the top in the screen 401 at the same speed as before.

  After the end timing, the height of the front end 471 in the screen 401 is constant, that is, the height of the rear reference line 416.

  On the other hand, in this figure (b), a horizontal axis is time passage and a vertical axis | shaft is equivalent to the position from the left end to the right end in a screen. The left end and the right end of the timing diagram 411 are at fixed positions before the end timing, but when the player's operation is successful, after the end timing, they move at a constant speed.

  As described above, the movement after the end timing of the left end and the right end of the timing graphic 411 is the same as the direction in which the hand has moved last in the gesture of the player's hand gesture determined to be successful.

  Thus, if it is determined at which position in the screen each timing graphic 411 is drawn, the position at which the hand-type graphic 412 is drawn with respect to the timing graphic 411 is also determined. The position for drawing the foot type figure 403 is also determined in the same manner.

  Wait until a vertical synchronization interrupt occurs (step S605). During this standby, other processes can be appropriately executed in a coroutine manner.

  In addition, the processing described in and after step S607 is executed in advance as a coroutine, and when a vertical synchronization interrupt occurs, the processing temporarily returns to step S605 and the processing in step S606 is executed to further advance the processing of the coroutine. Techniques can also be adopted.

  When the vertical synchronization interrupt occurs, the CPU 101 controls the image processing unit 107 to transfer the image generated in the RAM 103 to the monitor and display it on the screen 401 (step S606). By this processing, an image as illustrated in FIG. 4 or FIGS. 5 to 11 is drawn on the screen 401.

  At the time of image generation, the CPU 101 may read a numerical value stored in the score area in the RAM 103 and draw a numerical string representing the numerical value in the image.

  Therefore, the CPU 101 functions as the display unit 303 in cooperation with the RAM 103, the image processing unit 107, and the like.

  Note that vertical synchronization interrupts typically occur every 1 / 60th of a second. Accordingly, the display update of the screen 401 is also performed at regular intervals.

  Next, the CPU 101 acquires the detection result of the controller 105 (step S607) and adds it to the ring buffer in the RAM 103 (step S608). Here, information on the triaxial acceleration detected by the left and right hand modules 201 and information on the presence / absence of the stepping pressure at each stepping pressure spot 203 detected by the foot module 202 are acquired.

  Therefore, the controller 105 functions as the detection unit 302.

  As the controller 105, it is possible to use a device that takes a video of a player and recognizes the movement of the limb.

  In simple terms, the player's limbs are equipped with light emitters that emit light at different wavelengths, colors, and timing, and this situation is filmed with the camera, and the position of the light spot of a specific wavelength or color in the captured image As a result of image recognition, a method for recognizing the movement of the limbs of the player can be employed.

  In addition, there may be a method of recognizing an image only from a moving image obtained by shooting a player without using such a light emitter.

  Further, these image recognition methods may be used in combination with the hand module 201 and the foot module 202.

  After that, the CPU 101 compares the gesture gesture type and start timing and end timing read into the RAM 103, the step gesture type and execution timing, and the detection results stored in the ring buffer, It is determined whether or not the player's operation is successful (step S609).

  If the player's operation is successful (step S609; Yes), the score corresponding to the degree of success, that is, the timing error is added to the score area in the RAM 103 (step S610).

  Typically, the ring buffer is once scanned at the end timing of the hand gesture or the execution timing of the stepping gesture to determine whether or not the player's gesture is successful. If it is successful, the information related to the gesture is deleted from the ring buffer.

  In this case, it is possible to recognize when the gesture by the player is executed early or when the gesture by the player is executed at an accurate time.

  Further, after a certain error time has elapsed from the end timing of the hand gesture and the execution timing of the stepping gesture, the ring buffer is scanned again to determine whether or not the player's gesture is successful. If it is successful, the information related to the gesture is deleted from the ring buffer.

  In this case, it is possible to recognize the case where the gesture by the player is executed with a delay.

  Thus, the CPU 101 functions as the determination unit 304 in cooperation with the RAM 103 and the like.

  When the success of the player's operation cannot be recognized (step S609; No), or when the player succeeds (step S609; Yes) and the score is added (step S610), the CPU 101 causes the audio processing unit 110 to Control is performed to inquire whether or not the performance of BGM has been completed (step S611).

  If the BGM performance has not been completed (step S611; No), the process returns to step S604, and the above process is repeated to realize a rhythm game.

  If the BGM performance has been completed (step S611; Yes), this means that the game has been completed, and thus this process ends.

  As described above, in the present embodiment, the player easily distinguishes and recognizes the types of hand gestures and stepping gestures by using the foot type graphic 403, the timing graphic 411, and the hand type graphic 412 displayed on the screen 401. Or the start timing and execution timing of these gestures can be easily grasped.

  Furthermore, by using only the display area for four lanes 402 in the screen 401, two hand gestures and four types of treading pressure points 203 can be expressed. It can also be used effectively to present other information to the player.

  In the above embodiment, the relative position from the front end 471 of the timing graphic 411 (or the front reference line 415 after the start timing) of the hand type graphic 412 is fixed.

  In the present embodiment, by changing this position, the state of the hand module 201 is fed back to the player.

  That is, in the above embodiment, the hand-type graphic 412 is relatively fixed with respect to the front end 471 of the timing graphic 411. In the present embodiment, the “fixed relative position” in the above embodiment is set as the reference position of the hand-type graphic 412.

  In the present embodiment, the displacement of the hand type figure 412 from the reference position is changed according to the state of the hand module 201. This will be described in detail below.

  FIG. 14 is an explanatory diagram showing the relationship between the hand module 201 and the reference position and displacement of the hand type graphic 412. FIG. 14 (a) shows the state of the hand module 201. FIG. The figure shows the relationship between the reference position and displacement of the hand-type graphic 412. Hereinafter, a description will be given with reference to FIG.

  As shown in this figure, the hand module 201 gripped by one of the left and right hands can detect three-axis accelerations in the longitudinal direction 701, the vertical direction 702, and the horizontal direction 703. These three-axis accelerations are measured in a coordinate system fixed to the hand module 201.

  In general, when the player swings the bar-shaped hand module 201, the acceleration in the longitudinal direction 701 detects a so-called centrifugal force, so that it is difficult to directly use it to determine the success or failure of the operation.

  Therefore, in the present embodiment, acceleration detected in the vertical direction 702 and the horizontal direction 703 is fed back to the player, and the success or failure of the operation is determined based on the acceleration.

  In this embodiment, the hand-type graphic 412 is considered as a certain kind of mass point 713, and the following physical simulation is performed on the assumption that the mass point 713 is arranged at a position shifted by a displacement 712 from the reference position 711. .

  That is, a predetermined mass is assigned to the mass point 713.

  Then, an external force 722 obtained by multiplying the acceleration detected in the vertical direction 702 by a constant for the vertical direction is calculated and applied to the mass point 713.

  Also, an external force 723 obtained by multiplying the acceleration detected in the left / right direction 703 by a constant for the left / right direction is calculated and applied to the mass point 713.

  Further, an elastic force 725 is applied to return the position of the mass point 713 to the reference position 711. This elastic force 725 is proportional to the magnitude of the displacement 712.

  Further, it is assumed that a viscous force (friction force) 726 proportional to the speed acts on the mass point 713 in the direction opposite to the current movement speed 714.

  If these conditions are satisfied, the displacement 712 and the speed 714 of the mass point 713 can be calculated in an environment where the viscous force 726, the elastic force 725, and the external forces 722 and 723 are working. In this calculation, time integration based on a simple difference may be used, or various high-precision integration techniques may be used.

  Here, the calculated displacement 712 can be considered as an approximation of the position of the hand module 201 in the real world. When determining the success of the gesture, the locus of the displacement 712 of the mass point 713 may be used.

  When the displacement 712 is obtained in this way, the hand-type graphic 412 is drawn at a position shifted from the reference position 711 in the screen 401 by the displacement 712.

  Depending on the size of the displacement 712, the hand-type graphic 412 may be drawn out of the timing graphic 411. In order to prevent this as much as possible, the constant multiplied by the acceleration may be adjusted as appropriate, or the displacement may be limited so that the hand-type graphic 412 does not always protrude from the timing graphic 411.

  Further, since the hand type figure 412 includes left hand use and right hand use, the displacement 712 of each hand type figure 412 is changed based on the acceleration detected by the left and right hand modules 201.

  FIG. 15 is an explanatory diagram for explaining how the displacement of the hand type graphic 412 with respect to the reference position 711 fixed to the timing graphic 411 changes. This figure (a) shows the positional relationship at the time point corresponding to FIG. 4, this figure (b) shows the positional relationship at the time point corresponding to FIG. 5, and this figure (c) corresponds to FIG. FIG. 6D shows the positional relationship at the time point corresponding to FIG. 7, FIG. 8E shows the positional relationship at the time point corresponding to FIG. 8, and FIG. 9 shows the positional relationship at the time point corresponding to FIG. 9, FIG. 11G shows the positional relationship at the time point corresponding to FIG. 10, and FIG. 11H shows the positional relationship at the time point corresponding to FIG. Show.

  Between the figures (a) to (c), the hand-type graphic 412b moves minutely in conjunction with the movement of the player's right hand.

  In this drawing (d) corresponding to the start timing, the hand type figure 412b is positioned slightly above the reference position 711.

  Thereafter, in the figure (e), the hand type figure 412b is moved to the left side with respect to the reference position 711.

  Thereafter, in this figure (f), the hand type figure 412b has moved slightly to the left and slightly below the reference position 711.

  Thereafter, in the figure (g), the hand type figure 412b has moved to the right with respect to the reference position 711, and this time is the end timing.

  Thereafter, in the figure (h), the hand type figure 412b is further moved to the right with respect to the reference position 711.

  That is, during this figure (d) to this figure (g), the hand type figure 412b is drawn in the hand type figure 412b with respect to the reference position 711 in conjunction with the movement of the right hand. It follows a trajectory similar to a bent arrow.

  By adopting such a display form, the player can easily grasp how the game apparatus 301 recognizes the player's gesture. The player can naturally learn what gesture gesture is used to determine success.

  As described above, according to the present invention, the timing at which a gesture such as waving or stepping a hand or arm is to be executed, the timing to start, or the timing to end is presented to the player so that it can be easily understood. It is possible to provide a game device, a game control method, and a program that realizes these on a computer.

100 Information processing apparatus 101 CPU
102 ROM
103 RAM
104 Interface 105 Controller 106 External Memory 107 Image Processing Unit 108 DVD-ROM Drive 109 NIC
DESCRIPTION OF SYMBOLS 110 Audio | voice processing part 111 Microphone 201 Hand module 202 Foot module 203 Treading pressure part 301 Game device 302 Detection part 303 Display part 304 Judgment part 401 Screen 402 Lane 403 Foot type figure 404 Execution reference line 405 Foot index figure 411 Timing figure 412 Hand type graphic 415 Front reference line 416 Rear reference line 421 Score display field 471 Timing graphic front edge 472 Timing graphic rear edge 701 Longitudinal direction 702 Vertical direction 703 Horizontal direction 711 Reference position 712 Displacement 713 Mass point 714 Speed 722 Vertical direction External force 723 left-right external force 725 elastic force 726 viscous force

Claims (8)

Detection unit for detecting left and right hand gestures by the player and left, back, front and right stepping gestures by the player;
The type of foot gesture that indicates the type of step gesture to be taken by the player and the execution timing at which the player should execute the step gesture, the hand type graphic that indicates the type of hand gesture to be taken by the player, A display unit for displaying on the screen a timing graphic indicating a start timing at which a gesture should be started,
Whether the gesture by the player is successful,
(A) Whether or not the type of gesture gesture detected is the type displayed on the screen, the timing when the detected gesture gesture is started, and the start timing displayed on the screen And the time difference between
(B) Whether or not the type of the detected stepping gesture is the type displayed on the screen, the timing at which the detected stepping gesture is executed, and the execution timing displayed on the screen And the time difference between
A game device including a determination unit for determining based on
The predetermined direction in the screen is a vertical direction,
The display unit is
In the screen, four rows of lanes are set in parallel to the predetermined direction,
The foot type graphic showing a gesture of the left foot, move the leftmost lane of the four rows of lanes,
The foot type graphic showing the foot of the gesture after the move the adjacent lane of one lane leftmost or rightmost of the four rows of lanes,
The foot type graphic showing a gesture of the previous stepping, moving the adjacent lane of the other of the lane leftmost or rightmost of the four rows of lanes,
The foot type graphic showing a gesture of the right foot moves the rightmost lane of the four rows of lanes,
Wherein the timing figure showing a gesture of the left hand gesture of the player moves the leftmost and adjacent lane Of the four rows of lanes,
The player right timing figure indicating a gesture gesture of moving the rightmost and adjacent lane Of the four rows of lanes,
The foot type graphic for gestures of the foot, the execution timing earlier, the screen is moved to the predetermined direction, the execution timing, brought to the set running reference line on the screen,
Before the start timing at the front end in the predetermined direction of the timing diagram, the screen is moved in the predetermined direction within the screen, and at the start timing, the front reference line set in the screen is reached .
Hands for type graphic for gestures of the hand gestures for the front end of said timing figures, displayed on a position shifted by varying the displacement based on the magnitude and direction of the sensed gesture,
A game device characterized by that. A detection unit that detects gestures by players,
A display unit for displaying on the screen a type graphic indicating a type of gesture to be taken by the player, and a timing graphic indicating a start timing at which the gesture should be started;
Based on whether or not the type of the detected gesture is the type displayed on the screen, and the time difference between the timing at which the detected gesture was started and the start timing displayed on the screen, A game device including a determination unit that determines whether or not a gesture by a player is successful,
The display unit is
Before the start timing at the front end in a predetermined direction of the timing diagram, the screen is moved in the predetermined direction within the screen, and at the start timing, the front reference line set in the screen is reached ,
The type graphic against the front end of the timing figure, game device and displaying the detected magnitude and position shifted by a displacement that varies based on the direction of the gesture. The game device according to claim 1 or 2,
The timing diagram further indicates an end timing at which the gesture should end,
The display unit moves to the rear end in the predetermined direction of the timing diagram, and moves in the screen in the predetermined direction before the end timing, and the rear side set in the screen at the end timing. brought to the reference line,
In the determination unit, the type of the detected gesture is the type displayed on the screen, and the timing at which the detected gesture is started and the timing at which the detected gesture is ended are If it is included between the start timing and the end timing displayed on the screen, it is determined that the gesture by the player is successful. The game device according to any one of claims 1 to 3,
The display unit moves to the front end at a predetermined speed in the screen before the start timing, and stays at the front reference line from the start timing to the end timing.
The display device moves to the rear end at a predetermined speed in the screen before the end timing. The game device according to any one of claims 1 to 4, wherein:
Wherein the display unit, the game apparatus characterized by starting the display in the screen of the timing figure, before a predetermined grace time from the start timing. A game device according to any one of claims 1 to 5,
The detection unit detects the acceleration of the gesture by the player,
The display unit is operated by a virtual elastic force that attempts to return the displacement to a predetermined value, a virtual frictional force that is proportional to the change in the displacement, and a virtual external force that is based on the acceleration. The game apparatus characterized in that the displacement is determined by physics simulation. A game device according to any one of claims 1 to 5,
The game device according to claim 1, wherein the display unit determines the displacement so that the type graphic does not protrude from the timing graphic . Computer
A detection unit that detects gestures by players,
A display unit for displaying on the screen a type graphic indicating a type of gesture to be taken by the player, and a timing graphic indicating a start timing at which the gesture should be started;
Based on whether or not the type of the detected gesture is the type displayed on the screen, and the time difference between the timing at which the detected gesture was started and the start timing displayed on the screen, It functions as a judgment part that judges whether or not the gesture by the player is successful,
The display unit is
Before the start timing at the front end in a predetermined direction of the timing diagram, the screen is moved in the predetermined direction within the screen, and at the start timing, the front reference line set in the screen is reached ,
The type graphic for the front end of the timing figure, the program for causing the functions to be displayed on the sensed magnitude and a position displaced by a displacement that varies based on the direction of the gesture.

Images