JP5325327B2 - Game device, detailed presentation method, and program - Google Patents

Abstract

A character image generation unit (261) generates a sample character on the basis of a sample posture stored in a game information storage unit (210). A posture detection unit (240) detects a posture made by a player in accordance with the generated sample character. A determination unit (250) determines the degree of similarity between the detected posture of the player and the sample posture stored in the game information storage unit (210). If the determined degree of similarity is higher than a prescribed value (for example, a degree of similarity value at which the contours of the sample posture are successfully copied), an assistance image generation unit (262) generates an assistance image for calling attention to the details of the sample posture to which the player's posture is dissimilar.

Description

  The present invention relates to a game apparatus, a detailed presentation method, and a program capable of appropriately presenting details of a posture to be performed by a player and prompting the player to improve.

  Conventionally, various games (software or the like) that are executed on a business or home game device have been developed. Among them, music games represented by dance games are deeply popular and are supported by players of a wide range of ages. This music game is a type of game in which a player competes for a high score by performing an appropriate operation in a timely manner in accordance with the music to be played.

  More specifically, with an example, in a conventional music game, an object that appears as appropriate from the starting point of the moving lane moves toward the end point of the moving lane according to the music to be played. When the player performs an appropriate button operation (pressing the button corresponding to the type of object or the moving lane) at the timing when the moving object reaches the determination line or the like, a score can be obtained. .

  In such a conventional music game, there is also disclosed an invention of a game device that can easily show the player whether the timing of the operation actually performed by the player was early or late (for example, Patent Documents) 1).

Japanese Unexamined Patent Publication No. 2009-201667 (page 5-12, FIG. 6)

Recently, a new type of music game has been developed in which a sample character dances and the player takes the same posture.
For example, the game device displays a sample character imitating a human on the game screen, and sequentially generates an image of the sample character so as to take a sample posture (dance choreography, etc.) according to the music played during the game. . On the other hand, the player tries to dance with the same choreography while imitating the posture while watching the sample posture made by the sample character. Then, the game apparatus evaluates the dance that the player dances by detecting the posture of the player with a predetermined sensor (for example, a sensor that recognizes the photographed player video) and comparing it with the sample posture.

In such a new type of music game, the player is required to take the same posture as the sample posture as much as possible in addition to taking the posture at the timing required in the conventional music game described above. ing.
Even so, players such as beginners often become full by trying the same posture while following the sample posture (sample character) with their eyes, and can often imitate the sample posture only roughly.
For example, even if a sample character has a sample posture in which a right hand (right arm) is raised diagonally, his palm (right palm) is bent, and all his fingers (each right finger) are opened. A player such as a beginner who cannot afford can imitate only a rough posture in which the right hand is simply raised with respect to the sample posture.
In other words, the posture of players such as beginners is often different even with the right hand angle mentioned above, and in addition, details such as palm warping and finger opening are completely different. is there. For this reason, it was greatly different from the sample posture, and high evaluation could not be obtained.

Therefore, it is also conceivable to display a guidance image for announcing such details that are difficult to imitate together with a sample posture.
However, if such a guidance image is displayed to a player such as a beginner who cannot afford, there is a possibility that attention will be directed to that and even the outline of the sample posture may not be imitated. That is, when the skill level of the player is low, there is too much information to be displayed, which is rather confusing and may hinder progress.

  Therefore, in a music game that displays a sample posture, there has been a demand for a technique for appropriately presenting details of the sample posture without hindering the progress of the player.

  The present invention has been made in view of the above circumstances, and provides a game device, a detailed presentation method, and a program that can appropriately present details of the posture to be performed by the player and prompt the player to improve. Objective.

  A game device according to a first aspect of the present invention includes a display control unit, a detection unit, a determination unit, and a presentation unit.

  First, the display control unit displays a sample posture indicating the posture to be played by the player on the screen. For example, a sample posture (such as dance choreography or yoga pose) is displayed by a character image or the like. Further, the detection unit detects the posture of the player that is made corresponding to the displayed sample posture. For example, the player's posture is detected by recognizing the photographed player video. The determination unit determines a similarity between the detected posture of the player and the displayed sample posture. For example, it is determined how much the player resembles (imitates) the sample posture to perform a dance or a yoga pose. Then, when the determined similarity is higher than a predetermined value (as an example, a value that can imitate the outline of the sample posture), the presenting unit presents a message for notifying the details of the displayed sample posture. To do. For example, a message indicating the details of the sample posture is presented by voice or image.

That is, when a player such as a beginner plays, there are many cases where the sample posture can only be roughly imitated, and since the degree of similarity determined by the determination unit is low, no message is presented by the presentation unit. Eventually, when the player can imitate the outline of the sample posture, the similarity determined by the determination unit increases and exceeds a predetermined value. If it does so, a presentation part will present the message which makes the details of a sample posture notice.
Thus, when the skill of the player is low, no message is presented and only the sample posture is displayed. Therefore, the player concentrates on imitating the sample posture. Eventually, when the skill of the player increases to such an extent that the outline of the sample posture can be imitated, a message for notifying the details is displayed in addition to the sample posture. Therefore, the player receives this message and tries to imitate even the details of the sample posture that he did not notice.
As a result, it is possible to appropriately present the details of the posture to be performed by the player and to encourage the player to improve.

  A game device according to a second aspect of the present invention is a game device that displays a generated image on a screen and evaluates a corresponding posture of a player, and includes a storage unit, a character image generation unit, a detection unit, A determination unit and an auxiliary image generation unit are provided.

  First, the storage unit stores a sample posture (for example, a dance choreography or a yoga pose) that defines a posture to be performed by the player. For example, the sample posture is stored by a skeleton model or the like. Further, the character image generation unit generates a character image that moves based on the stored sample posture. For example, an image with a movement of a sample character or a still image is sequentially generated based on the sample posture. Further, the detection unit detects the posture of the player that is made corresponding to the generated character image. For example, the player's posture is detected by recognizing the photographed player video. The determination unit determines a similarity between the detected posture of the player and the stored sample posture. For example, it is determined how much the player resembles (imitates) the sample posture to perform a dance or a yoga pose. Then, when the determined similarity is higher than a predetermined value (for example, a value that can imitate the outline of the sample posture), the auxiliary image generation unit notices the details of the sample posture that is not similar. An auxiliary image is generated. For example, a character that points out details of a sample posture that is not similar, or an auxiliary image that magnifies or highlights the details is generated.

That is, when a player such as a beginner plays, there are many cases where the sample posture can only be roughly imitated, and the similarity determined by the determination unit is low, so that no auxiliary image is generated. Eventually, when the player can imitate the outline of the sample posture, the similarity determined by the determination unit increases and exceeds a predetermined value. Then, the auxiliary image generation unit generates an auxiliary image for recognizing details of the sample posture that are not similar.
Thus, in a state where the skill of the player is low, no auxiliary image is generated, and only the sample character based on the sample posture is generated and displayed. Therefore, a player concentrates on imitation of a sample character. Eventually, when the skill of the player increases to such an extent that the outline of the sample character (sample posture) can be imitated, an auxiliary image for recognizing the details of the sample posture that is not similar to the sample character is generated. Therefore, the player tries to imitate even the details of the sample posture that he / she did not notice from this auxiliary image.
As a result, it is possible to appropriately present the details of the posture to be performed by the player and to encourage the player to improve.

The determination unit determines an approximate similarity between the outline of the sample posture and the player's posture, and a detailed similarity between the details of the sample posture and the player's posture,
The auxiliary image generating unit is configured to recognize the details of the sample postures that are not similar when the determined approximate similarity is higher than a predetermined value and the determined detailed similarity is lower than the predetermined value. May be generated.
According to this configuration, it is possible to prevent unnecessary auxiliary images from being displayed unnecessarily for an expert who can take almost the same posture as the sample posture. That is, the skilled person can imitate a sample posture until it reaches a detailed posture, but if the auxiliary image is displayed until that time, the experienced person may feel that the display is troublesome. However, as described above, the condition for creating the auxiliary image is limited to the case where the approximate similarity is higher than the predetermined value and the detailed similarity is lower than the predetermined value, thereby becoming familiar with beginners and music. Since an auxiliary image is displayed only for a player who is not present, it is possible to perform an appropriate image display according to the skill level of the game.

  The auxiliary image generation unit may generate an auxiliary image in which the display form of the part is changed corresponding to the part of the character image corresponding to the details of the sample posture that is not similar.

  When generating the auxiliary image based on the posture of the player detected by the detecting unit, the auxiliary image generating unit may generate the auxiliary image by exaggerating a part corresponding to the details of the sample posture that is not similar.

  A detailed presentation method according to a third aspect of the present invention is a detailed presentation method executed by a game device having a display control unit, a detection unit, a determination unit, and a presentation unit, the display control step, the detection step, and the determination It comprises a process and a presentation process.

  First, in the display control step, a sample posture indicating the posture to be played by the player is displayed on the screen. For example, a sample posture (such as dance choreography or yoga pose) is displayed by a character image or the like. Further, in the detection step, the posture of the player made corresponding to the displayed sample posture is detected. For example, the player's posture is detected by recognizing the photographed player video. In the determination step, the similarity between the detected posture of the player and the displayed sample posture is determined. For example, it is determined how much the player resembles (imitates) the sample posture to perform a dance or a yoga pose. In the presenting step, when the determined similarity is higher than a predetermined value (for example, a value that can imitate the outline of the sample posture), a message for notifying the details of the displayed sample posture is presented. To do. For example, a message indicating the details of the sample posture is presented by voice or image.

That is, when a player such as a beginner plays, there are many cases where the sample posture can only be roughly imitated, and since the degree of similarity determined in the determination step is low, no message is presented in the presentation step. Eventually, when the player can imitate the outline of the sample posture, the degree of similarity determined in the determination step increases and exceeds a predetermined value. Then, in the presenting step, a message for notifying the details of the sample posture is presented.
Thus, when the skill of the player is low, no message is presented and only the sample posture is displayed. Therefore, the player concentrates on imitating the sample posture. Eventually, when the skill of the player increases to such an extent that the outline of the sample posture can be imitated, a message for notifying the details is displayed in addition to the sample posture. Therefore, the player receives this message and tries to imitate even the details of the sample posture that he did not notice.
As a result, it is possible to appropriately present the details of the posture to be performed by the player and to encourage the player to improve.

  A program according to a fourth aspect of the present invention is configured to cause a computer (including an electronic device) to function as the above game device.

  This program can be recorded on a computer-readable information recording medium such as a compact disk, flexible disk, hard disk, magneto-optical disk, digital video disk, magnetic tape, and semiconductor memory.

  The above program can be distributed and sold via a computer communication network independently of the computer on which the program is executed. The information recording medium can be distributed and sold independently of the computer.

  According to the present invention, it is possible to appropriately present the details of the posture to be performed by the player and promote the player to improve.

It is a mimetic diagram showing the outline composition of the typical information processor with which the game device concerning this embodiment is realized. It is a block diagram for demonstrating the schematic structure of the game device which concerns on this embodiment. It is a schematic diagram for demonstrating a sample attitude | position (skeleton model). (A), (b) is a schematic diagram for demonstrating a mode that a skeleton model is produced | generated from the image obtained by image | photographing a player. (A)-(c) It is a schematic diagram for demonstrating a mode that the similarity with the outline and detail of a sample attitude | position are all determined. (A), (b) is a schematic diagram for demonstrating an example of the game image containing a sample character. (A), (b) is a schematic diagram for demonstrating an example of another auxiliary image. It is a flowchart for demonstrating the game control process which concerns on this embodiment. It is a schematic diagram for demonstrating an example of the game image (auxiliary image) which concerns on other embodiment. It is a block diagram for demonstrating the schematic structure of the game device which concerns on other embodiment.

  Embodiments of the present invention will be described below. In the following, for ease of understanding, an embodiment in which the present invention is applied to an information processing apparatus will be described. However, the present invention is similarly applied to information processing apparatuses such as various computers, PDAs, and mobile phones. Can do. That is, the embodiment described below is for explanation, and does not limit the scope of the present invention. Therefore, those skilled in the art can employ embodiments in which each or all of these elements are replaced with equivalent ones, and these embodiments are also included in the scope of the present invention.

  FIG. 1 is a schematic diagram showing a schematic configuration of a typical information processing device in which a game device according to an embodiment of the present invention is realized. Hereinafter, a description will be given with reference to FIG.

  The information processing apparatus 100 includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, an interface 104, a sensor module 105, an external memory 106, and a DVD (Digital Versatile Disc) -ROM drive 107, image processing unit 108, audio processing unit 109, and NIC (Network Interface Card) 110.

  Note that a DVD-ROM storing a game program and data is loaded into the DVD-ROM drive 107, and the information processing apparatus 100 is turned on to execute the program. Realized.

  The CPU 101 controls the overall operation of the information processing apparatus 100 and is connected to each component to exchange control signals and data.

  The ROM 102 records an IPL (Initial Program Loader) that is executed immediately after the power is turned on, and when this is executed, the program recorded on the DVD-ROM is read out to the RAM 103 and execution by the CPU 101 is started. The The ROM 102 stores an operating system program and various data necessary for operation control of the entire information processing apparatus 100.

  The RAM 103 is for temporarily storing data and programs, and holds programs and data read from the DVD-ROM and other data necessary for game progress and chat communication.

The sensor module 105 connected via the interface 104 is a module that includes an RGB camera, a depth sensor, and the like, and performs player posture detection and the like.
An RGB camera is an imaging device that can photograph a subject with three primary colors of red, green, and blue. For example, only a player is cut out from a photographed image using a color difference. Is possible.
The depth sensor can detect the distance to the player (that is, the depth) by, for example, a pattern irradiation method or a TOF (Time Of Flight) method.
The sensor module 105 detects, for example, each part such as the head, arm, torso, and leg of the player (human body) based on the image captured by the RGB camera and the depth detected by the depth sensor. Then, a simplified player skeleton model is generated. That is, the player's posture (current posture, a series of movements, etc.) can be detected from this skeleton model.

  In the external memory 106 detachably connected via the interface 104, data indicating game progress, game result log (record) data, and the like are stored in a rewritable manner. For example, the player can appropriately record these data in the external memory 106 by performing a specific operation via the sensor module 105.

  A DVD-ROM mounted on the DVD-ROM drive 107 stores a program for realizing the game and image data and sound data associated with the game. Under the control of the CPU 101, the DVD-ROM drive 107 performs a reading process on the DVD-ROM loaded therein, reads out necessary programs and data, and these are temporarily stored in the RAM 103 or the like.

  The image processing unit 108 processes the data read from the DVD-ROM by the CPU 101 or an image arithmetic processor (not shown) included in the image processing unit 108, and then processes the processed data on a frame memory ( (Not shown). The image information recorded in the frame memory is converted into a video signal (video signal) at a predetermined synchronization timing and output to a monitor connected to the image processing unit 108. Thereby, various image displays are possible.

The image calculation processor can execute a two-dimensional image overlay calculation, a transmission calculation such as α blending, and various saturation calculations at high speed.
In addition, the polygon information arranged in the virtual three-dimensional space and added with various kinds of texture information is rendered by the Z buffer method, and a rendered image is obtained by overlooking the polygon arranged in the virtual three-dimensional space from a predetermined viewpoint position. High speed execution of the obtained operation is also possible.

  Further, the CPU 101 and the image arithmetic processor operate in a coordinated manner, so that a character string can be drawn as a two-dimensional image in a frame memory or drawn on the surface of each polygon according to font information that defines the character shape. is there. The font information is recorded in the ROM 102, but it is also possible to use dedicated font information recorded in the DVD-ROM.

  The audio processing unit 109 converts audio data read from the DVD-ROM into an analog audio signal and supplies the analog audio signal to an external speaker to output the audio. For example, the sound processing unit 109 generates sound effects and music data to be generated during the game under the control of the CPU 101, and outputs sound corresponding to the sound effects from the speaker.

  The NIC 110 is used to connect the information processing apparatus 100 to a computer communication network (not shown) such as the Internet, and is based on the 10BASE-T / 100BASE-T standard used when configuring a LAN (Local Area Network). Or modems that connect to the Internet using telephone lines, ISDN (Integrated Services Digital Network) modems, ADSL (Asymmetric Digital Subscriber Line) modems, and cables that connect to the Internet using cable television lines A modem or the like, and an interface (not shown) that mediates between them and the CPU 101 are configured.

In addition, the information processing apparatus 100 uses a large-capacity external storage device such as a hard disk so as to perform the same function as the ROM 102, the RAM 103, the external memory 106, the DVD-ROM attached to the DVD-ROM drive 107, and the like. You may comprise.
In addition, it is possible to adopt a form in which a keyboard for receiving a character string editing input from a player, a mouse for receiving various position designations and selection inputs, and the like are connected.

  Further, instead of the information processing apparatus 100 of the present embodiment, a general computer (general-purpose personal computer or the like) can be used as a game apparatus. For example, a general computer, like the information processing apparatus 100, includes a CPU, RAM, ROM, DVD-ROM drive, and NIC, and an image processing unit that has a simpler function than the information processing apparatus 100. In addition to having a hard disk as an external storage device, a flexible disk, a magneto-optical disk, a magnetic tape, and the like can be used. The sensor module can also be connected to a general computer via a general-purpose interface, and can detect the player's posture and the like in the same manner as described above. Then, after the game program is installed, when the program is executed, it functions as a game device.

(Configuration of game device)
FIG. 2 is a schematic diagram showing a schematic configuration of the game apparatus 200 according to the present embodiment. This game device 200 provides a dance game as an example of a music game, and is characterized by appropriately presenting details of the posture (action to be performed) by the player and urging the player to improve.
Specifically, the game device 200 displays a sample character imitating a human on the game screen, and causes the sample character to take a dance (such as choreography of hands and feet) according to the music being played. That is, the sample posture (sample operation) to be performed by the player is displayed. The player tries to take the same posture as this sample posture (let's dance the same dance). Then, the game device 200 detects the actual posture of the player and compares the sample posture with the sample posture to evaluate the player's dance. Hereinafter, such a game apparatus 200 will be described with reference to this drawing.

  As shown in FIG. 2, the game device 200 includes a game information storage unit 210, a game control unit 220, a music sound output unit 230, a posture detection unit 240, a determination unit 250, and an image generation unit 260. .

The game information storage unit 210 stores various information necessary for a dance game.
For example, the game information storage unit 210 stores a plurality of pieces of music data that can be played, and sample postures (posture information) corresponding to each piece of music. It also stores object information (modeling, images, etc.) such as sample characters necessary for game display.
The sample character causes the player to perform a posture (dance according to the music to be played) based on the sample posture during the game. Specifically, the game information storage unit 210 stores a sample posture (sample operation) as shown in FIG. In other words, the sample posture includes a series of continuous movements.
As an example, the sample posture shown in FIG. 3 is a time series in which a skeletal model composed of parts such as the head, arms, palms (including fingers, etc.), torso, legs, etc. It shows how it is regulated. In order to facilitate understanding of the invention, the skeleton model is visually shown in FIG. 3, but actually, it is defined by numerical information indicating the position and orientation of each part.
Based on such a sample posture, the sample character is controlled by the game control unit 220 described later. Further, this sample posture is also used by the determination unit 250 described later to determine the player's posture.
Note that the RAM 103 and the like described above can function as such a game information storage unit 210.

Returning to FIG. 2, the game control unit 220 controls the entire game apparatus 200 to advance the dance game.
For example, the game control unit 220 causes the sample character to take (dancing) the sample posture (sample operation) of the dance that the player should dance while playing the music. Specifically, the game control unit 220 controls the image generation unit 260 (to be described later) to move (displace) the sample character's head, arms, palm, torso, legs, and the like based on the sample posture shown in FIG. ) To generate an image of a dancing sample character. That is, the sample posture is sequentially displayed by the sample character as the music progresses. Therefore, the sample posture includes a series of continuous movements.
The CPU 101 described above can function as such a game control unit 220.

The music sound output unit 230 is controlled by the game control unit 220 and outputs the music sound of the dance game.
For example, the music sound output unit 230 reads music data selected by the player from the game information storage unit 210 before the game starts (before play), and reproduces the music data after the game starts (during play). And output the music sound.
Note that the music reproduction method is not limited to this, and is arbitrary. For example, the music data may be reproduced while being read sequentially during play.
Note that the audio processing unit 109 described above can function as such a music sound output unit 230.

The posture detection unit 240 detects the posture (motion) of the player made in correspondence with the sample posture displayed by the sample character.
For example, the posture detection unit 240 detects the posture of the player by photographing the player and performing image recognition on the video.
Specifically, the posture detection unit 240 images each part such as the head, arms, palms (including fingers, etc.), torso, and legs of the video (captured image) of the player as shown in FIG. Recognize by analysis. Then, based on the analysis (image recognition), a skeleton model as shown in FIG. 4B is generated, and the posture of the player is detected. The posture detection unit 240 sequentially detects such a posture of the player (generation of a skeleton model), for example, every 1/60 seconds during the game.
Note that the method of detecting the posture of the player is not limited to the method of analyzing (image recognition) such a player image, and can be appropriately changed according to the actual configuration of the game apparatus 200.
For example, in the case of detecting only the posture of the player's arms (both hands), the player is allowed to dance with a predetermined controller in both hands, and the player's posture (arm posture) is detected via the controller. May be. At that time, the posture of the arm may be detected by obtaining information such as position and acceleration from the controller, and the arm posture may be detected by causing a part of the controller to emit light and recognizing the image thereof. It may be detected.
Note that the sensor module 105 and the like described above can function as such a posture detection unit 240.

Returning to FIG. 2, the determination unit 250 determines the degree of similarity between the detected posture (motion) of the player and the displayed sample posture (sample motion). That is, it is determined how much the player is dancing (imitating) to resemble the sample posture.
For example, the determination unit 250 compares the player posture detected by the posture detection unit 240 with the sample posture stored in the game information storage unit 210 (sample posture according to the progress of music) to determine the similarity. .
That is, the determination unit 250 appropriately compares the skeleton model (player's posture) obtained from the player with the skeleton model (current sample posture) corresponding to the music playback time to determine the similarity. At that time, the determination unit 250 determines a rough similarity (rough similarity) and a detailed similarity (detailed similarity).

An example where the sample posture (skeleton model) is such that the right hand is raised diagonally, the right palm is bent, and all the fingers of the right hand are opened as shown in FIG. Will be described.
First, the determination unit 250 determines the approximate posture in which the arms and legs of a skeleton model (sample posture) as shown in FIG. 5B are enclosed by a predetermined shape (for example, a rectangle) and the posture of the player. In comparison, the approximate similarity is determined. This approximate posture has a certain width such as the approximate posture RA of the right arm, the approximate posture LA of the left arm, the approximate posture RF of the right leg, and the approximate posture LF of the left leg. , The approximate similarity is determined. Therefore, for example, when compared with the above-described skeleton model (player's posture) as shown in FIG. 4B, the right arm is raised and the angle is within the range, the approximate similarity is Is determined to be high (higher than a predetermined specified value).
Further, the determination unit 250 compares the detailed posture of the skeleton model as shown in FIG. 5C (for example, the right elbow RE, the right palm RP, and each right finger RFS) with the posture of the player. The detailed similarity is determined. That is, the warp of the right palm from the positional relationship between the right palm RP and each right finger RFS, and the opening of each right finger from the positional relationship between each right finger RFS are compared with the posture of the player, and a detailed similarity is determined. The Therefore, for example, when compared with a skeleton model (player's posture) as shown in FIG. 4B, for example, the right palm warp and the finger of each right hand are different, so the detailed similarity is low (predetermined) Is lower than the prescribed value).
The CPU 101 described above can function as such a determination unit 250.

Returning to FIG. 2, the image generation unit 260 is controlled by the game control unit 220 to generate a game image along with the progress of the game and display it on a screen (a predetermined monitor).
For example, the image generation unit 260 generates a game image including a sample character representing a sample posture (sample operation) to be performed by the player.
Specifically, the image generation unit 260 includes a character image generation unit 261 and an auxiliary image generation unit 262, and generates a game image as shown in FIG. 6 as an example.
The character image generation unit 261 generates a character image that moves based on the sample posture shown in FIG. 3 described above and stored in the game information storage unit 210. That is, the image of the sample character that dances the dance shown in FIG. 6A by moving (displace) the sample character's head, arms, palms, torso, legs, and the like along the skeleton model of FIG. Is generated.

When the similarity determined by the determination unit 250 described above is higher than a predetermined value (as an example, a value that can imitate the outline of the sample posture), the auxiliary image generation unit 262 does not have a similar sample posture. An auxiliary image for recognizing details of (sample operation) is generated. For example, when the player cannot imitate the details such as opening the finger, the auxiliary image generation unit 262 generates an auxiliary image HG including a message as shown in FIG.
Instead of displaying such a message (auxiliary image), or in addition to displaying the message, the message may be issued by voice. Specifically, the music output unit 230 described above may output a message for recognizing details of a sample posture that is not similar to each other by voice. That is, such a message presentation method can be changed as appropriate, such as image or sound, or image and sound.
Further, the content of the auxiliary image generated by the auxiliary image generation unit 262 can be changed as appropriate. For example, the auxiliary image generation unit 262 may generate an auxiliary image HG in which a dissimilar part (in this case, the finger of the right hand) is enlarged as shown in FIG. 7 (b), an auxiliary image HG in which a dissimilar part (in this example, the finger of the right hand) is highlighted may be generated. That is, these auxiliary images HG are examples, and the display form can be changed as appropriate in order to notice details of the sample postures that are not similar.
In addition to this, the image generation unit 260 also displays an image indicating the score totaled according to the progress of the game, the remaining life value, and the like.
Note that the above-described image processing unit 108 can function as such an image generation unit 260 (character image generation unit 261 and auxiliary image generation unit 262).

(Overview of game device operation)
Hereinafter, the operation of the game apparatus 200 having such a configuration will be described with reference to the drawings. FIG. 8 is a flowchart showing the flow of game control processing executed by the game apparatus 200. This game control process is started, for example, after a music piece to be played is selected by the player.

First, the game device 200 starts playing a music piece (step S301).
That is, the music sound output unit 230 reads the music data selected by the player from the game information storage unit 210 and starts playing.

The game device 200 causes the sample character to dance according to the music to be played (step S302).
That is, the character image generation unit 261 generates an image of a dancing sample character and displays a sample posture to be played by the player. That is, the character image which dances based on the sample posture as shown in FIG. 3 stored in the game information storage unit 210 is generated.
Specifically, the character image generation unit 261 moves (displaces) the sample character's head, arms, palms, torso, legs, and the like along the skeleton model of FIG. ) Etc., an image of a sample character dancing the dance shown in FIG.

The game device 200 detects the posture of the player (step S303).
That is, the posture acquisition unit 240 detects the player's posture by photographing the player and recognizing the video image.
Specifically, the posture detection unit 240 has various parts such as the head, arms, palms (including fingers, etc.), torso, and legs of the player's video (captured image) as shown in FIG. Is recognized by image analysis. Then, based on the analysis (image recognition), a skeleton model as shown in FIG. 4B is generated, and the posture of the player is detected.

The game device 200 determines the player's dance (step S304).
That is, the determination unit 250 determines the similarity by comparing the detected posture of the player with the sample posture (sample posture according to the progress of the music). That is, it is determined how much the player is dancing (imitating) to resemble the sample posture.
Specifically, the determination unit 250 appropriately compares a skeleton model obtained from the player (player's posture) and a skeleton model (current sample posture) corresponding to the playback time of the music to determine similarity. At that time, the determination unit 250 determines a rough similarity (rough similarity) and a detailed similarity (detailed similarity).
For example, the determination unit 250 includes a general posture in which the arms and legs of the skeleton model (sample posture) as shown in FIG. And the approximate similarity is determined.
Further, the determination unit 250 compares the detailed posture of the skeleton model as illustrated in FIG. 5C (for example, the right elbow RE, the right palm RP, and each right finger RFS) with the posture of the player. Then, the detailed similarity is determined.

The game device 200 determines whether or not the similarity is higher than a predetermined value (step S305). For example, it is determined whether the similarity is higher than a value that can imitate the outline of the sample posture. Specifically, it is determined whether or not the above-described approximate similarity is higher than a predetermined value.
When determining that the similarity is not higher than the predetermined value (step S305; No), the game device 200 advances the process to step S307 described later.
Even if the approximate similarity is higher than a predetermined value, if the above-described detailed similarity is higher than the predetermined value and there is no content to be pointed out to the player, the process proceeds to step S307 described later. To do. In other words, only when the approximate similarity is higher than the predetermined value and the detailed similarity is lower than the predetermined value, it is necessary to make the player aware of the details of the dissimilar sample posture. Shall continue.

On the other hand, when it is determined that the similarity is higher than the predetermined value (step S305; Yes), the game device 200 displays an auxiliary image (step S306).
That is, the auxiliary image generation unit 262 generates an auxiliary image for recognizing details of the sample postures that are not similar. Specifically, the auxiliary image HG as shown in FIG. 6B and FIGS. 7A and 7B is generated.

  The game device 200 calculates and displays the score and the like (step S307). That is, from the comparison between the player's posture and the sample posture, the score is added, the remaining life value is subtracted, and the value and the like are synthesized in the game image.

The game device 200 determines whether or not the game has ended (step S308). That is, it is determined whether or not the dance game for one time (one song) has been completed. In addition, when the remaining life value becomes zero at the time of calculating the above score or the like, it is determined that the dance game is finished.
If it is determined that the game has not ended (step S308; No), the game device 200 returns the process to step S302 described above. Then, the processes of steps S302 to S308 are repeatedly executed.
On the other hand, when it is determined that the game has ended (step S308; Yes), the game device 200 displays a predetermined end message, a total score, and the like, and then ends the game control process.

In such a game control process, when a player such as a beginner plays, in many cases, the sample posture can only be roughly imitated, and since the degree of similarity determined is low, no auxiliary image is generated. Eventually, when the player can imitate the outline of the sample posture, the degree of similarity to be determined increases and exceeds a predetermined value. Then, an auxiliary image is generated and displayed to make the player aware of the details of the sample postures that are not similar.
Thus, in a state where the skill of the player is low, no auxiliary image is displayed, and only the sample posture by the sample character is displayed. Therefore, the player concentrates on imitation of the sample posture. When the skill of the player increases to such an extent that the outline of the sample posture can be imitated, an auxiliary image for notifying the details of the sample posture that is not similar to the sample character is displayed. Therefore, the player tries to imitate even the details of the sample posture that he / she did not notice from this auxiliary image.
As a result, it is possible to appropriately present the details of the posture to be performed by the player and to encourage the player to improve.

(Other embodiments)
In the above embodiment, the case where an auxiliary image indicating the part of the sample character or the like is generated in order to notice the details of the sample posture has been described. However, an auxiliary image that can compare the detected player's posture with the sample character is described. It may be generated.
For example, the auxiliary image generation unit 262 generates an auxiliary image with a character different from the sample character based on the posture (skeleton model) of the player detected by the posture detection unit 240. In order to notice the details of the posture, the part (part) is exaggerated more.
Specifically, as illustrated in FIG. 9, the auxiliary image generation unit 262 generates an auxiliary image HG (another character) based on the posture of the player, next to the sample character MC. Even in this example, the auxiliary image HG exaggerating the appearance that the fist is hardened (the right finger is tied) is generated as a dissimilar part.
With such an exaggerated auxiliary image HG, it is possible to make the player aware of details of the sample posture that are not similar.

In the above embodiment, the music game (dance game) has been described as an example. However, the present invention is also applicable to a game that teaches gymnastics, yoga, and the like. In the case of a game in which the player imitates a stationary sample posture as opposed to a game in which the player imitates a sample posture with a series of movements such as the dance game described above, the determination timing of the player's posture and an auxiliary image The display timing of is slightly different.
In the following, a game in which a player imitates a stationary sample posture will be described using a yoga teaching game (yoga lesson game) as an example.

Also in the yoga lesson game, the above-described game device 200 of FIG. 2 can be employed.
The game information storage unit 210 stores a plurality of sample postures (stationary sample postures) indicating yoga poses to be performed by the player. In addition, the game information storage unit 210 also stores a duration determined according to each sample posture (each pose). That is, in the yoga lesson game, it is stipulated that the player continues the yoga pose (stationary pose) for a long time (for example, several minutes). The time is stored in association with the sample posture.
The character image generation unit 261 generates a character image indicating a yoga pose based on the sample posture stored in the game information storage unit 210. Note that the character image generation unit 261 generates a character image based on the next sample posture when the duration (the duration corresponding to the sample posture) stored in the game information storage unit 210 has elapsed.

  The posture detection unit 240 detects the posture (pose) of the player that is made corresponding to the sample posture displayed by the sample character. Then, the determination unit 250 determines the degree of similarity between the detected player posture and the displayed sample posture. That is, the determination unit 250 determines how much the player takes a yoga pose by imitating (simulating) the sample posture.

More specifically, for example, the determination unit 250 determines the player's posture detected by the posture detection unit 240 and the game every time a predetermined time (for example, 10 seconds) elapses while the player stops the posture. The similarity is determined by comparing the sample posture (corresponding sample posture) stored in the information storage unit 210. At this time, as described above, the determination unit 250 determines a rough similarity (rough similarity) and a detailed similarity (detailed similarity).
By this determination, when the approximate similarity is higher than the predetermined value and the detailed similarity is lower than the predetermined value, the auxiliary image generating unit 262 makes the auxiliary image for recognizing the details of the dissimilar sample postures. Is generated.

In such a yoga lesson game, since the player continues to imitate a stationary sample posture for a long time, the player's posture with respect to one sample posture is repeatedly determined every predetermined time.
Specifically, when the player imitates the first-look pose (basic posture), the sample posture is often imitated only roughly at first. Therefore, the degree of similarity determined by the determination unit 250 is low, and the auxiliary image generation unit 262 does not generate an auxiliary image. That is, no auxiliary image is displayed, and only the sample posture by the sample character is displayed. Therefore, the player concentrates on imitation of the sample posture.
Eventually, when the player can imitate the outline of the sample posture, the similarity determined by the determination unit 250 increases and exceeds a predetermined value (if only the approximate similarity is higher than the predetermined value). Determined). At that time, the auxiliary image generation unit 262 generates an auxiliary image. That is, in addition to the sample character, an auxiliary image for notifying the details of the sample posture that is not similar is displayed. Therefore, the player tries to imitate even the details of the sample posture that he / she did not notice from this auxiliary image.

Furthermore, when the player can imitate even the details of the sample posture, the determination unit 250 determines that both the approximate similarity and the detailed similarity are higher than a predetermined value, and the auxiliary image generation unit 262 displays the auxiliary image. Stop generation. That is, since it is no longer necessary to be aware of the details of the sample posture, no auxiliary image is generated.
Even if the player intends to maintain the same pose, the player's posture may be slightly collapsed due to fatigue or the like. In that case, the determination unit 250 determines that the detailed similarity is lower than the predetermined value, and the auxiliary image generation unit 262 generates the auxiliary image again. That is, an auxiliary image for notifying the collapsed player posture (details of the sample posture) is displayed.
In this way, in a lesson game in which the player imitates a stationary sample posture, the player's posture is repeatedly determined, and an auxiliary image is displayed as necessary.
As a result, it is possible to appropriately present the details of the posture to be performed by the player and to encourage the player to improve.

  Further, the present invention is not limited to such a yoga lesson game, and can be similarly applied to other games. For example, it can be applied to a body building lesson game. Furthermore, in the above-described dance game, when it is necessary to take a stationary pose between dances as a determined pose, the above-described determination method or the like may be employed only for this determined pose.

In the above embodiment, the case where an auxiliary image made up of a message or the like is displayed in order to notice the details of the sample posture has been described. However, instead of displaying the auxiliary image, a message with the same content may be issued by voice. Good.
Hereinafter, a game apparatus 300 that outputs a voice message in order to make the details of the sample posture noticeable will be described with reference to FIG. FIG. 10 is a schematic diagram showing a schematic configuration of a game apparatus 300 according to another embodiment. A case where the game apparatus 300 executes a dance game will be described as an example.

As illustrated, the game apparatus 300 includes a game information storage unit 210, a game control unit 220, a music sound output unit 230, a posture detection unit 240, a determination unit 250, a display control unit 370, and a presentation unit 380. With.
Note that the game information storage unit 210 to the determination unit 250 have the same configuration as the game device 200 of FIG. 2 described above.

The display control unit 370 generates a game image along the progress of the dance game and displays it on the screen (predetermined monitor).
That is, the display control unit 370 generates a game image including a sample character representing a sample posture to be played by the player. Specifically, the display control unit 370 generates a game image including the sample character MC as shown in FIG.

  If the similarity determined by the determination unit 250 is higher than a predetermined value (for example, a value that can imitate the outline of the sample posture), the presentation unit 380 notices details of the sample posture that are not similar A message is displayed by voice. In addition, the presentation method for noticing the details of dissimilar sample postures may be presented not only in such a sound but also in a combination of an image and a sound.

Also in this game apparatus 300, when a player such as a beginner plays, there are many cases where the sample posture can only be roughly imitated, and the similarity determined by the determination unit 250 is low, so the message is displayed at the presentation unit 380. Not presented. Eventually, when the player can imitate the outline of the sample posture, the degree of similarity determined by the determination unit 250 increases and exceeds a predetermined value. If it does so, the presentation part 380 will present the message which makes the detail of a sample attitude | position aware with an audio | voice.
Thus, when the skill of the player is low, no message is presented and only the sample posture is displayed. Therefore, the player concentrates on imitating the sample posture. Eventually, when the skill of the player increases to such an extent that the outline of the sample posture can be imitated, a message for notifying the details in addition to the sample posture is presented. Therefore, the player receives this message and tries to imitate even the details of the sample posture that he did not notice.
As a result, it is possible to appropriately present the details of the posture to be performed by the player and to encourage the player to improve.

In addition, when the game apparatus 300 executes a lesson game such as yoga, the determination is repeatedly made at predetermined time intervals. That is, in a lesson game in which the player imitates a stationary sample posture, the player's posture is repeatedly determined, and a message for recognizing the details of the sample posture that is not similar is presented by voice as necessary.
Also in this case, it is possible to appropriately present the details of the posture to be performed by the player and promote the improvement of the player.

  As described above, according to the present invention, it is possible to provide a game device, a detailed presentation method, and a program that can appropriately present details of the posture to be performed by the player and prompt the player to improve.

100 Information processing apparatus 101 CPU
102 ROM
103 RAM
104 Interface 105 Sensor Module 106 External Memory 107 DVD-ROM Drive 108 Image Processing Unit 109 Audio Processing Unit 110 NIC
200,300 Game device 210 Game information storage unit 220 Game control unit 230 Music sound output unit 240 Attitude detection unit 250 Determination unit 260 Image generation unit 370 Display control unit 380 Presentation unit

Claims (6)

A display control unit that displays a sample posture indicating a posture to be played by the player on the screen;
A detection unit for detecting a posture of the player corresponding to the displayed sample posture;
A determination unit that determines the degree of similarity between the detected posture of the player and the displayed sample posture;
A presentation unit for presenting a message for notifying the details of the displayed sample posture when the determined similarity is higher than a predetermined value ;
The determination unit determines an approximate similarity between the outline of the sample posture and the player's posture, and a detailed similarity between the details of the sample posture and the player's posture,
The presenting unit presents a message for recognizing details of sample postures that are not similar when the determined approximate similarity is higher than a predetermined value and the determined detailed similarity is lower than a predetermined value. To
A game device characterized by that. A game device that displays a generated image on a screen and evaluates a corresponding posture of a player,
A storage unit for storing a sample posture that defines a posture to be played by the player;
A character image generation unit that generates a character image based on the stored sample orientation;
A detection unit for detecting the posture of the player made corresponding to the generated character image;
A determination unit for determining a similarity between the detected posture of the player and the stored sample posture;
An auxiliary image generation unit that generates an auxiliary image for recognizing details of a sample posture that is not similar when the determined similarity is higher than a predetermined value ;
The determination unit determines an approximate similarity between the outline of the sample posture and the player's posture, and a detailed similarity between the details of the sample posture and the player's posture,
The auxiliary image generation unit is configured to assist in recognizing details of sample postures that are not similar when the determined approximate similarity is higher than a predetermined value and the determined detailed similarity is lower than a predetermined value. Generate images,
A game device characterized by that. The game device according to claim 2 ,
The auxiliary image generation unit generates an auxiliary image in which the display form of the part is changed corresponding to the part of the character image corresponding to the details of the sample posture that is not similar.
A game device characterized by that. The game device according to claim 2 ,
The auxiliary image generation unit generates an auxiliary image by exaggerating a part corresponding to details of a sample posture that is not similar when generating an auxiliary image based on the posture of the player detected by the detection unit;
A game device characterized by that. A detailed presentation method executed by a game device having a display control unit, a detection unit, a determination unit, and a presentation unit,
A display control step in which the display control unit displays a sample posture indicating a posture to be played by the player on the screen;
A detection step in which the detection unit detects a posture of the player made corresponding to the displayed sample posture;
A determination step in which the determination unit determines the degree of similarity between the detected posture of the player and the displayed sample posture;
A presentation step of presenting a message for notifying the details of the displayed sample posture when the determined similarity is higher than a predetermined value ;
In the determination step, a rough similarity between the outline of the sample posture and the posture of the player, and a detailed similarity between the details of the sample posture and the posture of the player are respectively determined.
In the presenting step, when the determined approximate similarity is higher than a predetermined value and the determined detailed similarity is lower than a predetermined value, a message for notifying the details of the sample postures that are not similar is presented. To
Detailed presentation wherein a call. Computer
A display control unit for displaying a sample posture indicating a posture to be played by the player on the screen;
A detection unit for detecting a posture of the player corresponding to the displayed sample posture;
A determination unit for determining a similarity between the detected posture of the player and the displayed sample posture;
When the determined degree of similarity is higher than a predetermined value, function as a presentation unit that presents a message for notifying the details of the displayed sample posture ,
The determination unit determines an approximate similarity between the outline of the sample posture and the player's posture, and a detailed similarity between the details of the sample posture and the player's posture,
The presenting unit presents a message for recognizing details of sample postures that are not similar when the determined approximate similarity is higher than a predetermined value and the determined detailed similarity is lower than a predetermined value. To
Program for causing to function as.

Images