KR20120048334A - The video game console - Google Patents

Abstract

PURPOSE: A video game machine is provided to rapidly and accurately recognize detail movement of arms hand hands of a player while grasping the whole movement of the player. CONSTITUTION: A video game machine comprises an operating device(10) and a main body(20). The main body recognizes the whole movement pattern of a player around the joints of the player. The operating device comprises a plurality of buttons and action detection sensors and is placed in the hand or foot of the player. The controller of the main body is equipped with a pretreatment module, a video information extraction module, a motion confirmation module, a segmentation module, a recognition module, and a control module.

Description

A video game machine that checks the movement of a specific segmented part while watching the player's overall movement. {The video game console}

The present invention relates to a system for enjoying a game by instructing the user to take an appropriate movement and confirming the result of the operation according to the present invention. By grasping the movement path of the hand and the foot, it is possible to recognize the details quickly and accurately while overcoming the problem of incorrect recognition result due to the difference in height or body shape.

A typical video game machine that recognizes motion is Will's game system, developed by Nintendo.

Here, the game system as described above is composed of a main body and an operation device, and a general operation device includes an infrared sensor, a gyro sensor, and a plurality of buttons, such that the player looks at the screen on the display device and punches or moves up and down. When a specific operation is taken, the fact is detected and transmitted to the main body, and the main body is configured to include a receiver to check whether or not a given operation is performed based on the transmitted values.

At this time, the game system as described above checks the operation of the player only by the movement of the operating device in the hand in which the infrared sensor and the gyro sensor are installed. Taking detailed movements such as torsion of the shoulders does not recognize the result and was inaccurate even if recognized.

In other words, the conventional game system recognizes the player's entire movement pattern as a partial movement pattern, so that even if the processing result is late and recognized, there was an inaccuracy.

In addition, when the user moves fast, some missing information is lost to the main body, so that the player can move slowly to obtain accurate information and recognize it. Especially, the conventional game system can only recognize one-dimensional information. Because they are acquired and recognized, different recognition results are calculated for each user even if different people (children and young people) with different heights or shapes take the same action.

Accordingly, the present invention enables the user to grasp the overall movement of the player while allowing the user to quickly and accurately recognize the detailed movement of the hand or the arm, and a wrong recognition result occurs due to the difference in the height or body of each user. To overcome.

To this end, the present invention divides and recognizes each part (arm, leg, head, torso) of the player through the camera of the main body, which is the second person view, and also divides each part using the motion detection sensor of the operation device that is the first person. By detecting and confirming the movement path of a specific part, it is possible to recognize the movement of each part based on the overall movement of the user so that it can recognize the detail quickly and accurately, while the same key or body type is different for each player. The recognition result is secured.

Since the present invention detects and recognizes the movement of the player in the second person view through the camera of the main body and in the first person view through the operation device, it recognizes the movement of each part or specific part while checking the overall movement of the player. Detailed and fast processing time and accurate recognition results were obtained.

In addition, the present invention, even if some of the information detected through the motion sensor due to the rapid movement of the player, because the camera of the main body observes the user's overall movement, incorrectly recognized or wrong operation results are calculated While this is minimized, it can be applied to sports or dance games requiring intense movement and can be implemented to have a speedy feeling.

In addition, since the present invention divides and recognizes each part, even if each user has a different key or body type, the same operation results in the same operation so that everyone regardless of gender or age can enjoy.

1 is an exemplary view according to an embodiment of the present invention.
2 is a block diagram according to an embodiment of the present invention.
3 is a block diagram according to a second embodiment of the present invention.
4 is a block diagram according to an embodiment of the present invention.
5 is a flow chart according to an embodiment of the present invention.

Hereinafter, specific details for carrying out the present invention will be described in detail with reference to the accompanying drawings.

1 illustrates an example of a player dancing according to an exemplary embodiment of the present invention, and FIG. 2 illustrates an internal configuration of a main body 20 and an operating device according to an exemplary embodiment of the present invention. The present invention outputs a dancing motion to the display device 21 to perform a specific motion or a specific motion. In addition, the image device 22 divides and recognizes each part of the user and then determines whether each part has a specified motion. It comprises a main body 20 to check whether or not, including a motion detection sensor 11 and a plurality of buttons made to include an operation device for detecting the movement of each part (head, arm, leg, torso) of the user.

Here, the operation device includes a motion detection sensor 11 and a button, and an operation control unit 13 and a transmission unit 12 and may be manufactured in various forms, but glove that can be grasped or mounted in the hand according to an embodiment. It can also be manufactured in the form of a pad and a floor pad. In addition, the motion detection sensor 11 of the operation device is made of an infrared sensor, a pressure sensor or a strain gauge and a gyro sensor, and the like, and when the arm is made in a form that can be grabbed or mounted in the arm Through the infrared sensor and the gyro sensor of the operating device mounted on the main body 20 is to determine the movement path of the arm.

In addition, it is possible to check the exact movement path and movement by grasping the direction of the torsion or force applied to one side through the pressure sensor installed in the control device or through the strain gauge. Therefore, the strength or strength of the punch can be changed.

In addition, the main body 20 includes an image processing unit connected to one or more image devices 22 that can grasp the overall movement of the user, and also an image processing unit and main unit for dividing and recognizing each part of the entire image. It includes the control unit 24 and the receiving unit 23 for receiving the information transmitted from the operating device. At this time, the main body 20 separately extracts and removes only background information that does not change as the user moves based on the image information transmitted from the image device 22, and recognizes each part by using only the remaining user's image information. Done.

In addition, the user's image information is recognized by extracting only the outer information for quick processing, and in particular, it is recognized by dividing each part on the basis of the change of the inclination value of one side and the other side or taking different movements based on the outer information. have. In other words, the part where the tilt value is changed and the part that takes different movements correspond to the joint part or the connection part of each part, and based on this, the parts are recognized to be recognized.

Therefore, the main body 20 can check the operation taken by each part using the information transmitted through the operation device on the basis of the divided hand, foot or torso, while the main body 20 observes the entire situation of the user. Since only the movements of the divided parts can be recognized separately, it can be quickly determined, thereby having a faster processing time.

Furthermore, the present invention monitors the overall movement of the user in the second person view through the image device 22 of the main body 20, and checks the movement of each part in the first person view through the operation device. It secures information and checks the movement of each part while watching the whole situation, and even if it is applied to intense sports or dance games that require fast movements due to the fast processing time, it is carried out with the same speed feeling as the real thing. It can be.

In addition, since the present invention divides and recognizes each part of the player while watching the overall situation, even if the body type, height, or radius of movement of each player is different, everyone has the same feature of recognition. . That is, in the conventional case, even if the adult and the child take the same action, there is a problem that can be recognized differently due to the difference in height. However, since each part is recognized, the same action is indicated for each person. It is characterized by the same recognition result.

In addition, the main body 20 proposes to perform a predetermined operation at a predetermined time in accordance with the music file to be played. In particular, it is determined whether or not the motion of each part coincides with the reproduced video in accordance with the time when the music file is reproduced.

Figure 3 shows the configuration of the main control unit 24 for processing by dividing each part while watching the overall movement of the user according to an embodiment of the present invention, Figure 4 is divided around the player's overall movement pattern and joint area Each part is shown as an example, wherein each module means a functional and structural combination of hardware for performing the technical idea of the present invention and software for driving the hardware.

As shown, the main controller 24 of the present invention includes a preprocessing module 24a, an image information extraction module 24b, a motion confirmation module 24c, a division module 24d, a recognition module 24e, and a control module 24f. ), Database 24g.

First, the preprocessing module 24a is a module that separates and processes only background information photographed with play from image information stored in the allocated memory area, and may include a plurality of filters as necessary. Here, the background information refers to peripheral information that does not change as the player moves. The background information is intended to ensure fast processing time by removing unnecessary information while ensuring clean information as much as possible.

In addition, the image information extraction module 24b is for securing the processing time as fast as possible by binarizing the image information processed by the preprocessing module 24a, and then extracting only the outer information to secure only the outer line of the player. . At this time, the image information extraction module 24b may be implemented to secure each outer line based on the color information.

In addition, the motion confirmation module 24c recognizes a change in the inclination of the outer line of the player extracted through the image information extraction module 24b or a part having different inclinations as a joint or a connection part of the player, so that the entire motion is improved. Check the movement pattern. At this time, the motion confirmation module 24c checks the degree of matching by comparing the motion pattern of the specific motion presented by the control module 24f through the display apparatus 21 based on the player's motion pattern, and calculates the result. To the control module 24f.

In addition, the motion confirmation module 24c may directly check the degree of coincidence as described above. However, the motion confirmation module 24c may perform a comparison confirmation process by the called control module 24f.

In addition, the splitting module 24d divides each part (head, torso, arm, leg) on the basis of each joint part or connection part of the player identified through the motion checking module 24c, and also divides each part. It is to recognize and process only the part selected through the operation device separately.

In addition, the recognition module 24e checks whether there is any movement based on the movement of the selected region among the regions divided by the division module 24d. At this time, the recognition module 24e calls the control module 24f to receive information (speed, direction, torsion, pressure, other information) of the operation device received by the receiver 23, and from the operation device. Based on the transmitted information, it is possible to check the movement path, twist or motion pattern of the selected part.

In addition, the control module 24f is called by the motion checking module 24c and the recognition module 24e to provide necessary information and receives the resultant value, while watching the entire movement pattern of the player. It is possible to check in detail how the movement of a specific part was taken.

In addition, the control module 24f displays a predetermined operation at a predetermined time in accordance with the music file to be played. In addition, the result is calculated according to the degree of agreement.

In this case, according to an embodiment of the present invention, each part may be separately recognized without looking at the entire movement of the player in order to secure fast processing time, and then only the movement of the specific part may be separately identified and processed.

In addition, Figure 4 shows an example of checking the overall movement of the user around the joint portion of the image information recording the movement of the player, and separately processing only the hair of the specific part in close contact with the control device of the divided parts As shown, the motion check module 24c may be used to check the overall movement pattern of the player based on a part in which the tilt direction is changed or takes different movements. In addition, the dividing module 24d can be divided into a region, b region and c region around the joint portion. At this time, the area a is the arm on which the operating device is mounted, and the area b and the area c are the parts on which the operating device is not mounted.

In addition, the database 24g stores a movement pattern of the displayed image, and stores an operation pattern or a movement path of a specific portion of the movement patterns, and according to an embodiment, one or more databases 24g. It may be made of.

Hereinafter, the operation of the present invention will be described in detail with reference to FIGS. 5 and 6.

First, the main body 20 displays a specific operation in a state where the main body 20, the operation device, the image device 22, and the display device 21 are provided. Then, the main body 20 drives the imaging device 22 to capture the movement of the player (S101), and the main body 20 stores the captured image information in the allocated memory and stores the preprocessing module 24a. After filtering unnecessary background information, only necessary video information of the player is acquired (S102).

The main body 20 acquires only the outer line information of the player through the image information extraction module 24b based on the filtered information (S103), and changes the inclination of the outer line through the motion checking module 24c or Recognizing portions having different inclinations as joint portions or connecting portions of the player is to determine what movement pattern the overall movement is (S104). At this time, in the present invention, the motion confirmation module 24c calls the control module 24f to check the degree of matching by comparing with the movement pattern of the specific operation presented through the display apparatus 21, and the result is the control module. It may be applied to (24f).

Then, the main body 20 recognizes each part by dividing each part around the joint part or the connection part through the splitting module 24d, and processes only the information of the selected part of the hand or leg or the body which grabbed the operation button. S105)

At this time, the recognition module 24e of the main body 20 calls the control module 24f to determine the area of the portion where the division module 24d is selected based on the information (speed, direction, torsion, pressure) applied from the operation device. The movement path, the torsion or the movement pattern are checked in detail. (S106, S107)

At this time, the control module 24f can check the movement of a specific part in detail through the recognition module 24e while checking the entire movement pattern of the player by the motion confirmation module 24c, so that the movement of the player can be correctly recognized. After that, it is possible to calculate an accurate result value compared with the operation instructed (S108).

At this time, in the present invention, as shown in FIG. 6, the motion checking module 24c recognizes only the joint part or the connecting part of the player (S204), and then grabs the operation device through the splitting module 24 d. Only a clenched hand or a specific part of the leg or body in close contact with the control device can be divided and recognized. (S205)

In this case, the divided part checks which operation pattern is taken based on the information acquired from the manipulation apparatus (S206, S207), and compares the indicated action with the movement of the player to calculate a result value. (S208)

Therefore, the present invention is to be able to quickly and accurately determine what operation pattern the player has taken with the minimized image data.

10: operating device 11: motion detection sensor
12: Transmission unit 13: Operation control unit
20: main body 21: display device
22: image device 22a: image processing unit
23: receiver 24: main controller
24a: preprocessing module 24b: image information extraction module
24c: Motion confirmation module 24d: Split module
24e: recognition module 24f: control module
24g: Database

Claims (3)

A control device comprising a plurality of buttons and a motion detection sensor and mounted or positioned on a hand or foot for operation;
Display a specific motion on a display device and take a motion corresponding to the displayed motion by using the control device, and compare the motion pattern of the motion taken by the player with the motion of the displayed motion based on information applied from the control device. In the video game machine system comprising a main body to enjoy the game,
The game system includes at least one video device capable of capturing the entire movement of the player,
The main body recognizes the entire movement pattern of the player based on the joint part of the player based on the image information photographed by the imaging device, divides the limb around the joint part, and then selects a specific part of each divided part. A video game machine for checking the movement of a specific part of a segment while observing the entire movement of the player, wherein the movement of the specific part is confirmed based on the information obtained through the operation device. The method of claim 1,
The control unit of the main body is a pre-processing module for filtering only the background information of the image information stored in the allocated memory area does not change as the player moves;
An image information extraction module for extracting only the outer information from the image information based on the filtered image information through the preprocessing module to secure only the outer line information of the player;
A motion check module for recognizing the change of the inclination of the outer line of the player or the parts having different inclinations extracted through the image information extraction module as the joints or connection parts of the player and checking the overall movement pattern of the player based on this;
Each part (head, torso, arm, leg) is divided based on each joint part or connection part of the player identified through the motion checking module, and separately recognizes only the selected specific part in close contact with the operation device among the divided parts. A splitting module,
Recognition module for receiving the information of the operating device transmitted from the operating device on the basis of the specific portion selected through the splitting module to check the movement path or twist or operation pattern of the selected specific portion;
Called by the motion confirmation module and the recognition module to provide the necessary information, while receiving the necessary information through the motion confirmation module and the recognition module to check the movement of the selected specific part while watching the entire movement pattern of the player, and display And a control module configured to calculate and display a result value according to the degree of matching and display the result of comparison with a specific motion. The method of claim 1,
The controller of the main body includes a preprocessing module for filtering only background information of the image information stored in the allocated memory area that does not change as the player moves;
An image information extraction module for extracting only the outer information based on the filtered image information through the preprocessing module to secure only the outer line of the player;
A motion check module for recognizing a change in the inclination of the outer line of the player extracted through the image information extraction module or a part having a different inclination as a joint or a connection part of the player;
A splitting module for separately recognizing and processing only a specific part selected by the user in close contact with the control device based on each joint part or connection part of the player identified through the motion checking module;
Recognition module for receiving the information of the operating device transmitted from the operating device on the basis of the specific portion selected through the splitting module to check the movement path or twist or operation pattern of the selected specific portion;
Called by the recognition module to provide the information of the operation device to the recognition module while receiving the result confirmed by the recognition module to compare the movement of the selected specific region and the movement of the displayed specific motion and the result according to the degree of matching And a control module configured to calculate and display a value, wherein the video game machine checks the movement of the divided specific part while watching the entire movement of the player.

Images