JP3904706B2 - Playground equipment and method for controlling the same - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a playground equipment to which distance image acquisition means for acquiring a distance image is applied, and a control method for the same.
[0002]
[Prior art]
Conventionally, as a playground equipment called an arcade game machine or the like, many games using human movement such as a boxing game and a shooting game have been developed. In a boxing game, the pressure when a user actually hits a sandbag is physically measured. At this time, only the pressure at the moment when the user's punch hits the sandbag is measured. It is not used how fast and how fast the punch is fed from the user. For this reason, it has become a monotonous game that simply competes for punch strength.
[0003]
In the shooting game, a light emitter is attached to the tip of a toy gun, and it detects where the light from the light emitter is on the screen. When the gun is triggered, it is determined that the bullet has hit the object that is hit by light. Because of this simplicity, rather than competing for shooting skills, it has become a game that only finds the presented target and competes for reflexes to shoot.
[0004]
On the other hand, a method of recognizing the position of a human body by analyzing an image captured using a CCD camera or the like is used. In this method, first, the traveling direction is imaged using an imaging device such as a CCD camera. Next, in the case of extracting a human from the image, for example, the face or hand color is flesh-colored, so other unnecessary parts such as the background are removed, and only the target to be recognized, such as an obstacle, is cut out. Process. Then, the shape of the object is recognized by using the processed image.
[0005]
First, the pre-processing part of extracting the recognition target will be described. In the conventional technique, as an operation means for cutting out only a portion of the target object to be acquired from an image photographed by the camera, the target object is cut out by using some difference between the target object and the other part as a clue. .
[0006]
As a clue, a method using a change in hue or a method using a difference image is used. When cutting out using colors, a portion with a large hue difference is extracted, and processing such as thinning is performed to extract edges. When targeting humans, attention is paid to the skin color of the face and hand parts, and only the hue part is extracted.
[0007]
However, the method of using the hue difference changes depending on the color and angle of illumination, even if it is called skin color, and if the background hue is close to skin color, it is difficult to distinguish it from human skin color. It is difficult to cut out regularly. In addition, in the state where there is no illumination, the entire captured image becomes dark, and it is difficult for a human to discriminate an object from a photograph taken in the dark.
[0008]
Alternatively, there is a method of calculating a motion vector between frames of a video image and analyzing a moving object. In this case, there is no problem as long as there are few moving objects, but if there are many moving objects, the number of motion vectors suddenly increases, the load of calculating motion vectors between frames increases, and the calculation cannot catch up.
[0009]
[Problems to be solved by the invention]
Thus, in the conventional system, a game that makes use of the body movement of the user of the playground equipment has not been realized. In addition, the method of imaging a body movement and processing the image has strict restrictions, and has a disadvantage that it is not sufficiently effective for a high price.
[0010]
The present invention has been made in view of such circumstances, and by obtaining a distance image in the most suitable direction for capturing the user's motion and controlling the game, the user's body movement is inexpensive. It is an object of the present invention to provide a playground equipment device that can realize a game that takes advantage of the game, and a control method for the device.
[0011]
[Means for Solving the Problems]
  In order to achieve the above-described object, the gaming device of the present invention provides:Distance image acquisition means for receiving reflected light from an object irradiated with light and acquiring a distance image, image processing means for extracting the shape and action of the object from the distance image, and storing the shape and action It has a storage means and a presentation means for presenting the shape and operation stored in the storage means.
[0012]
  Also,The gaming apparatus according to the present invention includes a distance image acquisition unit that receives reflected light from an object irradiated with light and acquires a distance image, an image processing unit that extracts the shape and motion of the object from the distance image, Character generating means for analyzing the distance image to generate a character, and character control means for controlling the movement of the character generated by the character generating means based on the shape and motion of the object extracted by the image processing means And presenting means for presenting the character.
[0014]
DETAILED DESCRIPTION OF THE INVENTION
Embodiments of the present invention will be described below with reference to the drawings.
(First embodiment)
First, a first embodiment of the present invention will be described.
[0015]
FIG. 1 is a schematic configuration diagram of the playground equipment according to the first embodiment, and FIG. 2 is an external view of the image acquisition unit 1 in the configuration of FIG.
As shown in FIG. 1, the playground equipment according to the first embodiment receives a reflected light to acquire a distance image, for example, an image acquisition unit 1 as shown in Japanese Patent Application No. 8-275949. Based on the analysis result of the image processing unit 2 that analyzes the acquired distance image, extracts the target, calculates the distance to the target, and the like, and is composed of, for example, a small liquid crystal panel The game control unit 3 controls the content presented to the presented unit 4.
[0016]
FIG. 2 is an external view of the image acquisition unit 1 as shown in Japanese Patent Application No. 8-275949. The center circle (a) is a lens, and the small circle (b) arranged in the periphery corresponds to, for example, an LED that emits light such as infrared rays. The light emitted from the LEDb is reflected by the object, collected by the lens a, and received by the area sensor at the rear of the lens a. The image acquired in this way has a format as shown in FIG. 3, for example.
[0017]
FIG. 3A shows a part of the acquired image data (a part of 256 × 256, 8 × 8). In this example, the value of the cell in the matrix indicates the intensity of the acquired reflected light with 256 bits. A cell having a value of 255 indicates the state closest to the image acquisition unit 1, and a cell having a value of 0 is far from the image acquisition unit 1, indicating that the reflected light does not reach the image acquisition unit 1. ing. FIG. 3B shows the entire acquired image data three-dimensionally. In this example, data obtained from a human hand is shown.
[0018]
The image processing unit 2 receives the distance image acquired by the distance image acquisition unit 1 in the format shown in FIG. 3A, and performs various image processing such as edge cutout, centroid extraction, and area calculation.
[0019]
If the pixel value of (i, j) is Pij and the pixel of the contour information to be generated is Rij,
Rij = 255
(If (Pij−Pi−1j)> α & Pij−Pij)> α & (Pij−Pi + 1j)> α & (Pij−Pij + 1)> α)
Rij = 0 (other than above)
By doing so, contour information as shown in FIG. 4 can be obtained.
[0020]
What kind of gesture the shape extracted in this way is depends on whether the image processing unit 2 is matched with a recognition dictionary stored in a format as shown in FIG. Make a decision.
[0021]
Here, as shown in FIG. 1, the image acquisition unit 1 can acquire the speed of the user's arm to be fed and the shape of the hand, and the normal direction of the presentation surface of the presentation unit 4. It is installed to acquire images in the orthogonal direction.
[0022]
Usually, the user performs various gestures on the assumption that there is a game opponent in the presenting unit 5. For this reason, for example, in the case of a Janken game, a Janken game is performed on the presentation surface of the presentation unit 4 as shown in FIG. 6A or 6B. Then, it is assumed that the image acquisition unit 1 is placed on a position parallel to the presentation surface, for example, on the presentation unit 4 as shown in FIGS. At this time, as shown in FIG. 5 (a), when the palm is presented at a position substantially parallel or oblique to the presentation surface, there is no problem and the pattern dictionary stored in the format shown in FIG. 5 can be matched. it can. However, as shown in FIG. 6 (b), if the fingertip is moved so that the fingertip faces the presentation surface, almost no palm image can be acquired.
[0023]
On the other hand, for example, as shown in FIG. 6C, orthogonal to the direction of the direction of the direction of the presentation surface so that a distance image can be acquired when the palm is facing the presentation surface or not. If the image acquisition unit 1 is placed at a position where an image in the direction to acquire can be acquired, the user's gesture can be acquired without blind spots.
[0024]
As described above, according to the gaming apparatus of this embodiment, the user's body, hand shape, movement, and the like can be captured with high accuracy from the distance image acquired by the image acquisition unit 1. A game that makes use of the movement can be realized, and the user can operate without being aware of the position of the camera, so the effect is great.
[0025]
In the first embodiment, the number of image acquisition units 1 is one, but the number is not necessarily limited to this. For example, it is also effective to use a plurality of image acquisition units 1 as shown in FIG. At this time, at least one image acquisition unit 1 (referred to as a first image acquisition unit) acquires an image in a direction orthogonal to the normal direction of the presentation surface of the presentation unit 4 as in the first embodiment. It is installed as possible. Further, another distance image acquisition unit 1 (referred to as a second image acquisition unit) is orthogonal to the first distance image acquisition unit 1 as shown in FIG. Install so that images in a direction parallel to the surface can be acquired. By doing in this way, since the object can be caught from a different angle with the first distance image acquisition unit 1, even if the shape acquired by the first image acquisition unit 1 does not match, the second image Since the shapes acquired by the acquisition unit 1 are matched, the recognition accuracy can be improved.
[0026]
Alternatively, as shown in FIG. 8, in order to input an operation for a playground equipment such as a gesture, an image acquisition unit is provided for a game input board 5 on which a user of the playground equipment places a part of a body such as a hand. It is also possible to install at an angle of 45 degrees. By using such an angle, an image can be acquired with fewer blind spots.
[0027]
(Second Embodiment)
Next, a second embodiment of the present invention will be described.
The playground equipment according to the second embodiment relates to an application to a game in which winning or losing is determined based on an action obtained by analyzing an acquired distance image. FIG. 9 is a schematic configuration diagram of the playground equipment according to the second embodiment.
[0028]
9A is a schematic configuration diagram when a motion is stored in a card, FIG. 9B is a schematic configuration diagram when a game is played with the stored motion, and FIG. 10 is a flowchart of these processes. .
[0029]
The game control unit 3 actually stores the operation processed and extracted by the image processing unit 2 in the portable card-type storage unit 6 or presents the extracted operation to the presenting unit 5 in addition to the actual control. Control the game.
[0030]
The card-type storage unit 6 is composed of a magnetic card, an IC card, or the like, and can be inserted into and removed from the playground equipment body and can be carried. When actually playing the game, as shown in FIG. 9B, the two card-type storage units 6 are inserted into the main body and played. The win / loss determination unit 7 determines the win / loss.
[0031]
The storage in the card type storage unit 6 is performed according to the flow shown in FIG. In the configuration of FIG. 9A, when processing is started, initialization is first performed (step A1). In the initialization, a character (such as a character who fights on behalf of himself / herself during a game) C stored in the card-type storage unit 6, a battle motion (such as a skill during a martial art or a speed at which it is delivered) B, and magic Clear the memory field with motion (such as a curse) M.
[0032]
Next, since various characters are presented on the presenting unit 4, if one of them is selected as his / her favorite character, it is stored in the character C of the card type storage unit 6 (step A2). For example, as shown in FIG. 11, “character N” is selected as the content of the item C in the card-type storage unit 6, and the actual data is stored at the address P1.
[0033]
Since the message “Please enter battle motion” appears on the presentation screen (step A3), the user goes to the presentation unit 4 to use the technique he wants to use, for example, a fist like a fist fight. Move out one after another, or just move your hand as if you were using a sword. Then, these are imaged by the image acquisition unit 1. They are sent to the image processing unit 2 one after another, and their actions are extracted and stored in the card type storage unit 6 (step A4). The image processing unit 2 identifies, for example, the shape of the hand (whether it is a fist, open, two fingers are standing, three fingers are standing, a sword is being formed, etc.). Further, the center of gravity, direction, speed, and the like are extracted. The extracted operation is stored in the item B as shown in FIG.
Contents "Fist center of gravity (x1, y1, z1), direction (nx1, ny1, nz1), velocity (vx1, vy1, vz1), ..."
Indicates that the shape of the hand is a fist, the center of gravity is (x1, y1, z1), the direction is (nx1, ny1, nz1), and the speed is (vx1, vy1, vz1). For example, if the image acquisition unit 2 acquires 30 images per second, 30 values come per second. The address “p1” indicates that the next value is stored in the address p1. Similarly, address p1 has
Contents "Fist center of gravity (x2, y2, z2), direction (nx2, ny2, nz2), speed (vx1, xv2, xz3), ..."
Is remembered.
And
The address becomes “NULL” like the contents “2 centroids (xn, yn, zn), direction (nxn, nyn, nzn), speed (vxn, vyn, vzn), ...,” address “NULL” If there is no following data, it will be understood.
[0034]
Here, it is assumed that 30 pieces of data are stored per second, but the present invention is not necessarily limited to this. For example, the image acquisition unit 1 can acquire 100 images per second, extract 30 pieces of the data, and store them.
[0035]
When the movement is extracted for a certain period of time, the stored movement is reproduced on the presentation unit 4 by the previously selected character (step SA5). If the reproduced motion is not satisfactory (Yes in Step A6), the motion can be performed again and the motion can be re-registered (Step A4).
[0036]
If satisfied (No in step A6), the process proceeds to the magic motion (step A7). Similar to the battle motion, when the motion is performed, as shown in FIG. 11, it is stored in the card type storage unit 6 in the same format as the battle motion (step A8). If the reproduced magic motion is seen (step A9) and not satisfactory (Yes in step A10), it can be corrected (step A8-).
[0037]
Then, using the two card type storage units 6 in which various data are stored in this way, a game is played in the flow shown in FIG. In initialization (step B1), first, the characters C1 and C2, battle motions B1 and B2, and magic motions M1 and M2 stored in the respective card type storage units 6 are read out. Also, prior to the game, a scene for battle is selected (step B2). Depending on the selected scene, how the combat motion and magical motion change. The game control unit 3 has, for example, a knowledge dictionary as shown in FIG. For example, according to FIG. 13, if it is a sandy beach, the battle is martial arts and the magic is black magic. Also, if you are in a spaceship, a sword of force called force is used for battle, and the magic becomes an African magic called voodoo. Or in the sea, fight with underwater guns, and magic becomes a feng shui that is deeply related to water.
[0038]
A signal to start the battle is presented (step B3). If there is no problem, the battle is started, and the motion of the character is calculated, drawn and presented (step B4). Controls whether the technique that is sent out from another input unit such as a gamepad is battle motion or magic motion. On the other hand, based on the battle motions B1 and B2 and the magic motions M1 and M2 read from the card-type storage unit 6, the game control unit 3 delivers various techniques based on the dictionary of FIG. The winning / losing determining unit 7 determines the damages D1 and D2 that are given to the opponent by the delivered technique (step B5). This calculation is performed, for example, by performing a polygon interference check between the characters, another three-dimensional polygon data released by the drawn magic, and a collision check with the character that hits it.
[0039]
It is determined by the game control unit 3 whether or not the calculated damage or battle time has exceeded a certain specified value (step B6). When the specified value is exceeded (Yes in step B6), the game is ended. Then, the result of winning or losing is stored in the card type storage unit 6.
[0040]
Thus, according to the playground equipment of this 2nd Embodiment, since the user can make a character play a game with his / her movement, he can enjoy a variety of play.
[0041]
In the second embodiment, an example of a portable card type is described as the storage means, but it is not necessarily limited to this. For example, it is possible to define a storage format for character, battle, and magic motions and store the file in a normal storage medium such as a hard disk or floppy disk in that format. It is also possible to play a game by exchanging such files on the network instead of actually carrying them around.
[0042]
In addition, in a normal portable storage medium, what kind of content is stored inside, by adding a simple presentation means to the card type storage means, and presenting the character etc. stored in the inside, It is also possible to make it easy to identify. For example, the presenting means can be configured by a small liquid crystal display, and an image of a character stored in the card-type storage unit 6 can be presented. Alternatively, it is possible to distinguish the stored motion from the video corresponding to the stored motion such as battle motion or magic motion (for example, according to the change in the speed of operation and the center of gravity). , The video changes). Alternatively, it is also possible to present the winning / losing stored in the card type storage unit 6. This way, you can see a strong card at a glance.
[0043]
In the second embodiment, a game with two people (two cards) is shown, but the present invention is not necessarily limited to this. For example, three or more people can participate in the game at the same time. It is also possible for one user to use two or more cards. For example, it is also possible to store a game separately, such as a battle motion for one card and a magic motion for another card, and play a game with various battle motions and magic motions. Alternatively, one card stores the basic motion (magic sword swing, fist out, etc.) motion and magic motion, and the other card stores its strength (speed, sharpness, etc.). It is also possible to play by combining these.
[0044]
(Third embodiment)
Next, a third embodiment of the present invention will be described.
The playground equipment according to the third embodiment generates a character by three-dimensional CG or the like based on the acquired distance image.
[0045]
FIG. 14 is a schematic configuration diagram of the playground equipment according to the third embodiment.
As shown in FIG. 14, the playground equipment according to the third embodiment includes a distance image acquisition unit 1 that acquires a distance image, an image processing unit 2 that processes a distance image acquired by the distance image acquisition unit 1, and a distance image. A character generation unit 9 that generates a character based on the distance image acquired by the acquisition unit 1, a character control unit 8 that controls the character generated by the character generation unit 9 based on the processing result of the image processing unit 2, and character control It is comprised from the presentation part 4 which presents a character according to the control result of the part 8. FIG.
[0046]
The character generation unit 9 performs shading based on the distance image as shown in FIG. 3B acquired by the distance image acquisition unit 1 as a wire frame and draws it as a three-dimensional CG (computer graphics) model. The hand character to be presented is presented according to the center of gravity position and orientation calculated by the image processing unit 2 analyzing the image acquired by the distance image acquisition unit 1. The processing flow is as shown in FIG.
[0047]
FIG. 16 shows an example in which the hand of the user who is operating the playground equipment of the third embodiment and the character of the hand created based on the hand are displayed on the presentation unit 4. Yes. In FIG. 16, a scene in which the hand is throwing the ball is displayed. In step C6 of FIG. 15, the character control unit 8 determines whether or not the hand shape is open. If the shape of the hand is open (Yes in Step B6), the ball is fired (Step B7). The initial speed and direction of the launch are the speed and direction of the center of gravity of the hand calculated by the image processing unit 2. On the other hand, if the hand is not open (No in Step B6), the distance image is acquired continuously (Step C2).
[0048]
As described above, according to the playground equipment of the third embodiment, since a part of the human body such as the shape of the hand can be displayed as a three-dimensional character as it is, there is no need to create a troublesome three-dimensional CG model. Thus, a game in a three-dimensional CG environment can be realized at low cost, and the effect is great.
[0049]
In the third embodiment, an example of simply throwing a ball has been described, but the present invention is not necessarily limited thereto. In the third embodiment, the ball is thrown out when the hand is opened. For example, the ball's own attributes (viscosity, elasticity, etc.) may be changed according to the shape and movement of the hand. Is possible. For example, when the hand is rotated with a fist, the ball changes to a pie, and when the hand is opened in that state, the pie is thrown. If you change the direction of the hand, you can also change the throw target. By doing this, you can easily change what you throw and its nature with a slight difference in the shape of your hand, so you can enjoy various variations. How the hand shape and movement change is stored in the character control unit 8 in the form shown in FIG. 17, for example.
[0050]
For example,
“Condition 1: (fist, move) & (open, move)
Result 1: Ball launch, elastic modulus 1 "
Indicates that the ball is fired at the center of gravity speed and direction when the hand is opened and the elastic modulus is 1 when the hand is opened and moved as it is in the state of a fist. Therefore, when the object collides with another object in the three-dimensional space, the reflection motion with the elastic coefficient 1 is performed.
[0051]
on the other hand,
"Condition 2: (fist, rotation) & (open, move)
Result 2: Pie launch, destroy yourself if it collides "
Indicates that if the fist rotates and then opens and moves, the pie will be fired from the hand. Since a pie is not an elastic body like a ball, when it collides, it does not bounce off with an elastic coefficient of 1 like a ball and breaks down. Therefore, when it collides with another object, it breaks and the fragments are attached.
[0052]
“Condition 3: (fist, move) & (one, move)
Result 3: Bullet fire, triple the speed, destroy the opponent when colliding "
Indicates that a bullet has been fired from the pistol when the fist moves and then puts one finger. When a bullet collides, it destroys the object.
[0053]
“Condition 4: (fist, move) & (4, move)
Result 3: slime, viscosity coefficient 3 "
When the fist moves and then four fingers stick out, the slime is fired. The slime is sticky and has a high viscosity coefficient. When it collides with an object, it does not bounce and adheres to the opponent.
[0054]
Thus, it is possible to enjoy various variations depending on the shape and movement of the hand.
Since this gaming machine control method can be realized as software, it is stored in a computer-readable recording medium such as a floppy disk, an optical disk, and a semiconductor memory as a program that can be executed by a computer. Is possible.
[0055]
【The invention's effect】
As described above in detail, according to the present invention, the user's body, hand shape, and movement can be captured with high accuracy from the distance image from an appropriate direction, so that the user's body motion can be utilized at low cost. A game can be realized.
[0056]
In addition, since the character can play the game with his / her movements, it is possible to realize a variety of play.
Furthermore, since a part of the human body such as the shape of a hand can be displayed as a three-dimensional character as it is, there is no need to create a troublesome 3D CG model, and a game in a 3D CG environment can be realized at low cost. Is possible.
[Brief description of the drawings]
FIG. 1 is a schematic configuration diagram of a playground equipment according to a first embodiment of the present invention.
FIG. 2 is an external view of an image acquisition unit according to the first embodiment.
FIG. 3 is a view showing an example of an image format acquired by an image acquisition unit of the first embodiment.
FIG. 4 is a diagram showing an example of a processing result of an image processing unit according to the first embodiment.
FIG. 5 is a diagram showing an example of a storage format of a processing dictionary provided in the image processing unit of the first embodiment.
FIG. 6 is a diagram showing an example of an outline of an operation by a user according to the first embodiment.
FIG. 7 is a schematic configuration diagram of a playground equipment in a modification of the first embodiment.
FIG. 8 is a schematic configuration diagram of a playground equipment according to a modification of the first embodiment.
FIG. 9 is a schematic configuration diagram of the playground equipment according to the second embodiment.
FIG. 10 is a view showing a process flow of the second embodiment;
FIG. 11 is a diagram showing an example of a storage format of operations in the second embodiment.
FIG. 12 is a view showing the flow of processing of the second embodiment.
FIG. 13 is a diagram showing an example of a storage format for scene knowledge in the third embodiment.
FIG. 14 is a schematic configuration diagram of the playground equipment according to the third embodiment.
FIG. 15 is a view showing the flow of processing of the third embodiment.
FIG. 16 is a diagram showing an example of presentation in the third embodiment.
FIG. 17 is a diagram showing an example of a knowledge storage format in a modification of the third embodiment.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 ... Image acquisition part, 2 ... Image processing part, 3 ... Game control part, 4 ... Presentation part, 5 ... Game input board, 6 ... Card-type memory | storage part, 7 ... Win / loss determination part, 8 ... Character control part, 9 ... Character generator.

Claims (8)

Distance image acquisition means for receiving reflected light from an object irradiated with light and acquiring a distance image;
Image processing means for extracting the shape and motion of the object from the distance image;
Storage means for storing the shape and operation;
And presenting means for presenting the shape and operation stored in the storage means,
The playground equipment according to claim 1, wherein the distance image acquisition means is arranged at a position where an image in a direction orthogonal to the normal direction of the presentation surface of the presentation means can be obtained.   The play equipment according to claim 1, wherein the storage means is portable.   The playground equipment according to claim 2, wherein the storage means includes a presentation means for performing presentation according to the processing result of the stored image processing means. Distance image acquisition means for receiving reflected light from an object irradiated with light and acquiring a distance image;
Image processing means for extracting the shape and motion of the object from the distance image;
Character generating means for analyzing the distance image and generating a character;
Character control means for controlling the movement of the character generated by the character generation means based on the shape and motion of the object extracted by the image processing means;
And presenting means for presenting the character,
The playground equipment according to claim 1, wherein the distance image acquisition means is arranged at a position where an image in a direction orthogonal to the normal direction of the presentation surface of the presentation means can be obtained.   The playground equipment according to claim 4, wherein the character control means changes the attribute of the character based on the shape and motion of the object extracted by the image processing means. Receives the reflected light from the object irradiated with light and obtains a distance image,
Extract the shape and motion of the object from the distance image,
Memorize the shape and movement;
Presenting the memorized shape and action;
A method for controlling a playground equipment, comprising: obtaining a distance image from a position where an image in a direction orthogonal to a normal direction of a presentation surface on which the shape and motion are presented can be obtained. Receives the reflected light from the object irradiated with light and obtains a distance image,
Extract the shape and motion of the object from the distance image,
Analyzing the distance image to generate a character,
Based on the shape and motion of the extracted object, control the movement of the generated character,
Presenting the character,
A method for controlling a playground equipment, comprising: obtaining a distance image from a position where an image in a direction orthogonal to a normal direction of a presentation surface on which the character is presented can be obtained.   The method of controlling a playground equipment according to claim 7, wherein the attribute of the character is changed based on the shape and motion of the extracted object.

Images