TWI543804B - A method and apparatus for fingers guessing - Google Patents

Description

Method and device for punching

A technique for making a digital processor and a person perform a punch, in particular, a technique of using a depth of field sensor and a voice recognizer to perform a punch.

Rowing, usually refers to two people punching, the two called A and B, respectively, in the form of a two-person punch (including physical movements) and their predicted values can be divided into two, one for The traditional gesture or limb movement plus the sound, the sound part is a bid (bid) or prediction, predicting the interaction result of the gestures or physical movements of both sides, the most common kind of interaction results such as the gesture of both sides The sum of the numbers, the one who predicts the correct is the winner, the one who is correct is the tie, and the two are wrong. The other is the interaction result of pure gestures or physical movements, excluding the sound parts, such as scissors, stones, cloth, scissors wins cloth, stone wins scissors, cloth wins stones, without sound prediction, directly by gestures can be won The principle of punching by two people can also be applied to multiplayer punching. China Patent Publication No. 201338839 "Balling Robot System" provides a system of punching robots, which is used for interactive kicking games with humans. However, due to the use of general photo photography for gestures, image recognition techniques are used to identify players. The resulting boxing, therefore, will have the following problems: (1). Need to use in the special design background environment, in order to reduce the error rate, if used in the general background, because the background scene is more random and complex, Error rate High. (2). For some applications that require two palms to be used at the same time, there will be situations where the palms are shielded from each other, and the correct gestures of the two palms cannot be correctly distinguished by image processing techniques. (3). Using image processing technology to distinguish the gesture of the palm, the processing time is longer. For those who have a faster punching speed, the computer obviously cannot catch up with the speed. Therefore, the punching can not proceed smoothly. When the speed and correctness of the identification is improved, another problem is that when there is no control of the punching speed, the computer will be allowed to punch out after the computer is finished before the punching work, which will cause the computer to punch out and the player’s timing is inconsistent. In the case, the computer will be out of the boxing of the player or the player will be punched earlier than the computer, but in any case, it will be in conflict with the unspoken rules of punching at the same time in the general punching, and the activity of the boxing will not proceed smoothly. (4). For the boxing that needs to be predicted by the sound price, the boxing will only select the boxing in a random manner, which will result in "fool boxing", and the so-called "fool boxing" will limit the follow-up price due to the punching of the body movement. The forecast, when using the boxing, uses a price prediction that is completely impossible to make, so that it is absolutely impossible to win the boxing, that is, due to the fists of the body movements, some bidding forecasts are made in this time. It is impossible to appear in boxing. If the computer price forecast is generated in a random manner and does not rule out these impossible bidding forecasts, the computer will not win if it is punched. For example, both parties The boxing is performed with the fists of both hands representing 0, the one palm opening 5, and the palms opening 10, the two sides except the fists of the palms, and the number of the two sides is predicted by the sound price, and the guess is the winner. If two palms open in the boxing, it represents the number 10, and each time the price is likely to appear 0, 5, 10, 15, 20 and other 5 predictions, but in this case 0 and 5 are absolute It’s impossible to happen in this punch. Randomly generated, A's bid price prediction may appear 0 and 5 two numbers. If it is not excluded, whether it is 0 or 5, the punch is absolutely impossible, if it occurs in a random way, the probability of occurrence is 40%. It can not be said that the problem is not high. The present invention discloses a "virtual punching technique" to overcome this problem, as described in the following. The invention provides A technique different from image processing to detect the depth of an object's position, mainly using infrared, ultrasonic or electromagnetic waves to obtain the depth of the object's position, and quickly acquire the shape of the object in a complex environment, and to carry out the skeleton and various Dynamic analysis, such as Microsoft's Kinect, Asus's Xtion series, and Creative's Senz3D are infrared detectors. In a simpler way, infrared rays can be made to detect the depth of each object in the environment.

In view of the foregoing shortcomings, the present invention proposes a technique different from image processing to quickly and effectively recognize gestures or limb movements, so that the punching activity can be performed more smoothly. The main object of the present invention is to disclose a method and apparatus for punching a fist which can be combated by at least one person (hereinafter referred to as a player). The invention mainly comprises a digital processor, which is responsible for the processing of digital information, a box recognition module for recognizing the boxing state of the player, and a speech recognition module for recognizing the bidding sound of the player. The boxing module is used to determine the boxing fist and output the boxing animation and sound corresponding to the boxing to carry out the confrontation between the two sides (computer and player).

10‧‧‧ Players’ fists

20‧‧‧The price of the player’s bid

110‧‧‧Box Identification Module

120‧‧‧Digital Processor

130‧‧‧Boxing module

111‧‧‧Depth of Field Sensor

112‧‧‧Box recognition unit

131‧‧‧ Boxing selection unit

132‧‧‧ punching speed control unit

133‧‧‧Output unit

134‧‧‧Boxing Statistics Unit

210‧‧‧Step 210

220‧‧‧Step 220

230‧‧‧Step 230

1331‧‧‧Animation subunit

1332‧‧‧Voice subunit

901‧‧‧Screen output device

902‧‧‧ Speaker

134‧‧‧Boxing Statistics Unit

Figure 1 shows a first preferred embodiment of the present invention

Figure 2 Virtual punching technology flow chart

Figure 3 output unit architecture diagram

Figure 4 is a second preferred embodiment of the present invention

Figure 5 strokes flow chart

1 is a first embodiment of the present invention, including a digital processor 120, which is responsible for processing digital information, and a fist recognition module 110 for recognizing a player's fist state 10, a voice recognition module 150 is used to identify the bidding sound 20 that the player shouts, and a punching module 130 is used to determine the boxing fist and output the fist-like animation and sound corresponding to the boxing to perform both sides (computer and player) ) The fight against punching. The digital processor 120 is electrically connected to the fist recognition module 110, the speech recognition module 150, and the punch module 130, respectively. The digital processor 120 regulates the actions of the components and adjusts the motion of the punch module 130 according to the information of the gesture recognition module 110 and the voice recognition module 150.

The gesture recognition module 110 includes a depth of field sensor 111 and a box recognition unit 112. The depth of field sensor 111 mainly uses infrared, ultrasonic or electromagnetic waves to quickly acquire the depth of the object and reuse it. The depth distance obtained is obtained, the contour of the object is obtained, and the feature of the object is analyzed, and the result of the sensing is sent to the box recognition unit 112, and the box recognition unit 112 receives the sensor sensed by the depth sensor 111. Object feature information, which mainly uses these feature information to identify various different fist states, in order to provide a judgment for the control of the punching speed and the victory of the punching.

The punching module 130 includes a boxing selecting unit 131, a punching speed control unit 132 and an output unit 133. The boxing selecting unit 131 mainly determines whether the punching needs to be predicted by the sound bidding, and if necessary, the virtual The punching technique selects the fist of the boxing and the sound of the bidding prediction, and if it is not necessary, the boxing fist is generated in a random manner, and the output unit 133 outputs the boxing and sound selected by the boxing selecting unit 131, and The punching speed control unit 132 controls the time point of the output of the output unit 133. The boxing selection unit 131 generates a boxing fist by using a random method, but if the boxing rule of the boxing type includes the sound price prediction in addition to the gesture body motion, the bid price prediction may not be generated in a simple random manner to avoid Causing "fool fist", the present invention discloses a "virtual punching technique" that simulates in a random manner The other party punches, using a simple 3 steps to eliminate the impermissible bid price prediction, as shown in Figure 2, first, step 210 randomly generates a number A that can correspond to the boxing, so that the corresponding boxing is C, then, Step 220 randomly generates a number B that can correspond to the boxing, so that the corresponding boxing is D, that is, the number A corresponds to the boxing C, the number B corresponds to the boxing D, and finally, the step 230 calculates the boxing C and the boxing. The interaction result of D, and the result is E, then C is the boxing fist, E is the prediction of the bid price, taking the above figures and predictions of the palm opening and closing as an example, suppose the number 0 corresponds to the palm full closure, ie 0, the number 1 corresponds to 1 open 1 closed, number 2 corresponds to 2 palm full open, in step 210 generates a random number A is 2, indicating that the palm is fully open, then step 220, randomly generating another number B is 1 indicating that the palm is open and closed, the steps 3 Calculate the interaction result between the full opening of the palm and the opening and closing of the palm. The interaction in this boxing is defined as the sum of the figures of the two punches. The full opening of the palm represents the number 10, and the palm opens and closes to represent the number 5. Therefore, The result of the interaction is 15, that is, the boxing fist is full of palms, asking price Measuring 15 to the invention of the "virtual punching technique" punching each other no matter what, will not appear "fool boxing." After the selection of the boxing fists is completed, the output can be prepared. The two sides involved in the boxing in the process of punching must punch at the appropriate time to smoothly perform the boxing. Some of the boxing types must be punched at the same time. It happens when the computer punches or the computer is earlier than the player punches, but because each player's punching speed is different, and even if the same player, the speed of each punching price will be slightly different, in order to avoid causing the first The unfavorable situation of the boxer and the unique rhythm of the boxing, the computer's punch must adjust the speed according to the player's punching speed. On the other hand, some boxings must be both rounds of punches, when it is the turn of the computer. When punching, the computer needs to control the punching speed. This work is performed by the punching speed control unit 132. In the punching speed control unit 132, the following different methods are used to control the speed of the punching, (1) Pre-action: Set a pre-action as a signal that the player is ready. When the player puts out the action, the player is ready to complete, and can enter the punching match at any time. The depth of field sensor 111 can be sensed and recognized, and a delay time can be set after the front action, so that the computer can detect After the pre-action, wait for a delay time and then start to punch. (2). Determine by sound: Let the computer detect the sound of the player. When the player makes a bid, it is the time when the computer punches. (3). The depth of field sensor 111 is used to sense the action of the player. When it is sensed that the player is about to punch, the computer must also punch at the same time, and the sensing action may have multiple choices, such as sensing the hand. The punching action, the state of the mouth is about to call the price, and the comprehensive judgment of the two. If the judgment result is that the player is about to punch, then the time is selected as the computer punch (4). Interval: Set the time interval between each punch, the computer will punch according to this time interval, but in order to make the computer keep up with the speed of the player, this time interval can also be adjusted with each punch. The adjustment method is (a). The fine adjustment method is to calculate the time difference between the computer and the player punching. If the player punches the box earlier than the computer, the computer will punch the time interval to subtract the time difference, and if the computer is earlier than the player. Punch, the computer will punch time interval Add this time difference. (b). The averaging method is to calculate the average number of time intervals between each player in the recent game, and use this average as the time interval for the next punch. (c). The recent time interval method of punching, that is, the time interval of the previous time is the time interval of the next punch. The punching speed control unit 132 sends the punching speed selected by the boxing picking unit to the output unit 133 at the time of the punching, as shown in FIG. 3. The output unit 133 includes An animation sub-unit 1331 is electrically connected to a picture output device for outputting a boxing-like animation and a voice sub-unit 1332, and is electrically connected to a speaker for outputting the price of the boxing. If the boxing is not If you want the sound, you can only output the animation, and the animation and sound can be stored in the pre-recorded manner of each boxing. When there is a need to output, the animation or sound pre-recorded from the above-mentioned boxings is based on the boxing. Play differently. In the beginning, no historical data is available. You can use the sound to determine or detect the action mode to determine the time of the punch. You can also set the time interval directly with the experience value. After the two sides punch, the time interval can be Adjust according to the above method. The above four kinds of punching speed control modes can be mixed and applied for the best effect, and the front action can be set according to the characteristics of different types of punches. The player and the computer can be synchronized, and the subsequent punch can consider the boxing fist. If the time interval between each punch is fixed, the time interval method can be used. Secondly, if the box contains sound and punch , you can use the sound and motion fast method, that is, use the sound to determine the time point of the earliest detected player action in the detection action, when the time is the punch, and if the boxing voice does not need to participate in the punching, Choose to detect the action to control the time of the punch. If the boxing fist is a computer and a player rounds out the boxer, if the boxing contains sound and punching action, the sound and action squatting method can be used, that is, the player's action and sound are detected, and the last of the two is The end time is the benchmark, and an interval can be selectively added. After the addition, the time is the time for the computer to punch. 4 is a second preferred embodiment of the present invention, which is mainly used to add a boxing statistics unit 134 to the boxing module 130 by using FIG. 1 , and the boxing statistics unit 134 collects and counts the boxing recognition module 110 . The information about the identified players’ punches is used to select the next boxing with a higher winning percentage. Some of the selected aspects are the statistical player’s most fists, the least punches, and the most recent punches. Recently, the least amount of boxing, the most often lost boxing, etc., and this boxing is the punch of the imaginary player. If the boxing does not include the price of the sound, the direct selection is better than the boxing of the imaginary player. Including the sound price, you can use the "virtual punching technique" similar to the above to select the appropriate output of the boxing and asking price. The main difference is the number B and the boxing D randomly generated by the step 220 of the "virtual punching technique". It is changed to a fist with a large winning ratio calculated by the boxing statistics unit 134 and set as a boxing D. In addition, the so-called two-handed interaction, interaction methods are: (1) add: the two figures represent the sum of the figures, (2) and the specified action mutually exclusive: both sides of the two sides of the boxing, both sides of the boxing, including a The first limb and the second limb, wherein the first limb and the second limb can perform a plurality of different actions, the first limb motion is called a guiding motion, the second limb motion is called a follow motion, and each is defined The result of the interaction between the guiding action and each following action, the outcome of the competition between Party A and Party B, the result of the interaction between the guiding action of Party A and the following action of Party B, or the result of interaction between the guiding action of Party B and the following action of Party A, In the way of looking at the boxing, a common adopter takes turns in two ways. For example, if the first limb is the hand and the second limb is the head, then the hand and the head are respectively pointed or turned up and down, and we define that if the head of B is the same as the direction of the hand of A, it is Jia Shengyi. If the difference is different, the outcome is the same as the specified action: and the same rule as the specified action, and the winning and losing is the opposite, that is, if the head of B is the same as the direction of the hand of A, then B Winning defeat, if different, the outcome is not divided. The actions of the first limb or the second limb that are the same as the specified motion and the same as the specified motion may be changed to other display patterns, such as changing one of them to be expressed by sound. The punching speed control unit 132 can be selectively added to the punching module 130 according to actual needs.

In summary, the punching method of the present invention is summarized as shown in FIG. 5, and step 310 is to start the punching. Then, the boxing picking unit 131 determines the boxing of the punching box, whether the sound of the bidding is required, and if the step 330 is performed, The aforementioned virtual punching technique is used to generate the fist boxing and the sound of the bidding prediction. Conversely, if the boxing type does not require sound, proceed to step 340 to directly generate the boxing fist in a random manner, and then follow the steps. The 350 uses the punching speed control unit 132 to adjust the timing of the punch. When the timing of the punch arrives, the step 360 is performed, and the generated fist is output. If the sound is included, the sound is output to the output unit 133 together with the sound of the bidding prediction. In the end, the player's punching information recognized by the boxing recognition module 110 and the voice recognition module 150 and the boxing and sound outputted by the boxing module 130 can be used to determine the winning or losing of the parties.

110‧‧‧Box Identification Module

120‧‧‧Digital Processor

130‧‧‧Boxing module

111‧‧‧Depth of Field Sensor

112‧‧‧Box recognition unit

131‧‧‧ Boxing selection unit

132‧‧‧ punching speed control unit

133‧‧‧Output unit

Claims (7)

A punching device includes a digital processor (120) for processing digital information, and a fist recognition module (110) for recognizing a player's fist state (10), a speech recognition module (150) ) to identify the call price sound (20) that the player shouted, and a punch module (130) to determine the fist shape of the boxing, and output the animation and sound corresponding to the fist state of the fist sample to perform both sides In the confrontation of the punching, the digital processor (120) is electrically connected to the fist recognition module (110), the speech recognition module (150) and the punch module (130), respectively, and the fist recognition module (110) comprises A depth of field sensor (111) to obtain an outline and feature of the object, a state recognition unit (112) to receive information from the depth sensor (111) and identify the player's fist (10) The punching module (130) includes a boxing selection unit (131) to determine whether the punching requires a sound of the bidding prediction to determine whether to use the virtual punching technique or the random method to select the punching and bidding prediction. The sound and an output unit (133) receives the fist and sound selected from the boxing selection unit (131) to output a punch. And sound. The punching device according to claim 1, wherein the punching module (130) further comprises a punching speed control unit (132) for controlling the punching at an appropriate time, wherein the punching speed control unit (132) Set a pre-action as a signal that the player is ready. The punching device according to claim 1, wherein the punching module (130) further comprises a punching speed control unit (132) for controlling the punching at an appropriate time, wherein the punching speed control unit (132) In order to detect the price of the bidding sound, the time point of the punch is determined. The punching device according to claim 1, wherein the punching module (130) further comprises a punching speed control unit (132) for controlling the punching at an appropriate time, wherein the punching speed control unit (132) In order to detect the punch action to determine the time point of the punch. The punching device according to claim 1, wherein the punching module (130) further comprises a punching speed control unit (132) for controlling the punching at an appropriate time, wherein the punching speed control unit (132) At the time interval of the punch, the time point of the punch is determined. For example, the punching device described in claim 5, wherein the time interval of the punch is adjusted to one of a fine adjustment method, an average method, or a recent time interval method. A method for punching a fist to combat at least one person with a punching stroke includes the following steps: Step 320: Using the boxing picking unit (131) to determine whether the punching type of the punching punch requires a sound of the asking price, and if performing step 330, using the virtual The boxing technique is used to generate the boxing fist and the sound of the bidding prediction. Conversely, if no sound is needed, step 340 is performed to directly generate the fist boxing in a random manner, and then step 350 utilizes the punching speed control unit ( 132) In order to control the timing of the punch, when the timing of the punch arrives, step 360 is performed, and the fist will be generated. If the sound is included, the sound is output to the output unit (133) together with the sound of the bidding prediction.