WO2021070770A1 - Game method using controller - Google Patents

Game method using controller Download PDF

Info

Publication number
WO2021070770A1
WO2021070770A1 PCT/JP2020/037697 JP2020037697W WO2021070770A1 WO 2021070770 A1 WO2021070770 A1 WO 2021070770A1 JP 2020037697 W JP2020037697 W JP 2020037697W WO 2021070770 A1 WO2021070770 A1 WO 2021070770A1
Authority
WO
WIPO (PCT)
Prior art keywords
game
controller
sensor
movement
myoelectric potential
Prior art date
Application number
PCT/JP2020/037697
Other languages
French (fr)
Japanese (ja)
Inventor
聡 耿
Original Assignee
聡 耿
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 聡 耿 filed Critical 聡 耿
Publication of WO2021070770A1 publication Critical patent/WO2021070770A1/en

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/211—Input arrangements for video game devices characterised by their sensors, purposes or types using inertial sensors, e.g. accelerometers or gyroscopes
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/212—Input arrangements for video game devices characterised by their sensors, purposes or types using sensors worn by the player, e.g. for measuring heart beat or leg activity
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/40—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
    • A63F13/42—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
    • A63F13/428—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/55—Controlling game characters or game objects based on the game progress
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Definitions

  • the present invention relates to a game method using a game controller which is an input device for a computer game or the like, and more particularly to a game method using a controller capable of simulating a more realistic action.
  • the game content including the movement of characters (characters) is displayed on the display, and a signal is sent from an input device connected to the computer, etc. Is input to a personal computer or the like, the movement of the player or the like is calculated, and the display is displayed as if a human character is active.
  • the activity of this character realizes a virtual world that imitates or cannot be expressed in reality on the display.
  • the movement of the character is controlled by the signal input from the input device connected to the computer.
  • This input device is a game controller.
  • a joystick is known as such a game controller, but a touch panel, a keyboard, and a mouse are also used. Then, using this game controller, input the direction, position, angle, etc., input the voice with the microphone, select the function with the button, and hold down this button to have the continuous shooting function. There is a game.
  • Patent Documents 1 and 2 disclose an inertial sensor as a sensor used in this game controller, and the inertial sensor includes an acceleration sensor that detects the magnitude of acceleration along a predetermined three-axis direction. Includes an angular velocity sensor that detects the angular velocity around the three axes. Then, in these Patent Documents 1 and 2, information on the movement or posture of the controller is calculated by the detection signal of the inertial sensor and used for the expression of the game.
  • Patent Document 3 discloses a pointing device in which an electromyographic sensor is provided near a person's wrist and inputs to an information processing device according to the movement of the hand. However, there is no knowledge about the game controller in Patent Document 3.
  • the conventional game controller operates the controller by making full use of both hands and / both feet of the game player (the person who plays the game) to make the character of the game perform the desired movement, which is complicated for the game player. Was supposed to require such an operation.
  • the present invention has been made in view of the above problems, and the movement of the player's body becomes the movement of the character as it is without requiring complicated operations in order to make the character of the game perform complicated movements.
  • the game method using the controller according to the present invention A controller with a built-in myoelectric potential sensor that detects the myoelectric potential on the skin surface and an acceleration sensor that detects acceleration is attached to multiple locations on the body of the game player.
  • Information related to the movement or position of the mounting position of the controller is obtained from the detection signal of the acceleration sensor, and it is made to correspond to the information related to the movement or position of the corresponding position of the game character.
  • Information related to the state of the muscle at the mounting position of the controller is obtained from the detection result of the myoelectric sensor, and it is related to information related to the intensity of movement of the corresponding position of the game character and / or game setting / selection. It is characterized in that it corresponds to the information to be used.
  • the game method using another controller is A controller with a built-in myoelectric potential sensor that detects the myoelectric potential on the skin surface and an angular velocity sensor that detects the angular velocity is attached to multiple locations on the body of the game player.
  • the detection signals of the myoelectric potential sensor and the angular velocity sensor are input, Information related to the rotation of the mounting position of the controller is obtained from the detection signal of the angular velocity sensor, and it is made to correspond to the information related to the rotation of the corresponding position of the game character.
  • Information related to the state of the muscle at the mounting position of the controller is obtained from the detection result of the myoelectric sensor, and it is related to information related to the intensity of movement of the corresponding position of the game character and / or game setting / selection. It is characterized in that it corresponds to the information to be used.
  • a controller with a built-in myoelectric potential sensor that detects the myoelectric potential on the skin surface, an acceleration sensor that detects acceleration, and an angular velocity sensor that detects angular velocity is attached to multiple locations on the body of the game player.
  • the detection signals of the myoelectric potential sensor, the acceleration sensor, and the angular velocity sensor are input.
  • Information related to the movement or position of the mounting position of the controller is obtained from the detection signal of the acceleration sensor, and it is made to correspond to the information related to the movement or position of the corresponding position of the game character.
  • Information related to the rotation of the mounting position of the controller is obtained from the detection signal of the angular velocity sensor, and it is made to correspond to the information related to the rotation of the corresponding position of the game character.
  • Information related to the state of the muscle at the mounting position of the controller is obtained from the detection result of the myoelectric sensor, and it is related to information related to the intensity of movement of the corresponding position of the game character and / or game setting / selection. It is characterized in that it corresponds to the information to be used.
  • the game control unit can be configured as an application installed on a user terminal.
  • the detection result of the myoelectric potential sensor is made to correspond to the strength of the movement of the controller mounting position of the game character (for example, the strength of the boxing punch), and by executing the mouse click or the like, which has been conventionally required.
  • the game control unit input signals such as game settings and selections. Therefore, in addition to the movement and / or rotation of the controller mounting position by the acceleration sensor and / or the angular velocity sensor, the control of the character by the operation of the player becomes various, and the mouse or the like is operated for the game control. No need. Therefore, according to the present invention, button operations and the like are not required, the player can immerse himself in the game, and more realistic actions can be easily input.
  • an action of giving rotation to the ball such as a spin or a slice can be added to the action of swinging a racket of a tennis game, and a button can be pressed. It is possible to instantly select the ball rotation in the swinging motion of the racket at the same time as the swinging motion of the racket without performing operations such as pushing, and to execute a deeper game motion in a more realistic and immersive state. Can be done.
  • FIG. 1 is a bottom view showing a game controller (hereinafter, controller) 10 according to an embodiment of the present invention
  • FIG. 2 is a perspective view showing the inside of the controller 10
  • FIG. 3 is an exploded perspective view showing the controller 10. Is a vertical sectional view of the electrode portion 5.
  • FIG. 5 is a block diagram showing the measurement unit 100 of the controller 10.
  • the controller 10 is attached to a plurality of places such as the upper body of the human body, the head (neck), the left hand, and the right hand.
  • the shell portion 11 of the controller 10 has a thin box shape, the lower end thereof is open, and the holding portion 4 is arranged in the shell portion 11.
  • the holding portion 4 has an insulating substrate 42 fixed to the shell portion 11, and the substrate 42 is provided with, for example, three electrode connecting portions 41.
  • an electrode portion 5 is further installed in the shell portion 11.
  • three electrodes 3 are arranged on one surface of the insulating substrate 51 at positions consistent with the electrode connecting portion 41 of the substrate 42. Further, on the other surface of the insulating substrate 51, three contact portions 2 electrically connected to each electrode 3 are provided.
  • the contact portion 2 is formed of a gel-like conductive material in a film shape, and the strip-shaped separation portions 1a and 1b in which the conductive material is missing in order to separate them in an insulating manner are formed between the contact portions 2. Is provided.
  • the contact portion 2 is pressed against the skin at a predetermined position on the human body, and the controller 10 is attached to the predetermined position on the human body due to the adhesiveness of the contact portion 2.
  • the protective film 6 is attached and held on the entire surface of the substrate 42 including the contact portion 2. The protective film 6 prevents dust or dirt from adhering to the contact portion 2 and maintains the adhesiveness of the contact portion 2.
  • the protective film 6 is peeled off, and the contact portion 2 is adhered to the body due to the adhesiveness of the contact portion 2.
  • the electric potential on the skin surface of the body is taken out via the contact portion 2 and the electrode 3, and the electrical connection portion 41 arranged at a position consistent with the electrode 3 and the electrode 3 are in contact with each other to conduct electricity.
  • the potential on the skin surface is input to the myoelectric potential detection unit 101 of the holding unit 4, which will be described later.
  • An input switch 12 is provided on the upper surface of the shell portion 11, and the input switch 12 activates and operates the measuring unit 100. Further, a display unit 13 is provided on a part of the side surface of the shell unit 11, and the display unit 13 displays the operating state of the measuring unit 100 and the battery status by a plurality of LED elements.
  • An IC tag 7 is installed in the electrode unit 5, and authentication information is stored in the IC tag 7.
  • the IC tag reader 303 uses the IC tag 7 authentication information via NFC communication. Can be read.
  • the authentication information is information about a user who uses the controller 10 and information about the type of the controller 10.
  • other short-range wireless communication such as Bluetooth (registered trademark) communication or infrared communication can be performed according to the implementation conditions such as communication data size. You can also use it.
  • a measuring unit 100 including a myoelectric potential detecting unit 101 and an acceleration sensor 102 is provided on the surface of the holding unit 4 on the shell portion 11 side.
  • the change in electric potential detected by the three electrodes 3 is input to the myoelectric potential detection unit 101, and the change in electric potential on the skin surface due to the movement of muscles is detected.
  • the accelerometer 102 is also installed in the holding unit 4.
  • the acceleration sensor 102 detects the acceleration of a portion to which the controller 10 is attached as one of the movements of a person, and includes, for example, a capacitance detection method, a piezoresistive method, or a heat detection method. ..
  • the myoelectric potential detection unit 101 detects the myoelectric potential from the detection signal of the electrode 3 at predetermined intervals, and this myoelectric potential is sent to the control unit 104 after AD conversion.
  • the reference signal acquisition unit 110 of the control unit 104 inputs a myoelectric signal to be a reference signal from the electrode 3, and stores this in the storage unit 105.
  • the reference signal is, for example, a myoelectric signal in a state where no force is applied to the portion to which the controller 10 is attached (at rest) is detected with a predetermined number of samples, and the median value of the detected myoelectric signal is used. This is obtained and used as a reference signal, and the median value of this myoelectric signal is stored in the storage unit 105 as a reference signal.
  • the control unit 104 includes a data processing unit 111, a state notification unit 112, and a state control unit 113 in addition to the reference signal acquisition unit 110.
  • the data processing unit 111 reduces the amount of information of the myoelectric signal by using the reference signal, and reduces the amount of myoelectric signal data output from the wireless communication unit 108 to the outside, which will be described later. Make it smaller.
  • the status notification unit 112 outputs information regarding the status of the measurement unit 100 to the user terminal 200. For example, the remaining battery level of the battery 106 and information on whether or not the measurement unit 100 has acquired the reference signal by the reference signal acquisition unit 110 are output to the user terminal 200.
  • the state control unit 113 controls the operating state of the measurement unit 100 based on the control instruction from the user terminal 200.
  • the states controlled by the state control unit 113 are, for example, the start of reading the authentication information described later, the start and end of measurement of the reference signal, and whether or not the myoelectric signal can be detected.
  • the start of reading the authentication information, the start of detection of the reference signal, and the like can be set so as to be executed based on the instruction by the system user input via the user terminal 200.
  • the measuring unit 100 is provided with a battery 106 for supplying power to the control unit 104 and a non-contact power feeding coil 107 for supplying power to the battery 106 in a non-contact manner.
  • the wireless communication unit 108 inputs / outputs information by wireless communication with the wireless communication unit 201 of the user terminal 200.
  • the wireless communication between the wireless communication unit 108 and the wireless communication unit 201 and the wireless communication between the wireless communication unit 201 and the wireless communication unit 301 of the charging device 300, which will be described later, are short-range wireless communication including Bluetooth (registered trademark). Communication.
  • BLE Bluetooth (registered trademark) Low Energy) communication
  • infrared communication infrared communication
  • NFC Near Field Communication
  • the controller 10 has a watertight structure, and the electrode portion 5 and the measuring portion 100 in the shell portion 11 are watertightly sealed. In order to supply power to the battery 106, a power supply process is performed with the outside of the controller 10 via the non-contact power supply coil 107.
  • the user terminal 200 has a generation unit 202, an output unit 203, a state management unit 204, and an application 205, and transmits / receives data to / from the outside via the wireless communication unit 201.
  • the generation unit 202 generates the input information by using the input information table in which the parameters and the input information are associated with each other based on the myoelectric information received from the measurement unit 100. That is, the input information is generated based on the value of the myoelectric signal and the parameters specified in the input information table.
  • the generated input information is output to the application 205 by the output unit 203.
  • the application 205 uses the received input information to perform processing according to the purpose of use.
  • the state management unit 204 acquires the state information of the measuring unit 100 and the charging device 300 and gives control instructions for the information.
  • the generation unit 202 uses the correction coefficient calculated in advance according to the thickness of the skin of the part where the controller 10 is attached, and generates the myoelectric signal before the generation of the input information or the generated input information. It can also be configured to make corrections.
  • This correction coefficient is a coefficient that is multiplied by the myoelectric signal or input information. As a result, the detected value of the myoelectric signal that changes depending on the mounting portion of the measuring unit 100 can be standardized and used.
  • the charging device 300 includes a wireless communication unit 301 that wirelessly communicates with the user terminal 200, an IC tag reader 303 that reads the IC tag of the electrode unit 5, a battery 304, and a battery 106 of the measurement unit 100 via a non-contact power feeding coil 107. It has a power supply unit 305 that supplies power to the power supply unit 305.
  • the IC tag reader 303 reads the authentication information recorded on the IC tag 7 of the electrode unit 5. This authentication information includes a character string indicating that the electrode portion 5 is a genuine product, and information such as an expiration date based on the adhesive performance of the contact portion 2.
  • the read authentication information is subjected to authentication processing (preprocessing) by the authentication unit 302 of the charging device 300, and the electrode unit 5 is a regular electrode unit or the contact unit 3 has an expiration date. It is judged whether there is a problem in the usage history.
  • the determination result of the authentication unit 302 is transmitted to the user terminal 200 via the wireless communication unit 301 and the wireless communication unit 201.
  • the state management unit 204 of the user terminal 200 gives an operation instruction for preprocessing to the state control unit 113 of the measurement unit 100 based on the received determination result, and also displays the authentication result and the reason when the authentication cannot be performed. Displayed in unit 13.
  • the authentication unit 302 may be provided in the user terminal 200. Further, the authentication result may be directly output to the measuring unit 100.
  • the controller 10 configured as described above is attached to a plurality of parts of the human body due to the adhesiveness of the conductive contact portion 2.
  • the controller 10a is attached to the chest in front of the body
  • the controller 10b is attached to the neck on the back of the body
  • the controller 10c is attached to the forearm of the right upper limb
  • the controller 10d is attached to the forearm of the left upper limb.
  • These myoelectric potential signals and acceleration signals are subjected to predetermined preprocessing or data processing by the measuring unit 100, and are input to the application 205 of the user terminal 200.
  • the application 205 calculates the speed and / or the moving distance at that time at the position where the controller 10 is arranged from this acceleration signal, and calculates the movement of the human body from the myoelectric potential.
  • An example of the embodiment is shown below.
  • the mode of simulating the movement of the character of the game by attaching the controller to a plurality of parts of the body, detecting the myoelectric potentials of the plurality of parts, and detecting the acceleration of the plurality of parts is extremely achieved. Can be increased.
  • the myoelectric potential detection result is applied to an action game, it is possible to express the strength of the force when the character is active in the action game by adjusting the force when the player holds the hand. It is possible to significantly spread the mode of activity of the character.
  • the operation using the myoelectric sensor can correspond to the operation of the mouse and the keyboard.
  • the detection result of the myoelectric sensor can be used so as not to use the mouse and the keyboard at all.
  • the control of the character by the operation of the player becomes various, and it is not necessary to operate the mouse or the like for the control of the game. According to the present invention, more realistic action can be easily input.
  • FIG. 7A shows the movements of the acceleration sensor and the geomagnetic sensor in the controller 10a of the embodiment
  • FIG. 7B shows a dedicated controller for game A
  • FIG. 7C shows a dedicated controller for game B
  • FIG. 7D shows a keyboard used as a controller in a personal computer game.
  • the player's body is moved left and right to move the controller 10a attached to the player's chest to the right or left, and the body is moved forward or backward to move the controller 10a forward or backward.
  • This operation corresponds to, for example, the operation of the button 21 of the controller for the game machine A, the operation of the button 23 of the controller for the game machine B, and corresponds to the key 24 or the key 25 of the keyboard.
  • the button 22 of the controller for the game machine A controls the movement of the field of view, and each game machine is provided with a dedicated operation button.
  • the conventional movement of the human body by the controller shown in FIGS. 7 (b), 7 (c), and (d) can be associated with the movement of the position of the controller 10a in the controller 10a of FIG. 7 (a).
  • the movement of the controller 10a is detected by the acceleration sensor and / or the geomagnetic sensor mounted on the controller 10a. Further, it has been conventionally performed to detect the movement of the human body by using this acceleration sensor and / or the geomagnetic sensor.
  • the present invention is characterized in that the controllers 10a, 10b, etc. are equipped with a myoelectric potential sensor in addition to the acceleration sensor and / or the geomagnetic sensor, and a new method of using the game by effectively utilizing the myoelectric potential sensor. Is to provide.
  • the controllers 10c and 10d shown in FIGS. 8 (a) and 9 (a) are provided with a myoelectric potential sensor in addition to the acceleration sensor, and the controllers 10c and 10d are mounted at positions on the palm side of the forearm, respectively. ing. As a result, the controllers 10c and 10d detect the acceleration of the forearm and the electric potential of the muscle on the palm side of the forearm.
  • the player swings both forearms or one forearm in small steps to apply a slight force to the muscles on the palm side of the forearm.
  • this small swing is detected by the acceleration sensor, the light force of the muscle is detected by the myoelectric sensor, and the movement of this player indicates a light action.
  • this light action is simulated by pressing the button 31.
  • this mild action is operated by the left click 32 in the case of the mouse shown in FIG. 8 (c), and is operated by pressing the key 33 in the case of the keyboard shown in FIG. 8 (d).
  • FIG. 9 the player swings both forearms or one forearm greatly to apply a heavy force to the muscles on the palm side of the forearm. Then, the swing of this large forearm is detected by the acceleration sensor, the strong force of the muscle is detected by the myoelectric sensor, and the movement of this player indicates a serious action. For example, in boxing, it corresponds to a bang.
  • this severe action is simulated by pressing a button 34. Further, this severe action is operated by right-clicking 35 in the case of the mouse shown in FIG. 9 (c), and by pressing the key 36 in the case of the keyboard shown in FIG. 9 (d).
  • the magnitude of the myoelectric potential detected by the controllers 10c and 10d is adjusted by increasing the force of gripping the hand or directly controlling the force of the muscle of the forearm. That is, by applying a strong load to the muscle of the forearm, the potential of this muscle becomes high, and by detecting the high myoelectric potential of the controllers 10c and 10d, the player is connected to the game control unit to which the controllers 10c and 10d are connected.
  • a signal is input indicating that a strong action has been selected. Then, the game control unit determines a strong action instruction together with the detection result such as the magnitude of the swing of the arm of the acceleration sensor of the controller 10c and 10d, and displays a strong and long stroke or a strong and short stroke on the display. Further, when a weak load is applied to the muscle of the forearm, the electric potential of this muscle becomes low, and the controllers 10c and 10d detect the low myoelectric potential, so that the game control unit to which the controllers 10c and 10d are connected is connected to the game control unit. A signal is input indicating that the player has selected a weak action.
  • the game control unit determines a weak action instruction together with the detection result such as the magnitude of the swing of the arm of the acceleration sensor of the controller 10c and 10d, and displays a weak long stroke or a weak short stroke on the display. Therefore, in the present invention, instead of inputting a signal by operating a button to the controller as in the conventional case, the player can be a character in the game simply by attaching a controller for detecting myoelectric potential, acceleration, etc. to the player's body. The action to be executed can be expressed by the intuitive movement of one's own body.
  • the movement of the player's body allows the player to enjoy the game and concentrate on the progress of the game just by moving the player in the same manner as the movement desired to be performed by the character. It can be done, and the way of enjoying the game is dramatically expanded and improved.
  • FIG. 10 shows a case where a long-time force is applied to the muscles of both forearms.
  • the output of the myoelectric potential sensor is detected by the controllers 10c and 10d attached to both forearms for a long time.
  • the detection of the myoelectric potential for a long period of time is referred to as a livestock action, a charge to the livestock gauge, or an infrequent action in a game control unit to which the controllers 10c and 10d are connected, for example, as a typical game expression. It is judged to be equivalent to what is said.
  • This long-term muscle tension i.e., the long-term significant output of the myoelectric potential sensor, represents, for example, the movement of rapid fire in a war game.
  • the controllers 10c and 10d by mounting the controllers 10c and 10d on the palm side of the forearm and the opposite side, respectively, it is possible to easily swing the racket to the tennis ball and give rotation to the ball at that time. realizable. That is, the controllers 10c are mounted on the front and back of the player's right forearm, the controllers 10d are mounted on the front and back of the player's left forearm, respectively, and the four controllers 10c and 10d are mounted on both forearms. Then, for example, when the player swings out the right arm (rotation of the entire arm around the shoulder), which is assumed to hold the racket, for the stroke motion of launching the tennis ball forward, the player moves the arm.
  • Such an operation can be applied to, for example, an operation of giving rotation to the ball in a table tennis game and an operation of giving rotation to the ball by a pitcher in a baseball game.
  • a boxing game it is possible to express the difference between uppercut and straight by the difference in the twisting direction of the arm.
  • the two myoelectric potential sensors can be installed in two places. The interrelationship and change pattern of the myoelectric potential can be detected, and the movement of the character intended by the player can be specified to the game control unit from the movement of the player's arm.
  • the number of controllers to be attached to one arm is not limited to one or two, and may be three or more. In this case, a more complicated operation can be performed with one arm.
  • a plurality of controllers may be provided around the arm at appropriate length intervals so as to surround the arm to detect a plurality of myoelectric potentials.
  • the controller of the present embodiment includes an acceleration sensor, if it is not necessary to provide a plurality of acceleration sensors, one controller and one or a plurality of myoelectric potential sensors may be provided around the arm.
  • the controller includes an acceleration sensor in addition to the myoelectric potential sensor.
  • the controller of the present invention is not limited to this, and may include an angular velocity sensor in place of the acceleration sensor or in addition to the acceleration sensor.
  • the angular velocity sensor detects the angular velocity of the position of the body on which the controller is mounted and detects information related to rotation of this position.
  • the game control unit uses the detection result of the angular velocity together with the detection result of the myoelectric potential to control the character.
  • the controller of the present invention may be equipped with an acceleration sensor and an angular velocity sensor in addition to the myoelectric potential sensor. In this case, the detection result of the acceleration sensor and the detection result of the angular velocity sensor can be used together with the detection result of the myoelectric potential sensor to control the movement of the game character.
  • the present invention is not limited to this, and a game control unit may be separately provided.
  • the controller including the myoelectric potential sensor + acceleration sensor and / or angle sensor
  • the controller can be attached to any position on the player's body, and is attached not only to the arm but also to, for example, the foot.
  • the combination of the detection signals of the myoelectric potential sensor and the acceleration and / or angular velocity sensor makes it possible to set various movements of the game character.
  • the myoelectric potential sensor is used in combination with the detection results of the accelerometer, the angular velocity sensor, or the gyro sensor that have been conventionally used, and the detection result of the myoelectric potential that changes depending on the degree of muscle tension is used.
  • Electrode connection unit 100 Measurement unit 104: Control unit 200: User terminal 300: Charging device

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biophysics (AREA)
  • Cardiology (AREA)
  • General Health & Medical Sciences (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Position Input By Displaying (AREA)

Abstract

According to the present invention, controllers, each of which is incorporated with a myoelectric sensor that detects a myogenic potential of a skin surface and an acceleration sensor that detects an acceleration, are mounted on a plurality of points of the body of a game player. In addition, a movement of the mounting position of the controller is obtained by using a detection signal from the acceleration sensor and is made to correspond to a movement of a corresponding position of a game character. In addition, a state of the muscle at the mounting position of the controller is obtained by using a detection result of the myoelectric sensor and is made to correspond to the intensity of an operation at the corresponding position of the game character and is also made to correspond to an input of a control signal such as a setting/selection of a game in a user terminal. Accordingly, a complicate operation is not required to operate the game character complicatedly, and a movement of the body of the player can be mirrored to be a movement of the character. In addition, a game experience can be possible and the fun of the game can be enhanced through a more intuitive operation.

Description

コントローラを使用したゲーム方法Game method using a controller
　本発明は、コンピュータゲーム等の入力装置であるゲームコントローラを使用したゲーム方法に関し、特に、よりリアルなアクションをシミュレートすることができるコントローラを使用したゲーム方法に関する。 The present invention relates to a game method using a game controller which is an input device for a computer game or the like, and more particularly to a game method using a controller capable of simulating a more realistic action.
　コンピュータゲーム、ビデオゲーム、又はパソコンゲーム等（以下、総称してコンピュータゲームという）においては、ディスプレイにキャラクタ（登場人物）の動きを含むゲーム内容を表示し、パソコン等に接続された入力装置から信号をパソコン等に入力して、プレーヤ等の動きを演算して、ディスプレイ上にあたかも人間のキャラクタが活動しているかのように表示する。このキャラクタの活動により、ディスプレイ上で現実を模した又は現実では表現できない仮想的な世界が実現される。このとき、キャラクタの動きは、コンピュータに接続された入力装置から入力された信号により制御される。この入力装置が、ゲームコントローラである。 In computer games, video games, computer games, etc. (hereinafter collectively referred to as computer games), the game content including the movement of characters (characters) is displayed on the display, and a signal is sent from an input device connected to the computer, etc. Is input to a personal computer or the like, the movement of the player or the like is calculated, and the display is displayed as if a human character is active. The activity of this character realizes a virtual world that imitates or cannot be expressed in reality on the display. At this time, the movement of the character is controlled by the signal input from the input device connected to the computer. This input device is a game controller.
　このようなゲームコントローラとしては、ジョイスティックが知られているが、タッチパネル、キーボード及びマウスも使用されている。そして、このゲームコントローラを使用して、方向、位置、角度等を入力し、マイクで音声を入力し、ボタンで機能を選択し、更にこのボタンを押したままにすることで連射機能を持たせたゲームがある。 A joystick is known as such a game controller, but a touch panel, a keyboard, and a mouse are also used. Then, using this game controller, input the direction, position, angle, etc., input the voice with the microphone, select the function with the button, and hold down this button to have the continuous shooting function. There is a game.
　このゲームコントローラに使用されているセンサとして、特許文献１及び２には、慣性センサが開示されており、この慣性センサは、所定の３軸方向に沿った加速度の大きさを検出する加速度センサと、前記３軸周りの角速度を検出する角速度センサを含む。そして、これらの特許文献１及び２においては、この慣性センサの検出信号により、コントローラの動き又は姿勢の情報を演算し、ゲームの表現に利用している。 Patent Documents 1 and 2 disclose an inertial sensor as a sensor used in this game controller, and the inertial sensor includes an acceleration sensor that detects the magnitude of acceleration along a predetermined three-axis direction. Includes an angular velocity sensor that detects the angular velocity around the three axes. Then, in these Patent Documents 1 and 2, information on the movement or posture of the controller is calculated by the detection signal of the inertial sensor and used for the expression of the game.
　なお、特許文献３には、人の手首の近傍に筋電センサを設け、手の動きに応じて情報処理装置への入力を行うポインティングデバイスが開示されている。しかし、この特許文献３には、ゲームコントローラについての知見は存在しない。 Note that Patent Document 3 discloses a pointing device in which an electromyographic sensor is provided near a person's wrist and inputs to an information processing device according to the movement of the hand. However, there is no knowledge about the game controller in Patent Document 3.
特許第６４９９３５４号公報Japanese Patent No. 6499354 特許第６５１７４０３号公報Japanese Patent No. 6517403 特開２００８－３０５１９９号公報Japanese Unexamined Patent Publication No. 2008-30599
　しかしながら、従来のゲームコントローラは、ゲームプレーヤ（ゲームで遊ぶ人）の両手及び／両足を駆使してコントローラを操作し、ゲームのキャラクタに所望の動作をさせるが、このために、ゲームプレーヤには複雑な操作を要求することになっていた。 However, the conventional game controller operates the controller by making full use of both hands and / both feet of the game player (the person who plays the game) to make the character of the game perform the desired movement, which is complicated for the game player. Was supposed to require such an operation.
　本発明はかかる問題点に鑑みてなされたものであって、ゲームのキャラクタに複雑な動きをさせるために、複雑な操作を必要とすることなく、プレーヤの身体の動きがそのままキャラクタの動きとなるようにすることができ、より直感的な操作でゲーム体験が可能で面白さを高めることができるコントローラを使用したゲーム方法を提供する

ゲームのキャラクタに複雑な動きをさせるために、複雑な操作を必要とすることなく、よりリアル且つ複雑なアクションの入力をより容易な操作で可能とするコントローラを使用したゲーム方法を提供することを目的とする。 The present invention has been made in view of the above problems, and the movement of the player's body becomes the movement of the character as it is without requiring complicated operations in order to make the character of the game perform complicated movements. To provide a game method using a controller that can make the game experience more intuitive and more interesting.

To provide a game method using a controller that enables input of more realistic and complicated actions with easier operation without requiring complicated operations in order to make the characters of the game perform complicated movements. The purpose.
　本発明に係るコントローラを使用したゲーム方法は、
皮膚表面の筋電位を検出する筋電位センサと、加速度を検出する加速度センサとを内蔵したコントローラを、ゲームプレーヤの身体の複数箇所に取り付け、
前記筋電位センサ及び加速度センサの検出信号が入力されるゲーム制御部にて、
前記加速度センサの検出信号により前記コントローラの取付位置の移動又は位置に関連する情報を求めて、それをゲームキャラクタの対応位置の移動又は位置に関連する情報に対応させ、
前記筋電センサの検出結果により前記コントローラの取付位置の筋肉の状態に関連する情報を求めて、それをゲームキャラクタの対応位置の動作の強度に関連する情報及び／又はゲームの設定・選択に関連する情報に対応させることを特徴とする。 The game method using the controller according to the present invention
A controller with a built-in myoelectric potential sensor that detects the myoelectric potential on the skin surface and an acceleration sensor that detects acceleration is attached to multiple locations on the body of the game player.
In the game control unit where the detection signals of the myoelectric potential sensor and the acceleration sensor are input,
Information related to the movement or position of the mounting position of the controller is obtained from the detection signal of the acceleration sensor, and it is made to correspond to the information related to the movement or position of the corresponding position of the game character.
Information related to the state of the muscle at the mounting position of the controller is obtained from the detection result of the myoelectric sensor, and it is related to information related to the intensity of movement of the corresponding position of the game character and / or game setting / selection. It is characterized in that it corresponds to the information to be used.
　また、本発明に係る他のコントローラを使用したゲーム方法は、
皮膚表面の筋電位を検出する筋電位センサと、角速度を検出する角速度センサとを内蔵したコントローラを、ゲームプレーヤの身体の複数箇所に取り付け、
前記筋電位センサ及び角速度センサの検出信号が入力されるゲーム制御部にて、
前記角速度センサの検出信号により前記コントローラの取付位置の回転に関連する情報を求めて、それをゲームキャラクタの対応位置の回転に関連する情報に対応させ、
前記筋電センサの検出結果により前記コントローラの取付位置の筋肉の状態に関連する情報を求めて、それをゲームキャラクタの対応位置の動作の強度に関連する情報及び／又はゲームの設定・選択に関連する情報に対応させることを特徴とする。 In addition, the game method using another controller according to the present invention is
A controller with a built-in myoelectric potential sensor that detects the myoelectric potential on the skin surface and an angular velocity sensor that detects the angular velocity is attached to multiple locations on the body of the game player.
In the game control unit where the detection signals of the myoelectric potential sensor and the angular velocity sensor are input,
Information related to the rotation of the mounting position of the controller is obtained from the detection signal of the angular velocity sensor, and it is made to correspond to the information related to the rotation of the corresponding position of the game character.
Information related to the state of the muscle at the mounting position of the controller is obtained from the detection result of the myoelectric sensor, and it is related to information related to the intensity of movement of the corresponding position of the game character and / or game setting / selection. It is characterized in that it corresponds to the information to be used.
　更に、本発明に係る更に他のコントローラを使用したゲーム方法は、
皮膚表面の筋電位を検出する筋電位センサと、加速度を検出する加速度センサと、角速度を検出する角速度センサを内蔵したコントローラを、ゲームプレーヤの身体の複数箇所に取り付け、
前記筋電位センサ、加速度センサ及び角速度センサの検出信号が入力されるゲーム制御部にて、
前記加速度センサの検出信号により前記コントローラの取付位置の移動又は位置に関連する情報を求めて、それをゲームキャラクタの対応位置の移動又は位置に関連する情報に対応させ、
前記角速度センサの検出信号により前記コントローラの取付位置の回転に関連する情報を求めて、それをゲームキャラクタの対応位置の回転に関連する情報に対応させ、
前記筋電センサの検出結果により前記コントローラの取付位置の筋肉の状態に関連する情報を求めて、それをゲームキャラクタの対応位置の動作の強度に関連する情報及び／又はゲームの設定・選択に関連する情報に対応させることを特徴とする。 Further, a game method using still another controller according to the present invention is described.
A controller with a built-in myoelectric potential sensor that detects the myoelectric potential on the skin surface, an acceleration sensor that detects acceleration, and an angular velocity sensor that detects angular velocity is attached to multiple locations on the body of the game player.
In the game control unit where the detection signals of the myoelectric potential sensor, the acceleration sensor, and the angular velocity sensor are input.
Information related to the movement or position of the mounting position of the controller is obtained from the detection signal of the acceleration sensor, and it is made to correspond to the information related to the movement or position of the corresponding position of the game character.
Information related to the rotation of the mounting position of the controller is obtained from the detection signal of the angular velocity sensor, and it is made to correspond to the information related to the rotation of the corresponding position of the game character.
Information related to the state of the muscle at the mounting position of the controller is obtained from the detection result of the myoelectric sensor, and it is related to information related to the intensity of movement of the corresponding position of the game character and / or game setting / selection. It is characterized in that it corresponds to the information to be used.
　上記各本発明において、前記ゲーム制御部は、ユーザ端末にインストールされたアプリケーションとして構成されるようにすることができる。 In each of the above inventions, the game control unit can be configured as an application installed on a user terminal.
　本発明によれば、筋電位センサの検出結果を、ゲームキャラクタのコントローラ取付位置の動作の強度（例えば、ボクシングのパンチの強度）に対応させると共に、従来必要であったマウスのクリック等の実行によるゲームの設定・選択等の信号を、ゲーム制御部に入力させることができる。このため、加速度センサ及び／又は角速度センサ等によるコントローラ取付位置の移動及び／又は回転の他に、プレーヤの動作によるキャラクタの制御が多彩なものになると共に、ゲーム制御のためにマウス等を操作する必要がなくなる。よって、本発明により、ボタン操作等が不要になって、プレーヤはゲームに没頭することができると共に、よりリアルなアクションの容易な入力が可能となる。 According to the present invention, the detection result of the myoelectric potential sensor is made to correspond to the strength of the movement of the controller mounting position of the game character (for example, the strength of the boxing punch), and by executing the mouse click or the like, which has been conventionally required. It is possible to have the game control unit input signals such as game settings and selections. Therefore, in addition to the movement and / or rotation of the controller mounting position by the acceleration sensor and / or the angular velocity sensor, the control of the character by the operation of the player becomes various, and the mouse or the like is operated for the game control. No need. Therefore, according to the present invention, button operations and the like are not required, the player can immerse himself in the game, and more realistic actions can be easily input.
　また、プレーヤの身体の隣接した複数箇所から筋電位を検出することにより、例えば、テニスゲームのラケットを振る動作に、スピン又はスライス等のボールに回転を与える動作を付加することができ、ボタンを押す等の操作をすることなく、ラケットの振り動作と同時にその振り動作におけるボール回転を瞬間的に選択することができ、よりリアルで、且つゲームに没頭した状態でより深いゲーム動作を実行することができる。 Further, by detecting myoelectric potential from a plurality of adjacent locations on the player's body, for example, an action of giving rotation to the ball such as a spin or a slice can be added to the action of swinging a racket of a tennis game, and a button can be pressed. It is possible to instantly select the ball rotation in the swinging motion of the racket at the same time as the swinging motion of the racket without performing operations such as pushing, and to execute a deeper game motion in a more realistic and immersive state. Can be done.
本実施形態で使用するコントローラ１０を示す斜視図である。It is a perspective view which shows the controller 10 used in this embodiment. 同じくコントローラ１０の内部を示す斜視図である。Similarly, it is a perspective view which shows the inside of the controller 10. 同じくコントローラ１０の内部を示す組み立て斜視図である。Similarly, it is an assembly perspective view which shows the inside of the controller 10. 同じく電極部５の断面図である。Similarly, it is a cross-sectional view of the electrode portion 5. 本実施形態の制御部１００等を示すブロック図である。It is a block diagram which shows the control part 100 and the like of this embodiment. コントローラ１０の取付位置を示す図である。It is a figure which shows the mounting position of a controller 10. 本実施形態のコントローラの使用方法の前提条件を示す図である。It is a figure which shows the precondition of the use method of the controller of this embodiment. 本実施形態のコントローラを使用したゲーム方法を示す図である。It is a figure which shows the game method using the controller of this embodiment. 同じく、本実施形態のコントローラを使用したゲーム方法を示す図である。Similarly, it is a figure which shows the game method using the controller of this embodiment. 同じく、本実施形態のコントローラを使用したゲーム方法を示す図である。Similarly, it is a figure which shows the game method using the controller of this embodiment.
　以下、本発明の実施形態について添付の図面を参照して説明する。図１は本発明の実施形態に係るゲームコントローラ（以下、コントローラ）１０を示す底面図、図２は同じくコントローラ１０の内部を示す斜視図、図３は同じくコントローラ１０を示す分解斜視図、図４は電極部５の縦断面図である。また、図５はこのコントローラ１０の測定部１００を示すブロック図である。このコントローラ１０は、人体の上半身、頭部(首部)、左手、右手等の複数箇所に貼付される。 Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. FIG. 1 is a bottom view showing a game controller (hereinafter, controller) 10 according to an embodiment of the present invention, FIG. 2 is a perspective view showing the inside of the controller 10, and FIG. 3 is an exploded perspective view showing the controller 10. Is a vertical sectional view of the electrode portion 5. Further, FIG. 5 is a block diagram showing the measurement unit 100 of the controller 10. The controller 10 is attached to a plurality of places such as the upper body of the human body, the head (neck), the left hand, and the right hand.
　コントローラ１０の殻部１１は薄い箱状をなし、その下端は開放されていて、この殻部１１内に保持部４が配置されている。保持部４は、殻部１１に固定された絶縁性基板４２を有し、この基板４２には、例えば３個の電極接続部４１が設けられている。この殻部１１内には、図３に示すように、更に、電極部５が設置される。この電極部５には、絶縁性基板５１の一面に、３個の電極３が、基板４２の電極接続部４１に整合する位置に配置されている。また、絶縁性基板５１の他面には、各電極３に電気的に接続された３個の接触部２が設けられている。接触部２は、ゲル状の導電性素材で膜状に形成されており、各接触部２間には、それらを絶縁的に分離するために導電性素材が欠落した帯状の分離部１ａ、１ｂが設けられている。この接触部２は、人体の所定の位置の皮膚に押し当てられ、接触部２の接着性により、コントローラ１０が人体の所定の位置に取り付けられる。そして、この接触部２を含む基板４２の全面に保護膜６が貼り付けられて保持されている。この保護膜６は、接触部２に、ゴミ又は汚れが付着することを防止し、接触部２の粘着性を維持するものである。コントローラ１０を身体に装着する場合には、この保護膜６は剥がされ、接触部２の接着性により、接触部２が身体に接着されることになる。これにより、身体の皮膚表面の電位が、接触部２及び電極３を介して取り出され、この電極３に整合する位置に配置された電気接続部４１と電極３とが接触して導通していることにより、皮膚表面の電位が、後述する保持部４の筋電位検出部１０１に入力される。 The shell portion 11 of the controller 10 has a thin box shape, the lower end thereof is open, and the holding portion 4 is arranged in the shell portion 11. The holding portion 4 has an insulating substrate 42 fixed to the shell portion 11, and the substrate 42 is provided with, for example, three electrode connecting portions 41. As shown in FIG. 3, an electrode portion 5 is further installed in the shell portion 11. In the electrode portion 5, three electrodes 3 are arranged on one surface of the insulating substrate 51 at positions consistent with the electrode connecting portion 41 of the substrate 42. Further, on the other surface of the insulating substrate 51, three contact portions 2 electrically connected to each electrode 3 are provided. The contact portion 2 is formed of a gel-like conductive material in a film shape, and the strip-shaped separation portions 1a and 1b in which the conductive material is missing in order to separate them in an insulating manner are formed between the contact portions 2. Is provided. The contact portion 2 is pressed against the skin at a predetermined position on the human body, and the controller 10 is attached to the predetermined position on the human body due to the adhesiveness of the contact portion 2. Then, the protective film 6 is attached and held on the entire surface of the substrate 42 including the contact portion 2. The protective film 6 prevents dust or dirt from adhering to the contact portion 2 and maintains the adhesiveness of the contact portion 2. When the controller 10 is attached to the body, the protective film 6 is peeled off, and the contact portion 2 is adhered to the body due to the adhesiveness of the contact portion 2. As a result, the electric potential on the skin surface of the body is taken out via the contact portion 2 and the electrode 3, and the electrical connection portion 41 arranged at a position consistent with the electrode 3 and the electrode 3 are in contact with each other to conduct electricity. As a result, the potential on the skin surface is input to the myoelectric potential detection unit 101 of the holding unit 4, which will be described later.
　殻部１１の上面には、入力スイッチ１２が設けられており、入力スイッチ１２により、測定部１００の起動及び操作が行われる。また、殻部１１の側面の一部には、表示部１３が設けられており、この表示部１３により、複数のＬＥＤ素子によって測定部１００の動作状態及びバッテリの状況が表示される。 An input switch 12 is provided on the upper surface of the shell portion 11, and the input switch 12 activates and operates the measuring unit 100. Further, a display unit 13 is provided on a part of the side surface of the shell unit 11, and the display unit 13 displays the operating state of the measuring unit 100 and the battery status by a plurality of LED elements.
　電極部５には、ＩＣタグ７が設置されており、このＩＣタグ７には、認証情報が記憶されていて、後述するように、ＮＦＣ通信を介してＩＣタグリーダ３０３でＩＣタグ７の認証情報を読み取ることができるようになっている。なお、認証情報とは、このコントローラ１０を使用する使用者に関する情報及びコントローラ１０の種類に関する情報である。また、ＩＣタグを介したＮＦＣ通信に代えて、又はこのＮＦＣ通信と組み合わせて、ブルートゥース（登録商標）通信又は赤外線通信等の他の近距離無線通信を、通信データサイズ等の実施条件に応じて利用することもできる。 An IC tag 7 is installed in the electrode unit 5, and authentication information is stored in the IC tag 7. As will be described later, the IC tag reader 303 uses the IC tag 7 authentication information via NFC communication. Can be read. The authentication information is information about a user who uses the controller 10 and information about the type of the controller 10. In addition, instead of NFC communication via an IC tag, or in combination with this NFC communication, other short-range wireless communication such as Bluetooth (registered trademark) communication or infrared communication can be performed according to the implementation conditions such as communication data size. You can also use it.
　保持部４の殻部１１側の面には、図５に示すように、筋電位検出部１０１と、加速度センサ１０２とを含む測定部１００が設けられている。筋電位検出部１０１には、３個の電極３により検出された電位の変化が入力されており、筋肉の動きによる皮膚表面の電位の変化を検出する。一方、保持部４には、加速度センサ１０２も設置されている。この加速度センサ１０２は、人の動きの一つとして、コントローラ１０が取り付けられた部位の加速度を検出するものであり、例えば、静電容量検出方式、ピエゾ抵抗方式、又は熱検知方式のものがある。 As shown in FIG. 5, a measuring unit 100 including a myoelectric potential detecting unit 101 and an acceleration sensor 102 is provided on the surface of the holding unit 4 on the shell portion 11 side. The change in electric potential detected by the three electrodes 3 is input to the myoelectric potential detection unit 101, and the change in electric potential on the skin surface due to the movement of muscles is detected. On the other hand, the accelerometer 102 is also installed in the holding unit 4. The acceleration sensor 102 detects the acceleration of a portion to which the controller 10 is attached as one of the movements of a person, and includes, for example, a capacitance detection method, a piezoresistive method, or a heat detection method. ..
　筋電位検出部１０１は、電極３の検出信号から所定の間隔で筋電位を検出し、この筋電位は、ＡＤ変換した後、制御部１０４に送られる。制御部１０４の基準信号取得部１１０は、電極３から基準信号となる筋電信号を入力し、これを記憶部１０５に記憶する。この場合に、基準信号とは、例えば、コントローラ１０を取り付けた部位に力を入れていない状態（平静時）の筋電信号を所定のサンプル数で検出し、検出した筋電信号の中央値を求めてこれを基準信号としたものであり、この筋電信号の中央値を記憶部１０５に基準信号として記憶する。制御部１０４は、基準信号取得部１１０の他に、データ加工部１１１、状態通知部１１２及び状態制御部１１３を有する。データ加工部１１１は、筋電信号を検出する処理において、基準信号を使用して筋電信号の情報量を減少させ、後述する無線通信部１０８から外部へ出力される筋電信号のデータ量を小さくする。状態通知部１１２は、測定部１００の状態に関する情報をユーザ端末２００に出力する。例えば、バッテリ１０６の電池残量と、測定部１００が基準信号取得部１１０で基準信号を取得できたか否かの情報等を、ユーザ端末２００に出力する。状態制御部１１３は、ユーザ端末２００からの制御指示に基づいて、測定部１００の動作状態を制御する。状態制御部１１３で制御される状態は、例えば、後述する認証情報の読み取り開始、基準信号の計測開始及び終了、及び筋電信号の検出可否等である。認証情報の読み取り開始及び基準信号検出開始等は、ユーザ端末２００を介して入力されるシステム使用者による指示に基づき実施されるように、設定することができる。 The myoelectric potential detection unit 101 detects the myoelectric potential from the detection signal of the electrode 3 at predetermined intervals, and this myoelectric potential is sent to the control unit 104 after AD conversion. The reference signal acquisition unit 110 of the control unit 104 inputs a myoelectric signal to be a reference signal from the electrode 3, and stores this in the storage unit 105. In this case, the reference signal is, for example, a myoelectric signal in a state where no force is applied to the portion to which the controller 10 is attached (at rest) is detected with a predetermined number of samples, and the median value of the detected myoelectric signal is used. This is obtained and used as a reference signal, and the median value of this myoelectric signal is stored in the storage unit 105 as a reference signal. The control unit 104 includes a data processing unit 111, a state notification unit 112, and a state control unit 113 in addition to the reference signal acquisition unit 110. In the process of detecting the myoelectric signal, the data processing unit 111 reduces the amount of information of the myoelectric signal by using the reference signal, and reduces the amount of myoelectric signal data output from the wireless communication unit 108 to the outside, which will be described later. Make it smaller. The status notification unit 112 outputs information regarding the status of the measurement unit 100 to the user terminal 200. For example, the remaining battery level of the battery 106 and information on whether or not the measurement unit 100 has acquired the reference signal by the reference signal acquisition unit 110 are output to the user terminal 200. The state control unit 113 controls the operating state of the measurement unit 100 based on the control instruction from the user terminal 200. The states controlled by the state control unit 113 are, for example, the start of reading the authentication information described later, the start and end of measurement of the reference signal, and whether or not the myoelectric signal can be detected. The start of reading the authentication information, the start of detection of the reference signal, and the like can be set so as to be executed based on the instruction by the system user input via the user terminal 200.
　また、測定部１００には、制御部１０４に給電するためのバッテリ１０６と、バッテリ１０６に非接触で給電するための非接触給電コイル１０７とが設けられている。無線通信部１０８は、ユーザ端末２００の無線通信部２０１との間で無線通信により情報を入出力する。この無線通信部１０８と無線通信部２０１との間の無線通信及び後述する無線通信部２０１と充電装置３００の無線通信部３０１との間の無線通信は、ブルートゥース（登録商標）を含む近距離無線通信である。ブルートゥース（登録商標）の拡張仕様であるＢＬＥ（Bluetooth（登録商標）Low Energy）通信、赤外線通信、及びＮＦＣ（Near Field Communication）等の他の近距離無線通信も、通信データのサイズ（データ量）等の実施条件に応じて利用することができる。 Further, the measuring unit 100 is provided with a battery 106 for supplying power to the control unit 104 and a non-contact power feeding coil 107 for supplying power to the battery 106 in a non-contact manner. The wireless communication unit 108 inputs / outputs information by wireless communication with the wireless communication unit 201 of the user terminal 200. The wireless communication between the wireless communication unit 108 and the wireless communication unit 201 and the wireless communication between the wireless communication unit 201 and the wireless communication unit 301 of the charging device 300, which will be described later, are short-range wireless communication including Bluetooth (registered trademark). Communication. Other short-range wireless communication such as BLE (Bluetooth (registered trademark) Low Energy) communication, infrared communication, and NFC (Near Field Communication), which are extended specifications of Bluetooth (registered trademark), also have the size (data amount) of communication data. It can be used according to the implementation conditions such as.
　コントローラ１０は水密構造を有し、殻部１１内の電極部５及び測定部１００は、水密的に封止されている。バッテリ１０６に給電するために、非接触給電コイル１０７を介して、コントローラ１０の外部との間で給電処理を行う。 The controller 10 has a watertight structure, and the electrode portion 5 and the measuring portion 100 in the shell portion 11 are watertightly sealed. In order to supply power to the battery 106, a power supply process is performed with the outside of the controller 10 via the non-contact power supply coil 107.
　ユーザ端末２００は、生成部２０２と、出力部２０３と、状態管理部２０４と、アプリケーション２０５とを有し、無線通信部２０１を介して、外部との間でデータの送受を行う。生成部２０２は、測定部１００から受信した筋電情報に基づき、パラメータと入力情報を対応付けた入力情報テーブルを使用して、入力情報を生成する。即ち、筋電信号の値と、入力情報テーブルに指定されたパラメータに基づいて、入力情報が生成される。生成された入力情報は、出力部２０３によって、アプリケーション２０５に出力される。アプリケーション２０５では、受信した入力情報を利用して、利用目的に応じた処理を行う。状態管理部２０４は、測定部１００及び充電装置３００の状態情報の取得及びこれに対する制御指示を行う。なお、生成部２０２は、コントローラ１０が装着される部位の皮膚の厚さ等に応じて予め算出された補正係数を利用して、入力情報の生成前の筋電信号又は生成された入力情報を補正するように構成することもできる。この補正係数は、筋電信号又は入力情報に掛け合わされる係数である。これにより、測定部１００の装着部位によって変化する筋電信号の検出値を標準化して利用することができる。 The user terminal 200 has a generation unit 202, an output unit 203, a state management unit 204, and an application 205, and transmits / receives data to / from the outside via the wireless communication unit 201. The generation unit 202 generates the input information by using the input information table in which the parameters and the input information are associated with each other based on the myoelectric information received from the measurement unit 100. That is, the input information is generated based on the value of the myoelectric signal and the parameters specified in the input information table. The generated input information is output to the application 205 by the output unit 203. The application 205 uses the received input information to perform processing according to the purpose of use. The state management unit 204 acquires the state information of the measuring unit 100 and the charging device 300 and gives control instructions for the information. In addition, the generation unit 202 uses the correction coefficient calculated in advance according to the thickness of the skin of the part where the controller 10 is attached, and generates the myoelectric signal before the generation of the input information or the generated input information. It can also be configured to make corrections. This correction coefficient is a coefficient that is multiplied by the myoelectric signal or input information. As a result, the detected value of the myoelectric signal that changes depending on the mounting portion of the measuring unit 100 can be standardized and used.
　充電装置３００は、ユーザ端末２００と無線通信を行う無線通信部３０１と、電極部５のＩＣタグを読み取るＩＣタグリーダ３０３と、バッテリ３０４と、非接触給電コイル１０７を介して測定部１００のバッテリ１０６に給電する電力供給部３０５とを有する。ＩＣタグリーダ３０３は、電極部５のＩＣタグ７に記録された認証情報を読み取る。この認証情報は、電極部５が真正品であることを示す文字列と、接触部２の粘着性能に基づく使用期限等の情報を含む。この読み取られた認証情報は、充電装置３００の認証部３０２によって認証処理（前処理）が実施され、電極部５が正規の電極部であるか、及び接触部３の使用期限との間でその使用履歴に問題がないか等が判断される。 The charging device 300 includes a wireless communication unit 301 that wirelessly communicates with the user terminal 200, an IC tag reader 303 that reads the IC tag of the electrode unit 5, a battery 304, and a battery 106 of the measurement unit 100 via a non-contact power feeding coil 107. It has a power supply unit 305 that supplies power to the power supply unit 305. The IC tag reader 303 reads the authentication information recorded on the IC tag 7 of the electrode unit 5. This authentication information includes a character string indicating that the electrode portion 5 is a genuine product, and information such as an expiration date based on the adhesive performance of the contact portion 2. The read authentication information is subjected to authentication processing (preprocessing) by the authentication unit 302 of the charging device 300, and the electrode unit 5 is a regular electrode unit or the contact unit 3 has an expiration date. It is judged whether there is a problem in the usage history.
　この認証部３０２の判断結果は、無線通信部３０１及び無線通信部２０１を介してユーザ端末２００に送信される。ユーザ端末２００の状態管理部２０４は、受信した判断結果に基づいて、測定部１００の状態制御部１１３に前処理の動作指示を行い、併せて認証結果及び認証できなかった場合の理由を、表示部１３に表示させる。なお、この認証部３０２は、ユーザ端末２００に設けても良い。また、認証結果を、直接測定部１００に出力するようにしてもよい。 The determination result of the authentication unit 302 is transmitted to the user terminal 200 via the wireless communication unit 301 and the wireless communication unit 201. The state management unit 204 of the user terminal 200 gives an operation instruction for preprocessing to the state control unit 113 of the measurement unit 100 based on the received determination result, and also displays the authentication result and the reason when the authentication cannot be performed. Displayed in unit 13. The authentication unit 302 may be provided in the user terminal 200. Further, the authentication result may be directly output to the measuring unit 100.
　上述の如く構成されたコントローラ１０は、図６に示すように、人体の複数の箇所に、導電性接触部２の接着性により、貼り付けられる。例えば、コントローラ１０ａは身体正面の胸に、コントローラ１０ｂは身体背面の首に、コントローラ１０ｃは右手上肢の前腕に、コントローラ１０ｄは左手上肢の前腕に取り付けられる。これにより、入力スイッチ１２をオンにし、人が、胸、首、両腕を動かすと、各位置に配置されたコントローラ１０において、電極３及び筋電位検出部１０１により筋肉の表面の筋電位が検出され、加速度センサ１０２によりコントローラ１０の加速度が検出される。これらの筋電位信号及び加速度信号は、測定部１００にて、所定の前処理又はデータ加工が施され、ユーザ端末２００のアプリケーション２０５に入力される。アプリケーション２０５は、この加速度信号から、コントローラ１０を配置した位置でのその時点での速度及び／又は移動距離を演算し、筋電位から、人間の身体の動きを演算する。その態様の一例を以下に示す。 As shown in FIG. 6, the controller 10 configured as described above is attached to a plurality of parts of the human body due to the adhesiveness of the conductive contact portion 2. For example, the controller 10a is attached to the chest in front of the body, the controller 10b is attached to the neck on the back of the body, the controller 10c is attached to the forearm of the right upper limb, and the controller 10d is attached to the forearm of the left upper limb. As a result, when the input switch 12 is turned on and a person moves the chest, neck, and both arms, the myoelectric potential on the surface of the muscle is detected by the electrode 3 and the myoelectric potential detection unit 101 in the controller 10 arranged at each position. Then, the acceleration sensor 102 detects the acceleration of the controller 10. These myoelectric potential signals and acceleration signals are subjected to predetermined preprocessing or data processing by the measuring unit 100, and are input to the application 205 of the user terminal 200. The application 205 calculates the speed and / or the moving distance at that time at the position where the controller 10 is arranged from this acceleration signal, and calculates the movement of the human body from the myoelectric potential. An example of the embodiment is shown below.
Figure JPOXMLDOC01-appb-T000001
Figure JPOXMLDOC01-appb-T000001
　このように、身体の複数の部位に、コントローラを取付け、複数の部位の筋電位を検出すると共に、複数の部位の加速度を検出することにより、ゲームのキャラクタの動きをシミュレートする態様を、極めて増大させることができる。また、筋電位の検出結果を、アクションゲームに適用すれば、プレーヤが手を握るときの力を調節することにより、キャラクタがアクションゲームの中で活動するときの力の強さに表現することができ、キャラクタの活動の態様を著しく広めることができる。更に、筋電センサの検出結果を、マウスの操作に対応付けることにより、筋電センサを利用した操作をマウス及びキーボードの操作に対応させることができ、従来のゲームにおいては、必要に応じてマウス及びキーボード操作を実際に行っていたのに対し、本発明のコントローラを使用したゲーム操作では、マウス及びキーボードを一切使用しないように、筋電センサの検出結果を利用することができる。これにより、プレーヤの動作によるキャラクタの制御が多彩なものになると共に、ゲーム制御のためにマウス等を操作する必要がなくなり、本発明により、よりリアルなアクションの容易な入力が可能となる。 In this way, the mode of simulating the movement of the character of the game by attaching the controller to a plurality of parts of the body, detecting the myoelectric potentials of the plurality of parts, and detecting the acceleration of the plurality of parts is extremely achieved. Can be increased. In addition, if the myoelectric potential detection result is applied to an action game, it is possible to express the strength of the force when the character is active in the action game by adjusting the force when the player holds the hand. It is possible to significantly spread the mode of activity of the character. Further, by associating the detection result of the myoelectric sensor with the operation of the mouse, the operation using the myoelectric sensor can correspond to the operation of the mouse and the keyboard. In contrast to the actual keyboard operation, in the game operation using the controller of the present invention, the detection result of the myoelectric sensor can be used so as not to use the mouse and the keyboard at all. As a result, the control of the character by the operation of the player becomes various, and it is not necessary to operate the mouse or the like for the control of the game. According to the present invention, more realistic action can be easily input.
　図7（ａ）は実施形態のコントローラ１０ａにおける加速度センサ及び地磁気センサの動きを示し、図７（ｂ）はゲームＡ用の専用コントローラを示し、図７（ｃ）はゲームＢ用の専用コントローラを示し、図７（ｄ）はパソコンゲームにおいて、コントローラとして使用するキーボードを示す。プレーヤの身体を左右方向に動かして、プレーヤの胸に装着したコントローラ１０ａを右方向又は左方向に移動させ、身体を前屈み又は後ろ反りに動かして、コントローラ１０ａを前方又は後方に移動させる。この動作は、例えば、ゲーム機Ａ用のコントローラのボタン２１の操作に対応し、ゲーム機Ｂ用のコントローラのボタン２３の操作に対応し、キーボードのキー２４又はキー２５に対応する。なお、例えば、ゲーム機Ａ用のコントローラのボタン２２は、視界の移動を操作するものであり、各ゲーム機には専用の操作ボタンが備えられている。従来の図７（ｂ）、（ｃ）、（ｄ）に示すコントローラによる人体の動きは、図７（ａ）のコントローラ１０ａにおいては、このコントローラ１０ａの位置の移動に対応づけることができるが、このコントローラ１０ａの移動の検知は、コントローラ１０ａに搭載された加速度センサ及び／又は地磁気センサにより行われる。また、この加速度センサ及び／又は地磁気センサを使用して人体の動きを検出することは従来から行われている。 FIG. 7A shows the movements of the acceleration sensor and the geomagnetic sensor in the controller 10a of the embodiment, FIG. 7B shows a dedicated controller for game A, and FIG. 7C shows a dedicated controller for game B. FIG. 7D shows a keyboard used as a controller in a personal computer game. The player's body is moved left and right to move the controller 10a attached to the player's chest to the right or left, and the body is moved forward or backward to move the controller 10a forward or backward. This operation corresponds to, for example, the operation of the button 21 of the controller for the game machine A, the operation of the button 23 of the controller for the game machine B, and corresponds to the key 24 or the key 25 of the keyboard. For example, the button 22 of the controller for the game machine A controls the movement of the field of view, and each game machine is provided with a dedicated operation button. The conventional movement of the human body by the controller shown in FIGS. 7 (b), 7 (c), and (d) can be associated with the movement of the position of the controller 10a in the controller 10a of FIG. 7 (a). The movement of the controller 10a is detected by the acceleration sensor and / or the geomagnetic sensor mounted on the controller 10a. Further, it has been conventionally performed to detect the movement of the human body by using this acceleration sensor and / or the geomagnetic sensor.
　本発明は、コントローラ１０ａ、１０ｂ等に、加速度センサ及び／又は地磁気センサの他に、筋電位センサを搭載したことに特徴があり、この筋電位センサを有効に利用して、ゲームの新しい使用方法を提供するものである。 The present invention is characterized in that the controllers 10a, 10b, etc. are equipped with a myoelectric potential sensor in addition to the acceleration sensor and / or the geomagnetic sensor, and a new method of using the game by effectively utilizing the myoelectric potential sensor. Is to provide.
　図８（ａ）及び図９（ａ）に示すコントローラ１０ｃ、１０ｄは、加速度センサの他に筋電位センサを具備したものであり、このコントローラ１０ｃ、１０ｄを夫々前腕の手のひら側の位置に装着している。これにより、コントローラ１０ｃ、１０ｄによって、前腕の加速度を検知すると共に、前腕の手のひら側の筋肉の電位を検知する。 The controllers 10c and 10d shown in FIGS. 8 (a) and 9 (a) are provided with a myoelectric potential sensor in addition to the acceleration sensor, and the controllers 10c and 10d are mounted at positions on the palm side of the forearm, respectively. ing. As a result, the controllers 10c and 10d detect the acceleration of the forearm and the electric potential of the muscle on the palm side of the forearm.
　そして、図８において、プレーヤが両前腕又は片方の前腕を小刻みに振り、前腕の手のひら側の筋肉に対し軽度の力を付与する。そうすると、この小刻みな振りは加速度センサにより検知され、筋肉の軽い力は筋電センサにより検知されて、このプレーヤの動きは、軽度なアクションを示すことになる。例えば、ボクシングでいえば、軽いジョブに対応する。図８（ｂ）に示すように、ゲーム機Ａ用のコントローラでは、この軽度なアクションは、ボタン３１を押すことによりシミュレートされる。また、この軽度なアクションは、図８（ｃ）に示すマウスの場合には、左クリック３２で動作し、図８（ｄ）に示すキーボードの場合には、キー３３の押下で動作する。 Then, in FIG. 8, the player swings both forearms or one forearm in small steps to apply a slight force to the muscles on the palm side of the forearm. Then, this small swing is detected by the acceleration sensor, the light force of the muscle is detected by the myoelectric sensor, and the movement of this player indicates a light action. For example, in boxing, it corresponds to a light job. As shown in FIG. 8B, in the controller for the game machine A, this light action is simulated by pressing the button 31. Further, this mild action is operated by the left click 32 in the case of the mouse shown in FIG. 8 (c), and is operated by pressing the key 33 in the case of the keyboard shown in FIG. 8 (d).
　一方、図９においては、プレーヤが両前腕又は片方の前腕を大きく振り、前腕の手のひら側の筋肉に対し重度の力を付与する。そうすると、この大きな前腕の振りは加速度センサにより検知され、筋肉の強い力は筋電センサにより検知されて、このプレーヤの動きは、重度なアクションを示すことになる。例えば、ボクシングでいえば、強打に対応する。図９（ｂ）に示すように、ゲーム機Ａ用のコントローラでは、この重度のアクションは、ボタン３４を押すことによりシミュレートされる。また、この重度のアクションは、図９（ｃ）に示すマウスの場合には、右クリック３５で動作し、図９（ｄ）に示すキーボードの場合には、キー３６の押下で動作する。 On the other hand, in FIG. 9, the player swings both forearms or one forearm greatly to apply a heavy force to the muscles on the palm side of the forearm. Then, the swing of this large forearm is detected by the acceleration sensor, the strong force of the muscle is detected by the myoelectric sensor, and the movement of this player indicates a serious action. For example, in boxing, it corresponds to a bang. As shown in FIG. 9B, in the controller for game console A, this severe action is simulated by pressing a button 34. Further, this severe action is operated by right-clicking 35 in the case of the mouse shown in FIG. 9 (c), and by pressing the key 36 in the case of the keyboard shown in FIG. 9 (d).
　図８と図９の対比からわかるように、従来のゲーム機Ａ用のコントローラ、ゲーム機Ｂ用のコントローラ及びパソコンゲーム機用キーボードで、ゲームをしようとすると、弱いアクションと、強いアクションの違いを、異なるボタンを押すことにより選択する。これに対し、本発明においては、手を握る力を強くしたり、又は前腕の筋肉の力を直接制御することにより、コントローラ１０ｃ、１０ｄが検出する筋電位の大きさを調整する。つまり、前腕の筋肉に強い負荷を与えることにより、この筋肉の電位が高くなり、コントローラ１０ｃ、１０ｄが高い筋電位を検出することにより、コントローラ１０ｃ、１０ｄが接続されたゲーム制御部には、プレーヤが強いアクションを選択したことを示す信号が入力される。そして、ゲーム制御部は、コントローラ１０ｃ、１０ｄの加速度センサの腕の振りの大きさ等の検知結果と共に強いアクションの指示を判断し、強力で長いストローク又は強力で短いストロークをディスプレイ上に表示する。また、前腕の筋肉に弱い負荷を与えた場合は、この筋肉の電位が低くなり、コントローラ１０ｃ、１０ｄが低い筋電位を検出することにより、コントローラ１０ｃ、１０ｄが接続されたゲーム制御部には、プレーヤが弱いアクションを選択したことを示す信号が入力される。そして、ゲーム制御部は、コントローラ１０ｃ、１０ｄの加速度センサの腕の振りの大きさ等の検知結果と共に弱いアクションの指示を判断し、弱く長いストローク又は弱く短いストロークをディスプレイ上に表示する。よって、本発明においては、従来のようなコントローラに対するボタン操作による信号入力をする代わりに、筋電位及び加速度等を検出するコントローラをプレーヤの身体に装着するだけで、そのプレーヤがゲーム上のキャラクタに実行させようとするアクションを自身の身体の直感的な動作で表すことができる。このように従来のボタン操作による入力の代わりに、プレーヤの身体の動きにより、キャラクタに動作させたい動きと同様にプレーヤが動くだけで、ゲームを楽しむことができ、ゲームの進行に集中することができ、ゲームの楽しみ方が飛躍的に拡大及び向上する。 As can be seen from the comparison between FIGS. 8 and 9, when trying to play a game with a conventional controller for game machine A, a controller for game machine B, and a keyboard for a personal computer game machine, the difference between weak action and strong action is seen. , Select by pressing different buttons. On the other hand, in the present invention, the magnitude of the myoelectric potential detected by the controllers 10c and 10d is adjusted by increasing the force of gripping the hand or directly controlling the force of the muscle of the forearm. That is, by applying a strong load to the muscle of the forearm, the potential of this muscle becomes high, and by detecting the high myoelectric potential of the controllers 10c and 10d, the player is connected to the game control unit to which the controllers 10c and 10d are connected. A signal is input indicating that a strong action has been selected. Then, the game control unit determines a strong action instruction together with the detection result such as the magnitude of the swing of the arm of the acceleration sensor of the controller 10c and 10d, and displays a strong and long stroke or a strong and short stroke on the display. Further, when a weak load is applied to the muscle of the forearm, the electric potential of this muscle becomes low, and the controllers 10c and 10d detect the low myoelectric potential, so that the game control unit to which the controllers 10c and 10d are connected is connected to the game control unit. A signal is input indicating that the player has selected a weak action. Then, the game control unit determines a weak action instruction together with the detection result such as the magnitude of the swing of the arm of the acceleration sensor of the controller 10c and 10d, and displays a weak long stroke or a weak short stroke on the display. Therefore, in the present invention, instead of inputting a signal by operating a button to the controller as in the conventional case, the player can be a character in the game simply by attaching a controller for detecting myoelectric potential, acceleration, etc. to the player's body. The action to be executed can be expressed by the intuitive movement of one's own body. In this way, instead of the input by the conventional button operation, the movement of the player's body allows the player to enjoy the game and concentrate on the progress of the game just by moving the player in the same manner as the movement desired to be performed by the character. It can be done, and the way of enjoying the game is dramatically expanded and improved.
　図１０は、両前腕の筋肉に長時間の力を負荷した場合のものである。この場合は、両前腕に装着したコントローラ１０ｃ、１０ｄに長時間にわたり、筋電位センサの出力が検出される。そうすると、この長時間の筋電位の検出は、コントローラ１０ｃ、１０ｄが接続されたゲーム制御部において、例えば、典型的なゲームでの表現として、畜力アクション、畜力ゲージへのチャージ又は頻度が少ないアクションといわれるものに相当するものと、判断される。この長時間の筋肉の緊張、即ち、筋電位センサの長時間の有意の出力は、例えば、戦争ゲームにおいては、連射の動きを表現する。また、攻撃の継続、ジャンプの継続、組合技等を表現する場合もある。従来、このような動作は、例えば、図１０（ｂ）に示すように、ゲーム機Ａ用のコントローラにおいては、ボタン３７の長押しにより与える。また、ゲーム機Ｂにおいては、図１０（ｃ）に示すように、マウスの左右のボタンを同時にクリックしつつ、キーボードのボタン３９を長押しすることにより与える。しかし、本発明においては、両前腕の筋肉の緊張を継続するだけで、連射等を表現することができ、図８及び図９と同様に、ゲームへの没頭感を従来より著しく高めることができる。 FIG. 10 shows a case where a long-time force is applied to the muscles of both forearms. In this case, the output of the myoelectric potential sensor is detected by the controllers 10c and 10d attached to both forearms for a long time. Then, the detection of the myoelectric potential for a long period of time is referred to as a livestock action, a charge to the livestock gauge, or an infrequent action in a game control unit to which the controllers 10c and 10d are connected, for example, as a typical game expression. It is judged to be equivalent to what is said. This long-term muscle tension, i.e., the long-term significant output of the myoelectric potential sensor, represents, for example, the movement of rapid fire in a war game. It may also represent the continuation of attacks, the continuation of jumps, union skills, etc. Conventionally, such an operation is given by pressing and holding the button 37 in the controller for the game machine A, for example, as shown in FIG. 10 (b). Further, in the game machine B, as shown in FIG. 10 (c), it is given by pressing and holding the button 39 of the keyboard while simultaneously clicking the left and right buttons of the mouse. However, in the present invention, it is possible to express continuous shooting and the like only by continuing the tension of the muscles of both forearms, and as in FIGS. 8 and 9, the feeling of immersion in the game can be remarkably enhanced as compared with the conventional case. ..
　また、例えば、テニスゲームにおいて、ボールに回転を与えるような動作をキャラクタにさせる場合、従来のゲーム機のコントローラにおいては、円滑にそのような操作をすることはできない。仮に、キャラクタにそのような操作をさせる場合、プレーヤはコントローラのボタンを押すか、又はコントローラを傾ける等のように、コントローラを操るような動作をする必要がある。よって、従来、テニスゲームにおいて、ラケットを振ると同時に、その振り方に対し、ボールの右回転又は左回転を瞬時に与えることは、プレーヤに対し厳しい動作を強いることになる。 Further, for example, in a tennis game, when a character is made to perform an action that gives rotation to a ball, such an operation cannot be smoothly performed with a controller of a conventional game machine. If the character is to perform such an operation, the player needs to perform an operation such as pressing a button on the controller or tilting the controller. Therefore, conventionally, in a tennis game, swinging a racket and at the same time instantly giving a right or left rotation of the ball to the swinging method imposes a severe motion on the player.
　これに対し、本発明においては、前腕の手のひら側と、その反対側に、夫々コントローラ１０ｃ、１０ｄを装着することにより、テニスボールにラケットの振り出しとその際のボールへの回転付与とを容易に実現できる。即ち、プレーヤの右前腕の裏表に夫々コントローラ１０ｃを装着し、プレーヤの左前腕の裏表に夫々コントローラ１０ｄを装着し、両前腕に４個のコントローラ１０ｃ、１０ｄを装着する。そして、例えば、テニスボールを前方に打ち出すストローク動作のために、プレーヤがラケットを持ったと仮定された右腕を振り出す動作（肩を中心とする腕全体の回動）をしたときに、プレーヤが腕を左回転（左ねじり）させると、右腕の表裏に装着した２個のコントローラがその筋電位の変化を検知して、腕の左回転（左ねじり）を検知する。そうすると、現実のテニスの際に、腕を振り出すと同時に左回転（左ねじり）させた場合と同様に、ボールに対し、スピンをかけることができる。逆に、腕に右回転（右ねじり）を与えると、ボールにスライス回転をかけることができる。サービスの場合も同様に、２個のコントローラにおける筋電位の変化が、プレーヤが腕を振り上げたときの右ねじり回転又は左ねじり回転を検知することができる。これにより、キャラクタのサーブに対し、スピン回転又はスライス回転を与えることができる。 On the other hand, in the present invention, by mounting the controllers 10c and 10d on the palm side of the forearm and the opposite side, respectively, it is possible to easily swing the racket to the tennis ball and give rotation to the ball at that time. realizable. That is, the controllers 10c are mounted on the front and back of the player's right forearm, the controllers 10d are mounted on the front and back of the player's left forearm, respectively, and the four controllers 10c and 10d are mounted on both forearms. Then, for example, when the player swings out the right arm (rotation of the entire arm around the shoulder), which is assumed to hold the racket, for the stroke motion of launching the tennis ball forward, the player moves the arm. When the ball is rotated counterclockwise (twisted left), two controllers attached to the front and back of the right arm detect the change in the myoelectric potential and detect the left rotation (twisted left) of the arm. Then, in the actual tennis, it is possible to spin the ball in the same manner as when the arm is swung out and at the same time rotated counterclockwise (twisted counterclockwise). Conversely, by giving the arm a right-handed rotation (right-handed twist), the ball can be sliced. Similarly, in the case of the service, the change in the myoelectric potential in the two controllers can detect the right-handed twisting rotation or the left-handed twisting rotation when the player swings his arm up. As a result, spin rotation or slice rotation can be given to the serve of the character.
　このような動作は、例えば、卓球ゲームにおけるボールに回転を与える操作及び野球ゲームにおけるピッチャーがボールに回転を与える操作にも適用することができる。更に、ボクシングゲームにおいては、腕のねじり方向の違いにより、アッパーカットか、ストレートかの違いを表現すること等が可能である。更に、戦争ゲーム等においても、一つの腕に２個のコントローラ（筋電位センサ）を装着することにより、その腕のねじれ角又はねじれ方向を変更すれば、２個の筋電位センサが２カ所の筋電位の相互関係及び変化パターンを検出して、そのプレーヤの腕の動きから、プレーヤが意図するキャラクタの動きをゲーム制御部に指定することができる。よって、従来のように、コントローラのボタンを押す等の外部機器を使用した付加的な操作ではなく、プレーヤ自身の動きによりキャラクタに与える動作を指定することができ、ゲームに没頭してゲームを楽しむことができる。更に、１本の腕に装着すべきコントローラの数は、１個又は２個に限らず、３個以上でも良く、この場合は更に複雑な操作を１本の腕で実行することができる。例えば、腕の周囲に適長間隔で複数個のコントローラを腕を取り囲むように設けて、複数個の筋電位を検出することとしてもよい。また、本実施形態のコントローラは加速度センサを含むものであるが、加速度センサを複数個設ける必要がない場合は、１個のコントローラと１又は複数個の筋電位センサを腕の周囲に設けてもよい。 Such an operation can be applied to, for example, an operation of giving rotation to the ball in a table tennis game and an operation of giving rotation to the ball by a pitcher in a baseball game. Further, in a boxing game, it is possible to express the difference between uppercut and straight by the difference in the twisting direction of the arm. Furthermore, even in war games, if two controllers (myoelectric potential sensors) are attached to one arm and the twist angle or twist direction of the arm is changed, the two myoelectric potential sensors can be installed in two places. The interrelationship and change pattern of the myoelectric potential can be detected, and the movement of the character intended by the player can be specified to the game control unit from the movement of the player's arm. Therefore, it is possible to specify the action to be given to the character by the movement of the player himself, instead of the additional operation using an external device such as pressing a button on the controller as in the past, and enjoy the game by immersing himself in the game. be able to. Further, the number of controllers to be attached to one arm is not limited to one or two, and may be three or more. In this case, a more complicated operation can be performed with one arm. For example, a plurality of controllers may be provided around the arm at appropriate length intervals so as to surround the arm to detect a plurality of myoelectric potentials. Further, although the controller of the present embodiment includes an acceleration sensor, if it is not necessary to provide a plurality of acceleration sensors, one controller and one or a plurality of myoelectric potential sensors may be provided around the arm.
　上記実施形態においては、コントローラが、筋電位センサの他に、加速度センサを具備するものである。しかしながら、本発明のコントローラは、これに限らず、加速度センサに代えて、又は加速度センサに加えて、角速度センサを具備してもよい。この角速度センサは、コントローラが装着される身体の位置の角速度を検出し、この位置の回転に関連する情報を検出する。ゲーム制御部は、この角速度の検出結果を、筋電位の検出結果と併せて、キャラクタの制御に利用する。また、本発明のコントローラは、筋電位センサの他に、加速度センサと角速度センサを装着するようにしても良い。この場合は、加速度センサの検出結果と、角速度センサの検出結果を、筋電位センサの検出結果と共に、ゲームキャラクタの動作の制御に利用することができる。 In the above embodiment, the controller includes an acceleration sensor in addition to the myoelectric potential sensor. However, the controller of the present invention is not limited to this, and may include an angular velocity sensor in place of the acceleration sensor or in addition to the acceleration sensor. The angular velocity sensor detects the angular velocity of the position of the body on which the controller is mounted and detects information related to rotation of this position. The game control unit uses the detection result of the angular velocity together with the detection result of the myoelectric potential to control the character. Further, the controller of the present invention may be equipped with an acceleration sensor and an angular velocity sensor in addition to the myoelectric potential sensor. In this case, the detection result of the acceleration sensor and the detection result of the angular velocity sensor can be used together with the detection result of the myoelectric potential sensor to control the movement of the game character.
　なお、上記実施形態は、ゲーム制御部がユーザ端末にインストールされたアプリケーションとして構成されているが、本発明はこれに限らず、別途ゲーム制御部を設けることも可能である。また、本実施形態のコントローラ（筋電位センサ＋加速度センサ及び又は角度センサを含む）は、プレーヤの身体の任意の位置に装着することができ、腕に限らず、例えば、足等に装着して、筋電位センサと加速度及び／又は角速度センサの各検出信号の組み合わせにより、ゲームキャラクタの動作を種々設定することが可能になる。 Although the above embodiment is configured as an application in which the game control unit is installed on the user terminal, the present invention is not limited to this, and a game control unit may be separately provided. Further, the controller (including the myoelectric potential sensor + acceleration sensor and / or angle sensor) of the present embodiment can be attached to any position on the player's body, and is attached not only to the arm but also to, for example, the foot. , The combination of the detection signals of the myoelectric potential sensor and the acceleration and / or angular velocity sensor makes it possible to set various movements of the game character.
　本発明によれば、従来から使用されている加速度センサ、角速度センサ、又はジャイロセンサの検出結果と組み合わせて、筋電位センサを使用して、筋肉の緊張度合いにより変化する筋電位の検出結果を利用することにより、ゲームキャラクタに対し、動作の強度を表現することができると共に、ボクシングゲームにおけるジャブ又はアッパーカット、テニスゲーム等におけるボール回転の選択・設定を指示することができ、より深みのある指示をゲームキャラクタに与えることができる。しかも、これらの動作及び選択・設定をプレーヤの身体の動きと筋肉の緊張度合いとにより表現することができるから、従来のようにコントローラのボタンを押すというような操作をゲームの途中で実行する必要がない。このため、ゲームに没頭することができ、本発明は、ゲームの可能性を著しく広めるという利点がある。 According to the present invention, the myoelectric potential sensor is used in combination with the detection results of the accelerometer, the angular velocity sensor, or the gyro sensor that have been conventionally used, and the detection result of the myoelectric potential that changes depending on the degree of muscle tension is used. By doing so, it is possible to express the strength of the movement to the game character, and it is possible to instruct the selection / setting of the ball rotation in the jab or upper cut in the boxing game, the tennis game, etc., and the instruction is deeper. Can be given to the game character. Moreover, since these movements and selections / settings can be expressed by the movement of the player's body and the degree of muscle tension, it is necessary to perform an operation such as pressing a button on the controller in the middle of the game as in the past. There is no. Therefore, it is possible to immerse yourself in the game, and the present invention has the advantage of significantly expanding the possibilities of the game.
２：接触部
３：電極
５：電極部
１０、１０ａ、１０ｂ、１０ｃ、１０ｄ：コントローラ
２１、２２、２３、３１、３２、３４、３５、３７、３８：ボタン
２４、２５、３３、３６、３９：キー
４１：電極接続部
１００：測定部
１０４：制御部
２００：ユーザ端末
３００：充電装置 2: Contact part 3: Electrode 5: Electrode part 10, 10a, 10b, 10c, 10d: Controller 21, 22, 23, 31, 32, 34, 35, 37, 38: Button 24, 25, 33, 36, 39 : Key 41: Electrode connection unit 100: Measurement unit 104: Control unit 200: User terminal 300: Charging device

Claims (9)

  1. 皮膚表面の筋電位を検出する筋電位センサと、加速度を検出する加速度センサとを内蔵したコントローラを、ゲームプレーヤの身体の複数箇所に取り付け、
    前記筋電位センサ及び加速度センサの検出信号が入力されるゲーム制御部にて、
    前記加速度センサの検出信号により前記コントローラの取付位置の移動又は位置に関連する情報を求めて、それをゲームキャラクタの対応位置の移動又は位置に関連する情報に対応させ、
    前記筋電センサの検出結果により前記コントローラの取付位置の筋肉の状態に関連する情報を求めて、それをゲームキャラクタの対応位置の動作の強度に関連する情報及び／又はゲームの設定・選択に関連する情報に対応させることを特徴とするコントローラを使用したゲーム方法。     A controller with a built-in myoelectric potential sensor that detects the myoelectric potential on the skin surface and an acceleration sensor that detects acceleration is attached to multiple locations on the body of the game player.
    In the game control unit where the detection signals of the myoelectric potential sensor and the acceleration sensor are input,
    Information related to the movement or position of the mounting position of the controller is obtained from the detection signal of the acceleration sensor, and it is made to correspond to the information related to the movement or position of the corresponding position of the game character.
    Based on the detection result of the myoelectric sensor, information related to the state of the muscle at the mounting position of the controller is obtained, and it is related to the information related to the strength of the movement of the corresponding position of the game character and / or the setting / selection of the game. A game method using a controller, which is characterized by corresponding to information to be played.
  2. 皮膚表面の筋電位を検出する筋電位センサと、角速度を検出する角速度センサとを内蔵したコントローラを、ゲームプレーヤの身体の複数箇所に取り付け、
    前記筋電位センサ及び角速度センサの検出信号が入力されるゲーム制御部にて、
    前記角速度センサの検出信号により前記コントローラの取付位置の回転に関連する情報を求めて、それをゲームキャラクタの対応位置の回転に関連する情報に対応させ、
    前記筋電センサの検出結果により前記コントローラの取付位置の筋肉の状態に関連する情報を求めて、それをゲームキャラクタの対応位置の動作の強度に関連する情報及び／又はゲームの設定・選択に関連する情報に対応させることを特徴とするコントローラを使用したゲーム方法。     A controller with a built-in myoelectric potential sensor that detects the myoelectric potential on the skin surface and an angular velocity sensor that detects the angular velocity is attached to multiple locations on the body of the game player.
    In the game control unit where the detection signals of the myoelectric potential sensor and the angular velocity sensor are input,
    Information related to the rotation of the mounting position of the controller is obtained from the detection signal of the angular velocity sensor, and it is made to correspond to the information related to the rotation of the corresponding position of the game character.
    Based on the detection result of the myoelectric sensor, information related to the state of the muscle at the mounting position of the controller is obtained, and it is related to the information related to the strength of the movement of the corresponding position of the game character and / or the setting / selection of the game. A game method using a controller, which is characterized by corresponding to information to be played.
  3. 皮膚表面の筋電位を検出する筋電位センサと、加速度を検出する加速度センサと、角速度を検出する角速度センサを内蔵したコントローラを、ゲームプレーヤの身体の複数箇所に取り付け、
    前記筋電位センサ、加速度センサ及び角速度センサの検出信号が入力されるゲーム制御部にて、
    前記加速度センサの検出信号により前記コントローラの取付位置の移動又は位置に関連する情報を求めて、それをゲームキャラクタの対応位置の移動又は位置に関連する情報に対応させ、
    前記角速度センサの検出信号により前記コントローラの取付位置の回転に関連する情報を求めて、それをゲームキャラクタの対応位置の回転に関連する情報に対応させ、
    前記筋電センサの検出結果により前記コントローラの取付位置の筋肉の状態に関連する情報を求めて、それをゲームキャラクタの対応位置の動作の強度に関連する情報及び／又はゲームの設定・選択に関連する情報に対応させることを特徴とするコントローラを使用したゲーム方法。     A controller with a built-in myoelectric potential sensor that detects the myoelectric potential on the skin surface, an acceleration sensor that detects acceleration, and an angular velocity sensor that detects angular velocity is attached to multiple locations on the body of the game player.
    In the game control unit where the detection signals of the myoelectric potential sensor, the acceleration sensor, and the angular velocity sensor are input.
    Information related to the movement or position of the mounting position of the controller is obtained from the detection signal of the acceleration sensor, and it is made to correspond to the information related to the movement or position of the corresponding position of the game character.
    Information related to the rotation of the mounting position of the controller is obtained from the detection signal of the angular velocity sensor, and it is made to correspond to the information related to the rotation of the corresponding position of the game character.
    Based on the detection result of the myoelectric sensor, information related to the state of the muscle at the mounting position of the controller is obtained, and it is related to the information related to the strength of the movement of the corresponding position of the game character and / or the setting / selection of the game. A game method using a controller, which is characterized by corresponding to information to be played.
  4. 前記ゲーム制御部は、ユーザ端末のアプリケーションの一部であることを特徴とする請求項１に記載のコントローラを使用したゲーム方法。 The game method using the controller according to claim 1, wherein the game control unit is a part of an application of a user terminal.
  5. 前記ゲーム制御部は、ユーザ端末のアプリケーションの一部であることを特徴とする請求項２に記載のコントローラを使用したゲーム方法。 The game method using the controller according to claim 2, wherein the game control unit is a part of an application of a user terminal.
  6. 前記ゲーム制御部は、ユーザ端末のアプリケーションの一部であることを特徴とする請求項３に記載のコントローラを使用したゲーム方法。 The game method using the controller according to claim 3, wherein the game control unit is a part of an application of a user terminal.
  7. 前記コントローラを、前記ゲームプレーヤの同一部位に複数個取付け、
    前記ゲーム制御部にて、各コントローラの筋電位センサの検出結果の相互の関係又は時間的変化に基づいて、ゲームキャラクタの動作を制御することを特徴とする請求項１に記載のコントローラを使用したゲーム方法。     A plurality of the controllers are attached to the same part of the game player,
    The controller according to claim 1, wherein the game control unit controls the movement of the game character based on the mutual relationship or temporal change of the detection results of the myoelectric potential sensors of each controller. Game method.
  8. 前記コントローラを、前記ゲームプレーヤの同一部位に複数個取付け、
    前記ゲーム制御部にて、各コントローラの筋電位センサの検出結果の相互の関係又は時間的変化に基づいて、ゲームキャラクタの動作を制御することを特徴とする請求項２に記載のコントローラを使用したゲーム方法。     A plurality of the controllers are attached to the same part of the game player,
    The controller according to claim 2, wherein the game control unit controls the movement of the game character based on the mutual relationship or temporal change of the detection results of the myoelectric potential sensors of each controller. Game method.
  9. 前記コントローラを、前記ゲームプレーヤの同一部位に複数個取付け、
    前記ゲーム制御部にて、各コントローラの筋電位センサの検出結果の相互の関係又は時間的変化に基づいて、ゲームキャラクタの動作を制御することを特徴とする請求項３に記載のコントローラを使用したゲーム方法。     A plurality of the controllers are attached to the same part of the game player,
    The controller according to claim 3, wherein the game control unit controls the movement of the game character based on the mutual relationship or temporal change of the detection results of the myoelectric potential sensors of each controller. Game method.
PCT/JP2020/037697 2019-10-08 2020-10-05 Game method using controller WO2021070770A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2019185558A JP2021058482A (en) 2019-10-08 2019-10-08 Game method using controllers
JP2019-185558 2019-10-08

Publications (1)

Publication Number Publication Date
WO2021070770A1 true WO2021070770A1 (en) 2021-04-15

Family

ID=75380844

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2020/037697 WO2021070770A1 (en) 2019-10-08 2020-10-05 Game method using controller

Country Status (2)

Country Link
JP (1) JP2021058482A (en)
WO (1) WO2021070770A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015196091A (en) * 2014-04-02 2015-11-09 アップルジャック １９９ エル．ピー． Sensor-based gaming system for avatar to represent player in virtual environment
JP2015204091A (en) * 2014-04-16 2015-11-16 康太郎 高濱 vector data output system and video display system
JP2017126302A (en) * 2016-01-15 2017-07-20 株式会社ｍｅｌｅａｐ Image display system, control method thereof, image distribution system, and head-mounted display
JP2019128721A (en) * 2018-01-23 2019-08-01 株式会社コロプラ Program for reflecting user motion on avatar, information processing device for executing the same and method for distributing image containing avatar

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015196091A (en) * 2014-04-02 2015-11-09 アップルジャック １９９ エル．ピー． Sensor-based gaming system for avatar to represent player in virtual environment
JP2015204091A (en) * 2014-04-16 2015-11-16 康太郎 高濱 vector data output system and video display system
JP2017126302A (en) * 2016-01-15 2017-07-20 株式会社ｍｅｌｅａｐ Image display system, control method thereof, image distribution system, and head-mounted display
JP2019128721A (en) * 2018-01-23 2019-08-01 株式会社コロプラ Program for reflecting user motion on avatar, information processing device for executing the same and method for distributing image containing avatar

Also Published As

Publication number Publication date
JP2021058482A (en) 2021-04-15

Similar Documents

Publication Publication Date Title
JP5996138B1 (en) GAME PROGRAM, METHOD, AND GAME SYSTEM
CN107368183B (en) Glove for providing input
US20070149282A1 (en) Interactive gaming method and apparatus with emotion perception ability
JP5969626B2 (en) System and method for enhanced gesture-based dialogue
US9737817B1 (en) Method and apparatus for simulating a gaming event
JP5361349B2 (en) Information processing apparatus, computer program, information processing system, and information processing method
CN111356968A (en) Rendering virtual hand gestures based on detected hand input
JP5792971B2 (en) Information processing system, information processing program, and information processing method
US20130288761A1 (en) Interactive wearable videogame through the use of wireless electronic sensors and physical objects
EP2302487A2 (en) Storage medium with information processing program and information processing apparatus for detecting swing direction of input device
JP2008136694A (en) Program, information storage medium and game apparatus
JP6248219B1 (en) Information processing method, computer, and program for causing computer to execute information processing method
CN107427720A (en) Game console
EP3468679B1 (en) Method and apparatus for simulating a gaming event
JP6646565B2 (en) Information processing method and apparatus, and program for causing computer to execute the information processing method
JP2018147465A (en) Information processing method, device, and program for causing computer to execute the method
JP6479933B1 (en) Program, information processing apparatus, and method
WO2021070770A1 (en) Game method using controller
CN109475773B (en) Method and apparatus for simulating game events
CN109416679B (en) Multiple electronic control and tracking devices for mixed reality interactions
JP6263292B1 (en) Information processing method, computer, and program for causing computer to execute information processing method
JP2017170106A (en) Game program, method, and game system
JP2017099608A (en) Control system and program
US10242241B1 (en) Advanced mobile communication device gameplay system
JP6330072B1 (en) Information processing method, apparatus, and program for causing computer to execute information processing method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20875090

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20875090

Country of ref document: EP

Kind code of ref document: A1