CN111202973A - Game control method and device based on brain waves - Google Patents

Game control method and device based on brain waves Download PDF

Info

Publication number
CN111202973A
CN111202973A CN201911377375.9A CN201911377375A CN111202973A CN 111202973 A CN111202973 A CN 111202973A CN 201911377375 A CN201911377375 A CN 201911377375A CN 111202973 A CN111202973 A CN 111202973A
Authority
CN
China
Prior art keywords
game
control
instruction
voice
control instruction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201911377375.9A
Other languages
Chinese (zh)
Inventor
赖胤龙
刘志文
严绍熙
罗建民
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shaoguan University
Original Assignee
Shaoguan University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shaoguan University filed Critical Shaoguan University
Priority to CN201911377375.9A priority Critical patent/CN111202973A/en
Publication of CN111202973A publication Critical patent/CN111202973A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/21Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/212Input arrangements for video game devices characterised by their sensors, purposes or types using sensors worn by the player, e.g. for measuring heart beat or leg activity
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/40Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
    • A63F13/42Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1012Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals involving biosensors worn by the player, e.g. for measuring heart beat, limb activity

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biophysics (AREA)
  • Cardiology (AREA)
  • General Health & Medical Sciences (AREA)
  • Heart & Thoracic Surgery (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a game control method and a game control device based on brain waves, which comprise the following contents: arranging a signal acquisition module to acquire brain wave signals; a signal processing module is arranged to process the brain wave signals and generate fluctuation numerical values; a setting instruction generation module converts the fluctuation numerical value into a control instruction, wherein the control instruction comprises an artificial voice control instruction; setting a sound output module and controlling the output content to be artificial voice of the virtual scene name by the artificial voice control instruction; and setting a voice processing module and controlling the switching of the game virtual scene according to the artificial voice control instruction. According to the invention, the artificial intelligent voice instruction is generated through the brain wave signal, the sound output module is controlled to output the artificial voice, and the game is controlled, so that the control mode of the game and the experience mode of the sense of the user are increased.

Description

Game control method and device based on brain waves
Technical Field
The invention relates to the field of game control, in particular to a game control method and device based on brain waves.
Background
Virtual Reality (VR) is a computer simulation system that can create and experience a Virtual world, and it uses a computer to generate a simulation environment, so it is widely used in game and entertainment because it can make users immerse in the simulation environment and interact with each other. The existing VR game is usually controlled by using controllers such as a gamepad and a steering wheel, and the game controller with complex operation has high requirements on the use proficiency of a user, influences the experience of the user and is not beneficial to the popularization of the game. On the other hand, some methods for controlling games through brain waves have appeared in the prior art. For example, the invention patent with the patent application number of 201510981902.2 discloses a will tank game device, please refer to fig. 1, the will tank game device includes a will headset and a tank robot, the will headset includes a brain wave module and an MPU6050 motion sensor, the brain wave module and the MPU6050 motion sensor are both electrically connected with a 24L01 module, the brain wave module controls the motion speed of the tank robot by collecting the brain wave intensity data of a player, the MPU6050 motion sensor controls the motion mode of the tank robot by collecting the head posture data of the player, and the data collected by the brain wave module and the MPU6050 motion sensor are both processed by an Atmega328 singlechip and then wirelessly transmitted to the tank robot by a 24L01 module. The operation of the tank robot is controlled by a control method for detecting the brain waves of the player and the amplitude of the head swing.
Therefore, the brain wave controlled game can be applied to the VR game, thereby realizing that the game object is not controlled by the game controller. However, in the above patent, the game control method based on brain waves only controls the movement of the tank, the control object is single, and the movement of the tank only brings visual effects to users, so that various sensory experiences cannot be realized. However, there are generally many objects and operations to be controlled in a VR game, and a single control method in the prior art cannot meet the requirements of VR game operation control and user sensory experience, and how to further optimize the control method of the VR game by brain waves to meet the requirements of multiple operation controls of the VR game becomes a subject of research by the present invention.
Disclosure of Invention
Accordingly, an object of the present invention is to provide a game control method based on brain waves, which controls various objects and operations of a VR game by brain waves, improves user experience, and increases game operability and entertainment. The method comprises the following steps:
acquiring brain wave signals;
processing the brain wave signals and generating a fluctuation numerical value;
converting the fluctuation numerical value into a control instruction, wherein the control instruction comprises an artificial voice control instruction;
controlling the output content to be artificial voice of the virtual scene name according to the artificial voice control instruction;
and controlling the switching of the game virtual scene according to the artificial voice control instruction.
Compared with the prior art, the game is controlled while the artificial intelligent voice instruction is generated through the brain wave signal and the sound output module is controlled to output the artificial voice, so that the control mode of the game and the experience mode of the sense organ of the user are increased.
Further, converting the fluctuation numerical value into a control instruction, wherein the control instruction also comprises an action control instruction; also comprises the following steps: and controlling the action of the game object according to the action control command.
Further, the game object comprises a car running in a virtual scene; the action of the game object comprises controlling the automobile to move leftwards, rightwards, run at a constant speed, accelerate and decelerate.
Further, the method also comprises the following steps:
acquiring a heart rate;
and converting the heart rate into a game running instruction to control game termination.
Further, the method also comprises the following steps:
acquiring a voice uttered by a user;
and controlling the starting or stopping of the game according to the game running instruction converted from the voice content of the user.
In order to realize the game control method, the invention also provides a game control device based on brain waves, which comprises
The signal acquisition module is used for acquiring brain wave signals of a user;
the signal processing module is used for processing the brain wave signals and generating fluctuation numerical values;
the instruction generation module is used for prestoring a control instruction corresponding to the fluctuation numerical value and converting the control instruction into a control instruction according to the fluctuation numerical value so as to control a game; the control instruction comprises an artificial voice control instruction, and the content of the game controlled by the artificial voice control instruction comprises the switching of the virtual scene of the game and the artificial voice for controlling the output content to be the name of the virtual scene.
Further, the device also comprises an instruction execution module used for executing the control instruction;
the instruction execution module comprises
The sound output module is used for outputting artificial voice with the content of the virtual scene name according to the artificial voice control instruction;
and the voice execution module is used for controlling the switching of the virtual scene according to the artificial voice.
Further, also comprises
The heart rate monitor is used for acquiring the heart rate of the user in the game process;
and the game running control module is used for controlling the game running termination according to the heart rate.
Further, also comprises
The voice receiving module is used for acquiring and identifying voice sent by a user;
the game running control module is used for converting the voice content of the user into a game running instruction so as to control the starting of the game or control the termination of the game.
For a better understanding and practice, the invention is described in detail below with reference to the accompanying drawings.
Drawings
FIG. 1 is a schematic diagram of a prior art will tank game device;
FIG. 2 is a flow chart illustrating a method for controlling a brain wave-based game according to an embodiment of the present invention;
FIG. 3 is a schematic flow chart of the operation of the game controlled by heart rate according to one embodiment of the present invention;
FIG. 4 is a flow chart illustrating the operation of the game controlled by the user's voice according to one embodiment of the present invention;
fig. 5 is a schematic structural diagram of a brain wave-based game control apparatus according to an embodiment of the present invention.
Detailed Description
Preferred embodiments of the present invention will be described in detail below with reference to the accompanying drawings.
Referring to fig. 2, the present invention provides a game control method, including the following steps:
s10: acquiring brain wave signals;
the user acquires brain wave signals by wearing a brain wave sensor or the like and generates brain wave signal data.
S20: generating a fluctuation numerical value according to the brain wave signal;
and carrying out filtering, denoising, amplifying and other processing on the acquired brain wave signals, and generating a fluctuation numerical value.
S30: converting the fluctuation numerical value into a control instruction;
correspondingly converting the fluctuation numerical value into a control instruction according to the size of the fluctuation numerical value; alternatively, an electroencephalogram waveform is generated from the fluctuation values, and the waveform is divided into different sections, and the different sections correspond to different control commands.
The control command converted in step S30 includes an artificial voice control command and an action control command.
In one embodiment, the fluctuation value is converted into the artificial voice command and controls the game, the control content includes the switching of the game virtual scene and the output content is the artificial voice of the virtual scene name, and the method includes the following steps:
s31: converting the fluctuation numerical value into an artificial voice control instruction;
s310: controlling the output content to be artificial voice of the virtual scene name according to the artificial voice control instruction;
s311: and controlling the virtual scene switching of the game according to the artificial voice control instruction.
For example, after the user imagines the names of virtual scenes such as "road", "city", "space" and the like and generates corresponding brain waves, the brain waves are acquired and generate fluctuation numerical values, the fluctuation numerical values are converted into the artificial voice command control, and the artificial voice command control outputs the names of the virtual scenes such as "road", "city", "space" and the like as artificial voice contents and switches the game scenes to the corresponding virtual scenes.
In one embodiment, the conversion of the fluctuation value into the motion control command controls the game, and the control content includes the motion of the game object, including the steps of:
s32: converting the fluctuation numerical value into an action control instruction;
s320: and controlling the action of the game object according to the action control command.
In one embodiment, the game object is a car running in a virtual scene, and the actions of the game object include moving the car left, moving the car right, running at a constant speed, accelerating and decelerating. After the user imagines that the automobile moves leftwards and rightwards, runs at a constant speed, accelerates and decelerates and generates corresponding brain waves, the brain waves are obtained and generate fluctuation numerical values, the fluctuation numerical values are converted into action control instructions, and the action control instructions control the automobile in the virtual scene to move correspondingly.
In addition, since the brain waves have immediacy, the user wants to generate corresponding brain waves immediately, according to one embodiment, the user simultaneously associates the name of the virtual scene and the action of the game object, so as to simultaneously acquire the generated brain waves, and converts the brain waves into the artificial voice control command and the action control command to simultaneously control the switching of the virtual scene in the game and the action of the game object.
Further, referring to fig. 3, in an embodiment, the method further includes the following steps:
s40: acquiring a heart rate;
and setting a heart rate monitor to acquire the heart rate of the user in the game process.
S50: and converting the heart rate into a game running instruction to control the game to run.
And comparing the value of the heart rate with a normal value, and if the value of the heart rate exceeds the normal value, converting the value into a game termination running instruction to control the termination of the game.
Further, referring to fig. 4, in an embodiment, the method further includes the following steps:
s60: acquiring a voice uttered by a user;
the voice uttered by the user and the acquired user voice are recognized.
S70: and controlling the starting or stopping of the game according to the game running instruction converted from the voice content of the user.
For example, the user sends out the voice of 'power on' or 'power off', acquires the voice and identifies the content, and the voice content is converted into a corresponding game starting running instruction or a corresponding game ending running instruction according to the voice content of the user so as to control the game starting or the game ending.
Referring to fig. 5, the present invention further provides a game control device based on brain waves to implement the game control method, including:
a signal acquisition module 500 for acquiring brain wave signals of a user;
the signal processing module 510 is configured to perform processing such as filtering, denoising, and amplifying on the acquired brain wave signals, and generate corresponding fluctuation values;
an instruction generating module 520, configured to pre-store a control instruction corresponding to the fluctuation value and convert the fluctuation value into a control instruction according to the fluctuation value to control a game;
the control instruction comprises an artificial voice control instruction and an action control instruction; the game content controlled by the artificial voice control instruction comprises the switching of a game virtual scene and the artificial voice with the output content being the name of the virtual scene; the game content controlled by the action control instruction comprises the action of controlling the game object.
An instruction execution module 600, configured to execute the artificial voice control instruction and the action control instruction;
the instruction execution module 600 further comprises:
the sound output module 610 is configured to output an artificial voice with a virtual scene name according to the artificial voice control instruction;
a voice executing module 620, configured to control switching of a virtual scene according to the artificial voice;
and an action executing module 630, configured to control an action of the game object according to the action control instruction.
In one embodiment, the game control apparatus further comprises:
a heart rate monitor 700 for acquiring a heart rate of a user during a game;
and a game running control module 800 for controlling the game running termination according to the heart rate.
In one embodiment, the game control apparatus further comprises:
a voice receiving module 750, configured to obtain and recognize a voice uttered by a user;
the game operation control module 800 is configured to convert the user voice content into a game operation instruction for controlling a game to start or control a game to stop.
In one embodiment, the game control apparatus further comprises:
and an online communication module (not shown) for online playing the game by the plurality of game control devices.
Compared with the prior art, the game control method has the advantages that the artificial intelligent voice instruction is generated through the brain wave signal to control the sound output module to send the artificial voice and control the game, so that the control mode of the game and the experience mode of the sense of the user are increased, the artificial intelligent voice instruction controls the game virtual scene to be switched and sends the artificial voice, and the vision and the hearing of the user are stimulated, so that the interestingness of the game is improved; furthermore, the action of the game object is controlled by adding the action control instruction, and the game is simple to operate, so that the game can be presented as the user wants to, the switching of the virtual scene and the control of the action of the game object are synchronously carried out, and the entertainment of the game is high; in addition, the starting or stopping control mode of the game is controlled through the voice of the user, and the heart rate monitor is arranged to monitor the health state of the user in the game, so that the safety is improved. Finally, the game control method and the game control device are suitable for controlling other VR games besides the games and the game objects listed in the embodiment, and have wide applicability.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention.

Claims (10)

1. A game control method based on brain waves is characterized by comprising the following steps:
acquiring brain wave signals;
processing the brain wave signals and generating a fluctuation numerical value;
converting the fluctuation numerical value into a control instruction, wherein the control instruction comprises an artificial voice control instruction;
controlling the output content to be artificial voice of the virtual scene name according to the artificial voice control instruction;
and controlling the switching of the game virtual scene according to the artificial voice control instruction.
2. The game control method according to claim 1, wherein the fluctuation value is converted into a control instruction, the control instruction further including an action control instruction; also comprises the following steps:
and controlling the action of the game object according to the action control command.
3. The game control method of claim 2, wherein the game object comprises a car running in a virtual scene; the action of the game object comprises controlling the automobile to move leftwards, rightwards, run at a constant speed, accelerate and decelerate.
4. The game control method according to claim 3, further comprising the steps of:
acquiring a heart rate;
and converting the heart rate into a game running instruction to control game termination.
5. The game control method according to claim 4, further comprising the steps of:
acquiring a voice uttered by a user;
and controlling the starting or stopping of the game according to the game running instruction converted from the voice content of the user.
6. A game control device based on brain waves is characterized by comprising
The signal acquisition module is used for acquiring brain wave signals of a user;
the signal processing module is used for processing the brain wave signals and generating fluctuation numerical values;
the instruction generation module is used for prestoring a control instruction corresponding to the fluctuation numerical value and converting the control instruction into a control instruction according to the fluctuation numerical value so as to control a game; the control instruction comprises an artificial voice control instruction, and the content of the game controlled by the artificial voice control instruction comprises the switching of the virtual scene of the game and the artificial voice for controlling the output content to be the name of the virtual scene.
7. The game control apparatus of claim 6, further comprising
The instruction execution module is used for executing the control instruction;
the instruction execution module comprises
The sound output module is used for outputting artificial voice with the content of the virtual scene name according to the artificial voice control instruction;
and the voice execution module is used for controlling the switching of the virtual scene according to the artificial voice.
8. The game control apparatus of claim 7, wherein the control instructions further comprise action control instructions; the instruction execution module also comprises an action processing module used for controlling the action of the game object according to the action control instruction.
9. The game control apparatus of claim 8, further comprising
The heart rate monitor is used for acquiring the heart rate of the user in the game process;
and the game running control module is used for controlling the game running termination according to the heart rate.
10. The game control apparatus of claim 9, further comprising
The voice receiving module is used for acquiring and identifying voice sent by a user;
the game running control module is used for converting the voice content of the user into a game running instruction so as to control the starting of the game or control the termination of the game.
CN201911377375.9A 2019-12-27 2019-12-27 Game control method and device based on brain waves Pending CN111202973A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911377375.9A CN111202973A (en) 2019-12-27 2019-12-27 Game control method and device based on brain waves

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911377375.9A CN111202973A (en) 2019-12-27 2019-12-27 Game control method and device based on brain waves

Publications (1)

Publication Number Publication Date
CN111202973A true CN111202973A (en) 2020-05-29

Family

ID=70782580

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911377375.9A Pending CN111202973A (en) 2019-12-27 2019-12-27 Game control method and device based on brain waves

Country Status (1)

Country Link
CN (1) CN111202973A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116688479A (en) * 2023-06-07 2023-09-05 廊坊市珍圭谷科技有限公司 Athletics control device based on brain wave signals

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1740950A (en) * 2005-07-21 2006-03-01 高春平 Module type non-hand operated control method and apparatus thereof
CN108404275A (en) * 2018-02-26 2018-08-17 广东欧珀移动通信有限公司 Training method of sleeping and relevant device
CN108970109A (en) * 2018-06-21 2018-12-11 珠海金山网络游戏科技有限公司 A kind of methods, devices and systems based on idiodynamic reality-virtualizing game

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1740950A (en) * 2005-07-21 2006-03-01 高春平 Module type non-hand operated control method and apparatus thereof
CN108404275A (en) * 2018-02-26 2018-08-17 广东欧珀移动通信有限公司 Training method of sleeping and relevant device
CN108970109A (en) * 2018-06-21 2018-12-11 珠海金山网络游戏科技有限公司 A kind of methods, devices and systems based on idiodynamic reality-virtualizing game

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116688479A (en) * 2023-06-07 2023-09-05 廊坊市珍圭谷科技有限公司 Athletics control device based on brain wave signals
CN116688479B (en) * 2023-06-07 2024-02-06 廊坊市珍圭谷科技有限公司 Athletics control device based on brain wave signals

Similar Documents

Publication Publication Date Title
JP6781697B2 (en) Media-driven haptics
US10322336B2 (en) Haptic braille output for a game controller
JP7119896B2 (en) Communication robot and communication robot control program
CN112905015B (en) Meditation training method based on brain-computer interface
US20180243647A1 (en) Information processing apparatus, information processing method, and information processing system
CN104991650B (en) A kind of gesture controller and a kind of virtual reality system
CN100427164C (en) Game software and game device
CN103984411B (en) Tactile force feedback system and tactile force feedback network system realization
CN102178535B (en) Fun cervical vertebra healthcare system and implementing method thereof
CN106028217B (en) Intelligent equipment interaction system and method based on audio recognition technology
CN110837298A (en) Brain wave remote control training system and method based on concentration and vision
JP2018529176A (en) Vibration providing system and vibration providing method for providing real-time vibration by frequency change
CN111202973A (en) Game control method and device based on brain waves
CN111338473A (en) Brain electrical signal-based rehabilitation training method, computer device and computer-readable storage medium
CN107544675A (en) Brain control formula virtual reality method
EP3308840A1 (en) Vibration feedback system and vibration feedback method
JPWO2017115545A1 (en) Controller, input / output device, and communication system
CN114307128A (en) Interaction method based on vehicle-mounted entertainment system, vehicle and medium
CN204619374U (en) Utilize voice-operated remote control Multi-axis aircraft toy
CN108297082A (en) A kind of method and system of Study of Intelligent Robot Control
CN104460962A (en) 4D somatosensory interaction system based on game engine
CN218686251U (en) Game controller and game system including the same
EP2787501A1 (en) Musical instrument and apparatus for the remote control of an event in the vicinity of a musical instrument
WO2017075992A1 (en) Interaction method and device
JP2013042476A (en) Moving body toy

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination