CN108415560A - Electronic device, method of controlling operation thereof and Related product - Google Patents
Electronic device, method of controlling operation thereof and Related product Download PDFInfo
- Publication number
- CN108415560A CN108415560A CN201810140828.5A CN201810140828A CN108415560A CN 108415560 A CN108415560 A CN 108415560A CN 201810140828 A CN201810140828 A CN 201810140828A CN 108415560 A CN108415560 A CN 108415560A
- Authority
- CN
- China
- Prior art keywords
- electronic device
- operational order
- user information
- object run
- preset kind
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 210000004556 brain Anatomy 0.000 claims abstract description 105
- 238000002567 electromyography Methods 0.000 claims abstract description 66
- 238000004590 computer program Methods 0.000 claims description 15
- 238000001228 spectrum Methods 0.000 claims description 15
- 238000013507 mapping Methods 0.000 claims description 12
- 230000003183 myoelectrical effect Effects 0.000 claims description 11
- 238000004891 communication Methods 0.000 claims description 9
- 238000010606 normalization Methods 0.000 claims description 9
- 238000012545 processing Methods 0.000 claims description 9
- 238000013497 data interchange Methods 0.000 claims description 2
- 238000003384 imaging method Methods 0.000 claims description 2
- 230000005055 memory storage Effects 0.000 claims 2
- 230000000694 effects Effects 0.000 abstract description 4
- 230000000875 corresponding effect Effects 0.000 description 33
- 230000005611 electricity Effects 0.000 description 17
- 238000010586 diagram Methods 0.000 description 15
- 230000006870 function Effects 0.000 description 13
- 230000001276 controlling effect Effects 0.000 description 11
- 210000001508 eye Anatomy 0.000 description 11
- 230000001737 promoting effect Effects 0.000 description 9
- 239000000047 product Substances 0.000 description 6
- 210000003205 muscle Anatomy 0.000 description 5
- 230000009471 action Effects 0.000 description 4
- 230000006399 behavior Effects 0.000 description 4
- 210000005252 bulbus oculi Anatomy 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000004070 electrodeposition Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000002650 habitual effect Effects 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 230000015572 biosynthetic process Effects 0.000 description 2
- 230000007177 brain activity Effects 0.000 description 2
- 210000004027 cell Anatomy 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 239000012466 permeate Substances 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000036982 action potential Effects 0.000 description 1
- 210000002318 cardia Anatomy 0.000 description 1
- 210000003710 cerebral cortex Anatomy 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 210000003792 cranial nerve Anatomy 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000007717 exclusion Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 235000013372 meat Nutrition 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003387 muscular Effects 0.000 description 1
- 210000005036 nerve Anatomy 0.000 description 1
- 210000004761 scalp Anatomy 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/015—Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Dermatology (AREA)
- Neurosurgery (AREA)
- Neurology (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- User Interface Of Digital Computer (AREA)
- Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
Abstract
The embodiment of the present application discloses a kind of electronic device, method of controlling operation thereof and Related product, including：The eeg signal of user is acquired by the brain wave sensor；The user information of preset kind is obtained, the user information of the preset kind includes gesture information and electromyography signal；It determines that object run instructs according to the user information of the eeg signal and the preset kind, and the electronic device is controlled by object run instruction.The embodiment of the present application realizes the control to electronic device by the collective effect of brain wave and user information, improves the convenience of electronic device operation and control, accuracy and intelligent.
Description
Technical field
This application involves technical field of mobile terminals, and in particular to a kind of electronic device, method of controlling operation thereof and related production
Product.
Background technology
With a large amount of popularization and applications of mobile terminal (such as smart mobile phone), the application that mobile terminal can be supported is increasingly
More, function is stronger and stronger, and smart mobile phone develops towards diversification, personalized direction, becomes indispensable in user's life
Appliance and electronic.
Currently, user usually carries out a variety of fingers by the forms such as finger touch, voice input, gesture control and mobile terminal
Enable interaction, mobile terminal that can be completed to execute control to the multiple functions event needed for user according to the instruction interaction.
Invention content
The embodiment of the present application provides a kind of electronic device, method of controlling operation thereof and Related product, passes through brain to realize
Control of the collective effect of electric wave and user information to electronic device improves convenience, the accuracy of electronic device operation and control
With it is intelligent.
In a first aspect, the embodiment of the present application provides a kind of electronic device, including processor, the brain electricity of the processor is connected
Wave sensor and multiple sensors in addition to the brain wave sensor, wherein
The brain wave sensor, the eeg signal for acquiring user；
The user information of the multiple sensor, the user information for obtaining preset kind, the preset kind includes
Gesture information and electromyography signal；
The processor, for determining object run according to the user information of the eeg signal and the preset kind
Instruction, and the electronic device is controlled by object run instruction.
Second aspect, the embodiment of the present application provide a kind of method of controlling operation thereof, are applied to electronic device, the electronic device
Including brain wave sensor, the method includes：
The eeg signal of user is acquired by the brain wave sensor；
The user information of preset kind is obtained, the user information of the preset kind includes gesture information and electromyography signal；
Determine that object run instructs according to the user information of the eeg signal and the preset kind, and by described
Object run instruction controls the electronic device.
The third aspect, the embodiment of the present application provide a kind of operating control device, are applied to electronic device, the electronic device
Including brain wave sensor, the operating control device includes collecting unit, acquiring unit and determination unit, wherein
The collecting unit, the eeg signal for acquiring user by the brain wave sensor；
The user information of the acquiring unit, the user information for obtaining preset kind, the preset kind includes hand
Gesture information and electromyography signal；
The determination unit, the eeg signal and the acquiring unit for being acquired according to the collecting unit obtain
The user information of the preset kind taken determines that object run instructs, and controls the electronics by object run instruction
Device.
Fourth aspect, the embodiment of the present application provide a kind of electronic device, including processor, memory, communication interface and
One or more programs, wherein said one or multiple programs are stored in above-mentioned memory, and are configured by above-mentioned
It manages device to execute, above procedure includes the instruction for executing the step in the embodiment of the present application second aspect either method.
5th aspect, the embodiment of the present application provide a kind of computer readable storage medium, wherein above computer is readable
Computer program of the storage medium storage for electronic data interchange, wherein above computer program makes computer execute such as
Step some or all of described in the embodiment of the present application second aspect either method.
6th aspect, the embodiment of the present application provide a kind of computer program product, wherein above computer program product
Non-transient computer readable storage medium including storing computer program, above computer program are operable to make calculating
Machine executes the step some or all of as described in the embodiment of the present application second aspect either method.The computer program product
It can be a software installation packet.
As can be seen that in the embodiment of the present application, electronic device acquires the brain of user by the brain wave sensor first
Secondly electric wave signal obtains the user information of preset kind, the user information of the preset kind includes gesture information and myoelectricity
Signal finally determines that object run instructs, and pass through institute according to the user information of the eeg signal and the preset kind
It states object run instruction and controls the electronic device.It is found that electronic device is by acquiring the brain wave of user and obtaining user
Finger information and electromyography signal, the operation and control automated to electronic device may be implemented, be conducive to promoted control operation electricity
Sub-device it is intelligent, can be by same equipment simultaneously moreover, because brain wave and electromyography signal are same type of data
It obtains, therefore, electronic device is controlled by brain wave and electromyography signal, be conducive to the convenience for promoting control, less hardware is opened
Pin promotes control speed, further, since gesture information can accurately be expressed by user's control rather than heart rate, expression in the eyes
Deng the data that can not exclusively control, therefore, gesture information can accurately express the demand of user, be conducive to promote control electronics
The accuracy of device.
Description of the drawings
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, to embodiment or will show below
There is attached drawing needed in technology description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of application for those of ordinary skill in the art without creative efforts, can be with
Obtain other attached drawings according to these attached drawings.
Figure 1A is a kind of structural schematic diagram of electronic device provided by the embodiments of the present application；
Figure 1B is a kind of structural schematic diagram of brain wave sensor signal receiver provided by the embodiments of the present application；
Fig. 1 C are a kind of structural schematic diagrams of brain wave sensor chip type signal picker provided by the embodiments of the present application；
Fig. 1 D are the structural schematic diagrams of another electronic device provided by the embodiments of the present application；
Fig. 2A is a kind of flow diagram of method of controlling operation thereof provided by the embodiments of the present application；
Fig. 2 B are a kind of waveform example figures of electroencephalogram provided by the embodiments of the present application；
Fig. 2 C are a kind of waveform example figures of electromyogram provided by the embodiments of the present application；
Fig. 2 D are that a kind of flow of electroencephalogram and electromyogram formation target amplitude spectrogram provided by the embodiments of the present application is shown
Illustration；
Fig. 3 is the flow diagram of another method of controlling operation thereof provided by the embodiments of the present application；
Fig. 4 is the flow diagram of another method of controlling operation thereof provided by the embodiments of the present application；
Fig. 5 is a kind of structural schematic diagram of electronic device provided by the embodiments of the present application；
Fig. 6 is a kind of functional unit composition block diagram of operating control device provided by the embodiments of the present application.
Specific implementation mode
In order to make those skilled in the art more fully understand application scheme, below in conjunction in the embodiment of the present application
Attached drawing, technical solutions in the embodiments of the present application are clearly and completely described, it is clear that described embodiment is only
Some embodiments of the present application, instead of all the embodiments.Based on the embodiment in the application, those of ordinary skill in the art
The every other embodiment obtained without creative efforts, shall fall in the protection scope of this application.
Term " first ", " second " in the description and claims of this application and above-mentioned attached drawing etc. are for distinguishing
Different objects, rather than for describing particular order.In addition, term " comprising " and " having " and their any deformations, it is intended that
It is to cover and non-exclusive includes.Such as process, method, system, product or the equipment for containing series of steps or unit do not have
It is defined in the step of having listed or unit, but further includes the steps that optionally not listing or unit, or optionally also wrap
It includes for other intrinsic steps of these processes, method, product or equipment or unit.
Referenced herein " embodiment " is it is meant that a particular feature, structure, or characteristic described can wrap in conjunction with the embodiments
It is contained at least one embodiment of the application.Each position in the description occur the phrase might not each mean it is identical
Embodiment, nor the independent or alternative embodiment with other embodiments mutual exclusion.Those skilled in the art explicitly and
Implicitly understand, embodiment described herein can be combined with other embodiments.
Electronic device involved by the embodiment of the present application may include various handheld devices with wireless communication function,
Mobile unit, wearable device, computing device or other processing equipments and various forms for being connected to radio modem
User equipment (User Equipment, UE), mobile station (Mobile Station, MS), terminal device (terminal
Device) etc..For convenience of description, apparatus mentioned above is referred to as electronic device.
It describes in detail below to the embodiment of the present application.
Please refer to Fig.1 A, Figure 1A is that an embodiment of the present invention provides a kind of structural schematic diagram of electronic device 100, the electronics
Device 100 includes：Shell 110, the display 120 being set on the shell 110, the mainboard being set in the shell 110
130, it is provided with the memory 150 of processor 140, the connection processor 140, brain wave sensor 160 on mainboard 130 and removes
Multiple sensors 170 except the brain wave sensor etc., the processor 140 connect the display 120, the electronics
Device 100 further includes radio frequency system 180, and the radio frequency system 180 includes transmitter 181, receiver 182, signal processor
183, wherein
The brain wave sensor 160, the eeg signal for acquiring user；
The multiple sensor 170, the user information for obtaining preset kind, the user information packet of the preset kind
Include gesture information and electromyography signal；
The processor 140, for determining target according to the user information of the eeg signal and the preset kind
Operational order, and the electronic device 100 is controlled by object run instruction.
Wherein, the display 120 includes circuit of display driving, display screen and touch screen, the display driving electricity
Road is carried out for controlling the display screen according to the display data and display parameters (for example, brightness, color, saturation degree etc.) of picture
Content shows that the touch screen is organic light-emitting diode (OLED) display screen OLED for detecting touch control operation, the display screen.
Wherein, multiple sensors 170 in addition to the brain wave sensor can be camera, can also be that myoelectricity passes
Sensor etc., does not limit herein.
Wherein, brain wave sensor 160 is properly termed as brain wave chip, brain wave receiver etc., brain wave sensing again
Device 160 is integrated in an electronic, has special signal processing circuit, and connect with the processor of electronic device 140, according to adopting
Collection signal type can be divided into current type brain wave sensor 160 and electromagnetic type brain wave sensor 160, and current type brain wave passes
Sensor 160 acquires the bioelectricity that cortex generates, and electromagnetic type brain wave sensor 160 acquires the electromagnetism radiated when human brain activity
Wave.It is understood that the specific form of the brain wave sensor 160 can be diversified, such as can be wearable
Brain wave sensor, or can be the brain wave sensor etc. of chip type, not do unique restriction herein.
For example, as shown in figs. ib and 1 c, which may include signal receiver 161 and chip
Formula signal picker 162, the signal receiver 161 can be contained in electronic device as shown in Figure 1B, in use, such as Fig. 1 C
Shown, chip type signal picker 162 uses radio connection with electronic device, by chip type signal picker 162
Wireless communication module connect with electronic device communications.
Wherein, the shape size of the mainboard 130 can be the arbitrary size and shape that the electronic device 100 can accommodate
Shape does not do unique restriction herein.
Wherein, processor 140 includes application processor and baseband processor, and processor 140 is the control of electronic device 100
Center is stored in memory using the various pieces of various interfaces and the entire electronic device of connection by running or executing
Software program in 150 and/or module, and the data being stored in memory 150 are called, execute each of electronic device 100
Kind function and processing data, to carry out integral monitoring to electronic device 100.Wherein, the main processing operation system of application processor
System, user interface and application program etc., baseband processor mainly handles wireless communication.It is understood that above-mentioned Base-Band Processing
Device can not also be integrated into processor.
Wherein, memory 150 can be used for storing software program and module, and processor 140 is stored in storage by operation
The software program and module of device 150, to execute various function application and the data processing of electronic device 100.Memory
150 can include mainly storing program area and storage data field, wherein storing program area can storage program area, at least one work(
Application program etc. needed for energy；Storage data field can be stored uses created data etc. according to electronic device.In addition, storage
Device 150 may include high-speed random access memory, can also include nonvolatile memory, for example, at least a disk storage
Device, flush memory device or other volatile solid-state parts.
In the specific implementation, electronic device can control the brain wave sensor 160 under static state with low-power mould
Formula works, and is worked with high frequency mode under motion state, power consumption is reduced with this.
As can be seen that in the embodiment of the present application, electronic device acquires the brain of user by the brain wave sensor first
Secondly electric wave signal obtains the user information of preset kind, the user information of the preset kind includes gesture information and myoelectricity
Signal finally determines that object run instructs, and pass through institute according to the user information of the eeg signal and the preset kind
It states object run instruction and controls the electronic device.It is found that electronic device is by acquiring the brain wave of user and obtaining user
Finger information and electromyography signal, the operation and control automated to electronic device may be implemented, be conducive to promoted control operation electricity
Sub-device it is intelligent, can be by same equipment simultaneously moreover, because brain wave and electromyography signal are same type of data
It obtains, therefore, electronic device is controlled by brain wave and electromyography signal, be conducive to the convenience for promoting control, less hardware is opened
Pin promotes control speed, further, since gesture information can accurately be expressed by user's control rather than heart rate, expression in the eyes
Deng the data that can not exclusively control, therefore, gesture information can accurately express the demand of user, be conducive to promote control electronics
The accuracy of device.
In a possible example, the multiple sensor 170 includes myoelectric sensor 171, the preset kind
User information is the electromyography signal, and mesh is determined in the user information according to the eeg signal and the preset kind
In terms of marking operational order, the processor 140 is specifically used for：Electroencephalogram is formed according to the eeg signal；And it is used for root
Electromyogram is formed according to the electromyography signal that the myoelectric sensor obtains；And for being stored according to the memory 150
Mapping relations between preset electroencephalogram template, electromyogram template and operational order determine and the electroencephalogram and the myoelectricity
Scheme corresponding operational order to instruct for the object run.
Wherein, the myoelectric sensor 171 is the action potential that can receive muscular movement unit (by meat fiber cell)
Waveform, and the waveform is converted into the sensor of usable output signal, in addition, as shown in figure iD, 171 He of the myoelectric sensor
The brain wave sensor 160 can use the same signal receiver 161, the use principle of the myoelectric sensor 171 with
Above-mentioned brain wave sensor is similar, is not set forth in detail herein.
In this possible example, in the preset electroencephalogram template stored according to the memory 150, myoelectricity
Mapping relations between artwork plate and operational order determine that operational order corresponding with the electroencephalogram and the electromyogram is institute
In terms of stating object run instruction, the processor 140 is specifically used for：It is handled the first of the electroencephalogram by frequency normalization
Amplitude groups and first frequency group and the second amplitude groups of the electromyogram, second frequency group form target amplitude spectrogram；With
And for determining behaviour corresponding with the matched amplitude frequency spectrum artwork plate of the storage of the memory 150 of the target amplitude spectrogram
It is that the object run instructs to make instruction, and the amplitude frequency spectrum artwork plate is by the electroencephalogram template and the myoelectricity artwork
What plate was formed.
In a possible example, the multiple sensor includes imaging sensor, user's letter of the preset kind
Breath is gesture information, determines that object run instructs in the user information according to the eeg signal and the preset kind
Aspect, the processor 140 are specifically used for：The pending event of user is determined according to the gesture information；And it is used for basis
The eeg signal determines the object run instruction corresponding with the pending event.
It is true in the user information according to the eeg signal and the preset kind in a possible example
It sets the goal in terms of operational order, the processor 140 is specifically used for：Determine that the first operation corresponding with the eeg signal refers to
It enables；Determine the second operational order corresponding with the user information of the preset kind；When detect first operational order with
When second operational order is identical, determine that first operational order or second operational order are that the object run refers to
It enables.
Fig. 2A is please referred to, Fig. 2A is that the embodiment of the present application provides a kind of flow diagram of method of controlling operation thereof, application
In the electronic device as described in Figure 1A -1D, it is applied to electronic device, the electronic device includes brain wave sensor, as schemed institute
Show, this method of controlling operation thereof includes：
S201, electronic device acquire the eeg signal of user by the brain wave sensor；
Wherein, brain wave is a kind of method recording brain activity using electrophysiological index, and record brain is in active device
Electric wave variation, be overall reflection of the bioelectrical activity in cerebral cortex or scalp surface of cranial nerve cell, therefore, brain wave
Signal is the collective's nervous activity signal generated by the common electric discharge of many nerves.
S202, the electronic device obtain the user information of preset kind, and the user information of the preset kind includes hand
Gesture information and electromyography signal；
Wherein, the user information of the preset kind can also include the heart rate data of user, and eye data is (for example, eye
The rotational angle of ball, the focal zone etc. of eyeball), wherein the gesture data can by camera or 3D cameras,
Or the acquisitions such as pressure sensor of touch screen or touch screen, the electromyography signal can be the electromyography signals of eye muscle,
It can also be the electromyography signal of hand muscle, or can also be the electromyography signal etc. around heart, the electromyography signal passes through
Myoelectric sensor obtains, and does not do unique restriction herein.
S203, the electronic device determine that target is grasped according to the user information of the eeg signal and the preset kind
It instructs, and the electronic device is controlled by object run instruction.
Wherein, the specific list that the eeg signal is wished to meditate when electronic device performance objective operational order by user
Word, vocabulary or phrase, and the user information of preset kind is wished to make when electronic device performance objective operational order by user
Gesture motion or some position electromyography signal (such as Rotation of eyeball, gesture commander etc.), such as user wishes electronics
The object run instruction that device executes is " taking pictures " or " 1 " by the vocabulary meditated when photographing operation, and the gesture made is five
Habitual action when finger opens or user takes pictures；In another example user wishes the object run instruction that electronic device executes to play
The specific vocabulary meditated when music is " music " or " music " or " 2 ", and the gesture made beats display screen to be regular
Deng, instructed for different object run, be for different users, between the word of meditation, vocabulary or phrase it is multifarious,
The action of execution or electromyography signal be also it is multifarious, therefore, the eeg signal and preset kind that electronic device receives
User information it is also different.
Wherein, can be two-by-two between this three of the user information of object run instruction, eeg signal and preset kind
It is associated, can also be between this three it is a mapping relations, does not do unique restriction herein, the relationship between this three can be with
It is used for the first time by user by carrying out data training foundation in an electronic with interacting for electronic device when electronic device, example
Such as, when " unlock " two word occurs in mobile phone, user makes brain wave sensor receive the brain electricity of user by two word of meditation " unlock "
Wave signal, and myoelectric sensor receives the electromyography signal around the heart of user, and then it is corresponding to form eeg signal
Electroencephalogram template, the electromyogram template etc. that user information is formed, and the correspondence between this three is established in an electronic,
Brain wave data when user executes corresponding actions can also be obtained during using electronic device and preset by user
The user information of type carries out convenient foundation in the case that user is unwitting not by the interaction with user, for example, when with
During being unlocked using mobile phone, at this moment brain wave sensor and other kinds of sensor obtain the brain electricity of user at family
The user information of wave signal and preset kind, and then electroencephalogram template is formed, user information template, and by pair between this three
It should be related to foundation in an electronic, in addition, the data (eeg signal and the other kinds of user that pass through two or more types
Information) determine an object run instruction, be conducive to promote the determining accuracy of object run instruction.
Wherein, the object run instruction can control the operation of the electronic device execution including at least following any one
Kind：Audio broadcasting, video playing, take pictures, unlock, fast charge, photograph album displaying, game start, screen adjustment (including interface adjustment,
The adjustment of screen locking magazine, wallpaper change), payment, operating mode adjustment, call and answer, using startup, download, search etc.,
Unique restriction is not done herein.
As can be seen that in the embodiment of the present application, electronic device acquires the brain of user by the brain wave sensor first
Secondly electric wave signal obtains the user information of preset kind, the user information of the preset kind includes gesture information and myoelectricity
Signal finally determines that object run instructs, and pass through institute according to the user information of the eeg signal and the preset kind
It states object run instruction and controls the electronic device.It is found that electronic device is by acquiring the brain wave of user and obtaining user
Finger information and electromyography signal, the operation and control automated to electronic device may be implemented, be conducive to promoted control operation electricity
Sub-device it is intelligent, can be by same equipment simultaneously moreover, because brain wave and electromyography signal are same type of data
It obtains, therefore, electronic device is controlled by brain wave and electromyography signal, be conducive to the convenience for promoting control, less hardware is opened
Pin promotes control speed, further, since gesture information can accurately be expressed by user's control rather than heart rate, expression in the eyes
Deng the data that can not exclusively control, therefore, gesture information can accurately express the demand of user, be conducive to promote control electronics
The accuracy of device.
In a possible example, the user information of the preset kind is electromyography signal, described according to brain electricity
The user information of wave signal and the preset kind determines that object run instructs, including：
Electroencephalogram is formed according to the eeg signal；
Electromyogram is formed according to the electromyography signal；
It is determined and brain electricity according to the mapping relations between preset electroencephalogram template, electromyogram template and operational order
Figure operational order corresponding with the electromyogram instructs for the object run.
Wherein, the electroencephalogram includes amplitude and frequency, and the amplitude is about 50 μ of μ V~200 V, and the frequency is about 1-
30HZ。
Wherein, the specific implementation that electroencephalogram is formed according to the eeg signal can be by the electronics
Device knows the brain wave information using Hilbert-Huang transform (Hibert-Huang Transform, HHT) algorithm
Not, then target brain wave is obtained by carrying out denoising to the eeg signal and being filtered and modulus A/D conversion
Then signal forms electroencephalogram according to target eeg signal.
Wherein, the user information of the preset kind is electromyography signal, and the electronic device is obtained by myoelectric sensor
Electromyogram forms electromyogram according to the electromyography signal, and the electromyogram equally includes amplitude and frequency, different user identical portions
The electromyography signal of position is different, therefore, can promote the safety of electronic device by electromyography signal to determine whether for user
Property, the electromyography signal of same subscriber different parts is different, when the electromyography signal can be that user hand holds electronic device, hand
Electromyography signal, when can also be user eyeball rotation, the electromyography signal of eye muscle, or can also be the flesh of lip week muscle
Electric signal, or when can also be heartbeat, the muscle signal etc. on cardia periphery does not do unique restriction herein.
Wherein, the same brain wave template may correspond to multiple electromyogram templates, and different electromyogram templates corresponds to different
Object run instruction, by between the electroencephalogram template, electromyogram template and operational order three formed one uniquely reflect
Penetrate relationship.
As it can be seen that in this example, electronic device is according to reflecting between electroencephalogram template and electromyogram template and operational order
Relationship is penetrated, determines that unique object run instructs by eeg signal and the electromyography signal correspondence of acquisition, algorithm is simple, has
Conducive to the determining convenience of object run instruction is promoted, operation and control speed is promoted.
It is described according between preset electroencephalogram template, electromyogram template and operational order in this possible example
Mapping relations determine that corresponding with the electroencephalogram and electromyogram operational order is object run instruction, including：
It is handled the first amplitude groups of the electroencephalogram and first frequency group and the electromyogram by frequency normalization
The second amplitude groups, second frequency group formed target amplitude spectrogram；
Determine that operational order corresponding with the matched amplitude frequency spectrum artwork plate of the target amplitude spectrogram is the target
Operational order, the amplitude frequency spectrum artwork plate are formed by the electroencephalogram template and the electromyogram template.
Wherein, first amplitude groups and the first frequency group are one-to-one relationship, second amplitude groups and institute
It is one-to-one relationship to state second frequency group, and the electronic device is by by the first frequency group and the in electromyogram and electroencephalogram
Two group of frequencies are normalized, and the electromyogram and electroencephalogram are presented on a width target amplitude spectrogram, and
It is compared with amplitude frequency spectrum artwork plate.
Wherein, EEG signal electrode position corresponding with electromyography signal is obtained with current in the amplitude frequency spectrum artwork plate
EEG signal and electromyography signal obtain electrode position be same electrode position.
For example, when it is removing screen screen locking that user, which needs performance objective operational order, electronic device is adopted default
The electroencephalogram that the eeg signal obtained in sample time interval is formed, and by electroencephalogram frequency normalization treated brain electricity
Figure is electroencephalogram as shown in Figure 2 B, the flesh of the electromyography signal formation for user's palm grip electronic device that electronic device obtains
Electrograph, and by electromyogram frequency normalization treated electromyogram, for electromyogram as shown in fig. 2 c, then, electronic device
By after normalized electroencephalogram and electromyogram be fused to amplitude frequency spectrum figure as shown in Figure 2 D, and shaking when by identical frequency
Width, which is maximized, obtains target amplitude spectrogram.In addition, target amplitude spectrogram can be the left side in being fused to Fig. 2 D
After legend, the minimum value of amplitude is taken in identical frequency point, or the mean value of amplitude of each Frequency point is taken to obtain target amplitude
Spectrogram does not do unique restriction herein.
As it can be seen that in this example, electronic device determines that object run instructs by comparing two kinds of data of electroencephalogram and electromyogram,
The accuracy for being conducive to be promoted operation and control, moreover, by the frequency of normalized electroencephalogram and electromyogram, to electroencephalogram and
Electromyogram permeate width figure and to be matched with template, is conducive to the convenience for promoting matching comparison.
In a possible example, the user information of the preset kind is gesture information, described according to brain electricity
The user information of wave signal and the preset kind determines that object run instructs, including：
The pending event of user is determined according to the gesture information；
The object run instruction corresponding with the pending event is determined according to the eeg signal.
Wherein, the pending event can be the above-mentioned audio broadcasting being previously mentioned, video playing, take pictures, unlocks, soon
Fill, the events such as photograph album displaying, game start, different pending events corresponds to the preset user of electronic device meditate it is different
Electroencephalogram template.
Wherein, the gesture information is trigger condition, and the gesture information can be arbitrary gesture information, such as can be
The habitual gesture of user, or can be user-defined arbitrary gesture information, such as the gesture information of active user is
When the habitual gesture of user, corresponding pending event is to start A applications.
Wherein, described that the object run instruction corresponding with the pending event is determined according to the eeg signal
Specific implementation can be：Obtain the electroencephalogram template with the pending event matches；By the eeg signal shape
At electroencephalogram；When detecting the electroencephalogram with electroencephalogram template matches success, determine and the pending event pair
The object run instruction answered.
As it can be seen that in this example, electronic device is used as trigger condition by the gesture information of user and determines that user's is pending
After event, the matching operation of electroencephalogram is carried out, when being conducive to avoid not having trigger condition, the continuous matching primitives of brain wave image
The electric quantity consumption brought advantageously reduces the power consumption of electronic device.
It is described to be determined according to the user information of the eeg signal and the preset kind in a possible example
Object run instructs, including：
Determine the first operational order corresponding with the eeg signal；
Determine the second operational order corresponding with the user information of the preset kind；
When detecting that first operational order is identical as second operational order, first operational order is determined
Or second operational order instructs for the object run.
Wherein, the electronic device may include the first operational order set and the second operational order set, and described first
Operational order set includes the correspondence between multigroup electroencephalogram and operational order, and the second operational order set includes more
Correspondence between group user information and operational order.
The electronic device can by determine the first operational order set in the matched operational order of the electroencephalogram
For the first operational order, determine that the matched operational order of user information in the second operational order set with the preset kind is
Second operational order.
Wherein, the user information of the preset kind can be the gesture data of user, and the second operational order is multiple use
Correspondence between family gesture and operational order, such as electronic device obtain different gestures by camera, according to gesture
Determine that user needs the operational order executed.
As it can be seen that in this example, electronic device is by corresponding the first operational order formed with electroencephalogram and with user information
Whether determining the second operational order is identical to determine that object run instructs, and to realize double authentication determines operational order,
Further improve the accuracy of operation and control.
It is consistent with embodiment shown in above-mentioned Fig. 2A, referring to Fig. 3, Fig. 3 is a kind of behaviour provided by the embodiments of the present application
Make the flow diagram of control method, be applied to the electronic device as described in Figure 1A -1D, is applied to electronic device, the electronics
Device includes brain wave sensor, as shown, method includes：
S301, electronic device acquire the eeg signal of user by the brain wave sensor.
S302, the electronic device obtain the electromyography signal of user.
S303, the electronic device form electroencephalogram according to the eeg signal.
S304, the electronic device form electromyogram according to the electromyography signal.
S305, the electronic device are handled by frequency normalization by the first amplitude groups and first frequency of the electroencephalogram
Group and the second amplitude groups of the electromyogram, second frequency group form target amplitude spectrogram.
S306, the electronic device determine behaviour corresponding with the matched amplitude frequency spectrum artwork plate of the target amplitude spectrogram
It is that the object run instructs to make instruction.
Wherein, the amplitude frequency spectrum artwork plate is electroencephalogram template and the electromyogram template of the electronic device by acquisition
It is formed.
S307, the electronic device control the electronic device by object run instruction.
As can be seen that in the embodiment of the present application, electronic device acquires the brain of user by the brain wave sensor first
Secondly electric wave signal obtains the user information of preset kind, the user information of the preset kind includes gesture information and myoelectricity
Signal finally determines that object run instructs, and pass through institute according to the user information of the eeg signal and the preset kind
It states object run instruction and controls the electronic device.It is found that electronic device is by acquiring the brain wave of user and obtaining user
Finger information and electromyography signal, the operation and control automated to electronic device may be implemented, be conducive to promoted control operation electricity
Sub-device it is intelligent, can be by same equipment simultaneously moreover, because brain wave and electromyography signal are same type of data
It obtains, therefore, electronic device is controlled by brain wave and electromyography signal, be conducive to the convenience for promoting control, less hardware is opened
Pin promotes control speed, further, since gesture information can accurately be expressed by user's control rather than heart rate, expression in the eyes
Deng the data that can not exclusively control, therefore, gesture information can accurately express the demand of user, be conducive to promote control electronics
The accuracy of device.
In addition, electronic device determines that object run instructs by comparing two kinds of data of electroencephalogram and electromyogram, be conducive to carry
The accuracy of lift operations control, moreover, by the frequency of normalized electroencephalogram and electromyogram, to electroencephalogram and electromyogram into
Row permeates width figure and to be matched with template, is conducive to the convenience for promoting matching comparison.
It is consistent with embodiment shown in above-mentioned Fig. 2A, referring to Fig. 4, Fig. 4 is a kind of behaviour provided by the embodiments of the present application
Make the flow diagram of control method, is applied to the electronic device as described in Figure 1A -1D.As shown, this method of controlling operation thereof
Including：
S401, electronic device acquire the eeg signal of user by the brain wave sensor；
S402, the electronic device obtain the gesture information of user；
S403, the electronic device determine the pending event of user according to the gesture information；
S404, the electronic device determine the target corresponding with the pending event according to the eeg signal
Operational order.
S405, the electronic device control the electronic device by object run instruction.
As can be seen that in the embodiment of the present application, electronic device acquires the brain of user by the brain wave sensor first
Secondly electric wave signal obtains the user information of preset kind, the user information of the preset kind includes gesture information and myoelectricity
Signal finally determines that object run instructs, and pass through institute according to the user information of the eeg signal and the preset kind
It states object run instruction and controls the electronic device.It is found that electronic device is by acquiring the brain wave of user and obtaining user
Finger information and electromyography signal, the operation and control automated to electronic device may be implemented, be conducive to promoted control operation electricity
Sub-device it is intelligent, can be by same equipment simultaneously moreover, because brain wave and electromyography signal are same type of data
It obtains, therefore, electronic device is controlled by brain wave and electromyography signal, be conducive to the convenience for promoting control, less hardware is opened
Pin promotes control speed, further, since gesture information can accurately be expressed by user's control rather than heart rate, expression in the eyes
Deng the data that can not exclusively control, therefore, gesture information can accurately express the demand of user, be conducive to promote control electronics
The accuracy of device.
In addition, electronic device is used as the pending event that trigger condition determines user by the user information of preset kind
Afterwards, the matching operation for carrying out electroencephalogram, when being conducive to avoid not having trigger condition, the continuous matching primitives of brain wave image are brought
Electric quantity consumption, advantageously reduce the power consumption of electronic device.
It is consistent with above-mentioned Fig. 2A, Fig. 3, embodiment shown in Fig. 4, it is provided referring to Fig. 5, Fig. 5 is the embodiment of the present application
A kind of electronic device structural schematic diagram, as shown, the electronic device include processor, memory, communication interface and
One or more programs, wherein said one or multiple programs are stored in above-mentioned memory, and are configured by above-mentioned
It manages device to execute, above procedure includes the instruction for executing following steps；
The eeg signal of user is acquired by the brain wave sensor；
The user information of preset kind is obtained, the user information of the preset kind includes gesture information and electromyography signal；
Determine that object run instructs according to the user information of the eeg signal and the preset kind, and by described
Object run instruction controls the electronic device.
As can be seen that in the embodiment of the present application, electronic device acquires the brain of user by the brain wave sensor first
Secondly electric wave signal obtains the user information of preset kind, the user information of the preset kind includes gesture information and myoelectricity
Signal finally determines that object run instructs, and pass through institute according to the user information of the eeg signal and the preset kind
It states object run instruction and controls the electronic device.It is found that electronic device is by acquiring the brain wave of user and obtaining user
Finger information and electromyography signal, the operation and control automated to electronic device may be implemented, be conducive to promoted control operation electricity
Sub-device it is intelligent, can be by same equipment simultaneously moreover, because brain wave and electromyography signal are same type of data
It obtains, therefore, electronic device is controlled by brain wave and electromyography signal, be conducive to the convenience for promoting control, less hardware is opened
Pin promotes control speed, further, since gesture information can accurately be expressed by user's control rather than heart rate, expression in the eyes
Deng the data that can not exclusively control, therefore, gesture information can accurately express the demand of user, be conducive to promote control electronics
The accuracy of device.
In a possible example, the user information of the preset kind is electromyography signal, described according to the brain
In terms of the user information of electric wave signal and the preset kind determines object run instruction, the instruction in described program is specifically used for
Execute following operation：Electroencephalogram is formed according to the eeg signal；And for forming electromyogram according to the electromyography signal；
And for being determined and brain electricity according to the mapping relations between preset electroencephalogram template, electromyogram template and operational order
Figure operational order corresponding with the electromyogram instructs for the object run.
In this possible example, it is described according to preset electroencephalogram template, electromyogram template and operational order it
Between mapping relations determine that corresponding with the electroencephalogram and electromyogram operational order is object run instruction aspect,
Instruction in described program is specifically used for executing following operation：It is handled the first amplitude of the electroencephalogram by frequency normalization
Group and first frequency group and the second amplitude groups of the electromyogram, second frequency group form target amplitude spectrogram；And it uses
It is that the object run refers in determining operational order corresponding with the matched amplitude frequency spectrum artwork plate of the target amplitude spectrogram
It enables, the amplitude frequency spectrum artwork plate is formed by the electroencephalogram template and the electromyogram template.
In a possible example, the user information of the preset kind is gesture information, described according to the brain
In terms of the user information of electric wave signal and the preset kind determines object run instruction, the instruction in described program is specifically used for
Execute following operation：The pending event of user is determined according to the gesture information；And for according to the eeg signal
Determine the object run instruction corresponding with the pending event.
It is true in the user information according to the eeg signal and the preset kind in a possible example
It sets the goal in terms of operational order, the instruction in described program is specifically used for executing following operation：It determines and the eeg signal
Corresponding first operational order；And for determining the second operational order corresponding with the user information of the preset kind；With
And for when detecting that first operational order is identical as second operational order, determine first operational order or
Second operational order instructs for the object run.
It is above-mentioned that mainly the scheme of the embodiment of the present application is described from the angle of method side implementation procedure.It is appreciated that
, for electronic device in order to realize above-mentioned function, it comprises execute the corresponding hardware configuration of each function and/or software mould
Block.Those skilled in the art should be readily appreciated that, in conjunction with each exemplary unit of embodiment description presented herein
And algorithm steps, the application can be realized with the combining form of hardware or hardware and computer software.Some function actually with
Hardware or computer software drive the mode of hardware to execute, and depend on the specific application and design constraint item of technical solution
Part.Professional technician specifically can realize described function to each using distinct methods, but this reality
Now it is not considered that exceeding scope of the present application.
The embodiment of the present application can carry out electronic device according to the above method example division of functional unit, for example, can
Each functional unit is divided with each function of correspondence, two or more functions can also be integrated in a processing unit
In.The form that hardware had both may be used in above-mentioned integrated unit is realized, can also be realized in the form of SFU software functional unit.It needs
It is noted that be schematical, only a kind of division of logic function to the division of unit in the embodiment of the present application, it is practical real
It is current that there may be another division manner.
Fig. 6 is the functional unit composition block diagram of operating control device 600 involved in the embodiment of the present application.The operation control
Device 600 processed is applied to electronic device, and the electronic device includes brain wave sensor, which includes adopting
Collect unit 601, acquiring unit 602 and determination unit 603, wherein
The collecting unit 601, the eeg signal for acquiring user by the brain wave sensor；
The user information of the acquiring unit 602, the user information for obtaining preset kind, the preset kind includes
Gesture information and electromyography signal；
The determination unit 603, the eeg signal for being acquired according to the collecting unit 601 and the acquisition
The user information for the preset kind that unit 602 obtains determines that object run instructs, and is instructed and controlled by the object run
Make the electronic device.
As can be seen that in the embodiment of the present application, electronic device acquires the brain of user by the brain wave sensor first
Secondly electric wave signal obtains the user information of preset kind, the user information of the preset kind includes gesture information and myoelectricity
Signal finally determines that object run instructs, and pass through institute according to the user information of the eeg signal and the preset kind
It states object run instruction and controls the electronic device.It is found that electronic device is by acquiring the brain wave of user and obtaining user
Finger information and electromyography signal, the operation and control automated to electronic device may be implemented, be conducive to promoted control operation electricity
Sub-device it is intelligent, can be by same equipment simultaneously moreover, because brain wave and electromyography signal are same type of data
It obtains, therefore, electronic device is controlled by brain wave and electromyography signal, be conducive to the convenience for promoting control, less hardware is opened
Pin promotes control speed, further, since gesture information can accurately be expressed by user's control rather than heart rate, expression in the eyes
Deng the data that can not exclusively control, therefore, gesture information can accurately express the demand of user, be conducive to promote control electronics
The accuracy of device.
In a possible example, the user information of the preset kind is electromyography signal, described according to the brain
In terms of the user information of electric wave signal and the preset kind determines object run instruction, the determination unit 603 is specifically used for：
Electroencephalogram is formed according to the eeg signal；And for forming electromyogram according to the electromyography signal；And it is used for basis
Mapping relations between preset electroencephalogram template, electromyogram template and operational order determine and the electroencephalogram and the myoelectricity
Scheme corresponding operational order to instruct for the object run.
In this possible example, it is described according to preset electroencephalogram template, electromyogram template and operational order it
Between mapping relations determine that corresponding with the electroencephalogram and electromyogram operational order is object run instruction aspect,
The determination unit 603 is specifically used for：It is handled the first amplitude groups and first frequency of the electroencephalogram by frequency normalization
Group and the second amplitude groups of the electromyogram, second frequency group form target amplitude spectrogram；And for determine with it is described
The corresponding operational order of the matched amplitude frequency spectrum artwork plate of target amplitude spectrogram instructs for the object run, the amplitude frequency
Spectrogram template is formed by the electroencephalogram template and the electromyogram template.
In a possible example, the user information of the preset kind is gesture information, described according to the brain
In terms of the user information of electric wave signal and the preset kind determines object run instruction, the determination unit 603 is specifically used for：
The pending event of user is determined according to the gesture information；And it waits holding with described for being determined according to the eeg signal
Act the corresponding object run instruction of part.
It is true in the user information according to the eeg signal and the preset kind in a possible example
It sets the goal in terms of operational order, the determination unit 603 is specifically used for：Determine the first operation corresponding with the eeg signal
Instruction；And for determining the second operational order corresponding with the user information of the preset kind；And it is detected for working as
When first operational order is identical as second operational order, determine that first operational order or second operation refer to
Enable is that the object run instructs.
Wherein, collecting unit 601 can be brain wave sensor, and acquiring unit 602 can be myoelectric sensor or take the photograph
As head, determination unit 603 can be processor.
The embodiment of the present application also provides a kind of computer storage media, wherein computer storage media storage is for electricity
The computer program that subdata exchanges, the computer program make computer execute any as described in above method embodiment
Some or all of method step.
The embodiment of the present application also provides a kind of computer program product, and above computer program product includes storing calculating
The non-transient computer readable storage medium of machine program, above computer program are operable to that computer is made to execute such as above-mentioned side
Some or all of either method described in method embodiment step.The computer program product can be a software installation
Packet.
It should be noted that for each method embodiment above-mentioned, for simple description, therefore it is all expressed as a series of
Combination of actions, but those skilled in the art should understand that, the application is not limited by the described action sequence because
According to the application, certain steps can be performed in other orders or simultaneously.Secondly, those skilled in the art should also know
It knows, embodiment described in this description belongs to preferred embodiment, involved action and module not necessarily the application
It is necessary.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, there is no the portion being described in detail in some embodiment
Point, it may refer to the associated description of other embodiment.
In several embodiments provided herein, it should be understood that disclosed device, it can be by another way
It realizes.For example, the apparatus embodiments described above are merely exemplary, for example, said units division, it is only a kind of
Division of logic function, formula that in actual implementation, there may be another division manner, such as multiple units or component can combine or can
To be integrated into another system, or some features can be ignored or not executed.Another point, shown or discussed is mutual
Coupling, direct-coupling or communication connection can be by some interfaces, the INDIRECT COUPLING or communication connection of device or unit,
Can be electrical or other forms.
The above-mentioned unit illustrated as separating component may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, you can be located at a place, or may be distributed over multiple
In network element.Some or all of unit therein can be selected according to the actual needs to realize the mesh of this embodiment scheme
's.
In addition, each functional unit in each embodiment of the application can be integrated in a processing unit, it can also
It is that each unit physically exists alone, it can also be during two or more units be integrated in one unit.Above-mentioned integrated list
The form that hardware had both may be used in member is realized, can also be realized in the form of SFU software functional unit.
If above-mentioned integrated unit is realized in the form of SFU software functional unit and sells or use as independent product
When, it can be stored in a computer-readable access to memory.Based on this understanding, the technical solution of the application substantially or
Person says that all or part of the part that contributes to existing technology or the technical solution can body in the form of software products
Reveal and, which is stored in a memory, including some instructions are used so that a computer equipment
(can be personal computer, server or network equipment etc.) executes all or part of each embodiment above method of the application
Step.And memory above-mentioned includes：USB flash disk, read-only memory (ROM, Read-Only Memory), random access memory
The various media that can store program code such as (RAM, Random Access Memory), mobile hard disk, magnetic disc or CD.
One of ordinary skill in the art will appreciate that all or part of step in the various methods of above-described embodiment is can
It is completed with instructing relevant hardware by program, which can be stored in a computer-readable memory, memory
May include：Flash disk, read-only memory (English：Read-Only Memory, referred to as：ROM), random access device (English：
Random Access Memory, referred to as：RAM), disk or CD etc..
The embodiment of the present application is described in detail above, specific case used herein to the principle of the application and
Embodiment is expounded, the description of the example is only used to help understand the method for the present application and its core ideas；
Meanwhile for those of ordinary skill in the art, according to the thought of the application, can in specific embodiments and applications
There is change place, in conclusion the contents of this specification should not be construed as limiting the present application.
Claims (13)
1. a kind of electronic device, which is characterized in that including processor, connect the brain wave sensor of the processor and except described
Multiple sensors except brain wave sensor, wherein
The brain wave sensor, the eeg signal for acquiring user；
The user information of the multiple sensor, the user information for obtaining preset kind, the preset kind includes gesture
Information and electromyography signal；
The processor, for determining that object run refers to according to the user information of the eeg signal and the preset kind
It enables, and the electronic device is controlled by object run instruction.
2. electronic device according to claim 1, which is characterized in that the electronic device further includes memory, described more
A sensor includes myoelectric sensor, and the user information of the preset kind is the electromyography signal, described according to the brain
In terms of the user information of electric wave signal and the preset kind determines object run instruction, the processor is specifically used for：According to
The eeg signal forms electroencephalogram；And the electromyography signal for being obtained according to the myoelectric sensor forms myoelectricity
Figure；And reflecting between preset electroencephalogram template, electromyogram template and the operational order for being stored according to the memory
It penetrates relationship and determines that operational order corresponding with the electroencephalogram and the electromyogram instructs for the object run.
3. electronic device according to claim 2, which is characterized in that described according to the preset of memory storage
Mapping relations between electroencephalogram template, electromyogram template and operational order determine corresponding with the electroencephalogram and the electromyogram
Operational order be the object run instruction in terms of, the processor is specifically used for：Being handled by frequency normalization will be described
The first amplitude groups and first frequency group of electroencephalogram and the second amplitude groups of the electromyogram, second frequency group form target and shake
Amplitude-frequency spectrogram；And for determining the amplitude frequency spectrum artwork plate with the matched memory storage of the target amplitude spectrogram
Corresponding operational order instructs for the object run.
4. electronic device according to claim 1, which is characterized in that the electronic device further includes memory, described more
A sensor includes imaging sensor, and the user information of the preset kind is gesture information, described according to the brain wave
In terms of the user information of signal and the preset kind determines object run instruction, the processor is specifically used for：According to described
Gesture information determines the pending event of user；And for being determined and the pending event pair according to the eeg signal
The object run instruction answered.
5. electronic device according to claim 1, which is characterized in that the electronic device further includes memory, described
In terms of object run instruction being determined according to the user information of the eeg signal and the preset kind, the processing implement body
For：Determine the first operational order corresponding with the eeg signal；Determination is corresponding with the user information of the preset kind
The second operational order；When detecting that first operational order is identical as second operational order, described first is determined
Operational order or second operational order instruct for the object run.
6. a kind of method of controlling operation thereof, which is characterized in that be applied to electronic device, the electronic device includes brain wave sensing
Device, the method includes：
The eeg signal of user is acquired by the brain wave sensor；
The user information of preset kind is obtained, the user information of the preset kind includes gesture information and electromyography signal；
It determines that object run instructs according to the user information of the eeg signal and the preset kind, and passes through the target
Operational order controls the electronic device.
7. according to the method described in claim 6, it is characterized in that, the user information of the preset kind be electromyography signal, institute
It states and determines that object run instructs according to the user information of the eeg signal and the preset kind, including：
Electroencephalogram is formed according to the eeg signal；
Electromyogram is formed according to the electromyography signal；
According between preset electroencephalogram template, electromyogram template and operational order mapping relations determine with the electroencephalogram and
The corresponding operational order of the electromyogram is object run instruction.
8. the method according to the description of claim 7 is characterized in that described according to preset electroencephalogram template, electromyogram template
Mapping relations between operational order determine that operational order corresponding with the electroencephalogram and the electromyogram is the target
Operational order, including：
It is handled the of the first amplitude groups of the electroencephalogram and first frequency group and the electromyogram by frequency normalization
Two amplitude groups, second frequency group form target amplitude spectrogram；
Determine that operational order corresponding with the matched amplitude frequency spectrum artwork plate of the target amplitude spectrogram is the object run
Instruction, the amplitude frequency spectrum artwork plate is formed by the electroencephalogram template and the electromyogram template.
9. according to the method described in claim 6, it is characterized in that, the user information of the preset kind be gesture information, institute
It states and determines that object run instructs according to the user information of the eeg signal and the preset kind, including：
The pending event of user is determined according to the gesture information；
The object run instruction corresponding with the pending event is determined according to the eeg signal.
10. according to the method described in claim 6, it is characterized in that, described according to the eeg signal and the default class
The user information of type determines that object run instructs, including：
Determine the first operational order corresponding with the eeg signal；
Determine the second operational order corresponding with the user information of the preset kind；
When detecting that first operational order is identical as second operational order, first operational order or institute are determined
The second operational order is stated to instruct for the object run.
11. a kind of operating control device, which is characterized in that be applied to electronic device, the electronic device includes brain wave sensing
Device, the operating control device include collecting unit, acquiring unit and determination unit, wherein
The collecting unit, the eeg signal for acquiring user by the brain wave sensor；
The user information of the acquiring unit, the user information for obtaining preset kind, the preset kind includes gesture letter
Breath and electromyography signal；
The determination unit, what the eeg signal and the acquiring unit for being acquired according to the collecting unit obtained
The user information of the preset kind determines that object run instructs, and controls the electronics by object run instruction and fill
It sets.
12. a kind of electronic device, which is characterized in that including processor, memory, communication interface, and one or more programs,
One or more of programs are stored in the memory, and are configured to be executed by the processor, described program packet
It includes for executing the instruction such as the step in claim 6-10 any one of them methods.
13. a kind of computer readable storage medium, which is characterized in that computer program of the storage for electronic data interchange,
In, the computer program makes computer execute such as claim 6-10 any one of them methods.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810140828.5A CN108415560B (en) | 2018-02-11 | 2018-02-11 | Electronic device, operation control method and related product |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810140828.5A CN108415560B (en) | 2018-02-11 | 2018-02-11 | Electronic device, operation control method and related product |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108415560A true CN108415560A (en) | 2018-08-17 |
| CN108415560B CN108415560B (en) | 2020-12-04 |
Family
ID=63128460
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810140828.5A Expired - Fee Related CN108415560B (en) | 2018-02-11 | 2018-02-11 | Electronic device, operation control method and related product |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108415560B (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109164986A (en) * | 2018-08-27 | 2019-01-08 | 平安科技（深圳）有限公司 | Cloud disk data processing method, device, electronic equipment and storage medium |
| CN109298787A (en) * | 2018-09-14 | 2019-02-01 | 清华大学 | Flexible human-computer interaction device and terminal device |
| CN109645989A (en) * | 2018-12-10 | 2019-04-19 | 燕山大学 | A kind of depth of anesthesia estimation method and system |
| CN111290579A (en) * | 2020-02-10 | 2020-06-16 | Oppo广东移动通信有限公司 | Control method and device of virtual content, electronic equipment and computer readable medium |
| CN111857326A (en) * | 2019-04-25 | 2020-10-30 | 北京小米移动软件有限公司 | Signal control method and device |
| CN112965391A (en) * | 2021-01-29 | 2021-06-15 | 青岛海尔空调器有限总公司 | Household appliance control method, household appliance control system and wearable device |
| CN114917544A (en) * | 2022-05-13 | 2022-08-19 | 上海交通大学医学院附属第九人民医院 | Visual auxiliary training method and equipment for function of orbicularis oris |
| CN115756178A (en) * | 2023-01-10 | 2023-03-07 | 深圳市心流科技有限公司 | Meditation application program control method, device, terminal and storage medium |
| CN116449967A (en) * | 2023-06-20 | 2023-07-18 | 浙江强脑科技有限公司 | Bionic hand teaching aid, control method thereof and main control equipment |
Citations (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101057795A (en) * | 2007-05-18 | 2007-10-24 | 天津大学 | Artificial hand using muscle electrical and electroencephalogram cooperative control and controlling method thereof |
| CN101332136A (en) * | 2008-08-01 | 2008-12-31 | 杭州电子科技大学 | Electric artificial hand combined controlled by brain electricity and muscle electricity and control method |
| CN101776981A (en) * | 2010-01-07 | 2010-07-14 | 天津大学 | Method for controlling mouse by jointing brain electricity and myoelectricity |
| CN102728068A (en) * | 2012-07-03 | 2012-10-17 | 北京理工大学珠海学院 | Control system and control method for electric toy car |
| CN104398325A (en) * | 2014-11-05 | 2015-03-11 | 西安交通大学 | Brain-myoelectricity artificial limb control device and method based on scene steady-state visual evoking |
| CN104516485A (en) * | 2013-09-28 | 2015-04-15 | 南京专创知识产权服务有限公司 | Glasses and mobile phone interaction system based on idea control |
| CN105046887A (en) * | 2015-04-16 | 2015-11-11 | 杨燕 | Stock-trader-state electronic detection system |
| CN105117018A (en) * | 2015-09-08 | 2015-12-02 | 长城信息产业股份有限公司 | System and method for interchanging information by utilizing brain wave and eyeball state |
| CN105138119A (en) * | 2015-08-04 | 2015-12-09 | 湖南七迪视觉科技有限公司 | Stereo vision system with automatic focusing controlled based on human biometrics |
| CN205039859U (en) * | 2015-08-10 | 2016-02-17 | 瑞声声学科技(深圳)有限公司 | Cell -phone shows extend system |
| CN205375373U (en) * | 2016-01-19 | 2016-07-06 | 郑州轻工业学院 | Intelligence house based on brain wave and gesture control |
| CN205485920U (en) * | 2016-01-21 | 2016-08-17 | 京东方科技集团股份有限公司 | Show controlling means and display control system |
| CN106227354A (en) * | 2016-08-31 | 2016-12-14 | 博睿康科技（常州）股份有限公司 | A kind of brain-machine interaction donning system |
| CN106457572A (en) * | 2014-06-20 | 2017-02-22 | 欧姆龙株式会社 | Worker terminal for robot operation |
| CN106527716A (en) * | 2016-11-09 | 2017-03-22 | 努比亚技术有限公司 | Wearable equipment based on electromyographic signals and interactive method between wearable equipment and terminal |
| CN106980359A (en) * | 2016-01-19 | 2017-07-25 | 美的集团股份有限公司 | Control method, system, headset equipment and the server of household electrical appliance |
| CN107357311A (en) * | 2017-07-28 | 2017-11-17 | 南京航空航天大学 | A kind of reconnaissance system with unmanned plane based on mixing control technology |
| CN107390714A (en) * | 2017-06-13 | 2017-11-24 | 深圳市易成自动驾驶技术有限公司 | Control method, device and the computer-readable recording medium of unmanned plane |
| CN107479704A (en) * | 2017-08-08 | 2017-12-15 | 广东小天才科技有限公司 | Control method, device and equipment of wearable equipment and storage medium |
| CN107678541A (en) * | 2017-09-20 | 2018-02-09 | 深圳市科迈爱康科技有限公司 | Intelligent glasses and its information gathering and transmission method, computer-readable recording medium |
-
2018
- 2018-02-11 CN CN201810140828.5A patent/CN108415560B/en not_active Expired - Fee Related
Patent Citations (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101057795A (en) * | 2007-05-18 | 2007-10-24 | 天津大学 | Artificial hand using muscle electrical and electroencephalogram cooperative control and controlling method thereof |
| CN101332136A (en) * | 2008-08-01 | 2008-12-31 | 杭州电子科技大学 | Electric artificial hand combined controlled by brain electricity and muscle electricity and control method |
| CN101776981A (en) * | 2010-01-07 | 2010-07-14 | 天津大学 | Method for controlling mouse by jointing brain electricity and myoelectricity |
| CN102728068A (en) * | 2012-07-03 | 2012-10-17 | 北京理工大学珠海学院 | Control system and control method for electric toy car |
| CN104516485A (en) * | 2013-09-28 | 2015-04-15 | 南京专创知识产权服务有限公司 | Glasses and mobile phone interaction system based on idea control |
| CN106457572A (en) * | 2014-06-20 | 2017-02-22 | 欧姆龙株式会社 | Worker terminal for robot operation |
| CN104398325A (en) * | 2014-11-05 | 2015-03-11 | 西安交通大学 | Brain-myoelectricity artificial limb control device and method based on scene steady-state visual evoking |
| CN105046887A (en) * | 2015-04-16 | 2015-11-11 | 杨燕 | Stock-trader-state electronic detection system |
| CN105138119A (en) * | 2015-08-04 | 2015-12-09 | 湖南七迪视觉科技有限公司 | Stereo vision system with automatic focusing controlled based on human biometrics |
| CN205039859U (en) * | 2015-08-10 | 2016-02-17 | 瑞声声学科技(深圳)有限公司 | Cell -phone shows extend system |
| CN105117018A (en) * | 2015-09-08 | 2015-12-02 | 长城信息产业股份有限公司 | System and method for interchanging information by utilizing brain wave and eyeball state |
| CN205375373U (en) * | 2016-01-19 | 2016-07-06 | 郑州轻工业学院 | Intelligence house based on brain wave and gesture control |
| CN106980359A (en) * | 2016-01-19 | 2017-07-25 | 美的集团股份有限公司 | Control method, system, headset equipment and the server of household electrical appliance |
| CN205485920U (en) * | 2016-01-21 | 2016-08-17 | 京东方科技集团股份有限公司 | Show controlling means and display control system |
| CN106227354A (en) * | 2016-08-31 | 2016-12-14 | 博睿康科技（常州）股份有限公司 | A kind of brain-machine interaction donning system |
| CN106527716A (en) * | 2016-11-09 | 2017-03-22 | 努比亚技术有限公司 | Wearable equipment based on electromyographic signals and interactive method between wearable equipment and terminal |
| CN107390714A (en) * | 2017-06-13 | 2017-11-24 | 深圳市易成自动驾驶技术有限公司 | Control method, device and the computer-readable recording medium of unmanned plane |
| CN107357311A (en) * | 2017-07-28 | 2017-11-17 | 南京航空航天大学 | A kind of reconnaissance system with unmanned plane based on mixing control technology |
| CN107479704A (en) * | 2017-08-08 | 2017-12-15 | 广东小天才科技有限公司 | Control method, device and equipment of wearable equipment and storage medium |
| CN107678541A (en) * | 2017-09-20 | 2018-02-09 | 深圳市科迈爱康科技有限公司 | Intelligent glasses and its information gathering and transmission method, computer-readable recording medium |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109164986A (en) * | 2018-08-27 | 2019-01-08 | 平安科技（深圳）有限公司 | Cloud disk data processing method, device, electronic equipment and storage medium |
| CN109164986B (en) * | 2018-08-27 | 2024-02-09 | 平安科技（深圳）有限公司 | Cloud disk data processing method and device, electronic equipment and storage medium |
| CN109298787A (en) * | 2018-09-14 | 2019-02-01 | 清华大学 | Flexible human-computer interaction device and terminal device |
| CN109298787B (en) * | 2018-09-14 | 2020-01-17 | 清华大学 | Flexible human-computer interaction device and terminal equipment |
| CN109645989A (en) * | 2018-12-10 | 2019-04-19 | 燕山大学 | A kind of depth of anesthesia estimation method and system |
| CN111857326A (en) * | 2019-04-25 | 2020-10-30 | 北京小米移动软件有限公司 | Signal control method and device |
| CN111290579A (en) * | 2020-02-10 | 2020-06-16 | Oppo广东移动通信有限公司 | Control method and device of virtual content, electronic equipment and computer readable medium |
| CN112965391A (en) * | 2021-01-29 | 2021-06-15 | 青岛海尔空调器有限总公司 | Household appliance control method, household appliance control system and wearable device |
| CN114917544A (en) * | 2022-05-13 | 2022-08-19 | 上海交通大学医学院附属第九人民医院 | Visual auxiliary training method and equipment for function of orbicularis oris |
| CN114917544B (en) * | 2022-05-13 | 2023-09-22 | 上海交通大学医学院附属第九人民医院 | Visual method and device for assisting orbicularis stomatitis function training |
| CN115756178A (en) * | 2023-01-10 | 2023-03-07 | 深圳市心流科技有限公司 | Meditation application program control method, device, terminal and storage medium |
| CN116449967A (en) * | 2023-06-20 | 2023-07-18 | 浙江强脑科技有限公司 | Bionic hand teaching aid, control method thereof and main control equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108415560B (en) | 2020-12-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108415560A (en) | Electronic device, method of controlling operation thereof and Related product | |
| CN106963372B (en) | A kind of brain electricity-electromyography signal fusing device and fusion method | |
| CN108334766B (en) | Electronic device, unlocking method and Related product | |
| CN109583356A (en) | Fingerprint identification method and Related product | |
| CN109144245A (en) | Apparatus control method and Related product | |
| KR102057705B1 (en) | A smart hand device for gesture recognition and control method thereof | |
| CN110287925A (en) | Read flipping-over control method and Related product | |
| CN108499111A (en) | Game difficulty method of adjustment and Related product | |
| CN106095086A (en) | A kind of Mental imagery brain-computer interface control method based on noinvasive electricity irritation | |
| CN108897418A (en) | A kind of wearable brain-machine interface arrangement, man-machine interactive system and method | |
| CN110162953A (en) | Biometric discrimination method and Related product | |
| CN108415564A (en) | Electronic device, apparatus control method and Related product | |
| CN108670275A (en) | Signal processing method and related product | |
| CN106506823A (en) | For the intelligent wearable device of control terminal equipment, system, method and apparatus | |
| CN108391049A (en) | Filming control method and relevant device | |
| CN107463819B (en) | Unlocking processing method and related product | |
| CN108418960A (en) | Electronic device, method of controlling operation thereof and Related product | |
| CN108494955A (en) | Network connection control method and related product | |
| CN108491074A (en) | Electronic device, exercising support method and Related product | |
| CN108837271A (en) | The output method and Related product of electronic device, prompt information | |
| CN108415738A (en) | Electronic equipment, apparatus control method and Related product | |
| CN108519810A (en) | electronic device, brain wave unlocking method and related product | |
| JP6904431B2 (en) | Information processing equipment, programs and information processing methods | |
| CN108628445A (en) | Acquiring brain waves method and Related product | |
| CN108553881A (en) | electronic device, game control method and related product |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. Address before: 523860 No. 18 Wusha Haibin Road, Chang'an Town, Dongguan City, Guangdong Province Applicant before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20201204 |