CN105988569A - Method and device for determining control information - Google Patents
Method and device for determining control information Download PDFInfo
- Publication number
- CN105988569A CN105988569A CN201510080315.6A CN201510080315A CN105988569A CN 105988569 A CN105988569 A CN 105988569A CN 201510080315 A CN201510080315 A CN 201510080315A CN 105988569 A CN105988569 A CN 105988569A
- Authority
- CN
- China
- Prior art keywords
- information
- brain
- control information
- electrical feature
- human body
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a method and a device for determining control information. The method for determining the control information comprises the following steps of obtaining brain electrical detection information of a human body, which is at least generated by a facial action of the human body; and determining the control information corresponding to the brain electrical detection information. The embodiments of the invention are convenient for a person to take the facial action as a control source to realize more natural, flexible and convenient human-machine interaction.
Description
Technical field
The application relates to brain electro-technical field, particularly relate to a kind of control information determine method and
Device.
Background technology
Currently, the development of new techniques such as wearable computing, mobile computing, general fit calculation is rapid, right
Human-computer interaction technology proposes new challenge and higher requirement, also provides many new simultaneously
Opportunity.In this stage, the man-machine interaction mode of natural harmony has obtained certain development, its
Be mainly characterized by based on the input mediums such as posture, expression, voice, handwritten form carry out single channel or
Multi-modal interaction, its objective is to enable a person to hand over natural ways such as action, sound, expressions
Interoperability, the place of this preferably " user is freely " that man-machine interaction is emphasized just.
Summary of the invention
The brief overview about the application given below, in order to provide about the application's
Basic comprehension in terms of some.Should be appreciated that this general introduction is not exhaustive about the application
Property general introduction.It is not intended to determine the key of the application or pith, is not to be intended to limit
Determine scope of the present application.Its purpose is only to provide some concept in simplified form, makees with this
For the preamble in greater detail discussed after a while.
The embodiment of the present application provides a kind of control information to determine method and apparatus.
On the one hand, the embodiment of the present application provides a kind of control information and determines method, including:
Obtain the brain electro-detection information of the described human body at least produced by the face action of a human body；
Determine the control information that described brain electro-detection information is corresponding.
Any one the control information provided in conjunction with the embodiment of the present application determines method, optionally, really
The control information that fixed described brain electro-detection information is corresponding, including: by described brain electro-detection information with
The brain electric information of storage mates；Brain electric information according to matching result and storage and control letter
The first mapping relations between breath, determine the control information that described brain electro-detection information is corresponding.
Any one the control information provided in conjunction with the embodiment of the present application determines method, optionally, really
The control information that fixed described brain electro-detection information is corresponding, including: extract described brain electro-detection information
In band segment be first brain electrical feature detection information；Determine and described first brain electrical feature inspection
The control information that measurement information is corresponding.
Any one the control information provided in conjunction with the embodiment of the present application determines method, optionally, really
The control information that fixed and described first brain electrical feature detection information is corresponding, including: by described first
Brain electrical feature detection information is mated with the first brain electrical feature information of storage；According to coupling knot
The second mapping relations between first brain electrical feature information and the control information of fruit and storage, determine
The control information that described first brain electrical feature detection information is corresponding.
Any one the control information provided in conjunction with the embodiment of the present application determines method, optionally, really
The control information that fixed described brain electro-detection information is corresponding, including: extract described brain electro-detection information
In band segment be brain electricity sample information；Determine the described brain the most described human body of electricity sample information
A brain electricity reference information corresponding band second brain electrical feature detection information；Determine and described
The control information that two brain electrical feature detection information are corresponding.
Any one the control information provided in conjunction with the embodiment of the present application determines method, optionally, and institute
State the brain electric information obtained when the face that brain electricity reference information is described human body remains static.
Any one the control information provided in conjunction with the embodiment of the present application determines method, optionally, really
The control information that fixed and described second brain electrical feature detection information is corresponding, including: by described second
Brain electrical feature detection information is mated with the second brain electrical feature information of storage；According to coupling knot
The 3rd mapping relations between second brain electrical feature information and the control information of fruit and storage, determine
The control information that described second brain electrical feature detection information is corresponding.
Any one the control information provided in conjunction with the embodiment of the present application determines method, optionally, and institute
Stating frequency range is 5-69Hz.
Any one the control information provided in conjunction with the embodiment of the present application determines method, optionally, and institute
State face action to include: the action of the mouth of described human body, buccal, tongue and/or jaw.
Any one the control information provided in conjunction with the embodiment of the present application determines method, optionally, really
Before the control information that fixed described brain electro-detection information is corresponding, described control information determines that method is also
Comprise determining that the maximum amplitude of described brain electro-detection information is more than a predetermined threshold.
Any one the control information provided in conjunction with the embodiment of the present application determines method, optionally, and institute
State predetermined threshold more than or equal to 10uV.
Any one the control information provided in conjunction with the embodiment of the present application determines method, optionally, really
After the control information that fixed described brain electro-detection information is corresponding, also include: the control performing Yu determining
Information processed operates accordingly.
On the other hand, the embodiment of the present application additionally provides a kind of control information and determines device, including:
One brain electro-detection data obtaining module, is at least produced by the face action of a human body for obtaining
The brain electro-detection information of raw described human body；
One controls information determination module, for determining the control letter that described brain electro-detection information is corresponding
Breath.
Any one the control information provided in conjunction with the embodiment of the present application determines device, optionally, and institute
State control information determination module to include: one first sub module stored, be used for storing brain electric information with
And the first mapping relations between brain electric information and control information；One first matched sub-block, uses
In described brain electro-detection information is mated with the brain electric information of storage；One first controls information
Determine submodule, for determining described brain electric-examination according to matching result and described first mapping relations
The control information that measurement information is corresponding.
Any one the control information provided in conjunction with the embodiment of the present application determines device, optionally, and institute
State control information determination module to include: a brain electrical feature extracts submodule, is used for extracting described brain
Band segment in electro-detection information is the first brain electrical feature detection information；One second controls information
Determine submodule, for determining the control letter corresponding with described first brain electrical feature detection information
Breath.
Any one the control information provided in conjunction with the embodiment of the present application determines device, optionally, and institute
Second control information of stating determines that submodule includes: one first memory element, for storage the first brain
The second mapping relations between electrical feature information and the first brain electrical feature information and control information；
One first matching unit, for the first brain by described first brain electrical feature detection information with storage
Electrical feature information is mated；One first controls information determination unit, for according to matching result
The control letter that described first brain electrical feature detection information is corresponding is determined with described second mapping relations
Breath.
Any one the control information provided in conjunction with the embodiment of the present application determines device, optionally, and institute
State control information determination module to include: a brain electricity sample information extracts submodule, is used for extracting institute
Stating the band segment in brain electro-detection information is brain electricity sample information；One brain electrical feature determines submodule
Block, for determining that a brain electricity reference information of the described brain the most described human body of electricity sample information is corresponding
Second brain electrical feature detection information of frequency range；One the 3rd control information determines submodule, for really
The control information that fixed and described second brain electrical feature detection information is corresponding.
Any one the control information provided in conjunction with the embodiment of the present application determines device, optionally, and institute
State the brain electric information obtained when the face that brain electricity reference information is described human body remains static.
Any one the control information provided in conjunction with the embodiment of the present application determines device, optionally, and institute
The 3rd control information of stating determines that submodule includes: one second memory element, for storage the second brain
The 3rd mapping relations between electrical feature information and the second brain electrical feature information and control information；
One second matching unit, for the second brain by described second brain electrical feature detection information with storage
Electrical feature information is mated；One second controls information determination unit, for according to matching result
The control letter that described second brain electrical feature detection information is corresponding is determined with described 3rd mapping relations
Breath.
Any one the control information provided in conjunction with the embodiment of the present application determines device, optionally, and institute
Stating frequency range is 5-69Hz.
Any one the control information provided in conjunction with the embodiment of the present application determines device, optionally, and institute
State face action to include: the action of the mouth of described human body, buccal, tongue and/or jaw.
Any one the control information provided in conjunction with the embodiment of the present application determines device, optionally, and institute
State control information and determine that device also includes: an amplitude determines module, be used for determining described brain electric-examination
The maximum amplitude of measurement information is more than a predetermined threshold and according to determining that result enables described control and believes
Breath determines that module determines corresponding control information.
Any one the control information provided in conjunction with the embodiment of the present application determines device, optionally, and institute
State predetermined threshold more than or equal to 10uV.
Any one the control information provided in conjunction with the embodiment of the present application determines device, optionally, and institute
State control information and determine that device also includes: one performs module, for the control letter performed and determine
The corresponding operation of breath.
The technical scheme that the embodiment of the present application provides can obtain at least is produced by the face action of human body
The brain electro-detection information of this raw human body, utilizes this brain electro-detection information to determine a control information.
It is to say, it is dynamic to use the program to be equivalent to indirectly set up face by the detection of brain electric information
Make and associating between control information, be thus easy to people and realize as control source using face action
The most natural, man-machine interaction flexibly and easily, meets the diversified practical application request of user,
Improve Consumer's Experience.
By below in conjunction with the accompanying drawing detailed description to the alternative embodiment of the application, the application's
The advantage of these and other will be apparent from.
Accompanying drawing explanation
The application can be by with reference to obtaining below in association with the description given by accompanying drawing more preferably
Understanding, employ same or analogous reference the most in all of the figs to represent identical
Or similar parts.Described accompanying drawing is included in this specification together with detailed description below
In and form the part of this specification, and be used for being further illustrated by the application can
Select embodiment and explain the principle and advantage of the application.In the accompanying drawings:
A kind of information that controls that Fig. 1 provides for the embodiment of the present application determines the flow chart of method；
Fig. 2 a is to represent detection when human body face remains static in the optional example of the application one
The EEG waveform of this human body arrived；
Fig. 2 b is to represent in the optional example of the application one that human body face carries out " connection " oral table
The EEG waveform of this human body detected when reaching action；
Fig. 2 c is to represent in the optional example of the application one that human body face carries out the oral table of "off"
The EEG waveform of this human body detected when reaching；
Fig. 2 d is to represent in the optional example of the application one that human body face is once dehisced and remains silent
The EEG waveform of this human body detected during action；
Fig. 2 e be in the optional example of the application one represent human body face carry out double dehisce and
Remain silent action time the EEG waveform of this human body that detects；
A kind of information that controls that Fig. 3 provides for the embodiment of the present application determines the logic diagram of device；
Fig. 4 determines the box of device for the another kind of control information that the embodiment of the present application provides
Figure；
Fig. 5 determines the box of device for another control information that the embodiment of the present application provides
Figure.
It will be appreciated by those skilled in the art that the element in accompanying drawing is only used to simple and clear
For the sake of and illustrate, and be not necessarily drawn to scale.Such as, some element in accompanying drawing
Size may be exaggerated relative to other elements, in order to be favorably improved the embodiment of the present application
Understanding.
Detailed description of the invention
Hereinafter in connection with accompanying drawing, the one exemplary embodiment of the application is described in detail.For
Clear and simple and clear for the sake of, all features of actual embodiment are not the most described.
It should be understood, however, that must make a lot during developing any this practical embodiments
Decision specific to embodiment, in order to realize the objectives of developer, such as, meet
Those restrictive conditions relevant to system and business, and these restrictive conditions may be with really
Execute the difference of mode and change.Additionally, it also should be appreciated that, although development is likely
It is extremely complex and time-consuming, but the those skilled in the art having benefited from present disclosure are come
Saying, this development is only routine task.
Here, also need to explanation a bit, in order to avoid obscuring because of unnecessary details
The application, merely depict closely-related with the scheme according to the application in the drawings and in the description
Apparatus structure and/or process step, and eliminate little with the application relation, this area
Parts known to those of ordinary skill and the expression of process and description.
Below in conjunction with the accompanying drawings (label identical in some accompanying drawings represent identical element) and implement
Example, is described in further detail the detailed description of the invention of the application.Following example are used for
Bright the application, but it is not limited to scope of the present application.
Only it will be understood by those skilled in the art that terms such as " first ", " second " in the application
For distinguishing different step, equipment or module etc., neither represent any particular technology implication, also
Do not indicate that the inevitable logical order between them.
A kind of information that controls that Fig. 1 provides for the embodiment of the present application determines the flow chart of method.This
The control information that application provides determines that the executive agent of method is that a certain control information determines device,
Control information determines that the equipment display form of device is very flexible, and such as, described control information is true
Determining device can be a certain independent parts, or, described control information determines that device also can conduct
A certain functional module is integrated in a certain electronic equipment, and described electronic equipment may include but be not limited to
Wearable device etc..Specifically, as it is shown in figure 1, the embodiment of the present application provide one
Control information determines that method includes:
S101: obtain the brain electro-detection of the described human body at least produced by the face action of a human body
Information.
Described face action may include but be not limited to: the mouth of described human body, buccal, tongue and/
Or the action at the position such as jaw, above-mentioned face action independently can be carried out by certain way by human body, institute
State the group that certain way may include but be not limited to one or more actions at one or more position
Close number of times of duration, repetition etc..
Present inventor's research shows, the face of human body does the action such as open one's mouth, speak such as to be caused
Electromyographic signal can be to the electroencephalogram of human body (ElectroEncephaloGram is called for short EEG)
Signal detection produces certain impact so that human body carries out the brain detected during above-mentioned face action
Electrical information shows the brain electric information with human body natural's state (as human body face remains static
Under, i.e. human body face is not carried out above-mentioned action etc.) the different specific spy of the brain electric information that detects
Levy.
S102: determine the control information that described brain electro-detection information is corresponding.
Owing to the EEG signals of human body face action initiation has, amplitude is higher and wave character is bright
The feature such as aobvious, therefore will depend on as the determination of the information of control the brain electro-detection information of face action
According to, have and be easy to detect, facilitate the features such as analysis.Described brain electro-detection information indirect reflects
What the face action that human body is done is, right according to certain between brain electric information and control information
Should be related to, it may be determined that go out the control information corresponding with brain electro-detection information, such as, human body face
Mouth, buccal, the position such as volume corresponding when coordinating the action carried out when oral expression " connects "
Control information is " connection " instruction, and the position such as the mouth of human body face, buccal, volume coordinates and carries out
Control information corresponding during action during oral expression "off" is "off" instruction, etc.
Deng.
Visible, the technical scheme that the embodiment of the present application provides can obtain at least to be moved by the face of human body
Make the brain electro-detection information of this human body produced, utilize this brain electro-detection information to determine a control letter
Breath.It is to say, use the program to be equivalent to indirectly set up face by the detection of brain electric information
Associating between portion's action with control information, is thus easy to people using face action as control source
Realize the most natural, man-machine interaction flexibly and easily, meet the diversified actual application of user
Demand, improves Consumer's Experience.
" oral expression " described in the embodiment of the present application be intended to illustrate human body face carried out on
State the action of sounding, i.e. include that human body outputs corresponding voice when carrying out above-mentioned face action
Situation；Also include that human body has been made the face action such as the corresponding degree of lip-rounding but do not exported corresponding language
The situations such as sound, so that the technical scheme that the embodiment of the present application provides applies also for inconvenience and enters
Control the determination of information when row voice output, thus can meet the diversified reality of user
Application demand.
Additionally, in the technical scheme of the embodiment of the present application offer, described brain electro-detection information is corresponding
The determination mode of control information can determine according to actual needs, it is achieved mode is the most flexible.
(1), in a kind of optional implementation, human body can be prestored and carry out certain or some
Mapping relations between the brain electric information of face action and these brain electric informations and control information
(the first mapping relations might as well be referred to as), at least produced by the face action of this human body getting
Brain electro-detection information after, the brain electric information of described brain electro-detection information Yu storage is carried out
Join；Determine that described brain electro-detection information is corresponding according to matching result with described first mapping relations
Control information, according to as described in the first mapping relations determine with as described in brain electro-detection information matches
The control information corresponding to brain electric information, this control information is described brain electro-detection information pair
The control information answered.The program can be overall according to brain electro-detection information corresponding with human body face action
Determine corresponding control information.
The brain electric information of described brain electro-detection information or storage is that human body is when carrying out certain face action
The brain electric information got, including the people that human body face is the most unrelated with carrying out above-mentioned face action
Body normal brain activity electrical information and human body are because carrying out above-mentioned face action to human normal brain electric information
One entirety of " interference or the noise " signal introduced.Human normal brain electric information typically refers to
The brain electric information of consciousness of personality's aspect, relatively low (the most several uV of amplitude of its EEG signals
Magnitude), as shown in Figure 2 a, the frequency range that amplitude resolution is higher is usually 0-32Hz；By
Relatively low in the amplitude of human normal brain electric information, therefore brain electric information based on consciousness of personality's aspect
Feature less obvious, there is bigger determination error.And present inventor is at research process
Middle discovery, when human body face carries out some action, the facial electromyographic signal that these actions produce
The EEG signals of this human body can be produced certain impact, i.e. on the basis of human normal brain electric information
The EEG signals that upper introducing amplitude is higher, this part EEG signals is equivalent to because of human body face action
Introduce on the basis of human normal EEG signals (brain electric information based on consciousness aspect) is " dry
Disturb or noise " signal, its amplitude is usually the several times even tens times of human normal EEG signals,
Brain wave patterns feature is obvious.As shown in Fig. 2 b-Fig. 2 e, wherein: Fig. 2 b is to human body face
Carry out the EEG waveform of this human body detected during " connection " oral expression action；Fig. 2 c is
The EEG waveform of this human body detected when human body face is carried out "off" oral expression；
This human body that Fig. 2 d detects when being and human body face is once dehisced and remained silent action
EEG waveform；Fig. 2 e is to represent in the optional example of the application one that human body face carries out double
Dehisce and remain silent action time the EEG waveform of this human body that detects.Therefore, can be utilized this
Characteristic, the brain wave patterns that will have at least face action generation is flexible to realize as certain control source
Control, the application such as mutual.
Wherein, the acquisition mode of described brain electric information and described first mapping relations is the most flexible.
Such as, described brain electric information and described first mapping relations can be by controlling information acquisition device to one
External equipment (such as server, high in the clouds, intelligent terminal etc.) obtains, to realize information sharing.
The most such as, control information determines that device self can obtain the brain electric information associated with described human body also
Set up described first mapping relations that associate with described human body, as control information determine device according to
It is corresponding that the training data of the face action of a certain human body obtains face action different from this human body
Brain electric information, using these brain electric informations as sample, sets up the brain electric information as sample and control
The association of system instruction.In actual applications, can be by brain electro-detection letter corresponding for human body face action
Breath compares with the brain electric information as sample, determines in Sample Storehouse and believes with described brain electro-detection
The breath the highest control instruction corresponding to brain electric information of matching degree, for described brain electro-detection information
Corresponding control instruction.The brain electric information of different human body there may be difference, in actual application,
Learning training can be carried out for different human body respectively, obtain the face of different human body according to learning outcome
The Sample Storehouse of the brain electric information of portion's action, and by the use of the Sample Storehouse of brain electric information Yu corresponding human body
Family information is associated, and thinks that different human body is suitable for different matched data sources, thus improves control
The accuracy that information processed determines.
(2), in another kind of optional implementation, can extract in described brain electro-detection information
Band segment is the first brain electrical feature detection information；Determine and described first brain electrical feature detection letter
The control information that breath is corresponding.Present inventor studies discovery, and human body is to carry out different face dynamic
The EEG signals making to cause is more obvious in the amplitude Characteristics of band segment, therefore, to this end, can
Frequency extraction amplitude changed greatly is out as the first brain electrical feature information, based on extracting
Brain electrical feature information determine corresponding control information.The program can be extracted at least by human body
The band segment that in the brain electro-detection information that face action produces, amplitude changes greatly is as first
Brain electrical feature detection information, described frequency range such as 5-69Hz, and determine the first brain electricity extracted
The control information that feature detection information is corresponding, thus makes full use of the brain telecommunications that face action produces
The frequency range feature of breath reduces detection and the complexity analyzed.
Optionally, can prestore in the brain electric information that human body carries out certain or some face action
Partly the brain electrical feature information of frequency range (such as 5-69Hz) (might as well be referred to as the first brain electrical feature letter
Breath) and the first brain electrical feature information brain electric information and control information between mapping relations (no
Harm is referred to as the second mapping relations), from the brain electro-detection at least produced by the face action of this human body
After information is extracted the first brain electrical feature detection information of corresponding band, can be by described first
Brain electrical feature detection information is mated with the first brain electrical feature information of storage；According to coupling knot
Fruit determines the control that described first brain electrical feature detection information is corresponding with described second mapping relations
Information, according to as described in the second mapping relations determine with as described in first brain electrical feature detection information
The control information corresponding to first brain electrical feature information of coupling, this control information is described the
The control information that one brain electrical feature detection information is corresponding.The program makes full use of face action and produces
The frequency range feature of brain electric information reduce detection and the complexity analyzed, be conducive to improving control
The accuracy that information determines.
Wherein, the acquisition mode of described first brain electrical feature information and described second mapping relations is non-
The most flexibly.Such as, described first brain electrical feature information and described second mapping relations can be by controlling
Information acquisition device obtains to an external equipment (such as server, high in the clouds, intelligent terminal etc.),
To realize information sharing.The most such as, control information determines that device self can obtain and described human body
Described second mapping that first brain electrical feature information of association foundation associate with described human body is closed
System, as control information determine device according to the training data of the face action of a certain human body obtain with
The brain electric information that this human body difference face action is corresponding, extracts amplitude bigger from this brain electric information
Band segment as the first brain electrical feature information corresponding with corresponding face action, by these
One brain electrical feature information, as sample, sets up the first brain electrical feature information and control as sample
The association of instruction.In actual applications, can be by brain electro-detection information corresponding for human body face action
The brain electrical feature detection information of partial frequency range and the first brain electrical feature information phase as sample
The EEG signals answering frequency range compares, and determines in Sample Storehouse and detects with described first brain electrical feature
The control instruction corresponding to the first brain electrical feature information that information matches degree is the highest, for described
The control instruction that one brain electrical feature detection information is corresponding.The brain electrical feature information of different human body may
There are differences, in actual application, learning training can be carried out respectively for different human body, according to
Practise the Sample Storehouse of the first brain electrical feature information of the face action of result acquisition different human body, and will
The Sample Storehouse of the first brain electrical feature information is associated with the user profile of corresponding human body, thinks not
It is suitable for different matched data sources with human body, thus improves the accuracy that control information determines.
(3), in another optional implementation, can extract in described brain electro-detection information
Band segment is brain electricity sample information；Determine the one of the described brain the most described human body of electricity sample information
Second brain electrical feature detection information of brain electricity reference information corresponding band；Determine and described second brain
The control information that electrical feature detection information is corresponding.Present inventor studies discovery, and human body is entering
The brain electric information that the different face action of row causes is more obvious in the amplitude Characteristics of band segment, and
And this brain electric information is just including the human body face human body the most unrelated with carrying out above-mentioned face action
Often human normal brain electric information is introduced by brain electric information and human body because carrying out above-mentioned face action
The entirety of " interference or noise " signal.Data volume to be processed, fall is needed in order to reduce
Low data processing complexity, the frequency extraction that can amplitude be changed greatly out is sampled as brain electricity
Information is corresponding according to the amplitude of this brain electricity sample information and a brain electricity reference information of this human body
The amplitude of frequency range, determines that the brain electrical feature detection information of this brain electricity sample information (might as well be referred to as the
Two brain electrical feature detection information), described brain electricity reference information is the brain telecommunications of human body naturalness
Breath, such as the brain electric information obtained when the face of described human body remains static.Such as, can be by
The amplitude of brain electricity sample information deducts the average amplitude of a brain electricity reference information corresponding band, so
Process and be equivalent in brain electro-detection information, extract the brain electricity higher with face action degree of association
Information, the i.e. second brain electrical feature detection information, determine the most again and described second brain electrical feature inspection
The control information that measurement information is corresponding, so that there is this face in the control information determined and human body
Wish during action that the control information obtained is the most identical, improve the accuracy that control information determines.
Optionally, can prestore in the brain electric information that human body carries out certain or some face action
The partly brain electrical feature letter of the relative brain electricity reference information corresponding band of frequency range (such as 5-69Hz)
Breath (the second brain electrical feature information might as well be referred to as) and the second brain electrical feature information brain electric information
And the mapping relations (might as well be referred to as the 3rd mapping relations) between control information, from least by this
Its relative brain electricity reference information phase of brain electro-detection acquisition of information that the face action of human body produces
After answering the second brain electrical feature detection information of frequency range, can be by described second brain electrical feature detection letter
The the second brain electrical feature information with storage that ceases is mated；Reflect according to matching result and the described 3rd
The relation of penetrating determines described second brain electrical feature detection control information corresponding to information, according to as described in
3rd mapping relations are determined and the second brain electricity of described second brain electrical feature detection information matches
Control information corresponding to characteristic information, this control information is described second brain electrical feature detection
The control information that information is corresponding.The program can extract and face action in brain electro-detection information
The brain electric information that degree of association is higher determines control information, is thus conducive to reducing required process
Quantity amount, reduces data processing complexity, improves the accuracy that control information determines.
Wherein, the acquisition mode of described second brain electrical feature information and described 3rd mapping relations is non-
The most flexibly.Such as, described second brain electrical feature information and described 3rd mapping relations can be by controlling
Information acquisition device obtains to an external equipment (such as server, high in the clouds, intelligent terminal etc.),
To realize information sharing.The most such as, control information determines that device self can obtain and described human body
Described 3rd mapping that second brain electrical feature information of association foundation associate with described human body is closed
System, as control information determine device according to the training data of the face action of a certain human body obtain with
The brain electric information that this human body difference face action is corresponding, extracts amplitude bigger from this brain electric information
Band segment as brain electricity sample information, the amplitude of brain electricity sample information is deducted one brain electricity ginseng
Examine signal result after the average amplitude of corresponding band as the second brain electrical feature information, general
These the second brain electrical feature information, as sample, set up the second brain electrical feature information as sample
With associating of control instruction.In actual applications, can be by brain electric-examination corresponding for human body face action
The brain electricity sample information of measurement information partial frequency range is relative to the second brain electricity of a brain electricity reference information
Feature detection information, with the EEG signals of the second brain electrical feature information corresponding band as sample
Compare, determine in Sample Storehouse the highest with described second brain electrical feature detection information matches degree
Control instruction corresponding to second brain electrical feature information, for believing with described second brain electrical feature detection
The control instruction that breath is corresponding.The brain electrical feature information of different human body there may be difference, and reality should
In with, learning training can be carried out respectively for different human body, obtain different people according to learning outcome
The Sample Storehouse of the second brain electrical feature information of the face action of body, and by the second brain electrical feature information
The user profile of Sample Storehouse and corresponding human body be associated, think that different human body is suitable for different
Matched data source, thus improves the accuracy that control information determines.
Optionally, the control information that the embodiment of the present application provides determines that method is determining described brain electricity
Before the control information that detection information is corresponding, including determine described brain electro-detection information the most significantly
Value is more than the step of a predetermined threshold.Owing to human body gets when carrying out some face action
In brain electric information, the brain electric information amplitude of the part relevant with face action is in certainly relative to human body
So react the width of the brain electric information of consciousness of personality under state (as human body is in face resting state)
Value height, therefore, the program, before triggering determines control information, can make full use of face action
The amplitude of the brain electric information that the brain electric information caused sets out from traditional consciousness is different tentatively to be sentenced
Disconnected, if the maximum amplitude of described brain electro-detection information is more than a predetermined threshold, then can determine that institute
State the control information that brain electro-detection information is corresponding；Otherwise, can not process.Wherein, described
Threshold value can produce according to the amplitude feature of the brain electric information that face action causes and/or consciousness of personality
The amplitude feature of brain electric information determine, the most described predetermined threshold more than or equal to 10uV etc.,
By rationally determining of described threshold value can tentatively be judged whether may wrap in brain electro-detection information
Include the brain electric information caused by the face action of human body, determine whether to trigger control according to judged result
The determination of information processed, thus improves efficiency.
Additionally, any one control information that the embodiment of the present application provides determines that method may also include that
Perform the operation corresponding with the described control information determined.Such as, corresponding human body is determined for export
Face when head expresses (whether sending sound, this is not limited by the application) " connection " moves
The control information of the brain electro-detection information made is " connection " instruction, then can control a certain electronics and set
The standby operation performing to connect network or other equipment etc.；The most such as, corresponding human body is determined for export
Head expresses face during (whether sending sound, this is not wished that by the application) "off"
The control information of the brain electro-detection information of action is "off" instruction, then can control a certain electronics
Equipment performs to disconnect the operation of network or other equipment connections etc.；Etc..Can be real based on the program
Now carry out nature, man-machine interaction flexibly and easily based on human body face action, meet user many
The practical application request of sample, improves Consumer's Experience.
It will be understood by those skilled in the art that any of the above-described side in the application detailed description of the invention
In method, the sequence number size of each step is not meant to the priority of execution sequence, the execution of each step
Order should determine with its function and internal logic, and should be to the reality of the application detailed description of the invention
Process of executing constitutes any restriction.
A kind of information that controls that Fig. 3 provides for the embodiment of the present application determines the logic diagram of device.
As it is shown on figure 3, a kind of control information that the embodiment of the present application provides determines that device includes: a brain
Electro-detection data obtaining module 31 and one controls information determination module 32.
Brain electro-detection data obtaining module 31 is at least produced by the face action of a human body for obtaining
The brain electro-detection information of raw described human body.
Control information determination module 32 for determining the control letter that described brain electro-detection information is corresponding
Breath.
The control information that the embodiment of the present application provides determines that the equipment display form of device is the cleverest
Living, such as, described control information determines that device can be a certain independent parts, or, described
Control information determines that device also can be integrated in a certain electronic equipment as a certain functional module, institute
State electronic equipment and may include but be not limited to Wearable device etc..
Described control information determines that device can obtain at least by being somebody's turn to do that the face action of human body produces
The brain electro-detection information of human body, utilizes this brain electro-detection information to determine a control information.Namely
Say, use the program to be equivalent to indirectly set up face action and control by the detection of brain electric information
Association between information processed, is thus easy to people and realizes more certainly as control source using face action
So, man-machine interaction flexibly and easily, meet the diversified practical application request of user, improve
Consumer's Experience.
Optionally, described face action may include but be not limited to: the mouth of described human body, buccal,
Tongue and/or the action of jaw.
Optionally, described control information determination module 32 includes: one first sub module stored 321,
One first matched sub-block 322 and one first control information determine submodule 323.First storage
Submodule 321 is for storing first between brain electric information and brain electric information and control information
Mapping relations；First matched sub-block 322 is for by the brain of described brain electro-detection information Yu storage
Electrical information is mated；First control information determine submodule 323 for according to matching result and
Described first mapping relations determine the control information that described brain electro-detection information is corresponding.The program can
It is determined entirely by corresponding control according to brain electro-detection information corresponding with human body face action to believe
Breath.
Optionally, described control information determination module 32 includes: a brain electrical feature extracts submodule
Block 324 and one second control information determine submodule 325.Brain electrical feature extracts submodule 324
It is the first brain electrical feature detection information for extracting the band segment in described brain electro-detection information；
Second control information determines that submodule 325 is for determining and described first brain electrical feature detection letter
The control information that breath is corresponding.The program can extract the brain electric-examination at least produced by human body face action
The band segment that in measurement information, amplitude changes greatly is as the first brain electrical feature detection information, described
Frequency range such as 5-69Hz, and determine the control that the first brain electrical feature detection information extracted is corresponding
Information, thus makes full use of the frequency range feature of the brain electric information that face action produces to reduce detection
With the complexity analyzed.
Optionally, described second control information determines that submodule 325 includes: one first storage is single
Unit 3251,1 first matching unit 3252 and one first controls information determination unit 3253.The
One memory element 3251 is for storage the first brain electrical feature information and the first brain electrical feature information
And the second mapping relations between control information；First matching unit 3252 is for by described the
One brain electrical feature detection information is mated with the first brain electrical feature information of storage；First controls
Information determination unit 3253 is described for determining according to matching result and described second mapping relations
The control information that first brain electrical feature detection information is corresponding.The program makes full use of face action and produces
The frequency range feature of raw brain electric information reduces detection and the complexity analyzed, and is conducive to improving control
The accuracy that information processed determines.
Optionally, described control information determination module 32 includes: a brain electricity sample information is extracted
Submodule 326, one brain electrical feature determines that submodule 327 and one the 3rd control information determine submodule
Block 328.Brain electricity sample information is extracted submodule 326 and is used for extracting in described brain electro-detection information
Band segment be brain electricity sample information；Brain electrical feature determines that submodule 327 is described for determining
Second brain electricity of one brain electricity reference information corresponding band of the most described human body of brain electricity sample information
Feature detection information；3rd control information determines that submodule 328 is for determining and described second brain
The control information that electrical feature detection information is corresponding.Optionally, described brain electricity reference information is described
The brain electric information obtained when the face of human body remains static.The program is equivalent in brain electric-examination
Measurement information extracts the brain electric information higher with face action degree of association, the i.e. second brain electrical feature
Detection information, determines the control letter corresponding with described second brain electrical feature detection information the most again
Breath, so that there is the control wishing to obtain during this face action in the control information determined and human body
Information processed is the most identical, improves the accuracy that control information determines.
Optionally, described 3rd control information determines that submodule 328 includes: one second storage is single
Unit 3281,1 second matching unit 3282 and one second controls information determination unit 3283.The
Two memory element 3281 are for storage the second brain electrical feature information and the second brain electrical feature information
And the 3rd mapping relations between control information；Second matching unit 3282 is for by described the
Two brain electrical feature detection information are mated with the second brain electrical feature information of storage；Second controls
Information determination unit 3283 is described for determining according to matching result and described 3rd mapping relations
The control information that second brain electrical feature detection information is corresponding.The program can be in brain electro-detection information
Extract the brain electric information higher with face action degree of association to determine control information, the most favorably
In reducing the required quantity amount processed, reduce data processing complexity, improve control information and determine
Accuracy.
Optionally, described control information determines that device also includes: an amplitude determines module 33.
Amplitude determines that module 33 makes a reservation for more than one for the maximum amplitude determining described brain electro-detection information
Threshold value and according to determine result enable described control information determination module determine corresponding control information.
Optionally, described predetermined threshold is more than or equal to 10uV.The program makes full use of to be moved by face
Making the amplitude of brain electric information that causes, specific whether preliminary judge may bag in brain electro-detection information
Include the brain electric information caused by the face action of human body, determine whether to trigger control according to judged result
The determination of information processed, thus improves efficiency.
Optionally, described control information determines that device also includes: one performs module 34.Perform
Module 34 is for performing operate corresponding with the control information determined.Can realize based on the program
Carry out nature, man-machine interaction flexibly and easily based on human body face action, meet user various
The practical application request changed, improves Consumer's Experience.
Another control information that Fig. 5 provides for the embodiment of the present application determines that the structure of device is shown
Being intended to, the application specific embodiment does not determine the side of implementing of device 500 to control information
Formula limits.As it is shown in figure 5, control information determines that device 500 may include that
Processor (Processor) 510, communication interface (Communications Interface)
520, memorizer (Memory) 530 and communication bus 540.Wherein:
Processor 510, communication interface 520 and memorizer 530 are by communication bus 540
Complete mutual communication.
Communication interface 520, for communicating with the such as first means of communication, the second means of communication etc..
Processor 510, is used for the program that performs 532, specifically can perform any of the above-described method real
Execute the correlation step in example.
Such as, program 532 can include that program code, described program code include that computer is grasped
Instruct.
Processor 510 is probably a central processing unit (Central Processing Unit, letter
Claim CPU), or specific integrated circuit (Application Specific Integrated Circuit,
It is called for short ASIC), or it is configured to implement the one or more integrated electricity of the embodiment of the present application
Road.
Memorizer 530, is used for program of depositing 532.Memorizer 530 may comprise random access memory
Memorizer (Random Access Memory is called for short RAM), it is also possible to also include non-volatile
Property memorizer (Non-volatile memory), for example, at least one disk memory.
Such as, in the optional implementation of one, processor 510 is by performing program 532
Following steps can be performed: obtain the brain of the described human body at least produced by the face action of a human body
Electro-detection information；Determine the control information that described brain electro-detection information is corresponding.Optional at other
In implementation, processor 510 can also carry out other arbitrary realities above-mentioned by execution program 532
Execute the step that example is mentioned, do not repeat them here.
In program 532, each step implements the corresponding step that may refer in above-described embodiment
Suddenly, corresponding in module, submodule, unit description, do not repeat them here.Art
Technical staff is it can be understood that arrive, for convenience and simplicity of description, and the equipment of foregoing description
With the specific works process of module, the corresponding process being referred in preceding method embodiment is retouched
State, do not repeat them here.
In the application the various embodiments described above, the sequence number of embodiment and/or sequencing are the most just
In description, do not represent the quality of embodiment.Description to each embodiment all emphasizes particularly on different fields, certain
Individual embodiment does not has the part described in detail, may refer to the associated description of other embodiments.
Those of ordinary skill in the art are it is to be appreciated that combine the embodiments described herein and retouch
The unit of each example stated and method step, it is possible to electronic hardware or computer software and
Being implemented in combination in of electronic hardware.These functions perform with hardware or software mode actually,
Depend on application-specific and the design constraint of technical scheme.Professional and technical personnel can be to often
Individual specifically should being used for uses different methods to realize described function, but this realization is not
It is considered as beyond scope of the present application.
If described function realizes and as independent product pin using the form of SFU software functional unit
When selling or use, can be stored in a computer read/write memory medium.Based on such
Understand, part that prior art is contributed by the technical scheme of the application the most in other words or
The part of this technical scheme of person can embody with the form of software product, this computer software
Product is stored in a storage medium, including some instructions with so that a computer equipment
(can be personal computer, server, or the network equipment etc.) performs the application, and each is real
Execute all or part of step of method described in example.And aforesaid storage medium includes: USB flash disk, shifting
Dynamic hard disk, read only memory (Read-Only Memory is called for short ROM), random access memory are deposited
Reservoir (Random Access Memory is called for short RAM), magnetic disc or CD etc. are various can
To store the medium of program code.
In the embodiments such as the device of the application, method, system, it is clear that each parts (system,
Subsystem, module, submodule, unit, subelement etc.) or each step be can decompose, group
Reconfigure after closing and/or decomposing.These decompose and/or reconfigure and should be regarded as the application's
Equivalents.Meanwhile, in description to the application specific embodiment above, real for one
The mode of executing describes and/or the feature that illustrates can be in same or similar mode one or more
Other embodiment individual uses, combined with the feature in other embodiment, or substitute it
Feature in its embodiment.
It should be emphasized that term " includes/comprises " referring to when using feature, key element, step herein
Rapid or the existence of assembly, but be not precluded from one or more further feature, key element, step or
The existence or additional of assembly.
Last it is noted that embodiment of above is merely to illustrate the application, and not to this
The restriction of application, about the those of ordinary skill of technical field, without departing from spirit herein
In the case of scope, it is also possible to make a variety of changes and modification, the technology of the most all equivalents
Scheme falls within the category of the application, and the scope of patent protection of the application should be limited by claim
Fixed.
Claims (10)
1. a control information determines method, it is characterised in that including:
Obtain the brain electro-detection information of the described human body at least produced by the face action of a human body；
Determine the control information that described brain electro-detection information is corresponding.
Method the most according to claim 1, it is characterised in that determine described brain electric-examination
The control information that measurement information is corresponding, including:
Described brain electro-detection information is mated with the brain electric information of storage；
Close according to the first mapping between matching result and the brain electric information of storage and control information
System, determines the control information that described brain electro-detection information is corresponding.
Method the most according to claim 1, it is characterised in that determine described brain electric-examination
The control information that measurement information is corresponding, including:
Extracting the band segment in described brain electro-detection information is the first brain electrical feature detection information；
Determine the control information corresponding with described first brain electrical feature detection information.
Method the most according to claim 3, it is characterised in that determine and described first
The control information that brain electrical feature detection information is corresponding, including:
First brain electrical feature information of described first brain electrical feature detection information with storage is carried out
Coupling；
According between matching result and the first brain electrical feature information and the control information of storage
Two mapping relations, determine the control information that described first brain electrical feature detection information is corresponding.
Method the most according to claim 1, it is characterised in that determine described brain electric-examination
The control information that measurement information is corresponding, including:
Extracting the band segment in described brain electro-detection information is brain electricity sample information；
Determine a brain electricity reference information respective tones of the described brain the most described human body of electricity sample information
Second brain electrical feature detection information of section；
Determine the control information corresponding with described second brain electrical feature detection information.
6. a control information determines device, it is characterised in that including:
One brain electro-detection data obtaining module, is at least produced by the face action of a human body for obtaining
The brain electro-detection information of raw described human body；
One controls information determination module, for determining the control letter that described brain electro-detection information is corresponding
Breath.
Device the most according to claim 6, it is characterised in that described control information is true
Cover half block includes:
One first sub module stored, is used for storing brain electric information and brain electric information and control information
Between the first mapping relations；
One first matched sub-block, for by the brain electric information of described brain electro-detection information Yu storage
Mate；
One first control information determines submodule, for mapping according to matching result and described first
Relation determines the control information that described brain electro-detection information is corresponding.
Device the most according to claim 6, it is characterised in that described control information is true
Cover half block includes:
One brain electrical feature extracts submodule, for extracting the part frequency in described brain electro-detection information
Section is the first brain electrical feature detection information；
One second control information determines submodule, is used for determining and described first brain electrical feature detection
The control information that information is corresponding.
Device the most according to claim 8, it is characterised in that described second controls letter
Breath determines that submodule includes:
One first memory element, for storage the first brain electrical feature information and the first brain electrical feature
The second mapping relations between information and control information；
One first matching unit, for by the of described first brain electrical feature detection information and storage
One brain electrical feature information is mated；
One first controls information determination unit, closes for mapping according to matching result and described second
System determines the control information that described first brain electrical feature detection information is corresponding.
Device the most according to claim 6, it is characterised in that described control information is true
Cover half block includes:
One brain electricity sample information extracts submodule, for extracting the portion in described brain electro-detection information
Frequency-division section is brain electricity sample information；
One brain electrical feature determines submodule, is used for determining the described brain the most described people of electricity sample information
Second brain electrical feature detection information of one brain electricity reference information corresponding band of body；
One the 3rd control information determines submodule, is used for determining and described second brain electrical feature detection
The control information that information is corresponding.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510080315.6A CN105988569A (en) | 2015-02-13 | 2015-02-13 | Method and device for determining control information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510080315.6A CN105988569A (en) | 2015-02-13 | 2015-02-13 | Method and device for determining control information |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105988569A true CN105988569A (en) | 2016-10-05 |
Family
ID=57042253
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510080315.6A Pending CN105988569A (en) | 2015-02-13 | 2015-02-13 | Method and device for determining control information |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105988569A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070100508A1 (en) * | 2005-10-28 | 2007-05-03 | Hyuk Jeong | Apparatus and method for controlling vehicle by teeth-clenching |
| CN103116405A (en) * | 2013-03-06 | 2013-05-22 | 胡三清 | Real-time detection and control device and method for brain and muscle electricity in tooth movement states |
| CN103150007A (en) * | 2011-12-06 | 2013-06-12 | 联想(北京)有限公司 | Input method and input device |
| CN103584856A (en) * | 2013-11-29 | 2014-02-19 | 国网安徽省电力公司淮南供电公司 | Algorithm for identifying blinking force by processing brain waves |
| CN103616882A (en) * | 2013-12-14 | 2014-03-05 | 胡三清 | Tooth-controlled smart home |
-
2015
- 2015-02-13 CN CN201510080315.6A patent/CN105988569A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070100508A1 (en) * | 2005-10-28 | 2007-05-03 | Hyuk Jeong | Apparatus and method for controlling vehicle by teeth-clenching |
| CN103150007A (en) * | 2011-12-06 | 2013-06-12 | 联想(北京)有限公司 | Input method and input device |
| CN103116405A (en) * | 2013-03-06 | 2013-05-22 | 胡三清 | Real-time detection and control device and method for brain and muscle electricity in tooth movement states |
| CN103584856A (en) * | 2013-11-29 | 2014-02-19 | 国网安徽省电力公司淮南供电公司 | Algorithm for identifying blinking force by processing brain waves |
| CN103616882A (en) * | 2013-12-14 | 2014-03-05 | 胡三清 | Tooth-controlled smart home |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Latif et al. | Survey of deep representation learning for speech emotion recognition | |
| JP7337953B2 (en) | Speech recognition method and device, neural network training method and device, and computer program | |
| US11238306B2 (en) | Generating vector representations of code capturing semantic similarity | |
| US10198071B2 (en) | Methods and apparatuses for determining control information | |
| Lee et al. | EEG-transformer: Self-attention from transformer architecture for decoding EEG of imagined speech | |
| CN108346427A (en) | Voice recognition method, device, equipment and storage medium | |
| CN107220235A (en) | Speech recognition error correction method, device and storage medium based on artificial intelligence | |
| CN110415701A (en) | The recognition methods of lip reading and its device | |
| CN104503592A (en) | Method and device for determining head gestures | |
| CN112233698A (en) | Character emotion recognition method and device, terminal device and storage medium | |
| CN109872276A (en) | Method and apparatus for generating image super-resolution model | |
| CN108229535A (en) | Relate to yellow image audit method, apparatus, computer equipment and storage medium | |
| US20230409116A1 (en) | Systems and Methods for Decoding Intended Symbols from Neural Activity | |
| Kuznetsov et al. | Interpretable feature generation in ECG using a variational autoencoder | |
| CN107329760A (en) | Information cuing method, device, terminal and storage medium | |
| Shivakumar et al. | Simplified and supervised i-vector modeling for speaker age regression | |
| CN109961152B (en) | Personalized interaction method and system of virtual idol, terminal equipment and storage medium | |
| CA3188766A1 (en) | Systems and methods decoding intended symbols from neural activity | |
| Gao et al. | Metric Learning Based Feature Representation with Gated Fusion Model for Speech Emotion Recognition. | |
| Li et al. | Robust automatic speech recognition | |
| US20230315203A1 (en) | Brain-Computer Interface Decoding Method and Apparatus Based on Point-Position Equivalent Augmentation | |
| CN114548262B (en) | Feature level fusion method for multi-mode physiological signals in emotion calculation | |
| CN105988569A (en) | Method and device for determining control information | |
| CN107251137A (en) | Improve method, device and the computer readable recording medium storing program for performing of the set of at least one semantic primitive using voice | |
| CN114708849A (en) | Voice processing method and device, computer equipment and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20161005 |