CN110221684A - Apparatus control method, system, electronic device and computer readable storage medium - Google Patents

Apparatus control method, system, electronic device and computer readable storage medium Download PDF

Info

Publication number
CN110221684A
CN110221684A CN201910156093.XA CN201910156093A CN110221684A CN 110221684 A CN110221684 A CN 110221684A CN 201910156093 A CN201910156093 A CN 201910156093A CN 110221684 A CN110221684 A CN 110221684A
Authority
CN
China
Prior art keywords
bioelectrical signals
user
signals
apparatus control
classifier
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910156093.XA
Other languages
Chinese (zh)
Inventor
陈刚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201910156093.XA priority Critical patent/CN110221684A/en
Publication of CN110221684A publication Critical patent/CN110221684A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/015Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Neurosurgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Neurology (AREA)
  • Health & Medical Sciences (AREA)
  • Dermatology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Biomedical Technology (AREA)
  • Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)

Abstract

The embodiment of the present application provides a kind of apparatus control method, system, electronic device and computer readable storage medium, is related to field of communication technology, wherein method includes that the type of the bioelectrical signals of user to be collected is determined according to current application scenarios;By acquiring biological electric signals device, determining at least one bioelectrical signals are acquired, and extract characteristic from least one bioelectrical signals of acquisition;The characteristic of extraction is inputted into classifier, to identify the intention of the user;The data that the classifier exports are converted into corresponding apparatus control instruction, and executes the apparatus control and instructs corresponding operation.The application can realize the human-computer interaction based on the fusion of multi-mode bioelectrical signals.

Description

Apparatus control method, system, electronic device and computer readable storage medium
Technical field
This application involves field of communication technology more particularly to a kind of apparatus control method, system, electronic device and computers Readable storage medium storing program for executing.
Background technique
Man-machine interaction mode traditional in mainstream market is all to be transferred to four limbs by human brain information to arrive movement again eventually at present End, the information that then mobile terminal is presented feed back to the such truck of human brain again and realize that people exists in traditional interactive mode It is had an idea or is realized by brain when receiving end message, trunk and four limbs pair are commanded by human central nervous system Idea or consciousness respond.But, on the one hand, the consciousness of people is transmitted to trunk and four limbs need the regular hour, another Aspect, it is mobile whole due to that can not be transferred to consciousness by trunk and four limbs for certain users with disabilities End, the reaction that also just mobile terminal can not be made to make a response.Therefore, how more efficiently the consciousness of people to be passed to mobile whole It holds and mobile terminal is controlled, be current a great problem in the industry.
Summary of the invention
The embodiment of the present application provides a kind of apparatus control method, system, electronic device and computer readable storage medium, can For realizing the human-computer interaction merged based on multi-mode bioelectrical signals.
On the one hand the embodiment of the present application provides a kind of apparatus control method, which comprises according to current application Scene determines the type of the bioelectrical signals of user to be collected;By acquiring biological electric signals device, to determining at least one Bioelectrical signals are acquired, and extract characteristic from least one bioelectrical signals of acquisition;By the characteristic of extraction According to input classifier, to identify the intention of the user;The data that the classifier exports are converted into corresponding apparatus control Instruction, and execute the apparatus control and instruct corresponding operation.
On the one hand the embodiment of the present application additionally provides a kind of apparatus control method, which comprises controlled device according to Current application scenarios determine the type of the bioelectrical signals of user to be collected, and determining type are sent to control dress It sets;The control device is by acquiring biological electric signals device, according to the type of the determination, at least one bioelectrical signals into Row acquisition, and characteristic is extracted from least one bioelectrical signals of acquisition, the characteristic of extraction is inputted into classifier, To identify the intention of the user, the data that the classifier exports are converted into corresponding apparatus control and are instructed, and will be described Apparatus control instruction is sent to the controlled device;The controlled device is instructed in response to the apparatus control, is executed corresponding Operation.
On the one hand the embodiment of the present application additionally provides a kind of electronic device, comprising: determining module, for being answered according to current With scene, the type of the bioelectrical signals of user to be collected is determined;Acquisition module, for passing through acquiring biological electric signals device, Determining at least one bioelectrical signals are acquired, and extract characteristic from least one bioelectrical signals of acquisition According to;Identification module, the characteristic for that will extract inputs classifier, to identify the intention of user;Conversion module is used for institute The data for stating classifier output are converted to corresponding apparatus control instruction;Execution module, for executing the apparatus control instruction Corresponding operation.
On the one hand the embodiment of the present application additionally provides a kind of electronic device, comprising: memory, processor and be stored in described It is real when the processor executes the computer program on memory and the computer program that can run on the processor Now such as apparatus control method provided by the above embodiment.
On the one hand the embodiment of the present application additionally provides a kind of computer readable storage medium, be stored thereon with computer journey Sequence when the computer program is executed by processor, realizes such as apparatus control method provided by the above embodiment.
On the one hand the embodiment of the present application additionally provides a kind of apparatus control system, the system comprises: electronic device and letter Number acquisition device;The signal pickup assembly includes: collector, microprocessing unit, data transmission unit and fixing belt;It is described micro- Processing unit, the type letter of at least one bioelectrical signals of the user to be collected for being sent according to the electronic device Breath controls the collector acquisition at least one bioelectrical signals, and the electric signal of acquisition is passed through after pretreatment The data transmission unit is sent to the electronic device;The electronic device, for determining institute according to current application scenarios It states information and is sent to the signal pickup assembly;And from by extracting characteristic in pretreated bioelectrical signals According to, the characteristic of extraction is inputted into classifier, to identify the intention of the user, data conversion that the classifier is exported It is instructed for corresponding apparatus control, and executes the apparatus control and instruct corresponding operation.
The various embodiments described above, by according to current application scenarios, at least one to match with current application scenarios Kind bioelectrical signals are acquired, and extract characteristic from least one bioelectrical signals of acquisition, then pass through classification Device identifies the intention of user according to the characteristic of extraction and is converted into corresponding apparatus control and instructs, to realize to electricity The control of sub-device, and realizing the human-computer interaction based on the fusion of multi-mode bioelectrical signals simultaneously, it may make intention assessment It is more targeted relative to current application scenarios.
Detailed description of the invention
Fig. 1 is the implementation process schematic diagram for the apparatus control method that one embodiment of the application provides;
Fig. 2 is the schematic diagram of the ERS or ERD phenomenon of Tasks excitation;
Fig. 3 is the signal of acquiring biological electric signals position and mode in apparatus control method provided by the embodiments of the present application Figure;
Fig. 4 is the implementation process schematic diagram for the apparatus control method that another embodiment of the application provides;
Fig. 5 is the schematic diagram of characteristic choosing method in apparatus control method provided by the embodiments of the present application;
Fig. 6 is the schematic diagram being trained in apparatus control method provided by the embodiments of the present application to classifier;
Fig. 7 is the timing flow diagram for the apparatus control method that another embodiment of the application provides;
Fig. 8 is the interaction schematic diagram for the apparatus control method that another embodiment of the application provides;
Fig. 9 is the hardware structural diagram for the electronic device that one embodiment of the application provides;
Figure 10 is the hardware structural diagram for the electronic device that one embodiment of the application provides;
Figure 11 is the hardware structural diagram of a kind of electronic equipment;
Figure 12 is the structural schematic diagram for the apparatus control system that one embodiment of the application provides;
Figure 13 is the structural schematic diagram of signal pickup assembly in apparatus control system provided by the embodiments of the present application.
Specific embodiment
To enable present invention purpose, characteristic, advantage more obvious and understandable, below in conjunction with this Apply for the attached drawing in embodiment, the technical scheme in the embodiment of the application is clearly and completely described, it is clear that described Embodiment be only some embodiments of the present application, and not all embodiments.Based on the embodiment in the application, this field skill Art personnel every other embodiment obtained without making creative work belongs to the model of the application protection It encloses.
Referring to Fig. 1, the implementation process schematic diagram of the apparatus control method provided for one embodiment of the application.This method can Applied to electronic device, such as: mobile phone, tablet computer, intelligent wearable device, smart camera can carry out at data on the move The electronic device of reason, alternatively, the non-electronic device that can carry out data processing on the move such as smart television, desktop computer.It should Electronic device establishes data transmission channel with acquiring biological electric signals device by way of wireless network or data line connection, biology Electrical signal collection device is used to acquire the bioelectrical signals of people, can be, but not limited to include: brain electricity, electrocardio, myoelectricity and eye telecommunications Number.As shown in Figure 1, this method specifically includes that
S101, according to current application scenarios, determine the type of the bioelectrical signals of user to be collected;
There are many kinds of classes for bioelectrical signals, in this present embodiment, specifically can be, but not limited to include: brain electricity, myoelectricity, eye electricity And electrocardio etc..Bioelectrical signals have recorded the movable index of biological physiology with a kind of very weak voltage signals, from physiology machine Explain that it is that central nervous system can be externally detected that it, which is the synchronous current potential that postsynaptic formation occurs of a large amount of neurons, in preparative layer face A kind of physics reflection, essence is the transmembrane movement of ion, these signals are generated jointly by more than one hundred million a neurons, not same district The responsible function in domain is different, and generated current potential and feature are different, and charge is generated by neuron, by electrolyte conducts it Electrode on scalp, pulls or pushes the metal electron on electrode, and the weak voltage difference between electrode is put by high-precision high-performance Big device amplification, these voltages for changing over time and changing are exactly the bioelectrical signals acquired.The some physiology or the heart of biology Faint variation in reason can embody on bioelectrical signals, such as the conscious activity of National People's Congress's brain, emotional change, consciousness are blinked Eye etc. can be judged by the bioelectrical signals feature of extraction.
By taking brain wave (Electroencephalogram, EEG) as an example, the brain wave of different frequency contains different lifes Information is managed, spontaneous brain electricity is the bioelectric that cerebral cortex carries out the spontaneous generation of thinking activities, and cortex specific region, which has, holds Continuous property rhythmicity potential change, brain different rhythm and pace of moving things of the spontaneous generation of meeting under different states of consciousness, usually by EEG according to frequency range Classify, can be divided into δ wave, θ wave, α wave, mu wave, β wave, under the specific features of five kinds of brain waves as shown in table 1.
1 different frequency range EEG signal of table and feature
Human body can also induce different bioelectrical signals, the practical limb motion of human body or the imagination when carrying out the consciousness imagination The process of limb motion can cause mu the and beta rhythm and pace of moving things of motor area at the top of brain, supplementary motor area and somatosensory area Power spectrum signal energy variation is known as the phenomenon that function rate spectrum energy decline to generate Event-related desynchronization signal (Event- Related Desynchronization, ERD), conversely, the phenomenon that power spectral energies are risen is known as producing event correlation Synchronization signal (Event-Related Synchronization, ERS).When brain imagines unilateral limb motion, brain opposite side Primary sensorimotor cortex is active, mu and beta periodic activity shows as the reduction of amplitude, that is, ERD phenomenon has occurred, Conversely, the ipsilateral primary sensorimotor cortex of brain is suppressed, mu and beta periodic activity shows as amplitude raising, referred to as sends out Raw ERS phenomenon.ERS or ERD belong to spontaneous brain electricity, are not necessarily to outside stimulus, airspace and frequency domain character are obvious.As shown in Fig. 2, working as people When carrying out the Tasks imagination, ERS or ERD phenomenon is produced, the main energetic of bio signal is distributed in specific region.
In this present embodiment, application scenarios can be with the function or currently performed task pair of the application program of front stage operation It answers.According to application scenarios difference, some possibility only need EEG signals that control operation can be completed, such as: the scene of lock screen is solved, Only need to determine being intended that the left still to the right for user according to EEG signals;Some possibility need EEG signals, electromyography signal Control operation could be completed, such as: under the scene for executing the task whether monitoring user falls asleep, needing EEG signals and eye Electric signal fusion, just can determine that whether user falls asleep.Therefore, it is preset under different application scenarios in a device, for controlling Device executes the corresponding relationship between the control instruction and the type of corresponding bioelectrical signals of different operation.As triggering control behaviour When making, according to current application scenarios, at least one bioelectrical signals for needing to acquire are determined.
S102, by acquiring biological electric signals device, determining at least one bioelectrical signals are acquired, and from acquisition At least one bioelectrical signals in extract characteristic;
Bioelectrical signals are acquired by several high sensors, and position is attachable to user's scalp, eye socket, ear etc. Position, as shown in figure 3, by be placed on scalp 2. on eeg sensor 1., EEG signals under skull can be collected 3.. Collected bioelectrical signals are handled, characteristic therein is extracted, according to the type of the bioelectrical signals of processing, are mentioned The characteristic taken can be, but not limited to include: consciousness imagination composition of matter data (EEG signals), consciousness facial expression feature Data (electromyography signal) and consciousness frequency of wink and dynamics data (electro-ocular signal).
S103, the characteristic of extraction is inputted into classifier, to identify the intention of user;
Classification is to learn a classification function on the basis of data with existing or construct a disaggregated model (that is, classification Device).The function or model can be mapped to the data recorded in database some in given classification, so as to apply It is predicted in data.The normal work to do of classifier is regular come learning classification using given classification, known training data and divides Then class device is classified (or prediction) to unknown data.In the present embodiment, extracted by classifier to from bioelectrical signals Characteristic classify, can recognize user intention or behavior.
Optionally, classifier can according to different kind organism electric signal sample training gathered in advance or study obtain, training or The process of study can be completed online by server.In actually reference, classifier can be based on support vector machines (Support Vector Machine, SVM) or neural metwork training building, in this present embodiment, specific building mode is not limited.
S104, the data that classifier exports are converted into corresponding apparatus control instruction, and execute apparatus control instruction pair The operation answered.
The data of classifier output are corresponding with the intention of user or behavior, such as: 0 represents to the left, and 1 represents to the right.In device Corresponding relationship between data configured with classifier output and apparatus control instruction, according to the corresponding relationship, it may be determined that corresponding Apparatus control instruction.
In the present embodiment, by according to current application scenarios, at least one to match with current application scenarios Bioelectrical signals are acquired, and extract characteristic from least one bioelectrical signals of acquisition, then pass through classifier The intention of user is identified according to the characteristic of extraction and is converted into corresponding apparatus control instruction, to realize to electronics The control of device, and realizing the human-computer interaction based on the fusion of multi-mode bioelectrical signals simultaneously, it may make intention assessment phase It is more targeted for current application scenarios.
Referring to Fig. 4, the implementation process schematic diagram of the apparatus control method provided for another embodiment of the application.This method It can be applied to electronic device, such as: mobile phone, tablet computer, intelligent wearable device, smart camera can carry out data on the move The electronic device of processing, alternatively, the non-electronic device that can carry out data processing on the move such as smart television, desktop computer. The electronic device establishes data transmission channel with acquiring biological electric signals device by way of wireless network or data line connection, raw Object electrical signal collection device is used to acquire the bioelectrical signals of people, can be, but not limited to include: brain electricity, myoelectricity and electro-ocular signal. As shown in figure 4, this method specifically includes that
S201, according to current application scenarios, determine the type of the bioelectrical signals of user to be collected;
S202, pass through acquiring biological electric signals device, determining at least one bioelectrical signals are acquired;
Step S201 and step S202 is identical as step S101 and step S102, specifically refer to above-mentioned steps S101 and The associated description of S102, details are not described herein again.
S203, voltage amplification is carried out by least one bioelectrical signals of the high-precision amplifying to acquisition;
S204, frequency domain filtering is carried out to the bioelectrical signals after voltage amplification;
The noise jamming in bioelectrical signals can be eliminated by frequency domain filtering.
Optionally, frequency domain filtering is carried out to the bioelectrical signals of acquisition, specifically includes: voltage amplification is eliminated by trapper The man-made noise in bioelectrical signals afterwards;The bioelectrical signals after eliminating man-made noise are filtered by bandpass filter Wave, bandpass filter are the limited long impulse response filters with linear phase, and the bandpass filter and life to be filtered The frequecy characteristic of object electric signal matches.
It should be understood that eliminating man-made noise to the Hz noise of bioelectrical signals, due to biological telecommunications by trapper Number will receive the severe jamming of industrial frequency noise, if not eliminating 50Hz (hertz) Hz noise of man-made noise, useful letter Number frequency domain information will lose completely.
In this present embodiment, it needs to be designed according to the frequency feature of different bioelectrical signals different with linear phase FIR (limited long impulse response filter) bandpass filter, such as: ERD the or ERS signal band of the event imagination is concentrated mainly on 10Hz~15Hz may be selected the bandpass filter that frequency band is slightly larger than 10Hz~15Hz, set to guarantee not lose useful information Meter frequency band should be 5Hz~25Hz.
S205, airspace filter is carried out to the bioelectrical signals after frequency domain filtering;
The purpose of airspace filter is that elimination is widely distributed in the random noise of human body, protrudes the useful of current useful lead Signal improves signal-to-noise ratio.
Optionally, using the instantaneous signal mean value of all leads as reference signal, to the bioelectrical signals after frequency domain filtering Airspace filter is carried out, wherein the formula used are as follows:
Wherein,For the signal after airspace filter, XiFor original signal before airspace filter.
Whether the intensity of the bioelectrical signals after S206, assessment airspace filter reaches preset strength;
If S207, not up to preset strength, the bioelectrical signals for being less than preset strength to intensity re-start acquisition;
If S208, reaching preset strength, characteristic is extracted from the bioelectrical signals after airspace filter;
It should be understood that there are many integrated modes for bioelectrical signals according to the difference of application scenarios.In practical applications, Different characteristic morphologies can be needed to choose according to the difference of application scenarios, the basic principle of selection is that feature is obvious.It is with Fig. 5 Example carries out airspace filter and frequency domain filtering to different kind organism electric signal respectively, to improve data to before extracting characteristic The signal-to-noise ratio of signal later assesses the power of filtered bioelectrical signals.If the intensity of the bioelectrical signals reaches To preset strength, illustrate that the bioelectrical signals are effective, which is exported to characteristic extracting module, therefrom to extract Characteristic.If the intensity of bioelectrical signals is not up to preset strength, illustrates that the bioelectrical signals are invalid, can not therefrom extract Validity feature then re-starts acquisition to similar bioelectrical signals.
S209, the characteristic of extraction is inputted into classifier, to identify the intention of the user;
The characteristic extracted from the bioelectrical signals of acquisition is inputted into classifier, classifier is by this feature data and sample The similarity of the characteristic of Ben Kunei is compared, and when the similarity of the two reaches preset similarity value, classifier can should The corresponding user of characteristic is intended to or behavior is intended to the user learnt before or behavior determines at consistent, and exports accordingly For identifying the data of corresponding user's intention or behavior.
S210, the data that classifier exports are converted into corresponding apparatus control instruction, and execute apparatus control instruction pair The operation answered.
Step S210 is identical as step S104, specifically refers to the associated description of step S104 in embodiment illustrated in fig. 1, this Place repeats no more.
Optionally, to improve discrimination, training can be optimized to classifier, to obtain optimum classifier.Specific training Method includes: acquisition as the difference of user under the different application scene of sample and is intended to corresponding at least one bioelectrical signals; Characteristic is extracted from least one bioelectrical signals of acquisition;The characteristic input classifier of extraction supervision has been subjected to Classification, and judge whether nicety of grading reaches preset threshold value;If nicety of grading reaches threshold value, optimum classifier is exported, To be used for user's intention assessment;If nicety of grading is not up to preset, the characteristic of extraction is added in sample database, And update the classifier.It is above-mentioned that classifier is optimized in training, it is extracted from least one bioelectrical signals of acquisition special The detailed process of sign data can refer to the associated description of step S203 to step S208, and details are not described herein again.
By taking Fig. 6 as an example, the instruction guidance user pre-established can be first passed through and carry out special Tasks, pass through use The sensor that family is worn is acquired the bioelectrical signals of user, then carries out sample for the bioelectrical signals of acquisition as sample The extraction of eigen data inputs existing classifier to the sample characteristics data of extraction, to carry out having the classification of supervision, simultaneously According to the classification results of output, judge whether nicety of grading reaches preset threshold value, if nicety of grading is not up to threshold value, updates Sample characteristics data are simultaneously added in sample database by the classifier, export optimum classifier if precision reaches threshold value, with It is used when for device, user is intended to for identification.
Wherein, Supervised classification refers to for training all samples of classifier all to have passed through artificial or other modes marks Note.Nicety of grading refers to classification accuracy rate, and such as requiring classification accuracy rate to reach 95% can stop learning.If nicety of grading does not reach Characteristic is then added in sample database by threshold value, its purpose is to increase training data sample, so that training data Comprising various scenes, classifier is allowed to learn to certain data boundaries.
Optionally, to advanced optimize classifier, discrimination is improved, user can be obtained and be not inconsistent in operation and the intention of user When the feedback information that inputs;According to feedback information, classifier is updated, for example, modifying the corresponding feature of the operation in classifier Label of the data in classifier.
Optionally, in other embodiments of the application, bioelectrical signals can be used to unlock.Specifically, when classification When the corresponding apparatus control instruction of the data of device output is for triggering unlocking pin setting operation, electronic device is exported for unlocking The prompt information of target intention operate according to the user's choice, acquire the eye of user and by acquiring biological electric signals device Any two kind of first bioelectrical signals in electricity, brain electricity, electrocardio and flesh point;Fisrt feature number is extracted from the first bioelectrical signals According to, and save in an electronic.Wherein, the control instruction of the selection operation triggering of user, can be according to step S201 to step The data that classifier exports in scheme shown in S209 determine.User can choose any two in eye electricity, brain electricity, electrocardio and flesh point Kind bioelectrical signals are for unlocking.
In the case where unlocking scene, when unlock task is triggered, by acquiring biological electric signals device, acquire user second is raw Object electric signal, the type of the second bioelectrical signals is identical as the first bioelectrical signals, as: if being acquired when unlocking pin is arranged It is eye electricity and EEG signals, then what is acquired in unlock is also eye electricity and EEG signals.Then, from the second biological telecommunications of acquisition Second feature data are extracted in number, which is matched with the fisrt feature data of preservation, and work as second feature number When spending according to the matching degree with fisrt feature data greater than preset matching, unlock operation is executed.Wherein, unlock operation can with but it is unlimited In including solution lock screen, unlocks file or unlock the other function etc. of electronic device.In this present embodiment, to unlock task Trigger condition is not specifically limited, wherein also may include that the apparatus control obtained by step S201 to S209 instructs as triggering The case where unlock instruction.
Apparatus control method provided in this embodiment, independently of human vertebra or peripheral nerve musculature system, it is not The normal four limbs access with people is relied on, but simulates human nerve's maincenter work system, by acquiring multi-mode bioelectrical signals, And this signal is translated and decoded into apparatus control and is instructed, so that the four limbs instead of people respond the consciousness or idea of people, and Brain generate multiclass bioelectrical signals and terminal between establish direct path, by acquisition bioelectrical signals control device come Realize human-computer interaction.
The details of the present embodiment not to the greatest extent, can refer to the associated description of other embodiments.
In the present embodiment, by according to current application scenarios, at least one to match with current application scenarios Bioelectrical signals are acquired, and extract characteristic from least one bioelectrical signals of acquisition, then pass through classifier The intention of user is identified according to the characteristic of extraction and is converted into corresponding apparatus control instruction, to realize to electronics The control of device, and realizing the human-computer interaction based on the fusion of multi-mode bioelectrical signals simultaneously, it may make intention assessment phase It is more targeted for current application scenarios.
Referring to Fig. 7, the timing flow diagram of the apparatus control method provided for another embodiment of the application.This method It can be by interacting realization between controlled device and control device, wherein controlled device and control device can be electronic device, Such as: mobile phone, tablet computer, intelligent wearable device, smart camera can carry out the electronic device of data processing on the move, or Person, the non-electronic device that can carry out data processing on the move such as smart television, desktop computer.The control device passes through wireless The mode and acquiring biological electric signals device of network or data line connection establish data transmission channel, and acquiring biological electric signals device is used for The bioelectrical signals for acquiring people can be, but not limited to include: brain electricity, myoelectricity and electro-ocular signal.Alternatively, the control device can also To be integrated in acquiring biological electric signals device.As shown in fig. 7, this method specifically includes that
S301, controlled device determine the type of the bioelectrical signals of user to be collected according to current application scenarios;
Determining type is sent to control device by S302, controlled device;
S303, control device are by acquiring biological electric signals device, according to determining type, at least one bioelectrical signals It is acquired, and extracts characteristic from least one bioelectrical signals of acquisition, the characteristic of extraction is inputted into classification The data that classifier exports are converted to corresponding apparatus control and instructed by device to identify the intention of user;
Step S303 specifically refers to the correlation step in embodiment illustrated in fig. 4, and details are not described herein again.
Apparatus control instruction is sent to controlled device by S304, control device;
Optionally, according to the connection type of control device and controlled device, control device can pass through radio path or data Apparatus control instruction is sent to controlled device by line.
S305, controlled device are instructed in response to apparatus control, execute corresponding operation.
Optionally, classifier can be obtained by the method for server on-line study, and optimize training.Specifically, by Device command control device is controlled by acquiring biological electric signals device, acquires the difference as user under the different application scene of sample It is intended to corresponding at least one bioelectrical signals, and at least one bioelectrical signals of acquisition is sent to server.Server Characteristic is extracted from least one bioelectrical signals of acquisition, the characteristic input classifier of extraction has been subjected to supervision Classification, and if judge whether nicety of grading reaches preset threshold value nicety of grading and reach threshold value, export optimum classifier simultaneously It is sent to control device, to be used for user's intention assessment, if nicety of grading is not up to threshold value, the characteristic of extraction is added Into sample database, and update classifier.
Optionally, controlled device acquisition user inputs anti-when the intention for the operation and user that controlled device executes is not inconsistent Feedforward information, and feedback information is sent to server, server updates classifier according to feedback information, and by updated point Class device is sent to control device, to be used for user's intention assessment.It is connect it should be understood that controlled device provides information feedback for user Mouthful, by the information feedback interface, when the operation and user that controlled device executes are intended to not be inconsistent, user can be defeated by feedback information Enter controlled device.Wherein feedback information can be, but not limited to include: user true intention or user intention it is corresponding true Operation.
To further illustrate the present embodiment, to be integrated with the acquiring biological electric signals device of control device and as controlled device Mobile terminal for, as shown in Figure 8.Acquiring biological electric signals device acquires at least one bioelectrical signals of user, then right The bioelectrical signals of acquisition carry out feature extraction, and the characteristic of extraction is inputted optimum classifier, to identify user Intention, and the intention is converted into apparatus control instruction, mobile terminal is then sent to by radio path, so as to mobile end End executes corresponding operation, carries out audio visual feedback to user.The not traditional four limbs access of whole process participates in, and the application is straight It connects and the bioelectrical signals of user is translated into machine instruction, mobile terminal is then transferred to by radio path, to complete to hand over Mutually, and then realization interacts under the premise of not depending on normal four limbs access with mobile terminal.
It should be understood that some special populations such as physical disabilities, possibly can not make according to the wish of oneself freely This kind of disadvantaged group can be helped to regain and movement by apparatus control method provided in this embodiment with mobile terminal The ability of terminal interaction, and this method is also applied under Intelligent internet of things application scenarios, and user can be by this method Realize that idea controls household such as lamp, air-conditioning etc., user only needs to wear acquiring biological electric signals equipment, by decoding user's idea The bioelectrical signals of excitation and realize that idea controls household, do not need to control mobile phone by four limbs again and be remotely controlled.
Optionally, in other embodiments of the application, bioelectrical signals can be applied to unlock, specifically, when dividing When the corresponding apparatus control instruction of the data of class device output is for triggering unlocking pin setting operation, controlled device is exported for solving The prompt information of the target intention of lock, and operate according to the user's choice, the eye of the user to be collected is sent to control device First description information of electricity, brain electricity, electrocardio and any two kind of first bioelectrical signals in flesh point.Then, the control device root According to first description information, by the acquiring biological electric signals device, acquire any two kind of first bioelectrical signals, from this first Fisrt feature data are extracted in bioelectrical signals, and the fisrt feature data are sent to the controlled device and are saved, in case Later period unlock uses.
In the case where unlocking scene, when unlock task is triggered, which sends the second bioelectricity to the control device Second description information of signal, the type of second bioelectrical signals are identical as first bioelectrical signals.The control device is logical The acquiring biological electric signals device is crossed, according to second description information, acquires second bioelectrical signals, from the second biological telecommunications Second feature data are extracted in number, and the second feature data are matched with the fisrt feature data, when the second feature When the matching degree of data and the fisrt feature data is spent greater than preset matching, unlock instruction is sent to the controlled device.This is controlled Device executes unlock operation in response to the unlock instruction.It should be understood that above-mentioned first description information and the second description information example It such as can be the identification information of bioelectrical signals, such as: preset coding.Above-mentioned fisrt feature data and second feature data mention Mode is taken to specifically refer to associated description of the above-mentioned steps S203 into step S208, details are not described herein again.
It should be understood that needing to input the characteristic extracted from bioelectrical signals and classify under non-unlock scene In device, to identify the intention of user.It, can be without classifier, directly by the characteristic of extraction and default in the case where unlocking scene Characteristic matched, so as to execute different operations for different application scenarios, improve being directed to for data processing Property and efficiency.
It should be understood that in practical applications, the extraction of characteristic can also be completed by controlled device, specific extracting mode Similar with being extracted by control device, details are not described herein again.
The details of the present embodiment not to the greatest extent, such as the extracting mode of characteristic, can refer to the associated description of other embodiments.
In the present embodiment, by according to current application scenarios, at least one to match with current application scenarios Bioelectrical signals are acquired, and extract characteristic from least one bioelectrical signals of acquisition, then pass through classifier The intention of user is identified according to the characteristic of extraction and is converted into corresponding apparatus control instruction, to realize to electronics The control of device, and realizing the human-computer interaction based on the fusion of multi-mode bioelectrical signals simultaneously, it may make intention assessment phase It is more targeted for current application scenarios.
Referring to Fig. 9, the hardware structural diagram of the electronic device provided for one embodiment of the application.The electronic device can For realizing above-mentioned apparatus control method shown in FIG. 1.As shown in figure 9, the electronic device specifically includes that determining module 401, adopts Collect module 402, identification module 403, conversion module 404 and execution module 405.
Determining module 401, for determining the kind of the bioelectrical signals of user to be collected according to current application scenarios Class;
Acquisition module 402, for being adopted to determining at least one bioelectrical signals by acquiring biological electric signals device Collection, and characteristic is extracted from least one bioelectrical signals of acquisition;
Identification module 403, the characteristic for that will extract inputs classifier, to identify the intention of user;
Conversion module 404, the data for exporting the classifier are converted to corresponding apparatus control instruction;
Execution module 405 instructs corresponding operation for executing the apparatus control.
Further, acquisition module 402 are also used to acquire disagreeing for the user under the different application scene as sample Scheme corresponding at least one bioelectrical signals, extracts characteristic from least one bioelectrical signals of acquisition;
The device further include:
Categorization module carries out the classification for having supervision for the characteristic of extraction to be inputted the classifier, and judges to classify Whether precision reaches preset threshold value;
Output module exports optimum classifier if reaching the threshold value for the nicety of grading, to be intended to know for user Not;
The characteristic of extraction is added to sample number if being not up to the threshold value for the nicety of grading by update module According in library, and update the classifier.
Further, acquisition module 402 includes:
Amplification module, for carrying out voltage amplification by least one bioelectrical signals of the high-precision amplifying to acquisition;
Frequency domain filtering module, for carrying out frequency domain filtering to the bioelectrical signals after voltage amplification;
Airspace filter module, for carrying out airspace filter to the bioelectrical signals after frequency domain filtering;
Evaluation module, whether the intensity for assessing the bioelectrical signals after airspace filter reaches preset strength, if not reaching To the preset strength, then the bioelectrical signals for being less than the preset strength to the intensity re-start acquisition, if it is default strong to reach this Degree then extracts this feature data from the bioelectrical signals after airspace filter.
Further, frequency domain filtering module, specifically for eliminating the biological telecommunications after the voltage amplification by trapper Man-made noise in number;The bioelectrical signals after eliminating man-made noise are filtered also particularly useful for by bandpass filter, The bandpass filter is the limited long impulse response filter with linear phase, and the bandpass filter and the life to be filtered The frequecy characteristic of object electric signal matches.
Further, the airspace filter module, specifically for using the instantaneous signal mean value of all leads as reference signal, Airspace filter is carried out to the bioelectrical signals after the frequency domain filtering, wherein the formula used are as follows:
Wherein,For the signal after airspace filter, XiFor original signal before airspace filter.
Further, the device further include:
Module is obtained, the feedback information inputted for obtaining the user when the intention of the operation and the user is not inconsistent;
The update module is also used to update the classifier according to the feedback information.
Above-mentioned each module realizes the detailed process of respective function, and it is specific interior into embodiment illustrated in fig. 7 to can refer to Fig. 1 Hold, details are not described herein again.
In the present embodiment, by according to current application scenarios, at least one to match with current application scenarios Bioelectrical signals are acquired, and extract characteristic from least one bioelectrical signals of acquisition, then pass through classifier The intention of user is identified according to the characteristic of extraction and is converted into corresponding apparatus control instruction, to realize to electronics The control of device, and realizing the human-computer interaction based on the fusion of multi-mode bioelectrical signals simultaneously, it may make intention assessment phase It is more targeted for current application scenarios.
Referring to Fig. 10, Figure 10 is the hardware structural diagram for the electronic device that one embodiment of the application provides.
Electronic device as described in this embodiment, comprising:
Memory 501, processor 502 and it is stored in the computer journey that can be run on memory 501 and on processor 502 Sequence when processor 502 executes the computer program, realizes earlier figures 1 to device controlling party described in embodiment illustrated in fig. 6 Method.
At least one input equipment 503 and at least one output equipment 504.
Above-mentioned memory 501, processor 502, input equipment 503 and output equipment 504, are connected by bus 505.
Wherein, input equipment 503 concretely camera, touch panel, physical button etc..Output equipment 504 is specific It can be touch screen.
Memory 501 can be high random access memory body (RAM, Random Access Memory) memory, It can be non-labile memory (non-volatile memory), such as magnetic disk storage.Memory 501 is for storing one Group executable program code, processor 502 are coupled with memory 501.
The external acquiring biological electric signals device of the electronic device.
Further, which further includes being electrically connected at what processor 502 connected:
High-precision amplifying, the bioelectrical signals for acquiring to acquiring biological electric signals device carry out voltage amplification;
Trapper, for eliminating the man-made noise in bioelectrical signals;
Bandpass filter, for being filtered to the bioelectrical signals after elimination man-made noise, the bandpass filter is Limited long impulse response filter with linear phase, and the bandpass filter and the bioelectrical signals to be filtered Frequecy characteristic matches;And
Spatial filter, for carrying out airspace filter to the bioelectrical signals after frequency domain filtering.
Further, the embodiment of the present application also provides a kind of computer readable storage medium, the computer-readable storages Medium can be arranged in the electronic device in the various embodiments described above, which can be above-mentioned each reality Apply storage unit of the configuration in main control chip and data acquisition chip in example.Meter is stored on the computer readable storage medium Calculation machine program realizes earlier figures 1 to apparatus control method described in embodiment illustrated in fig. 6 when the program is executed by processor.
Illustratively, electronic device can be movement with flexible capacitive touch screen or portable and execute channel radio Any one of various types of computer system devices of letter.Specifically, electronic device can be mobile phone or intelligence Phone (for example, being based on iPhone TM, the phone based on Android TM), portable gaming device (such as Nintendo DS TM, PlayStation Portable TM, Gameboy Advance TM, iPhone TM), it is laptop computer, PDA, portable Formula internet device, music player and data storage device, other handheld devices and such as wrist-watch, earphone, pendant, ear Machine etc., electronic device can also be other wearable devices (for example, such as electronic glasses, electronics clothes, electronics bracelet, electricity Subitem chain, electronics tatoo, the headset equipment (HMD) of electronic equipment or smartwatch).
Electronic device can also be that any one of multiple electronic equipments, multiple electronic equipments include but is not limited to honeycomb Phone, smart phone, other wireless telecom equipments, personal digital assistant, audio player, other media players, music note It records device, video recorder, camera, other medium recorders, radio, Medical Devices, vehicle transport instrument, calculator, may be programmed Remote controler, pager, laptop computer, desktop computer, printer, netbook computer, personal digital assistant (PDA), just Formula multimedia player (PMP), Motion Picture Experts Group (MPEG-1 or MPEG-2) audio layer 3 (MP3) player are taken, it is portable Medical Devices and digital camera and combinations thereof.
In some cases, electronic device can execute multiple functions and (for example, playing music, show video, store picture And send and receive call).If desired, electronic device can be such as cellular phone, media player, other hands The portable device of holding equipment, watch equipment, pendant equipment, receiver device or other compact portable equipment.
As shown in figure 11, electronic equipment 10 may include control circuit, which may include storage and processing electricity Road 30.The storage and processing circuit 30 may include memory, such as hard drive memory, nonvolatile memory (such as Flash memory or be used to form solid state drive other electronic programmable limit deletings memory etc.), volatile memory (such as Either statically or dynamically random access memory etc.) etc., the embodiment of the present application is with no restriction.Store and process the processing electricity in circuit 30 Road can be used for the operating of controlling electronic devices 10.The processing circuit can microprocessor based on one or more, microcontroller, Digital signal processor, baseband processor, power management unit, audio codec chip, specific integrated circuit, display driving Device integrated circuit etc. is realized.
Storage and processing circuit 30 can be used for running the software in electronic equipment 10, such as the Internet browser application program, Voice over internet protocol (Voice over Internet Protocol, VOIP) call application program, Email are answered With program, media play-back application, operation system function etc..These softwares can be used for executing some control operations, for example, Image Acquisition based on camera, the ambient light measurement based on ambient light sensor, the proximity sensor based on proximity sensor Measurement, the information display function that the positioning indicators such as status indicator lamp based on light emitting diode are realized are passed based on touching The touch event of sensor detects, function associated with information show on multiple (such as layering) displays, with execution nothing The associated operation of line communication function, operation associated with collecting and generating audio signal, presses with collection and treatment button Other functions etc. in the associated control operation of event data and electronic equipment 10, the embodiment of the present application is with no restriction.
Electronic equipment 10 can also include imput output circuit 42.Imput output circuit 42 can be used for keeping electronic equipment 10 real Existing data are output and input, i.e., permission electronic equipment 10 allows electronic equipment 10 by data from outer equipment receiving data and also From the output of electronic equipment 10 to external equipment.Imput output circuit 42 may further include sensor 32.Sensor 32 can be with Including ambient light sensor, the proximity sensor based on light and capacitor, touch sensor (for example, based on light touch sensor and/ Or capacitive touch sensors, wherein touch sensor can be a part of touching display screen, can also be used as a touch Sensor structure independently uses), acceleration transducer and other sensors etc..
Imput output circuit 42 can also include one or more displays, such as display 14.Display 14 can wrap Include liquid crystal display, organic light emitting diode display, electronic ink display, plasma display uses other display skills One or several kinds of combination in the display of art.Display 14 may include touch sensor array (that is, display 14 can be with It is touching display screen).Touch sensor can be by transparent touch sensor electrode (such as tin indium oxide (ITO) electrode) battle array The capacitive touch sensors formed are arranged, or can be the touch sensor formed using other touching techniques, such as sound wave Touch-control, pressure sensible touch, resistive touch, optical touch etc., the embodiment of the present application is with no restriction.
Electronic equipment 10 can also include audio component 36.Audio component 36 can be used for providing audio for electronic equipment 10 Output and input function.Audio component 36 in electronic equipment 10 may include loudspeaker, microphone, buzzer, tone generation Device and other components for being used to generate and detect sound.
Telecommunication circuit 38 can be used for providing the ability with external device communication for electronic equipment 10.Telecommunication circuit 38 can be with Radio communication circuit including analog- and digital- input/output interface circuit, and based on radiofrequency signal and/or optical signal.Communication electricity Radio communication circuit in road 38 may include radio-frequency transceiver circuitry, power amplifier circuit, low-noise amplifier, switch, Filter and antenna.For example, the radio communication circuit in telecommunication circuit 38 may include for close by transmitting and reception Couple electromagnetic signals support the circuit of near-field communication (Near Field Communication, NFC).For example, communication electricity Road 38 may include near-field communication aerial and near-field communication transceiver.Telecommunication circuit 38 can also include cellular telephone transceiver and Antenna, wireless lan transceiver circuit and antenna etc..
Electronic equipment 10 can further include battery, power management circuitry and other input-output units 40.Input Output unit 40 may include button, control stick, click wheel, scroll wheel, touch tablet, keypad, keyboard, camera, shine two Pole pipe and other positioning indicators etc..
User can input a command for the operation of controlling electronic devices 10 by imput output circuit 42, and can be used The output data of imput output circuit 42 receives status information and other outputs from electronic equipment 10 to realize.
Figure 12 is please referred to, for the structural schematic diagram for the apparatus control system that one embodiment of the application provides.As shown in figure 12, The system includes: electronic device 60 and signal pickup assembly 70.Wherein, electronic device 60 for example may is that mobile phone, plate electricity Brain, intelligent wearable device, smart camera etc. can carry out the mobile terminal of data processing on the move, alternatively, smart television, platform Non- other computer installations that can carry out data processing on the move such as formula computer, for ease of understanding, Figure 12 is with mobile terminal For.Electronic device 60 and signal pickup assembly 70 can pass through WI-FI (Wireless Fidelity), bluetooth, NFC (Near Field Communication, near-field communication) etc. wireless channels carry out data interaction, alternatively, can also pass through data line carry out data friendship Mutually.
As shown in figure 13, signal pickup assembly 70 includes: collector 71, microprocessing unit (Microcontroller Unit, MCU) 72, data transmission unit 73 and fixing belt 74.Optionally, collector 71 includes: acquiring biological electric signals sensing Device, high-precision amplifying, frequency domain filter and digital analog converter.Data transmission unit 73 is wireless transport module, alternatively, USB (Universal Serial Bus, universal serial bus) module.
Collector 71 is used to acquire the bioelectrical signals of user, can be, but not limited to include: eye electricity, myoelectricity, electrocardio and Brain electricity etc..Fixing belt 74 is used to signal pickup assembly 70 being fixed on the position that human body needs to carry out signal acquisition.Data transmission Unit 73 is used to bioelectrical signals being transferred to electronic device 60.
Microprocessing unit 72, at least one bioelectrical signals of the user to be collected for being sent according to electronic device 60 Information, control collector 71 acquire at least one bioelectrical signals, and by the electric signal of acquisition through pretreatment after, Electronic device 60 is sent to by data transmission unit 93.Wherein pretreatment can be, but not limited to include: voltage amplification, frequency domain, Airspace filter and digital-to-analogue conversion etc..Specific preprocessing process can refer in above-mentioned embodiment illustrated in fig. 4 step S204 to step Associated description in S206, details are not described herein again.
The structure of electronic device 60 specifically refers to embodiment illustrated in fig. 10, and details are not described herein again.Electronic device 60, is used for According to current application scenarios, determines the information and be sent to signal pickup assembly 70;And from by pretreated life Characteristic is extracted in object electric signal, the characteristic of extraction is inputted into classifier, to identify the intention of the user, by the classification The data of device output are converted to corresponding apparatus control instruction, and execute the apparatus control and instruct corresponding operation.
Further, this system can be applied to unlock, specifically, when apparatus control instruction is close for triggering unlock When code setting operation, electronic device 60 is also used to export the prompt information of the target intention for unlock, and according to the user's Selection operation sends any two kinds in eye electricity, brain electricity, electrocardio and the flesh point of the user to be collected to signal pickup assembly 70 First description information of the first bioelectrical signals.
Microprocessing unit 72 is also used to control collector 71 according to first description information, acquires this any two kind first Bioelectrical signals are simultaneously pre-processed, and will be sent to electricity by data transmission unit 93 by pretreated first bioelectrical signals Sub-device 60.
Electronic device 60 is also used to from this by extracting fisrt feature data in pretreated first bioelectrical signals and protecting It deposits.
When the current application scenarios be unlock scene, and, when unlock task is triggered, electronic device 60, be also used to Signal pickup assembly 70 send the second bioelectrical signals the second description information, the type of second bioelectrical signals and this first Bioelectrical signals are identical.
Microprocessing unit 72 is also used to control collector 71 according to second description information, acquires the second biological telecommunications Number and pre-processed, the second pretreated bioelectrical signals are sent to electronic device 60 by data transmission unit 93.
Electronic device 60 is also used to extract second feature data from second bioelectrical signals, and by the second feature Data are matched with the fisrt feature data, are preset when the matching degree of the second feature data and the fisrt feature data is greater than When matching degree, unlock operation is executed.
It should be understood that user is for the first time in use, need to save the bioelectrical signals template of user.With smart phone For, specifically, the consciousness that smart phone onscreen cue user carries out a period of time is appointed after user wears signal pickup assembly Business (that is, target intention) induces special bioelectrical signals, and according to the customized selection of user, Tasks include but unlimited In including: the consciousness imagination, consciousness blink, consciousness facial expression, at least two in the consciousness operation such as heartbeat.Meanwhile intelligent hand Machine command signal acquisition device is acquired at least two bioelectrical signals that user selectes, and signal pickup assembly passes through biology Electrical signal collection sensor acquires the bioelectrical signals (analog signal) of user, then passes through the bioelectrical signals of acquisition high-precision It spends amplifier and carries out voltage amplification, amplified voltage passes through the noise that frequency domain, airspace filter improve signal with filtering clutter again Than then, analog signal is being transferred to smart phone after digital-to-analogue conversion is at digital signal, then through wireless transport module. The signal characteristic that smart phone extracts various dimensions from the bioelectrical signals that signal pickup assembly is sent carries out template preservation.When After second of user is worn signal pickup assembly, this same Tasks can induce same biology with first for progress The template of electric signal, various dimensions feature and first time that signal extracts after signal processing matches, and similarity reaches It is considered same user after some threshold value and unlocks mobile phone.
Further, which further includes server, and the server is for constructing classifier and carrying out to the classifier Optimization training and update.
Specifically, classifier can be obtained by the method for server on-line study, and optimize training.Electronic device 60 The acquisition of command signal acquisition device 70 is intended to corresponding at least one raw as the difference of user under the different application scene of sample Object electric signal, and at least one bioelectrical signals of acquisition are sent to server.Server is from least one electronic device 60 Characteristic is extracted at least one bioelectrical signals of transmission, the characteristic input classifier of extraction is carried out having supervision Classification, and if judge whether nicety of grading reaches preset threshold value nicety of grading and reach threshold value, it is concurrent to export optimum classifier Control device is given, to be added to the characteristic of extraction if nicety of grading is not up to threshold value for user's intention assessment In sample database, and update classifier.
Optionally, electronic device 60 obtains user's input when the intention of operation and user that electronic device 60 executes is not inconsistent Feedback information, and feedback information is sent to server, server updates classifier according to feedback information, and after updating Classifier be sent to electronic device 60, be used for user's intention assessment.It should be understood that electronic device 60 provides letter for user Feedback interface is ceased, by the information feedback interface, when the operation and user that electronic device 60 executes are intended to not be inconsistent, user can will Feedback information input electronic device 60.Wherein feedback information can be, but not limited to include: the true intention of user or the meaning of user Scheme corresponding true operation.
Optionally, the building, optimization training and update of above-mentioned classifier can also be completed by electronic device 60.
In the present embodiment, by according to current application scenarios, at least one to match with current application scenarios Bioelectrical signals are acquired, and extract characteristic from least one bioelectrical signals of acquisition, then pass through classifier The intention of user is identified according to the characteristic of extraction and is converted into corresponding apparatus control instruction, to realize to electronics The control of device, and realizing the human-computer interaction based on the fusion of multi-mode bioelectrical signals simultaneously, it may make intention assessment phase It is more targeted for current application scenarios.Further, by above-mentioned apparatus control system in unlock when, due to It can be realized through bioelectrical signals quick release electronic device, process can accomplish not depending on both hands completely, when unlock Tasks content can not also be got a glimpse of by other people, therefore safety with higher.
In several embodiments provided herein, it should be understood that disclosed device and method can pass through it Its mode is realized.For example, the apparatus embodiments described above are merely exemplary, for example, the division of the module, only Only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple module or components can be tied Closing or be desirably integrated into another system or some characteristics can ignore, or not execute.Another point, it is shown or beg for The mutual coupling, direct-coupling or communication connection of opinion can be through some interfaces, the INDIRECT COUPLING of device or module Or communication connection, it can be electrical property, mechanical or other forms.
The module as illustrated by the separation member may or may not be physically separated, aobvious as module The component shown may or may not be physical module, it can and it is in one place, or may be distributed over multiple On network module.Some or all of the modules therein can be selected to realize the mesh of this embodiment scheme according to the actual needs 's.
It, can also be in addition, can integrate in a processing module in each functional module in each embodiment of the application It is that modules physically exist alone, can also be integrated in two or more modules in a module.Above-mentioned integrated mould Block both can take the form of hardware realization, can also be realized in the form of software function module.
If the integrated module is realized in the form of software function module and sells or use as independent product When, it can store in a computer readable storage medium.Based on this understanding, the technical solution of the application is substantially The all or part of the part that contributes to existing technology or the technical solution can be in the form of software products in other words It embodies, which is stored in a readable storage medium storing program for executing, including some instructions are used so that a meter It calculates machine equipment (can be personal computer, server or the network equipment etc.) and executes each embodiment the method for the application All or part of the steps.And readable storage medium storing program for executing above-mentioned includes: USB flash disk, mobile hard disk, ROM, RAM, magnetic or disk etc. The various media that can store program code.
It should be noted that for the various method embodiments described above, describing for simplicity, therefore, it is stated as a series of Combination of actions, but those skilled in the art should understand that, the application is not limited by the described action sequence because According to the application, certain steps can use other sequences or carry out simultaneously.Secondly, those skilled in the art should also know It knows, the embodiments described in the specification are all preferred embodiments, and related actions and modules might not all be this Shen It please be necessary.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, there is no the portion being described in detail in some embodiment Point, it may refer to the associated description of other embodiments.
The above are to apparatus control method provided herein, system, electronic device and computer readable storage medium Description, for those skilled in the art, according to the embodiment of the present application thought, in specific embodiments and applications There will be changes, and to sum up, the contents of this specification should not be construed as limiting the present application.

Claims (16)

1. a kind of apparatus control method is applied to electronic device, which is characterized in that the described method includes:
According to current application scenarios, the type of the bioelectrical signals of user to be collected is determined;
By acquiring biological electric signals device, determining at least one bioelectrical signals are acquired, and from least the one of acquisition Characteristic is extracted in kind bioelectrical signals;
The characteristic of extraction is inputted into classifier, to identify the intention of the user;
The data that the classifier exports are converted into corresponding apparatus control instruction, and executes the apparatus control instruction and corresponds to Operation.
2. the method as described in claim 1, which is characterized in that the method also includes:
It acquires and is intended to corresponding at least one bioelectrical signals as the difference of the user under the different application scene of sample;
Characteristic is extracted from least one bioelectrical signals of acquisition;
The characteristic of extraction is inputted into the classifier and carries out the classification for having supervision, and judges whether nicety of grading reaches default Threshold value;
If the nicety of grading reaches the threshold value, optimum classifier is exported, to be used for user's intention assessment;
If the nicety of grading is not up to the threshold value, the characteristic of extraction is added in sample database, and is updated The classifier.
3. method according to claim 2, feature exists, and extracts feature at least one bioelectrical signals from acquisition Data specifically include:
Voltage amplification is carried out by least one bioelectrical signals of the high-precision amplifying to acquisition;
Frequency domain filtering is carried out to the bioelectrical signals after voltage amplification;
Airspace filter is carried out to the bioelectrical signals after frequency domain filtering;
Whether the intensity of the bioelectrical signals after assessment airspace filter reaches preset strength;
If the not up to described preset strength, the bioelectrical signals that the intensity is less than the preset strength are re-started and are adopted Collection;
If reaching the preset strength, the characteristic is extracted from the bioelectrical signals after airspace filter.
4. method as claimed in claim 3, which is characterized in that the bioelectrical signals to after voltage amplification carry out frequency domain filter Wave specifically includes:
The man-made noise in the bioelectrical signals after the voltage amplification is eliminated by trapper;
The bioelectrical signals after eliminating man-made noise are filtered by bandpass filter, the bandpass filter is with line Property phase limited long impulse response filter, and the frequency of the bandpass filter and the bioelectrical signals to be filtered is special Sign matches.
5. method as claimed in claim 3, which is characterized in that the bioelectrical signals to after frequency domain filtering carry out airspace filter Wave specifically includes:
Using the instantaneous signal mean value of all leads as reference signal, airspace is carried out to the bioelectrical signals after the frequency domain filtering Filtering, wherein the formula used are as follows:
Wherein,For the signal after airspace filter, XiFor original signal before airspace filter.
6. the method as described in claim 1, which is characterized in that the method also includes:
Obtain the feedback information that the user inputs when the operation and the intention of the user are not inconsistent;
According to the feedback information, the classifier is updated.
7. method according to any one of claims 1 to 6, which is characterized in that when the apparatus control is instructed for touching It is described to execute the corresponding operation of the apparatus control instruction when sending out unlocking pin setting operation, it specifically includes:
Prompt information of the output for the target intention of unlock, and by the acquiring biological electric signals device, according to the user Selection operation, acquire any two kind of first bioelectrical signals in the eye electricity, brain electricity, electrocardio and flesh point of the user;
Fisrt feature data are extracted from first bioelectrical signals, and are stored in the electronic device;
When the current application scenarios are unlock scene, the method also includes:
When unlock task is triggered, by the acquiring biological electric signals device, the second bioelectrical signals of the user are acquired, The type of second bioelectrical signals is identical as first bioelectrical signals;
Second feature data are extracted from second bioelectrical signals, and when the second feature data and the fisrt feature When the matching degree of data is spent greater than preset matching, unlock operation is executed.
8. a kind of apparatus control method, which is characterized in that the described method includes:
Controlled device determines the type of the bioelectrical signals of user to be collected according to current application scenarios, and will be determining Information is sent to control device;
The control device is by acquiring biological electric signals device, according to the information of the determination, at least one bioelectricity Signal is acquired, and extracts characteristic from least one bioelectrical signals of acquisition, by the characteristic input point of extraction The data that the classifier exports are converted to corresponding apparatus control and instructed by class device to identify the intention of the user, and will The apparatus control instruction is sent to the controlled device;
The controlled device is instructed in response to the apparatus control, executes corresponding operation.
9. method according to claim 8, which is characterized in that the method also includes:
The controlled device instructs the control device by acquiring biological electric signals device, acquires the different application field as sample The difference of the user is intended to corresponding at least one bioelectrical signals under scape, and at least one bioelectrical signals of acquisition are sent out Give server;
The server extracts characteristic from least one bioelectrical signals of the acquisition, and the characteristic of extraction is defeated Enter the classifier and carry out the classification for having supervision, and if judging whether nicety of grading reaches the preset threshold value nicety of grading and reach It to the threshold value, then exports optimum classifier and is sent to the control device, to be used for user's intention assessment, if the classification Precision is not up to the threshold value, then the characteristic of extraction is added in sample database, and updates the classifier.
10. method as claimed in claim 9, which is characterized in that the method also includes:
The controlled device obtains the feedback information that the user inputs when the operation and the intention of the user are not inconsistent, and The feedback information is sent to the server;
The server updates the classifier according to the feedback information, and updated classifier is sent to the control Device processed.
11. method according to claim 8, which is characterized in that set when the apparatus control is instructed for triggering unlocking pin When setting operation, the controlled device is instructed in response to the apparatus control, is executed corresponding operation, is specifically included:
Prompt information of the controlled device output for the target intention of unlock, and according to the selection operation of the user, to The control device sends any two kind of first bioelectricity in eye electricity, brain electricity, electrocardio and the flesh point of the user to be collected First description information of signal;
The control device passes through the acquiring biological electric signals device, acquisition described any two according to first description information Kind of the first bioelectrical signals, extract fisrt feature data from first bioelectrical signals, and by the fisrt feature data The controlled device is sent to be saved;
When the current application scenarios are unlock scene, the method also includes:
When unlock task is triggered, the controlled device sends the second description of the second bioelectrical signals to the control device Information, the type of second bioelectrical signals are identical as first bioelectrical signals;
It is raw to acquire described second according to second description information by the acquiring biological electric signals device for the control device Object electric signal, extracts second feature data from second bioelectrical signals, and by the second feature data and described the One characteristic is matched, when the matching degree of the second feature data and the fisrt feature data is greater than preset matching degree When, Xiang Suoshu controlled device sends unlock instruction;
The controlled device executes unlock operation in response to the unlock instruction.
12. a kind of electronic device, which is characterized in that described device includes:
Determining module, for determining the type of the bioelectrical signals of user to be collected according to current application scenarios;
Acquisition module, for being acquired to determining at least one bioelectrical signals by acquiring biological electric signals device, and from Characteristic is extracted at least one bioelectrical signals of acquisition;
Identification module, the characteristic for that will extract inputs classifier, to identify the intention of user;
Conversion module, the data for exporting the classifier are converted to corresponding apparatus control instruction;
Execution module instructs corresponding operation for executing the apparatus control.
13. a kind of electronic device, there is touch screen, the electronic device includes: memory, processor and is stored in the storage On device and the computer program that can run on the processor, which is characterized in that the processor executes the computer journey When sequence, the apparatus control method as described in any one in claim 1 to 7 is realized.
14. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program When being executed by processor, the apparatus control method as described in any one in claim 1 to 7 is realized.
15. a kind of apparatus control system, which is characterized in that the system comprises: electronic device and signal pickup assembly;
The signal pickup assembly includes: collector, microprocessing unit, data transmission unit and fixing belt;
The microprocessing unit, at least one bioelectrical signals of the user to be collected for being sent according to the electronic device Information, control collector acquisition at least one bioelectrical signals, and by the electric signal of acquisition by pre- place After reason, the electronic device is sent to by the data transmission unit;
The electronic device, for determining the information and being sent to the signal acquisition according to current application scenarios Device;And from by extracting characteristic in pretreated bioelectrical signals, the characteristic of extraction is inputted into classifier, with The data that the classifier exports are converted to corresponding apparatus control and instructed by the intention for identifying the user, and described in execution Apparatus control instructs corresponding operation.
16. system as claimed in claim 15, which is characterized in that
When apparatus control instruction is for triggering unlocking pin setting operation, the electronic device is also used to output and is used for The prompt information of the target intention of unlock, and according to the selection operation of the user, Xiang Suoshu signal pickup assembly is sent wait adopt The eye of the user of collection is electric, brain is electric, electrocardio and any two kind of first bioelectrical signals in flesh point the first description information;
The microprocessing unit is also used to control the collector according to first description information, acquires described any two kinds First bioelectrical signals are simultaneously pre-processed, and will be sent out by pretreated first bioelectrical signals by the data transmission unit Give the electronic device;
The electronic device is also used to from described by extracting fisrt feature data in pretreated first bioelectrical signals and protecting It deposits;
When the current application scenarios be unlock scene, and, when unlock task is triggered, the electronic device, be also used to The signal pickup assembly sends the second description information of the second bioelectrical signals, the type of second bioelectrical signals and institute It is identical to state the first bioelectrical signals;
The microprocessing unit is also used to control the collector according to second description information, acquires second biology Electric signal is simultaneously pre-processed, and the second pretreated bioelectrical signals are sent to the electricity by the data transmission unit Sub-device;
The electronic device is also used to extract second feature data from second bioelectrical signals, and special by described second Sign data are matched with the fisrt feature data, when the matching degree of the second feature data and the fisrt feature data When spending greater than preset matching, unlock operation is executed.
CN201910156093.XA 2019-03-01 2019-03-01 Apparatus control method, system, electronic device and computer readable storage medium Pending CN110221684A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910156093.XA CN110221684A (en) 2019-03-01 2019-03-01 Apparatus control method, system, electronic device and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910156093.XA CN110221684A (en) 2019-03-01 2019-03-01 Apparatus control method, system, electronic device and computer readable storage medium

Publications (1)

Publication Number Publication Date
CN110221684A true CN110221684A (en) 2019-09-10

Family

ID=67822377

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910156093.XA Pending CN110221684A (en) 2019-03-01 2019-03-01 Apparatus control method, system, electronic device and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN110221684A (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110879552A (en) * 2019-11-29 2020-03-13 联想(北京)有限公司 Control method and control system
CN111144363A (en) * 2019-12-31 2020-05-12 北京理工大学 Behavior identification method under first view angle based on scene and object information
CN112075938A (en) * 2020-06-03 2020-12-15 深圳市润谊泰益科技有限责任公司 Distributed data acquisition system, method and storage medium
CN112163210A (en) * 2020-10-09 2021-01-01 Oppo广东移动通信有限公司 Unlocking control method, terminal encryption method, device, terminal and storage medium
CN114153266A (en) * 2021-11-12 2022-03-08 苏州维伟思医疗科技有限公司 Data time synchronization method and device and computer readable storage medium
CN114783585A (en) * 2022-06-17 2022-07-22 苏州景昱医疗器械有限公司 Program control device, program control system, electronic device, and computer-readable storage medium
CN115314080A (en) * 2022-09-29 2022-11-08 北京脑陆科技有限公司 Data transmission method, device, system, computer equipment and storage medium

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102306303A (en) * 2011-09-16 2012-01-04 北京工业大学 Electroencephalography signal characteristic extraction method based on small training samples
CN103699226A (en) * 2013-12-18 2014-04-02 天津大学 Tri-modal serial brain-computer interface method based on multi-information fusion
CN104586387A (en) * 2015-01-19 2015-05-06 秦皇岛市惠斯安普医学系统有限公司 Method for extracting and fusing time, frequency and space domain multi-parameter electroencephalogram characters
CN104615250A (en) * 2015-02-11 2015-05-13 中国兵器科学研究院 Method of quickly controlling two-dimensional cursor based on brain-computer interface
CN107212883A (en) * 2017-05-24 2017-09-29 天津理工大学 A kind of mechanical arm writing device and control method based on brain electric control
CN107411935A (en) * 2017-07-18 2017-12-01 西安交通大学 A kind of multi-mode brain-computer interface control method for software manipulators in rehabilitation
CN207234755U (en) * 2017-10-12 2018-04-13 北京翼石科技有限公司 A kind of sender unit for animal mood brain electricity analytical
CN108319928A (en) * 2018-02-28 2018-07-24 天津大学 A kind of deep learning model and application based on Multi-objective PSO optimization
CN108875344A (en) * 2018-06-25 2018-11-23 Oppo(重庆)智能科技有限公司 A kind of electronic equipment control method, electronic appliance controlling device and electronic equipment

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102306303A (en) * 2011-09-16 2012-01-04 北京工业大学 Electroencephalography signal characteristic extraction method based on small training samples
CN103699226A (en) * 2013-12-18 2014-04-02 天津大学 Tri-modal serial brain-computer interface method based on multi-information fusion
CN104586387A (en) * 2015-01-19 2015-05-06 秦皇岛市惠斯安普医学系统有限公司 Method for extracting and fusing time, frequency and space domain multi-parameter electroencephalogram characters
CN104615250A (en) * 2015-02-11 2015-05-13 中国兵器科学研究院 Method of quickly controlling two-dimensional cursor based on brain-computer interface
CN107212883A (en) * 2017-05-24 2017-09-29 天津理工大学 A kind of mechanical arm writing device and control method based on brain electric control
CN107411935A (en) * 2017-07-18 2017-12-01 西安交通大学 A kind of multi-mode brain-computer interface control method for software manipulators in rehabilitation
CN207234755U (en) * 2017-10-12 2018-04-13 北京翼石科技有限公司 A kind of sender unit for animal mood brain electricity analytical
CN108319928A (en) * 2018-02-28 2018-07-24 天津大学 A kind of deep learning model and application based on Multi-objective PSO optimization
CN108875344A (en) * 2018-06-25 2018-11-23 Oppo(重庆)智能科技有限公司 A kind of electronic equipment control method, electronic appliance controlling device and electronic equipment

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
徐鲁强等: ""脑电Laplacian空域滤波的改进算法"", 《计算机应用研究》 *

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110879552A (en) * 2019-11-29 2020-03-13 联想(北京)有限公司 Control method and control system
CN110879552B (en) * 2019-11-29 2021-08-17 联想(北京)有限公司 Control method and control system
CN111144363A (en) * 2019-12-31 2020-05-12 北京理工大学 Behavior identification method under first view angle based on scene and object information
CN111144363B (en) * 2019-12-31 2023-02-28 北京理工大学 Behavior identification method under first view angle based on scene and object information
CN112075938A (en) * 2020-06-03 2020-12-15 深圳市润谊泰益科技有限责任公司 Distributed data acquisition system, method and storage medium
CN112075938B (en) * 2020-06-03 2024-01-05 深圳市润谊泰益科技有限责任公司 Distributed data acquisition system, method and storage medium
CN112163210A (en) * 2020-10-09 2021-01-01 Oppo广东移动通信有限公司 Unlocking control method, terminal encryption method, device, terminal and storage medium
CN114153266A (en) * 2021-11-12 2022-03-08 苏州维伟思医疗科技有限公司 Data time synchronization method and device and computer readable storage medium
CN114153266B (en) * 2021-11-12 2023-10-27 苏州维伟思医疗科技有限公司 Data time synchronization method and device and computer readable storage medium
CN114783585A (en) * 2022-06-17 2022-07-22 苏州景昱医疗器械有限公司 Program control device, program control system, electronic device, and computer-readable storage medium
CN115314080A (en) * 2022-09-29 2022-11-08 北京脑陆科技有限公司 Data transmission method, device, system, computer equipment and storage medium

Similar Documents

Publication Publication Date Title
CN110221684A (en) Apparatus control method, system, electronic device and computer readable storage medium
KR102302640B1 (en) Detecting and using body tissue electrical signals
Song et al. Design of a flexible wearable smart sEMG recorder integrated gradient boosting decision tree based hand gesture recognition
Bright et al. EEG-based brain controlled prosthetic arm
EP3389474B1 (en) Drowsiness onset detection
Lin et al. EEG-based brain-computer interface for smart living environmental auto-adjustment
WO2016073802A1 (en) Modular wearable device for conveying affective state
CN107106063A (en) Intelligent audio headset system
CN107145239A (en) A kind of intelligence system and its control method that sensor is read based on brain
CN108108603A (en) Login method and device and electronic equipment
WO2020006271A1 (en) Wearable system for brain health monitoring and seizure detection and prediction
CN108874130A (en) Control method for playing back and Related product
CN108261274A (en) A kind of two-way deformed limb interface system controlled for prosthetic hand with perceiving
Kumar et al. Neuro-phone: An assistive framework to operate Smartphone using EEG signals
CN103294192A (en) LED lamp switch control device and control method thereof based on motor imagery
Jagadish et al. A novel system architecture for brain controlled IoT enabled environments
Dai et al. [Retracted] Application Analysis of Wearable Technology and Equipment Based on Artificial Intelligence in Volleyball
CN105487661A (en) Terminal control method and device
Liao et al. A systematic review of global research on natural user interface for smart home system
CN108108974A (en) Method of payment and device and electronic equipment
Yang et al. Survey on emotion sensing using mobile devices
CN206400210U (en) The intelligent AR glasses devices of brain wave control
Anupama et al. Real-time EEG based object recognition system using Brain Computer Interface
Suk et al. A probabilistic approach to spatio-spectral filters optimization in Brain-Computer Interface
CN207164699U (en) A kind of intelligence system that sensor is read based on brain

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20190910

RJ01 Rejection of invention patent application after publication