WO2013063986A1

WO2013063986A1 - Remote control method, device and system based on brain waves

Info

Publication number: WO2013063986A1
Application number: PCT/CN2012/081529
Authority: WO
Inventors: 方华; 程志超
Original assignee: 深圳Tcl新技术有限公司
Priority date: 2011-11-03
Filing date: 2012-09-18
Publication date: 2013-05-10
Also published as: CN102426481B; CN102426481A

Abstract

Disclosed are a remote control method, device and system based on brain waves. The method includes the following steps: receiving a brain wave signal sent by a brain wave detection device; matching the brain wave signal with a stored brain wave standard signal; and if the matching is successful, then generating a control signal for controlling an external device according to the matched brain wave standard signal. In the present invention, a brain wave detection device collects the brain wave signal of a user in various states and matches same with a brain wave standard signal so as to produce a control signal for controlling an external device, so that the external device can be remotely controlled through brain waves, and an operation method which can be realized is proposed for use by a user and the future producibility of brain wave products.

Description

Method and device system for remote control based on brain wave

The present invention relates to the field of communications, and in particular, to a method, apparatus and system for remote control based on brain waves. Background technique

Bioelectricity is one of the basic characteristics of life activities. The bioelectrical signal generated by human beings in thinking activities is the electroencephalogram (EGG), which is mainly caused by the synaptic potential synchronization of a large number of neurons in the cortex. What is formed is the result of the joint activities of many neurons.

Our brains are constantly generating brain waves. Frequency variation of these spontaneous bioelectrical signals

- between 30Hz, as shown in Table 1

The plasticity of the brain is that new connections can be made between the nerves, and old connections are lost. Simply put, people can connect things because when nerves move at the same time, they are linked together, and vice versa. When a person»device requires a specific brainwave, it unconsciously strengthens the connections between the neural groups associated with beneficial brain states.

Therefore, the brain wave signal is measured by a sensor placed at the head, and the external device is controlled by brain-brain interaction according to the brain wave signal - Brain Computer Interfece (BCI) is established between the brain and an external device. A direct communication and control channel.

At present, the control of the device is still carried out by the remote control device of the button, and the brain wave signal is used. Control ^ I""" is the target invention content pursued by human fi

The main object of the present invention is to provide a method for remote control based on brain waves, which aims to realize remote control of external devices by brain wave signals.

The present invention provides a method for remote control based on brain waves, comprising the steps of: receiving an electroencephalogram signal transmitted by an electroencephalogram detecting device;

Matching the brain wave signal with a stored brainwave standard signal;

If the matching is successful, a control signal for controlling the external device is generated based on the matched brainwave standard signal.

Preferably, the stored brainwave standard signal is an electroencephalogram signal in which the user is in a certain control state and has a correspondence relationship with the remote control function.

Preferably, the brain wave signal of the user in various states is obtained by: setting a number of times of brain wave signal acquisition;

The brain wave signal of the user in a certain control state is collected, a set of data is obtained, and the collecting action is repeatedly performed until the number of times of acquisition is reached;

Calculate all collected data to obtain the average value and error value;

The brain wave standard signal is set to a range value centered on the average value and the error value is a positive or negative difference value. Preferably, the collecting the brain wave signal of the user in a certain control state, and obtaining the data of the group includes:

Set the value range to 0.1 -50Hz;

According to the step size of 0.1Hz, a set of data is formed by collecting 500 points each time.

Preferably, the number of times the brain wave signal is collected is 10 times.

Preferably, the step of receiving the brain wave signal sent by the brain wave detecting device further comprises: collecting the brain wave signal of the user at least twice according to the collecting instruction;

Determining whether the acquired brain wave signal is within a preset error range;

If yes, send a brain wave signal;

If not, a failure message is returned, and the user's brainwave signal is re-acquired. The invention also provides a device for remote control based on brain waves, comprising: a brain wave signal receiving module, configured to receive a brain wave signal sent by the brain wave detecting device;

a brain wave signal matching module for matching the brain wave signal with the stored brain wave standard signal;

And a control signal generating module, configured to generate a control signal for controlling the external device according to the matched brain wave standard signal when the brain wave signal is successfully matched with the stored brain wave standard signal.

Preferably, the apparatus for remotely controlling based on brain waves further includes an electroencephalogram signal acquiring module, configured to generate an electroencephalogram signal corresponding to a remote control function by the user of the electroencephalogram detecting device in a certain control state, and It is processed and stored as the brainwave standard signal.

Preferably, the brain wave signal acquisition module specifically includes:

The acquiring data acquiring unit is configured to set the number of times of brain wave signal acquisition; collecting, by the brain wave detecting device, the brain wave signal of the user in a certain control state, obtaining a set of data, and repeatedly performing the collecting action until the number of times of collecting is reached ;

The data processing unit is configured to calculate the average value and the error value for all the collected numbers, and set the brain wave signal of the user in the state to a range value with the average value as the center and the error value as the positive and negative difference values.

Preferably, the number of times the brain wave signal is set in the acquisition data acquisition unit is 10 times. The present invention also provides a system for remotely controlling based on brain waves, including detecting and outputting brain wave signals. The brain wave detecting device control processing device, wherein the remote control processing device comprises: a brain wave signal receiving module, configured to receive an electroencephalogram signal sent by the brain wave detecting device;

a brain wave signal matching module, configured to match the brain wave signal with the stored brain wave standard signal;

Preferably, the remote control processing device further includes an electroencephalogram signal receiving module, configured to receive an electroencephalogram signal sent by the brain wave detecting device;

The control signal generating module is configured to generate a control signal for controlling the external device according to the matched brain wave standard signal when the brain wave signal is successfully matched with the stored brain wave standard signal. Preferably, the device based on the brain wave remote control further comprises an electroencephalogram signal acquisition module, which is used for the brain corresponding to the remote control function control function by the user of the brain wave detecting device under a certain control state. Wave signal, and it is stored, it is stored as the brainwave standard signal.

Preferably, the brain wave signal acquisition module specifically includes:

Preferably, the brain wave detecting device is used to:

Set the value range to 0.1-50HZ; take the point according to the step size of 0.1Hz, then collect 500 points each time to form a set of data, and repeat the acquisition action until the number of acquisitions is reached.

Preferably, the number of times the brain wave signal is set in the acquisition data acquisition unit is 10 times. Preferably, the brain wave detection device is specifically configured to:

According to the acquisition instruction, the user's brain wave signal is collected at least twice; whether the collected brain wave signal is within a preset error range; if yes, the brain wave signal is sent to the control device; if not, Then the failure information is returned, and the brain wave signal of the user is collected again. The invention collects brain wave signals of the user in various states by the brain wave detecting device, and matches them with the brain wave standard signals to generate a control signal for controlling the external device, so that the remote control external device is realized through the brain wave, in the user The use and future productization of brainwave products propose an achievable method of production.

1 is a schematic diagram of an embodiment of a method for remotely controlling a brain wave according to the present invention; FIG. 2 is a schematic diagram of a method for acquiring an electroencephalogram signal of a user in various states according to an embodiment of the method for remotely controlling a brain wave according to the present invention; ;

3 is a schematic flow chart of another embodiment of a method for remote control based on brain waves according to the present invention; FIG. 4 is a schematic structural view of an embodiment of a device for remote control based on brain waves according to the present invention; 5 is a schematic structural view of another embodiment of a device based on brain wave 3⁄4 remote control according to the present invention; FIG. 6 is a schematic diagram showing a structure of an embodiment based on a brain control system. The realization, functional features and advantages of the object of the present invention will be Further explanation will be made with reference to the drawings in conjunction with the embodiments. detailed description

The invention is further described in the following detailed description of the invention and the embodiments of the invention.

1 is a schematic flow chart of an embodiment of a method for remote control based on brain waves according to the present invention. Referring to Figure 1, the method includes the following steps:

Step S01, receiving an electroencephalogram signal sent by the brain wave detecting device;

The brain wave detecting device is placed on the user's brain, and the brain wave signal collecting sensing area is the brain prefrontal cortex area. When the user is in a certain state, it will generate brain wave signals, and the brain wave detecting device will sense the brain wave. Signal and send to an external device. The external device may be a wireless receiving terminal or a remote control device thereof, such as a mobile terminal, a television receiving terminal, or a remote control device thereof.

Step S02, the brain wave signal is matched with the stored brain wave standard signal; if the matching is successful, step S03 is performed; if the matching fails, the process returns to step S01;

The external device will pre-store the brain wave standard signal, and match the received brain wave signal with the brain wave standard signal. If the matching is successful, step S03 is performed. If the matching fails, the process returns to step S01 to re-receive the brain wave signal sent by the brain wave detecting device. If the received brain wave detecting device transmits too many brain wave signals and the external device cannot respond in time, the received brain wave signal can be stored in the external device.

The brain wave standard signal is a brain wave signal of the user in various states, and the state in which the user is in the brain wave standard signal forms a relationship with the remote control function. In this embodiment, eight states of the user and the remote controller are listed. Correspondence of control functions, as shown in ^2.

Remote control function corresponding to user status

can

Imagine the water droplets moving up in the center of the TV in a relaxed state.

Imagine the water drop in the center of the TV under the relaxed state Imagine the water droplets in the center of the electric machine moving to the left in the left relaxed state.

Imagine the TV in the loose state.

Confirm. Close the eyes for 3 seconds

Menu Concentrate on state of mind, imagine the center of the TV drops moving up

Home Concentrated Thought State Imagine TV Center Round Left

- Concentrated mind state imagination TV center round right hand

The user's status can also be flexibly set. For example, "Imagine the water drop in the center of the TV in an easy state" can set the range of movement and the speed JL of the movement; the time of closing the eyes in "Close the eyes for 3 seconds" can be set to 2 -10 seconds and so on.

Step S03: Generate a control signal for controlling the external device according to the matched brain wave standard signal. Assuming that the user is in a state of "imagining that the water droplets in the center of the television are moving upwards in a relaxed state", the brain wave detecting device collects the brain wave signal and transmits it to the external device, and the external device matches the brain wave signal with the brain wave standard signal. After that, an "up" remote control signal is generated to control the external device.

In the embodiment of the present invention, the brain wave detecting device collects the brain wave signals of the user in various states, and matches the brain wave standard signals to generate a control signal for controlling the external device, so that the remote control external device is realized by the brain wave. An achievable method of production is proposed in the user's use and in the future productization of brainwave products. Referring to FIG. 2, the brain wave signal of the user in various states is obtained by the following method: Step S21: setting the number of times of brain wave signal acquisition;

First, the number of acquisitions of the brain wave signal is set. This embodiment is set to 10 times.

Step S22: collecting brain wave signals of the user in a certain control state, obtaining a set of data, and repeatedly performing the collecting action until the number of times of acquisition is reached;

For example, in the state of "imagine the water drop in the center of the TV in an easy state", if the user is in this state, the brain wave detecting device will collect it. The collecting method can be set according to the specific situation. For example, the collection method used in this embodiment is as follows: Set the value interval to 0.1-50 Hz. According to the step size of 0.1 Hz, collect 500 sets of data each time, and collect 10 sets of data after 10 acquisitions. .

Step S23, calculating all the collected data to obtain an average value and an error value;

The 10 sets of data collected in step S22 are calculated to obtain an average value, and then according to the average value. A set of data with the smallest error and the average value are used for error calculation to obtain the error value.

For example, suppose = (J^ ₅ oo is the acquired data point matrix, where i = l,...,10 ; 7 = 1, - -,500; represents the number of collections, representing the first value point from small to large Obviously, · =(;^,^ ₂ ,..Ά ₅₀₀ ) indicates the data vector of each node collected in the third time. The standard reference for defining this state is as follows:

Xi =( _Ί , , · · , , ₅ . . ), where =丄

105^^, _ = 1," ',500;

Define the distance between the data points collected by the ί and the standard as follows:

== 11,, ··,,1100 ;;

It is not a generality to find out the distance between the sum of the standard and the standard value of the standard value, and it is not a generality, and it is not conceivable to set the first. . The data of the acquisition set is collected for the second time, namely:

Ii ₀₀ == aarrgg--mmiinn _{11≤≤ii≤≤1100}

Define the meaning of the first. . The error ratio of the error data of the data acquisition data of the second acquisition collection is 100% of the ratio of the upper and lower floating motion range of the brain brain wave under the user state state. ::

,, --丄丄∑∑ ⁵⁵ . .

EE == mmaaxx ₁ ^ _<i<500 —— **110000%%;; Step S24, setting the brain wave standard signal in which the user is in this state to the range centered on the average value and the error value is positive and negative value.

After obtaining the average value and the error value, the range of the brain wave signal in which the user is in this state is set to the average value of the error value.

Since the user may have many factors in the actual operation, for example: the concentration of thoughts, the speed of movement, the size of the water droplets imagined, the left-handed and right-handed circles of the imaginary circle in the concentrated state of thought, from small circles to large circles, or from large circles to small circles. and many more. Therefore, when obtaining the brain wave signal of the user in a certain state, it is necessary to consider the above factors and process the brain wave signal to calculate a similar value. Referring to FIG. 3, before step S01, the method further includes:

Step S31, according to the acquisition instruction, collecting the brain wave signal of the user at least twice;

According to the acquisition instruction, the user's brain wave signal is continuously acquired at least twice in a preset time interval.

After the brain wave detecting device is turned on, the brain wave detecting device takes 500 power signal intensity values between 0.1 and 50 Hz in steps of 0.1 Hz, and calculates the collected data by the following method: Let a = (a,, · · - _t a _m ) ^T be the power intensity value vector obtained according to the step length of 0.1 Hz during the brain wave acquisition process, where (1 ≤ « ≤ 500) is the power collected in the nth step. The signal strength value, the step value is expressed as h = Q. \(hz), then a _n = a _n (nh), α = {μ _γ (h), -■ ·, a ₅₀₀ (500Λ)) ^Γ ;

Let a _R = a _n (nh), (1 ≤ "≤ 500, h = 0. \{hz)) be the binary representation of the power signal strength value collected in step ,n, which is obtained during the brain wave acquisition process. The vector of the power intensity value binary representation is:

=^),·'·, ₀₀ (500 )) ^Γ ;

Step S32, determining whether the brain wave signal calculated by the above calculation is within a preset error range; if yes, executing step S33; otherwise, performing step S34;

It is judged whether the acquired brain wave signal is within the preset error range, and if so, it indicates that the brain wave signals acquired twice are the same, which is a valid signal; otherwise, it indicates that the brain wave signal is ineffective, and the brain wave signal is collected as an invalid brain wave signal.

Step S33, sending a brain wave signal;

If it is determined that the brain wave signal is a valid signal, the brain wave signal is transmitted.

Step S34: Returning the failure information, and re-collecting the brain wave signal of the user.

If it is determined that the brain wave signal is an invalid signal, the failure information is returned, and the user's brain wave signal is collected again. 4 is a schematic structural view of an embodiment of a device for remote control based on brain waves according to the present invention. Referring to FIG. 4, a device for remote control based on brain waves of the present invention includes:

The brain wave signal receiving module 110 is configured to receive the brain wave signal sent by the brain wave detecting device 2; the brain wave detecting device 2 is placed on the brain of the user, and the brain wave signal collecting sensing region is the brain prefrontal cortex region. The brain wave signal receiving module 10 receives the brain wave signal transmitted from the brain wave detecting device 2.

The brain wave signal matching module 120 is configured to match the brain wave signal with the stored brain wave standard signal;

The brain wave signal matching module 120 will pre-store the brain wave standard signal, and according to the received brain wave signal and the brain wave standard signal, if the matching is successful, the matched brain wave standard signal is sent to the control signal generating module 130; If the matching fails, the brain wave signal received by the brain wave detecting device 2 is re-accepted by the brain wave signal receiving module 110. If the brain wave detecting device 2 received by the brain wave signal receiving module 10 transmits too many brain wave signals and the brain wave signal matching module 120 cannot respond in time, it can receive the brain wave signal matching module 120. The brain wave number is stored on the brain wave signal receiving module 110, and waits for the processing of the brain wave nickname matching module 120.

The control signal generating module 130 is configured to, after the brain wave signal is successfully matched with the stored brain wave standard signal, generate a control signal for controlling the external device 3 according to the matched brain wave standard signal. The above-described apparatus 1 for remote control based on brain waves can be integrated in the external device 3.

The brainwave standard signal stored above is an electroencephalogram signal in which the user is in various states, and the state in which the user is in the electroencephalogram standard signal is associated with the remote control function. In the present embodiment, the correspondence between the eight states of the user and the remote control function is shown, as shown by ^2. Assuming that the user is in a state of "imagining that the water droplets in the center of the television are moved upwards in a relaxed state", the brain wave detecting device 2 collects the brain wave signal and transmits it to the external device. Then, the external device 3 matches the brain wave signal with the brain wave standard signal to generate an "upper" remote control signal, thereby implementing control of the external device. The embodiment of the present invention collects the user in various states by the brain wave detecting device 2. The brain wave signal is matched and matched with the brain wave standard signal to generate a control signal for controlling the external device, so that the remote control external device is realized by the brain wave, and the user's use and future productization of the brain wave product are proposed. A achievable method of production.

Referring to FIG. 5, the device further includes an electroencephalogram signal acquiring module 140, configured to acquire an electroencephalogram signal in which the user is in a certain control state and is in a corresponding relationship with the remote control function, and performs the brainwave signal acquisition module 140. Processing, storing it as the brainwave standard signal. The brainwave signal acquisition module 140 specifically includes:

The acquisition data acquisition unit 141 is configured to set the number of times of brain wave signal acquisition; collect the brain wave signal of the user in a certain state by the brain wave detecting device 2, obtain a set of data, and repeatedly perform the collection action until the collection is completed. Number of times

The acquisition data processing unit 142 is configured to calculate all the collected data to obtain an average value and an error value, and set the brain wave signal of the user in the state to a range value with the average value as the center and the error value as the positive and negative difference values.

Since the user may have many factors in the actual operation, for example: the concentration of thought, the speed of movement, the size of the imaginary water droplets, the left-handedness and the right-handedness of the imaginary 集中 in the concentrated state of mind, from small circles to large circles, or from large circles to small circles. Etc. Therefore, when the acquisition data processing unit 42 obtains the brain wave signal of the user in a certain state, it is necessary to consider the above factors and process the brain wave signal. The calculation is similar to that of the present invention. FIG. 6 is a schematic structural view of an embodiment of a system for remote control based on brain waves.

Referring to Figure 6, a system for remote control based on brain waves includes a remote control device 4 and a brain wave detecting device 2, wherein:

Brain wave detecting device 2 for detecting brain wave signals of the brain and transmitting them to the remote control device

4;

a remote control processing device 4 for processing and generating a remote control signal for controlling an external device according to the brain wave signal of the brain

The brain wave detecting device 2 is specifically configured to: collect the brain wave signal of the user at least twice according to the acquisition instruction; determine whether the collected brain wave signal is within a preset error range; if yes, send the brain wave signal; If not, the failure information is returned, and the brain wave signal of the user is re-acquired. The remote control device 4 is the same device as the device 1 for remote control based on brain waves in the above embodiment, with reference to FIGS. 4 and 5 This will not go into details. It should be noted here that the remote control device 4 can be disposed on a remote control device that controls an external device, or can be directly disposed on an external device.

In the embodiment of the present invention, the brain wave detecting device 2 collects the brain wave signals of the user in various states, and matches them with the brain wave standard signals to generate a control signal for controlling the external device, so that the remote control external device is realized by the brain wave. In the use of users and the future productization of brainwave products, an achievable method of production is proposed. The above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the patents. The equivalent structure or equivalent transformations made by the specification and the drawings of the present invention are directly or indirectly applied to other related technical fields. The same is included in the scope of patent protection of the present invention.

Claims

Rights request

A method for remotely controlling based on brain waves, comprising the steps of: receiving an electroencephalogram signal transmitted by an electroencephalogram detecting device;

Matching the brain wave signal with a stored brainwave standard signal;

2. The method according to claim 1, wherein the stored brainwave standard signal is an electroencephalogram signal in which the user is in a certain control state and forms a correspondence relationship with the remote control function.

3. The method according to claim 2, wherein the brain wave standard signal is obtained by the following method:

Set the number of brain wave signal acquisitions;

Calculate all collected data to obtain the average value and error value;

The brain wave standard signal is set to a range value centered on the average value and the error value is a positive or negative difference value.

4. The method according to claim 3, wherein the step of acquiring a brain wave signal of the user in a certain control state, and obtaining a set of data comprises:

Set the value range to 0.1 -50Hz;

5. The method according to claim 4, wherein the number of times the brain wave signal is collected is ten.

A method according to claim 3, wherein said step of receiving an electroencephalogram signal transmitted by the brain wave detecting means further comprises:

Collecting instructions, collecting the brain wave signal of the user at least twice; Determining whether the acquired brain wave signal is within the error range of the device;

If yes, send a brain wave signal;

If not, a failure message is returned, and the user's brainwave signal is re-acquired.

7. A device for remote control based on brain waves, characterized in that it comprises:

a brain wave signal receiving module, configured to receive a brain wave signal sent by the brain wave detecting device;

The device according to claim 7, further comprising an electroencephalogram signal acquisition module, configured to: through the brain wave detecting device, the user is in a certain control state and forms a corresponding relationship with the remote control function The wave signal is processed and stored as the brainwave standard signal.

9. The apparatus according to claim 8, wherein the brain wave signal acquisition module comprises:

The device according to claim 9, wherein the number of acquisitions of the brain wave signal set in the acquisition data acquisition unit is 10 times.

11. A system for remote control based on brain waves, comprising: an electroencephalogram detecting device for detecting and outputting an electroencephalogram signal, and for processing and generating an external device according to the brain wave signal. Remote control device for remote control signals.

12. The system according to claim 11, wherein the control device comprises: a brain wave signal receiving module, configured to receive an electroencephalogram signal sent by the brain wave detecting device;

The system according to claim 12, wherein the control processing device further comprises an electroencephalogram signal acquisition module, configured to be controlled by the remote control device by the user of the electroencephalogram detecting device under a certain control state The function forms a corresponding brainwave signal and processes it to store the brainwave standard signal

14. The system of claim 13, wherein the brainwave signal is obtained by:

15, & the patent requires 14 systems, the brain wave detection device is also used to:

Set the value range to 0.1- 50Hz; take the point according to the step size of 0.1Hz, then collect 500 points each time and shape a set of data, and repeat the acquisition action until the number of times is reached.

16. The system according to the profit request 14 is characterized in that the number of brain wave signal acquisitions set in the acquired data acquisition unit is it) times

The system according to claim 11, wherein the brain wave detecting device is configured to: collect at least two times a brain wave signal of the user according to the acquisition instruction; and determine the collected brain wave letter Whether the number is within the preset error range; if yes, the brain wave signal is sent to the remote control device; if not, the escape failure message "re-acquisitions the user's brain wave number.

18. The system of claim 17 wherein said brainwave detecting means is further adapted to:

Set the value range to 0.1-50HZ; take the point according to the step size of 0.1Hz, then collect 500 points each time to form a set of data.