WO2014171598A1

WO2014171598A1 - Brain-machine interface device and method for recognizing intention by using brain waves

Info

Publication number: WO2014171598A1
Application number: PCT/KR2013/008194
Authority: WO
Inventors: 민병경
Original assignee: 고려대학교 산학협력단
Priority date: 2013-04-16
Filing date: 2013-09-11
Publication date: 2014-10-23
Also published as: KR101431203B1

Abstract

During brain-machine interface processing through a brain-machine interface device comprising a light-emitting element arrangement member in which a plurality of light-emitting elements is arranged, the plurality of light-emitting elements are classified into a plurality of groups to control the light-emitting elements to blink at a different frequency for each group, a brain wave signal of a patient staring steadily at the light-emitting elements is measured without requiring eye motion, at least one frequency is detected from the measured brain wave signal, a group set to a frequency corresponding to the detected frequency is detected from among the plurality of groups, an image associated by the patient is inferred on the basis of an image according to an arrangement shape of the light-emitting elements of the detected group, and information on the inferred image is outputted.

Description

Brain machine interface device and method for intention recognition using brain waves

The present invention relates to an apparatus and method for processing a brain-machine interface (BMI) using an EEG signal.

In order to control brain-machine interface according to human intention by using EEG signals, parameters according to cognitive properties of EEG are analyzed and used.

As such, when the EEG signal is used as the interface control signal, the EEG signal may be analyzed by an analysis method based on a time axis or a frequency axis. At this time, in the analysis based on the time axis, the EEG signals related to the stimulus presentation are repeatedly measured, and the unit EEG fragments are aligned based on the time point at which the stimulus is presented, and then the average EEG potential is calculated based on the presentation time point. This is based on the principle that only the EEG signals associated with the stimulus are valid at the mean value, and any EEG signals irrelevant to the stimulus are canceled by the mean.

As such, the cumulative brain potentials that appear at the mean value associated with a given stimulus or event are called event-related potentials (ERPs). As a component obtained by the time-base analysis of the EEG, there is a representative EEG component 'Steady State Visual Evoked Potential (SSVEP)'. The steady state visual induced potential (SSVEP) component is an EEG signal using an EEG in response to repetitive visual stimuli. For example, if a person sees a flickering stimulus, the brainwave with the same frequency as the blinking stimulus is physically induced, and the vibrating brainwave with the same frequency as the stimulus is induced by the blinking visual stimulus. Is SSVEP.

In this regard, Korean Patent Laid-Open Publication No. 2013-0002590 (name of the invention: a character input interface device and a character input method of QWERTY type using the steady state visual oil generation level), a character display unit in which a plurality of characters are displayed in QWERTY style, EEG signal measuring unit for measuring the EEG signal of the user during the steady state visual genetic development induced by the visual stimulus due to the displayed character, EEG signal analysis unit for analyzing the measured EEG signal and the analyzed EEG signal A character input interface device including a character output unit for outputting a corresponding character is disclosed.

By the way, such a conventional brain-machine interface device only checks the keys selected by the subject on the keyboard keyboard, and even higher levels of information are associated with the subject without thinking about the actual pupil movement. (That is, information reflecting intention) has a disadvantage of not being able to be confirmed. In addition, the eye of the subject moves according to the position of the keyboard keyboard, there is a limit that can be more conveniently replaced by a separate equipment such as eye-tracker (eye-tracker) without using the brain wave signal.

The present invention is to solve the above-mentioned problems of the prior art, to provide an apparatus and method for providing an interface between the brain and the machine using the EEG signal.

However, the technical problem to be achieved by the present embodiment is not limited to the technical problem as described above, and other technical problems may exist.

According to an aspect of the present invention for achieving the above technical problem, the brain machine interface device, a plurality of light emitting elements arranged in the light emitting element arrangement spaced apart from each other; A light emitting device controller for dividing the plurality of light emitting devices into a plurality of groups, and controlling the plurality of light emitting devices to blink at different frequencies for each of the groups; An EEG measuring unit for measuring an EEG signal of a subject looking at the light emitting device; A frequency detector detecting at least one frequency from the measured brain wave signal; A shape that detects a group set to a frequency corresponding to the detected at least one frequency among the plurality of groups, and infers a shape reminiscent of the subject by the shape based on the shape of an array of light emitting elements of the detected group An analysis unit; And a result output unit configured to output the shape information inferred by the shape analyzer.

In addition, according to another aspect of the present invention, the brain machine interface method using a brain machine interface device including a light emitting element array member arranged a plurality of light emitting elements, (a) dividing the plurality of light emitting elements into a plurality of groups To control the light emitting device to blink at a different frequency for each group; (b) measuring an EEG signal of a subject looking at the light emitting device; (c) detecting at least one frequency from the measured EEG signal; (d) detecting a group set to a frequency corresponding to the detected frequency among the plurality of groups; (e) inferring a shape reminiscent of the subject by the shape based on the shape of the array of light emitting elements of the detected group; And (f) outputting the inferred shape information.

According to any one of the problem solving means of the present invention described above, by using the frequency information contained in the EEG signal measured from the subject to observe the blinking stimulus divided into a plurality of frequencies easily and accurately the shape associated with the subject There is an effect that can be reconstructed.

According to any one of the problem solving means of the present invention, the arrangement and the device characteristics of the light-emitting element flickering at a plurality of frequencies to be observed by the subject can be variously adjusted, so that the subject can precisely infer the associative shape. In addition to being able to be mounted or interlocked with various equipments, there is a convenient effect.

In addition, according to any one of the problem solving means of the present invention, by causing the light emitting elements to blink at a high frequency, there is an effect that it is possible to efficiently infer the shape associated with the subject while reducing the eye fatigue of the subject.

1 is a block diagram showing the configuration of a brain machine interface device according to an embodiment of the present invention.

2 is a view for explaining the arrangement method and the associative shape inference method using the light emitting device according to an embodiment of the present invention.

3 is a view for explaining an arrangement method and an associative shape inference method using the light emitting device according to another embodiment of the present invention.

4 is a flowchart illustrating a brain machine interface method according to an embodiment of the present invention.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

Throughout the specification, when a part is "connected" to another part, this includes not only "directly connected" but also "electrically connected" with another element in between. . In addition, when a part is said to "include" a certain component, which means that it may further include other components, except to exclude other components unless otherwise stated.

As shown in FIG. 1, the brain machine interface device 100 according to an exemplary embodiment of the present invention may include a light emitting element arranging unit 110, a light emitting element controller 120, an EEG measuring unit 130, and a frequency detecting unit 140. ), A shape analyzer 150, a result output unit 160, a time measuring unit 170, and a light emitting device activator 180.

The light emitting element arranging unit 110 includes a plurality of light-emitting elements, and the plurality of light emitting elements are arranged to be spaced apart from each other. In this case, the interval between the plurality of light emitting devices is a psychophysics meaningful interval and may be set based on a result of experiment in advance. That is, arranged so as to have sufficient visual separation resolution between each light emitting element. For example, the spacing may be set such that the maximum length of all the light emitting device arrays is configured to have a visual angle of 8 degrees to 10 degrees or less. This is to allow the image of the ocular retina not to be blind spots, but to ensure that the light of all the light emitting devices is completely detected in the optic nerve. For example, when five light emitting elements are arranged in a row and a column, when the distance between the light emitting elements is 1 cm, the lengths of the rows and columns are 5 cm, respectively, and the total diagonal length of the array is 5√2 cm. Accordingly, when staring at the light emitting device array at a distance of 1m, the visual angle is 2xarctan (0.05x√2 / 2). Since it is about 4 degrees visually, all light-emitting visual stimuli do not reach the blind spot of the subject's retina, but are formed at the center of the fovea region where the visual information processing is most precisely, so that a suitable light emitting device This can be an example of an array.

In addition, in the embodiment of the present invention, the light emitting device may be a light emitting diode (LED) and may be any one of red and green light emitting diodes. This is because optic nerve cone cells, which are distributed relatively in the fovea of the retina of humans, are red and green cells. For reference, a white diode may be used to use a rod cell that is widely distributed in most locations of the retina. In the embodiment of the present invention, when the luminance of the light emitting diode is conditioned, a red or white light emitting diode having relatively high luminance can be configured as a light emitting element. Meanwhile, as shown in FIGS. 2 and 3, in the light emitting device arrangement unit 110 according to the embodiment of the present invention, a plurality of light emitting devices may be arranged in a matrix form. In this case, each light emitting device may be spaced apart from each other by a predetermined interval, and two or more light emitting devices may be disposed at positions where each row and column cross each other. Accordingly, each row and column does not share the light emitting element at the crossing position, and the light emitting element is independently configured. This is to cause the rows and columns to flash at their own independent frequency.

2 is a view for explaining the arrangement method and the associative shape inference method using the light emitting device according to an embodiment of the present invention. 3 is a view for explaining an arrangement method and an associative shape inference method using the light emitting device according to another embodiment of the present invention.

In FIGS. 2 and 3, the symbols of the light emitting elements RD1 to RD25 of the rows R1 to R5 and the light emitting elements CD1 to CD25 of the columns C1 to C5 are different from each other in the arrangement of the light emitting elements. To facilitate discrimination between rows and columns, the light emitting elements of the matrix may be configured in the same kind.

Specifically, FIG. 2 and FIG. 3 show that the light emitting device arrangement 110 includes five rows and columns. That is, in FIG. 2 and FIG. 3, five light emitting elements RD1 to RD25 are configured for each row, and five light emitting elements CD1 to CD25 are configured for each column. For reference, the size of the light emitting device matrix of the light emitting device array 110 may be variously set.

For example, in FIG. 2, the light emitting devices of the light emitting device array unit 110 are arranged in a line at the intersection points of the matrix.

As another example, FIG. 3 illustrates that the light emitting devices of the light emitting device array 110 are diagonally disposed at the intersection points of the matrix. This may make the arrangement of the entire light emitting devices closer to the square than in the case where the light emitting devices are arranged in a line at an intersection point as shown in FIG. 2. This allows the subject to look at the light emitting device arrangement 110 more easily, and the shape of the symbol or letter to be shaped by the light emitting device arrangement 110 is symmetrical, so that the object is more consistent with the actual shape. For sake.

1 again, the light emitting device controller 120 divides the light emitting devices of the light emitting device array unit 110 into a plurality of groups, and controls the light emitting devices to blink according to differently set frequencies for each group. For reference, the light emitting device controller 120 according to an embodiment of the present invention may reduce eye fatigue of the subject by setting the light emitting elements to be observed by the subject to blink at a high frequency.

In detail, the light emitting device controller 120 may divide the light emitting devices into groups according to a plurality of preset array position ranges. That is, the light emitting device control unit 120 may group the plurality of light emitting devices arranged in one row or one column of all the light emitting devices arranged as shown in FIGS. 2 and 3 into one group.

The light emitting device controller 120 may set different frequencies for each of the plurality of groups, and control the light emitting devices in each group to blink at the same frequency. For example, in FIGS. 2 and 3, 35 Hz, 15 Hz, 5 Hz, 25 Hz, and 45 Hz are set in five rows of the light emitting element array 110, respectively, and 49 Hz, 28 Hz, 7 Hz, 21 Hz, and 14 Hz in five columns, respectively. The set is shown in one embodiment.

In this case, the light emitting device controller 120 may set a wide bandwidth of frequency between adjacent rows or columns on the light emitting device array 110. As illustrated in FIGS. 2 and 3, the light emitting device controller 120 may set a bandwidth difference between frequencies for each row or column so as to be different from a predetermined threshold value or more. This is to increase the resolution and the reliability of the measured value when detecting the frequency on the EEG signal of the subject measured through the EEG measurement unit 130 to be described later.

In addition, the light emitting device controller 120 may allocate a frequency for each row and column such that the sum of frequencies according to any combination of rows and columns on the light emitting device arrangement is different from the sum of frequencies according to combinations of other rows and columns. . This is for ease of inferring that EEG detected through Steady State Visual Evoked Potential (SSVEP), which will be described below, is a frequency combination between specific rows and columns.

For example, in a state in which the light emitting elements arranged as shown in FIGS. 2A and 3A are blinking at different frequencies of each row and column, the subject measures the letter “T”. Associating with the light emitting device array 110 may stare. At this time, the frequency of the SSVEP which is expected to be detected is 7 Hz (ie, column C3), 35 Hz (ie, row R1), and 42 Hz, which is the sum of the two frequencies, as shown in FIGS. 2B and 3B. to be. As another example, when the subject gazes at the light emitting device array in a state of blinking while reminding of the letter “+”, the frequencies of the SSVEP which are expected to be detected are 7 Hz (column), 5 Hz (row), and 12 Hz, which is the sum of the two frequencies. to be.

As such, the frequency of each row and column of the light emitting device may be set such that the sum of the frequencies (that is, 42 Hz and 12 Hz) according to the combination of the rows and the columns corresponding to the different shapes is different from each other.

Specifically, in the light emitting device arrangement shown in Figs. 2 and 3, the number of all combinations that can be formed in five rows and five columns is 25. That is, the number of frequency sums per combination of rows and columns is 25. At this time, the frequencies are assigned to all rows and columns on the light emitting element array so that the sum of all 25 frequencies is different. Meanwhile, in FIG. 1, in the brain machine interface device 100 according to an exemplary embodiment, the light emitting device arrangement unit 110 and the light emitting device control unit 120 have been described in a separate configuration. The device array unit 110 and the light emitting device controller 120 may be combined and implemented in one configuration. In this case, the light emitting device array unit 110 and the light emitting device control unit 120 are connected to the EEG measuring unit 130, the frequency detecting unit 140, and the shape analyzing unit 150 to be described below, and the EEG measuring unit 130. The frequency detector 140 and the shape analyzer 150 may provide frequency information set for each light emitting device and control information of the light emitting device (for example, information such as start and end of flicker control).

The EEG measuring unit 130 measures the EEG signal of the subject looking at the light emitting elements of the LED array 110, and transmits the measured EEG signal to the frequency detector 140.

The EEG measuring unit 130 may measure EEG signals in various ways, among which the steady state visual induced potential (SSVEP) is physically induced in the visual cortex of the occipital lobe of the subject. can do.

For reference, the EEG measurement unit 130 may be connected to the EEG measurement device (not shown) to control to measure the EEG signal, EEG measurement of the configuration of the brain machine interface device 100 according to an embodiment of the present invention At least one configuration including the unit 130 may be included as one configuration in the EEG measurement device. For example, in one embodiment of the present invention, a headset-type EEG measurement device may be applied for the convenience of the subject.

The frequency detector 140 detects at least one frequency or a combination frequency between the plurality of frequencies from the received EEG signal.

Specifically, in a state in which the subject looks at the light emitting device arrangement 110, when a specific shape intended to be intentional is associated with the light emitting device arrangement 110, the light emitting device matched with the shape reminded by the subject on the light emitting device arrangement 110. Particular attention is given to the arrangement of the subject's attention. Accordingly, a frequency equal to the frequency of the light emitting element belonging to the light emitting element array to which the subject's attention is applied is detected in the EEG signal. That is, the EEG signal according to the cognitive attention of the subject staring at the light emitting element array unit 110 is detected.

In this case, the frequency of the EEG signal detected by the frequency detector 140 is the frequency of the group corresponding to the shape association of the subject of the group (for example, row or column) on the light emitting element array 110, the correspondence The sum of the frequencies for each group is detected. Accordingly, the frequency detector 140 is a frequency that matches the frequency set on the light emitting element array 110 through the light emitting element controller 120 among the frequency components of the detected EEG signal and its resonance frequency. And when the pseudo frequency around the matching frequency is included, referring to a frequency associated with the shape association of the subject and the sum of the frequencies among the set frequencies, a correct frequency matching the shape associated with the measurement is determined. I can figure it out.

The shape analyzer 150 may be configured based on a shape of an array of light emitting devices in a group corresponding to a frequency detected by the frequency detector 140 and a combination frequency of the corresponding frequencies among the plurality of groups on the light emitting device array 110. Infer the shape associated with the subject.

In this case, when two or more frequencies are detected through the frequency detector 140, the shape analyzer 150 may combine the arrangement forms of the light emitting devices for each group of the light emitting device array units 110 corresponding to the detected two or more frequencies. The elicited shape can be inferred.

For example, referring to FIGS. 2B and 3B, a method of inferring an associative shape of a subject using the light emitting device arrangement 110 will be described.

As shown in (b) of FIG. 2 and (b) of FIG. 3, when the subject is reminiscent of the letter “T”, the frequency detector 140 is a group on the light emitting element array 110 from the brain wave signal of the subject. (Ie, rows and columns) detect frequencies of 35 Hz and 7 Hz corresponding to the shape of the letter “T”. In addition, the frequency detector 140 may detect 42 Hz, which is a sum of 35 Hz and 7 Hz.

In this case, the shape analyzer 150 determines a group (that is, a row and a column) on the light emitting device array unit 110 corresponding to 35 Hz, 7 Hz, and 42 Hz, the sum of which is detected by the frequency detector 140. The shape according to the arrangement form of the light emitting elements corresponding to the group (that is, the shape corresponding to the letter “T”) is determined.

On the other hand, the shape analysis unit 150 according to an embodiment of the present invention calculates the similarity between the plurality of pre-stored shape and the shape by the detected group, inferring the shape having the highest similarity as the shape reminded by the measurer It is also possible. In this case, the shape analyzer 150 may include a reference shape including various types of shapes such as letters (letters), numbers, and symbols in advance, and a group of light emitting device groups on the light emitting device array unit 110 corresponding to each reference shape. The information can be matched and stored.

1 again, the result output unit 160 outputs shape information about the shape determined by the shape analyzer 150. At this time, the result output unit 160 may output as display information that can be identified by the user (for example, the subject) by the naked eye or by listening, or may transmit the corresponding information to a predetermined related device.

For example, when the inference of the shape is completed by using the EEG signal of the subject in the state in which all the light emitting diodes on the light emitting element array 110 are blinking at the set frequency, the result output unit 160 is configured as the light emitting element array unit ( The shape measured by the subject on the 110 may be output.

In addition, the brain mechanical interface device 100 according to an embodiment of the present invention, may be a form mounted on the remote control of home appliances, including a TV, the remote control in the state reminiscent of letters, numbers and symbols intended by the user When staring at the small light emitting device array mounted on the screen, the user may perform a predetermined operation by analyzing the EEG of the user. For example, when the user stares at the remote controller equipped with the small light emitting device array 110, the user Reminiscent of the letters 'K', 'B', and 'S' sequentially, the brain machine interface device 100 may infer and confirm the letter “KBS” through brain wave analysis. In this case, the result output unit 160 may transmit the corresponding information to a predetermined related device (ie, a TV receiving device) so that the TV channel according to the checked “KBS” text information is automatically selected.

In addition, the brain machine interface device 100 according to an embodiment of the present invention can be mounted on a specific device such as a smartphone, and any machine related to the user simply by associating various characters (or numbers, symbols, etc.). Alternatively, the software may pass the associative letters (or numbers, symbols, etc.) into the software.

On the other hand, the brain machine interface device 100 according to an embodiment of the present invention so that the subject can perform associative according to the intention without covering the eyeball in the state of gazing at the light emitting element array unit 110. In addition, the shape can be inferred so that the result can be output.

Specifically, as shown in FIG. 1, the brain machine interface device 100 according to an embodiment of the present invention may further include a visual measuring unit 170 and a light emitting device activator 180.

The visual measurement unit 170 measures a maximum visual angle and an effective time when the focus is maintained toward the light emitting element array 110 of the subject at a distance spaced from the light emitting element array by a predetermined distance. For reference, the maximum time may be set to a viewing angle at which the subject can see the maximum without eye movement, and the effective time is a viewing angle at which the subject can check the information relatively accurately (ie, validly) within the maximum time. Can be set.

For example, in one embodiment of the present invention, the brain machine interface device 100 may further include a separate member (not shown) for measuring the field of view of the subject on a portion of the front surface of the light emitting device array unit 110. The time measurement unit 170 may calculate a maximum time and an effective time by receiving a field measurement value from the member for measuring the field of view.

The light emitting device activator 180 selects light emitting devices to be activated from among a plurality of light emitting devices on the light emitting device array 110 based on at least one of the measured maximum time and effective time.

In detail, the light emitting element activator 180 selects a range of light emitting elements disposed at the position within the maximum time measured based on the focus of the subject, and activates only light emitting elements within the selected range.

In this case, the light emitting device controller 120 may control the light emitting devices selected through the light emitting device activator 180 to be divided into a plurality of groups and to blink at different frequencies for each group as described above.

On the other hand, the brain machine interface device 100 according to another embodiment of the present invention may implement the light emitting device arrangement 110 itself. In detail, the brain machine interface device 100 may include a physical size of the light emitting device array unit 110 such that the vision of the subject is fixed within a predetermined distance from the light emitting device array unit 110 through a preliminary experiment. The interval between the light emitting elements can be set.

Hereinafter, the brain and machine interface method according to an embodiment of the present invention will be described in detail with reference to FIG. 4.

First, a plurality of light emitting elements arranged at regular intervals are divided into a plurality of groups (S410).

In this case, the plurality of light emitting devices may be divided into a plurality of groups by dividing the plurality of preset array position ranges. For example, the plurality of light emitting devices may be arranged in a matrix form in which two or more light emitting devices are arranged at positions where each row and column intersect, and each of the rows and columns may be set as a group.

Then, a different frequency is set for each group to control the light emitting device in the group to blink at the set frequency (S420).

In this case, as described above, two or more light emitting devices positioned at the intersection of each row and column on the light emitting device matrix are controlled to flash by applying different groups of frequencies. For reference, the bandwidth of the frequency between each row or column of adjacent positions may be set to differ by more than a predetermined threshold value. In addition, the sum of frequencies according to any combination of rows and columns may be set to be different from the sum of frequencies according to combinations of other rows and columns.

Thereafter, in a state in which the plurality of light emitting elements are blinking, the EEG signal of the subject looking at the light emitting element is measured (S430).

At this time, the subject looks at the plurality of light emitting devices and intends any specific letters, numbers, or symbols in the mind, and thus measures the steady state visual induced potential (SSVEP) derived from the occipital lobe.

Then, at least one frequency or a combination frequency of related frequencies is detected from the measured EEG signal (S440). This frequency is related to the blinking frequency of the group of light emitting elements by the geometry or shape of the symbol intended by the subject.

Specifically, when the subject intentionally associates a specific shape with the subject watching the flashing light emitting elements after the step S420, the EEG signal of the subject is included in the frequency of the light emitting elements on the position corresponding to the specific shape. The same frequency as is detected.

Next, a group of light emitting devices corresponding to the detected frequency is detected (S450).

That is, a group set to a frequency corresponding to the frequency detected from the EEG signal of the subject is detected from among the plurality of groups.

Thereafter, the shape of the object to be measured is inferred based on the shape by the arrangement of the light emitting elements of the detected group (S460).

In this case, when two or more groups are detected, the shape of the object to be measured may be inferred by combining the shapes of the detected groups of light emitting elements. In addition, it is also possible to calculate the similarity between the plurality of pre-stored shapes and shapes by the detected group, and infer the shape having the highest similarity as the shape reminiscent of the subject.

Then, the inferred shape is identified as display information (S470).

At this time, in an embodiment of the present invention, in step S470, it is also possible to transmit the information of the inferred shape to a predetermined related device.

On the other hand, in the brain mechanical interface method according to an embodiment of the present invention, prior to the step (S410), the maximum time when the focus is maintained toward the light emitting element of the subject at a distance separated by a predetermined distance from the light emitting elements (visual) angle) and effective time, and selecting light emitting devices to be activated from among the plurality of light emitting devices based on the measured maximum time and effective time. That is, in step S410, the selected light emitting devices may be divided into a plurality of groups, and subsequent steps may be performed.

Accordingly, the subject can continuously associate various shapes in a state where the eye is fixed without moving the eyeball, and can accurately infer and provide shapes according to the association of the subject.

An embodiment of the present invention may also be implemented in the form of a recording medium including instructions executable by a computer, such as a program module executed by the computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, computer readable media may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transmission mechanism, and includes any information delivery media.

The foregoing description of the present invention is intended for illustration, and it will be understood by those skilled in the art that the present invention may be easily modified in other specific forms without changing the technical spirit or essential features of the present invention. . Therefore, it should be understood that the embodiments described above are exemplary in all respects and not restrictive. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The scope of the present invention is shown by the following claims rather than the above description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present invention. do.

Claims

In the device for processing the interface between the brain and the machine,

A light emitting device arrangement unit in which a plurality of light emitting devices are arranged to be spaced apart from each other;

A light emitting device controller for dividing the plurality of light emitting devices into a plurality of groups, and controlling the plurality of light emitting devices to blink at different frequencies for each of the groups;

An EEG measuring unit for measuring an EEG signal of a subject looking at the light emitting device;

A frequency detector detecting at least one frequency from the measured brain wave signal;

A shape that detects a group set to a frequency corresponding to the detected at least one frequency among the plurality of groups, and infers a shape reminiscent of the subject by the shape based on the shape of an array of light emitting elements of the detected group An analysis unit; And

And a result output unit configured to output information of the shape inferred by the shape analyzer.
The method of claim 1,

The light emitting device control unit,

A brain machine interface device for dividing the plurality of light emitting elements into a plurality of groups by dividing the plurality of light emitting elements into a plurality of preset array position ranges.
The method of claim 1,

The plurality of light emitting devices are arranged in a matrix form in which two or more light emitting devices are arranged at positions where each row and column cross each other.

The light emitting device control unit,

And setting the rows and columns into one group each, and controlling two or more light emitting elements disposed at the crossing positions to flash at different groups of frequencies, respectively.
The method of claim 3, wherein

The light emitting device control unit,

Sets the bandwidth of the frequency between the row or column of each adjacent position by more than a preset threshold value,

And a sum of frequencies when the two or more frequencies of the row and the column are combined to be different from the sum of the frequencies according to other combinations.
The method of claim 1,

A time measuring unit configured to measure a maximum visual angle and an effective time at the time of maintaining focus toward the light emitting device array of the subject at a distance spaced from the light emitting device array by a predetermined distance; And

Further comprising a light emitting device activation unit for selecting a light emitting device to be activated from the plurality of light emitting devices based on the measured maximum time and effective time,

The light emitting device control unit,

Brain machine interface device for controlling the selected light emitting device through the light emitting device activation.
The method of claim 1,

The shape analysis unit,

A brain machine interface device for inferring a shape reminiscent of the subject by combining shapes of two or more detected groups of light emitting elements.
The method of claim 1,

The shape analysis unit,

And a similarity between a plurality of previously stored shapes and shapes by the detected group, and inferring the shape having the highest similarity into a shape reminiscent of the subject.
The method of claim 1,

The brain wave measuring unit,

Brain machine interface device for measuring Steady State Visual Evoked Potential (SSVEP).
The method of claim 1,

And the light emitting element is at least one of a red, green and white light emitting diode (LED).
The method of claim 1,

The result output unit,

Output the inferred shape as display information including at least one of identifiable letters, numbers, and symbols;

Brain machine interface device for outputting the information of the shape to a predetermined associated device.
The method of claim 1,

The frequency detector,

And a brain machine interface device for detecting at least two frequencies and a combined frequency of the at least two frequencies from the brain wave signal.
A brain machine interface method using a brain machine interface device comprising a light emitting element array member in which a plurality of light emitting elements are arranged,

(a) dividing the plurality of light emitting devices into a plurality of groups and controlling the light emitting devices to blink at different frequencies for each of the groups;

(b) measuring an EEG signal of a subject looking at the light emitting device;

(c) detecting at least one frequency from the measured EEG signal;

(d) detecting a group set to a frequency corresponding to the detected frequency among the plurality of groups;

(e) inferring a shape reminiscent of the subject by the shape based on the shape of the array of light emitting elements of the detected group; And

and (f) outputting the inferred shape information.
The method of claim 12,

In step (a),

The brain machine interface method of dividing the plurality of light emitting elements by a plurality of preset array position ranges into the plurality of groups.
The method of claim 12,

The plurality of light emitting devices are arranged in a matrix form in which two or more light emitting devices are arranged at positions where each row and column cross each other.

In step (a),

And setting the rows and columns into one group each so as to control two or more light emitting elements disposed at the crossing positions to flash at different groups of frequencies.
The method of claim 14,

In step (a),

When the bandwidths of frequencies are set to differ by more than a predetermined threshold value between rows or columns of adjacent positions, and the combination of two or more frequencies of the rows and columns is different, the sum of frequencies differs from the sum of frequencies according to different combinations. How to set the brain mechanical interface.
The method of claim 12,

Before step (a) above,

Measuring a maximum visual angle and an effective time at the time of maintaining the focus toward the light emitting element array of the subject at a distance spaced from the light emitting element array by a predetermined distance; And

Selecting the light emitting devices to be activated from among the plurality of light emitting devices based on the measured maximum time and effective time;

In step (a),

A brain machine interface method for dividing the selected light emitting devices into a plurality of groups.
The method of claim 12,

In step (e),

A brain machine interface method for inferring a shape reminiscent of the subject by combining shapes of two or more detected groups of light emitting elements.
The method of claim 12,

In step (e),

Calculating a similarity between a plurality of previously stored shapes and shapes by the detected group; And

Inferring the shape having the highest similarity into a shape reminiscent of the subject.
The method of claim 12,

Step (f),

And outputting the inferred shape information as display information including at least one of identifiable letters, numbers, and symbols, or outputting the inferred shape information to a predetermined related device.
The method of claim 12,

In step (c),

And a brain machine interface method for detecting at least two frequencies and a combined frequency of the at least two frequencies from the EEG signal.