KR101470588B1 - Apparatus and method for brain-brain interfacing - Google Patents

Abstract

In the brain-brain interface processing, an EEG signal is measured, an EEG signal is inferred based on an EEG signal, and a predetermined plurality of cranial nervous functions and a reference shape matched to the corresponding neuron A reference shape corresponding to the inferred shape is detected and a combination of ultrasonic stimulation parameters matched to the cranial nerve function and the corresponding nerve site is used to determine the ultrasound stimulation parameter for optimal control of the corresponding cranial nerve function matched to the detected reference shape Combination is detected, and focused ultrasound is irradiated non-invasively to the nerve area including the brain to be irradiated on the basis of the combination of the detected ultrasonic stimulation parameters. Accordingly, it is possible to control the cranial nerves (or cognitive functions) of other subjects through non-invasive and highly precise ultrasonic stimulation using cranial nerve (or cognitive) information according to the intention or intention of the subject .

Description

[0001] APPARATUS AND METHOD FOR BRAIN-BRAIN INTERFACING [0002]

The present invention relates to an apparatus and a method for processing an interface (Brain-Brain Interface, BBI) between a brain and a brain using an electroencephalogram and an ultrasonic wave.

Conventionally, researches on methods for controlling a brain-computer interface according to intention of a person using an EEG signal have been actively conducted.

Specifically, a method of analyzing and using parameters according to the cognitive properties of brain waves has been proposed. EEG analysis can be divided into time axis analysis and frequency axis analysis. As an example of temporal analysis of EEG signals, EEG signals related to stimulus presentation are repeatedly measured, and unit EEG fragments are arranged based on the point at which the stimulus is presented, and the average brain potential is calculated based on the presentation time point. Thus, it is possible to calculate event-related potentials (ERPs) that are accumulated in the mean value in relation to the presented stimulus or event. This is based on the principle that only the EEG signals related to stimulation are effective at the mean value and that any EEG signals irrelevant to stimulation are canceled by means.

The components obtained by the time-axis analysis of the EEG are the Steady State Visual Evoked Potential (SSVEP), which is a typical EEG component. The steady-state visual evoked potential (SSVEP) component is an EEG signal that responds to repetitive visual stimuli. For example, if a person is looking at a flickering stimulus, an EEG having the same frequency as the frequency at which the stimulus flickers is physically induced is induced by a blinking visual stimulus, Is SSVEP.

In this connection, Korean Patent Laid-Open Publication No. 2013-0002590 (titled "QWERTY-type character input interface device and character input method using stable-state visual evoked potential") has a character display portion in which a plurality of characters are displayed in QWERTY style, An EEG signal measuring unit for measuring a user's EEG signal while the stable state visual evoked potential is induced by the visual stimulation due to the displayed character, an EEG signal analyzing unit for analyzing the measured EEG signal, And a character output unit for outputting the corresponding character.

However, this conventional brain-machine interface device has a problem in that the user only confirms the key selected overtly on the keyboard, and the higher-level information is not covertly associated with the subject's actual pupil movement (That is, information reflecting the intention) can not be confirmed.

In the related art, techniques for processing a brain-computer (or a machine) interface or processing a computer-machine-brain interface have been proposed. However, research on techniques for processing a brain-brain interface (BBI) It is not enough. Moreover, computer-to-brain interface technology is in need of non-invasive and accurate techniques due to the risk of invasive methods.

In this situation, a method of controlling the cranial nerve function by using ultrasound to be noninvasive into the brain and with a fine spatial resolution has emerged.

Previous research on this neuronal control technique of ultrasound has shown that ultrasound reduces cortical neuronal activity through the study of visual evoked potentials of cats (Fry et al., 1958) (Borrelli et al., 1981) reported that ultrasound may have a significant impact on the neurophysiology of local neuronal circuits in vitro (Rinaldi et al., 1991). It has also been found that subjects experience auditory sensation by irradiating ultrasound to the human cerebral basilar artery (Magee and Davies, 1993). Although ultrasound has not yet been reported to precisely disturb the nervous system, studies have suggested that mechanical forces induced by ultrasound may induce changes in neuronal membrane potential (Gavrilov et al., 1996).

However, in a situation where previous research results related to the disturbance of the nerve function of the ultrasonic wave are present as described above, existing methods of controlling brain dysfunction and treating brain diseases have been limited. For example, epidural cortical stimulation (EpCS) and deep brain stimulation (DBS) are inevitably infectious, and in some cases, There was a hassle of treatment that had to be exposed to danger and opened the skull.

In order to solve such a problem, a noninvasive cranial nerve therapy (for example, transcranial magnetic stimulation (TMS), transcranial direct current stimulation (tDCS)) has been proposed. However, these methods have limitations in efficiency due to limitations of skull penetration and ambiguity of focus. On the other hand, ultrasound-based control of nerve function is non-invasive and has advantages of high penetration power and spatial resolution.

In this regard, the Korean National Registered Patent No. 1143645 (entitled "Light Intensity Low Intensity Ultrasound Transmission Device and Noninvasive Brain Function Control Method Using the Same)" includes an ultrasonic generator for generating ultrasonic waves, a noninvasive An ultrasound transducer that adjusts the focal distance of the low intensity ultrasound to image a specific region of the brain, a cylindrical ultrasound transducer that is fixed to the subject's scalp, Discloses an ultrasonic transmitter including an applicator, a supply amount of the ultrasonic wave provided by the ultrasonic wave generator, a terminal for measuring the reflection amount of the low-intensity ultrasonic wave imaged by the ultrasonic wave converter, and an output meter for outputting each measurement amount provided to the terminal.

Disclosure of Invention Technical Problem [8] Accordingly, the present invention has been made in view of the above problems, and it is an object of the present invention to provide an apparatus and method for providing an interface between a brain and a brain using an EEG and an ultrasonic wave.

Specifically, the technology that stimulates the cranial nerves by irradiating the ultrasound energy to the spatially precise (mm unit) target point using the focused ultrasound, which passes the skull noninvasively and has excellent spatial resolution, We apply this method to the brain interface, and combine the brain-computer interface using the electroencephalogram to provide an electroencephalogram-ultrasound-based brain-brain interface.

It should be understood, however, that the technical scope of the present invention is not limited to the above-described technical problems, and other technical problems may exist.

According to an aspect of the present invention, there is provided a brain-brain interface apparatus including a shape speculation unit for speculating a shape associated with an intention-aware object based on an EEG signal; A neural function information storage unit in which a plurality of predetermined cranial nerve functions and a combination of a reference shape and an ultrasound stimulation parameter are matched and stored for each corresponding nerve site matched to the cranial nerve function; And a controller configured to detect the reference shape corresponding to the inferred shape and detect a focused ultrasound wave on the brain to be irradiated based on the combination of the cranial nerve function, the nerve portion, and the ultrasonic stimulation parameter matched to the detected reference shape and an ultrasound output unit for irradiating a focused ultrasound.

According to another aspect of the present invention, there is provided a brain-brain interface method using a brain-brain interface device, comprising the steps of: (a) measuring an EEG signal; (b) deducing a shape reminiscent of the intention or object based on the EEG signal; (c) detecting a reference shape corresponding to the inferred shape among reference shapes matched to a predetermined plurality of cranial nerve functions; (d) detecting a combination of ultrasonic stimulation parameters matched to the detected reference shape among combinations of the predetermined plurality of cranial nerve functions and ultrasound stimulation parameters matched to corresponding nerve sites corresponding to the cranial nerve function ; And (e) irradiating a focused ultrasound to the brain to be irradiated based on the combination of the detected ultrasonic stimulation parameters.

According to any one of the above-described tasks of the present invention, a shape reminiscent of an intentional object can be easily obtained only by an EEG signal measured from an intended brain that is intended to watch a stimulus blinking at a plurality of frequencies There is an effect that can be accurately reconstructed.

According to any one of the tasks of the present invention, it is possible to control and control the specific cranial nerve function of the cranial nerve control object (that is, the subject to be irradiated with ultrasonic waves) There is a possible effect.

In addition, according to any one of the tasks of the present invention, it is possible to apply a combination of ultrasound stimulation parameters optimized for each of the cranial nervous functions, so that various brain cognitive functions and intention directions (nerve excitation or nerve suppression) And the degree of control thereof can be controlled. In addition, by irradiating ultrasonic waves in the form of pulses at a low intensity, it is possible to reversibly control the cranial nerve function without thermally or physically damaging the cell tissue.

Further, according to any one of the tasks of the present invention, the nerve area of the brain corresponding to the cranial nerve function is set, and an accurate brain for the target of the ultrasound irradiation through a brain imaging method such as fMRI (Functional Magnetic Resonance Imaging) It is possible to detect the position of the magnetic pole on the surface. By attaching an infrared marker to the ultrasound generator and tracking it through an infrared camera, it is possible to track the focus coordinates of the ultrasound generator in a three-dimensional space and to be an ultrasound target generated using ultrasound focal coordinates and brain images By aligning the positional coordinates with respect to the living body part, there is an effect that the output accuracy and accuracy with respect to the target brain position at the time of ultrasonic output can be enhanced.

Further, according to any one of the tasks of the present invention, the brain mental function generated as a function of time can be expressed as an objective index called an EEG signal, and the EEG signal can be converted into a digital or analog type data signal / Can be transmitted wirelessly. Further, since the information generated in the brain can be received and decoded by a transmitter (i.e., an 'ultrasound output unit' in one embodiment of the present invention) acting on another brain, Mental function, and ultimately the transmission of 'mental data'.

1 is a view for explaining the concept of a brain-brain interface according to an embodiment of the present invention.
2 is a block diagram illustrating a configuration of a brain-brain interface apparatus according to an embodiment of the present invention.
FIG. 3 is a block diagram illustrating a detailed configuration of a shape inference unit according to an embodiment of the present invention.
4 is a view for explaining an example of an associative shape inference method using a control method of a light emitting device array unit and a light emitting device array unit according to an embodiment of the present invention.
FIG. 5 is a conceptual diagram for explaining ultrasonic irradiation positions according to an embodiment of the present invention.
6 is a block diagram illustrating a detailed configuration of an ultrasonic wave output unit according to an embodiment of the present invention.
FIG. 7 is a flowchart for explaining a brain-brain interface method according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, which will be readily apparent to those skilled in the art. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when a part is referred to as being "connected" to another part, it includes not only "directly connected" but also "electrically connected" with another part in between . Also, when an element is referred to as "comprising ", it means that it can include other elements as well, without departing from the other elements unless specifically stated otherwise.

1 is a view for explaining the concept of a brain-brain interface according to an embodiment of the present invention.

As shown in FIG. 1, the brain-brain interface device 100 according to an embodiment of the present invention is an apparatus that processes an interface between the brains of different objects.

Specifically, as shown in FIG. 1, the brain-brain interface device 100 measures an EEG signal from a brain of an intention or target, and based on the measured EEG signal, A specific shape associated with an intentional object is inferred. Then, the brain-brain interface device 100 detects a combination of optimal ultrasonic stimulation parameters to control specific neural functions of other brain (hereinafter referred to as " brain to be irradiated with ultrasonic waves " And irradiates focused ultrasound on a specific region of the brain subject to the ultrasound irradiation based on the detected information, thereby controlling the control of the nerve function. At this time, the nerve region corresponding to the specific nerve function among the brain regions to be irradiated with ultrasound is set as a target nerve region to be irradiated with ultrasound.

As described above, the brain-brain interface device 100 according to an embodiment of the present invention includes a brain-computer interface (BCI) based on an electroencephalogram, a computer-based brain interface CBI) - Ultrasound-based Brain-Brain Interface (BBI).

1, the brain-brain interface device 100 according to an embodiment of the present invention can be used not only for a person (i.e., an intended or an intended subject) Interfaces between brain of various organisms such as large animals are possible.

Hereinafter, a brain-brain interface device 100 according to an embodiment of the present invention will be described in detail with reference to FIG.

2 is a block diagram illustrating a configuration of a brain-brain interface apparatus according to an embodiment of the present invention.

2, the brain-brain interface device 100 according to an exemplary embodiment of the present invention includes a light emitting device arrangement unit 110, a shape speculation unit 120, a neural function information storage unit 130, An output unit 140 and an MRI photographing unit 150.

In the light emitting device array 110, a plurality of light emitting elements are arranged at a predetermined interval. For reference, the intervals in which the plurality of light emitting elements are spaced apart may be set based on the result of the experiment previously, which is a psychophysically meaningful interval. That is, it is arranged so as to have a sufficient visual resolution resolution between the respective light emitting device arrays.

4, a light emitting device array 110 according to an exemplary embodiment of the present invention includes a plurality of light emitting devices arranged in a matrix, and each of the light emitting devices includes two or more A light emitting element can be arranged. Accordingly, each row and column does not share the light emitting element at the intersection, and the light emitting element is configured independently of each other, so that the row and column can be flickered (i.e., blink) at their own independent frequency.

At this time, according to the control of the light emitting element control module 121 included in the shape reasoning unit 120 described below, the light emitting elements of the light emitting element array unit 110 are flickered at different frequencies according to their arrangement positions, So that the object to be watched will see the light emitting device array 110.

In FIG. 4, the light emitting elements RD1 to RD25 and the light emitting elements CD1 to CD25 of the row are shown differently from each other, but this is for facilitating the distinction between rows and columns. Lt; / RTI > For reference, in one embodiment of the present invention, the light emitting device may be a light emitting diode (LED), and may be any one of red, green, and white light emitting diodes among the light emitting diodes.

Referring back to FIG. 2, the shape inferring unit 120 deduces a shape associated with the intentional or cognitive object based on an EEG signal.

Hereinafter, the configuration and operation of the shape speculation unit 120 will be described in detail with reference to FIGS. 3 and 4. FIG.

FIG. 3 is a block diagram illustrating a detailed configuration of a shape inference unit according to an embodiment of the present invention. 4 is a view for explaining an example of an associative shape inference method using a control method of a light emitting device array unit and a light emitting device array unit according to an embodiment of the present invention.

3, the shape inferring unit 120 includes a light emitting device control module 121, an EEG measurement module 122, and a shape analysis module 123. As shown in FIG.

The light emitting element control module 121 controls the plurality of light emitting elements arranged in the light emitting element array 110 to flicker at different frequencies according to their arrangement positions. In addition, the light emitting element control module 121 can control various blinking operation conditions such as the total time of blinking, the brightness of blinking, and the selection of the light emitting element to be blinked.

At this time, the light emitting element control module 121 divides the light emitting elements of the light emitting element array 110 into a plurality of groups, and controls the light emitting elements to blink according to different frequencies set for the respective groups. For reference, the light emitting element control module 121 can reduce the fatigue of eyes by setting the light emitting elements to be watched by the intent or object to be blinked at a high frequency.

Specifically, the light-emitting element control module 121 divides a plurality of light-emitting elements into a plurality of groups according to a plurality of predetermined arrangement ranges, and groups the light-emitting elements as one row or all of the light-emitting elements arranged in a matrix form as shown in FIG. The plurality of light emitting elements arranged on the array position of the column can be grouped into one group.

The light emitting element control module 121 sets different frequencies for a plurality of groups, and controls the light emitting elements belonging to each group to flicker at the same frequency. For example, in FIG. 4, 35Hz, 15Hz, 5Hz, 25Hz, and 45Hz are set in five rows of the light emitting device array 110, and 49Hz, 28Hz, 7Hz, 21Hz, and 14Hz are set in five columns, respectively .

The light emitting element control module 121 may set the difference in bandwidth between the frequencies for each row or column to be greater than or equal to a predetermined threshold value. The light emitting element control module 121 may assign frequencies to each row and column so that the frequency sum of two or more rows and / or columns is different from the sum of frequencies between two or more rows and / or columns having different frequencies.

This is to increase the resolution and reliability of the measured values when detecting the frequency from the EEG signals measured by the EEG measurement module 122 to be described later. In addition, a combination component of the blinking frequency between a specific row and a column is also detected in an EEG signal detected through the Steady State Visual Evoked Potential (SSVEP) measured by the EEG measurement module 122, It is for easy use.

For example, referring to FIG. 4 (b), when the intended object looks at the light emitting device array 110 where all of the matrices are flickering at a specific frequency while reminding the letter "T" The expected SSVEP is 7 Hz (row), 35 Hz (row), and 42 Hz which is the sum of the two frequencies. In contrast, when the intended object looks at the flashing light emitting device array while remembers the character " + ", the expected SSVEP is 7 Hz (column), 5 Hz (row) . As such, frequencies can be set for each row and column so that the sum of the frequencies corresponding to the different shapes (i.e., 42 Hz and 12 Hz described above) are different from each other.

Meanwhile, in the brain-brain interface device 100 according to the embodiment of the present invention, the light emitting device arrangement unit 110 of FIG. 2 and the light emitting device control module 121 of FIG. 3 are separately described The light emitting device arrangement unit 110 and the light emitting device control module 121 may be combined into one structure. The combined light emitting device arrangement 110 and the light emitting device control module 121 are connected to the EEG measurement module 124 and the shape analysis module 123 to be described below, Information (e.g., information such as the start and end of the flicker control).

The EEG measurement module 122 measures an EEP signal of the intention-aware subject to watch the light emitter array 110. For reference, the EEG measurement module 122 may be connected to the EEG measurement device (not shown) to measure the EEG signal. The EEG measurement module 122 may be configured to measure the EEG signal of the EEG 100 according to an embodiment of the present invention. At least one configuration including the measurement module 122 may be included as a configuration in the EEG device. For example, in an embodiment of the present invention, a brain wave measuring device (not shown) such as a headset or a band type measuring non-invasive non-invasive EEG may be applied for safety and convenience of an object of interest.

At this time, the EEG measurement module 122 can measure EEG signals in various ways. In one embodiment of the present invention, the visual cortex of the occipital lobe is physically induced by the cognitive attention of the intended or perceived luminescent device arrangement 110, (SSVEP) can be measured.

The shape analyzing module 123 detects at least one frequency included in the measured EEG signal and determines the shape of the intended or target object based on the arrangement of the light emitting elements that blinks at a frequency corresponding to the detected at least one frequency .

Specifically, when a specific shape (letter, number, symbol, or the like) is associated with an intention in a state in which the intended object is looking at the light emitting element of the light emitting element array 110, A frequency equal to the frequency at which the light emitting element on the light emitting element array 110 matched to the light emitting element 110 blinks is detected in the EEG signal.

At this time, the frequency of the EEG signal detected through the shape analysis module 123 reflects the blink frequency of the corresponding light emitting element group matched to the shape (for example, a geometry) of a specific shape intended by the subject . That is, the frequency of the group corresponding to the shape association of the object on the light-emitting element array 110 and the corresponding group-specific frequency is detected.

For example, the shape analyzing module 123 can select an accurate frequency based on a frequency perfectly matching the group-specific frequency set through the light-emitting element control module 121 and the harmonic frequency of the detected frequency . When the similar frequency around the detected frequency is included, the shape analysis module 123 refers to the frequency related to the intention of the target person or the frequency related to the intention of the target person, which is set on the light emitting device arrangement unit 110, You can select the correct frequency.

Then, the shape analysis module 123 detects a group set to a frequency corresponding to the detected at least one frequency among the plurality of groups on the light emitting device array 110. [ The shape analysis module 123 deduces a shape reminiscent of an intended object based on the shape of the detected group of the light emitting elements.

In this case, when two or more frequencies are detected from the measured EEG signal, the shape analysis module 123 combines the arrangement form of the light emitting devices of each group of the light emitting device array units 110 corresponding to the detected two or more frequencies, It is possible to deduce the shape of the object.

4 (b), the shape analyzing module 123 determines that the character " T " among the rows and columns on the light emitting device array 110, It is possible to detect frequencies of 35 Hz and 7 Hz corresponding to the shape and 42 Hz including 35 Hz and 7 Hz.

At this time, the shape analysis module 123 determines the rows and columns on the light emitting device array 110 corresponding to 35 Hz, 7 Hz, and 42 Hz detected from the EEG signals, and determines the row and column according to the arrangement of the light emitting devices corresponding to the determined rows and columns (I.e., the shape corresponding to the letter " T ").

The shape analysis module 123 according to an embodiment of the present invention calculates the similarity between a plurality of reference shapes stored in advance and the shapes of the detected groups to deduce the shape having the highest degree of similarity as a shape reminiscent of an intention or an object It is also possible to do. At this time, the shape analysis module 123 may calculate the shapes of the reference shapes including various types of shapes such as letters (characters), numbers, and symbols, and the shapes of the light emitting element groups on the light emitting element arrays 110 corresponding to the reference shapes The information can be matched and stored.

Referring back to FIG. 2, the neural function information storage unit 130 stores combinations of a reference shape and ultrasonic stimulation parameters for a predetermined plurality of cranial nerve functions and nerve regions corresponding to each cranial nerve function. At this time, the combination of the ultrasonic stimulation parameters is a combination that enables optimal control of the cranial nerve function, and can be set through experiment or the like in advance.

Specifically, each part of the nerve area of the brain to be irradiated with ultrasound is set to be responsible for a specific nerve function (or cognitive function), and a reference shape capable of determining the degree of division and control of each cranial nerve function, A combination of ultrasonic stimulation parameters capable of controlling the output of the ultrasonic wave suitable for controlling the nerve function is matched. For reference, the site to be irradiated with ultrasound may include both the central nervous system including the brain and the nervous system including the peripheral nervous system.

Specifically, FIG. 5 is a conceptual diagram for explaining an ultrasonic wave irradiation position according to a cranial nerve function in an embodiment of the present invention.

For example, as shown in FIG. 5, among the various parts of the brain, the Broca area is responsible for language production, the Wernicke area is for language understanding, and the frontal lobe The hippocampus is responsible for learning and memory, and there is a neural network for attention. In addition, various sites such as the amygdala for emotion regulation and the suprachiasmatic nucleus for the biological clock can be preset. For reference, the region of the neural function of the brain can be set as the position coordinate value on the three-dimensional space.

Accordingly, when the ultrasound focus is irradiated to a specific region of a desired brain through the ultrasound output unit 140 to be described later, a change in nerve function (or cognitive function, etc.) related to the region occurs.

Meanwhile, in the neural function information storage unit 130, combinations of two or more ultrasound stimulation parameters may be stored for each of the cranial nerve functions, and thus, one brain nerve function may be different for each combination of ultrasound stimulation parameters Lt; / RTI >

For reference, the ultrasound stimulation parameter includes an ultrasound center frequency for the focused ultrasound output through the ultrasound output unit 140, a unit time during which the ultrasound stimulation progresses uninterrupted, an ultrasound stimulation unit (for example, the number of repetitions per unit time (e.g., 1 second) of the pulse '), the percentage occupied by the ultrasound time applied per unit time, the ultrasound intensity per unit area of the ultrasound irradiation, and the ultrasound total irradiation time. At this time, the combination of parameters such as the intensity, frequency, and time of the focused ultrasound to be irradiated to the brain can be set as an optimum combination that can control the cranial nerve function for the purpose without damaging the living tissue of the brain have.

Such modulation of ultrasound stimulation parameters may enhance or weaken the nerve function.

For example, after selecting a specific cranial nerve function, examining ultrasound according to a combination of specific ultrasound stimulation parameters may improve learning ability, or may be able to improve the learning ability of ultrasound according to the combination of different ultrasound stimulation parameters for the same brain region Examination can weaken learning ability. As such, the cognitive or neural function can be controlled and controlled to a certain degree as desired.

In addition, it is possible to stimulate the central nervous function of the brain so that the subject to be irradiated with ultrasound can feel the tactile sensation (tactile sensation, proprioception, thermal sensation, pain perception, sensation of movement) It is also possible to control the motor ability through peripheral nerve control by stimulating the specific nerve function of the brain.

2, the ultrasound output unit 140 acquires a shape inferred by the shape inferring unit 120, and refers to a plurality of reference shapes stored in the neural function information storage unit 130 to correspond to the inferred shape Thereby detecting the reference shape. The ultrasound output unit 140 refers to a combination of ultrasound stimulation parameters by reference shape stored in the neural function information storage unit 130 and determines a combination of cranial nerve function and ultrasound stimulation parameters matched to the detected reference shape .

Then, the ultrasound output unit 140 performs a matching process between the ultrasound focus and the target (that is, the target site to which the ultrasound is to be irradiated) on the three-dimensional space. The ultrasound output unit 140 non-invasively irradiates the focused ultrasound according to the combination of the detected ultrasound stimulation parameters to the brain to be irradiated by applying the result of the matching processing.

Meanwhile, the brain-brain interface device 100 according to another embodiment of the present invention may be configured separately from an electroencephalogram-based brain-machine (or computer) interface device and an ultrasound-based machine (or computer) The two interface devices may further include a wireless transmission / reception unit (not shown) for wirelessly transmitting / receiving information to / from each other.

Specifically, in a brain-brain interface apparatus 100 according to another embodiment of the present invention, an electroencephalogram-based brain-mechanical (or computer) interface apparatus transmits information of an associative shape deduced through the shape reasoning unit 120 to a wireless communication To the ultrasound output unit 140 through a wireless transmission unit (not shown). In the brain-brain interface device 100 according to another embodiment of the present invention, the ultrasound-based machine (or computer) -brain interface device wirelessly receives the information of the shape from the wireless transmitter, (Not shown) for transmitting the radio signal to the base station. That is, a wireless transmission / reception unit (not shown) may be additionally provided between the shape reasoning unit 120 and the ultrasonic output unit 140 in the brain-brain interface device 100 shown in FIG.

Hereinafter, the configuration and operation of the ultrasonic wave output unit according to one embodiment of the present invention will be described in detail with reference to FIG.

6 is a block diagram illustrating a detailed configuration of an ultrasonic wave output unit according to an embodiment of the present invention.

6, the ultrasound output unit 140 includes a brain position coordinate storage module 141, a 3D position tracking module 142, a position coordinate matching module 143, and an ultrasonic output control module 144 .

The brain position coordinate storage module 141 generates a three-dimensional position coordinate using a brain image obtained by imaging a brain to be irradiated with an ultrasonic wave, The generated three-dimensional position coordinates are matched and stored. For reference, MRI or ultrasound focal point setting can be performed after fixing the brain (that is, the brain to be irradiated) for accurate three-dimensional coordinate tracking and access.

As shown in FIG. 2, the brain-brain interface device 100 may include an MRI imaging unit 150 for performing MRI imaging of the brain to be irradiated with ultrasound, The coordinate storage module 141 may acquire a brain image from the MRI photographing unit 150. [ In another embodiment of the present invention, the MRI photographing unit 150 may be configured as an external device separate from the brain-brain interface device 100, and may include an MRI photographing unit 150 and a brain position coordinate storing module 141. [ It is also possible to acquire a brain image from the MRI photographing unit 150.

Referring back to FIG. 6, the 3D position tracking module 142 tracks coordinate values on the 3D space with respect to the focus of the ultrasonic wave to be output from an ultrasonic transducer (not shown). That is, virtual coordinate values for the ultrasonic focus to be irradiated on the three-dimensional space of the brain to be irradiated with the ultrasonic waves are calculated. By tracking and confirming the position of the ultrasonic wave to be irradiated by using the imaginary coordinate value of the ultrasonic focus, ultrasonic waves can be accurately irradiated to a specific position set in the region of the brain to be irradiated with the ultrasonic wave.

For example, the brain-brain interface device 100 according to an embodiment of the present invention includes an infrared marker (not shown) fixed to a holder (not shown) for supporting the ultrasonic generator, The virtual coordinate value on the three-dimensional space with respect to the ultrasonic focus to be output by the ultrasonic generator can be calculated using an infrared ray tracking camera (not shown). For example, the ultrasound generator is a device that generates ultrasonic waves under the control of the ultrasound output control module 144, which will be described later. The infrared ray tracking camera measures the position coordinates (i.e., the position coordinates of the ultrasound output device) . Also, the configuration of at least one of the ultrasound generator and the infrared ray tracking camera may be integrally included in the brain-brain interface device 100, or may be separately included and interlocked with the brain-brain interface device 100.

Specifically, the three-dimensional position tracking module 142 obtains the three-dimensional spatial position coordinates of the infrared marker provided from the infrared tracking camera, and obtains the position information of the infrared marker using the position coordinates of the infrared marker and the relative distance information from the infrared marker to the ultrasonic focal point. The imaginary coordinate value on the three-dimensional space of the focus is calculated. For reference, the focal distance of the focused ultrasound to be output by the ultrasonic generator is preset.

The position coordinate matching module 143 calculates the output coordinates on the three-dimensional space of the ultrasonic waves by aligning the three-dimensional position coordinates of the brain to be ultrasonic irradiated using the brain image with the virtual coordinates of the ultrasonic focus do. Accordingly, as the position of the ultrasonic wave output of the ultrasonic wave generator moves, the virtual position at which the ultrasonic wave is output on the three-dimensional space inside the head of the object to be ultrasonically irradiated is tracked in real time.

The ultrasound output control module 144 detects the cranial nerve function to be controlled based on the shape inferred by the shape inferring unit 120 of FIG. 2, and generates three-dimensional position coordinates The three-dimensional position coordinates of the corresponding nerve region according to the detected cranial nerve function are detected.

When the output coordinates of the ultrasonic focal point calculated in real time correspond to the three-dimensional position coordinates of the detected neural part, the ultrasonic output control module 144 sets the output coordinates of the corresponding ultrasonic focus as the target coordinates. Then, the ultrasound output control module 144 controls the focused ultrasonic wave according to the combination of the ultrasound stimulation parameter matched to the detected cranial nerve function to be output to the brain position on the set target coordinate.

In an embodiment of the present invention, the ultrasound output unit 140 outputs focused ultrasound through an ultrasound generator (not shown), and a non-fluid ultrasound transmission medium (for example, a gel) Type and special rubber material). The output focused focused ultrasonic waves can be transmitted to the contact portion (surface) of the object to be irradiated through the non-fluid medium. Thus, ultrasound energy can be delivered non-invasively deeply into the cranial nerve. For reference, 'degassed water' may be used as a medium of ultrasonic energy transfer, but a fluidic liquid is not suitable for a portable ultrasonic generator, so that a non-fluid ultrasonic medium can be used.

Hereinafter, the brain-brain interface method according to one embodiment of the present invention will be described in detail with reference to FIG.

FIG. 7 is a flowchart for explaining a brain-brain interface method according to an embodiment of the present invention.

First, an EEG signal of the subject is measured (S710).

At this time, before the step S710, the plurality of light emitting devices arranged in the light emitting device array 110 are controlled to blink at different frequencies according to the arrangement positions, and the intention of watching the light emitting device array 110 Measure the EEG signal of the subject. Accordingly, the steady state visual evoked potential (SSVEP) reflecting the attention-focused shape according to the intention or intention of the subject can be measured.

Next, based on the measured EEG signal, a shape reminiscent of an intentional object is inferred (S720).

Specifically, at least one frequency included in the measured EEG signal is detected, and a shape reminiscent of an intended or an object is inferred based on the arrangement of the light emitting elements that flickers at a frequency corresponding to at least one detected frequency. At this time, the degree of similarity between any one of the predetermined reference shapes and the shape based on the arrangement form of the light emitting device is calculated, and the shape having the highest degree of similarity can be inferred as a shape reminiscent of an intent or an object.

Then, a reference shape corresponding to the inferred shape among the reference shapes matched to a predetermined plurality of cranial nerve functions is detected (S730).

In operation S740, the type of the cognitive control cognitive function matched to the detected reference shape and the combination of the three-dimensional position coordinate information of the nerve portion and the ultrasound parameter matched as the optimal control condition of the corresponding nerve function are detected.

At this time, the ultrasonic parameters include the ultrasonic center frequency, the minimum unit time in which the ultrasonic stimulation is continued without interruption, the number of repetitions per unit time of the ultrasonic stimulation unit, the percentage occupied by the ultrasonic time per unit time, And an ultrasound total irradiation time. In addition, before the step S740, a combination of two or more ultrasonic stimulation parameters may be matched and stored for any one of the cranial nerve functions, and the cranial nerve functions may be controlled and controlled differently depending on the combination of the ultrasonic parameters .

Then, focused ultrasonic waves are non-invasively inspected to the brain to be irradiated on the basis of the combination of the detected ultrasonic parameters (S750).

Specifically, the step S750 may be performed by performing the following steps.

First, a three-dimensional position coordinate is generated using a brain image obtained by MRI of a brain to be irradiated with an ultrasonic wave, and a predetermined position (i.e., a nerve region) of each brain nerve function and a generated three- Match.

Then, the position coordinate information on the three-dimensional space of the infrared marker attached to the ultrasonic generator is obtained from the linked infrared tracking camera.

The virtual position coordinate value of the ultrasonic focal point on the three-dimensional space is calculated using the information of the position of the infrared marker and the relative distance information of the ultrasonic focus from the infrared marker.

Then, the three-dimensional space of the ultrasonic focus (that is, the brain to be irradiated with ultrasonic waves) is aligned by aligning the three-dimensional position coordinate of the nerve region of the cranial nerve function generated using the brain image with the virtual position coordinate of the ultrasonic focus, And calculates phase output coordinates.

Next, the desired cranial nerve function is detected based on the reference shape corresponding to the reasoning shape detected in step S730, and the three-dimensional position coordinate of the cranial nerve corresponding to the desired cranial nerve function is detected.

Then, when the output coordinates of the calculated ultrasound focus corresponds to the three-dimensional position coordinates of the detected cranial nerve region, focused ultrasound according to a combination of parameters of the ultrasound stimulation matched to the desired cranial nerve function is obtained Non-invasive examination of the brain.

One embodiment of the present invention may also be embodied in the form of a recording medium including instructions executable by a computer, such as program modules, being executed by a computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, the computer-readable medium may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes any information delivery media, including computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transport mechanism.

It will be understood by those skilled in the art that the foregoing description of the present invention is for illustrative purposes only and that those of ordinary skill in the art can readily understand that various changes and modifications may be made without departing from the spirit or essential characteristics of the present invention. will be. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents are to be construed as being included within the scope of the present invention do.

100: Brain-brain interface device
110:
120:
130: nerve function information storage unit
140: Ultrasonic output unit
150: MRI photographing unit

Claims (15)

In a brain-brain interface device,
A shape inferring unit for inferring a shape reminiscent of the intentional cognitive object based on an EEG signal of an intentional subject;
A neural function information storage unit in which a plurality of predetermined cranial nerve functions and a combination of a reference shape and an ultrasound stimulation parameter are matched and stored for each of the corresponding nerve sites matching the cranial nerve function; And
Detecting a reference shape corresponding to the speculated shape; detecting a focused ultrasonic focused on the brain to be irradiated based on the combination of the cranial nerve function, the nerve region and the ultrasonic stimulation parameter matched to the detected reference shape; an ultrasound output unit for irradiating ultrasound to the brain. The method according to claim 1,
Wherein the ultrasonic wave output unit comprises:
Generating three-dimensional positional coordinates using a brain image obtained by imaging the brain to be irradiated with the ultrasonic wave by Magnetic Resonance Image, calculating a position of the corresponding neural region predetermined for each of the plurality of cranial nerve functions, A brain position coordinate storage module for storing coordinates for matching;
And a controller for acquiring an ultrasonic output position coordinate obtained by tracking the position of an infrared marker attached to the ultrasonic generator outputting the focused ultrasonic wave from the interlaced infrared camera and calculating an ultrasonic output position coordinate based on the output distance of the focused ultrasonic wave, A three-dimensional position tracking module for calculating virtual coordinates on a three-dimensional space with respect to a focus of an ultrasonic wave;
A position coordinate matching module for aligning the three-dimensional position coordinates generated using the brain image with virtual coordinates for the focus of the focused ultrasonic wave to calculate output coordinates for the focus of the focused ultrasonic wave; And
Dimensional position coordinate corresponding to a cranial nerve function matched with the detected reference shape is detected, and when the output coordinate corresponds to the detected three-dimensional position coordinate, an ultrasonic stimulation parameter And outputting the focused ultrasonic wave according to a combination of the ultrasound output control module and the ultrasound output control module. The method according to claim 1,
The shape-
A light emitting element control module for controlling the plurality of light emitting elements arranged in the light emitting element array portion to flicker at different frequencies according to the arrangement positions;
An EEG measurement module for measuring an EEP signal of an intent to watch the light emitter array; And
Detecting at least one frequency included in the measured EEG signal and deducing a shape reminiscent of the intention or object based on the arrangement of the light emitting elements that flickers at a frequency corresponding to the detected at least one frequency A brain-brain interface device comprising a shape analysis module. The method of claim 3,
The shape analysis module includes:
Calculating a degree of similarity between any one of the reference shapes and a shape based on the arrangement of the light emitting elements and deducing the shape having the highest degree of similarity as a shape reminiscent of the intention or object. The method according to claim 1,
The ultrasound stimulation parameter may be,
The ultrasound center frequency, the minimum unit time in which the ultrasound stimulation continues uninterrupted, the repetition frequency per unit time of the ultrasound stimulation unit, the percentage occupied by the ultrasound time per unit time, the ultrasound intensity per unit area of the ultrasound irradiation, A brain-brain interface device comprising one. The method according to claim 1,
The neural function information storage unit stores,
A combination of two or more ultrasound stimulation parameters is matched for any one of the cranial nerve functions,
Wherein the one cranial nerve function is controlled differently according to the combination of the ultrasonic stimulation parameters. The method according to claim 1,
Wherein the ultrasonic wave output unit comprises:
Wherein the focused ultrasonic wave is transmitted to the surface of the object to be irradiated through the non-fluid ultrasonic transmission medium to non-invasively irradiate the focused ultrasonic wave to the object to be irradiated with the ultrasonic wave. The method according to claim 1,
The shape-
Brain-brain interface device for measuring the steady state visual evoked potential (SSVEP) of the object of interest, and deducing the shape based on the steady state visual evoked potential. A brain-brain interface method through a brain-brain interface device,
(a) measuring an EEG signal of an intended or perceived subject;
(b) deducing a shape reminiscent of the intention or object based on the EEG signal;
(c) detecting a reference shape corresponding to the inferred shape among reference shapes matched to a predetermined plurality of cranial nerve functions;
(d) detecting a combination of ultrasonic stimulation parameters matched to the detected reference shape among combinations of the predetermined plurality of cranial nerve functions and ultrasound stimulation parameters matched to corresponding nerve sites corresponding to the cranial nerve function ; And
(e) outputting a focused ultrasound based on a combination of the detected ultrasonic stimulation parameters,
Wherein the step of outputting the focused ultrasonic waves comprises:
And outputting the focused ultrasound through an ultrasound transmission medium so as to be irradiated to a brain to be irradiated with ultrasound. 10. The method of claim 9,
The step (e)
(e-1) generating three-dimensional position coordinates using a brain image obtained by imaging a brain to be irradiated with ultrasound with a magnetic resonance image;
(e-2) matching the position of the corresponding neural region predetermined for each of the plurality of cranial nerve functions with the three-dimensional position coordinate;
(e-3) obtaining an ultrasonic output position coordinate tracking the position of an infrared marker attached to the ultrasonic generator outputting the focused ultrasonic wave from the interfaced infrared camera;
(e-4) calculating imaginary coordinates on the three-dimensional space with respect to the focal point of the focused ultrasonic wave on the basis of the ultrasonic output position coordinate and the output distance of the focused ultrasonic wave set in advance;
(e-5) calculating an output coordinate of the focused ultrasonic wave by aligning the three-dimensional position coordinate generated using the brain image with the virtual coordinate of the focus of the focused ultrasonic wave;
(e-6) detecting the three-dimensional position coordinate corresponding to the cranial nerve function matched with the detected reference shape;
(e-7) outputting the focused ultrasonic wave according to a combination of ultrasonic stimulation parameters matched with the detected cranial nerve function when the output coordinate of the focused ultrasonic wave corresponds to the detected three-dimensional position coordinate / RTI > The method of claim 1, 10. The method of claim 9,
Before the step (a)
Further comprising controlling the plurality of light emitting devices arranged in the light emitting device array to flicker at different frequencies according to the arrangement positions,
The step (a)
And a brain-brain interface method for measuring an intracellular signal of the intention to watch the light-emitting device array. 12. The method of claim 11,
The step (b)
Detecting at least one frequency included in the measured EEG signal and deducing a shape reminiscent of the intention or object based on the arrangement of the light emitting elements that flickers at a frequency corresponding to the detected at least one frequency Brain-brain interface method. 13. The method of claim 12,
The step (b)
Calculating a degree of similarity between any one of the reference shapes and the shape based on the arrangement of the light emitting devices and deducing the shape having the highest degree of similarity as a shape reminiscent of the intention or object. 10. The method of claim 9,
The ultrasound stimulation parameter may be,
At least one of the ultrasound center frequency, the minimum unit time without interruption of the ultrasound stimulation, the number of repetitions per unit time of the ultrasound stimulation unit, the percentage occupied by the ultrasound time per unit time, the ultrasound intensity per unit area of the ultrasound irradiation, Comprising a brain-brain interface method. 10. The method of claim 9,
Prior to step (d)
Further comprising the step of matching and storing a combination of two or more ultrasonic stimulation parameters according to any one of the cranial nerve functions,
Wherein the one cranial nerve function is controlled differently according to the combination of the ultrasonic stimulation parameters.

Images