CN111329446B - Visual stimulation system and method for processing spatial frequency of facial pores through brain visual pathway - Google Patents
Visual stimulation system and method for processing spatial frequency of facial pores through brain visual pathway Download PDFInfo
- Publication number
- CN111329446B CN111329446B CN202010119363.2A CN202010119363A CN111329446B CN 111329446 B CN111329446 B CN 111329446B CN 202010119363 A CN202010119363 A CN 202010119363A CN 111329446 B CN111329446 B CN 111329446B
- Authority
- CN
- China
- Prior art keywords
- visual
- stimulation
- brain
- face
- testee
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/40—Detecting, measuring or recording for evaluating the nervous system
- A61B5/4058—Detecting, measuring or recording for evaluating the nervous system for evaluating the central nervous system
- A61B5/4064—Evaluating the brain
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/05—Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves
- A61B5/055—Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B2576/00—Medical imaging apparatus involving image processing or analysis
- A61B2576/02—Medical imaging apparatus involving image processing or analysis specially adapted for a particular organ or body part
- A61B2576/026—Medical imaging apparatus involving image processing or analysis specially adapted for a particular organ or body part for the brain
Abstract
The invention provides a visual stimulation system and a method for processing spatial frequency of a facial opening in a cerebral visual pathway, which comprises the steps of firstly, acquiring cerebral data of a testee by utilizing visual stimulation and nuclear magnetic resonance fMRI technology, completing individualized functional positioning of a brain area of interest in the visual pathway, then, utilizing facial opening configuration (low spatial frequency information) and characteristic (high spatial frequency information) pictures as visual stimulation, simultaneously recording the nuclear magnetic resonance fMRI data of the cerebral of the testee, analyzing the functions of different cerebral areas when the cerebral performs facial opening characteristic identification and configuration identification, and knowing the functional connection relation among the different cerebral areas, thereby completing the visual stimulation. The invention can be used for studying the abnormity of the facial pore recognition ability of the brain of a disease patient in clinic, thereby having an auxiliary effect on the diagnosis and treatment of the disease; the invention discloses the brain function of the face recognition capability of the normal person, and can provide basis and help for artificial intelligence and application of face recognition.
Description
Technical Field
The invention belongs to the technical field of neuroscience, and particularly relates to a visual stimulation system and a method for processing spatial frequency of a facial hole through a brain visual pathway.
Background
The human body mainly depends on the visual system to obtain the external environment information, the visual information accounts for more than 70% of the total sensory information obtained by normal people, and about 20% of cerebral cortex is specially used for processing the visual information. The face information is a special visual stimulus of human society, and is very important for human interaction and environmental adaptation. The identification of the face information is helpful for people to obtain corresponding social information such as sex, age, race, familiarity degree, emotional state and the like, and meanwhile, the method explores how the human brain processes the face information and is helpful for comprehensively knowing the physiological functions of human beings; and lays a theoretical foundation for the application basic research of pattern recognition, the commercial application of face recognition, computer science and the like, the clinical application research of the visual ability impairment principle in brain diseases (such as amblyopia, brain injury, senile dementia and the like) and the disease diagnosis and treatment.
The study of brain function is mainly divided into three levels: 1) inputting an external stimulation signal to activate a relevant brain reaction; 2) recording the activated brain response; 3) the recorded data is analyzed to resolve brain functions associated with the input stimuli. In recent years, an emerging functional nuclear magnetic resonance (fMRI) technology provides technical support for recording brain functions in brain science research, the fMRI has the advantages of being noninvasive, noninvasive and the like, and has high spatial resolution and temporal resolution, and the fMRI realizes accurate positioning of a region with vigorous neuron activity by recording changes of Blood Oxygen Level Dependence (BOLD). When the human brain receives visual stimulation, corresponding neurons in different areas of the brain generate activity, which promotes the change of local metabolic activity and the change of blood oxygen level. The technology can record data of brain activation conditions under different visual stimuli, locate a brain area activated by specific visual stimuli, and analyze the time-space characteristics of brain response to the visual stimuli by combining different data analysis methods. At present, it is known that a brain visual pathway is divided into two parallel pathways according to the characteristics of stimulation when processing visual information, that is, a large (M) cell pathway processes fast, and non-color information of Low Spatial Frequency (LSF) is related to motion perception; while the small (P) cell pathway handles color information at slow, High Spatial Frequency (HSF), in relation to color and shape information. The brain structure of the large cell pathway includes the large (M) cell layer of the lateral geniculate body, the primary visual cortex (V1), the secondary visual zone (V2 and V4), and the temporal cortex; the brain structure of the small cell pathway includes the small (P) cell layer of the lateral geniculate body, the primary visual cortex (V1), the secondary visual zone (V2 and V3), the intermediate temporal cortex (MT) and the parietal cortex.
In the past experiment, simple graphs with different spatial frequencies are used as visual stimuli to verify that two parallel visual pathways are arranged in the brain of people, however, in the real world, not only the simple graphs have different spatial frequency information, but also the complex stimuli have different high and low spatial frequencies. For example, the face of a human face is common in our lives, and configuration information (i.e. relative positions between eyebrows, eyes, nose and mouth) and characteristic information (i.e. shapes of facial organs such as eyebrows, eyes, nose and mouth) of the face are very important for face recognition capability. Experiments show that human brains respectively encode and process face feature information and configuration information, while the face feature information is processed by relying on high-frequency spatial information, and face configuration information is processed by utilizing low-frequency spatial information to be more advantageous. Research on related brain mechanisms finds that the Occipital Foramen Area (OFA) participates in processing of facial foramen characteristic information, but is insensitive to facial foramen configuration information; the carboxy-shaped retrofacies foramen area (FFA) has the capability of independently processing high-frequency and low-frequency spatial information of the facies foramen, which indicates that the signal processing of high-frequency and low-frequency spatial information by neuron cells in the brain area of the FFA is not integrated.
However, the following problems exist in the existing research on human brain processing facial configuration and characteristic information: 1) experiments are all researches on a single brain area, and integrity researches on a visual pathway, such as functional connection between different brain areas in the visual pathway, signal transmission sequence, efficiency and the like, are not carried out; 2) the face of the African race is adopted as experimental stimulation, and the face is not suitable for researching the brain function of Chinese. Because, the face recognition ability of human has 'heterogeneous effect', that is, the face recognition and memory ability of human for same race is stronger than that for different races. Therefore, the research on the face recognition capability of Chinese people adopts faces of the same race as experimental stimulation, and the recognition and processing capability of the face information of the brain can be accurately reflected.
Disclosure of Invention
Aiming at the defects in the prior art, the invention provides a visual stimulation system for processing the spatial frequency of the facial pores through the brain visual pathway, which aims to solve the problems of the defects.
In order to achieve the above purpose, the invention adopts the technical scheme that:
the scheme provides a visual stimulation system for processing spatial frequency of a face hole of a brain visual pathway, which comprises a nuclear magnetic resonance instrument, a visual stimulation presentation module, a multimedia presentation module, a visual stimulation task module and a visual stimulation experiment module, wherein the multimedia presentation module, the visual stimulation task module and the visual stimulation experiment module are respectively connected with the nuclear magnetic resonance instrument;
the nuclear magnetic resonance apparatus is used for recording the blood oxygen level dependence BOLD signal when the brain of the testee receives visual stimulation;
the multimedia presentation module is used for displaying visual stimulation information of the testee;
the visual stimulation presenting module is used for recording the key feedback of the testee in the visual stimulation, exciting nuclear magnetic resonance scanning and synchronously starting the nuclear magnetic resonance scanning, the visual stimulation task module and the visual stimulation experiment module;
the visual stimulation task module is used for analyzing and completing individualized functional positioning of an interested brain region ROI in a visual passage of a testee according to visual stimulation task data of the testee and synchronously recorded nuclear magnetic resonance fMRI brain data and according to a blood oxygen dynamics response function and a linear model; the visual stimulation tasks include: the method comprises the following steps of (1) performing lateral geniculate nucleus M and P cell layer positioning test, visual cortex positioning test and facial recognition brain area positioning test;
the visual stimulation experiment module is used for analyzing the functional activity of the ROI (region of interest) by utilizing a blood oxygen dynamics response function and a linear model according to face recognition task test data with Chinese faces as prototypes and with changed configurations and characteristics and synchronously recorded nuclear magnetic resonance fMRI brain data, and analyzing the functional connection between different brain regions according to the functional activity of the ROI.
Furthermore, the multimedia presentation module comprises a computer respectively connected with the nuclear magnetic resonance apparatus, a liquid crystal display device and a power signal box respectively compatible with the nuclear magnetic resonance apparatus, a reflector positioned on a head coil in the nuclear magnetic resonance apparatus, a feedback key and a feedback key optical fiber connected with the feedback key.
Furthermore, the lateral geniculate body M and P cell layer positioning test is used for activating the checkerboard stimulation of the lateral geniculate body M cells and P cells of the testee and performing individualized space positioning on the lateral geniculate body M and P cell layer of the testee;
the checkerboard stimulation of the lateral geniculate M cells and the lateral geniculate P cells is full-field stimulation, the diameter visual angle of the full-field stimulation is 24 degrees, and the stimulation mode is a chunk mode;
the chessboard stimulation of the lateral geniculate P cells is high spatial frequency checkerboard stimulation alternating between red and green, the high spatial frequency is 0.5 cycles/degree;
the chessboard stimulation of the lateral geniculate M cells is low spatial frequency checkerboard stimulation with alternate black and white, and the low spatial frequency is 0.25 cycles/degree.
Still further, the visual cortex localization test is used for individualizing black and white bar and grid stimulations for localizing the brain areas of the visual cortex V1, V2, V3 and V4 of the testee, and the black and white bar and grid stimulations sequentially appear on the magnetic resonance compatible liquid crystal display device from left to right or from right to left, wherein each black and white bar and grid stimulation is non-full-field stimulation.
And further, the face recognition brain area positioning test is used for positioning face stimulation of a face recognition brain area of a testee, the face stimulation adopts a 1-back working memory task and is presented in a chunk form by stimulation, and a picture of the face stimulation is derived from a Chinese face and face image library.
Still further, the face recognition brain area positioning test further comprises a landscape stimulation block.
Based on the system, the invention also discloses a visual stimulation method for processing the spatial frequency of the facial pores by the brain visual pathway, which is characterized by comprising the following steps:
s1, sending the testee into a nuclear magnetic resonance scanning room, wearing an in-ear earplug and lying on a scanning bed, installing a head coil and a head coil reflector, placing a feedback key beside the hand of the testee, sending the testee into a scanner, adjusting the position of a reflector on the head coil on the head of the testee, and ensuring the content displayed on a liquid crystal display to be in the range of the tested visual field;
s2, scanning the brain structure and brain function of the human subject, sequentially carrying out three different brain function positioning tests of the lateral geniculate nucleus M and P cell layers, the visual cortex and the face recognition brain area of the human subject, synchronously carrying out nuclear magnetic resonance scanning and recording the key feedback of the human subject, and acquiring the magnetic resonance fMRI function positioning data of the human subject;
s3, obtaining an interested brain region ROI by using an oximetry response function and linear model analysis according to the magnetic resonance fMRI functional positioning data;
s4, taking the face configuration and the face feature picture as a visual stimulation picture of the testee, testing a face recognition task on the testee by using the visual stimulation picture, simultaneously recording the key feedback condition of the testee and the magnetic resonance fMRI data of the brain of the testee, and analyzing the functional activity of the ROI (region of interest) by using a blood oxygen dynamics response function and a linear model according to the recorded magnetic resonance fMRI data;
and S5, performing functional connection analysis among different brain areas according to the functional activity of the ROI of the brain area of interest, and finishing visual stimulation to the testee according to the analysis result.
Further, the step S4 of using the face configuration and the face feature picture as the visual stimulation picture of the subject includes the following steps:
a1, establishing an ellipsoid hole model as a uniform face contour by taking a Chinese face as a prototype, and extracting the information of five sense organs of each picture;
a2, combining the facial feature information and the uniform facial contour to form a complete human face picture as a face prototype, adjusting the positions of eyes and mouth, and generating face pictures with different configurations from the same face prototype;
a3, replacing eyes and a mouth in the same face prototype with corresponding five sense organs of other faces to generate face pictures with different face characteristics;
a4, using the face pictures with different face characteristics and the face pictures with different configurations as visual stimulation pictures of the testee.
Still further, the method for adjusting the size of the visual stimulation picture in the step a4 specifically includes:
the size of the visual stimulation picture is adjusted according to the distance between the eyes of the testee and the liquid crystal display device for projection in the nuclear magnetic resonance scanning room, the visual stimulation picture is controlled within 10 degrees of the visual field range of the testee, and the face visual stimulation is ensured to be in the center position of the visual field range.
Still further, the face hole identification task test in step S4 specifically includes:
and displaying the face configuration and the face characteristic picture in different blocks by using a delay matching sample task and an alternate block mode, judging whether the next two continuous visual stimulation pictures are the same as the previous one by using a feedback key by a testee, pressing a feedback key 1 by using a right index finger if the two continuous visual stimulation pictures are the same as the previous one, otherwise, pressing a feedback key 2 by using a right middle finger, and entering the step S5.
The invention has the beneficial effects that:
(1) the invention effectively avoids 'alien effect' in face recognition: because the face recognition has the 'heterogeneous effect', namely the recognition and memory abilities of people on faces of the same race are stronger than those of faces of different races, the face recognition ability of the brain can be accurately reflected only by applying the faces of the same race as experimental stimulation to the face recognition ability research. In the invention, all face pictures are stimulated by taking the Chinese face as a prototype, and the configuration and the characteristic of the face are changed to form two groups of different stimulation pictures which are used for researching the recognition capability of a Chinese visual system on the face configuration change and the characteristic change and the response of a corresponding brain channel, so that the 'alien effect' generated by the stimulation of other race face images is avoided;
(2) the functional brain area positioning task comprises chessboard stimulation of different spatial frequencies to the lateral geniculate nucleus, bar grid stimulation is utilized to position a visual cortex (V1-V4), and a face and landscape picture are utilized as stimulated 1-back work memory task to position a face recognition brain area, because the difference between human brain individuals is huge, the method for performing structural positioning according to a brain map lacks the brain area positioning accuracy, the invention utilizes specific visual stimulation to perform individual functional positioning on the researched interested brain area, so that the positioning result is more accurate;
(3) the invention carries out systematic research aiming at the visual pathway, and can systematically research the information processing capability of the visual pathway (including lateral geniculate body, visual cortex and facial recognition brain area) by considering all brain areas on the relevant visual pathway. Because the previous researches are carried out by separately researching the functions of different brain areas, such as the coding processing capacity of an outer side knee to objects with different spatial frequencies and the coding processing capacity of a face recognition brain area, the invention systematizes the researches, can research the reaction of the same tested low-level brain area to a high-level brain area in coding processing to the same stimulus (face configuration and characteristic information) and the condition of nerve signal conduction in a visual pathway, constructs a visual pathway nerve signal conduction pathway model, and can more comprehensively know the brain visual system;
(4) the invention can be used for being synchronously carried out with magnetic resonance scanning, has the setting of an automatic synchronous starting program of magnetic resonance pulses, can accurately carry out benchmarking on the stimulation presentation time and the brain reaction time, and ensures the accuracy of modeling and analyzing the brain reaction;
(5) the invention can be applied to the research of a plurality of diseases, for example, in the research of patients with diseases such as amblyopia and senile dementia, the amblyopia or the common face recognition obstacle can stimulate the amblyopia eye and the normal eye of the amblyopia patient respectively, and the effects of different brain areas in processing visual information can be known more accurately by comparing the brain area activity difference on the visual pathway corresponding to different eyes, and a favorable scientific basis is provided for the diagnosis and treatment of the amblyopia disease; in addition, the senile dementia patients also have visual cognition ability reduction, and the system is applied to the law of the attenuation of face recognition ability of the elderly, which is beneficial to exploring biomarkers of diseases such as senile dementia and the like; the invention can effectively research the difference and sameness of normal people and disease patients in the processing of facial pore information, can promote the understanding of the human visual system, provides theoretical support for the development and application of face recognition in the field of artificial intelligence, and has wide application prospect.
Drawings
FIG. 1 is a system block diagram of the present invention.
Fig. 2 is a schematic diagram of hardware connections of the apparatus according to the present invention.
FIG. 3 is a schematic diagram of high and low spatial frequency stimulation of P and M cells for activation of the lateral geniculate body in accordance with the present invention.
FIG. 4 is a schematic diagram of bar grid stimulation to locate visual cortex V1-V4 in the present invention.
Fig. 5 is a schematic diagram of a face recognition brain region positioning task according to the present invention.
FIG. 6 is a flow chart of a method of the present invention.
FIG. 7 is an experimental flow chart of the present invention.
FIG. 8 is a schematic diagram of a face recognition experiment in accordance with the present invention.
Detailed Description
The following description of the embodiments of the present invention is provided to facilitate the understanding of the present invention by those skilled in the art, but it should be understood that the present invention is not limited to the scope of the embodiments, and it will be apparent to those skilled in the art that various changes may be made without departing from the spirit and scope of the invention as defined and defined in the appended claims, and all matters produced by the invention using the inventive concept are protected.
Examples
The invention uses Chinese face as visual stimulation to avoid 'foreign body effect': the Chinese face is used as a prototype, and the configuration and the characteristic change of the facial hole are carried out to form two sets of different stimulation pictures for researching the recognition capability of the human visual system on the configuration change and the characteristic change of the facial hole and the response of a corresponding brain channel. The 'alien effect' caused by the stimulation of face images of other ethnic groups is avoided; the invention utilizes the specific visual stimulation to carry out individual functional positioning on the interested brain area to be researched, thus avoiding the inaccuracy brought by structural positioning by using a brain map, and the functional brain area positioning experiment comprises that checkerboard stimulation with different spatial frequencies is used for lateral geniculate body, bar grid stimulation is used for visual cortex (V1-V4), and the original face picture is used as a stimulated 1-back working memory task to position the face recognition brain area; the invention considers all related brain areas on the visual pathway, can carry out systematic research on the information processing capacity of the visual pathway (including lateral geniculate nucleus, primary visual cortex, visual combined cortex and facial recognition brain area), can effectively research the dissimilarity of facial information processing of normal people and disease patients, can provide theoretical support for the application of the human face recognition in the artificial intelligence field while promoting the self-recognition of the human visual system, and has wide application prospect; the invention can be used for being synchronously carried out with magnetic resonance scanning, has the setting of an automatic synchronous starting program of magnetic resonance pulses, can accurately carry out benchmarking on the stimulation presentation time and the brain reaction time, and ensures the accuracy of modeling and analyzing the brain reaction.
As shown in fig. 1, the present invention provides a visual stimulation system for processing spatial frequency of a facial hole in a brain visual pathway, which comprises a nuclear magnetic resonance apparatus, a visual stimulation presentation module, a multimedia presentation module, a visual stimulation task module and a visual stimulation experiment module, wherein the multimedia presentation module, the visual stimulation task module and the visual stimulation experiment module are respectively connected with the nuclear magnetic resonance apparatus; the nuclear magnetic resonance apparatus is used for recording the blood oxygen level dependence BOLD signal when the brain of the testee receives visual stimulation; the multimedia presentation module is used for displaying visual stimulation information of the testee; the visual stimulation presenting module is used for recording the key feedback of the testee in the visual stimulation, exciting nuclear magnetic resonance scanning and starting the nuclear magnetic resonance scanning synchronously with the visual stimulation task module and the visual stimulation experiment module; the visual stimulation task module is used for analyzing and completing individual functional positioning of an interested brain region ROI in a visual passage of the testee by utilizing a blood oxygen dynamics response function and a linear model by utilizing visual stimulation task data of the testee and nuclear magnetic resonance fMRI brain data synchronously recorded in the visual stimulation task; visual stimulation tasks include: the method comprises the following steps of (1) performing lateral geniculate nucleus M and P cell layer positioning test, visual cortex positioning test and facial recognition brain area positioning test; and the visual stimulation experiment module is used for analyzing the functional activity of the ROI (region of interest) by utilizing a blood oxygen dynamics response function and a linear model according to face recognition task test data with Chinese face as a prototype and face recognition task test data with characteristics changed and synchronously recorded nuclear magnetic resonance fMRI brain data, and analyzing the functional connection between different brain regions according to the functional activity of the ROI.
The multimedia presentation module comprises a computer, a liquid crystal display device, a power signal box, a reflecting mirror, a feedback button and a feedback button optical fiber, wherein the computer is respectively connected with the nuclear magnetic resonance instrument, the liquid crystal display device and the power signal box are respectively compatible with the nuclear magnetic resonance instrument, the reflecting mirror is positioned on a head coil in the nuclear magnetic resonance instrument, and the feedback button optical fiber is connected with the feedback button.
In this embodiment, as shown in fig. 2, all programs are implemented by MATLAB-compatible psychoolbox software packages, including stimulus presentation and feedback records for making key responses, such as responses, correct rate, and error rate. The system is simultaneously suitable for magnetic resonance functional scanning, namely, the magnetic resonance scanning is carried out on the brain to record brain response signals while the following cognitive tasks are completed, and the magnetic resonance scanning recording and the task stimulation presenting can be accurately and synchronously carried out.
In this embodiment, as shown in fig. 3, the lateral geniculate body M and P cell layer localization test is used to activate the checkerboard stimulation of the lateral geniculate body M cells and P cells of the subject and perform individualized spatial localization of the lateral geniculate body M and P cell layer of the subject; the checkerboard stimulation of the lateral geniculate M cells and the P cells is full-field stimulation, the diameter visual angle is 24 degrees, and the stimulation mode is a chunk mode; the chessboard stimulation of the lateral geniculate P cells is high-spatial-frequency checkerboard stimulation with red and green alternated, and the high spatial frequency is 0.5 week/degree; the checkerboard stimulation of the lateral geniculate M cells is a low spatial frequency checkerboard stimulation alternating between black and white, with a low spatial frequency of 0.25 cycles/degree. Each block 16s, each of which stimulates a fixation point in the middle of which the color is red or green, is randomly changed, and the subject needs to make a key response when the color of the fixation point is changed, and the task is set to ensure that the subject keeps visual attention to the stimulus during the experiment.
In this embodiment, as shown in fig. 4, the visual cortex localization test is used to individualize black and white bar and grid stimulation for locating the brain areas of the visual cortex V1, V2, V3 and V4 of the subject, and the black and white bar and grid stimulation appears sequentially from left to right or from right to left on the magnetic resonance compatible liquid crystal display device, wherein each black and white bar and grid stimulation is a non-full field stimulation.
In this embodiment, the face recognition brain area positioning test: as shown in fig. 5, a face stimulation program for locating face recognition brain areas (including fusiform circumfacial brain area FFA, occipital foramen brain area OFA, etc.). The face picture stimulation comes from a face picture library of Chinese faces, a 1-back working memory task is adopted in an experiment, stimulation presentation is carried out in a chunk form, face stimulation pictures continuously appear, and a subject needs to judge whether the currently presented face picture is the same as the previous one or not so as to activate a brain area for face recognition. The magnetic resonance functional scanning is carried out while the task is completed, the brain area of which the brain responds to the facial hole stimulation can be located in an individualized mode, the landscape stimulation block is used as the contrast stimulation of the brain response besides the facial hole stimulation block in the test, the brain area which plays a role in facial hole recognition and is located more accurately through contrast analysis and plays a role in removing the brain area which has general activation on the task picture stimulation.
Based on the above system, the present invention provides a visual stimulation method for spatial frequency processing of facial pores by brain visual pathways, as shown in fig. 6-7, which is implemented as follows:
s1, sending the testee into a nuclear magnetic resonance scanning room, wearing an in-ear earplug and lying on a scanning bed, installing a head coil and a head coil reflector, placing a feedback key beside the hand of the testee, sending the testee into a scanner, adjusting the position of the reflector on the head coil on the head of the testee, and ensuring the content displayed on the liquid crystal display to be within the visual field range of the testee;
s2, scanning brain structures and brain functions of a tested person, sequentially carrying out three different brain function positioning tests of an outer side geniculate nucleus M and P cell layer, a visual cortex and a face recognition brain area of the tested person, synchronously carrying out magnetic resonance scanning and recording key feedback of the tested person, and acquiring magnetic resonance fMRI function positioning data of the tested person;
s3, obtaining an interested brain region ROI by using an oximetry response function and linear model analysis according to the magnetic resonance fMRI functional positioning data;
s4, taking the face configuration and the face feature picture as a visual stimulation picture of the testee, testing a face recognition task on the testee by using the visual stimulation picture, simultaneously recording the key feedback condition of the testee and the magnetic resonance fMRI data of the brain of the testee, and analyzing the functional activity of the ROI (region of interest) by using a blood oxygen dynamics response function and a linear model according to the recorded magnetic resonance fMRI data;
the face configuration and the face feature picture are taken as visual stimulation pictures of a testee, and the implementation method comprises the following steps:
a1, establishing an ellipsoid hole model as a uniform face contour by utilizing Rhino software, and extracting the information of five sense organs of each picture;
a2, combining the five sense organs information with the uniform face contour to form a complete face picture as a face prototype, adjusting the positions of eyes and mouth, and generating face pictures with different configurations from the same face prototype;
a3, replacing eyes and mouth in the same face prototype with corresponding five sense organs of other faces to generate face pictures with different face characteristics;
a4, taking face pictures with different face characteristics and face pictures with different configurations as visual stimulation pictures of a testee;
the expression analyzed using the linear model is as follows:
y＝Xβ+ε
wherein y represents observation data, namely blood oxygen level dependent BOLD signal values recorded by the nuclear magnetic resonance fMRI, X represents a design matrix, β represents a specific gravity parameter corresponding to the X matrix, and epsilon represents a residual error.
In this example, the pictures of face configuration change and feature change: firstly, taking a neutral emotion front picture of the Chinese face as a prototype, establishing an ellipsoid hole model by utilizing Rhino software to serve as a uniform face contour, and extracting five sense organs information of each picture, including eyes, a nose and a mouth. Secondly, combining five sense organs with a face contour model by utilizing Photoshop software to form a complete face picture as a face hole prototype, and manually and quantitatively adjusting the positions of eyes and eyes, wherein the manual quantitative adjustment comprises the steps of expanding and reducing the distance between two eyes and simultaneously moving the position of a mouth upwards or downwards, so that four other face hole stimulations with different configurations can be generated by the same prototype face hole (namely changing 1 into expanding the eye distance and moving the mouth downwards, changing 2 into expanding the eye distance and moving the mouth upwards, changing 3 into reducing the eye distance and moving the mouth downwards, and changing 4 into reducing the eye distance and moving the mouth upwards); in addition, the eyes and mouth of the same face prototype are replaced by the corresponding five sense organs of other human faces, and four other pictures with different face features are generated, as shown in fig. 8A, and fig. 8A is a schematic diagram of the face features and the stimulation pictures with changed configurations. All pictures are stimulated by adopting the uniform face contour and have the same brightness and contrast, so that the difference of the brightness and the contrast of the pictures to be tested can be avoided as a factor for experimental judgment.
In this embodiment, the image stimulus size adjustment: according to the distance between the tested eye and the projection liquid crystal display device in the magnetic resonance scanning room, the size of the face stimulation picture is adjusted, the visual field range of the visual picture presented to the tested eye is controlled, the fixed visual angle is within 10 degrees, and the face visual stimulation is ensured to be in the center of the visual field.
In this embodiment, a Delayed match sample task (DMS) is adopted in the experiment, a software system is used to present a series of face pictures to a test, and a key of the test is used to determine whether the face picture presented later in two consecutive face pictures is the same as the previous one. The experimental design adopts a block design mode, the face stimulation with changed configuration and the face stimulation with changed characteristics are presented in different blocks, and the design of alternately carrying out different blocks is adopted, namely RABBARBAAB design (A represents the block presenting the face configuration change stimulation, and B represents the block presenting the face characteristic change stimulation) is shown in fig. 8B, and fig. 8B is a face recognition task schematic diagram, so that the stimulation adaptability of the tested brain is reduced. The presentation time of the stimulation picture is 500ms, the black and white snowflake picture is presented in the center of the screen at the interval of two stimulations, the presentation time is 700ms, the second face hole is presented followed by the "+" and the presentation time is 1200ms, and the tested time is given to make a judgment response, as shown in fig. 8C, fig. 8C is a schematic diagram of a delay matching task. The snowflake point picture between the two stimuli is presented in order to remove the image effect after the test vision, namely the visual residual phenomenon left by the previous picture presentation. The tested person is informed to keep staring at the middle position of the screen all the time in the experimental process, so that the concentration of the tested person is ensured, and the occurrence of eye movement is reduced.
And S5, performing functional linkage analysis among different Brain areas according to the functional activity of the ROI of the Brain area of interest, and completing visual stimulation to the testee according to the analysis result, such as ROI-to-ROI, ROI-to-white Brain, Independent Component Analysis (ICA), dynamic causal model practical modelling (DCM) analysis and the like.
In conclusion, the invention aims to carry out systematic research on the processing capability of the face of the brain better. Firstly, according to the characteristics of different brain areas, different visual stimuli are adopted to activate the brain areas, nuclear magnetic resonance fMRI BOLD signals are collected at the same time, and corresponding interesting brain areas in visual pathways of the brains of different individuals, such as an M cell layer and a P cell layer of LGN, a visual cortex V1-V4 brain area and OFA and FFA brain areas processed by a face hole, are accurately positioned through data analysis, so that the functions and functional connections of the different interesting brain areas are researched in a face hole configuration and feature recognition task; secondly, in order to avoid the alien effect, the Chinese face is used as a prototype, 8 groups of stimulating pictures with changed face configurations and 8 groups of stimulating pictures with changed face characteristics are generated through professional drawing software, the change of the face configurations generates a group of picture stimuli with changed face configurations by changing the distance between eyes and changing the distance between a mouth and eyes; meanwhile, the change of the face features is a picture stimulus of a group of face feature changes formed by replacing eyes and mouth in the face prototype. In addition, the nuclear magnetic resonance scanning is carried out while the stimulation picture is presented, the reaction signals of the whole brain of the brain, including the signals of all brain areas on the visual pathway, can be analyzed through later analysis and calculation, and the functions and the functional connection conditions of the visual pathway of the brain when different information of the surface pore is processed can be analyzed.
The invention can be used for studying the abnormity of the facial pore recognition ability of the brain of a disease patient in clinic, thereby having an auxiliary effect on the diagnosis and treatment of the disease; the disclosure of the face recognition capability and brain function of the normal person can provide basis and help for face recognition artificial intelligence and application.
Claims (10)
1. The visual stimulation system for processing the spatial frequency of the face hole of the brain visual pathway is characterized by comprising a nuclear magnetic resonance instrument, a visual stimulation presentation module, a multimedia presentation module, a visual stimulation task module and a visual stimulation experiment module, wherein the multimedia presentation module, the visual stimulation task module and the visual stimulation experiment module are respectively connected with the nuclear magnetic resonance instrument;
the nuclear magnetic resonance apparatus is used for recording the blood oxygen level dependence BOLD signal when the brain of the testee receives visual stimulation;
the multimedia presentation module is used for displaying visual stimulation information of the testee;
the visual stimulation presenting module is used for recording the key feedback of the testee in the visual stimulation, exciting nuclear magnetic resonance scanning and starting the nuclear magnetic resonance scanning synchronously with the visual stimulation task module and the visual stimulation experiment module;
the visual stimulation task module is used for analyzing the individualized functional positioning of an interested brain region ROI in a visual passage of a testee by utilizing an oximetry response function and a linear model according to the visual stimulation task data of the testee and the synchronously recorded nuclear magnetic resonance fMRI brain data; the visual stimulation tasks include: the method comprises the following steps of (1) performing lateral geniculate nucleus M and P cell layer positioning test, visual cortex positioning test and facial recognition brain area positioning test;
the visual stimulation experiment module is used for analyzing the functional activity of the ROI (region of interest) by utilizing a blood oxygen dynamics response function and a linear model according to face recognition task test data with Chinese faces as prototypes and with configuration and characteristics changed and nuclear magnetic resonance fMRI brain data which are synchronously recorded, and analyzing the functional connection among different brain areas according to the functional activity of the ROI, wherein the functional connection among different brain areas is analyzed by utilizing a dynamic causal model DCM (discontinuous cycle) according to the functional activity of the ROI.
2. The system of claim 1, wherein the multimedia presentation module comprises a computer connected to the nmr, a liquid crystal display and a power box compatible with the nmr, a mirror on a head coil in the nmr, a feedback button, and a feedback button fiber connected to the feedback button.
3. The visual stimulation system for spatial frequency treatment of foramen ovale through cerebral visual pathways as claimed in claim 1, wherein the lateral geniculate M and P cell layer localization test is used for activating the checkerboard stimulation of the lateral geniculate M and P cells of the subject and performing individualized spatial localization of the lateral geniculate M and P cell layers of the subject;
the checkerboard stimulation of the lateral geniculate M cells and the P cells is full-field stimulation, the diameter visual angle of the full-field stimulation is 24 degrees, and the stimulation mode is a chunk mode;
the chessboard stimulation of the lateral geniculate P cells is high spatial frequency checkerboard stimulation alternating between red and green, the high spatial frequency is 0.5 cycles/degree;
the chessboard stimulation of the lateral geniculate M cells is low spatial frequency checkerboard stimulation with alternate black and white, and the low spatial frequency is 0.25 cycles/degree.
4. The system of claim 2, wherein the visual cortex location test is used for individually locating black and white bar stimulation of the visual cortex V1, V2, V3 and V4 brain areas of the testee, and the black and white bar stimulation appears sequentially from left to right or from right to left on the magnetic resonance compatible liquid crystal display device, wherein each black and white bar stimulation is a non-full visual field stimulation.
5. The visual stimulation system for processing spatial frequency of facial pores through brain visual pathways according to claim 1, wherein the facial pore recognition brain area positioning test is used for positioning facial pore stimulation of a facial pore recognition brain area of a human subject, the facial pore stimulation adopts a 1-back working memory task and is presented in a stimulation form of chunks, and a picture of the facial pore stimulation is derived from a Chinese facial pore map library.
6. A visual stimulation system of brain visual pathway versus facial spatial frequency processing according to claim 5, characterized in that the facial recognition brain region localization test further comprises a landscape stimulation block.
7. The visual stimulation method for processing the spatial frequency of the facial pores by the visual pathway of the brain is characterized by comprising the following steps of:
s1, sending the testee into a nuclear magnetic resonance scanning room, wearing an in-ear earplug and lying on a scanning bed, installing a head coil and a head coil reflector, placing a feedback key beside the hand of the testee, sending the testee into a scanner, adjusting the position of the reflector on the head coil on the head of the testee, and ensuring the content displayed on the liquid crystal display to be within the visual field range of the testee;
s2, scanning the brain structure and brain function of the human subject, sequentially carrying out three different brain function positioning tests of the lateral geniculate nucleus M and P cell layers, the visual cortex and the face recognition brain area of the human subject, synchronously carrying out nuclear magnetic resonance scanning and recording the key feedback of the human subject, and acquiring the magnetic resonance fMRI function positioning data of the human subject;
s3, obtaining an interested brain region ROI by using an oximetry response function and linear model analysis according to the magnetic resonance fMRI functional positioning data;
s4, taking the face configuration and the face feature picture as a visual stimulation picture of the testee, testing a face recognition task on the testee by using the visual stimulation picture, simultaneously recording the key feedback condition of the testee and the magnetic resonance fMRI data of the brain of the testee, and analyzing the functional activity of the ROI (region of interest) by using a blood oxygen dynamics response function and a linear model according to the recorded magnetic resonance fMRI data;
s5, performing functional connection analysis among different brain areas according to the functional activity of the interesting brain area ROI, and finishing visual stimulation to the testee according to the analysis result, wherein the functional connection among the different brain areas is analyzed by utilizing a dynamic causal model DCM according to the functional activity of the interesting brain area ROI.
8. The method for visual stimulation through spatial frequency processing of facial pores by brain visual pathways according to claim 7, wherein the method for using facial pore configuration and facial pore characteristic pictures as visual stimulation pictures of the testee in the step S4 specifically comprises the following steps:
a1, establishing an ellipsoid hole model as a uniform face contour by taking a Chinese face as a prototype, and extracting the information of five sense organs of each picture;
a2, combining the facial feature information and the uniform facial contour to form a complete human face picture as a face prototype, adjusting the positions of eyes and mouth, and generating face pictures with different configurations from the same face prototype;
a3, replacing eyes and a mouth in the same face prototype with corresponding five sense organs of other faces to generate face pictures with different face characteristics;
a4, using the face pictures with different face characteristics and the face pictures with different configurations as visual stimulation pictures of the testee.
9. The method for visual stimulation of spatial frequency processing of facial pores by brain visual pathways according to claim 8, wherein the method for adjusting the size of the visual stimulation picture in step a4 comprises:
the size of the visual stimulation picture is adjusted according to the distance between the eyes of the testee and the liquid crystal display device for projection in the nuclear magnetic resonance scanning room, the visual stimulation picture is controlled within 10 degrees of the visual field range of the testee, and the face visual stimulation is ensured to be in the center position of the visual field range.
10. The visual stimulation method for spatial frequency processing of facial pores by brain visual pathways according to claim 7, wherein the facial pore recognition task test in the step S4 is specifically:
and displaying the face configuration and the face characteristic picture in different blocks by using a delay matching sample task and an alternate block mode, judging whether the next two continuous visual stimulation pictures are the same as the previous one by using a feedback key by a testee, pressing a feedback key 1 by using a right index finger if the two continuous visual stimulation pictures are the same as the previous one, otherwise, pressing a feedback key 2 by using a right middle finger, and entering the step S5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010119363.2A CN111329446B (en) | 2020-02-26 | 2020-02-26 | Visual stimulation system and method for processing spatial frequency of facial pores through brain visual pathway |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010119363.2A CN111329446B (en) | 2020-02-26 | 2020-02-26 | Visual stimulation system and method for processing spatial frequency of facial pores through brain visual pathway |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111329446A CN111329446A (en) | 2020-06-26 |
| CN111329446B true CN111329446B (en) | 2022-06-10 |
Family
ID=71174003
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010119363.2A Active CN111329446B (en) | 2020-02-26 | 2020-02-26 | Visual stimulation system and method for processing spatial frequency of facial pores through brain visual pathway |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111329446B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114145758B (en) * | 2021-11-30 | 2024-03-29 | 深圳先进技术研究院 | Function detection system and method for subcortical access |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101292871A (en) * | 2007-04-25 | 2008-10-29 | 中国科学院自动化研究所 | Method for specification extraction of magnetic resonance imaging brain active region based on pattern recognition |
| CN101912255A (en) * | 2010-08-10 | 2010-12-15 | 北京师范大学 | Nervous feedback system based on real-time functional magnetic resonance signal |
| CN110420389A (en) * | 2019-08-12 | 2019-11-08 | 四川大学华西医院 | A kind of the visual cortex localization method and device of transcranial magnetic stimulation |
| CN110569880A (en) * | 2019-08-09 | 2019-12-13 | 天津大学 | Method for decoding visual stimulation by using artificial neural network model |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100036233A1 (en) * | 2008-08-08 | 2010-02-11 | Michigan State University | Automatic Methods for Combining Human Facial Information with 3D Magnetic Resonance Brain Images |
| US20190159712A1 (en) * | 2009-03-30 | 2019-05-30 | Donald H. Marks | Brain function decoding process and system |
| US8694449B2 (en) * | 2009-05-29 | 2014-04-08 | Board Of Trustees Of Michigan State University | Neuromorphic spatiotemporal where-what machines |
| US10946165B2 (en) * | 2015-05-04 | 2021-03-16 | Phoenix Neurostim Therapeutics, Llc | Modulation of brainwave activity using non-invasive stimulation of sensory pathways |
| WO2018026710A1 (en) * | 2016-08-05 | 2018-02-08 | The Regents Of The University Of California | Methods of cognitive fitness detection and training and systems for practicing the same |
| US20180132751A1 (en) * | 2016-11-14 | 2018-05-17 | Medisim, Ltd. | Automatic system and method for evaluating and treating visual health |
-
2020
- 2020-02-26 CN CN202010119363.2A patent/CN111329446B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101292871A (en) * | 2007-04-25 | 2008-10-29 | 中国科学院自动化研究所 | Method for specification extraction of magnetic resonance imaging brain active region based on pattern recognition |
| CN101912255A (en) * | 2010-08-10 | 2010-12-15 | 北京师范大学 | Nervous feedback system based on real-time functional magnetic resonance signal |
| CN110569880A (en) * | 2019-08-09 | 2019-12-13 | 天津大学 | Method for decoding visual stimulation by using artificial neural network model |
| CN110420389A (en) * | 2019-08-12 | 2019-11-08 | 四川大学华西医院 | A kind of the visual cortex localization method and device of transcranial magnetic stimulation |
Non-Patent Citations (5)
| Title |
|---|
| Distinct and distributed functional connectivity patterns across cortex reflect the domain-specific constraints of object, face, scene, body, and tool category-selective modules in the ventral visual pathway;Hutchison R M,等;《Neuroimage》;20140331;第96卷;全文 * |
| Resting-state fMRI reveals functional connectivity between face-selective perirhinal cortex and the fusiform face area related to face inversion;O"Neil E B, 等;《Neuroimage》;20140212;全文 * |
| Temporal limitations in object processing across the human ventral visual pathway;McKeeff T J,等;《Journal of neurophysiology》;20070731;第98卷(第1期);全文 * |
| 人脑视觉意识的神经机制;回佳菡，等;《生物化学与生物物理进展》;20161231;全文 * |
| 基于功能磁共振的情绪脑机制研究;王海玲，等;《常州大学学报》;20130131;第25卷(第1期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111329446A (en) | 2020-06-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Kropotov | Functional neuromarkers for psychiatry: Applications for diagnosis and treatment | |
| Tucker et al. | Spatiotemporal analysis of brain electrical fields | |
| Jäncke et al. | Intensity coding of auditory stimuli: an fMRI study | |
| Miller et al. | Rapid online language mapping with electrocorticography | |
| CN106407733A (en) | Depression risk screening system and method based on virtual reality scene electroencephalogram signal | |
| CN1516561A (en) | Functional brain imaging for detecting and assessing deception and concealed recognition, and cognitive/emotional respnose to information | |
| CN101888875A (en) | Systems and methods for treatment of medical conditions related to the central nervous system and for enhancing cognitive functions | |
| Edelman et al. | Systems neuroengineering: understanding and interacting with the brain | |
| CN112545517A (en) | Attention training method and terminal | |
| Tal et al. | The origins of metamodality in visual object area LO: Bodily topographical biases and increased functional connectivity to S1 | |
| Berchicci et al. | Prompting future events: Effects of temporal cueing and time on task on brain preparation to action | |
| CN109938727A (en) | Non-human primate 3D vision stimulation test system and method | |
| CN111329446B (en) | Visual stimulation system and method for processing spatial frequency of facial pores through brain visual pathway | |
| Kalantari et al. | Evaluating educational settings through biometric data and virtual response testing | |
| Sitaram et al. | Real-time regulation and detection of brain states from fMRI signals | |
| CN113576497B (en) | Visual steady-state evoked potential detection system for binocular competition | |
| CN115336983B (en) | Work memory regulation and control system based on single brain region functional magnetic resonance nerve feedback | |
| Amaral et al. | Disentangling hand and tool processing: distal effects of neuromodulation | |
| CN208709883U (en) | The 3D vision stimulation test system of non-human primate | |
| AU2021102564A4 (en) | HCT based Near infrared Brain Function Imager 3D Analysis System | |
| AlJobouri et al. | Brain-Computer interface based on VEP and FMRI package | |
| Schnetzer et al. | Diagnosis and Prognosis in Disorders of Consciousness: An Active Paradigm fMRI Study | |
| Klein et al. | From Lab to Life: Challenges and Perspectives of fNIRS for Hemodynamic Neurofeedback in Real-World Environments | |
| Matamoros et al. | Analysis of EEG Signals in a Patient with Spastic Cerebral Palsy Undergone Dolphin-Assisted Therapies | |
| Sredniawa et al. | Local contribution to the somatosensory evoked potentials in rat's thalamus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |