CN112244875A - Schizophrenia detection method based on electroencephalogram and deep learning - Google Patents

Schizophrenia detection method based on electroencephalogram and deep learning Download PDF

Info

Publication number
CN112244875A
CN112244875A CN202011248815.3A CN202011248815A CN112244875A CN 112244875 A CN112244875 A CN 112244875A CN 202011248815 A CN202011248815 A CN 202011248815A CN 112244875 A CN112244875 A CN 112244875A
Authority
CN
China
Prior art keywords
schizophrenia
deep learning
electroencephalogram
input image
layer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011248815.3A
Other languages
Chinese (zh)
Inventor
车艳秋
郑海令
刘靖
秦迎梅
韩春晓
王若凡
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tianjin University of Technology and Education China Vocational Training Instructor Training Center
Original Assignee
Tianjin University of Technology and Education China Vocational Training Instructor Training Center
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tianjin University of Technology and Education China Vocational Training Instructor Training Center filed Critical Tianjin University of Technology and Education China Vocational Training Instructor Training Center
Priority to CN202011248815.3A priority Critical patent/CN112244875A/en
Publication of CN112244875A publication Critical patent/CN112244875A/en
Priority to CN202110182451.1A priority patent/CN112790774A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/40Detecting, measuring or recording for evaluating the nervous system
    • A61B5/4076Diagnosing or monitoring particular conditions of the nervous system
    • A61B5/4088Diagnosing of monitoring cognitive diseases, e.g. Alzheimer, prion diseases or dementia
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7203Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7235Details of waveform analysis
    • A61B5/7253Details of waveform analysis characterised by using transforms
    • A61B5/7257Details of waveform analysis characterised by using transforms using Fourier transforms
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7235Details of waveform analysis
    • A61B5/7264Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
    • A61B5/7267Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems involving training the classification device

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Artificial Intelligence (AREA)
  • Public Health (AREA)
  • Surgery (AREA)
  • Signal Processing (AREA)
  • Physiology (AREA)
  • Psychiatry (AREA)
  • Veterinary Medicine (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • Neurology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Mathematical Physics (AREA)
  • Psychology (AREA)
  • Hospice & Palliative Care (AREA)
  • Developmental Disabilities (AREA)
  • Neurosurgery (AREA)
  • Child & Adolescent Psychology (AREA)
  • Evolutionary Computation (AREA)
  • Fuzzy Systems (AREA)
  • Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)

Abstract

The invention discloses a method for detecting schizophrenia based on electroencephalogram and deep learning, which comprises the steps of extracting a test sample, converting the obtained test sample into a test input image, inputting the obtained test input image into a deep learning model, extracting robustness characteristics to obtain robustness characteristics, inputting the extracted robustness characteristics into an extreme learning machine classifier, detecting schizophrenia and outputting a detection result. The deep learning model is composed of a convolution neural network and a long-term and short-term memory neural network. The convolutional neural network can utilize the convolutional layer to extract the characteristics, so that proper characteristics do not need to be searched repeatedly, and a large amount of time is saved. Meanwhile, the feature extraction is carried out by utilizing the convolution layer, the accuracy of schizophrenia detection can be improved by changing the size of the convolution kernel, the operation is simple and convenient, the speed is higher, and the accuracy can reach more than 90 percent.

Description

Schizophrenia detection method based on electroencephalogram and deep learning
Technical Field
The invention relates to the technical field of schizophrenia detection, in particular to a schizophrenia detection method based on electroencephalogram and deep learning.
Background
Schizophrenia is a psychiatric disease that affects humans throughout life. Its clinical symptoms are complex and diverse, involving perception, thinking, emotion, will behavior and cognitive function. Manifested by delusions and hallucinations, or cognitive deficits, depressed mood and disorganized thought. Since the clinical manifestations of schizophrenia are complex, the definition, criteria and understanding of the diagnosis of schizophrenia symptoms by clinicians vary, leading to misdiagnosis and mistreatment of schizophrenia. Therefore, the method has important significance for the deep research of the schizophrenia detection method and the improvement of the diagnosis accuracy.
Today, there are many methods for the detection of schizophrenia. Most researches explore and detect by using the characteristic of abnormal expression of electroencephalogram signals. There are mainly two methods, one is to visually check abnormality by a doctor through electroencephalogram, and the other is to find characteristics of electroencephalograms of schizophrenic patients and healthy persons and to perform detection by using a classification method such as machine learning. Both methods, however, suffer from the disadvantage of being relatively time consuming and not accurate.
Disclosure of Invention
The invention aims to provide a schizophrenia detection method based on electroencephalogram and deep learning, aiming at the technical defects of time consumption and low precision of the schizophrenia detection method in the prior art.
The technical scheme adopted for realizing the purpose of the invention is as follows:
a schizophrenia detection method based on electroencephalogram and deep learning comprises the following steps:
step A: extracting an original electroencephalogram time sequence signal of a person to be tested, and carrying out noise filtering processing on the original electroencephalogram time sequence signal, wherein the electroencephalogram time sequence signal of the person to be tested after the noise filtering processing is used as a test sample;
and B: converting the test sample obtained in the step A into a test input image;
and C: b, inputting the test input image obtained in the step B into a deep learning model, and extracting robust features in the deep learning model to obtain robust features;
step D: inputting the robustness characteristics extracted in the step C into an Extreme Learning Machine (ELM) classifier, and detecting schizophrenia and outputting a detection result by the extreme learning machine classifier. Reference documents: [1] li, S.Song, and Y.Wan, "Laplacian twist extension learning machine for semi-collaborative classification", neuro-typing, vol.321, pp.17-27,2018.
[2]Y.Yu and Z.Sun,“Sparse coding extreme learning machine for classification”,Neurocomputing,vol.261,pp.50-56,2017.
In the above technical solution, the test sample conversion method in step B is based on a short-time fourier transform algorithm.
In the above technical solution, the short-time fourier transform algorithm is completed by the following formula:
Figure BDA0002770928050000021
where z (u) is the electroencephalogram time-series signal at time u, g (u-t) is a window function, f is the electroencephalogram time-series signal sampling rate, j is a complex number, j is 1 × i, and i is an imaginary unit.
In the above technical solution, when the obtained test sample is converted into a test input image, a window of 3 seconds is used to perform short-time fourier transform.
In the above technical solution, in step C, the deep learning model is composed of a Convolutional Neural Network (CNN) and a long-short term memory neural network (LSTM). CNN and LSTM are stacked, and the characteristic matrix extracted by CNN is integrated into the matrix which can be input by LSTM. Reference [3] Saintath T N, Vinyals O, Senior A, et al. volumetric, Long Short-Term Memory, full connected Deep Neural Networks [ C ]// ICASSP 2015 + 2015IEEE International Conference on Acoustics, speed and Signal Processing (ICASSP). IEEE,2016.
In the above technical solution, the convolutional neural network has three layers, the first layer convolution kernel size is 3 × (3-20), preferably 3 × 20, the second layer convolution kernel size is 2 × (2-20), preferably 2 × 20, and the third layer convolution kernel size is 2 × (2-20), preferably 2 × 20. When the size of the convolution kernel in the convolution neural network is in the range, the accuracy rate can be ensured to be more than 90%.
In the above technical solution, the long-term and short-term memory neural network has three layers, the first layer is an input layer, the second layer is a hidden layer, the hidden unit of the hidden layer is 100, and the third layer is an output layer.
In the above technical solution, the training method of the deep learning model includes the following steps:
step 1: extracting original electroencephalogram time sequence signals of the schizophrenia patient and the healthy person, and performing noise filtering processing, wherein the electroencephalogram time sequence signals of the schizophrenia patient and the healthy person after the noise filtering processing are used as training samples;
step 2: dividing the training samples extracted in the step 1 into a training set and a verification set; the number of the electroencephalogram time sequences in the training set is 70% of the total number of the electroencephalogram time sequences in the training sample, and the number of the electroencephalogram time sequences in the verification set is 30% of the total number of the electroencephalogram time sequences in the training sample.
And step 3: based on a short-time Fourier transform algorithm, respectively converting the training set and the verification set divided in the step (2) into a training set input image and a verification set input image which can be identified by a convolutional neural network, wherein the training set input image and the verification set input image form a model input image set;
and 4, step 4: and (4) inputting the model input image set obtained by conversion in the step (3) into the deep learning model, extracting robustness characteristics, and training optimal parameters of the deep learning model.
And 5: and (4) outputting the optimal parameters of the deep learning model trained in the step (4).
In the above-described embodiment, in step D, the output detection result indicates whether schizophrenia is present or absent.
Compared with the prior art, the invention has the beneficial effects that:
1. the invention provides a schizophrenia detection method based on electroencephalogram and deep learning. The convolutional neural network can utilize the convolutional layer to extract the characteristics, so that proper characteristics do not need to be searched repeatedly, and a large amount of time is saved.
2. The method for detecting the schizophrenia based on the electroencephalogram and the deep learning, provided by the invention, has the advantages that the characteristic extraction is carried out by utilizing the convolution layer, the accuracy of the schizophrenia detection can be improved by changing the size of the convolution kernel, the operation is simple and convenient, the speed is higher, and the accuracy can be up to more than 90%.
3. According to the method for detecting the schizophrenia based on the electroencephalogram and the deep learning, the long-term and short-term memory neural network can judge the time dependence on the basis of the features extracted by the convolutional layer to further extract the robustness features.
Drawings
Fig. 1 is a flowchart of a schizophrenia detection method based on electroencephalogram and deep learning.
FIG. 2 is a diagram showing the comparison of the brain electrical time series signals of schizophrenia and healthy people.
Figure 3 shows a 3s window short time fourier transform plot of schizophrenia versus healthy persons.
FIG. 4 shows a block diagram of CNN-LSTM-ELM.
Detailed Description
The present invention will be described in further detail with reference to specific examples. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Example 1
A deep learning model is composed of a convolution neural network and a long-short term memory neural network. The convolutional neural network has three layers, the size of a convolution kernel of the first layer is 3X20, the size of a convolution kernel of the second layer is 2X20, and the size of a convolution kernel of the third layer is 2X 20. The long-term and short-term memory neural network comprises three layers, wherein the first layer is an input layer, the second layer is a hidden layer, a hidden unit arranged in the hidden layer is 100, and the third layer is an output layer.
The training method of the deep learning model comprises the following steps:
step 1: extracting training samples
Extracting original electroencephalogram time sequence signals of 45 schizophrenia patients and 39 healthy persons, and performing noise filtering processing, wherein the electroencephalogram time sequence signals of the schizophrenia patients and the healthy persons after the noise filtering processing are used as training samples.
Step 2: partitioning training samples
Dividing the training sample extracted in the step 1 into a training set and a verification set, wherein the number of the electroencephalogram time sequences in the training set is 70% of the total number of the electroencephalogram time sequences in the training sample, and the number of the electroencephalogram time sequences in the verification set is 30% of the total number of the electroencephalogram time sequences in the training sample.
And step 3: transforming a model input image set
And (3) respectively converting the training set and the verification set divided in the step (2) into a training set input image and a verification set input image which can be identified by the convolutional neural network (the image format which can be identified by the convolutional neural network is a two-dimensional matrix format) based on a short-time Fourier transform algorithm, wherein the training set input image and the verification set input image form a model input image set.
And 4, step 4: and (4) inputting the model input image set obtained by conversion in the step (3) into the deep learning model, extracting robustness characteristics, and training optimal parameters of the deep learning model.
And 5: and (4) outputting the optimal parameters of the deep learning model trained in the step (4).
Example 2
A schizophrenia detection method based on electroencephalogram and deep learning comprises the following steps:
step A: extracting an original electroencephalogram time sequence signal of a person to be tested, and carrying out noise filtering processing on the original electroencephalogram time sequence signal, wherein the electroencephalogram time sequence signal of the person to be tested after the noise filtering processing is used as a test sample;
and B: converting the test sample obtained in the step A into a test input image which can be identified by a convolutional neural network based on a short-time Fourier transform algorithm;
and C: inputting the test input image obtained in the step B into the deep learning model trained in the embodiment 1, and extracting the robustness characteristics in the trained deep learning model to obtain the robustness characteristics;
step D: and D, inputting the robustness features extracted in the step C into an extreme learning machine classifier, and detecting schizophrenia and outputting a detection result by the extreme learning machine classifier.
Example 3
This example is based on example 2 and describes the detailed method or preference thereof.
In step 3 of example 1 and step B of example 2, the short-time fourier transform algorithm is completed by the following formula:
Figure BDA0002770928050000041
where z (u) is the electroencephalogram time-series signal at time u, g (u-t) is a window function, f is the electroencephalogram time-series signal sampling rate, j is a complex number, j is 1 × i, and i is an imaginary unit.
In step B, when the obtained test sample is converted into a test input image, short-time fourier transform is performed using a window of 3 seconds.
In the step D, the output detection result is that whether the testee has schizophrenia or does not have schizophrenia is judged according to the electroencephalogram time sequence signal.
The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.

Claims (10)

1. A schizophrenia detection method based on electroencephalogram and deep learning is characterized in that: the method comprises the following steps:
step A: extracting an original electroencephalogram time sequence signal of a person to be tested, and carrying out noise filtering processing on the original electroencephalogram time sequence signal, wherein the electroencephalogram time sequence signal after the noise filtering processing is used as a test sample;
and B: converting the test sample obtained in the step A into a test input image;
and C: inputting the test input image obtained in the step B into a trained deep learning model, and extracting robustness features in the deep learning model to obtain robustness features;
step D: and D, inputting the robustness features extracted in the step C into an extreme learning machine classifier, and detecting schizophrenia and outputting a detection result by the extreme learning machine classifier.
2. The method for detecting schizophrenia as set forth in claim 1, wherein: in the step B, the test sample conversion method is based on a short-time Fourier transform algorithm.
3. The method for detecting schizophrenia as set forth in claim 2, wherein: the short-time Fourier transform algorithm is completed by the following formula:
Figure FDA0002770928040000011
where z (u) is the electroencephalogram time-series signal at time u, g (u-t) is a window function, f is the electroencephalogram time-series signal sampling rate, j is a complex number, j is 1 × i, and i is an imaginary unit.
4. The method for detecting schizophrenia as set forth in claim 3, wherein: when the obtained test sample is converted into a test input image, short-time fourier transform is performed using a window of 3 seconds.
5. The method for detecting schizophrenia as set forth in claim 1, wherein: in the step C, the deep learning model is composed of a convolution neural network and a long-short term memory neural network.
6. The method for detecting schizophrenia as set forth in claim 5, wherein: the convolutional neural network has three layers, the first layer convolution kernel size is 3x (3-20), preferably 3x20, the second layer convolution kernel size is 2x (2-20), preferably 2x20, and the third layer convolution kernel size is 2x (2-20), preferably 2x 20.
7. The method for detecting schizophrenia as set forth in claim 5, wherein: the long-term and short-term memory neural network comprises three layers, wherein the first layer is an input layer, the second layer is a hidden layer, the hidden unit arranged in the hidden layer is 50-200, and the third layer is an output layer.
8. The method for detecting schizophrenia as set forth in claim 7, wherein: the training method of the deep learning model comprises the following steps:
step 1: extracting original electroencephalogram time sequence signals of the schizophrenia patient and the healthy person, and performing noise filtering processing, wherein the electroencephalogram time sequence signals of the schizophrenia patient and the healthy person after the noise filtering processing are used as training samples;
step 2: dividing the training samples extracted in the step 1 into a training set and a verification set;
and step 3: based on a short-time Fourier transform algorithm, respectively converting the training set and the verification set divided in the step (2) into a training set input image and a verification set input image which can be identified by a convolutional neural network, wherein the training set input image and the verification set input image form a model input image set;
and 4, step 4: inputting the model input image set obtained by conversion in the step 3 into the deep learning model, extracting robustness characteristics, and training optimal parameters of the deep learning model;
and 5: and (4) outputting the optimal parameters of the deep learning model trained in the step (4) and applying the optimal parameters to the deep learning model in the testing stage.
9. The method for detecting schizophrenia as set forth in claim 7, wherein: in step 2, the number of the electroencephalogram time sequences in the training set is 70% of the total number of the electroencephalogram time sequences in the training sample, and the number of the electroencephalogram time sequences in the verification set is 30% of the total number of the electroencephalogram time sequences in the training sample.
10. The method for detecting schizophrenia as set forth in claim 1, wherein: in step D, the output detection result is whether schizophrenia is output or not.
CN202011248815.3A 2020-11-10 2020-11-10 Schizophrenia detection method based on electroencephalogram and deep learning Pending CN112244875A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202011248815.3A CN112244875A (en) 2020-11-10 2020-11-10 Schizophrenia detection method based on electroencephalogram and deep learning
CN202110182451.1A CN112790774A (en) 2020-11-10 2021-02-07 Original electroencephalogram deep learning classification method and application

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011248815.3A CN112244875A (en) 2020-11-10 2020-11-10 Schizophrenia detection method based on electroencephalogram and deep learning

Publications (1)

Publication Number Publication Date
CN112244875A true CN112244875A (en) 2021-01-22

Family

ID=74265328

Family Applications (2)

Application Number Title Priority Date Filing Date
CN202011248815.3A Pending CN112244875A (en) 2020-11-10 2020-11-10 Schizophrenia detection method based on electroencephalogram and deep learning
CN202110182451.1A Pending CN112790774A (en) 2020-11-10 2021-02-07 Original electroencephalogram deep learning classification method and application

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN202110182451.1A Pending CN112790774A (en) 2020-11-10 2021-02-07 Original electroencephalogram deep learning classification method and application

Country Status (1)

Country Link
CN (2) CN112244875A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113812933A (en) * 2021-09-18 2021-12-21 重庆大学 Acute myocardial infarction real-time early warning system based on wearable equipment

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107153825A (en) * 2017-05-23 2017-09-12 哈尔滨理工大学 A kind of epileptic electroencephalogram (eeg) sorting technique based on SVMs
CN107693014A (en) * 2017-11-22 2018-02-16 北京工业大学 A kind of epileptic attack method for early warning based on bag of words and extreme learning machine
CN110477865A (en) * 2019-08-14 2019-11-22 深圳先进技术研究院 A kind of epileptic attack detection device, terminal device and storage medium
CN111631848B (en) * 2020-05-31 2023-05-05 天津大学 Ideation control artificial limb system based on brain-computer hybrid intelligence
CN111881812B (en) * 2020-07-24 2021-10-08 中国中医科学院针灸研究所 Multi-modal emotion analysis method and system based on deep learning for acupuncture

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113812933A (en) * 2021-09-18 2021-12-21 重庆大学 Acute myocardial infarction real-time early warning system based on wearable equipment

Also Published As

Publication number Publication date
CN112790774A (en) 2021-05-14

Similar Documents

Publication Publication Date Title
Sarawgi et al. Multimodal inductive transfer learning for detection of Alzheimer's dementia and its severity
Arora et al. Developing a large scale population screening tool for the assessment of Parkinson's disease using telephone-quality voice
CN108542386B (en) Sleep state detection method and system based on single-channel EEG signal
CN111461176A (en) Multi-mode fusion method, device, medium and equipment based on normalized mutual information
Yuan et al. A novel wavelet-based model for eeg epileptic seizure detection using multi-context learning
Chen et al. Automatic detection of Alzheimer’s disease using spontaneous speech only
CN112043252A (en) Emotion recognition system and method based on respiratory component in pulse signal
CN116821809B (en) Vital sign data acquisition system based on artificial intelligence
CN108567418A (en) A kind of pulse signal inferior health detection method and detecting system based on PCANet
CN113674767A (en) Depression state identification method based on multi-modal fusion
CN113069117A (en) Electroencephalogram emotion recognition method and system based on time convolution neural network
CN112244875A (en) Schizophrenia detection method based on electroencephalogram and deep learning
CN113796873B (en) Wearable dynamic electrocardiosignal classification method and system
Sanjeev et al. Deep learning-based mixed data approach for COVID-19 detection
CN111798980A (en) Complex medical biological signal processing method and device based on deep learning network
CN115273236A (en) Multi-mode human gait emotion recognition method
Whitehill et al. Whosecough: In-the-wild cougher verification using multitask learning
CN112466284B (en) Mask voice identification method
Guo et al. Monitor blood glucose levels via breath analysis system and sparse representation approach
Mahdi et al. A Customized Iomt-Cloud Based Healthcare System For Analyzing of Brain Signals Via Supervised Mining Algorithms
CN113571050A (en) Voice depression state identification method based on Attention and Bi-LSTM
CN113948203A (en) Fast prediction method based on convolutional neural network
CN112069897A (en) Knowledge graph-based voice and micro-expression recognition suicide emotion sensing method
Bhavya et al. Machine learning applied to speech emotion analysis for depression recognition
Zhao et al. A CNN-Based Method for Depression Detecting Form Audio

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20210122

WD01 Invention patent application deemed withdrawn after publication