CN109864750A - Based on the state of mind assessment and regulating system and its working method stimulated through cranium - Google Patents

Based on the state of mind assessment and regulating system and its working method stimulated through cranium Download PDF

Info

Publication number
CN109864750A
CN109864750A CN201910098685.0A CN201910098685A CN109864750A CN 109864750 A CN109864750 A CN 109864750A CN 201910098685 A CN201910098685 A CN 201910098685A CN 109864750 A CN109864750 A CN 109864750A
Authority
CN
China
Prior art keywords
state
mind
stimulation
cranium
physiological signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910098685.0A
Other languages
Chinese (zh)
Inventor
贾雪
张通
陈俊龙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
South China University of Technology SCUT
Original Assignee
South China University of Technology SCUT
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by South China University of Technology SCUT filed Critical South China University of Technology SCUT
Priority to CN201910098685.0A priority Critical patent/CN109864750A/en
Publication of CN109864750A publication Critical patent/CN109864750A/en
Pending legal-status Critical Current

Links

Landscapes

  • Magnetic Treatment Devices (AREA)

Abstract

The present invention provides a kind of based on the state of mind stimulated through cranium assessment and regulating system, it is characterised in that: includes: the physiological signal collection module for acquiring subject's physiological signal;For physiological signal to be pre-processed, feature extraction and the state of mind analysis assessment obtain state of mind assessment result state of mind evaluation module;For judging state of mind assessment result and adjusting the control equipment of stimulation parameter according to state of mind assessment result;And for being carried out through cranium stimulation subject through cranium stimulation apparatus according to stimulation parameter.State of mind assessment can be adjusted the targeted state of mind of subject's progress personalization with regulating system, have good state of mind regulating effect, easy to use effective, with the advantages such as non-invasive, validity, safety, easy to operate.The present invention also provides the working methods of a kind of above-mentioned state of mind assessment and regulating system.

Description

Based on the state of mind assessment and regulating system and its working method stimulated through cranium
Technical field
The present invention relates to state of mind assessments and regulation technology field, are based on stimulating through cranium more specifically to one kind The state of mind assessment with regulating system and its working method.
Background technique
The method that the existing state of mind is adjusted is mostly self-control, for example listens the music releived to adjust the feelings of anxiety Thread sees some videos made laughs to adjust dejected mood etc..But for the Asia with state of mind such as severe anxiety, depressions For healthy population, self-control tends not to play the role of good, needs to adjust the state of mind by external force, for example do Psychotherapy, drug alleviation etc..
Effectively to adjust the state of mind, also have at present using electrical stimulation method, including transcranial magnetic stimulation (TMS), through cranium electricity (TES), TCD,transcranial Doppler stimulation (TUS) are stimulated, there is biological effect really, can be adjusted with reversible change nerve conductivity Brains balance state and corticocerebral neuron activity, and nerve fiber is not caused to damage, that is, there is the nerve of safety to adjust Energy saving power is suitable for affective disease and functional lesion, such as influences sleep, speech function, motor function and mood, has simultaneously Effective, painless and noninvasive wound is easy to repeat and the clear advantages such as easy to operate.
But existing electronic stimulation or adjusting method are simple low-frequency electrical stimulation pulse, subject is in passive Treatment or regulative mode, due to after there is no subject to receive electro photoluminescence detection feedback, cause therapeutic modality single, treated Journey does not have data reference;And existing stimulating system is mostly that relevant stimulation parameter is selected according to the experience of professional, such as Stimulus intensity, frequency of stimulation, stimulation time cannot carry out dynamic regulation to effect of stimulation quantification, and according to quantized result.By Different to the tolerance stimulated through cranium in different people, tradition empirically manually selects stimulation parameter mode and is difficult to accurate judgement people Body tolerance and adjust stimulation parameter.In conclusion empirical parameter setting and traditional stimulus modality are difficult to meet individual character The Treatment need of change is easy to cause excessive stimulation or stimulation insufficient, cannot reach the effective or optimal state of mind and adjust Effect.
Summary of the invention
To overcome shortcoming and deficiency of the prior art, it is based on stimulating through cranium it is an object of the present invention to provide one kind The state of mind assessment and regulating system;State of mind assessment can carry out subject with regulating system personalized targeted The state of mind adjust, have good state of mind regulating effect, it is easy to use effectively, have non-invasive, validity, safety The advantages such as property, easy to operate.It is another object of the present invention to provide the works of a kind of above-mentioned state of mind assessment and regulating system Make method;The working method adapts to demand of the different people to different tolerance power, can carry out to subject personalized targeted The state of mind is adjusted, and has good state of mind regulating effect, easy to use effective.
In order to achieve the above object, the technical scheme is that: it is a kind of based on the essence stimulated through cranium Refreshing status assessment and regulating system, it is characterised in that: include:
For acquiring the physiological signal collection module of subject's physiological signal;
For physiological signal to be pre-processed, feature extraction and the state of mind analysis assessment obtain the state of mind assessment knot The state of mind evaluation module of fruit;
Control for judging state of mind assessment result and adjust stimulation parameter according to state of mind assessment result is set It is standby;
And for being carried out through cranium stimulation subject through cranium stimulation apparatus according to stimulation parameter;
The physiological signal collection module, state of mind evaluation module, control equipment and through cranium stimulation apparatus successively signal Connection.
The present invention adjusts the stimulation parameter of transcranial magnetic stimulation according to state of mind assessment result Intelligent Dynamic, big to subject Brain stimulate through cranium, adjusts Cortical Neurons activity, to sway the emotion, adjusts the state of mind;It is easy to use effective, Personalized, the targeted state of mind can be carried out to subject to adjust.The present invention is used through cranium stimulation mode, is realized to bad The intervention and adjusting of the state of mind;It, can be with reversible change nerve with the advantages such as non-invasive, validity, safety, easy to operate Conductivity, and nerve fiber is not caused to damage, that is, there is the nerve modulation ability of safety;It can pacify using through cranium stimulating technology Entirely, the inferior health state of mind is effectively adjusted.
Preferably, it is wearable in intelligence to refer respectively to setting for the physiological signal collection module and state of mind evaluation module Physiological signal collection module and state of mind evaluation module in equipment.
It preferably, further include cloud platform for storing and managing state of mind assessment result and physiological signal, cloud platform It is connect with state of mind evaluation module signal.Cloud platform be mainly responsible for storing, handle and analyze collected physiological signal with And state of mind assessment result, facilitate the data management and application in later period, state of mind assessment models can also be corrected.
The above-mentioned working method based on the state of mind stimulated through cranium assessment and regulating system, it is characterised in that: including such as Lower step:
S1 step, before subject receives to stimulate through cranium, physiological signal collection module acquires the physiology letter before subject's stimulation Number, and it is sent to control equipment;Set reference stimuli parameter;
S2 step carries out reference stimuli to subject according to reference stimuli parameter through cranium stimulation apparatus;Physiological signal collection mould The post-stimulatory physiological signal of block acquisition subject is simultaneously sent to control equipment, the physiological signal and thorn before control equipment judgement stimulation The amplitude of variation of physiological signal after swashing: if amplitude of variation is not up to setting range, reference stimuli parameter is adjusted, and hold again Row S2 step;If amplitude of variation reaches setting range, the tolerance of reference stimuli matching subject this moment is determined, it will this moment Reference stimuli parameter as initialization stimulation parameter;
S3 step, the physiological signal of physiological signal collection module acquisition subject are simultaneously sent to state of mind evaluation module;Essence Refreshing state estimation module pre-processes physiological signal, the analysis assessment of feature extraction and the state of mind obtains state of mind assessment As a result, state of mind assessment result includes type of emotion and intensity;
Physiological signal and state of mind assessment result are sent to control equipment by S4 step, state of mind evaluation module;Control Equipment judges state of mind assessment result with the presence or absence of negative emotions: if type of emotion includes negative in state of mind assessment result Face mood, then control equipment according to state of mind assessment result and initialization stimulation parameter generate control signal, and be sent to through Cranium stimulation apparatus, and skip to S5 step;Otherwise S3 step is jumped directly to;
S5 step receives control signal through cranium stimulation apparatus, and adjusts stimulation parameter according to control signal, through cranium stimulation apparatus Subject stimulate through cranium according to stimulation parameter, to adjust through cranium stimulation apparatus to the thorn of subject's Cortical Neurons Swash, to adjust the state of mind of subject;After stimulating through cranium, S3 step is skipped to.
The present invention carries out stimulation parameter personalization initialization using reference stimuli, to adapt to different people to different tolerance power Demand, and according to state of mind assessment result Intelligent Dynamic adjust transcranial magnetic stimulation stimulation parameter, to subject's brain Stimulated through cranium, adjust Cortical Neurons activity, to sway the emotion, adjusts the state of mind;It is easy to use effective, energy Personalized, the targeted state of mind is carried out to subject to adjust.The present invention is used through cranium stimulation mode, is realized to bad essence The intervention and adjusting of refreshing state;It, can be with reversible change neuroelectricity with the advantages such as non-invasive, validity, safety, easy to operate Conductance, and nerve fiber is not caused to damage, that is, there is the nerve modulation ability of safety;It can pacify using through cranium stimulating technology Entirely, the inferior health state of mind is effectively adjusted.
Preferably, described to include any one of transcranial magnetic stimulation, electrical transcranial stimulation and TCD,transcranial Doppler stimulation through cranium stimulation Or it is two or more;
When including transcranial magnetic stimulation through cranium stimulation, when initialization stimulation parameter includes stimulus intensity, frequency of stimulation, stimulation Between and stimulation location;When including electrical transcranial stimulation through cranium stimulation, initialization stimulation parameter includes stimulated current size, electrode choosing It selects and stimulation time;When including TCD,transcranial Doppler stimulation through cranium stimulation, initialization stimulation parameter includes the stimulation power of ultrasonic wave Size, frequency of stimulation and stimulation time.
Trans-skull magnetic stimulating device is discharged by capacitor to coil, and coil generates high-intensity magnetic field, to generate induced electricity in cortex Stream, further causes the changes of function of neuron electro physiology by induced current.Electrical transcranial stimulation is by AC power supply or directly It connects and is powered using battery, positive and negative anodes are accessed into head both ends, electric current flows to cathode by anode, and influences cranial nerve in the process The discharge scenario of member.The stimulation mode of electrical transcranial stimulation includes three kinds, i.e. anode excitation, cathode stimulation and pseudo- stimulation.It is general and Speech, anode excitation can enhance the excitability of stimulation location neuron, and cathode stimulates the excitability for then reducing stimulation location neuron, Puppet stimulation is used as a kind of control stimulation.TCD,transcranial Doppler stimulation is the high-penetration using low-frequency ultrasonic waves, in brain specific region Stimulation inhibits nervous activity.Its mechanism of action is to adjust nervous activity by the mechanism of ultrasound.
Preferably, the physiological signal refers to one of the following two kinds mode:
One, physiological signal refers to EEG signals;
Two, physiological signal includes EEG signals, further include electromyography signal, electro-ocular signal, skin electrical signal, electrocardiosignal, Any one of heart rate signal and broadcasting and TV pulse signal are two or more.
Preferably, in the second way, the S3 step, state of mind evaluation module locates physiological signal in advance Reason, feature extraction and state of mind analysis assessment obtain state of mind assessment result, and refer to: state of mind evaluation module is right respectively Various physiological signals carry out pretreatment and feature extraction, and all obtained features of extracting are carried out multi-modal Fusion Features later, And the Emotion identification of multi-modal Fusion Features data is carried out using deep learning and width learning system, thus to the state of mind into Row analysis assessment obtains state of mind assessment result.
Due to containing a large amount of physiologic information in EEG signals, so the existing commonly mood based on physiological signal is known Other method is mostly to carry out Emotion identification using EEG signals.But the generation of any mood all can be along with the certain of body Variation, such as the amplification of muscular tone, pupil, EEG signals only are used only may lost part emotion information.The present invention uses Multi-modal data, these data can complement each other emotion information, carry out feature extraction and Fusion Features using multi-modal data, Realize Emotion identification and state of mind assessment, accuracy rate is higher.
The present invention realizes mood classification using deep learning+width study algorithm to multi-modal Fusion Features data.It is right It is that feature is extracted using statistical nature or frequency-domain transform mostly, such method is difficult to mention in the feature extraction of EEG signals Abstract high-level feature is got, part emotion information can be also lost.The present invention is in addition to extracting traditional statistical nature, frequency domain change It changes except feature, also using deep learning+width study algorithm, makes full use of deep learning that can extract abstract high-level spy The advantages of sign and width study rapidly and efficiently, the high advantage of accuracy rate, the realization Emotion identification and the state of mind of efficiently and accurately Assessment.
Preferably, the mood for carrying out multi-modal Fusion Features data using deep learning and width learning system is known Not, refer to: one-dimensional multi-modal Fusion Features data being mapped as 2-D data, using the network of deep learning to 2-D data It is handled, extracts the high-level abstract characteristics of 2-D data, mood classification is carried out using width learning system later.
Preferably, physiological signal and state of mind assessment result are also carried out realtime curve by the control equipment.
Compared with prior art, the invention has the advantages that with the utility model has the advantages that
1, spirit of that invention status assessment and regulating system are adjusted according to state of mind assessment result Intelligent Dynamic through cranium magnetic The stimulation parameter of stimulation can carry out personalized, the targeted state of mind to subject and adjust, easy to use effective.This hair Bright intervention and adjusting using through the realization of cranium stimulation mode to the bad state of mind;With non-invasive, validity, safety, easily The advantages such as operation;
2, working method of the present invention carries out stimulation parameter personalization initialization using reference stimuli, to adapt to different people pair The demand of different tolerance power;The stimulation parameter of transcranial magnetic stimulation, user are adjusted according to state of mind assessment result Intelligent Dynamic Just effectively, personalized, the targeted state of mind can be carried out to subject to adjust;The present invention is used and is realized through cranium stimulation mode Intervention and adjusting to the bad state of mind have the advantages such as non-invasive, validity, safety, easy to operate;
3, working method of the present invention use multi-modal data, can complement each other emotion information, using multi-modal data into Row feature extraction and Fusion Features, realize Emotion identification and state of mind assessment, and accuracy rate is higher;
4, working method of the present invention also uses depth other than extracting traditional statistical nature, frequency-domain transform feature The algorithm of habit+width study, the advantages of making full use of deep learning that can extract abstract high-level feature and width study are fast Fast advantage efficient, accuracy rate is high, realization Emotion identification and the state of mind assessment of efficiently and accurately.
Detailed description of the invention
Fig. 1 is the system block diagram of spirit of that invention status assessment and regulating system;
Fig. 2 is the working principle diagram of physiological signal collection module in spirit of that invention status assessment and regulating system;
Fig. 3 is the working principle diagram of state of mind evaluation module in spirit of that invention status assessment and regulating system;
Fig. 4 is the working principle diagram that equipment is controlled in spirit of that invention status assessment and regulating system.
Specific embodiment
The present invention is described in further detail with specific embodiment with reference to the accompanying drawing.
Embodiment
As shown in Figure 1, the present embodiment is a kind of based on the state of mind stimulated through cranium assessment and regulating system, comprising:
For acquiring the physiological signal collection module of subject's physiological signal;
For physiological signal to be pre-processed, feature extraction and the state of mind analysis assessment obtain the state of mind assessment knot The state of mind evaluation module of fruit;
Control for judging state of mind assessment result and adjust stimulation parameter according to state of mind assessment result is set It is standby;
And for being carried out through cranium stimulation subject through cranium stimulation apparatus according to stimulation parameter;
The physiological signal collection module, state of mind evaluation module, control equipment and through cranium stimulation apparatus successively signal Connection.
The present invention adjusts the stimulation parameter of transcranial magnetic stimulation according to state of mind assessment result Intelligent Dynamic, big to subject Brain stimulate through cranium, adjusts Cortical Neurons activity, to sway the emotion, adjusts the state of mind;It is easy to use effective, Personalized, the targeted state of mind can be carried out to subject to adjust.The present invention is used through cranium stimulation mode, is realized to bad The intervention and adjusting of the state of mind;It, can be with reversible change nerve with the advantages such as non-invasive, validity, safety, easy to operate Conductivity, and nerve fiber is not caused to damage, that is, there is the nerve modulation ability of safety;It can pacify using through cranium stimulating technology Entirely, the inferior health state of mind is effectively adjusted.
Physiological signal collection module and state of mind evaluation module are preferably arranged in intelligent wearable device.
Modules are specifically described below:
Physiological signal collection module: as shown in Fig. 2, physiological signal collection module can be used STM32 chip carry out control and Processing, is worn over subject head for intelligent wearable device first, makes electrode that forehead skin and scalp be steadily contacted, then carries out Conduction choice acquires lead EEG signals, electromyography signal and the electro-ocular signal of subject, before collected physiological signal is carried out It puts greatly, to obtain carrying out postposition amplification and filtering operation later than stronger signal, finally exporting physiological signal.
State of mind evaluation module: as shown in figure 3, state of mind evaluation module believes collected EEG signals, myoelectricity Number and three kinds of physiological signals of electro-ocular signal be removed artefact etc. pretreatment, and respectively extract three kinds of physiological signals feature, such as Statistical nature, differential entropy feature, power spectral density, Fourier transformation, wavelet transformation etc., then by the feature of three kinds of physiological signals Multi-modal Fusion Features are carried out, are then known using the mood that deep learning and width learning system carry out multi-modal physiological data Not, to assess the state of mind, such as it is normal, tired, dejected, depression and anxiety, happy, and it is several that intensity, which is arranged, Grade, obtained state of mind assessment result includes type of emotion and intensity.
Control equipment: as shown in figure 4, control equipment includes mobile terminal APP, computer end application etc., intelligent wearable device By physiological signal and state of mind assessment result by Bluetooth transmission to control equipment, control equipment is to physiological signal and spiritual shape State assessment result carries out visualization display;Transcranial magnetic stimulation mode is manually selected by user in control equipment;Stimulation mode can To select one or both of transcranial magnetic stimulation, electrical transcranial stimulation, TCD,transcranial Doppler stimulation or three kinds;Equipment is controlled according to spirit Condition evaluation results come adjust through cranium stimulate stimulation parameter;For transcranial magnetic stimulation, stimulation parameter include stimulus intensity, Frequency of stimulation, stimulation location, stimulation time;For electrical transcranial stimulation, stimulation parameter include electrode selection, size of current, Stimulation time;For the stimulation of TCD,transcranial Doppler wave, when stimulation parameter includes the watt level of ultrasonic wave, frequency size, stimulation Between.Control equipment selects stimulation parameter setting and mode to generate control signal, by Bluetooth transmission to through cranium stimulation apparatus.
Through cranium stimulation apparatus: including that transcranial magnetic stimulation, electrical transcranial stimulation and TCD,transcranial Doppler stimulate through cranium stimulation apparatus.Through cranium Magnetic stimulating device is discharged by capacitor to coil, and coil generates high-intensity magnetic field, to generate induced current in cortex, is further passed through Induced current causes the changes of function of neuron electro physiology.Electrical transcranial stimulation is supplied by AC power supply or directly using battery Positive and negative anodes are accessed head both ends by electricity, and electric current flows to cathode by anode, and influences the electric discharge feelings of brain neuron in the process Condition.The stimulation mode of electrical transcranial stimulation includes three kinds, i.e. anode excitation, cathode stimulation and pseudo- stimulation.In general, anode excitation The excitability of stimulation location neuron can be enhanced, cathode stimulates the excitability for then reducing stimulation location neuron, puppet stimulation conduct A kind of control stimulation.TCD,transcranial Doppler stimulation is the high-penetration using low-frequency ultrasonic waves, stimulates or presses down in brain specific region Nervous activity processed.Its mechanism of action is to adjust nervous activity by the mechanism of ultrasound.
Control module through cranium stimulation apparatus receives the control signal transmitted from control equipment, according to control signal Information, to select to be arranged through cranium stimulation mode through cranium stimulation parameter, then generating to subject head is stimulated through cranium, adjusts quilt The cerebral cortex activity of examination person adjusts the state of mind to alleviate negative feeling.
State of mind assessment and regulating system further include for storing and managing state of mind assessment result and physiological signal Cloud platform, cloud platform connect with state of mind evaluation module signal.Cloud platform is mainly responsible for storage, processing and analysis acquisition The physiological signal and state of mind assessment result arrived, facilitates the data management and application in later period, can also comment the state of mind Estimate model to be corrected.
In the present embodiment, physiological signal collection module acquires EEG signals, electromyography signal and electro-ocular signal;Practical application In, physiological signal collection module can be acquisition EEG signals except, also acquisition electromyography signal, electro-ocular signal, skin electrical signal, Any one of electrocardiosignal, heart rate signal and broadcasting and TV pulse signal are two or more.
Present system is suitable for the adjusting that sub-health population carries out unhealthy emotion (tired, depressed, dejected, anxiety etc.), Be also applied for normal person carry out mood loosen and stress reduction.
The working method of the above-mentioned state of mind assessment and regulating system, includes the following steps:
S1 step, before subject receives to stimulate through cranium, physiological signal collection module acquires the physiology letter before subject's stimulation Number, and it is sent to control equipment;Set reference stimuli parameter;
S2 step carries out reference stimuli to subject according to reference stimuli parameter through cranium stimulation apparatus;Physiological signal collection mould The post-stimulatory physiological signal of block acquisition subject is simultaneously sent to control equipment, the physiological signal and thorn before control equipment judgement stimulation The amplitude of variation of physiological signal after swashing: if amplitude of variation is not up to setting range, reference stimuli parameter is adjusted, and hold again Row S2 step;If amplitude of variation reaches setting range, the tolerance of reference stimuli matching subject this moment is determined, it will this moment Reference stimuli parameter as initialization stimulation parameter;
In S1 step, before subject receives to stimulate through cranium, physiological signal collection module acquires the physiology before subject's stimulation Signal extracts neuron activity intensity data.In S2 step, physiological signal collection module acquires the post-stimulatory physiology letter of subject Number, to obtain neuron activity intensity.Neuron activity intensity and post-stimulatory neuron before controlling equipment judgement stimulation is living The amplitude of variation of fatigue resistance adjusts reference stimuli parameter.
S3 step, the physiological signal of physiological signal collection module acquisition subject are simultaneously sent to state of mind evaluation module;Essence Refreshing state estimation module pre-processes physiological signal, the analysis assessment of feature extraction and the state of mind obtains state of mind assessment As a result, state of mind assessment result includes type of emotion and intensity;
Physiological signal and state of mind assessment result are sent to control equipment by S4 step, state of mind evaluation module;Control Equipment judges state of mind assessment result with the presence or absence of negative emotions: if type of emotion includes negative in state of mind assessment result Face mood, then control equipment according to state of mind assessment result and initialization stimulation parameter generate control signal, and be sent to through Cranium stimulation apparatus, and skip to S5 step;Otherwise S3 step is jumped directly to;Negative emotions include tired, depressed, dejected, anxiety;
S5 step receives control signal through cranium stimulation apparatus, and adjusts stimulation parameter according to control signal, through cranium stimulation apparatus Subject stimulate through cranium according to stimulation parameter, to adjust through cranium stimulation apparatus to the thorn of subject's Cortical Neurons Swash, to adjust the state of mind of subject;After stimulating through cranium, S3 step is skipped to.
The present invention carries out stimulation parameter personalization initialization using reference stimuli, to adapt to different people to different tolerance power Demand, and according to state of mind assessment result Intelligent Dynamic adjust transcranial magnetic stimulation stimulation parameter, be easy to use Effectively, personalized, the targeted state of mind can be carried out to subject to adjust.The present invention is used through cranium stimulation mode, is realized Intervention and adjusting to the bad state of mind;With the advantages such as non-invasive, validity, safety, easy to operate, can be changed with invertibity Become neural conductivity, and nerve fiber is not caused to damage, that is, there is the nerve modulation ability of safety;Using through cranium stimulating technology It can the safe and effective adjusting inferior health state of mind.
It is described through cranium stimulation include transcranial magnetic stimulation, electrical transcranial stimulation and TCD,transcranial Doppler stimulation any one of or two kinds with On;When through cranium stimulation include transcranial magnetic stimulation when, initialization stimulation parameter include stimulus intensity, frequency of stimulation, stimulation time and Stimulation location;When through cranium stimulation include electrical transcranial stimulation when, initialization stimulation parameter include stimulated current size, electrode selection and Stimulation time;When through cranium stimulation include TCD,transcranial Doppler stimulation when, initialization stimulation parameter include ultrasonic wave stimulation power size, Frequency of stimulation and stimulation time.
The physiological signal refers to one of the following two kinds mode:
One, physiological signal refers to EEG signals;
Two, physiological signal includes EEG signals, further include electromyography signal, electro-ocular signal, skin electrical signal, electrocardiosignal, Any one of heart rate signal and broadcasting and TV pulse signal are two or more.
In the second way, the S3 step, state of mind evaluation module pre-processes physiological signal, feature mentions It takes and analyzes assessment acquisition state of mind assessment result with the state of mind, refer to: state of mind evaluation module is respectively to various physiology Signal carries out pretreatment and feature extraction, all obtained features of extracting is carried out multi-modal Fusion Features later, and using deep Degree study and width learning system carry out the Emotion identification of multi-modal Fusion Features data, comment to carry out analysis to the state of mind Estimate and obtains state of mind assessment result.
Due to containing a large amount of physiologic information in EEG signals, so the existing commonly mood based on physiological signal is known Other method is mostly to carry out Emotion identification using EEG signals.But the generation of any mood all can be along with the certain of body Variation, such as the amplification of muscular tone, pupil, EEG signals only are used only may lost part emotion information.The present invention uses Multi-modal data, these data can complement each other emotion information, carry out feature extraction and Fusion Features using multi-modal data, Realize Emotion identification and state of mind assessment, accuracy rate is higher.
Illustrate multi-modal Fusion Features by taking three kinds of EEG signals, electromyography signal and electro-ocular signal features as an example.
Fusion Features are carried out using Multilayer networks method.
If the feature of EEG signals is A=[a1, a2, a3, a4.....an], the feature of electromyography signal be B=[b1, b2, B3, b4....bm], the feature of electro-ocular signal is C=[c1, c2, c3, c4.....cp];
For A feature, n classifier of training is denoted as f1, f2....fn, then carries out following operation:
Xi=fi (ai), i=1.2.3....n;
For B feature, m classifier of training is denoted as g1.g2....gn, then carries out following operation:
Yj=gj (bj), j=1.2.3....m;
For C feature, p classifier of training is denoted as h1.h2....hp, then carries out following operation:
Zk=hk (ck), k=1.2.3....p;
Three classifiers g, f, h are selected as identical model, such as are all Bayes or are all svm, and not point The output of class device is set as classification, and is the probability of a certain classification.It is as follows as united feature that probability density is obtained in this way:
D=[x1, x2, x3.....xn, y1, y2, y3......ym, z1, z2, z3......zp];
The present invention realizes mood classification using deep learning+width study algorithm to multi-modal Fusion Features data.It is right It is that feature is extracted using statistical nature or frequency-domain transform mostly, such method is difficult to mention in the feature extraction of EEG signals Abstract high-level feature is got, part emotion information can be also lost.The present invention is in addition to extracting traditional statistical nature, frequency domain change It changes except feature, also using deep learning+width study algorithm, makes full use of deep learning that can extract abstract high-level spy The advantages of sign and width study rapidly and efficiently, the high advantage of accuracy rate, the realization Emotion identification and the state of mind of efficiently and accurately Assessment.
Deep learning algorithm, including CNN, RNN, DBN, LSTM, GCNN even depth learning algorithm;Width learning algorithm includes Width learning system (BLS).
The Emotion identification that multi-modal Fusion Features data are carried out using deep learning and width learning system, is referred to: by one The multi-modal Fusion Features data of dimension are mapped as 2-D data, are handled using the network of deep learning 2-D data, are mentioned The high-level abstract characteristics of 2-D data are taken, mood classification is carried out using width learning system later.
It controls equipment and physiological signal and state of mind assessment result is also subjected to realtime curve.
The above embodiment is a preferred embodiment of the present invention, but embodiments of the present invention are not by above-described embodiment Limitation, other any changes, modifications, substitutions, combinations, simplifications made without departing from the spirit and principles of the present invention, It should be equivalent substitute mode, be included within the scope of the present invention.

Claims (9)

1. a kind of based on the state of mind stimulated through cranium assessment and regulating system, it is characterised in that: include:
For acquiring the physiological signal collection module of subject's physiological signal;
For physiological signal to be pre-processed, the analysis assessment of feature extraction and the state of mind obtain state of mind assessment result State of mind evaluation module;
For judging state of mind assessment result and adjusting the control equipment of stimulation parameter according to state of mind assessment result;
And for being carried out through cranium stimulation subject through cranium stimulation apparatus according to stimulation parameter;
The physiological signal collection module, state of mind evaluation module, control equipment and successively signal connects through cranium stimulation apparatus.
2. according to claim 1 based on the state of mind stimulated through cranium assessment and regulating system, it is characterised in that: described The physiological signal that physiological signal collection module and state of mind evaluation module refer respectively to be arranged in intelligent wearable device is adopted Collect module and state of mind evaluation module.
3. according to claim 1 based on the state of mind stimulated through cranium assessment and regulating system, it is characterised in that: also wrap The cloud platform for storing and managing state of mind assessment result and physiological signal is included, cloud platform and state of mind evaluation module are believed Number connection.
4. a kind of according to any one of claim 1 to 3 based on the state of mind stimulated through cranium assessment and regulating system Working method, characterized by the following steps:
S1 step, before subject receives to stimulate through cranium, physiological signal collection module acquires the physiological signal before subject's stimulation, and It is sent to control equipment;Set reference stimuli parameter;
S2 step carries out reference stimuli to subject according to reference stimuli parameter through cranium stimulation apparatus;Physiological signal collection module is adopted The post-stimulatory physiological signal of collection subject is simultaneously sent to control equipment, after the physiological signal and stimulation before control equipment judgement stimulation Physiological signal amplitude of variation: if amplitude of variation is not up to setting range, adjust reference stimuli parameter, and re-execute S2 Step;If amplitude of variation reaches setting range, the tolerance of reference stimuli matching subject this moment is determined, by base this moment Quasi- stimulation parameter is as initialization stimulation parameter;
S3 step, the physiological signal of physiological signal collection module acquisition subject are simultaneously sent to state of mind evaluation module;Spiritual shape State evaluation module pre-processes physiological signal, the analysis assessment of feature extraction and the state of mind obtains state of mind assessment knot Fruit, state of mind assessment result include type of emotion and intensity;
Physiological signal and state of mind assessment result are sent to control equipment by S4 step, state of mind evaluation module;Control equipment Judge state of mind assessment result with the presence or absence of negative emotions: if type of emotion includes negative feelings in state of mind assessment result Thread then controls equipment according to state of mind assessment result and initialization stimulation parameter and generates control signal, and is sent to and pierces through cranium Swash equipment, and skips to S5 step;Otherwise S3 step is jumped directly to;
S5 step, through cranium stimulation apparatus receive control signal, and according to control signal adjust stimulation parameter, through cranium stimulation apparatus according to Stimulation parameter stimulate through cranium to subject, to adjust the stimulation through cranium stimulation apparatus to subject's Cortical Neurons, To adjust the state of mind of subject;After stimulating through cranium, S3 step is skipped to.
5. working method according to claim 4, it is characterised in that: described stimulate through cranium includes transcranial magnetic stimulation, through cranium Any one of electro photoluminescence and TCD,transcranial Doppler stimulation are two or more;
When through cranium stimulation include transcranial magnetic stimulation when, initialization stimulation parameter include stimulus intensity, frequency of stimulation, stimulation time and Stimulation location;When through cranium stimulation include electrical transcranial stimulation when, initialization stimulation parameter include stimulated current size, electrode selection and Stimulation time;When through cranium stimulation include TCD,transcranial Doppler stimulation when, initialization stimulation parameter include ultrasonic wave stimulation power size, Frequency of stimulation and stimulation time.
6. working method according to claim 4, it is characterised in that: the physiological signal refer to the following two kinds mode it One:
One, physiological signal refers to EEG signals;
Two, physiological signal includes EEG signals, further includes electromyography signal, electro-ocular signal, skin electrical signal, electrocardiosignal, heart rate Any one of signal and broadcasting and TV pulse signal are two or more.
7. working method according to claim 6, it is characterised in that: in the second way, the S3 step, spiritual shape State evaluation module pre-processes physiological signal, the analysis assessment of feature extraction and the state of mind obtains state of mind assessment knot Fruit refers to: state of mind evaluation module carries out pretreatment and feature extraction to various physiological signals respectively, later by all extractions Obtained feature carries out multi-modal Fusion Features, and carries out multi-modal Fusion Features number using deep learning and width learning system According to Emotion identification, thus to the state of mind carry out analysis assessment obtain state of mind assessment result.
8. working method according to claim 7, it is characterised in that: it is described using deep learning and width learning system into The Emotion identification of the multi-modal Fusion Features data of row, refers to: one-dimensional multi-modal Fusion Features data is mapped as 2-D data, 2-D data is handled using the network of deep learning, extracts the high-level abstract characteristics of 2-D data, later using width It spends learning system and carries out mood classification.
9. working method according to claim 4, it is characterised in that: the control equipment is also by physiological signal and spiritual shape State assessment result carries out realtime curve.
CN201910098685.0A 2019-01-31 2019-01-31 Based on the state of mind assessment and regulating system and its working method stimulated through cranium Pending CN109864750A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910098685.0A CN109864750A (en) 2019-01-31 2019-01-31 Based on the state of mind assessment and regulating system and its working method stimulated through cranium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910098685.0A CN109864750A (en) 2019-01-31 2019-01-31 Based on the state of mind assessment and regulating system and its working method stimulated through cranium

Publications (1)

Publication Number Publication Date
CN109864750A true CN109864750A (en) 2019-06-11

Family

ID=66918403

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910098685.0A Pending CN109864750A (en) 2019-01-31 2019-01-31 Based on the state of mind assessment and regulating system and its working method stimulated through cranium

Country Status (1)

Country Link
CN (1) CN109864750A (en)

Cited By (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110859593A (en) * 2019-08-22 2020-03-06 西安八水健康科技有限公司 Sleep stage automatic division algorithm based on width neural network
CN110947075A (en) * 2019-11-27 2020-04-03 华南理工大学 Personalized mental state adjusting system and method based on brainwave music
CN110947076A (en) * 2019-11-27 2020-04-03 华南理工大学 Intelligent brain wave music wearable device capable of adjusting mental state
CN111407257A (en) * 2020-03-27 2020-07-14 中国医学科学院生物医学工程研究所 Device for synchronously acquiring animal intracranial nerve electrical signals under transcranial ultrasonic action
CN111477299A (en) * 2020-04-08 2020-07-31 广州艾博润医疗科技有限公司 Method and device for regulating and controlling sound-electricity stimulation nerves by combining electroencephalogram detection and analysis control
CN111631688A (en) * 2020-06-24 2020-09-08 电子科技大学 Algorithm for automatic sleep staging
CN112215095A (en) * 2020-09-24 2021-01-12 西北工业大学 Contraband detection method, device, processor and security inspection system
CN112244792A (en) * 2020-10-30 2021-01-22 北京应激魔方数字科技有限公司 Multidimensional stress management system and method
CN113180661A (en) * 2021-04-07 2021-07-30 北京脑陆科技有限公司 Method and system for regulating and controlling anxiety state based on EEG signal
CN113180702A (en) * 2021-04-07 2021-07-30 北京脑陆科技有限公司 Alzheimer's disease nerve regulation and control method and system based on EEG signal
CN113180662A (en) * 2021-04-07 2021-07-30 北京脑陆科技有限公司 EEG signal-based anxiety state intervention method and system
CN113208617A (en) * 2021-04-06 2021-08-06 北京脑陆科技有限公司 Anxiety state nerve regulation and control method and system based on EEG signal
CN113208626A (en) * 2021-04-07 2021-08-06 北京脑陆科技有限公司 Emotional state regulation and control method and system based on EEG signal
CN113244533A (en) * 2021-06-24 2021-08-13 景昱医疗器械(长沙)有限公司 Parameter adjusting method and device, electronic equipment and computer readable storage medium
CN113499085A (en) * 2021-06-16 2021-10-15 南京曦光信息科技研究院有限公司 Self-learning type chronic neurological disease risk assessment and regulation device
CN114081490A (en) * 2021-11-02 2022-02-25 北京理工大学 System and method for mental state monitoring and treatment based on closed-loop feedback
CN114272523A (en) * 2021-12-27 2022-04-05 燕山大学 Portable animal transcranial ultrasonic stimulation and brain and muscle electric wireless acquisition system
CN115067968A (en) * 2021-08-31 2022-09-20 北京未名脑脑科技有限公司 Neural modulation systems and methods
CN115105714A (en) * 2022-03-09 2022-09-27 中国人民解放军陆军军医大学士官学校 Psychological stress assessment and regulation system applied to teaching and operation method thereof
WO2023005353A1 (en) * 2021-07-30 2023-02-02 苏州景昱医疗器械有限公司 Configuration information acquisition apparatus based on multi-modal data, and related device
CN116616708A (en) * 2023-05-22 2023-08-22 深圳市腾进达信息技术有限公司 Vital sign data processing method and system based on intelligent wearable device

Citations (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101569778A (en) * 2009-03-10 2009-11-04 深圳先进技术研究院 Biofeedback simulation system and biofeedback simulation method
CN202096603U (en) * 2011-05-26 2012-01-04 沈阳助邦科技有限公司 Multifunctional depressive anxiety therapeutic apparatus
CN103764021A (en) * 2011-05-20 2014-04-30 南洋理工大学 Systems, apparatuses, devices, and processes for synergistic neuro-physiological rehabilitation and/or functional development
CN103917271A (en) * 2011-10-14 2014-07-09 奈科斯迪姆公司 Method and apparatus for determining effects of transcranial magnetic stimulation to a brain
CN104394931A (en) * 2013-03-15 2015-03-04 奈科斯迪姆公司 Method and system for tms dose assessment and seizure detection
CN204411500U (en) * 2014-12-23 2015-06-24 先進電子醫療工業有限公司 Wear-type controlled in wireless electrical transcranial stimulation instrument
CN105943031A (en) * 2016-05-17 2016-09-21 西安交通大学 Wearable transcranial ultrasound nerve stimulation and electrophysiological recording combined system and method
CN106344009A (en) * 2016-10-13 2017-01-25 深圳双盈国际贸易有限公司 Brain function rehabilitation assisting device based on bioelectrical feedback
CN106922125A (en) * 2014-08-29 2017-07-04 因赛飞公司 For physiology and machine information to be combined to increase powerful method and system
CN107174735A (en) * 2016-03-10 2017-09-19 福特全球技术公司 It is a kind of for vehicle through cranial nerve stimulating system
CN108078565A (en) * 2017-12-14 2018-05-29 上海惠诚科教器械股份有限公司 A kind of sleep monitor feedback and the automatic improvement device of sleep
CN108744282A (en) * 2018-08-27 2018-11-06 张树成 A kind of control method and device improving biofeedback therapy efficiency
CN109009173A (en) * 2018-08-30 2018-12-18 北京机械设备研究所 It is a kind of based on brain electricity-eye movement bimodal signal fatigue detecting and regulation method
CN109009103A (en) * 2018-08-31 2018-12-18 华南理工大学 The detection of the biofeedback type disturbance of consciousness and wake-up system
CN109106346A (en) * 2018-07-24 2019-01-01 深圳市是源医学科技有限公司 Depressive emotion screening and regulating system
CN109157231A (en) * 2018-10-24 2019-01-08 阿呆科技(北京)有限公司 Portable multi-channel Depression trend assessment system based on emotional distress task

Patent Citations (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101569778A (en) * 2009-03-10 2009-11-04 深圳先进技术研究院 Biofeedback simulation system and biofeedback simulation method
CN103764021A (en) * 2011-05-20 2014-04-30 南洋理工大学 Systems, apparatuses, devices, and processes for synergistic neuro-physiological rehabilitation and/or functional development
CN202096603U (en) * 2011-05-26 2012-01-04 沈阳助邦科技有限公司 Multifunctional depressive anxiety therapeutic apparatus
CN103917271A (en) * 2011-10-14 2014-07-09 奈科斯迪姆公司 Method and apparatus for determining effects of transcranial magnetic stimulation to a brain
CN104394931A (en) * 2013-03-15 2015-03-04 奈科斯迪姆公司 Method and system for tms dose assessment and seizure detection
CN106922125A (en) * 2014-08-29 2017-07-04 因赛飞公司 For physiology and machine information to be combined to increase powerful method and system
CN204411500U (en) * 2014-12-23 2015-06-24 先進電子醫療工業有限公司 Wear-type controlled in wireless electrical transcranial stimulation instrument
CN107174735A (en) * 2016-03-10 2017-09-19 福特全球技术公司 It is a kind of for vehicle through cranial nerve stimulating system
CN105943031A (en) * 2016-05-17 2016-09-21 西安交通大学 Wearable transcranial ultrasound nerve stimulation and electrophysiological recording combined system and method
CN106344009A (en) * 2016-10-13 2017-01-25 深圳双盈国际贸易有限公司 Brain function rehabilitation assisting device based on bioelectrical feedback
CN108078565A (en) * 2017-12-14 2018-05-29 上海惠诚科教器械股份有限公司 A kind of sleep monitor feedback and the automatic improvement device of sleep
CN109106346A (en) * 2018-07-24 2019-01-01 深圳市是源医学科技有限公司 Depressive emotion screening and regulating system
CN108744282A (en) * 2018-08-27 2018-11-06 张树成 A kind of control method and device improving biofeedback therapy efficiency
CN109009173A (en) * 2018-08-30 2018-12-18 北京机械设备研究所 It is a kind of based on brain electricity-eye movement bimodal signal fatigue detecting and regulation method
CN109009103A (en) * 2018-08-31 2018-12-18 华南理工大学 The detection of the biofeedback type disturbance of consciousness and wake-up system
CN109157231A (en) * 2018-10-24 2019-01-08 阿呆科技(北京)有限公司 Portable multi-channel Depression trend assessment system based on emotional distress task

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
潘瑞(PERRY FORDSON): "基于多模态人体数据情绪识别及特征学习方法研究", 《中国优秀硕士学位论文全文数据库 信息科技辑 2019年》 *

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110859593A (en) * 2019-08-22 2020-03-06 西安八水健康科技有限公司 Sleep stage automatic division algorithm based on width neural network
CN110947075A (en) * 2019-11-27 2020-04-03 华南理工大学 Personalized mental state adjusting system and method based on brainwave music
CN110947076A (en) * 2019-11-27 2020-04-03 华南理工大学 Intelligent brain wave music wearable device capable of adjusting mental state
CN111407257A (en) * 2020-03-27 2020-07-14 中国医学科学院生物医学工程研究所 Device for synchronously acquiring animal intracranial nerve electrical signals under transcranial ultrasonic action
CN111407257B (en) * 2020-03-27 2023-03-24 中国医学科学院生物医学工程研究所 Device for synchronously acquiring animal intracranial nerve electrical signals under transcranial ultrasonic action
CN111477299A (en) * 2020-04-08 2020-07-31 广州艾博润医疗科技有限公司 Method and device for regulating and controlling sound-electricity stimulation nerves by combining electroencephalogram detection and analysis control
WO2021203719A1 (en) * 2020-04-08 2021-10-14 江苏贝泰福医疗科技有限公司 Acoustic-electric stimulation neuromodulation therapy and apparatus combining electroencephalogram testing, analysis and control
CN111631688A (en) * 2020-06-24 2020-09-08 电子科技大学 Algorithm for automatic sleep staging
CN111631688B (en) * 2020-06-24 2021-10-29 电子科技大学 Algorithm for automatic sleep staging
CN112215095A (en) * 2020-09-24 2021-01-12 西北工业大学 Contraband detection method, device, processor and security inspection system
CN112244792A (en) * 2020-10-30 2021-01-22 北京应激魔方数字科技有限公司 Multidimensional stress management system and method
CN113208617A (en) * 2021-04-06 2021-08-06 北京脑陆科技有限公司 Anxiety state nerve regulation and control method and system based on EEG signal
CN113208626A (en) * 2021-04-07 2021-08-06 北京脑陆科技有限公司 Emotional state regulation and control method and system based on EEG signal
CN113180662A (en) * 2021-04-07 2021-07-30 北京脑陆科技有限公司 EEG signal-based anxiety state intervention method and system
CN113180702A (en) * 2021-04-07 2021-07-30 北京脑陆科技有限公司 Alzheimer's disease nerve regulation and control method and system based on EEG signal
CN113180661A (en) * 2021-04-07 2021-07-30 北京脑陆科技有限公司 Method and system for regulating and controlling anxiety state based on EEG signal
CN113499085A (en) * 2021-06-16 2021-10-15 南京曦光信息科技研究院有限公司 Self-learning type chronic neurological disease risk assessment and regulation device
CN113244533A (en) * 2021-06-24 2021-08-13 景昱医疗器械(长沙)有限公司 Parameter adjusting method and device, electronic equipment and computer readable storage medium
WO2023005353A1 (en) * 2021-07-30 2023-02-02 苏州景昱医疗器械有限公司 Configuration information acquisition apparatus based on multi-modal data, and related device
CN115067968A (en) * 2021-08-31 2022-09-20 北京未名脑脑科技有限公司 Neural modulation systems and methods
CN114081490A (en) * 2021-11-02 2022-02-25 北京理工大学 System and method for mental state monitoring and treatment based on closed-loop feedback
CN114272523A (en) * 2021-12-27 2022-04-05 燕山大学 Portable animal transcranial ultrasonic stimulation and brain and muscle electric wireless acquisition system
CN115105714A (en) * 2022-03-09 2022-09-27 中国人民解放军陆军军医大学士官学校 Psychological stress assessment and regulation system applied to teaching and operation method thereof
CN116616708A (en) * 2023-05-22 2023-08-22 深圳市腾进达信息技术有限公司 Vital sign data processing method and system based on intelligent wearable device

Similar Documents

Publication Publication Date Title
CN109864750A (en) Based on the state of mind assessment and regulating system and its working method stimulated through cranium
WO2021203719A1 (en) Acoustic-electric stimulation neuromodulation therapy and apparatus combining electroencephalogram testing, analysis and control
CN106933348A (en) A kind of brain electric nerve feedback interventions system and method based on virtual reality
JP6717824B2 (en) Devices and software for effective non-invasive neural stimulation with various stimulation sequences
Petrantonakis et al. Emotion recognition from brain signals using hybrid adaptive filtering and higher order crossings analysis
CN110251801A (en) A kind of eyeshade reaction type microcurrent stimulating sleeping-assisting system
CN105797270A (en) Smart system and method for promoting sleep quality
EP2863986A1 (en) Device and methods for noninvasive neuromodulation using targeted transcrannial electrical stimulation
US20150148710A1 (en) Ultrasound Modulation of the Brain for Treatment of Stroke, Brain Injury, and Other Neurological Disorders
CN106377252A (en) Biologic information feedback system based on virtual reality
CN108836328A (en) A kind of equipment for being monitored for electromyography signal and generating corresponding electrical stimulation signal
Peng et al. User-centered depression prevention: An EEG approach to pervasive healthcare
CN108721048A (en) Rehabilitation training control method, computer readable storage medium and terminal
CN115640827B (en) Intelligent closed-loop feedback network method and system for processing electrical stimulation data
CN110993056A (en) Hybrid active rehabilitation method and device based on mirror image neurons and brain-computer interface
CN109846478A (en) A kind of assessment excitatoty method of cerebral cortex after cranium galvanic current stimulation
CN111481799A (en) Brain wave closed-loop control equipment
CN114343573B (en) Closed-loop digital medicine system, equipment and medium for drug addiction patients
CN205988477U (en) Physical and psychological rehabilitation feedback training device
CN204767042U (en) Biological electric excitation therapies appearance of intelligence frequency conversion
CN113713333A (en) Dynamic virtual induction method and system for lower limb rehabilitation full training process
Smith Electroencephalograph based brain computer interfaces
CN108814569A (en) Rehabilitation training control device
CN107875510A (en) A kind of biostimulation feedback treating method, system and computer equipment
CN115281692A (en) Closed-loop self-adaptive transcranial electrical stimulation device and method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20190611