WO2023005353A1 - Appareil d'acquisition d'informations de configuration basé sur des données multimodales, et dispositif associé - Google Patents

Appareil d'acquisition d'informations de configuration basé sur des données multimodales, et dispositif associé Download PDF

Info

Publication number
WO2023005353A1
WO2023005353A1 PCT/CN2022/092818 CN2022092818W WO2023005353A1 WO 2023005353 A1 WO2023005353 A1 WO 2023005353A1 CN 2022092818 W CN2022092818 W CN 2022092818W WO 2023005353 A1 WO2023005353 A1 WO 2023005353A1
Authority
WO
WIPO (PCT)
Prior art keywords
real
patient
time
data
configuration
Prior art date
Application number
PCT/CN2022/092818
Other languages
English (en)
Chinese (zh)
Inventor
王倩
唐建东
Original Assignee
苏州景昱医疗器械有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 苏州景昱医疗器械有限公司 filed Critical 苏州景昱医疗器械有限公司
Publication of WO2023005353A1 publication Critical patent/WO2023005353A1/fr

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
    • A61N1/00—Electrotherapy; Circuits therefor
    • A61N1/18—Applying electric currents by contact electrodes
    • A61N1/32—Applying electric currents by contact electrodes alternating or intermittent currents
    • A61N1/36—Applying electric currents by contact electrodes alternating or intermittent currents for stimulation
    • A61N1/3605—Implantable neurostimulators for stimulating central or peripheral nerve system
    • A61N1/36128—Control systems
    • A61N1/36135—Control systems using physiological parameters
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
    • A61N1/00—Electrotherapy; Circuits therefor
    • A61N1/18—Applying electric currents by contact electrodes
    • A61N1/32—Applying electric currents by contact electrodes alternating or intermittent currents
    • A61N1/36—Applying electric currents by contact electrodes alternating or intermittent currents for stimulation
    • A61N1/3605—Implantable neurostimulators for stimulating central or peripheral nerve system
    • A61N1/36128—Control systems
    • A61N1/36142—Control systems for improving safety
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/40—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/20—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems

Definitions

  • the present application relates to the technical field of implantable medical equipment, and in particular relates to a configuration information acquisition device, method, electronic equipment, program control system and computer-readable storage medium based on multimodal data.
  • implantable neurostimulators have become more and more widely used in clinical practice.
  • doctors can remotely control related electronic equipment, and then control the stimulators to exert pressure on patients.
  • Corresponding electrical stimulation achieves the purpose of treating diseases.
  • the doctor only observes the patient's state through video and adjusts the parameters when performing remote program control on the patient, it is inevitable that the patient's condition will be inaccurate and electrical stimulation cannot be correctly applied to the patient, especially for implanted neurons.
  • the stimulator directly acts on the nerves in the user's body by electrical stimulation. Once it fails, it may cause irreversible damage to the human body and bring risks to the patient. Therefore, it provides a way to obtain the bioelectric data of the patient. It is very important to grasp the real-time status information of the patient and to accurately apply electrical stimulation to the patient.
  • the purpose of this application is to provide configuration information acquisition device, method, electronic equipment, program control system and computer-readable storage medium based on multi-modal data, based on the real-time bioelectric data and real-time image data of the patient, to obtain the real-time state information of the patient, Further, the configuration information of the patient is obtained to control the stimulator in the patient to apply electrical stimulation.
  • the present application provides a configuration information acquisition method based on multimodal data, the method comprising: acquiring real-time bioelectric data of the patient, the bioelectric data including real-time EEG data, real-time ECG data and One or more of the real-time myoelectric data; using a camera to photograph the patient to obtain real-time image data of the patient; based on the real-time bioelectric data and real-time image data of the patient, to obtain real-time status information of the patient ; Based on the real-time state information of the patient, acquire configuration information of the patient, where the configuration information of the patient is used to control the stimulator in the patient to apply electrical stimulation.
  • the acquiring real-time status information of the patient based on the real-time bioelectric data and real-time image data of the patient includes: displaying the real-time bioelectric data and real-time image data; using the doctor equipment to receive a status input operation; in response to the status input operation, determine the real-time status information of the patient.
  • the acquiring the real-time status information of the patient based on the real-time bioelectric data and real-time image data of the patient may include: combining the real-time bioelectric data and real-time image data of the patient Input the state classification model to obtain the real-time state information of the patient.
  • the method for obtaining the state classification model may include: obtaining training data of a plurality of state sample objects, the training data of each state sample object includes real-time bioelectrical data of the state sample object and real-time image data and corresponding real-time state information, the real-time state information corresponding to real-time bioelectric data and real-time image data; using the training data of the plurality of state sample objects to train the first deep learning model to obtain the state Classification model: input the real-time bioelectrical data and real-time image data of the patient into the state classification model to obtain the real-time state information of the patient.
  • the acquiring configuration information of the patient based on the real-time status information of the patient includes: using a doctor device to display the real-time status information of the patient; using the doctor device to receive configuration input Operation: determining configuration information for the patient in response to the configuration input operation.
  • the acquiring configuration information of the patient based on the real-time status information of the patient includes: inputting the real-time status information of the patient into a configuration acquisition model to obtain the configuration information of the patient .
  • the method for acquiring the configuration acquisition model includes: acquiring training data of multiple configuration sample objects, the training data of each configuration sample object includes the real-time status information of the configuration sample object and its corresponding configuration information; using the training data of the plurality of configuration sample objects to train a second deep learning model to obtain the configuration acquisition model; inputting the real-time state information of the patient into the configuration acquisition model to obtain the patient's configuration information.
  • the present application provides a device for obtaining configuration information based on multimodal data
  • the device comprising: a bioelectricity acquisition module for acquiring real-time bioelectricity data of a patient, the bioelectricity data including real-time EEG One or more of data, real-time electrocardiogram data and real-time myoelectric data; image acquisition module, for using camera to shoot described patient, obtains the real-time image data of described patient; State acquisition module, is used for based on described The real-time bioelectric data and real-time image data of the patient are used to acquire the real-time status information of the patient; the configuration acquisition module is used to acquire the configuration information of the patient based on the real-time status information of the patient, and the configuration information of the patient is used Electrical stimulation is applied by controlling a stimulator inside the patient.
  • the state acquisition module includes: a first display unit, which uses the doctor equipment to display the real-time bioelectric data and real-time image data of the patient; a first receiving unit, which uses the doctor equipment to receive the status input operation; a state determination unit, in response to the state input operation, to determine the real-time state information of the patient.
  • the state acquisition module is configured to input the real-time bioelectrical data and real-time image data of the patient into a state classification model to obtain real-time state information of the patient.
  • the state acquisition module includes: a state sample unit, configured to obtain training data of a plurality of state sample objects, the training data of each state sample object includes the real-time bioelectricity of the state sample object data and real-time image data and corresponding real-time state information; the first training unit is used to use the training data of the plurality of state sample objects to train the first deep learning model to obtain the state classification model; the acquisition state unit is used to Inputting the real-time bioelectrical data and real-time image data of the patient into the state classification model to obtain real-time state information of the patient.
  • the configuration acquisition module includes: a second display unit, configured to use the doctor device to display the real-time status information of the patient; a second receiving unit, configured to use the doctor device to receive configuration input Operation: a configuration determining unit configured to determine configuration information of the patient in response to the configuration input operation.
  • the configuration acquisition module is configured to input the real-time status information of the patient into a configuration acquisition model to obtain the configuration information of the patient.
  • the configuration obtaining module includes: a configuration sample unit, configured to obtain training data of a plurality of configuration sample objects, the training data of each configuration sample object includes real-time state information of the configuration sample object and the corresponding configuration information; the second training unit is used to train the second deep learning model by using the training data of the plurality of configuration sample objects to obtain the configuration acquisition model; the acquisition configuration unit is used to convert the patient’s The real-time status information is input into the configuration acquisition model to obtain the configuration information of the patient.
  • the present application provides an electronic device, the electronic device includes a memory and a processor, the memory stores a computer program, and the processor includes:
  • the bioelectricity acquisition module is used to acquire the real-time bioelectricity data of the patient, and the bioelectricity data includes one or more of real-time EEG data, real-time ECG data and real-time EMG data;
  • An image acquisition module configured to use a camera to photograph the patient to obtain real-time image data of the patient
  • a status acquisition module configured to acquire real-time status information of the patient based on the real-time bioelectric data and real-time image data of the patient;
  • the configuration obtaining module is configured to obtain configuration information of the patient based on the real-time status information of the patient, and the configuration information of the patient is used to control the stimulator in the patient to apply electrical stimulation.
  • the electronic device is also provided with a display screen.
  • the present application provides a program-controlled system, which includes doctor equipment and the electronic equipment described in the third aspect.
  • the present application provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the following steps are implemented:
  • bioelectric data including one or more of real-time EEG data, real-time ECG data and real-time myoelectric data;
  • configuration information of the patient is acquired, and the configuration information of the patient is used to control a stimulator inside the patient to apply electrical stimulation.
  • the real-time status information of the patient is obtained, and then real-time
  • the state information is further obtained with configuration information. Since the obtained patient information is real-time, this method has timeliness; at the same time, the obtained patient information can be various, so it is comprehensive; therefore, using this configuration information to control The stimulator inside the patient applies electrical stimulation, which is more reliable.
  • FIG. 1 is a schematic flowchart of a method for acquiring configuration information based on multimodal data provided in an embodiment of the present application
  • Fig. 2 is a schematic flow chart of determining the real-time state information of a patient provided by the embodiment of the present application;
  • Fig. 3 is another schematic flow chart of determining the real-time state information of the patient provided by the embodiment of the present application.
  • Fig. 4 is a schematic flow chart of determining configuration information of a patient provided by an embodiment of the present application.
  • Fig. 5 is a schematic flow diagram of another method for determining configuration information of a patient provided by the embodiment of the present application.
  • FIG. 6 is a schematic structural diagram of an apparatus for acquiring configuration information based on multimodal data provided by an embodiment of the present application
  • FIG. 7 is a schematic structural diagram of a status acquisition module provided by an embodiment of the present application.
  • FIG. 8 is a schematic structural diagram of another state acquisition module provided by an embodiment of the present application.
  • FIG. 9 is a schematic structural diagram of a configuration acquisition module provided by an embodiment of the present application.
  • FIG. 10 is a schematic structural diagram of another configuration acquisition module provided by an embodiment of the present application.
  • Fig. 11 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
  • Fig. 12 is a schematic structural diagram of a program product for implementing a method for acquiring configuration information based on multimodal data provided by an embodiment of the present application.
  • At least one item (piece) of a, b or c can represent: a, b, c, a and b, a and c, b and c or a and b and c, wherein a, b and c can be It can be single or multiple. It should be noted that "at least one item (item)” can also be interpreted as “one item (item) or multiple items (item)”.
  • words such as “exemplary” or “for example” are used to mean an example, illustration or description. Any embodiment or design described herein as “exemplary” or “for example” is not to be construed as preferred or advantageous over other embodiments or designs. Rather, the use of words such as “exemplary” or “such as” is intended to present related concepts in a concrete manner.
  • an embodiment of the present application provides a method for acquiring configuration information based on multimodal data, and the method includes steps S101-S104.
  • the method for acquiring configuration information based on multi-modal data provided by the embodiment of the present application can be applied to an online remote program control scenario, and can also be applied to an offline program control scenario.
  • Step S101 Acquire real-time bioelectric data of the patient, the bioelectric data includes one or more of real-time EEG data, real-time ECG data and real-time EMG data.
  • the bioelectricity data may also include one or more of real-time electrogastric data and real-time retinal electricity data.
  • Step S102 Using a camera to photograph the patient to obtain real-time image data of the patient.
  • the camera is used to shoot the patient to obtain real-time image data, which complements the bioelectrical data and can more comprehensively reflect the patient's state.
  • Step S103 Acquire real-time status information of the patient based on the real-time bioelectrical data and real-time image data of the patient.
  • Step S104 Based on the real-time status information of the patient, acquire the configuration information of the patient, and the configuration information of the patient is used to control the stimulator in the patient to apply electrical stimulation.
  • the real-time status information of the patient is obtained , and further obtain the configuration information from the real-time status information. Since the obtained patient information is real-time, this method has timeliness; at the same time, the obtained patient information can be various, so it is comprehensive; therefore Using this configuration information to control the stimulator in the patient's body to apply electrical stimulation has reliability.
  • the camera may include, for example, an optical camera and/or an infrared camera.
  • the real-time image information of the patient may include video and/or images, for example. Through manual recognition or machine vision, based on real-time image information, the degree of completion of the patient's preset actions, the number of shaking of the patient's limbs (single hand or foot or multiple hands and feet) per minute, etc. can be obtained.
  • the preset motion may include, for example, one or more of finger pointing motions, arm stretching motions, arm raising motions, straight-line walking motions, and preset curve-walking motions.
  • step S103 may include: acquiring the patient's action information based on the patient's real-time image data; and acquiring the patient's real-time status based on the patient's real-time bioelectrical data and action information information.
  • the movement information of the patient can be used, for example, to indicate the degree of completion of the preset movement by the patient and the number of shakes per minute of the patient's limbs (single hand or feet or multiple hands and feet).
  • step S103 may include: obtaining the first state information of the patient based on the real-time bioelectric data of the patient; obtaining the second state information of the patient based on the real-time image data of the patient.
  • Status information when it is detected that the first status information matches the second status information, use the first status information as the real-time status information of the patient.
  • the implantable neurostimulation system mainly includes a stimulator implanted in the body and a program-controlled device outside the body.
  • the existing neuromodulation technology mainly uses stereotaxic surgery to implant electrodes in specific structures (i.e., targets) in the body, and the stimulator implanted in the patient sends electrical pulses to the targets through the electrodes to regulate the corresponding neural structures and networks. Electrical activity and its function, thereby improving symptoms and relieving pain.
  • the stimulator can be an implantable electrical nerve stimulation device, an implantable cardiac electrical stimulation system (also known as a cardiac pacemaker), an implantable drug infusion device (Implantable Drug Delivery System, referred to as IDDS) and a wire switch. Any one of the connected devices.
  • Implantable electrical nerve stimulation devices are, for example, Deep Brain Stimulation (DBS), Implantable Cortical Nerve Stimulation (CNS), Implantable Spinal Cord Stimulation , referred to as SCS), implanted sacral nerve stimulation system (Sacral Nerve Stimulation, referred to as SNS), implanted vagus nerve stimulation system (Vagus Nerve Stimulation, referred to as VNS), etc.
  • the stimulator can include IPG, extension wires and electrode wires.
  • the IPG implantable pulse generator, implantable pulse generator
  • the IPG is set in the patient's body, and relies on sealed batteries and circuits to provide controllable electrical stimulation to biological tissues.
  • Extended lead wires and electrode leads provide one or two controllable specific electrical stimulations to specific areas of biological tissue.
  • the extension lead is used in conjunction with the IPG as a transmission medium for the electrical stimulation signal, and transmits the electrical stimulation signal generated by the IPG to the electrode lead.
  • the electrode lead releases the electrical stimulation signal generated by the IPG to a specific area of the biological tissue through multiple electrode contacts;
  • the implantable medical device has one or more electrode leads on one or both sides, so
  • the electrode wires are provided with a plurality of electrode contacts, and the electrode contacts can be arranged uniformly or non-uniformly in the circumferential direction of the electrode wires.
  • the electrode contacts are arranged in an array of 4 rows and 3 columns (a total of 12 electrode contacts) in the circumferential direction of the electrode wire.
  • the stimulated biological tissue may be the patient's brain tissue, and the stimulated part may be a specific part of the brain tissue.
  • the stimulated site is generally different, the number of stimulation contacts used (single source or multi-source), one or more channels (single-channel or multi-channel) specific electrical stimulation signals
  • the application and stimulus parameter data are also different. This application does not limit the applicable disease types, which may be the applicable disease types for deep brain stimulation (DBS), spinal cord stimulation (SCS), pelvic stimulation, gastric stimulation, peripheral nerve stimulation, and functional electrical stimulation.
  • DBS disorders that DBS can be used to treat or manage include, but are not limited to: spasticity disorders (e.g., epilepsy), pain, migraine, psychiatric disorders (e.g., major depressive disorder (MDD)), bipolar disorder, anxiety disorders, Post-traumatic stress disorder, hypodepression, obsessive-compulsive disorder (OCD), conduct disorder, mood disorder, memory disorder, mental status disorder, mobility disorder (eg, essential tremor or Parkinson's disease), Huntington's disease, Al Alzheimer's disease, drug addiction disorder, autism, or other neurological or psychiatric conditions and impairments.
  • spasticity disorders e.g., epilepsy
  • DMDD major depressive disorder
  • bipolar disorder e.g., anxiety disorders, Post-traumatic stress disorder, hypodepression, obsessive-compulsive disorder (OCD)
  • CCD obsessive-compulsive disorder
  • conduct disorder mood disorder, memory disorder, mental status disorder, mobility disorder (eg, essential tre
  • the stimulator in this application is described by taking the deep brain stimulator (DBS) as an example.
  • the program-controlled device can be used to adjust the stimulation parameters of the electrical stimulation signal of the stimulator, or the stimulator can sense The bioelectric activity in the deep brain of the patient can be measured, and the stimulation parameters of the electrical stimulation signal of the stimulator can be adjusted continuously through the sensed bioelectric activity.
  • the stimulation parameters of the electrical stimulation signal can include frequency (for example, the number of electrical stimulation pulse signals per unit time 1s, the unit is Hz), pulse width (the duration of each pulse, the unit is ⁇ s) and amplitude (generally, voltage Expression, that is, the intensity of each pulse, the unit is any one or more of V).
  • various stimulation parameters of the stimulator can be adjusted in current mode or voltage mode.
  • the embodiment of the present application does not limit the disease type of the patient, and the patient can be any of the following: patients with Parkinson's disease; patients with depression; patients with addictive diseases; patients with obsessive-compulsive disorder; patients with bipolar disorder.
  • the addictive disease patients include drug addictive disease patients and/or drug addictive disease patients (ie drug addicts).
  • Parkinson's patients are mostly inconvenient to move, and there is a great demand for remote program control.
  • other diseases that can be treated are within the scope of protection of the embodiments of this application, including patients with mental diseases and other addictive diseases.
  • Real-time bioelectric data can be collected by bioelectric data acquisition equipment, which can integrate one or more of EEG acquisition modules, ECG acquisition modules, oculoelectric acquisition modules and myoelectric acquisition modules, and collect them separately
  • One or more of the patient's real-time EEG data, real-time ECG data, and real-time EMG data are preprocessed to obtain corresponding result data.
  • the above-mentioned bioelectric data acquisition device can also integrate one or more of the gastroelectric acquisition module and the retinal electrical data acquisition module to collect one or more of the real-time gastric electrical data and the real-time retinal electrical data respectively, and perform correlation preprocessing to obtain the corresponding result data.
  • the bioelectricity data acquisition device can integrate one or more of the EEG acquisition module, ECG acquisition module, EMG acquisition module, gastric electricity acquisition module and retinal electricity data acquisition module.
  • the bioelectricity data acquisition device can acquire real-time bioelectricity data through electrode wires implanted in the patient's body, or through electrode pads arranged outside the patient's body.
  • This application does not limit the EEG acquisition module, ECG acquisition module, oculoelectricity acquisition module and myoelectricity acquisition module integrated in the bioelectricity data acquisition device.
  • the EEG acquisition module is, for example, the EEG acquisition device disclosed in patent CN103519807B, or the EEG signal collector disclosed in patent CN109497998B;
  • the electrooculogram acquisition module is, for example, the electrooculogram signal extraction device disclosed in patent CN103070682B, or the wireless oculoelectric acquisition system disclosed in patent CN103211594A; Type myoelectric acquisition system, or the myoelectric signal acquisition device disclosed in patent CN106102575B.
  • historical bioelectric data of the patient may also be obtained, including text information and/or image information.
  • the real-time status information of the patient includes sleeping, eating, and exercising.
  • the real-time status information of the patient includes happiness, depression, and pain.
  • the real-time status information of the patient includes normal and sickness.
  • the real-time status information of the patient includes fatigue and non-fatigue.
  • the step S103 may include steps S201-S203.
  • Step S201 displaying the real-time bioelectrical data and real-time image data of the patient by using the doctor's equipment.
  • Step S202 Utilize the doctor equipment to receive a status input operation.
  • Step S203 Determine the real-time status information of the patient in response to the status input operation.
  • the doctor can obtain the real-time status information of the patient based on the real-time bioelectric data and real-time image data of the patient, combined with his own experience, and the doctor can conveniently operate the doctor's equipment to determine the real-time status information of the patient.
  • Doctor equipment is, for example, a mobile phone, a tablet computer, a notebook computer, a desktop computer, or a smart wearable device.
  • the doctor equipment may also be an in vitro program controller or a program controller.
  • the in vitro program controller is, for example, the in vitro program controller disclosed in patent CN105709336B, or the implantable nerve stimulator program controller disclosed in patent CN207412517U.
  • the programmer is, for example, a programmer in an implantable nerve electrical pulse stimulation system disclosed in patent CN100469401C, or a doctor programmer with security and confidentiality functions disclosed in patent CN201894778U.
  • This application does not limit the data interaction between the doctor's equipment and the stimulator.
  • the doctor's equipment can exchange data with the stimulator through the server and the patient's programmer.
  • the doctor's device can exchange data with the stimulator through the patient's programmer, and the doctor's device can also directly exchange data with the stimulator.
  • the patient programmer may include a host (in communication with the server) and a slave (in communication with the stimulator), the host and slave being communicably connected.
  • the doctor equipment can exchange data with the server through the 3G/4G/5G network
  • the server can exchange data with the host through the 3G/4G/5G network
  • the host can exchange data with the slave through the Bluetooth protocol/WIFI protocol/USB protocol
  • the sub-machine can exchange data with the stimulator through the 401MHz-406MHz working frequency band/2.4GHz-2.48GHz working frequency band
  • the doctor equipment can directly perform data interaction with the stimulator through the 401MHz-406MHz working frequency band/2.4GHz-2.48GHz working frequency band.
  • the step S103 may include: inputting the real-time bioelectrical data and real-time image data of the patient into a state classification model to obtain real-time state information of the patient.
  • the real-time bioelectric data and real-time image data of the patient are input into the state classification model to obtain the real-time state information of the patient, which does not require manual setting by the doctor, saves the doctor's operation steps, and has a high degree of intelligence; in addition, the doctor's judgment exists Strong subjectivity, while the state classification model can achieve high accuracy through training with a large amount of data, and the accuracy of judging the patient's state is higher.
  • the method for obtaining the state classification model may include steps S301-S303.
  • Step S301 Obtain training data of a plurality of state sample objects, the training data of each state sample object includes real-time bioelectric data and real-time image data of the state sample object and corresponding real-time state information.
  • the real-time status information corresponds to both real-time bioelectrical data and real-time image data.
  • Step S302 Using the training data of the plurality of state sample objects to train a first deep learning model to obtain the state classification model.
  • Step S303 Input the real-time bioelectrical data and real-time image data of the patient into the state classification model to obtain the real-time state information of the patient.
  • the first deep learning model can be trained using the training data of multiple sample objects to obtain a state classification model, as long as the real-time bioelectric data and real-time image data of the target object are input into the state classification model, the target object can be obtained
  • the real-time status information of patients especially when the number of samples used for training is large enough, the accuracy can reach a very high level.
  • the degree of intelligence is higher and the efficiency is higher.
  • the real-time state information of the target object can be sent to the user equipment, so that the user of the user equipment knows the real-time state information of the target object, so that the health status of the target object can be monitored at any time.
  • a preset first deep learning model can be obtained.
  • the learning and tuning of the system establishes the functional relationship from input to output. Although the functional relationship between input and output cannot be found 100%, it can approach the actual relationship as much as possible.
  • the state classification model obtained from this training and the calculation results High accuracy and high reliability.
  • the present application may use the above training process to train the state classification model, and in other implementation manners, the present application may use a pre-trained state classification model.
  • the present application does not limit the training process of the state classification model.
  • a supervised learning training method a semi-supervised learning training method, or an unsupervised learning training method may be used.
  • the present application does not limit the training end conditions of the state classification model, which can be, for example, that the number of training times reaches a preset number of times (the preset number of times is, for example, 1 time, 3 times, 10 times, 100 times, 1000 times, 10000 times, etc.), or It may be that the training data of multiple state sample objects have completed one or more trainings, or it may be that the total loss value obtained in this training is not greater than the preset loss value.
  • the step S104 may include steps S401-S403.
  • Step S401 Display the real-time status information of the patient by using the doctor's equipment.
  • Step S402 using the doctor equipment to receive configuration input operations
  • Step S403 Determine the configuration information of the patient in response to the configuration input operation.
  • the doctor's equipment is used to display the real-time status information of the patient, combined with the doctor's experience, the doctor manually determines the configuration information of the patient, and the operation is convenient.
  • the step S104 may include: inputting the real-time state information of the patient into a configuration acquisition model to obtain the configuration information of the patient.
  • the real-time state information of the patient is input into the configuration acquisition model to obtain the concerned configuration information, which does not require manual setting by the doctor, and has a high degree of intelligence; generally speaking, when the doctor manually configures the stimulation parameters of the stimulator, there is a strong subjective
  • the configuration acquisition model can achieve higher accuracy through training with a large amount of data, and the accuracy of the configured stimulus parameters is higher.
  • the method for acquiring the configuration acquisition model may include steps S501-S503.
  • Step S501 Obtain training data of multiple configuration sample objects, the training data of each configuration sample object includes the real-time status information of the configuration sample object and its corresponding configuration information.
  • Step S502 Using the training data of the plurality of configuration sample objects to train a second deep learning model to obtain the configuration acquisition model.
  • Step S503 Input the real-time status information of the patient into the configuration acquisition model to obtain the configuration information of the patient.
  • the training data of multiple configuration sample objects is obtained, the training data of each configuration sample object includes the real-time state information of the configuration sample object and its corresponding configuration information, and then the training data of multiple configuration sample objects is used to train the first 2.
  • Deep learning model to obtain a configuration acquisition model.
  • the configuration acquisition model has high accuracy, and the configuration acquisition model is used to predict the patient's configuration information, and the result is more accurate; and once the configuration acquisition model is formed, it can be applied to different patients and different conditions. state, a wide range of applications, easy to use, and a high degree of intelligence.
  • a preset second deep learning model can be obtained.
  • the learning and tuning of the system establishes the functional relationship from input to output. Although the functional relationship between input and output cannot be found 100%, it can approach the actual relationship as much as possible.
  • the configuration obtained from this training obtains the model and calculates the results. High accuracy and high reliability.
  • the present application does not limit the training process of the configuration acquisition model.
  • a supervised learning training method a semi-supervised learning training method, or an unsupervised learning training method may be used.
  • the present application does not limit the training end conditions of the configuration acquisition model, which can be, for example, that the number of training times reaches a preset number of times (the preset number of times is, for example, 1 time, 3 times, 10 times, 100 times, 1000 times, 10000 times, etc.), or It may be that the training data of multiple configuration sample objects has completed one or more trainings, or it may be that the total loss value obtained in this training is not greater than the preset loss value.
  • the embodiment of the present application also provides a device for acquiring configuration information based on multimodal data. Let me repeat.
  • the devices include:
  • the bioelectricity acquisition module 101 is configured to acquire real-time bioelectricity data of the patient, the bioelectricity data including one or more of real-time EEG data, real-time ECG data and real-time EMG data;
  • An image acquisition module 102 configured to photograph the patient with a camera to obtain real-time image data of the patient;
  • a state acquiring module 103 configured to acquire real-time state information of the patient based on the real-time bioelectrical data and real-time image data of the patient;
  • the configuration acquiring module 104 is configured to acquire configuration information of the patient based on the real-time state information of the patient, and the configuration information of the patient is used to control the stimulator in the patient to apply electrical stimulation.
  • the status acquisition module 103 may include:
  • the first display unit 201 is used to display the real-time bioelectric data and real-time image data of the patient by using the doctor's equipment;
  • the first receiving unit 202 is configured to use the doctor equipment to receive a status input operation
  • the state determination unit 203 determines the real-time state information of the patient in response to the state input operation.
  • the state acquisition module 103 can be configured to input the real-time bioelectrical data and real-time image data of the patient into a state classification model to obtain real-time state information of the patient.
  • the status acquisition module 103 may include:
  • the state sample unit 301 is used to obtain training data of a plurality of state sample objects, the training data of each state sample object includes real-time bioelectric data and real-time image data of the state sample object and corresponding real-time state information;
  • the first training unit 302 is configured to use the training data of the plurality of state sample objects to train a first deep learning model to obtain the state classification model;
  • Obtaining a state unit 303 configured to input the real-time bioelectrical data and real-time image data of the patient into the state classification model to obtain real-time state information of the patient.
  • the configuration acquisition module 104 may include:
  • the second display unit 401 is configured to display the real-time status information of the patient by using the doctor equipment;
  • the second receiving unit 402 is configured to use the doctor equipment to receive a configuration input operation
  • the configuration determining unit 403 is configured to determine configuration information of the patient in response to the configuration input operation.
  • the configuration acquisition module 104 can be configured to input the real-time status information of the patient into a configuration acquisition model to obtain the configuration information of the patient.
  • the configuration acquisition module 104 may include:
  • the configuration sample unit 501 is configured to acquire training data of a plurality of configuration sample objects, the training data of each configuration sample object includes the real-time state information of the configuration sample object and its corresponding configuration information;
  • the second training unit 502 is configured to use the training data of the plurality of configuration sample objects to train a second deep learning model to obtain the configuration acquisition model;
  • the acquisition configuration unit 503 is configured to input the real-time status information of the patient into the configuration acquisition model to obtain the configuration information of the patient.
  • the embodiment of the present application also provides an electronic device 200, which includes at least one memory 210, at least one processor 220, and a bus 230 connecting different platform systems.
  • Memory 210 may include readable media in the form of volatile memory, such as random access memory (RAM) 211 and/or cache memory 212 , and may further include read only memory (ROM) 213 .
  • RAM random access memory
  • ROM read only memory
  • the memory 210 also stores a computer program, and the computer program can be executed by the processor 220, so that the processor 220 executes the steps of the method for obtaining configuration information based on multi-modal data in the embodiment of the present application.
  • the implementation manners and the achieved technical effects described in the embodiment of the method for obtaining configuration information of the modal data are consistent, and part of the content will not be repeated here.
  • Memory 210 may also include utility 214 having at least one program module 215 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, examples of each or Implementations of network environments may be included in some combination.
  • program module 215 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, examples of each or Implementations of network environments may be included in some combination.
  • the processor 220 can execute the above-mentioned computer program, and can execute the utility tool 214 .
  • Bus 230 may be representative of one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of a variety of bus structures.
  • the electronic device 200 can also communicate with one or more external devices 240 such as keyboards, pointing devices, Bluetooth devices, etc., and can also communicate with one or more devices capable of interacting with the electronic device 200, and/or communicate with the electronic device 200 200 is capable of communicating with any device (eg, router, modem, etc.) that communicates with one or more other computing devices. Such communication may occur through input-output interface 250 .
  • the electronic device 200 can also communicate with one or more networks (such as a local area network (LAN), a wide area network (WAN) and/or a public network such as the Internet) through the network adapter 260 .
  • the network adapter 260 can communicate with other modules of the electronic device 200 through the bus 230 . It should be appreciated that although not shown, other hardware and/or software modules may be used in conjunction with electronic device 200, including but not limited to: microcode, device drivers, redundant processors, external disk drive arrays, RAID systems, tape drives And data backup storage platform, etc.
  • the processor includes: a bioelectricity acquisition module for acquiring real-time bioelectricity data of the patient, the bioelectricity data including one or more of real-time EEG data, real-time ECG data and real-time myoelectric data;
  • An acquisition module configured to use a camera to photograph the patient to obtain real-time image data of the patient;
  • a status acquisition module configured to acquire real-time status information of the patient based on the patient's real-time bioelectric data and real-time image data;
  • the configuration obtaining module is configured to obtain configuration information of the patient based on the real-time status information of the patient, and the configuration information of the patient is used to control the stimulator in the patient to apply electrical stimulation.
  • the electronic device may also be provided with a display screen.
  • the display is, for example, a touch display.
  • An embodiment of the present application also provides a program-controlled system, the program-controlled system includes doctor equipment and the above-mentioned electronic equipment.
  • the physician device and electronic device may be integrated.
  • the embodiment of the present application also provides a computer-readable storage medium, the computer-readable storage medium is used to store a computer program, and when the computer program is executed, the multimodal data-based configuration information acquisition method in the embodiment of the present application is implemented.
  • the specific implementation of the steps is consistent with the implementation and achieved technical effects described in the above-mentioned embodiment of the multimodal data-based configuration information acquisition method, and part of the content will not be repeated.
  • Fig. 12 shows a program product 300 provided by this embodiment for realizing the above-mentioned configuration information acquisition method based on multimodal data, which may adopt a portable compact disk read-only memory (CD-ROM) and include program codes, and may Run on end devices, such as personal computers.
  • the program product 300 of the present application is not limited thereto.
  • the readable storage medium may be any tangible medium containing or storing a program, and the program may be used by or in combination with an instruction execution system, device or device.
  • Program product 300 may utilize any combination of one or more readable media.
  • the readable medium may be a readable signal medium or a readable storage medium.
  • the readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any combination thereof. More specific examples (non-exhaustive list) of readable storage media include: electrical connection with one or more conductors, portable disk, hard disk, random access memory (RAM), read only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.
  • RAM random access memory
  • ROM read only memory
  • EPROM or flash memory erasable programmable read-only memory
  • CD-ROM compact disk read-only memory
  • optical storage devices magnetic storage devices, or any suitable combination of the foregoing.
  • a computer readable storage medium may include a data signal carrying readable program code in baseband or as part of a carrier wave traveling as part of a data signal. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing.
  • a readable storage medium may also be any readable medium that can transmit, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
  • the program code contained on the readable storage medium can be transmitted by any appropriate medium, including but not limited to wireless, cable, optical cable, RF, etc., or any suitable combination of the above.
  • the program code for performing the operation of the present application can be written in any combination of one or more programming languages, and the programming language includes object-oriented programming languages such as Java, C++, etc., and also includes conventional procedural programming languages A programming language such as C or similar.
  • the program code may execute entirely on the user's computing device, partly on an associated device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server to execute.
  • the remote computing device may be connected to the user computing device through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., using an Internet service provider). business to connect via the Internet).
  • LAN local area network
  • WAN wide area network
  • Internet service provider e.g., a wide area network

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Data Mining & Analysis (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Public Health (AREA)
  • Theoretical Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Medical Informatics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Evolutionary Computation (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Neurology (AREA)
  • Neurosurgery (AREA)
  • Evolutionary Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Radiology & Medical Imaging (AREA)
  • Animal Behavior & Ethology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • General Physics & Mathematics (AREA)
  • Veterinary Medicine (AREA)
  • Primary Health Care (AREA)
  • Artificial Intelligence (AREA)
  • Epidemiology (AREA)
  • Urology & Nephrology (AREA)
  • Surgery (AREA)
  • Databases & Information Systems (AREA)
  • Pathology (AREA)
  • Biophysics (AREA)
  • Physiology (AREA)
  • Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)

Abstract

L'invention concerne un appareil et un procédé d'acquisition d'informations de configuration basés sur des données multimodales, et un dispositif électronique, un système de commande de programme et un support de stockage lisible par ordinateur. L'appareil comprend : un module d'acquisition de bioélectricité qui est utilisé pour acquérir des données de bioélectricité en temps réel d'un patient ; un module d'acquisition d'image qui est utilisé pour photographier le patient à l'aide d'un appareil photo, de façon à obtenir des données d'image en temps réel du patient ; un module d'acquisition d'état qui est utilisé pour acquérir des informations d'état en temps réel du patient sur la base des données de bioélectricité en temps réel et des données d'image en temps réel du patient ; et un module d'acquisition de configuration qui est utilisé pour acquérir des informations de configuration du patient sur la base des informations d'état en temps réel du patient, les informations de configuration du patient étant utilisées pour commander un stimulateur dans le corps du patient afin d'appliquer un stimulus électrique.
PCT/CN2022/092818 2021-07-30 2022-05-13 Appareil d'acquisition d'informations de configuration basé sur des données multimodales, et dispositif associé WO2023005353A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110874804.4A CN113577555A (zh) 2021-07-30 2021-07-30 基于多模态数据的配置信息获取装置及相关设备
CN202110874804.4 2021-07-30

Publications (1)

Publication Number Publication Date
WO2023005353A1 true WO2023005353A1 (fr) 2023-02-02

Family

ID=78253284

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/092818 WO2023005353A1 (fr) 2021-07-30 2022-05-13 Appareil d'acquisition d'informations de configuration basé sur des données multimodales, et dispositif associé

Country Status (2)

Country Link
CN (1) CN113577555A (fr)
WO (1) WO2023005353A1 (fr)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113577555A (zh) * 2021-07-30 2021-11-02 苏州景昱医疗器械有限公司 基于多模态数据的配置信息获取装置及相关设备
CN115019948B (zh) * 2022-06-28 2023-06-16 苏州景昱医疗器械有限公司 控制设备、远程会诊系统和计算机可读存储介质
CN115054828B (zh) * 2022-07-25 2022-11-01 苏州景昱医疗器械有限公司 脉冲发生器、医疗系统及计算机可读存储介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106621041A (zh) * 2016-12-21 2017-05-10 北京品驰医疗设备有限公司 一种迷走神经刺激器电子处方配置系统
CN108392795A (zh) * 2018-02-05 2018-08-14 哈尔滨工程大学 一种基于多信息融合的康复机器人多模态控制方法
CN109864750A (zh) * 2019-01-31 2019-06-11 华南理工大学 基于经颅刺激的精神状态评估与调节系统及其工作方法
CN111481830A (zh) * 2020-04-24 2020-08-04 上海交通大学 闭环神经电刺激系统和设置闭环神经电刺激参数的方法
CN112120716A (zh) * 2020-09-02 2020-12-25 中国人民解放军军事科学院国防科技创新研究院 一种可穿戴式多模态情绪状态监测装置
CN113577555A (zh) * 2021-07-30 2021-11-02 苏州景昱医疗器械有限公司 基于多模态数据的配置信息获取装置及相关设备

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105792741A (zh) * 2013-12-06 2016-07-20 心脏起搏器股份公司 使用分类器融合的心力衰竭事件预测
US10639471B2 (en) * 2015-12-16 2020-05-05 Brainlab Ag Simulating a target coverage for deep brain stimulation
KR102022667B1 (ko) * 2017-02-28 2019-09-18 삼성전자주식회사 환자를 모니터링하는 방법 및 장치
CN110522983B (zh) * 2018-05-23 2023-06-23 深圳先进技术研究院 基于人工智能的脑刺激系统、方法、设备和存储介质
CN111012326B (zh) * 2018-10-09 2022-07-05 深圳市理邦精密仪器股份有限公司 盆底校准方法、设备及计算机可读存储介质

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106621041A (zh) * 2016-12-21 2017-05-10 北京品驰医疗设备有限公司 一种迷走神经刺激器电子处方配置系统
CN108392795A (zh) * 2018-02-05 2018-08-14 哈尔滨工程大学 一种基于多信息融合的康复机器人多模态控制方法
CN109864750A (zh) * 2019-01-31 2019-06-11 华南理工大学 基于经颅刺激的精神状态评估与调节系统及其工作方法
CN111481830A (zh) * 2020-04-24 2020-08-04 上海交通大学 闭环神经电刺激系统和设置闭环神经电刺激参数的方法
CN112120716A (zh) * 2020-09-02 2020-12-25 中国人民解放军军事科学院国防科技创新研究院 一种可穿戴式多模态情绪状态监测装置
CN113577555A (zh) * 2021-07-30 2021-11-02 苏州景昱医疗器械有限公司 基于多模态数据的配置信息获取装置及相关设备

Also Published As

Publication number Publication date
CN113577555A (zh) 2021-11-02

Similar Documents

Publication Publication Date Title
US10974049B1 (en) Artificial intelligence systems for quantifying movement disorder symptoms and adjusting treatment based on symptom quantification
WO2023005353A1 (fr) Appareil d'acquisition d'informations de configuration basé sur des données multimodales, et dispositif associé
US11160979B1 (en) Method and system for tuning of movement disorder therapy devices
US11759642B1 (en) Movement disorder therapy and brain mapping system and methods of tuning remotely, intelligently and/or automatically
WO2024021960A1 (fr) Générateur d'impulsions, système médical et support de stockage lisible par ordinateur
WO2023071378A1 (fr) Stimulateur nerveux implantable et système de stimulation nerveuse implantable
WO2024001723A1 (fr) Dispositif de commande, système médical et support de stockage lisible par ordinateur
WO2022262495A1 (fr) Procédé de commande et appareil associé pour dispositif médical domestique
WO2023124390A1 (fr) Dispositif commandé par programme et système de neurostimulation implantable
WO2024067449A1 (fr) Appareil d'ajustement de paramètre et procédé associé, dispositif commandé par programme, système médical, et support de stockage
CN113244533A (zh) 参数调整方法、装置、电子设备及计算机可读存储介质
WO2023241338A1 (fr) Dispositif de commande planifié, système de commande planifié, dispositif électronique et support de stockage lisible par ordinateur
WO2023000788A1 (fr) Procédé et appareil de comparaison de paramètres, dispositif électronique et support de stockage lisible par ordinateur
CN114761074A (zh) 用于刺激参数优化的闭环算法的输入的自动确定
CN115501481A (zh) 应急程控设备、医疗系统及计算机可读存储介质
WO2024041496A1 (fr) Dispositif de rappel de charge, système de stimulation neuronale implantable et support de stockage
WO2024007823A1 (fr) Chargeur in vitro, système de commande de programme et support de stockage lisible par ordinateur
JP2023537835A (ja) 運動機能促進のためのシステムおよび方法
WO2023185410A1 (fr) Procédé d'identification d'imagerie pour fil d'électrode de stimulation, et appareil associé
WO2023024881A1 (fr) Procédé de traçage vidéo pour patient atteint d'une maladie chronique et appareil associé
WO2023011493A1 (fr) Appareil expérimental à double aveugle, dispositif électronique, système expérimental à double aveugle et support d'enregistrement
WO2023000787A1 (fr) Procédé et appareil de traitement vidéo, dispositif électronique, et support de stockage lisible par ordinateur
US11918810B1 (en) Method and system for tuning of movement disorder therapy devices
US11400294B2 (en) Method and apparatus for neurostimulation device therapy management
CN115019948B (zh) 控制设备、远程会诊系统和计算机可读存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22847966

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE