EP3229684B1 - Procédés de mesure d'un mouvement physiologiquement pertinent - Google Patents

Procédés de mesure d'un mouvement physiologiquement pertinent Download PDF

Info

Publication number
EP3229684B1
EP3229684B1 EP15867321.0A EP15867321A EP3229684B1 EP 3229684 B1 EP3229684 B1 EP 3229684B1 EP 15867321 A EP15867321 A EP 15867321A EP 3229684 B1 EP3229684 B1 EP 3229684B1
Authority
EP
European Patent Office
Prior art keywords
subject
noise
motion
biometric
acceleration
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP15867321.0A
Other languages
German (de)
English (en)
Other versions
EP3229684A1 (fr
EP3229684A4 (fr
Inventor
Elizabeth B. TORRES
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Rutgers State University of New Jersey
Original Assignee
Rutgers State University of New Jersey
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Rutgers State University of New Jersey filed Critical Rutgers State University of New Jersey
Publication of EP3229684A1 publication Critical patent/EP3229684A1/fr
Publication of EP3229684A4 publication Critical patent/EP3229684A4/fr
Application granted granted Critical
Publication of EP3229684B1 publication Critical patent/EP3229684B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/40—Detecting, measuring or recording for evaluating the nervous system
    • A61B5/4076—Diagnosing or monitoring particular conditions of the nervous system
    • A61B5/4082—Diagnosing or monitoring movement diseases, e.g. Parkinson, Huntington or Tourette
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/1101—Detecting tremor
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7203—Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal
    • A61B5/7207—Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal of noise induced by motion artifacts
    • A61B5/721—Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal of noise induced by motion artifacts using a separate sensor to detect motion or using motion information derived from signals other than the physiological signal to be measured
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/01—Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/024—Detecting, measuring or recording pulse rate or heart rate
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316—Modalities, i.e. specific diagnostic methods
    • A61B5/369—Electroencephalography [EEG]
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316—Modalities, i.e. specific diagnostic methods
    • A61B5/389—Electromyography [EMG]
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/45—For evaluating or diagnosing the musculoskeletal system or teeth
    • A61B5/4538—Evaluating a particular part of the muscoloskeletal system or a particular medical condition
    • A61B5/459—Evaluating the wrist

Definitions

  • the present invention relates generally to methods for measuring and monitoring physiologically relevant motion, particularly, with respect to diagnosing and/or monitoring a disease or disorder, such as a neurological disorder or a traumatic brain injury, in a subject.
  • a disease or disorder such as a neurological disorder or a traumatic brain injury
  • Patent application US 2014/275854 discloses a wearable heart rate monitor comprising a motion detecting sensor.
  • Non-fatal sTBI may result in immediate unconsciousness (coma) and amnesia states followed by slow recovery with subsequent extended periods of impairments in one or more general functional areas. These may include impaired cognitive and/or motor functions as well as impaired sensations and/or emotional responses.
  • Physicians and researchers now generally recognize that the spectrum of disorders related to coma can be more broadly defined as a range of disorders of consciousness (DOC) that can be mapped onto a multi-dimensional space primarily defined by cognitive and motor impairments.
  • DOC disorders of consciousness
  • the initial coma state may evolve towards improved levels of consciousness and physical function such as a minimally conscious state (MCS).
  • MCS minimally conscious state
  • GCS Glasgow Coma Scale
  • CRS-R Coma Recovery Scale-Revised
  • AIS Abbreviated Injury Scale
  • Trauma Score or Abbreviated Trauma Score among others.
  • GCS Glasgow Coma Scale
  • CRS-R Coma Recovery Scale-Revised
  • AIS Abbreviated Injury Scale
  • Trauma Score or Abbreviated Trauma Score among others.
  • Other tools used in the hospital settings include objective assessments of the brain condition using imaging techniques. The use of these techniques is however limited to a few times per year, due primarily to their cost and regional availability.
  • the method comprises measuring the movement of the subject (e.g., movement of the arm or head).
  • the method comprises measuring the movement of the subject (e.g., movement of the arm or head) and measuring at least one biometric of the subject (e.g., body temperature); determining the noise-to-signal ratio for the movement measured as a function of the biometric; and identifying the movements where the signal is greater than noise at a particular biometric as a physiologically relevant motion.
  • the movement of the subject is a micromovement.
  • the subject is not actively attempting to move and/or is attempting to remain still.
  • the method comprises measuring the movement (e.g., physiologically relevant motion) of the subject.
  • a difference in the physiologically relevant motion of the subject compared to a healthy individual and/or the presence of a physiologically relevant motion associated with a disease or disorder indicates whether that the tested subject has the disease or disorder.
  • the method comprises measuring the motion (e.g., physiologically relevant motion) of the subject after administering the therapy (e.g., pharmaceutical based or non-pharmaceutical therapy) to the subject.
  • the method further comprises measuring a motion (e.g., physiologically relevant motion) of the subject prior to the administration of the therapy (e.g., as a baseline).
  • the modulation of the motion pattern of the subject after administration of the therapy indicates that the therapy modulates the disease or disorder.
  • motion tracking can be used, optionally, in combination with other physiologically relevant signals (temperature, electrodermal activity, heart beat variability, etc.), to help medical personnel and care givers assess the patient's mental and physical states daily, both during the hospitalization period and after discharge (e.g., when the patient goes into rehabilitation).
  • a disease or disorder e.g., neurological disorder or post TBI (e.g., severe TBI)
  • the methods are illustrated with data from a pregnant patient who underwent a severe TBI, slipped into a coma and had her baby successfully delivered by C-section.
  • the methods are also illustrated with subjects having an autism spectrum disorder.
  • the method comprises monitoring or measuring the movement of the subject.
  • the movement is a micromovement (e.g., a movement not recognizable (or not easily recognizable) by the naked eye; e.g., movements in the millisecond and/millimeter range (e.g., parameters of the movement are measured at intervals in the millisecond and/millimeter range)).
  • the subject is actively attempting not to move and/or is attempting to remain still.
  • the method comprises monitoring or measuring the movement of the subject and monitoring or measuring at least one biometric of the subject; determining the noise-to-signal ratio for the movement as a function of the biometric; and identifying the movements where the signal is greater than noise at a particular biometric as a physiologically relevant motion.
  • the movement and biometric are monitored or measured simultaneously (e.g., in tandem).
  • the movement and biometric are monitored or measured over a period of time (e.g., timecourse).
  • the movements with the lowest noise noise-to-signal ratio e.g., the lowest 50%, lowest 25%, the lowest 10%, the lowest 5% or the lowest 1%) are identified as the physiologically relevant motions.
  • any body part of the subject can be monitored for motion.
  • the hands, head, trunk, limbs, arms, etc. can be monitored.
  • the motion pattern of the subject's arm or hand, particularly the dominant arm or hand is measured.
  • the motion pattern of the subject's head is measured.
  • the difference in size of the body parts (e.g., limb size) of subjects and controls is accounted for (e.g., normalized).
  • Any parameter of the motion of the subject may be measured (e.g., by a wearable motion sensor).
  • Parameters that can be measured include, without limitation: velocity, acceleration, speed profile, max speed, max acceleration, minimum speed, minimum acceleration, time to reach maximum speed, time to reach maximum acceleration, max retraction speed, time to reach max retraction speed, inter-peak intervals, three-dimensional path, accuracy of target touching, overall amount of time for motion, body part rotation or positioning, translational movement, rotational movement, and joint angle.
  • acceleration of the movement is measured.
  • any biometric of the subject may be measured.
  • the subject's temperature e.g., skin temperature
  • heart rate e.g., beats per minute or inter beat time interval
  • electrodermal activity e.g., electrical activity of brain (e.g., brain waves (e.g., as measured by electroencephalogram (EEG)), electrical activity of muscles (e.g., as measured by electromyography (EMG)), and/or breathing pattern
  • EEG electroencephalogram
  • EMG electromyography
  • breathing pattern e.g., the subject's temperature is measured.
  • the subject may be conscious or unconscious. In a particular embodiment, the subject is unconscious. In a particular embodiment, the subject has suffered a traumatic brain injury.
  • traumatic brain injury or "TBI” refers to an acquired brain injury or a head injury, when a trauma causes damage to the brain. Trauma includes, e.g., post-head trauma, impact trauma, and other traumas to the head such as, for example, traumas caused by an external, physical force, accidents and/or sports injuries, military injuries, concussive injuries, penetrating head wounds, brain tumors, stroke, heart attack, meningitis, viral encephalitis, and other conditions that deprive the brain of oxygen.
  • the damage can be focal (confined to one area of the brain) or diffuse (involving more than one area of the brain).
  • the TBI can be chronic or acute.
  • the traumatic brain injury can result from a closed head injury (a brain injury when the head suddenly and violently hits an object but the object does not break through the skull).
  • the TBI is severe.
  • the method comprises monitoring the motion (e.g., physiologically relevant motion or spontaneous movement) of the subject by the methods described herein over time (e.g., at least two time points).
  • the movement is a micromovement.
  • the subject is actively attempting not to move and/or is attempting to remain still.
  • the subject is unconscious or in a coma.
  • the subject may have suffered a TBI, particularly a severe TBI.
  • the subject may have a neurological disorder.
  • the subject has an autism spectrum disorder.
  • the methods of the instant invention diagnose and/or monitor a subtype of autism spectrum disorder.
  • the gender and/or age of the subject and the control standards are the same.
  • the method further comprises monitoring or measuring at least one biometric of the subject.
  • the method comprises monitoring or measuring the movement of the subject and monitoring or measuring at least one biometric of the subject; determining the noise-to-signal ratio for the movement as a function of the biometric; and identifying the movements where the signal is greater than noise at a particular biometric as a physiologically relevant motion.
  • the movement and biometric are monitored or measured simultaneously (e.g., in tandem).
  • the movement and biometric are monitored or measured over a period of time (e.g., timecourse).
  • the movements with the lowest noise noise-to-signal ratio e.g., the lowest 50%, lowest 25%, the lowest 10%, the lowest 5% or the lowest 1%) are identified as the physiologically relevant motions.
  • the instant invention also encompasses methods for determining the ability of a therapy to modulate a disease or disorder in a subject.
  • the method comprises administering the therapy to a subject and monitoring the motion (e.g., physiologically relevant motion or spontaneous movement) of the subject by the methods described herein (e.g., over time) to determine whether the administered therapy modulated (e.g., treated) the disease or disorder (e.g., by comparing to standards/controls or previously obtained standards of the subject).
  • the modulation of the motion (e.g., physiologically relevant motion) of the subject after administration of the therapy indicates that the therapy modulates the disease or disorder.
  • the method comprises monitoring the motion of the subject, administering the therapy to the subject, and re-monitoring the motion of the subject, wherein a change in the motion after therapy compared to before therapy indicates that the therapy modulates the disease or disorder.
  • a change in the motion after therapy compared to before therapy indicates that the therapy modulates the disease or disorder.
  • the method further comprises monitoring or measuring at least one biometric of the subject (e.g., before and/or after therapy).
  • the method comprises monitoring or measuring the movement of the subject and monitoring or measuring at least one biometric of the subject; determining the noise-to-signal ratio for the movement as a function of the biometric; and identifying the movements where the signal is greater than noise at a particular biometric as a physiologically relevant motion.
  • the movement and biometric are monitored or measured simultaneously (e.g., in tandem).
  • the movement and biometric are monitored or measured over a period of time (e.g., timecourse).
  • the movements with the lowest noise noise-to-signal ratio e.g., the lowest 50%, lowest 25%, the lowest 10%, the lowest 5% or the lowest 1%) are identified as the physiologically relevant motions.
  • the disease or disorder of the instant invention is a developmental/mental disability or neurological disorder.
  • Neurological disorders include neurodevelopmental and neurodegenerative disorders.
  • Specific examples of neurological disorders include, without limitation: Parkinson's disease, parkinsonian syndrome, Autism, Autism spectrum disorder, Huntington's disease, athetosis, dystonia, cerebellar and spinal atrophy, multiple system atrophy, striatonigral degeneration, olivopontocerebellar atrophy, Shy-Drager syndrome, corticobasal degeneration, progressive supranuclear palsy, basal ganglia calcification, parkinsonism-dementia syndrome, diffuse Lewy body disease, Alzheimer's disease, Pick's disease, Wilson's disease, multiple sclerosis, peripheral nerve disease, brain tumor, cerebral stroke, attention deficit hyperactivity disorder (ADHD), Down syndrome, William syndrome, schizophrenias, etc.
  • ADHD attention deficit hyperactivity disorder
  • the developmental/mental disabilities or neurological disorders that the instant methods can be used with include, without limitation, attention deficit hyperactivity disorder (ADHD), Parkinson's Disease, stroke (e.g., stroke in the cortex, particularly the posterior parietal cortex; Torres et al. (2010) J. Neurophysiol., 104:2375-2388 ), Down syndrome, William syndrome, schizophrenics, concussive injuries (e.g., sports concussion), autism spectrum disorders, autism, Tourette's, neurodegenerative disorders, Fragile X syndrome, movement disorders, and the like.
  • the neurological disorder is Autism, Autism spectrum disorder, or Parkinson's disease.
  • diagnosis refers to detecting and identifying a disease/disorder in a subject.
  • the term may also encompass assessing or evaluating the disease/disorder status (severity, classification, progression, regression, stabilization, response to treatment, etc.) in a patient.
  • the diagnosis may include a prognosis of the disease/disorder in the subject.
  • the term “prognosis” refers to providing information regarding the impact of the presence of a disease/disorder on a subject's future health (e.g., expected morbidity or mortality). In other words, the term “prognosis” refers to providing a prediction of the probable course and outcome of a disease/disorder or the likelihood of recovery from the disease/disorder.
  • treat refers to any type of treatment that imparts a benefit to a patient afflicted with a disease, including improvement in the condition of the patient (e.g., in one or more symptoms), delay in the progression of the condition, etc.
  • millisecond range may refer to a time frame that is less than one second, particularly less than about 0.5 second, less than about 100 milliseconds, less than about 50 milliseconds, less than about 25 milliseconds, or less than about 5 or 10 milliseconds.
  • the motion of the subject e.g., a parameter of the motion (e.g., the speed or accelerator) is observed over segments or intervals of time in the millisecond range (e.g., from about one to about 3 millisecond, from about 1 to about 5 milliseconds, from about 1 to about 10 milliseconds, from about 1 to about 25 milliseconds, about 1 to about 50 milliseconds, about 1 to about 100 milliseconds, or about 1 to about 500 milliseconds).
  • a parameter of the motion e.g., the speed or accelerator
  • millimeter range may refer to a distance that is less than 100 cm, particularly less than about 100 mm or less than about 10 mm. In a particular embodiment, the millimeter range is from about 0.1 mm to about 100 cm, from about 1 mm to about 100 mm, or about 1 to about 10 mm.
  • autistic spectrum disorder or “ASD” refers to autism and similar disorders.
  • ASD include disorders listed in the Diagnostic and Statistical Manual of Mental Disorders (DSM-V). Examples include, without limitation, autistic disorder, Asperger's disorder, pervasive developmental disorder, childhood disintegrative disorder, and Rett's disorder.
  • Known ASD diagnostic screenings methods include, without limitation: Modified Checklist for Autism in Toddlers (M-CHAT), the Early Screening of Autistic Traits Questionnaire, and the First Year Inventory; the M-CHAT and its predecessor CHAT on children aged 18-30 months, Autism Diagnostic Interview (ADI), Autism Diagnostic Interview-Revised (ADI-R), the Autism Diagnostic Observation Schedule (ADOS) The Childhood Autism Rating Scale (CARS), and combinations thereof.
  • M-CHAT Modified Checklist for Autism in Toddlers
  • ADI Autism Diagnostic Interview
  • ADI-R Autism Diagnostic Interview-Revised
  • ADOS Autism Diagnostic Observation Schedule
  • CARS Childhood Autism Rating Scale
  • Known symptoms, impairments, or behaviors associated with ASD include without limitation: impairment in social interaction, impairment in social development, impairment with communication, behavior problems, repetitive behavior, stereotypy, compulsive behavior, sameness, ritualistic behavior, restricted behavior, self-injury, unusual response to sensory stimuli, impairment in emotion, problems with emotional attachment, impaired communication, and combinations thereof.
  • MC is a 39-year-old, right handed woman who was pregnant when diagnosed with a grade 2 oligoastrocytoma on 03/01/14 after worsening headaches, fatigue, nausea and some degree of confusion which prompted an MRI scan.
  • the MRI revealed on 03/07/14 a right frontal lobe mass lesion (8.5 x 5) with characteristics suggestive of oligodendroglioma.
  • Surgical excision was recommended by the neurologist and scheduled for 03/12/14 in consultation with her high-risk Ob/Gyn.
  • Patient MC is on a trach collar.
  • Her ABG on 06/30/14 showed adequate oxygenation.
  • Her weekly scores on the Western Neuro Sensory Stimulation Profile (WNSSP) from June 4th 2014 till October 8th 2014 are reported on Table 1.
  • Table 1 Weekly scores from the Western Neuro Sensory Stimulation Profile (WNSSP) commonly used to track changes in neural sensory processing.
  • Month (Day) WNSSP June (4) 11 (11) 10 (18) 26 (25) 27 July (2) 27 (10) 22 (17) 22 (24) 22 (31) 29 August (6) 13 (13) 14 (20) 5 (27) 17 September (3) 7 (10) 3 (17) 10 (24) 3 October (1) 9 (8) 14
  • Medications administered per feeding tube Amantadine 150mg, 50mg in the AM and 100mg noon; Desmopressin 0.1mg per day; Docusate 2mg per day; Ferrous sulfate 300mg; Folic acid 1mg; Glycopyrrolate 0.5mg; Keppra 1000mg; Multivitamin (1 tablet); Potassium chloride 20mEq; Senna two tabs; Vitamin D3 2000 IU; Aquatears to both eyes four times a day; Chlorhexidine 15ml for oral care 4 times daily; Meropenem 1g IV q 8.
  • Medications administered by subcutaneous bid Enoxaparin 50mg and Vancomycin 1g IV.
  • IMU inertial measurement units
  • APDM opal Portland, OR
  • magnetometer magnetometer data at 128Hz.
  • the units are synchronized and operate through wireless technology in live streaming mode and also in robust logging mode.
  • the former enables real time visualization of the synchronous data with no loss of data, while the latter allows the same without visualization of the recordings streamed in real time.
  • Data is reported from the right and left wrists of the patient, synchronously recorded in robust logging mode (no data loss). Each session comprises several hours. Table 2 provides information on the number of hours per session when the data were registered.
  • Table 2 Number of hours recorded by the APDM sensors per each day session across the 4 months. Day, hours Day, hours Day, hours Day, hours Day, hours Day, hours Day, hours April 24 7.09 25 7.22 26 7.16 29 6.41 May 3 9.45 6 12.56 8 12.28 11 3.45 13 6.26 17 6.74 27 12.24 June 5 3.57 8 11.33 12 7.32 20 13.29 July 1 9.34 9 7.06 12 9.43 15 4.32 17 5.37 19 7.14
  • the motion patterns were analyzed along with those of the temperature values, both registered simultaneously by the sensors.
  • the analyses were focused on the linear acceleration obtained from the tri-axial linear accelerometers.
  • the linear acceleration is first expressed as the time series of the norm of the three-dimensional vector of accelerations expressed as a function of the temperature range in each section.
  • the patterns of variability of the maximal instantaneous deviations of the acceleration from the overall mean acceleration across the session were examined using distributional analyses described in other work involving velocity- and acceleration dependent signals ( Torres, E.B. (2011) Exp. Brain Res., 215:269-83 ; Torres, E.B. (2013) Front. Integr. Neurosci., 7:50 ; Torres, E.B.
  • Figure 2 shows representative data from the patient's wrists.
  • Figure 2A shows the plots of the tri-axial acceleration profiles over several hours obtained on April 24th 2014 (see also Table 2).
  • the a i are the tri-axial components along the x, y, and z axes.
  • Figure 2D shows the scalar acceleration expressed as a function of the temperature range registered by the sensors.
  • the mean acceleration value and the instantaneous maximal deviation are taken from the overall mean of the session. These profiles are then obtained as a function of temperature.
  • For each minute of the session all samples of the maximal deviation from the mean acceleration are obtained and plotted in matrix form in Figure 2E (shown for a session in May 8th 2014) for 12.28 hours (739.6 minutes shown along the rows).
  • the columns of the matrix show one-degree Celsius intervals spanning the range of temperatures for that session.
  • the color of each entry in the matrix reflects for each minute and degree interval the maximal amount of motion deviating from the mean acceleration (see color bar) in units/s 2 .
  • Figure 3 illustrates the steps followed to build these matrices.
  • the acceleration and temperature data is first harnessed in one-minute-long intervals (128Hz x 60sec, 7,680 registered frames). For each degree the range of motion registered is obtained over time. The example in Figure 3 shows this for the 34-35°C-interval. All motion data occurring in that interval is harnessed (inset in right panel). Then for each minute and each °C the maximal deviation from the mean acceleration is obtained. Across the minutes and degrees, these are the entries of the matrix depicted in Figure 3 . The color indicates the amount of motion maximally deviating from the mean acceleration of the session on May 8th.
  • the May 8th matrix is used to further illustrate the methods.
  • the range from 33-35°C is used to show the statistics of the motion.
  • the number of maximal deviations (peaks) across the session (6.26-hours or 375 minutes along the rows of the matrix) were counted and were gathered in a frequency histogram.
  • a probability distribution function was then fit.
  • MLE maximum likelihood estimation
  • estimates of the shape (a) and the scale (b) parameters of the Gamma probability distribution with 95% confidence intervals are obtained.
  • the continuous Gamma family of probability distributions has been used to characterize the range of human motion variability across a range of neurological disorders and typical motions.
  • the Gamma statistical parameters (mean and variance) are obtained and then plotted on a ( ⁇ , ⁇ )-plane. Each point represents the Gamma statistical parameters of the acceleration-dependent motions for a temperature °C-interval taken across the time length of the session.
  • this session reveals a pattern of motion whereby the motion noise registered by these accelerometers overpowers the signal.
  • the range from 33-35°C used in Figure 5 to illustrate the methods are also marked here to show their range of noise-to-signal.
  • the Gamma distribution shape and scale parameters of the distributions corresponding to the noise-to-signal values are estimated. This was done to determine the physiologically appropriate statistical regimes in the motion data to further analyze that data. These are regimes of temperature where the motion maintains minimal noise-to-signal ratios across the session, as opposed to the signal being overpowered by instrumentation noise.
  • the estimated shape and scale parameters on the Gamma plane with 95% confidence intervals are plotted in Figure 4C .
  • the color code corresponds to the frequency histograms of 4B and the legend reflects the corresponding temperature °C-interval for this May 8th session.
  • the points corresponding to the shape value of 1 are at the most random noise-to-signal levels. Those towards the right correspond to statistically more predictable (systematic) regimes of noise-to-signal levels (towards symmetric shapes of the distribution of the noise-to-signal ratios.)
  • higher values indicate higher levels of noise (highest marked by blue star in correspondence with the frequency histogram in 4B).
  • the 33-35°C temperature interval used in 4B are marked to illustrate the methods to isolate the physiologically relevant motion regimes and in correspondence with the frequency histograms of the noise-to-signal ratio in 4B.
  • Figure 7 depicts the longitudinal stochastic trajectory of the noise-to-signal ratios extracted from the motion data across all sessions. There are 124 measurements automatically extracted from 21 sessions registered across 4 months (spanning from April to July).
  • the Gamma (b)-scale parameter relates to the Fano Factor, the Gamma estimated variance divided by the Gamma estimated mean value.
  • the former is a.b while the latter is a.b 2 .
  • the Fano Factor is then b, which is the scale parameter.
  • Figure 7A (right wrist) and 7B (left wrist) show the 3-dimensional trajectories of the changes in these Gama parameters (X-Y log-log plane) along the temperature ranges (Z-axis °C) registered by the sensors.
  • the vector field (black arrows) indicates the direction and the magnitude of the change in the reliability and predictability of the changes in the noise-to-signal ratio form the motion data.
  • Low changes in values vs. high changes in values are better appreciated in Figures 7C-D along the surface fitted through the 124 points of physiologically relevant (low noise) data across all sessions.
  • the Z-axis of these surfaces are the changes in temperature level. Notice that the right wrist had a dramatically sharp change in the month of May, while the left wrist had a gradual change in temperature from June onwards. Points along the 0-change lines of temperature, scale and shape are steady states in each session.
  • Figure 8 shows the frequency histograms of the right and left wrists data involving the maximal deviations from the mean acceleration obtained within the proper temperature intervals (those identified with the lowest noise-to-signal levels). The figure focuses on the month of May which Figure 7 identified as critical for the dominant hand. Notice the changes in the shape and width of these frequency histograms across the various sessions in May.
  • Figure 9A tracks the stochastic trajectories of the estimated Gamma parameters for each wrist (corresponding to the acceleration-dependent motions) and identifies (with a star) in each case the session with the largest rate of change towards the regimes of lowest variability (most reliable) and most symmetric shape, towards systematic motions, away from the (most random) Exponential distribution regimes of the Gamma plane. The starting and ending points of the trajectories are also highlighted.
  • Figure 9B shows for each day the Gamma estimated statistics (mean and variance) highlighting in the legend the dates of the sessions and the largest change in statistical regimes. Other analyzes of the rates of change in these estimated parameters were performed for the month of May and for other months as well.
  • Figure 10A shows the result of the analyses corresponding to the stochastic changes in the shape of the distribution estimated for each of the sessions of each month where the noise-to-signal was at its minimum.
  • the frequency distribution of the rate of change of the shape parameter in each session was well fit by the Gamma family.
  • the estimated shape and scale parameters are plotted with 95% confidence intervals on the (log-log) Gamma Plane.
  • This plane shows a clear separation in the clustering of the points corresponding to the sessions in the month of May for the right wrist. This separation is consistent with the overall behavior of the changes in temperature and motion data identified in Figure 7C and 7D .
  • the upward shift in this cluster along the vertical axis indicates an increase in the variability (the width) of the shapes of the distributions of the acceleration-dependent motion parameter.
  • the frequency distributions of the rate of change of surface skin temperature noise followed the Gamma distribution as well.
  • the shape and scale parameters of each session were estimated with minimal acceleration-dependent motion noise and the point from each session was plotted on the (log-log) Gamma plane with 95% confidence interval.
  • the month of May once again stood out as a separate cluster with shifts downwards towards regimes of reliable measurements (low noise) and shifts rightwards towards more systematic regimes tending towards symmetric shapes of the distribution of the rate of change in temperature noise. These patterns were not present in the values registered by the left wrist. In the left wrist the points from the sessions in the month of May did not cluster apart from those estimated from the measurements taken in the other months. Unlike in the right wrist, no reliable and systematic changes were revealed in the motions of the left wrist during the month of May.
  • Figure 10C shows the patterns corresponding to the rate of change in the shape parameter discussed in 10A-B for the acceleration-dependent motion as a function of the temperature.
  • the points representing the month of May cluster apart from the rest.
  • May had larger values for the change in the shape of the acceleration-dependent distribution corresponding to larger values in the change of the shape of the temperature-dependent distribution.
  • Figure 10C speaks of systematic changes in the shapes of the parameters' distributions
  • Figure 10D speaks of the changes in their noise levels.
  • the inset zooms in the Gamma statistics of the changes in the shape of the distributions of maximal deviation from the mean acceleration.
  • the figure shows that in May the motions were more systematic than in the other months and their variability in the shape of the distribution was higher. In particular, by May 17th the changes in surface skin temperature were steadier as the changes in motion patterns turned more systematic (as revealed by the higher values of the shape of the distribution of the relevant acceleration and temperature dependent parameters).
  • Patient MC had the C-section delivery of her baby boy on May 22, 2014. All the data preceding that date indicated patterns of systematic variability in her motions from the dominant (right) hand that were absent in the motions from her non-dominant (left) hand. Furthermore, the medical records indicated the formation of a blood clot in the right arm after May.
  • Figure 7D shows a slow gradual increase in the changes in surface skin temperature for the left wrist that also coincided with higher levels of motion. These motions from the left wrist however had no discernable patterns of systematic changes in variability levels as those observed in May.
  • New methods are provided herein to assess in a personalized manner the longitudinal progression of body motions as a function of surface skin temperature using wearable sensors.
  • the statistical metrics introduced here permit the continuous longitudinal assessment of patients as they move and as they undergo changes in physiological states.
  • a particular case of post-sTBI has been used to illustrate the methods, yet these methods can be generally extended and used in other patients as well.
  • These methods do not assume population statistics or expected values of the parameters of interest. Instead, they empirically estimate the probability distributions most likely underlying the changes in motion and physiologically relevant parameters registered in tandem within each daily session and longitudinally over months. The methods focus on the rates of change of these parameters' statistics along a continuum.
  • Newtonian mechanics concerned with acceleration estimations has no known relation to thermodynamics.
  • the laws of mechanics governing physical motions were derived for inanimate objects and rigid bodies, rather than for biological bodies in motion undergoing physiological changes that impact the motions' variability.
  • the field of neural control of movement employs primarily Newtonian mechanics in the analyses and modelings of behavioral states ( Shadiolo et al. (2005) The computational neurobiology of reaching and pointing : a foundation for motor learning. Cambridge, Mass.:MIT Press )
  • physiologically relevant measurements such as temperature, heartbeat, breathing patterns, etc.
  • the human body is in constant motion in tandem with other physiological patterns of the person. Such patterns fluctuate and change over time.
  • the absolute values of the parameters of interest are often registered, but very little is said about their rates of change over time.
  • the rates of change of those parameters over time contained information predictive of a relevant upcoming event.
  • May was the month of highest relevance in these longitudinal data sets.
  • a dramatic and sharp change in the patterns of motion and surface skin temperature of this patient's dominant hand manifested in May preceding the birth of her baby boy by C-section.
  • This task of characterizing longitudinally the individualized profiles of various physiological stages of pregnancy in an objective manner can be performed using the new analytics presented herein in tandem with a broad range of wearable sensors available in the market.
  • the current market offers sensors that capture heart rate variability, electro dermal activities, and blood-volume levels, among others. The outcomes of these biomarkers are currently examined in isolation.
  • the analytics provided herein allow for integrating them with the motion's temporal profiles in a multi-dimensional setting. In such a setting, such physiological signals are used as natural filters to isolate systematic changes in bodily motion patterns that are physiologically relevant and independent of instrumentation noise.
  • the human body is in constant motion, from every breath taken to every visibly purposeful action performed. Remaining still on command is one of the hardest things to achieve because micromovements across the body are hard to control under volition.
  • ASD autism spectrum disorders
  • researchers ask participants to remain still and use motion-correcting methods to eliminate periods of high movement.
  • uncorrected resting-state scans from 605 participants were examined and excess noise and randomness in the head displacements and rotations of the ASD participants were found. Such patterns were exacerbated with psychotropic medications, but found as well without medication.
  • the sensitivity and specificity of new individualized statistical biometrics to the sensory-motor patterns associated with the use of one or more commonly prescribed medications in the ASD cohort are reported, as well as interactions between specific medications and age.
  • the signatures of micro-movement noise accumulation are a biologically informed core feature of ASD with medication-specific information to help assess risks and benefits of pharmacological treatments across different ages.
  • Neurosci., 6:124 also extended to the head micro-movements, particularly when the person is lying down with the head padded to dampen these motions, this would indicate that corrupted motor output variability is a systemic problem, signaling a failure to anticipate sensory consequences of the impeding actions in these individuals.
  • these tools could help researchers to characterize ASD objectively from head-to-toe and to add a putative specific disorder type (e.g. head-trigeminal-ganglia- vs. body-dorsal-root-ganglia- noise prevalence) to the list of infantile neurological sensory-motor disorders of the nervous systems.
  • a putative specific disorder type e.g. head-trigeminal-ganglia- vs. body-dorsal-root-ganglia- noise prevalence
  • RDoC Research Domain Criteria
  • NIMH National Institutes of Mental Health
  • DSM Diagnostic Statistical Manual
  • ICD International Classification of Diseases
  • the head micro-motion data obtainable from a large number of functional neuroimaging datasets deposited in the Autism Brain Imaging Data Exchange (ABIDE) database (containing datasets of 1,112 individuals with and without ASD), offers researchers a unique opportunity to characterize normative data and better profile ASD. To this end, a new statistical platform is used herein for the personalized analyses and sensory-motor profiling of the variability inherent to resting-state behavior.
  • ABIDE Autism Brain Imaging Data Exchange
  • micro-movements' disorders were a systemic feature of ASD and if they were present in individuals currently on or off psychotropic medications, across multiple age groups, one can use these new techniques to provide a personalized dynamic measure of 'precision phenotyping' of ASD as the disorder evolves in time with and without medication. This would enable steering away from symptom-based medication towards individualized target treatments, in line with the current goals of Precision Medicine.
  • Datasets used in this study were obtained from public, freely accessible Autism Brain Imaging Data Exchange (ABIDE) database (fcon_1000.projects.nitrc.org/indi/abide/). Data are de-identified in compliance with U.S. Health Insurance Portability and Accountability Act (HIPAA) guidelines. Participants at all sites signed written informed consent and assent (and parental consent, if participants were less than 18 years) in accordance with U.S. 45 CFR 46 and Declaration of Helsinki for participation; research protocols which included neuroimaging and clinical assessments at each site, were approved by the local ethics committees. Analyses of these de-identified data were reviewed and approved by Institutional Review Boards of Rutgers University and Columbia University Medical Center.
  • HIPAA Health Insurance Portability and Accountability Act
  • ABIDE sites were included that (i) deposited raw resting-state functional Magnetic Resonance Imaging (MRI) scans (i.e., no motion correction or "scrubbing" ( Power et al. (2012) Neuroimage 59:2142-2154 ) was applied to these data), (ii) had a total scan duration at least 8 minutes, and/or (iii) had at least 15 individuals with ASD.
  • MRI Magnetic Resonance Imaging
  • BOLD Blood Oxygenation Level Dependent
  • GE GE Medical Systems, Milwaukee, WI
  • Siemens Siemens (Siemens Healthcare, Er Weg, Germany) 3 Tesla MR scanners.
  • UM_1 and UM_2 scans were 10 minute each (300 volumes) and USM was 8 minutes (240 volumes).
  • realignment of scanned volumes involves estimating the six parameters of an affine 'rigid-body' transformation (b-splines interpolation using least-squares approach) that minimizes the differences between each successive scan and a reference scan ( Friston, K.J. in Statistical Parametric Mapping: The analysis of functional brain images (eds. K.J. Friston et al.) (Academic Press, 2008 ); Friston et al. (1995) Human Brain Mapping 2:165-189 ).
  • the default reference scan in SPM8 is the first scan (volume), to which all subsequent volumes are realigned.
  • the output with the six motion parameters (3 translations in x, y, z directions, and 3 rotations: pitch (about x-axis), roll (about y-axis), and yaw (about z-axis)) is recorded as an rp_%s.txt file.
  • Raw NIfTI (.nii) files were separately processed for each site in the ABIDE database used in the current study because of differences in the inter-scan interval (Repetition Time, TR), number of slices, and total scan duration (number of volumes) across sites. Whenever the data from all 7 sites were pooled, ratios were defined that would consider the above mentioned sampling disparities across datasets.
  • micro-movements Small trial-by-trial variations in performance as captured by fluctuations in the amplitude or the timing of critical kinematic parameters. These may include velocity- and acceleration-dependent parameters such as the maxima, the minima, and the time to reach the peaks, or the inter-peak interval timings along continuous time series of changes in the positions of some parameter from some physiological signal, etc. This definition should not be confused with small movements or with sub-movements comprising a single movement or motor actions.
  • the present experiment assesses the scan-by-scan velocity-dependent variations in the linear displacement and in the angular rotations of the head's small motions. The analyses refer to the stochastic signatures of those minute motor variations, their accumulation and individualized empirically-estimated statistical features.
  • the rate of change of linear displacement was obtained in vector form (a three-dimensional velocity field over time).
  • the Euclidean norm was used to obtain the magnitude of each element in this scalar field over time, i.e. the linear speed profile corresponding to the given session.
  • the three rotational components were treated as Euler angles and converted to quaternions for proper use of the Euclidean norm on the angular velocity field.
  • the resulting scalar field was used as the angular speed profile over the given session.
  • the time series of the speed values was then plotted for each participant as a profile in time, measured (in seconds) across the length of the scanner session.
  • a , b 1 ⁇ a b a x a ⁇ 1 e ⁇ x b in which a is the shape parameter, b is the scale parameter, and ⁇ is the Gamma function ( Ross, S.M. Stochastic processes 2nd Ed. (Wiley, 1996 )).
  • the Gamma parameters are empirically estimated using maximum likelihood estimation with 95% confidence intervals.
  • the estimated parameter for each individual is plotted on the Gamma plane with confidence intervals to compare the individual to others in the cohort.
  • the data from ensembles of participants is also pooled and the Gamma parameters estimated and plotted on the Gamma plane with confidence intervals to compare different groups in the database.
  • the noise to signal ratio the Fano Factor (FF) (Fano, 1947) obtained from the empirically estimated Gamma variance divided by the empirically estimated Gamma mean.
  • the data follows the memoryless Exponential probability distribution. This is the most random distribution whereby events in the past do not accumulate information predictive of events in the future. Larger values towards the right of the shape axes on the Gamma ( a , b )-plane tend towards the symmetric distributions, with a variety of skewed distributions in between the two extremes.
  • Figure 11D shows the results of the median noise-to-signal ratio compared between the two groups.
  • the speed maxima were normalized to avoid allometric effects due to scan length and sampling resolution differences across sites and studies. To this end, the averaged speed value between each two local minima in the time series were obtained. Each speed maximum was then divided by the sum of the speed maximum and the average speed between the two corresponding minima. The same procedure explained for Figure 11 was then applied to the normalized speed maxima (denoted normalized peak velocity index, PV index). Smaller values of this index indicate larger values of the average speed in the denominator (i.e. faster rates of change in linear (angular) displacements (rotations) on average). Since there is interest in the cumulative effect over time and their rates of change across the scanning session, the empirical cumulative probability distribution function (eCDF) for these speed-dependent parameters (i.e. average speed, PV index, etc.) was also obtained.
  • eCDF empirical cumulative probability distribution function
  • the empirically estimated Gamma shape and scale parameters were plotted as points on the Gamma plane, each representing a study site for the ensemble data.
  • each point corresponds to the stochastic signatures of a single participant.
  • a scatter was obtained and studied on the log-log Gamma plane in search for power law relations.
  • the power law relation obtained is reported with the goodness of fit parameters.
  • the fitting error between the line obtained using the estimated exponent of the power relation (the slope of the line) and the data point from the scatter was obtained for each participant and their histograms compared between ASD and controls.
  • the Gamma scale parameter i.e.
  • the noise to signal ratio or Fano Factor was plotted as a function of this error (denoted here delta) and statistical comparisons performed along each dimension.
  • the Gamma statistics (the empirically estimated Gamma mean and Gamma variance) were plotted against the delta to fit a surface across the signatures of all ASD participants and those of the controls.
  • Figure 11 illustrates analyses of the magnitudes of the rates of change of linear displacements, shown here for UM_1 site, using pooled data across all participants within each of the ASD and TD groups (similar trends were found for the rates of change of the head's angular rotations).
  • Figures 11A and 11B show qualitative differences in the magnitude of the raw, scan-by-scan head micromotions between ASD and TD participants, whereby ASD patients have noticeably higher and more frequent head fluctuations. The differences in these speed maxima were quantitated using frequency histograms presented in Figure 11C , which show rapid accumulation of these peaks in the ASD group. Note that the squared log of the raw peak speed values was used for better visualization of the significant statistical disparity seen in Fig. 11A .
  • Figure 12A shows the normalized speed maxima index denoted peak velocity (PV) index for each of the three main sites. Across the 3 main studies (UM_1, UM_2 and USM) it was possible to differentiate ASD from control participants as the Gamma parameters and the estimated mean and variance separated these individuals.
  • Figure 12B shows the eCDFs while Figure 12C shows the estimated Gamma statistics (mean and variance) for ASD and TD participants.
  • the insets show the differences in the empirical cumulative distribution functions of the PV index pooled across the ensemble of the three studies. Note that these group differences held independently for NYU, UCLA_1, OLIN, and PITT sites and are presented for both linear displacements and rotations.
  • Figure 12D unfolds the ensemble data for all participants from the 3 main studies of comparable temporal resolution and scanning times.
  • the analyses of the Fano Factor revealed in the ASD group a subset of individuals with higher noise levels than that in the TD group (i.e., with FF above 0.06, about 2.5 standard deviations from the mean, in Figure 12F ). Closer inspection of this ratio revealed higher levels of variability in ASD.
  • the scatter was examined along three dimensions comprising the mean, the standard deviation and the delta residual as a measure of failure to follow the power law. This is shown in Figure 13A for controls and Figure 13B for ASD.
  • Figures 13C-13E show the box plots resulting from the Kruskall-Wallis test that yielded significant differences between ASD and TD participants for each of these dimensions (at the alpha 0.01 level).
  • the surface fitted to the scatter revealed that the subgroup with higher noise levels was comprised of some ASD participants that were currently taking at least one psychotropic medication and some that were not.
  • the ASD sub-groups included participants taking no medications, two medications and three medications from the UM_1 and UM_2 study-sites included in Figures 12-13 .
  • Figure 14A shows the results of this comparison on the Gamma plane.
  • Systematic increase in the levels of noise (upwards shift along the scale, the noise-to-signal ratio axis) and in randomness (leftward shift along the shape axis towards a 1 the special case of the memoryless Exponential distribution) of the head micro-movement signatures was found. Consistent results were found for microdisplacements and micro-rotations.
  • the number of medications taken pulled the stochastic signatures of head micro-motions of medicated ASD participants away from those of TD controls.
  • the medicated ASD with 3 medication-combination-treatments were the farthest apart from TD controls. They fell along the directions of the Gamma plane towards the random exponential distribution, and with higher levels of noise-to-signal ratio than controls.
  • Figure 14B shows the differences in the total cumulative distances traveled along the linear and angular domains for each patient.
  • This comparison includes two studies (UM_1 and UM_2) in Figures 12-13 that reported medication intake by participants, with 300 frames per participant (both studies at 1 ⁇ 2 Hz). These were used because they had congruent fixed scanning rate needed to be able to compare the cumulative linear and rotational total excursions of the head during the session.
  • a statistically significant systematic increase was found with medication quantity between medicated ASD and TD controls (P ⁇ 0.01), meaning that statistical patterns were significantly worse for ASD participants taking multiple medications.
  • This difference in shape and scale was also consistent between medicated and non-medicated ASD, as well as, notably, between non-medicated ASD and controls.
  • the medication information by medication classes broken down into different age groups was then examined. Given the broad range of ages in the sample (6 to 50 years old) it was desirable to elucidate several questions. First, the classes that were most likely driving the statistically significant effects of medications on the head micro-movement patterns of ASD participants was investigated. Second, it was asked whether age was a factor with variable effects (i.e. across medications). If so, it was asked which age group accounted for the worst increase in noise and randomness levels away from the non-medicated ASD, and which age would pull the medicated-ASD towards the controls (with highest reliability and predictability in the speed dependent signal). Lastly it was investigated whether there was an overall medication-class trend.
  • Figure 15A shows the panels with translation (T) and rotation (R) for different age groups (G1-G5). Notice that when taken as part of a combination, the anticonvulsants, across all age groups and for both translation and rotation speeds, correspond to data points that are the highest along the scale axis and the lowest along the shape axis, i.e. the farthest from the TD controls. The systematic order is shown in the Figure 15 legend with atypical antipsychotic at the lowest end, closer to TD controls. The effects on medicated ASD were different across age groups maximally pulling them away from TD in the oldest age group 5. In contrast other medication classes pulled them towards the TD group in the younger groups (G1-G3).
  • the most prescribed medication in combination is the alpha-agonist in the youngest group (6 to 11 year olds), whereas antidepressant and stimulants are the most prescribed in the oldest group (those above 17 years old).
  • Anticonvulsants abound in groups 2 and 3 (spanning 11 to 15 year olds) whereas group 4 (16 to 17 year olds) has the atypical ADHD medication as the most prescribed in combination with others.
  • Figure 16 shows the results across age groups (in the case of missing medication class, it was not included).
  • the younger medicated ASD groups are pulled away from the non-medicated ASD participants, towards the TD participants, indicating a benefit.
  • this trend is opposite.
  • Examination of these older age groups shows that the patterns of medicated ASD participants systematically pull away from those of the TD participants.
  • the older the person the more deleterious the effects are in the noise-to-signal ratio of the speed-dependent parameters and the farther away from symmetric (Gaussian-like) distributions that the TD manifest.
  • the examination of the proportions of medications across age groups revealed that the atypical antipsychotics are likely to be the most prescribed in the youngest group while the oldest participants (congruent with the analyses above) have a higher percentage of antidepressants and stimulants prescribed to them.
  • the corrupted kinesthetic motor reafference may stem in part from synaptic dysfunction putatively producing specific patterns of sensory-motor noise.
  • the medications reported in the ABIDE study-sites are those commonly used to treat symptoms of ASD. They are noted to have motor side effects, including tremors, dyskinesias, involuntary ticks and other motor disorders in adult populations. A form of monitoring that relies on self-report therefore poses a substantial risk to the patient, particularly to the children, because these effects and drug interactions are not well understood for the young developing nervous systems at the peak of their plasticity.
  • the stochastic signatures of micro-movements taps into core biological features of neurodevelopmental disorders such as ASD, and is amenable to constitute one of the dimensions of the RDoC that cuts across research domains ( Bernard et al. (2015) Psychol. Med., 1-5 ).
  • the statistical sensitivity of these signatures to specific effects from different medication classes opens the possibility of combining this dimension with other domains of research and treatments to capture interactions in other neurological disorders.
  • the existing clinical classification was used as the basis for performing comparisons.
  • the same methods could be used to blindly identify self-emerging clusters as a function of interaction of medication classes and the rates of change in stochastic signatures across different pathologies.
  • the present results can be translated into the clinic by using a combination of wearable sensing devices (for example, attached to the head, trunk, and limbs) and the dynamic biometrics presented here.
  • a participant with a neurodevelopmental disorder could be measured continuously at home and in the clinic using any of the commercially available technology specifically adapted to medication intake.
  • Currently such devices Apple watch, fitbits, etc.
  • the same statistical platform presented here for the characterization of head-micromotions can be used to profile the micro-motion patterns of such physiological signals and their fluctuations and rates of change unique to the person.
  • This quantitative information would assist physicians in reaching the decision on whether or not to alter the psychopharmacological regimen according to the personalized longitudinal assessment of each patient in relation to his/her own patterns from previous visits. It would also allow insurance companies to draw a conclusion on coverage based on an objective outcome measure automatically revealing trends in the person's signatures.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Neurology (AREA)
  • Medical Informatics (AREA)
  • Animal Behavior & Ethology (AREA)
  • Physiology (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Veterinary Medicine (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Public Health (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Neurosurgery (AREA)
  • Developmental Disabilities (AREA)
  • Dentistry (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Signal Processing (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Psychiatry (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)

Claims (16)

  1. Procédé de mesure d'un mouvement physiologiquement pertinent d'un sujet ; ledit procédé comprenant les étapes consistant à :
    a) mesurer automatiquement des micromouvements d'un sujet difficilement reconnaissables à l'œil nu et mesurer automatiquement au moins une valeur biométrique sans mouvement du sujet, dans lequel les micromouvements du sujet et la au moins une valeur biométrique sont mesurés simultanément sur une période de temps ;
    b) déterminer automatiquement un rapport bruit/signal pour les micromouvements mesurés à l'étape a) pour chacun d'une pluralité d'intervalles de temps dans la période de temps et pour chacune d'une pluralité de plages de valeurs pour la valeur biométrique mesurée à l'étape a) ; et
    c) identifier automatiquement au moins une plage de la pluralité de plages de valeurs pour la valeur biométrique et au moins un intervalle de temps de la pluralité d'intervalles de temps dans lequel le rapport bruit/signal est inférieur à un ayant des micromouvements d'un mouvement physiologiquement pertinent.
  2. Procédé selon la revendication 1, dans lequel les mouvements physiologiquement pertinents ont un rapport bruit/signal le plus faible.
  3. Procédé selon la revendication 1, dans lequel les micromouvements sont mesurés avec un capteur de mouvement portable comprenant une unité de mesure inertielle (« IMU ») .
  4. Procédé selon la revendication 1, dans lequel la au moins une valeur biométrique comprend : la température du sujet, la fréquence cardiaque du sujet, l'activité électrodermique, l'activité électrique d'un cerveau mesurée par électroencéphalogramme (« EEG »), l'activité électrique de muscles mesurée par électromyographie (« EMG ») et/ou un schéma respiratoire.
  5. Procédé selon la revendication 1, dans lequel les micromouvements comprennent au moins un parmi :
    vitesse, accélération, profil de vitesse, vitesse maximale, accélération maximale, vitesse minimale, accélération minimale, temps pour atteindre la vitesse maximale, temps pour atteindre l'accélération maximale, vitesse de rétraction maximale, temps pour atteindre la vitesse de rétraction maximale, intervalles entre pics, trajectoire tridimensionnelle, précision du toucher de la cible, durée globale du mouvement, rotation ou positionnement d'une partie du corps, mouvement de translation, mouvement de rotation, ou angle d'articulation.
  6. Procédé selon la revendication 1, dans lequel la mesure automatique de micromouvements d'un sujet comprend une mesure d'un mouvement de la main, de la tête, du tronc, d'un membre ou d'un bras du sujet.
  7. Procédé selon la revendication 1, dans lequel la mesure automatique de micromouvements d'un sujet comprend une mesure du mouvement du bras du sujet.
  8. Procédé selon la revendication 1, dans lequel ladite valeur biométrique est la température du sujet.
  9. Procédé selon la revendication 1, dans lequel ledit micromouvement est un micromouvement d'accélération maximale.
  10. Procédé selon la revendication 1, comprenant en outre les étapes consistant à :
    après qu'une thérapie ait été administrée à un sujet, répéter les étapes a) à c) ; et
    déterminer automatiquement une modification du mouvement physiologiquement pertinent dudit sujet.
  11. Procédé selon la revendication 1, comprenant en outre les étapes consistant à :
    déterminer automatiquement un taux de variation de rapport signal/bruit pour une première plage de la pluralité de plages de valeurs pour la valeur biométrique sur des intervalles de temps successifs de la pluralité d'intervalles de temps ; et
    utiliser le taux de changement pour déterminer si le mouvement physiologiquement pertinent à chaque intervalle biométrique est systématique ou spontanément aléatoire.
  12. Procédé selon la revendication 1, dans lequel la détermination du rapport bruit/signal pour les micromouvements dans une première plage de la pluralité de plages de valeurs pour la valeur biométrique comprend en outre les étapes consistant à :
    ajuster automatiquement un paramètre de forme et un paramètre d'échelle d'une distribution Gamma continue sur la base de micromouvements dans la première plage pour la valeur biométrique ; et,
    déterminer automatiquement le rapport bruit/signal sur la base du paramètre de forme de la distribution Gamma continue.
  13. Procédé selon la revendication 1, dans lequel la mesure des micromouvements du sujet comprend en outre l'utilisation d'un procédé d'estimation de mouvement pour estimer un mouvement d'une tête du sujet sur la période de temps en :
    capturant et collectant une séquence d'images de la tête du sujet au cours de la période de temps à partir d'un appareil d'imagerie par résonance magnétique fonctionnelle (IRMf).
  14. Procédé selon la revendication 1, dans lequel le procédé comprend en outre l'affichage d'une matrice tridimensionnelle sur un affichage, la matrice tridimensionnelle comprenant une pluralité de cellules dans un plan bidimensionnel, dans lequel :
    une première dimension est la pluralité d'intervalles de temps dans la période de temps ;
    une seconde dimension est la pluralité de plages de valeurs pour la valeur biométrique ; et
    chacune de la pluralité de cellules est codée par une couleur ou une échelle de gris qui représente un écart maximal par rapport à une accélération moyenne du sujet correspondant à un intervalle de temps dans la pluralité d'intervalles de temps et une plage de valeurs de la pluralité de plages de valeurs pour la valeur biométrique.
  15. Procédé selon la revendication 14, dans lequel :
    les micromouvements sont mesurés avec une résolution d'échantillonnage du capteur de mouvement ; et
    la valeur biométrique est une fréquence cardiaque ou une température cutanée.
  16. Procédé selon la revendication 1, comprenant en outre l'étape consistant à :
    produire automatiquement au moins un tracé de premières données sur la base de micromouvements du mouvement physiologiquement pertinent.
EP15867321.0A 2014-12-08 2015-12-08 Procédés de mesure d'un mouvement physiologiquement pertinent Active EP3229684B1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201462089031P 2014-12-08 2014-12-08
PCT/US2015/064440 WO2016094375A1 (fr) 2014-12-08 2015-12-08 Procédés de mesure d'un mouvement physiologiquement pertinent

Publications (3)

Publication Number Publication Date
EP3229684A1 EP3229684A1 (fr) 2017-10-18
EP3229684A4 EP3229684A4 (fr) 2018-07-25
EP3229684B1 true EP3229684B1 (fr) 2020-04-01

Family

ID=56108043

Family Applications (1)

Application Number Title Priority Date Filing Date
EP15867321.0A Active EP3229684B1 (fr) 2014-12-08 2015-12-08 Procédés de mesure d'un mouvement physiologiquement pertinent

Country Status (3)

Country Link
US (1) US10898122B2 (fr)
EP (1) EP3229684B1 (fr)
WO (1) WO2016094375A1 (fr)

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104503592A (zh) * 2015-01-23 2015-04-08 北京智谷睿拓技术服务有限公司 头部动作确定方法和装置
US9836896B2 (en) 2015-02-04 2017-12-05 Proprius Technologies S.A.R.L Keyless access control with neuro and neuro-mechanical fingerprints
US10357210B2 (en) 2015-02-04 2019-07-23 Proprius Technologies S.A.R.L. Determining health change of a user with neuro and neuro-mechanical fingerprints
US9577992B2 (en) 2015-02-04 2017-02-21 Aerendir Mobile Inc. Data encryption/decryption using neuro and neuro-mechanical fingerprints
US9590986B2 (en) 2015-02-04 2017-03-07 Aerendir Mobile Inc. Local user authentication with neuro and neuro-mechanical fingerprints
US10599980B2 (en) * 2015-12-21 2020-03-24 Intel Corporation Technologies for cognitive cuing based on knowledge and context
US10918288B2 (en) 2016-10-14 2021-02-16 Rutgers, The State University Of New Jersey Systems and methods for tracking neuro-development disorders
US10768196B2 (en) 2016-12-19 2020-09-08 Huami Inc. Determine wearing position of a wearable device
WO2019051206A1 (fr) 2017-09-08 2019-03-14 Randall Davis Systèmes et procédés de détection et de quantification de tremblements
US20190223839A1 (en) * 2018-01-03 2019-07-25 Cardiac Pacemakers, Inc. Imaging of a body part using sounds
JP7165207B2 (ja) 2018-05-01 2022-11-02 ブラックソーン セラピューティクス インコーポレイテッド 機械学習ベースの診断分類器
WO2020086729A1 (fr) 2018-10-23 2020-04-30 Blackthorn Therapeutics, Inc. Systèmes et procédés de sélection, de diagnostic et de stratification de patients
AU2019365103A1 (en) * 2018-10-24 2021-05-27 Research Triangle Institute Systems, methods, and devices for determining mild traumatic brain injuries
US11164319B2 (en) 2018-12-20 2021-11-02 Smith & Nephew, Inc. Machine learning feature vector generator using depth image foreground attributes
CN110473202B (zh) * 2019-06-18 2023-03-31 山东工商学院 一种高阶动态功能连接网络的时序不变特征提取方法
US10559145B1 (en) * 2019-07-17 2020-02-11 Abdulaziz Mohammed Almehmadi Systems and methods for providing behavioral based intention detection
CA3157362A1 (fr) 2019-10-15 2021-04-22 Imperative Care, Inc. Systemes et procedes de detection d'attaque multivariable
CN113143257B (zh) * 2021-02-09 2023-01-17 国体智慧体育技术创新中心(北京)有限公司 基于个体运动行为层次模型的泛化应用系统及方法
AU2022252334A1 (en) * 2021-04-01 2023-10-12 Oura Health Oy Pregnancy-related complication identification and prediction from wearable-based physiological data
US20220327947A1 (en) * 2021-04-13 2022-10-13 D2L Corporation Systems and methods for automatically revising feedback in electronic learning systems
WO2023235777A2 (fr) * 2022-06-01 2023-12-07 Rutgers, The State University Of New Jersey Techniques de mesure de neurodéveloppement atypique chez des nouveau-nés sur la base d'une courte vidéo

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US812169A (en) * 1905-04-19 1906-02-06 Augusta Grasser Fly-trap.
US20030105409A1 (en) * 2001-11-14 2003-06-05 Donoghue John Philip Neurological signal decoding
US7006856B2 (en) * 2003-01-10 2006-02-28 Nellcor Puritan Bennett Incorporated Signal quality metrics design for qualifying data for a physiological monitor
US20050143589A1 (en) * 2003-11-09 2005-06-30 Donoghue John P. Calibration systems and methods for neural interface devices
US20050165327A1 (en) * 2004-01-28 2005-07-28 Thibault Lawrence E. Apparatus and method for detecting the severity of brain function impairment
US7733224B2 (en) * 2006-06-30 2010-06-08 Bao Tran Mesh network personal emergency response appliance
US8121361B2 (en) * 2006-05-19 2012-02-21 The Queen's Medical Center Motion tracking system for real time adaptive imaging and spectroscopy
EP2018825A1 (fr) * 2007-07-26 2009-01-28 Ecole Polytechnique Fédérale de Lausanne (EPFL) Procédés et dispositif pour quantifier un modèle d'activité physique humaine
WO2009051638A1 (fr) 2007-10-16 2009-04-23 Medtronic, Inc. Commande de thérapie selon un état de mouvement de patient
US8718980B2 (en) * 2009-09-11 2014-05-06 Qualcomm Incorporated Method and apparatus for artifacts mitigation with multiple wireless sensors
US8401629B2 (en) * 2010-04-28 2013-03-19 Medtronic, Inc. Method and apparatus for detecting and discriminating tachycardia
US9615547B2 (en) * 2011-07-14 2017-04-11 Petpace Ltd. Pet animal collar for health and vital signs monitoring, alert and diagnosis
US10176299B2 (en) * 2011-11-11 2019-01-08 Rutgers, The State University Of New Jersey Methods for the diagnosis and treatment of neurological disorders
US9005129B2 (en) * 2012-06-22 2015-04-14 Fitbit, Inc. Wearable heart rate monitor
CN104684459B (zh) * 2012-08-01 2017-09-12 皇家飞利浦有限公司 光体积描记术测量中识别运动伪影并且改善测量结果和警报的可靠性的方法和系统
CN104768455B (zh) * 2012-09-11 2018-01-02 L.I.F.E.公司 可穿戴式通信平台

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Also Published As

Publication number Publication date
US10898122B2 (en) 2021-01-26
WO2016094375A1 (fr) 2016-06-16
EP3229684A1 (fr) 2017-10-18
EP3229684A4 (fr) 2018-07-25
US20170340261A1 (en) 2017-11-30

Similar Documents

Publication Publication Date Title
EP3229684B1 (fr) Procédés de mesure d'un mouvement physiologiquement pertinent
Onorati et al. Multicenter clinical assessment of improved wearable multimodal convulsive seizure detectors
Mansur et al. A review on techniques for tremor recording and quantification
JP6975853B2 (ja) 脳機能検査システムおよびそのデバイス
EP2983586B1 (fr) Procédés pour surveiller la conscience
EP2734107B1 (fr) Procédé et système pour estimer une commotion cérébrale
CN105658134B (zh) 脑健康的多模态药理诊断评价
Bidwell et al. Seizure reporting technologies for epilepsy treatment: A review of clinical information needs and supporting technologies
Thomas et al. A treatment-response index from wearable sensors for quantifying Parkinson's disease motor states
Luo et al. Biomarkers for prediction of schizophrenia: insights from resting-state EEG microstates
JP2003521987A (ja) 定量的ｅｅｇを使用して脳の生理学的不均衡を分類および処置する方法
Qadeer et al. Bispectral index monitoring of conscious sedation with the combination of meperidine and midazolam during endoscopy
CN104903897A (zh) 癫痫和癫痫发作的易发性的评定
Luppi et al. Connectome harmonic decomposition of human brain dynamics reveals a landscape of consciousness
Pulliam et al. Motion sensor dyskinesia assessment during activities of daily living
Gallego-Jutgla et al. A theta-band EEG based index for early diagnosis of Alzheimer's disease
Zach et al. The patient's perspective: the effect of levodopa on Parkinson symptoms
Stuart et al. Prefrontal cortex activity and gait in Parkinson's disease with cholinergic and dopaminergic therapy
Torres et al. Objective and personalized longitudinal assessment of a pregnant patient with post severe brain trauma
Schaefer et al. Parkinson patients without tremor show changed patterns of mechanical muscle oscillations during a specific bilateral motor task compared to controls
Andrzejak et al. Seizure forecasting: Where do we stand?
Krasovsky et al. Bilateral leg stepping coherence as a predictor of freezing of gait in patients with Parkinson’s disease walking with wearable sensors
Castillo Rodriguez et al. Differentiation of subclinical and clinical electrographic events in long‐term electroencephalographic recordings
Tanabe et al. Left ventricular hypertrophy by electrocardiogram as a predictor of success in home blood pressure control: HOMED-BP study
Igberaese et al. Eeg power spectrum as a biomarker of autism: A pilot study

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20170628

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20180625

RIC1 Information provided on ipc code assigned before grant

Ipc: A61B 5/11 20060101ALI20180619BHEP

Ipc: A61B 5/103 20060101AFI20180619BHEP

Ipc: A61B 5/01 20060101ALI20180619BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20190912

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1250292

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200415

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602015050049

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200701

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20200401

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200702

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200701

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200401

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200401

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200401

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200817

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200401

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200401

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200801

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1250292

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200401

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200401

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200401

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200401

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200401

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602015050049

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200401

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200401

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200401

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200401

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200401

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200401

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200401

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200401

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200401

26N No opposition filed

Effective date: 20210112

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200401

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200401

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20201231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201208

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201208

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201231

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200401

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200401

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200401

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200401

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201231

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230525

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20231227

Year of fee payment: 9

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20231227

Year of fee payment: 9

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20231229

Year of fee payment: 9