WO2021072531A1 - Methods and systems for the acquisition of kinematic data for neuromotor assessment - Google Patents

Methods and systems for the acquisition of kinematic data for neuromotor assessment Download PDF

Info

Publication number
WO2021072531A1
WO2021072531A1 PCT/CA2020/051372 CA2020051372W WO2021072531A1 WO 2021072531 A1 WO2021072531 A1 WO 2021072531A1 CA 2020051372 W CA2020051372 W CA 2020051372W WO 2021072531 A1 WO2021072531 A1 WO 2021072531A1
Authority
WO
WIPO (PCT)
Prior art keywords
tasks
subject
kinematic data
computing device
mobile computing
Prior art date
Application number
PCT/CA2020/051372
Other languages
French (fr)
Inventor
Maria Cristina Carmona Duarte
Réjean PLAMONDON
Nadir FACI
Original Assignee
Polyvalor, Limited Partnership
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Polyvalor, Limited Partnership filed Critical Polyvalor, Limited Partnership
Priority to CA3157828A priority Critical patent/CA3157828A1/en
Publication of WO2021072531A1 publication Critical patent/WO2021072531A1/en

Links

Classifications

    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/70ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mental therapies, e.g. psychological therapy or autogenous training
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/103Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/1124Determining motor skills
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/103Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/1126Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb using a particular sensing technique
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/40Detecting, measuring or recording for evaluating the nervous system
    • A61B5/4076Diagnosing or monitoring particular conditions of the nervous system
    • A61B5/4082Diagnosing or monitoring movement diseases, e.g. Parkinson, Huntington or Tourette
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/40Detecting, measuring or recording for evaluating the nervous system
    • A61B5/4076Diagnosing or monitoring particular conditions of the nervous system
    • A61B5/4088Diagnosing of monitoring cognitive diseases, e.g. Alzheimer, prion diseases or dementia
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/48Other medical applications
    • A61B5/4803Speech analysis specially adapted for diagnostic purposes
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/30ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/63ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/20ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems

Definitions

  • the present disclosure relates generally to neuromotor assessments in humans, and more particularly to systems and methods for acquiring kinematic data for neuromotor assessments.
  • a method for obtaining kinematic data from a subject comprises presenting on a mobile computing device at least two tasks from: a handwriting task, a speech task, and a natural movement task, the at least two tasks executable by the subject with the mobile computing device, providing an external stimulus through the mobile computing device as a trigger to begin the at least two tasks, acquiring kinematic data from the subject on the mobile computing device as the at least two tasks are being performed, and generating a file with the kinematic data together with subject data.
  • the method further comprises processing the kinematic data to get parameters that characterize a neuromotor performance of the subject.
  • processing the kinematic data comprises processing the kinematic data on the mobile computing device.
  • processing the kinematic data comprises decomposing complex movements into simple movements, analyzing statically the simple movements, and characterizing the neuromotor performance of the subject based on the analyzing.
  • processing the kinematic data comprises comparing and correlating data from different neuromotor groups acquired through the at least two tasks.
  • providing the external stimulus comprises providing a same external stimulus for the at least two tasks.
  • providing the external stimulus comprises signaling an end to the at least two tasks.
  • the method further comprises transmitting the file with the kinematic data to a remote location.
  • the subject data comprises a hardware identifier for the mobile computing device.
  • the tasks are presented on the mobile device in accordance with at least one of a specific order and a complexity level.
  • a system for obtaining kinematic data from a subject comprises a processing unit and a non- transitory computer readable medium having stored thereon program code.
  • the program code is executable by the processing unit for presenting on a mobile computing device at least two tasks from: a handwriting task, a speech task, and a natural movement task, the at least two tasks executable by the subject with the mobile computing device, providing an external stimulus through the mobile computing device as a trigger to begin the at least two tasks, acquiring kinematic data from the subject on the mobile computing device as the at least two tasks are being performed, and generating a file with the kinematic data together with subject data.
  • the program code is further executable for processing the kinematic data to get parameters that characterize a neuromotor performance of the subject.
  • processing the kinematic data comprises processing the kinematic data on the mobile computing device.
  • processing the kinematic data comprises decomposing complex movements into simple movements, analyzing statically the simple movements, and characterizing the neuromotor performance of the subject based on the analyzing.
  • processing the kinematic data comprises comparing and correlating data from different neuromotor groups acquired through the at least two tasks.
  • providing the external stimulus comprises providing a same external stimulus for the at least two tasks.
  • providing the external stimulus comprises signaling an end to the at least two tasks.
  • the program code is further executable transmitting the file with the kinematic data to a remote location.
  • the subject data comprises a hardware identifier for the mobile computing device.
  • the tasks are presented on the mobile device in accordance with at least one of a specific order and a complexity level.
  • FIG. 1 is a schematic diagram illustrating an example system for acquiring kinematic data
  • FIG. 2 is a schematic diagram illustrating an example handwriting task presented on the system of Fig. 1;
  • Fig. 3 is a block diagram of an example embodiment for the controller of the system of Fig. 1;
  • FIG. 4 is a schematic diagram of a network of systems from Fig. 1;
  • FIG. 5 is a flowchart of an example method for acquiring kinematic data.
  • the present disclosure relates to computer-aided neuromotor assessment.
  • Kinematic data is obtained from a subject in order to perform a neuromotor assessment.
  • a mobile computing device is used to acquire the kinematic data from a plurality of muscle groups in order to get parameters that allow for various types of neuromotor assessments.
  • the neuromotor assessment may relate to the diagnosis and/or evolution of a neuromotor disease or upper limb injuries, such as but not limited to Parkinson’s disease or Alzheimer’s disease, as well as muscular problems, concussions, etc.
  • the neuromotor assessment may relate to evaluating the effect of a treatment for a neuromotor disease or accident. Generally, changes to the health status of a subject may be detected and/or monitored via the motor or neural assessment.
  • Neuromotor assessments combine both motor and neural assessments using the same device and protocol. The neuromotor assessment may also be performed on athletes to track performance and/or practicing effects and/or fatigue.
  • a single mobile device is used to obtain kinematic data from different muscle groups and their central controller in the motor cortex using two or more modalities.
  • the different modalities on a same device allow comparisons and correlations to be made between the kinematic data from the different neuromotor groups.
  • the single device provides a controlled environment for the acquisition of the kinematic data using different modalities, thus providing a form of synchronization of the kinematic data., and simplifying comparison of the results due to a common reference frame in the acquisition process.
  • the single mobile device comprises a controller having software configured for presenting one or more tasks to a subject, for each of the modalities available on the mobile device.
  • the combined nature of the modalities allows for coordination in the way the various tasks are presented to the subject, with regards to ordering and/or complexity level (for example of increasing/decreasing complexity).
  • the controller may be configured using a global approach to evaluating the subject from multiple perspectives.
  • Fig. 1 illustrates an example embodiment for a mobile computing device 100 configured for obtaining kinematic data of muscle groups of a subject using two or more modalities.
  • the mobile computing device 100 may be a tablet computer, such as a slate, a mini tablet, a phablet, a booklet, and iPad and the like.
  • the mobile computing device 100 is a 2-in-1 portable computer having a detachable or convertible touchscreen.
  • the mobile computing device 100 is a smartphone.
  • the mobile computing device 100 is a custom-made device.
  • a first modality for acquiring kinematic data relates to obtaining a handwriting sample from a subject. Indeed, the generation of handwriting is a complex neuromotor skill requiring the interaction of many cognitive processes.
  • This modality is realized through a touchscreen display 102 of the device 100.
  • the touchscreen display 102 is operated by gestures executed by a hand 104 and/or a digital stylus 106 in contact with the touchscreen display 102.
  • the generated trajectory of the tip of the stylus 106 or a finger is made up of strokes superimposed over time, which may be used as a mathematical description for the impulse response of a neuromuscular system.
  • Kinematic data is acquired by presenting at least one task related to handwriting on the touchscreen display 102.
  • At least one handwriting sample is acquired from the touchscreen display 102 by the device 100 during the handwriting task.
  • the touchscreen display 102 covers a portion of a top surface of the device 100, and the other portion may be used for other purposes. In some embodiments, the touchscreen display 102 is separated into two separate regions, a first region dedicated to acquiring handwriting samples from the digital stylus 106 and a second region dedicated to acquiring handwriting samples from the finger of the hand 104. Other embodiments for the touchscreen display 102 may apply depending on practical implementations. For example, a specific area of the display 102 may be dedicated to generated visual stimuli.
  • FIG. 2 An example task for acquiring a handwriting sample is illustrated in Fig. 2.
  • a starting point such as a dot 200 is identified.
  • the subject may be asked to draw one or more lines, as quickly as possible, from the starting point 200 to either of the zones 206, 208 outside of the circle 204.
  • the subject may be asked to draw a shape of a given dimension (i.e. a triangle, a spiral), to move the digital stylus 106 or hand 104 from side to side for a given duration of time (i.e. in an oscillation pattern), to draw a line or a shape with the left hand and/or with the right hand, to write certain letters (separately or joined together), to write a signature, and the like.
  • a wide variety of handwriting tasks may be used to obtain kinematic data suitable for observing, characterizing and evaluating neuromotor control through handwriting patterns.
  • Visual and/or audio stimuli may be used to indicate the beginning (and in some cases the end) of the handwriting task.
  • a sound cue may be a 1 kHz beep having a duration of 500 ms, or a visual cue may be a colored light that appears on the touchscreen display 102 or on another part of the device 100.
  • a sampling frequency of 200 Hz or greater may be used to acquire the handwriting sample. It can also be smaller, such as 60Hz, 100HZ, or any other suitable frequency.
  • the values presented herein are exemplary only and may vary depending on practical implementation.
  • a second modality for acquiring kinematic data relates to obtaining a speech sample from the subject.
  • This modality is realized through a microphone 108 of the device 100.
  • the microphone 108 converts sound into an electrical signal and may be implemented using any known or other microphone technology, such as a dynamic microphone (also called moving-coil microphone), a condenser microphone (also called capacitor microphone or electrostatic microphone), a piezoelectric microphone, a fiber-optic microphone, a laser microphone, a MEMS (microelectrical- mechanical system) microphone, and the like.
  • the microphone 108 may be positioned at any location on the device 100, including around its periphery, on a top surface, on a back surface, and the like.
  • the microphone 108 is embedded into a casing of the device 100.
  • the microphone 108 is detachable from the device 100, for manipulation by the subject.
  • One or more tasks related to speech may be presented to the subject via the touchscreen display 102 of the device 100.
  • speech-related tasks may be presented via the microphone 108, which in some embodiments can also act as a speaker.
  • Example tasks include asking the subject to utter certain vowels, produce certain sound sequences for a given duration, and say certain words.
  • Other speech-based tasks may be presented to the subject via the device 100, whereby one or more speech sample is acquired via the microphone 108.
  • one or more external stimuli may be used as a trigger to begin (and in some cases end) each a speech task.
  • the stimulus for data acquisition using a first modality is the same as that used for data acquisition using a second modality.
  • a sound cue of a same frequency and a same duration is used for both modalities.
  • a third modality for acquiring kinematic data using the device 100 relates to natural movement of the subject.
  • Natural movement includes basic locomotion, such as walking, running, climbing or crawling, as well as manipulative movements such as lifting, carrying, throwing and catching.
  • Kinematic data related to natural movement is acquired by the device 100 using an accelerometer 110.
  • the accelerometer 110 measures acceleration, i.e. the rate of change of the velocity of an object.
  • the object is the device 100, as it is displaced in space (x, y, z) by the subject.
  • a natural movement sample is obtained during a natural movement related task.
  • the accelerometer 110 may comprise piezoelectric, piezoresistive and/or capacitive components.
  • the accelerometer 110 is MEMs-based, such as a thermal accelerometer.
  • the accelerometer 110 and the microphone 108 are provided as a single device, as accelerometers can also be used to record sound.
  • the accelerometer may also incorporate a gyroscope and may be embedded in an Inertial measurement unit (IMU).
  • IMU Inertial measurement unit
  • An IMU is a platform which contains one or more inertial sensors (accelerometer, gyroscope, magnetometer) to assess linear acceleration, angular velocity and magnetic North. IMUs are sometimes referred to as magnetic and inertial measurement unit (MIMU), magnetic angular rate and gravity sensor (MARG), inertial and magnetic measurement unit (IMMU), or attitude and heading reference system (AHRS), depending on configuration and domain of application.
  • MIMU magnetic and inertial measurement unit
  • MARG magnetic angular rate and gravity sensor
  • IMMU inertial and magnetic measurement unit
  • AHRS attitude and heading reference system
  • One or more tasks related to natural movement may be presented to the subject via the touchscreen display 102 of the device 100 and/or the microphone 108.
  • An example task includes asking the subject to hold the device 100 still with arms outstretched, for a given duration of time.
  • Another example task includes asking the subject to draw a given shape, such as a triangle or a circle, in the air with his or her arms while holding the device 100, or to draw a shape in the air as large as possible while holding the device 100.
  • Yet another example task includes asking the subject to hold the device 100 at a first position, such as straight above his or her head, and to bring the device to a second position, such as at waist level, in a slow and steady manner.
  • Various other tasks relating to natural movement may be presented, depending on practical implementation.
  • One or more external stimuli may be used as a trigger to begin (and in some cases end) each natural movement task.
  • the same stimuli may be used to trigger the beginning of a natural movement task as that used for a handwriting task and/or a speech task.
  • the controller 112 comprises a processing unit 302 and a memory 304 which has stored therein computer-executable instructions 306, as illustrated in Fig. 3.
  • the processing unit 302 may comprise, for example, any type of general-purpose microprocessor or microcontroller, a digital signal processing (DSP) processor, a CPU, an integrated circuit, a field programmable gate array (FPGA), a reconfigurable processor, a graphics processing unit (GPU), other suitably programmed or programmable logic circuits, or any combination thereof.
  • DSP digital signal processing
  • FPGA field programmable gate array
  • GPU graphics processing unit
  • the memory 304 may comprise any suitable known or other machine-readable storage medium.
  • the memory 304 may comprise non-transitory computer readable storage medium, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing.
  • the memory 504 may be, for example random-access memory (RAM), read-only memory (ROM), electro-optical memory, magneto-optical memory, erasable programmable read-only memory (EPROM), electrically-erasable programmable read-only memory (EEPROM), Ferroelectric RAM (FRAM) or the like.
  • Memory 304 may comprise any storage means (e.g., devices) suitable for retrievably storing machine-readable instructions 306 executable by processing unit 302.
  • the program instructions 306 may be implemented in a high level procedural or object oriented programming or scripting language, or a combination thereof. Alternatively, the program instructions 306 may be implemented in assembly or machine language. The language may be a compiled or interpreted language. Program code may be stored on a storage media or a device, for example a ROM, a magnetic disk, an optical disc, a flash drive, or any other suitable storage media or device. The program code may be readable by a general or special-purpose programmable computer for configuring and operating the computer when the storage media or device is read by the computer to perform the procedures described herein.
  • the computer-executable program instructions 306 may be in many forms, including program modules, executed by one or more computers or other devices.
  • program modules include routines, programs, objects, components, data structures, etc., that perform particular tasks or implement particular abstract data types.
  • functionality of the program modules may be combined or distributed as desired in various embodiments.
  • the program instructions 306 are configured to present the tasks to the subject on the device 100 and to acquire the kinematic data using the different modalities.
  • the program instructions 306 may also be configured to generate the external stimuli to begin (and in some cases end) the tasks, and to coordinate acquisition of the data with the beginning and end of the various tasks.
  • the program instructions 306 may be configured to present the tasks for the different modalities in a specific order. For example, the subject may be asked to perform handwriting tasks, followed by speech tasks, followed by natural movement tasks; or speech tasks, followed by natural movement tasks, followed by handwriting tasks.
  • the modalities may be alternated, for example: one handwriting task, one speech task, one handwriting task, one natural movement task, one speech task, one natural movement task.
  • the complexity level of the tasks may also be varied, for example by presenting increasingly difficult tasks.
  • Various combinations may be presented to the subject in order to obtain a maximum amount of information that may be used in the motor assessment.
  • a task triggered by a visual or an audio stimuli involves the visual or the auditive areas and may be based on the simple reaction test (SRT). It examines the capacity of the subject to react as quickly as possible to a visual or an audio stimulus. Using left or right visual stimuli to determine the direction of a stroke evaluates the capacity of a subject to react quickly and to make a good choice at the same time, both characteristics being of equal importance.
  • Speed accuracy trade-off tasks can assess the ability of the subject to coordinate spatial and temporal properties of his or her movements under competing speed (temporal) and accuracy(spatial) requirements. Other tasks might evaluate the rhythmical properties of the subject as his/her forearm or hand is oscillating at maximum frequency.
  • the tasks using the different modalities may need to be performed within a given time frame, such as 15 minutes, 30 minutes, or any other suitable time frame.
  • the program instructions 306 may be configured to enforce the time requirements, such as by presenting a timer on the touchscreen display 102, or by triggering a timer on the device 100 separate from the touchscreen display 102.
  • the program instructions 306 may be configured to generate a file with the handwriting sample(s), speech sample(s), and natural movement sample(s) together with subject data.
  • Subject data may comprise identification data of the subject.
  • the identification data excludes personal information about the subject (such as name, date of birth, etc.) in order to protect the identity of the subject. For example, a subject number may instead be used. Alternatively, detailed personal information may be stored with the kinematic data.
  • subject data includes information about the device used to acquire the data, for example a hardware identifier.
  • subject data comprises information about the data acquisition, such as the time and/or day on which it was acquired, whether it was acquired using the left or right hand, etc.
  • a questionnaire can also be used to evaluate some specific conditions, like sleep time, cardiac frequency, etc., or this information can be provided by any device, such as a cell phone, an instrumented watch, and the like.
  • the file comprising the kinematic data and the subject data is transmitted to a remote location.
  • a remote location An example is illustrated in Fig. 4, where a plurality of subjects 400 are each assigned a device 100 for acquisition of kinematic data.
  • the subjects 400 can have their devices 100 with them in their home, or they can access the devices at specific locations such as a health center, a recreational center, a rehab center, and the like.
  • the files 404 are transmitted to a database 402, which may be accessible through a cloud-based service (i.e. DropboxTM, AmazonTM Web Services, Cloud SQLTM, etc) or through an internal local area network (LAN) or wide area network (WAN).
  • the files 404 may be accessed from another computing device 406 by an operator 408.
  • the operator 408 is a clinician or other medical professional involved in the evaluation of neuromotor diseases.
  • Each file 404 links the data to a user 400 and to a device 100.
  • the data may be processed to provide a neuromotor assessment of the subject based on at least two of the handwriting sample, the speech sample, and the natural movement sample, by comparatively assessing kinematics associated with the samples.
  • analysis of the data is performed by the controller 112 on the mobile computing device 100.
  • analysis of the data is performed remotely from the mobile computing device 100, for example on computing device 406. Where the analysis is performed may be determined as a function of the processing capabilities of the mobile computing device 100, and more specifically of the processing unit 302 of the controller 112.
  • the network setup as illustrated in Fig. 4, provides the ability of compiling a large amount of information regarding different muscle groups as well as central information about the brain controller, which can be used for research purposes.
  • the setup also facilitates general monitoring and assessment of subjects from health care providers without requiring face-to-face evaluations.
  • updates and/or new features for the software residing on the controller 112 of each device 100 may be pushed to the devices 100 through the network, from the computing device 406 or another computing device.
  • the software may therefore be managed remotely.
  • the kinematic data acquired using the various types of tasks described herein, namely handwriting, speech and natural movement, may be analysed using the Kinematics Theory of rapid human movements (Plamondon, R.: A kinematic theory of rapid human movements. Part I: Movement representation and generation Biological Cybernetics. 72, 295-307 (1995)).
  • the data may represent any one of a position in space, velocity, and acceleration.
  • the Kinematics Theory the way in which neuromuscular systems are involved in the production of muscular movements is modelled using lognormal velocity profiles, which may be referred to as the Delta-lognormal or the Sigma- lognormal model.
  • the handwriting sample corresponds to a plurality of positions in space of the tip of the stylus 106 or a finger of the hand 104, as a function of time.
  • the positions may be derived with respect to time to obtain velocity.
  • the velocity may be derived with respect to time to obtain acceleration.
  • the Kinematic Theory of rapid human movements may be applied to the data obtained from the handwriting samples to extrapolate information about the subject and perform the neuromotor assessment.
  • the natural movement sample corresponds to an acceleration, which may be integrated over time to obtain velocity.
  • the velocity may be integrated over time to obtain positions in space as a function of time.
  • the Kinematic Theory of rapid human movements may be applied to the data obtained from the natural movement samples to extrapolate information about the subject and perform the motor assessment.
  • the speech data may be converted to a velocity profile (or a velocity signal).
  • the conversion is performed as described in Carmona, C., Plamondon, R., Gomez, P., Ferrer, M. A., Alonso, J. B., andmajl, A. R. (2016). “Application of the lognormal model to the vocal tract movement to detect neurological diseases in voice,” in Innovation in Medicine and Healthcare, Smart Innovation, Systems and Technologies, Vol. 60, eds Y. W. Chen, S. Tanaka, R. J. Howlett, and L. C. Jain (Cham: Springer International Publishing AG), 25-35.
  • the velocity profile may be integrated over time to obtain positions in space as a function of time.
  • the velocity profile may be derived with respect to time to obtain acceleration.
  • the Kinematic Theory of rapid human movements may be applied to the data obtained from the speech samples to extrapolate information about the subject and perform the motor assessment.
  • a method 500 of obtaining kinematic data from a subject, for neuromotor assessment of the subject At step 502, at least two tasks of different modalities are presented on a mobile computing device, such as device 100. Any two tasks from a handwriting task, a speech task, and a natural movement task may be presented, each task executable by the subject with the mobile computing device.
  • an external stimulus is provided through the mobile computing device as a trigger to begin each task.
  • steps 502 and 504 are performed iteratively, for example a first task is presented with a first external stimulus, followed by a second task with a second external stimulus, etc.
  • the tasks may be presented in a specific and predetermined order and/or manner.
  • kinematic data is acquired from the subject on the mobile computing device as the tasks are being performed.
  • kinematic data is acquired from the touchscreen display 102 during handwriting tasks, from the microphone 108 during speech tasks, and from the accelerometer 110 during natural movement tasks.
  • a file is generated with the kinematic data together with subject data.
  • the file is transmitted to a remote location at step 510 for further processing.
  • the method 500 comprises a step 512 of processing the kinematic data to get parameters that characterize a neuromotor performance of the subject.
  • the processing of step 512 is performed remotely when step 510 is also performed, and is performed locally when step 510 is omitted.
  • the processing step 512 is performed locally and the data is also transmitted to a remote location at step 510.
  • step 508 is omitted and the processing step 512 is performed locally.
  • the kinematic data may be processed in a same manner independently of a source of the kinematic data, such that data obtained from the handwriting task, the speech tasks, and the natural movement task is treated in a coherent and uniform manner.
  • processing the kinematic data comprises decomposing complex movements represented by the kinematic data into simple movements, for example by applying the Kinematics Theory of rapid human movements. This may be done using Sigma-lognormals or other models having similar characteristics. Other embodiments may also apply for decomposing the complex movements into simple movements. Simple movements may be analyzed statically and a neuromotor performance of the subject may be characterized based on the analysis.
  • both the central controller and the peripheral executor of the brain may be studied simultaneously through the global perspective afforded from the acquisition of kinematic data using two or more modalities. Neuromotricity of subjects may thus be assessed optimally.
  • the different tasks may be integrated or hidden, such as in a video game environment, to motivate subjects to use the system, particularly children, and to facilitate large data collection across large populations, opening the door to data mining and deep learning neuromotor assessments.
  • the program instructions 306 may reside in whole or in part remotely from the device 100.
  • an application is downloaded onto the device 100.
  • the features described herein are provided through the device 100 on a web-based platform.

Abstract

Methods and systems for obtaining kinematic data from a subject for neuromotor assessment are presented herein. The method comprises presenting on a mobile computing device at least two of: a handwriting task, a speech task, and a natural movement task, each task executable by the subject with the mobile computing device, providing an external stimulus through the mobile computing device as a trigger to begin each task and acquiring kinematic data from the subject on the mobile computing device as the tasks are being performed. The acquired kinematic data may be stored locally, processed locally, and/or stored and transmitted remotely for processing.

Description

METHODS AND SYSTEMS FOR THE ACQUISITION OF KINEMATIC DATA FOR
NEUROMOTOR ASSESSMENT
CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] The present application claims the benefit of United States Provisional Patent Application No. 62/916,325 filed on October 17, 2019, the contents of which are hereby incorporated by reference in their entirety.
TECHNICAL FIELD
[0002] The present disclosure relates generally to neuromotor assessments in humans, and more particularly to systems and methods for acquiring kinematic data for neuromotor assessments.
BACKGROUND OF THE ART
[0003] Human movement can be very complex, and there are many past and ongoing studies in various areas of medicine and human sciences dealing with some of these topics. For example in neurosciences, handwriting strokes constitute a specific class of rapid human movements and they are used to study neurodegenerative processes involved in diseases such as Parkinson’s and Alzheimer’s. The early detection of cerebral lesions appears possible by determining slight deviations from the norm, which are not evident by simple visual inspection.
[0004] For the purposes of detection, diagnosis, treatment, and research, various tools have been devised for gathering kinematic data from human subjects. Certain challenges arise when using comparative results from one experiment to another.
[0005] Therefore, improvements are needed.
SUMMARY
[0006] In accordance with a broad aspect, there is provided a method for obtaining kinematic data from a subject. The method comprises presenting on a mobile computing device at least two tasks from: a handwriting task, a speech task, and a natural movement task, the at least two tasks executable by the subject with the mobile computing device, providing an external stimulus through the mobile computing device as a trigger to begin the at least two tasks, acquiring kinematic data from the subject on the mobile computing device as the at least two tasks are being performed, and generating a file with the kinematic data together with subject data.
[0007] In various embodiments, the method further comprises processing the kinematic data to get parameters that characterize a neuromotor performance of the subject.
[0008] In various embodiments, processing the kinematic data comprises processing the kinematic data on the mobile computing device.
[0009] In various embodiments, processing the kinematic data comprises decomposing complex movements into simple movements, analyzing statically the simple movements, and characterizing the neuromotor performance of the subject based on the analyzing.
[0010] In various embodiments, processing the kinematic data comprises comparing and correlating data from different neuromotor groups acquired through the at least two tasks.
[0011] In various embodiments, providing the external stimulus comprises providing a same external stimulus for the at least two tasks.
[0012] In various embodiments, providing the external stimulus comprises signaling an end to the at least two tasks.
[0013] In various embodiments, the method further comprises transmitting the file with the kinematic data to a remote location.
[0014] In various embodiments, the subject data comprises a hardware identifier for the mobile computing device.
[0015] In various embodiments, the tasks are presented on the mobile device in accordance with at least one of a specific order and a complexity level.
[0016] In accordance with another broad aspect, there is provided a system for obtaining kinematic data from a subject. The system comprises a processing unit and a non- transitory computer readable medium having stored thereon program code. The program code is executable by the processing unit for presenting on a mobile computing device at least two tasks from: a handwriting task, a speech task, and a natural movement task, the at least two tasks executable by the subject with the mobile computing device, providing an external stimulus through the mobile computing device as a trigger to begin the at least two tasks, acquiring kinematic data from the subject on the mobile computing device as the at least two tasks are being performed, and generating a file with the kinematic data together with subject data. [0017] In various embodiments, the program code is further executable for processing the kinematic data to get parameters that characterize a neuromotor performance of the subject.
[0018] In various embodiments, processing the kinematic data comprises processing the kinematic data on the mobile computing device.
[0019] In various embodiments, processing the kinematic data comprises decomposing complex movements into simple movements, analyzing statically the simple movements, and characterizing the neuromotor performance of the subject based on the analyzing.
[0020] In various embodiments, processing the kinematic data comprises comparing and correlating data from different neuromotor groups acquired through the at least two tasks.
[0021] In various embodiments, providing the external stimulus comprises providing a same external stimulus for the at least two tasks.
[0022] In various embodiments, providing the external stimulus comprises signaling an end to the at least two tasks.
[0023] In various embodiments, the program code is further executable transmitting the file with the kinematic data to a remote location.
[0024] In various embodiments, the subject data comprises a hardware identifier for the mobile computing device.
[0025] In various embodiments, the tasks are presented on the mobile device in accordance with at least one of a specific order and a complexity level.
[0026] Features of the systems, devices, and methods described herein may be used in various combinations, in accordance with the embodiments described herein.
BRIEF DESCRIPTION OF THE DRAWINGS
[0027] Reference is now made to the accompanying figures in which:
[0028] Fig. 1 is a schematic diagram illustrating an example system for acquiring kinematic data;
[0029] Fig. 2 is a schematic diagram illustrating an example handwriting task presented on the system of Fig. 1; [0030] Fig. 3 is a block diagram of an example embodiment for the controller of the system of Fig. 1;
[0031] Fig. 4 is a schematic diagram of a network of systems from Fig. 1; and
[0032] Fig. 5 is a flowchart of an example method for acquiring kinematic data.
[0033] It will be noted that throughout the appended drawings, like features are identified by like reference numerals.
DETAILED DESCRIPTION
[0034] The present disclosure relates to computer-aided neuromotor assessment. Kinematic data is obtained from a subject in order to perform a neuromotor assessment. A mobile computing device is used to acquire the kinematic data from a plurality of muscle groups in order to get parameters that allow for various types of neuromotor assessments. The neuromotor assessment may relate to the diagnosis and/or evolution of a neuromotor disease or upper limb injuries, such as but not limited to Parkinson’s disease or Alzheimer’s disease, as well as muscular problems, concussions, etc. The neuromotor assessment may relate to evaluating the effect of a treatment for a neuromotor disease or accident. Generally, changes to the health status of a subject may be detected and/or monitored via the motor or neural assessment. Neuromotor assessments combine both motor and neural assessments using the same device and protocol. The neuromotor assessment may also be performed on athletes to track performance and/or practicing effects and/or fatigue.
[0035] A single mobile device is used to obtain kinematic data from different muscle groups and their central controller in the motor cortex using two or more modalities. The different modalities on a same device allow comparisons and correlations to be made between the kinematic data from the different neuromotor groups. The single device provides a controlled environment for the acquisition of the kinematic data using different modalities, thus providing a form of synchronization of the kinematic data., and simplifying comparison of the results due to a common reference frame in the acquisition process.
[0036] The single mobile device comprises a controller having software configured for presenting one or more tasks to a subject, for each of the modalities available on the mobile device. The combined nature of the modalities allows for coordination in the way the various tasks are presented to the subject, with regards to ordering and/or complexity level (for example of increasing/decreasing complexity). Moreover, the controller may be configured using a global approach to evaluating the subject from multiple perspectives.
[0037] Fig. 1 illustrates an example embodiment for a mobile computing device 100 configured for obtaining kinematic data of muscle groups of a subject using two or more modalities. The mobile computing device 100 may be a tablet computer, such as a slate, a mini tablet, a phablet, a booklet, and iPad and the like. In some embodiments, the mobile computing device 100 is a 2-in-1 portable computer having a detachable or convertible touchscreen. In some embodiments, the mobile computing device 100 is a smartphone. In some embodiments, the mobile computing device 100 is a custom-made device.
[0038] A first modality for acquiring kinematic data relates to obtaining a handwriting sample from a subject. Indeed, the generation of handwriting is a complex neuromotor skill requiring the interaction of many cognitive processes. This modality is realized through a touchscreen display 102 of the device 100. The touchscreen display 102 is operated by gestures executed by a hand 104 and/or a digital stylus 106 in contact with the touchscreen display 102. The generated trajectory of the tip of the stylus 106 or a finger is made up of strokes superimposed over time, which may be used as a mathematical description for the impulse response of a neuromuscular system. Kinematic data is acquired by presenting at least one task related to handwriting on the touchscreen display 102. At least one handwriting sample is acquired from the touchscreen display 102 by the device 100 during the handwriting task.
[0039] In some embodiments, the touchscreen display 102 covers a portion of a top surface of the device 100, and the other portion may be used for other purposes. In some embodiments, the touchscreen display 102 is separated into two separate regions, a first region dedicated to acquiring handwriting samples from the digital stylus 106 and a second region dedicated to acquiring handwriting samples from the finger of the hand 104. Other embodiments for the touchscreen display 102 may apply depending on practical implementations. For example, a specific area of the display 102 may be dedicated to generated visual stimuli.
[0040] An example task for acquiring a handwriting sample is illustrated in Fig. 2. A starting point, such as a dot 200 is identified. The subject may be asked to draw one or more lines, as quickly as possible, from the starting point 200 to either of the zones 206, 208 outside of the circle 204. Alternatively or in combination therewith, the subject may be asked to draw a shape of a given dimension (i.e. a triangle, a spiral), to move the digital stylus 106 or hand 104 from side to side for a given duration of time (i.e. in an oscillation pattern), to draw a line or a shape with the left hand and/or with the right hand, to write certain letters (separately or joined together), to write a signature, and the like. A wide variety of handwriting tasks may be used to obtain kinematic data suitable for observing, characterizing and evaluating neuromotor control through handwriting patterns.
[0041] Visual and/or audio stimuli may be used to indicate the beginning (and in some cases the end) of the handwriting task. For example, a sound cue may be a 1 kHz beep having a duration of 500 ms, or a visual cue may be a colored light that appears on the touchscreen display 102 or on another part of the device 100. A sampling frequency of 200 Hz or greater may be used to acquire the handwriting sample. It can also be smaller, such as 60Hz, 100HZ, or any other suitable frequency. The values presented herein are exemplary only and may vary depending on practical implementation.
[0042] Referring back to Fig. 1 , a second modality for acquiring kinematic data relates to obtaining a speech sample from the subject. This modality is realized through a microphone 108 of the device 100. The microphone 108 converts sound into an electrical signal and may be implemented using any known or other microphone technology, such as a dynamic microphone (also called moving-coil microphone), a condenser microphone (also called capacitor microphone or electrostatic microphone), a piezoelectric microphone, a fiber-optic microphone, a laser microphone, a MEMS (microelectrical- mechanical system) microphone, and the like. The microphone 108 may be positioned at any location on the device 100, including around its periphery, on a top surface, on a back surface, and the like. In some embodiments, the microphone 108 is embedded into a casing of the device 100. In some embodiments, the microphone 108 is detachable from the device 100, for manipulation by the subject.
[0043] One or more tasks related to speech may be presented to the subject via the touchscreen display 102 of the device 100. Alternatively or in combination therewith, speech-related tasks may be presented via the microphone 108, which in some embodiments can also act as a speaker. Example tasks include asking the subject to utter certain vowels, produce certain sound sequences for a given duration, and say certain words. Other speech-based tasks may be presented to the subject via the device 100, whereby one or more speech sample is acquired via the microphone 108. [0044] Similarly to the handwriting tasks, one or more external stimuli may be used as a trigger to begin (and in some cases end) each a speech task. In some embodiments, the stimulus for data acquisition using a first modality is the same as that used for data acquisition using a second modality. For example, a sound cue of a same frequency and a same duration is used for both modalities. In this manner, when considering kinematic data obtained from the same subject using the two different modalities, there is no need to account for differences in the trigger used to begin the tasks.
[0045] A third modality for acquiring kinematic data using the device 100 relates to natural movement of the subject. Natural movement includes basic locomotion, such as walking, running, climbing or crawling, as well as manipulative movements such as lifting, carrying, throwing and catching. Kinematic data related to natural movement is acquired by the device 100 using an accelerometer 110. The accelerometer 110 measures acceleration, i.e. the rate of change of the velocity of an object. In this case, the object is the device 100, as it is displaced in space (x, y, z) by the subject. A natural movement sample is obtained during a natural movement related task.
[0046] Any technology suitable for measuring proper acceleration, by converting mechanical motion into an electrical signal, may be used. For example, the accelerometer 110 may comprise piezoelectric, piezoresistive and/or capacitive components. In some embodiments, the accelerometer 110 is MEMs-based, such as a thermal accelerometer. In some embodiments, the accelerometer 110 and the microphone 108 are provided as a single device, as accelerometers can also be used to record sound. Various embodiments may apply depending on practical implementation. The accelerometer may also incorporate a gyroscope and may be embedded in an Inertial measurement unit (IMU). An IMU is a platform which contains one or more inertial sensors (accelerometer, gyroscope, magnetometer) to assess linear acceleration, angular velocity and magnetic North. IMUs are sometimes referred to as magnetic and inertial measurement unit (MIMU), magnetic angular rate and gravity sensor (MARG), inertial and magnetic measurement unit (IMMU), or attitude and heading reference system (AHRS), depending on configuration and domain of application.
[0047] One or more tasks related to natural movement may be presented to the subject via the touchscreen display 102 of the device 100 and/or the microphone 108. An example task includes asking the subject to hold the device 100 still with arms outstretched, for a given duration of time. Another example task includes asking the subject to draw a given shape, such as a triangle or a circle, in the air with his or her arms while holding the device 100, or to draw a shape in the air as large as possible while holding the device 100. Yet another example task includes asking the subject to hold the device 100 at a first position, such as straight above his or her head, and to bring the device to a second position, such as at waist level, in a slow and steady manner. Various other tasks relating to natural movement may be presented, depending on practical implementation.
[0048] One or more external stimuli may be used as a trigger to begin (and in some cases end) each natural movement task. The same stimuli may be used to trigger the beginning of a natural movement task as that used for a handwriting task and/or a speech task.
[0049] Once the handwriting sample(s), speech sample(s), and/or natural movement sample(s) are acquired by the different modalities of the device 100, they are transmitted to a controller 112 on the device 100. In some embodiments, the controller 112 comprises a processing unit 302 and a memory 304 which has stored therein computer-executable instructions 306, as illustrated in Fig. 3. The processing unit 302 may comprise, for example, any type of general-purpose microprocessor or microcontroller, a digital signal processing (DSP) processor, a CPU, an integrated circuit, a field programmable gate array (FPGA), a reconfigurable processor, a graphics processing unit (GPU), other suitably programmed or programmable logic circuits, or any combination thereof.
[0050] The memory 304 may comprise any suitable known or other machine-readable storage medium. The memory 304 may comprise non-transitory computer readable storage medium, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. The memory 504 may be, for example random-access memory (RAM), read-only memory (ROM), electro-optical memory, magneto-optical memory, erasable programmable read-only memory (EPROM), electrically-erasable programmable read-only memory (EEPROM), Ferroelectric RAM (FRAM) or the like. Memory 304 may comprise any storage means (e.g., devices) suitable for retrievably storing machine-readable instructions 306 executable by processing unit 302.
[0051] The program instructions 306 may be implemented in a high level procedural or object oriented programming or scripting language, or a combination thereof. Alternatively, the program instructions 306 may be implemented in assembly or machine language. The language may be a compiled or interpreted language. Program code may be stored on a storage media or a device, for example a ROM, a magnetic disk, an optical disc, a flash drive, or any other suitable storage media or device. The program code may be readable by a general or special-purpose programmable computer for configuring and operating the computer when the storage media or device is read by the computer to perform the procedures described herein.
[0052] The computer-executable program instructions 306 may be in many forms, including program modules, executed by one or more computers or other devices. Generally, program modules include routines, programs, objects, components, data structures, etc., that perform particular tasks or implement particular abstract data types. Typically the functionality of the program modules may be combined or distributed as desired in various embodiments.
[0053] The program instructions 306 are configured to present the tasks to the subject on the device 100 and to acquire the kinematic data using the different modalities. The program instructions 306 may also be configured to generate the external stimuli to begin (and in some cases end) the tasks, and to coordinate acquisition of the data with the beginning and end of the various tasks.
[0054] The program instructions 306 may be configured to present the tasks for the different modalities in a specific order. For example, the subject may be asked to perform handwriting tasks, followed by speech tasks, followed by natural movement tasks; or speech tasks, followed by natural movement tasks, followed by handwriting tasks. The modalities may be alternated, for example: one handwriting task, one speech task, one handwriting task, one natural movement task, one speech task, one natural movement task. The complexity level of the tasks may also be varied, for example by presenting increasingly difficult tasks. Various combinations may be presented to the subject in order to obtain a maximum amount of information that may be used in the motor assessment.
[0055] Depending on the task, the kinematic data allows to study different neuromotor functions. For example a task triggered by a visual or an audio stimuli involves the visual or the auditive areas and may be based on the simple reaction test (SRT). It examines the capacity of the subject to react as quickly as possible to a visual or an audio stimulus. Using left or right visual stimuli to determine the direction of a stroke evaluates the capacity of a subject to react quickly and to make a good choice at the same time, both characteristics being of equal importance. Speed accuracy trade-off tasks can assess the ability of the subject to coordinate spatial and temporal properties of his or her movements under competing speed (temporal) and accuracy(spatial) requirements. Other tasks might evaluate the rhythmical properties of the subject as his/her forearm or hand is oscillating at maximum frequency.
[0056] The tasks using the different modalities may need to be performed within a given time frame, such as 15 minutes, 30 minutes, or any other suitable time frame. The program instructions 306 may be configured to enforce the time requirements, such as by presenting a timer on the touchscreen display 102, or by triggering a timer on the device 100 separate from the touchscreen display 102.
[0057] The program instructions 306 may be configured to generate a file with the handwriting sample(s), speech sample(s), and natural movement sample(s) together with subject data. Subject data may comprise identification data of the subject. In some embodiments, the identification data excludes personal information about the subject (such as name, date of birth, etc.) in order to protect the identity of the subject. For example, a subject number may instead be used. Alternatively, detailed personal information may be stored with the kinematic data. In some embodiments, subject data includes information about the device used to acquire the data, for example a hardware identifier. In some embodiments, subject data comprises information about the data acquisition, such as the time and/or day on which it was acquired, whether it was acquired using the left or right hand, etc. A questionnaire can also be used to evaluate some specific conditions, like sleep time, cardiac frequency, etc., or this information can be provided by any device, such as a cell phone, an instrumented watch, and the like.
[0058] In some embodiments, the file comprising the kinematic data and the subject data is transmitted to a remote location. An example is illustrated in Fig. 4, where a plurality of subjects 400 are each assigned a device 100 for acquisition of kinematic data. The subjects 400 can have their devices 100 with them in their home, or they can access the devices at specific locations such as a health center, a recreational center, a rehab center, and the like. The files 404 are transmitted to a database 402, which may be accessible through a cloud-based service (i.e. Dropbox™, Amazon™ Web Services, Cloud SQL™, etc) or through an internal local area network (LAN) or wide area network (WAN). The files 404 may be accessed from another computing device 406 by an operator 408. In some embodiments, the operator 408 is a clinician or other medical professional involved in the evaluation of neuromotor diseases.
[0059] Each file 404 links the data to a user 400 and to a device 100. The data may be processed to provide a neuromotor assessment of the subject based on at least two of the handwriting sample, the speech sample, and the natural movement sample, by comparatively assessing kinematics associated with the samples. In some embodiments, analysis of the data is performed by the controller 112 on the mobile computing device 100. In some embodiments, analysis of the data is performed remotely from the mobile computing device 100, for example on computing device 406. Where the analysis is performed may be determined as a function of the processing capabilities of the mobile computing device 100, and more specifically of the processing unit 302 of the controller 112.
[0060] The network setup, as illustrated in Fig. 4, provides the ability of compiling a large amount of information regarding different muscle groups as well as central information about the brain controller, which can be used for research purposes. The setup also facilitates general monitoring and assessment of subjects from health care providers without requiring face-to-face evaluations.
[0061] In some embodiments, updates and/or new features for the software residing on the controller 112 of each device 100 may be pushed to the devices 100 through the network, from the computing device 406 or another computing device. The software may therefore be managed remotely.
[0062] The kinematic data acquired using the various types of tasks described herein, namely handwriting, speech and natural movement, may be analysed using the Kinematics Theory of rapid human movements (Plamondon, R.: A kinematic theory of rapid human movements. Part I: Movement representation and generation Biological Cybernetics. 72, 295-307 (1995)). Depending on the modality with which the kinematic data is acquired, the data may represent any one of a position in space, velocity, and acceleration. According to the Kinematics Theory, the way in which neuromuscular systems are involved in the production of muscular movements is modelled using lognormal velocity profiles, which may be referred to as the Delta-lognormal or the Sigma- lognormal model. [0063] The handwriting sample corresponds to a plurality of positions in space of the tip of the stylus 106 or a finger of the hand 104, as a function of time. The positions may be derived with respect to time to obtain velocity. The velocity may be derived with respect to time to obtain acceleration. The Kinematic Theory of rapid human movements may be applied to the data obtained from the handwriting samples to extrapolate information about the subject and perform the neuromotor assessment.
[0064] The natural movement sample corresponds to an acceleration, which may be integrated over time to obtain velocity. The velocity may be integrated over time to obtain positions in space as a function of time. The Kinematic Theory of rapid human movements may be applied to the data obtained from the natural movement samples to extrapolate information about the subject and perform the motor assessment.
[0065] The speech data may be converted to a velocity profile (or a velocity signal). In some embodiments, the conversion is performed as described in Carmona, C., Plamondon, R., Gomez, P., Ferrer, M. A., Alonso, J. B., and Londral, A. R. (2016). “Application of the lognormal model to the vocal tract movement to detect neurological diseases in voice,” in Innovation in Medicine and Healthcare, Smart Innovation, Systems and Technologies, Vol. 60, eds Y. W. Chen, S. Tanaka, R. J. Howlett, and L. C. Jain (Cham: Springer International Publishing AG), 25-35. The velocity profile may be integrated over time to obtain positions in space as a function of time. The velocity profile may be derived with respect to time to obtain acceleration. The Kinematic Theory of rapid human movements may be applied to the data obtained from the speech samples to extrapolate information about the subject and perform the motor assessment.
[0066] The ability to obtain kinematic data from a subject, using different modalities, on a single device, allows comparative analyses to be performed that can draw parallels between information obtained from the different modalities. New information may be derived that would not otherwise be available. Neuromotor assessments of a subject can be performed in a more thorough and complete manner, providing a global perspective of the subject’s abilities both at the central and the peripheral level of his neuromotor control, based on information acquired in a synchronized and controlled environment.
[0067] Referring to Fig. 5, there is illustrated a method 500 of obtaining kinematic data from a subject, for neuromotor assessment of the subject. At step 502, at least two tasks of different modalities are presented on a mobile computing device, such as device 100. Any two tasks from a handwriting task, a speech task, and a natural movement task may be presented, each task executable by the subject with the mobile computing device.
[0068] At step 504, an external stimulus is provided through the mobile computing device as a trigger to begin each task. Although presented sequentially, it will be understood that steps 502 and 504 are performed iteratively, for example a first task is presented with a first external stimulus, followed by a second task with a second external stimulus, etc. As indicated above, the tasks may be presented in a specific and predetermined order and/or manner.
[0069] At step 506, kinematic data is acquired from the subject on the mobile computing device as the tasks are being performed. For example, kinematic data is acquired from the touchscreen display 102 during handwriting tasks, from the microphone 108 during speech tasks, and from the accelerometer 110 during natural movement tasks.
[0070] At 508, a file is generated with the kinematic data together with subject data. In some embodiments, the file is transmitted to a remote location at step 510 for further processing. In some embodiments, the method 500 comprises a step 512 of processing the kinematic data to get parameters that characterize a neuromotor performance of the subject. The processing of step 512 is performed remotely when step 510 is also performed, and is performed locally when step 510 is omitted. In some embodiments, the processing step 512 is performed locally and the data is also transmitted to a remote location at step 510. In some embodiments step 508 is omitted and the processing step 512 is performed locally.
[0071] The kinematic data may be processed in a same manner independently of a source of the kinematic data, such that data obtained from the handwriting task, the speech tasks, and the natural movement task is treated in a coherent and uniform manner. In some embodiments, processing the kinematic data comprises decomposing complex movements represented by the kinematic data into simple movements, for example by applying the Kinematics Theory of rapid human movements. This may be done using Sigma-lognormals or other models having similar characteristics. Other embodiments may also apply for decomposing the complex movements into simple movements. Simple movements may be analyzed statically and a neuromotor performance of the subject may be characterized based on the analysis. [0072] Using the method 500, both the central controller and the peripheral executor of the brain may be studied simultaneously through the global perspective afforded from the acquisition of kinematic data using two or more modalities. Neuromotricity of subjects may thus be assessed optimally.
[0073] The above description is meant to be exemplary only, and one skilled in the art will recognize that changes may be made to the embodiments described without departing from the scope of the invention disclosed. For example, in some embodiments, the different tasks may be integrated or hidden, such as in a video game environment, to motivate subjects to use the system, particularly children, and to facilitate large data collection across large populations, opening the door to data mining and deep learning neuromotor assessments.
[0074] Still other modifications which fall within the scope of the present invention will be apparent to those skilled in the art, in light of a review of this disclosure. For example, although illustrated as a local application that resides on the mobile computing device 100, the program instructions 306 may reside in whole or in part remotely from the device 100. In some embodiments, an application is downloaded onto the device 100. In some embodiments, the features described herein are provided through the device 100 on a web-based platform.
[0075] Various aspects of the methods and devices for neuromotor assessment may be used alone, in combination, or in a variety of arrangements not specifically discussed in the embodiments described in the foregoing and is therefore not limited in its application to the details and arrangement of components set forth in the foregoing description or illustrated in the drawings. For example, aspects described in one embodiment may be combined in any manner with aspects described in other embodiments. The scope of the following claims should not be limited by the embodiments set forth in the examples, but should be given the broadest reasonable interpretation consistent with the description as a whole.

Claims

1. A method for obtaining kinematic data from a subject, the method comprising: presenting on a mobile computing device at least two tasks from: a handwriting task, a speech task, and a natural movement task, the at least two tasks executable by the subject with the mobile computing device; providing an external stimulus through the mobile computing device as a trigger to begin the at least two tasks; acquiring kinematic data from the subject on the mobile computing device as the at least two tasks are being performed; and generating a file with the kinematic data together with subject data.
2. The method of claim 1, further comprising processing the kinematic data to get parameters that characterize a neuromotor performance of the subject.
3. The method of claim 2, wherein processing the kinematic data comprises processing the kinematic data on the mobile computing device.
4. The method of claims 2 or 3, wherein processing the kinematic data comprises comparing and correlating data from different neuromotor groups acquired through the at least two tasks.
5. The method of any one of claims 2 to 4, wherein processing the kinematic data comprises: decomposing complex movements into simple movements; analyzing statically the simple movements; and characterizing the neuromotor performance of the subject based on the analyzing.
6. The method of any one of claims 1 to 5, wherein providing the external stimulus comprises providing a same external stimulus for the at least two tasks.
7. The method of any one of claims 1 to 6, wherein providing the external stimulus comprises signaling an end to the at least two tasks.
8. The method of any one of claims 1 to 7, further comprising transmitting the file with the kinematic data to a remote location.
9. The method of any one of claims 1 to 8, wherein the subject data comprises a hardware identifier for the mobile computing device.
10. The method of any one of claims 1 to 9, wherein the tasks are presented on the mobile device in accordance with at least one of a specific order and a complexity level.
11. A system for obtaining kinematic data from a subject, the system comprising: a processing unit; and a non-transitory computer readable medium having stored thereon program code executable by the processing unit for: presenting on a mobile computing device at least two tasks from: a handwriting task, a speech task, and a natural movement task, the at least two tasks executable by the subject with the mobile computing device; providing an external stimulus through the mobile computing device as a trigger to begin the at least two tasks; acquiring kinematic data from the subject on the mobile computing device as the at least two tasks are being performed; and generating a file with the kinematic data together with subject data.
12. The system of claim 11, wherein the program code is further executable for processing the kinematic data to get parameters that characterize a neuromotor performance of the subject.
13. The system of claim 12, wherein processing the kinematic data comprises processing the kinematic data on the mobile computing device.
14. The system of claims 12 or 13, wherein processing the kinematic data comprises comparing and correlating data from different neuromotor groups acquired through the at least two tasks.
15. The system of any one of claims 12 to 14, wherein processing the kinematic data comprises: decomposing complex movements into simple movements; analyzing statically the simple movements; and characterizing the neuromotor performance of the subject based on the analyzing.
16. The system of any one of claims 11 to 15, wherein providing the external stimulus comprises providing a same external stimulus for the at least two tasks.
17. The system of any one of claims 11 to 16, wherein providing the external stimulus comprises signaling an end to the at least two tasks.
18. The system of any one of claims 11 to 17, wherein the program code is further executable for transmitting the file with the kinematic data to a remote location.
19. The system of any one of claims 11 to 18, wherein the subject data comprises a hardware identifier for the mobile computing device.
20. The system of any one of claims 11 to 19, wherein the tasks are presented on the mobile device in accordance with at least one of a specific order and a complexity level.
PCT/CA2020/051372 2019-10-17 2020-10-14 Methods and systems for the acquisition of kinematic data for neuromotor assessment WO2021072531A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CA3157828A CA3157828A1 (en) 2019-10-17 2020-10-14 Methods and systems for the acquisition of kinematic data for neuromotor assessment

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201962916325P 2019-10-17 2019-10-17
US62/916,325 2019-10-17

Publications (1)

Publication Number Publication Date
WO2021072531A1 true WO2021072531A1 (en) 2021-04-22

Family

ID=75537297

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CA2020/051372 WO2021072531A1 (en) 2019-10-17 2020-10-14 Methods and systems for the acquisition of kinematic data for neuromotor assessment

Country Status (2)

Country Link
CA (1) CA3157828A1 (en)
WO (1) WO2021072531A1 (en)

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080152202A1 (en) * 2005-02-09 2008-06-26 Sc Softwin Srl System and Methods of Acquisition, Analysis and Authentication of the Handwritten Signature
US20100049095A1 (en) * 2008-03-14 2010-02-25 Stresscam Operations & Systems, Ltd. (c/o PHD Associates) Assessment of medical conditions by determining mobility
US20170061817A1 (en) * 2015-08-28 2017-03-02 Icuemotion, Llc System for movement skill analysis and skill augmentation and cueing
US20170109566A1 (en) * 2014-05-12 2017-04-20 The Johns Hopkins University Kinematic and morpometric analysis of digitized handwriting tracings
WO2017165717A1 (en) * 2016-03-23 2017-09-28 Canary Medical Inc. Implantable reporting processor for an alert implant
US20170296048A1 (en) * 2014-12-11 2017-10-19 Indian Institute of Technology, Gandhinagar Smart eye system for Visuomotor dysfunction diagnosis and its operant conditioning
WO2018093765A1 (en) * 2016-11-15 2018-05-24 Regents Of The University Of California Methods and apparatuses for improving peripheral nerve function
US20190009133A1 (en) * 2017-07-06 2019-01-10 Icuemotion Llc Systems and methods for data-driven movement skill training
EP3461403A1 (en) * 2017-09-29 2019-04-03 Koninklijke Philips N.V. A method and apparatus for assessing the mobility of a subject
US20190308017A1 (en) * 2011-11-11 2019-10-10 Neuroenabling Technologies, Inc. Transcutaneous neuromodulation system and methods of using same

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080152202A1 (en) * 2005-02-09 2008-06-26 Sc Softwin Srl System and Methods of Acquisition, Analysis and Authentication of the Handwritten Signature
US20100049095A1 (en) * 2008-03-14 2010-02-25 Stresscam Operations & Systems, Ltd. (c/o PHD Associates) Assessment of medical conditions by determining mobility
US20190308017A1 (en) * 2011-11-11 2019-10-10 Neuroenabling Technologies, Inc. Transcutaneous neuromodulation system and methods of using same
US20170109566A1 (en) * 2014-05-12 2017-04-20 The Johns Hopkins University Kinematic and morpometric analysis of digitized handwriting tracings
US20170296048A1 (en) * 2014-12-11 2017-10-19 Indian Institute of Technology, Gandhinagar Smart eye system for Visuomotor dysfunction diagnosis and its operant conditioning
US20170061817A1 (en) * 2015-08-28 2017-03-02 Icuemotion, Llc System for movement skill analysis and skill augmentation and cueing
WO2017165717A1 (en) * 2016-03-23 2017-09-28 Canary Medical Inc. Implantable reporting processor for an alert implant
WO2018093765A1 (en) * 2016-11-15 2018-05-24 Regents Of The University Of California Methods and apparatuses for improving peripheral nerve function
US20190009133A1 (en) * 2017-07-06 2019-01-10 Icuemotion Llc Systems and methods for data-driven movement skill training
EP3461403A1 (en) * 2017-09-29 2019-04-03 Koninklijke Philips N.V. A method and apparatus for assessing the mobility of a subject

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
CARMONA-DUARTE CRISTINA, PLAMONDON RÉJEAN, GÓMEZ-VILDA PEDRO, FERRER MIGUEL A., ALONSO JESÚS B., LONDRAL ANA RITA M.: "Application of the Lognormal Model to the Vocal Tract Movement to Detect Neurological Disease in Voice", INNOVATION IN MEDICINE AND HEALTHCARE 2016, SMART INNOVATION, SYSTEM AND TECHNOLOGIES, vol. 60, April 2016 (2016-04-01), pages 25 - 35, XP055816146 *
RÉJEAN PLAMONDON: "A kinematic theory of rapid human movements: Part 1. Movement representation and generation", BIOLOGICAL CYBERNETICS, vol. 72, 1995, pages 295 - 307, XP000946207, DOI: 10.1007/s004220050131 *
RÉJEAN PLAMONDON: "A kinematic theory of rapid human movements: Part II. Movement time and control", BIOLOGICAL CYBERNETICS, vol. 72, 1995, pages 309 - 320, XP055816147 *

Also Published As

Publication number Publication date
CA3157828A1 (en) 2021-04-22

Similar Documents

Publication Publication Date Title
Butt et al. Objective and automatic classification of Parkinson disease with Leap Motion controller
Greene et al. A survey of affective computing for stress detection: Evaluating technologies in stress detection for better health
US11723582B2 (en) Non-invasive and non-contact measurement in early therapeutic intervention
RU2603047C2 (en) System and methods for medical use of motion imaging and capture
US20190239795A1 (en) Emotion estimation apparatus, method, and program
EP3355761B1 (en) Emotional/behavioural/psychological state estimation system
CN109996485B (en) Platform for implementing signal detection metrics during adaptive reaction-deadline
KR20200074951A (en) Machine learning-based system for identification and monitoring of nervous system disorders
US20150208975A1 (en) System and Method for Target Independent Neuromotor Analytics
CN105592798A (en) System and signatures for multi-modal physiological stimulation and assessment of brain health
JP2022506651A (en) Facial expression detection for screening and treatment of emotional disorders
Wang et al. Literature review on wearable systems in upper extremity rehabilitation
JP7442596B2 (en) Platform for Biomarker Identification Using Navigation Tasks and Treatment Using Navigation Tasks
Gordienko et al. Deep learning for fatigue estimation on the basis of multimodal human-machine interactions
JP2022502789A (en) A cognitive platform for deriving effort metrics to optimize cognitive treatment
Mimouna et al. A survey of human action recognition using accelerometer data
Mesanza et al. Machine learning based fall detector with a sensorized tip
WO2021072531A1 (en) Methods and systems for the acquisition of kinematic data for neuromotor assessment
Cavallo et al. A low-cost stand-alone platform for measuring motor behavior across developmental applications
López-Nava et al. Variability analysis of therapeutic movements using wearable inertial sensors
Trujillo-Guerrero et al. Accuracy comparison of CNN, LSTM, and Transformer for activity recognition using IMU and visual markers
Bleser et al. Human motion capturing and activity recognition using wearable sensor networks
Nutakki et al. Correlations of gait phase kinematics and cortical EEG: modelling human gait with data from sensors
Choi et al. A Mobile Application for a Daily Assessment of Forearm Pronation and Supination Motor Activities as an Early Diagnostic Tool of Parkinson's Disease
KR102048546B1 (en) System and Method for rehabilitation training using Virtual reality device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20875866

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 3157828

Country of ref document: CA

WWE Wipo information: entry into national phase

Ref document number: 17768623

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20875866

Country of ref document: EP

Kind code of ref document: A1